-- Logs begin at Sat 2021-11-27 20:01:15 UTC, end at Sat 2021-11-27 22:28:30 UTC. -- Nov 27 20:35:08.941215 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Nov 27 20:35:08.950927 ncdv-master-1 devstack@n-api.service[120213]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 27 20:35:08 2021] *** Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: nodename: ncdv-master-1 Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: machine: x86_64 Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: clock source: unix Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: pcre jit disabled Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: detected number of CPU cores: 4 Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: current working directory: / Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: detected binary path: /usr/bin/uwsgi-core Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: your processes number limit is 47680 Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: your memory page size is 4096 bytes Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: detected max file descriptor number: 2048 Nov 27 20:35:08.953726 ncdv-master-1 devstack@n-api.service[120213]: lock engine: pthread robust mutexes Nov 27 20:35:08.954939 ncdv-master-1 devstack@n-api.service[120213]: thunder lock: enabled Nov 27 20:35:08.954939 ncdv-master-1 devstack@n-api.service[120213]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 27 20:35:08.954939 ncdv-master-1 devstack@n-api.service[120213]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 27 20:35:09.007817 ncdv-master-1 devstack@n-api.service[120213]: Python main interpreter initialized at 0x561e7b4389c0 Nov 27 20:35:09.007817 ncdv-master-1 devstack@n-api.service[120213]: python threads support enabled Nov 27 20:35:09.007817 ncdv-master-1 devstack@n-api.service[120213]: your server socket listen backlog is limited to 100 connections Nov 27 20:35:09.007817 ncdv-master-1 devstack@n-api.service[120213]: your mercy for graceful operations on workers is 90 seconds Nov 27 20:35:09.008197 ncdv-master-1 devstack@n-api.service[120213]: mapped 403077 bytes (393 KB) for 2 cores Nov 27 20:35:09.008276 ncdv-master-1 devstack@n-api.service[120213]: *** Operational MODE: preforking *** Nov 27 20:35:09.008486 ncdv-master-1 devstack@n-api.service[120213]: *** uWSGI is running in multiple interpreter mode *** Nov 27 20:35:09.008486 ncdv-master-1 devstack@n-api.service[120213]: spawned uWSGI master process (pid: 120213) Nov 27 20:35:09.008699 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Nov 27 20:35:09.013298 ncdv-master-1 devstack@n-api.service[120213]: spawned uWSGI worker 1 (pid: 120214, cores: 1) Nov 27 20:35:09.013298 ncdv-master-1 devstack@n-api.service[120213]: spawned uWSGI worker 2 (pid: 120215, cores: 1) Nov 27 20:35:09.013298 ncdv-master-1 devstack@n-api.service[120213]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 27 20:35:10.802035 ncdv-master-1 devstack@n-api.service[120214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:35:10.802035 ncdv-master-1 devstack@n-api.service[120214]: from cryptography.utils import int_from_bytes Nov 27 20:35:10.802728 ncdv-master-1 devstack@n-api.service[120214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:35:10.802728 ncdv-master-1 devstack@n-api.service[120214]: from cryptography.utils import int_from_bytes Nov 27 20:35:10.802849 ncdv-master-1 devstack@n-api.service[120215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:35:10.802849 ncdv-master-1 devstack@n-api.service[120215]: from cryptography.utils import int_from_bytes Nov 27 20:35:10.802849 ncdv-master-1 devstack@n-api.service[120215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:35:10.802849 ncdv-master-1 devstack@n-api.service[120215]: from cryptography.utils import int_from_bytes Nov 27 20:35:13.391211 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 27 20:35:13.391901 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 27 20:35:13.391994 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 27 20:35:13.392355 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 27 20:35:13.392430 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 27 20:35:13.392498 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 27 20:35:13.392567 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 27 20:35:13.392641 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 27 20:35:13.392828 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 27 20:35:13.392935 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.393068 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 27 20:35:13.393233 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.393456 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.393553 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.393789 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.393928 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.394111 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.394214 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.394435 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.394547 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.394757 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.394852 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.395067 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.395171 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.395416 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.395509 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.395675 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.395763 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.395987 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.396090 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.396304 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.396392 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.396623 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.396712 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.396928 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.397037 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.397236 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.397327 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.397551 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.397647 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.397858 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.397969 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.398168 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.398259 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.398468 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.398567 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.398789 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.398964 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.399077 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.400270 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.400549 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.400764 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.400945 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.401135 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.401345 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.401550 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.401739 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.401945 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.402148 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.402336 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.402542 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.402731 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.402917 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.403122 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.403322 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.403512 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.403739 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.403928 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.404116 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.404316 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.405083 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.405278 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.405467 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.405640 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.405795 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.405923 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.406081 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.406224 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.406392 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.406516 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.406642 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.406787 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.406926 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.407090 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.407225 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.407388 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.407531 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.407662 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.407788 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.407932 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.408070 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.408197 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.408338 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.408500 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.408630 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.408759 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.408885 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409020 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409147 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409273 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409398 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409524 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409657 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409803 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.409930 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410062 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410199 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410326 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410458 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410598 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410726 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410853 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.410979 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411166 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411325 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411467 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411604 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411731 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411870 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411997 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.411997 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.412248 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.412248 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.412503 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.412629 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.412768 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.412904 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413031 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413163 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413298 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413432 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413573 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413707 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413834 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.413967 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.414101 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.414228 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.414366 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.414489 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.414614 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.414746 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.414879 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415023 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415151 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415302 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415430 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415556 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415682 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415821 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.415956 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.416091 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.416224 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.416351 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.416482 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.416689 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.416829 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.416829 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417067 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417067 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417317 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417457 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417584 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417584 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417809 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.417936 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418060 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418060 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418312 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418312 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418568 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418695 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418830 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.418956 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419082 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419209 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419350 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419350 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419617 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419617 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419860 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.419986 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.420152 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.420280 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.420419 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.420547 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.420679 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.420805 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.420930 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.421056 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.421193 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.421363 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.421494 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.421669 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.421799 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.421974 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.422105 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.422280 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.422411 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.422584 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.422712 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.422886 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.423016 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.423191 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.423748 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.423871 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.423978 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424101 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424226 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424334 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424449 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424557 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424672 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424803 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.424911 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.425018 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.425131 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.425287 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.425410 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.425593 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.425710 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.425897 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.426021 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.426202 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.426327 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.426508 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.426639 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.426819 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.426950 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.427120 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.427309 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.427440 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.427580 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.427759 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.427900 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.428064 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.428193 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.428367 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.428504 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.428683 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.428812 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.428989 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.429130 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.429294 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.429425 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.429599 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.429729 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.429900 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.430041 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.430207 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.430338 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.430505 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.430633 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.430812 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.430956 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.431114 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.431273 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.431441 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.431573 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.431744 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.431884 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.432053 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.432183 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.432356 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.432495 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.432658 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.432796 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.432958 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.433094 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.433257 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.433388 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.433559 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.433714 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.433844 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.433978 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.434165 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.434295 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.434469 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.434604 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.434772 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.434912 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.435078 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.435207 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.435409 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.435548 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.435763 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:35:13.435894 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.436100 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.436231 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.436411 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.436541 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.436742 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.436881 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.437064 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.437203 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.437378 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.437515 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.437687 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.437824 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.437997 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.438139 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.438319 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.438448 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.438626 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.438762 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.438935 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.439075 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.439242 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.439404 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.439577 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.439712 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.439891 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.440021 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.440209 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.440338 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.440519 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.440752 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.441280 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.441419 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.441531 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.441639 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.441745 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.441852 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.441971 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442088 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442205 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442322 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442431 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442537 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442653 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442763 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.442978 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.443103 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.443318 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.443438 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.443639 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.443763 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.443962 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.444095 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.444267 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.444403 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.444583 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.444715 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.444895 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.445033 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.445205 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.445343 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.445516 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.445645 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.445827 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.445955 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.446135 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.446273 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.446443 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.446574 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.447246 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.447455 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.447596 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.447724 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.447724 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.447961 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.448094 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.448220 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.448378 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.448506 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.448632 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.448757 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.448893 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449027 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449162 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449289 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449421 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449550 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449677 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449815 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.449942 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450066 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450200 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450328 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450461 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450595 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450724 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450849 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.450975 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.451107 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.451233 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.451888 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.452073 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.452212 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.452380 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.452512 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.452683 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.452824 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.453005 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.453136 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.453314 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.453446 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.453620 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.453752 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.453933 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.454078 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.454235 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.454364 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.454539 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.454678 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.454846 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.454984 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.455153 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.455352 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.455491 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.455627 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.455785 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.455917 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.456093 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.456222 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.456406 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.456536 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.456717 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.456854 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.457029 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.457167 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.457343 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.457481 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.457652 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.457788 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.457978 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.458111 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.458292 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.458420 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.458595 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.458711 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.459100 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.459269 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.459410 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.459539 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.459666 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.459792 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.459926 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.460062 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.460195 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.460322 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.460456 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.460628 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.460766 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.460901 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461029 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461165 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461300 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461428 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461563 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461700 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461836 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.461970 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.462124 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.462264 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.462430 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.462570 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.462733 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.462872 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.463036 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.463167 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.463346 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.463477 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.463689 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.463820 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.464035 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.464178 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.464377 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.464506 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.464685 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.464823 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.465017 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.465222 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.465354 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.465481 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.465636 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.465775 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.465951 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.466095 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.466260 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.466392 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.466572 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.466712 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.466904 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.467796 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.468113 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.468466 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.468795 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.469114 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.469314 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.469447 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.469683 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.469816 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.470014 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.470145 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.470336 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.470468 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.470664 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.470794 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.470970 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.471098 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.471335 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.471471 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.471657 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.471790 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.471995 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.472126 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.472300 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.472437 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.472618 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.472749 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.472930 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.473068 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.473248 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.473386 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.473561 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.473691 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.473875 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.474020 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.474184 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.474314 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.474493 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.474622 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.474790 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.474928 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.475094 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.475225 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.475428 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.475571 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.475738 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.475883 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.476053 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.476184 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.476363 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.476491 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.476676 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.476818 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.476979 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.477107 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.477294 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.477432 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.477600 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.477738 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.477917 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.478050 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.478217 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.478356 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.478526 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.478658 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.478852 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.478983 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.479164 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.479314 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.479503 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.479635 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.479818 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.479948 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.480125 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.480255 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.480432 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.480562 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.480841 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.480992 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.481122 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.481258 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.481386 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.481521 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.481656 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.481783 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.481931 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.482072 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.482244 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.482375 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.482575 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.482708 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.482886 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.483026 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.483189 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.483381 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.483509 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.483634 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.483820 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.483961 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.484124 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.484257 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.484431 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.484562 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.484740 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.484872 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.485051 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.485188 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.485355 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.485487 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.485674 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.485804 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.485983 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.486113 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.486283 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.486413 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.486585 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.486717 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.486888 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.487039 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.487200 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.487351 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.487530 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.487670 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.487835 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.487967 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.488139 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.488283 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.488463 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.488600 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.488774 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.488905 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.489058 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.489196 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.489376 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.489516 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.489687 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.489816 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.489994 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.490132 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.490306 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.490437 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.490613 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.490745 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.490955 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.491128 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.491283 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.491411 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.491560 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.491689 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.491869 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.492076 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.492214 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.492343 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.492470 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.492599 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.492772 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.492912 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.493063 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.493198 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.493380 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.493509 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.493686 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.493816 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.493996 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.494126 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.494309 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.494577 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.494718 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.494906 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.495043 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.495220 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.495404 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.495566 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.495809 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.495951 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.496143 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.496274 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.496459 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.496600 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.496776 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.496908 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.497096 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.497220 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.497413 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.497555 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.497738 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.497870 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.498046 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.498197 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.498645 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.498788 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.498952 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.499083 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.499281 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.499413 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.499586 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.499723 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.499890 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.500022 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.500223 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.500356 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.500493 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.500627 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.500795 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.500934 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.501099 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.501231 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.501407 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.501539 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.501709 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.501855 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.502009 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.502140 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.502319 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.502458 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.502625 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.502756 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.502938 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.503077 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.503240 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.503398 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.503572 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.503702 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.503871 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.503999 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.504175 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.504304 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.504490 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.504631 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.504792 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.504923 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.505095 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.505227 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.505396 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.505534 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.505737 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.505876 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.506040 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.506181 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.506366 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.506503 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.506689 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.506818 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.506993 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.507132 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.507305 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.507435 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.507618 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.507758 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.507944 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.508087 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.508216 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.508344 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.508519 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.508650 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.508818 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.508959 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.509123 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.509262 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.509430 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.509559 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.509727 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.509858 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.510034 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.510171 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.510339 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.510471 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.510643 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.510780 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.510945 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.511076 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.511246 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.511388 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.511573 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.511714 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.511872 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.512005 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.512180 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.512310 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.512482 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.512620 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.512780 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.512912 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.513078 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.513220 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.513379 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.513508 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.513681 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.514386 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.514518 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.514658 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.514816 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.514948 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.515116 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.515307 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.515444 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.515583 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.515744 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.515873 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.516045 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.516175 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.516343 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.516481 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.516649 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.516782 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.516955 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.517093 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.517255 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.517410 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.517567 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.517699 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.517871 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.518009 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.518171 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.518308 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.518469 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.518607 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.518774 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.518906 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.519074 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.519206 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.519392 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.519523 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.519691 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.519822 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.520022 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.520150 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.520284 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.520419 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.520624 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.520770 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.520900 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.521033 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.521168 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.521286 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.521474 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.521618 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.521777 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.521915 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.522079 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.522216 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.522378 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.522519 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.522678 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.522809 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.522977 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.523115 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.523299 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.523448 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.523601 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.523731 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.523903 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.524032 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.524210 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.524339 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.524516 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.524647 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.524819 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.524957 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.525117 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.525249 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.525456 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.525587 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.525756 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.525887 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.526092 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.526223 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.526397 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.526532 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.526711 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.526839 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.527020 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.527151 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.527350 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.527480 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.527663 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.527794 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.527975 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.528114 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.528278 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.528407 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.528586 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.528758 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.528888 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.529014 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.529192 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.529325 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.530328 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.530482 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.530482 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.530726 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.530853 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.530980 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.531152 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.531327 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.531619 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.531768 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.532111 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.532247 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.532443 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.532692 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.533175 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.533927 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.534141 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.534440 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.534583 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.534819 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.534940 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.535153 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.535296 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.535815 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.535977 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.536219 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.536542 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.536674 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.537065 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.537203 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.537639 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.537773 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.537990 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.538208 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.538346 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.538637 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.538776 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.538986 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.539116 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.539338 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.539485 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.539659 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.539793 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.539985 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.540117 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.540304 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.540444 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.540627 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.540767 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.540942 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.541080 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.541374 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.541496 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.541710 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.541846 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.542017 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.542149 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.542334 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.542465 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.542655 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.542794 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.542974 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.543168 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.543326 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.543516 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.543656 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.543835 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.543974 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.544275 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.544691 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.544830 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.544959 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.545111 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.545246 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.545374 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.545508 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.545644 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.545779 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.545906 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.546033 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.546204 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.546334 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.546538 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.546703 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.546853 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.546991 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.547164 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.547342 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.547498 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.547627 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.547805 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.547946 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.548120 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.548262 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.548447 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.548582 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.548754 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.548883 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.549062 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.549202 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.549369 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.549500 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.549697 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.549879 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.550012 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.550195 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.550328 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.550508 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.550727 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.550859 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.551043 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.551184 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.551381 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.551513 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.551819 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.551961 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.552103 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.552231 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.552403 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.552534 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.552725 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.552856 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.553051 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.553181 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.553366 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.553498 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.553672 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.553802 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.553978 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.554108 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.554286 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.554415 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.554610 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.554750 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.554923 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.555051 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.555233 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.555400 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.555570 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.555718 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.555877 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.556007 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.556208 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.556339 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.556531 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.556675 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.556847 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.556999 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.557170 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.557303 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.557500 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.557631 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.557814 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.557957 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.558123 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.558255 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.558483 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.558620 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.558756 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.558893 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.559050 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.559181 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.559390 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.559522 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.559706 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.559838 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.560010 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.560138 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.560892 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.561024 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.561321 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.561450 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.561450 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.561657 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.561767 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.561903 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.562124 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.562259 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.562396 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.562538 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.562668 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.562800 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.562943 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.563072 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.563209 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.563380 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.563521 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.563660 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.563790 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.563931 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564066 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564195 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564324 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564464 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564595 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564723 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564852 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.564989 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.565120 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.565257 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.565394 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.565534 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.565664 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.565799 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.565929 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.566067 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.566204 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.566340 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.566477 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.566607 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.566745 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.566885 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.567015 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.567155 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.567323 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.567495 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.567707 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.567838 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.567956 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.568114 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.568256 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.568421 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.568563 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.568733 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.568872 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.569043 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.569177 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.569355 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.569497 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.569662 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.569813 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.569975 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.570116 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.570281 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.570415 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.570583 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.570714 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.570886 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.571028 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.571189 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.571368 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.571510 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.571649 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.571816 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.571950 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.572107 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.572242 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.572407 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.572539 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.572728 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.572861 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.573030 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.573170 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.573351 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.573492 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.573657 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.573803 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.573961 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.574094 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.574267 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.574401 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.574569 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.574773 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.574946 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.575076 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.575205 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.575376 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.575545 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.575687 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.575861 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.576003 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.576180 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.576838 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.577037 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.577180 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.577347 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.577477 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.577661 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.577791 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.577976 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.578111 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.578285 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.578428 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.578594 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.578733 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.578907 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.579038 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.579222 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.579411 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.579564 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.579703 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.579875 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.580108 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.580243 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.580439 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.580582 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.580756 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.580935 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.581059 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.581186 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.581370 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.581596 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.581739 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.581924 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.582055 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.582238 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.582369 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.582549 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.582694 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.582860 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.583000 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.583174 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.583335 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.583512 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.583653 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.583822 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.583955 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.584130 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.584289 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.584436 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.584565 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.584735 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.584875 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.585044 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.585176 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.585365 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.585498 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.585689 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.585822 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.586022 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.586154 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.586337 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.586470 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.586643 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.586781 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.586957 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.587097 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.587287 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.587434 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.587610 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.587741 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.587925 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.588067 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.588240 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.588372 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.588553 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.588683 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.588866 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.589006 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.589176 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.589315 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.589483 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.589614 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.589792 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.589923 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.590105 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.590245 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.590417 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.590549 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.590726 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.590859 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.591034 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.591159 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.591368 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.591514 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.591682 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.591822 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.592558 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.592692 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.592926 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.593088 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.593234 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.593408 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.593540 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.593746 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.593878 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.594079 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.594212 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.594409 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.594657 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.594789 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.594973 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.595106 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.595334 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.595482 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.595665 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.595798 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.595970 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.596101 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.596286 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.596419 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.596597 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.596729 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.596902 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.597036 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.597220 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.597357 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.597525 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.597657 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.597829 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.597960 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.598135 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.598267 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.598439 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.598582 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.598760 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.598968 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.599109 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.599345 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.599491 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.599665 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.599799 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.599983 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.600113 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.600308 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.600509 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.600660 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.600854 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.600985 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.601167 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.601312 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.601489 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.601630 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.601812 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.601954 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.602125 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.602257 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.602430 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.602563 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.602741 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.602872 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.603043 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.603179 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.603422 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.603564 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.603694 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.603823 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.603951 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.604086 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.604255 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.604394 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.604556 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.604688 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.604864 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.604996 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.605201 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.605347 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.605511 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.605650 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.605778 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.605915 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.606051 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.606186 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.606341 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.606475 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.606640 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.606779 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.606945 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.607076 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.607244 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.607393 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.607604 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.607751 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.607909 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.608049 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.608210 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.608342 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.608512 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.608651 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.608809 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.608939 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.609116 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.609248 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.609416 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.609548 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.609718 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.609840 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.610015 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.610154 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.610324 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.610457 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.610626 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.610763 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.610929 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.611060 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.611230 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.611426 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.611575 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.611708 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.611878 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.612022 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.612166 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.612296 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.612478 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.612610 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.612784 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.612925 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.613103 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.613348 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.613481 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.613705 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.613835 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.614039 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.614171 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.614351 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.614528 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.614709 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.614877 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.615019 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.615274 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.615422 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.615595 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.615729 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.615935 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.616076 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.616245 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.616377 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.616558 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.616690 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.616866 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.616998 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.617169 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.617309 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.617478 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.617612 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.617785 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.617916 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.618094 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.618238 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.618401 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.618524 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.618710 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.618840 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.619015 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.619146 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.619357 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.619510 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.619666 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.619799 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.619972 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.620103 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.620278 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.620423 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.620591 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.620725 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.620901 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.621031 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.621214 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.621356 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.621527 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.621660 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.621837 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.621968 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.622154 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.622293 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.622460 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.622590 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.622768 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.622900 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.623076 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.623764 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.623939 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.624072 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.624254 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.624394 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.624585 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.624721 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.624896 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.625028 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.625200 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.625342 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.625570 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.625701 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.625894 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.626034 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.626207 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.626353 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.626523 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.626665 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.626832 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.626964 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.627159 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.627325 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.627504 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.627635 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.627816 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.627949 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.628135 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.628268 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.628446 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.628585 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.628750 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.628889 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.629057 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.629193 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.629365 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.629506 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.629693 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.629825 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.630000 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.630132 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.630302 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.630434 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.630604 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.630728 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.630909 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.631051 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.631236 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.631462 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.631594 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.631729 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.631880 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.632011 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.632202 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.632334 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.632510 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.632648 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.632822 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.632952 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.633125 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.633255 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.633444 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.633586 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.633752 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.633884 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.634064 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.634197 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.634370 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.634577 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.634708 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.634836 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.634963 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.635091 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.635305 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.635443 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.635615 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.635747 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.635922 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.636054 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.636228 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.636362 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.636535 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.636666 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.636852 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.636982 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.637167 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.637301 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.637469 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.637599 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.637791 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.637931 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.638102 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.638233 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.638418 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.638550 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.638741 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.638913 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.639094 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.639225 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.639442 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.639576 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.639754 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.639894 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.640070 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.640206 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.640382 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.640523 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.640694 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.640827 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.641010 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.641148 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.641368 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.641509 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.641637 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.641764 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.641957 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.642090 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.642283 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.642415 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.642597 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.642729 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.642911 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.643053 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.643223 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.643414 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.643556 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 27 20:35:13.643688 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.643900 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.644211 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.644523 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.644824 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:35:13.645067 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 27 20:35:13.666391 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_db.sqlalchemy.engines [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:13.667561 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:13.735204 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.context [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=120215) load_cells /opt/stack/nova/nova/context.py:464}} Nov 27 20:35:13.735510 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.context [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=120214) load_cells /opt/stack/nova/nova/context.py:464}} Nov 27 20:35:13.740021 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:35:13.740177 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_concurrency.lockutils [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:35:13.741638 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:35:13.741778 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_concurrency.lockutils [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:35:13.742457 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:35:13.742586 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_concurrency.lockutils [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:35:13.744413 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:35:13.744539 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_concurrency.lockutils [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:35:13.755002 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_db.sqlalchemy.engines [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:13.757507 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_db.sqlalchemy.engines [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:13.760663 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:13.767073 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:13.917314 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_db.sqlalchemy.engines [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:13.923639 ncdv-master-1 devstack@n-api.service[120214]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:35:14.260921 ncdv-master-1 devstack@n-api.service[120214]: WARNING keystonemiddleware.auth_token [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:35:14.267593 ncdv-master-1 devstack@n-api.service[120214]: WARNING keystonemiddleware.auth_token [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:35:14.267886 ncdv-master-1 devstack@n-api.service[120215]: WARNING keystonemiddleware.auth_token [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:35:14.274623 ncdv-master-1 devstack@n-api.service[120215]: WARNING keystonemiddleware.auth_token [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:35:14.605418 ncdv-master-1 devstack@n-api.service[120214]: WARNING keystonemiddleware.auth_token [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:35:14.610652 ncdv-master-1 devstack@n-api.service[120214]: WARNING keystonemiddleware.auth_token [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:35:14.615805 ncdv-master-1 devstack@n-api.service[120214]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e7b4389c0 pid: 120214 (default app) Nov 27 20:35:14.616188 ncdv-master-1 devstack@n-api.service[120215]: WARNING keystonemiddleware.auth_token [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:35:14.617864 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:35:14.619045 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Nov 27 20:35:14.619487 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 788 bytes} [Sat Nov 27 20:35:14 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:35:14.621425 ncdv-master-1 devstack@n-api.service[120215]: WARNING keystonemiddleware.auth_token [None req-69769413-d475-4ae4-b15f-c0a4b7155019 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:35:14.628364 ncdv-master-1 devstack@n-api.service[120215]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561e7b4389c0 pid: 120215 (default app) Nov 27 20:36:38.862579 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:38.863676 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 27 20:36:38.864071 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:39.294147 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-2598d411-a995-4017-9940-1cec9211679f admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:39.323823 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-2598d411-a995-4017-9940-1cec9211679f admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452278 Nov 27 20:36:39.325280 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 1/3] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 20:36:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:36:41.824965 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:41.825938 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-1f9937c7-d51a-4bee-a030-d6cf5f880c2c None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 27 20:36:41.826331 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 3/4] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:41.889393 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-5df890da-d4a6-430d-b2f1-2a3eb84a5a06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:41.908911 ncdv-master-1 devstack@n-api.service[120215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:36:41.908911 ncdv-master-1 devstack@n-api.service[120215]: warnings.warn(msg) Nov 27 20:36:41.949951 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-5df890da-d4a6-430d-b2f1-2a3eb84a5a06 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116648 Nov 27 20:36:41.951055 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 2/5] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:36:41 2021] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:36:42.168904 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-7a3035cf-dfff-47f1-a28e-0bd627968d69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:42.171280 ncdv-master-1 devstack@n-api.service[120214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:36:42.171280 ncdv-master-1 devstack@n-api.service[120214]: warnings.warn(msg) Nov 27 20:36:42.229254 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-7a3035cf-dfff-47f1-a28e-0bd627968d69 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.269983 Nov 27 20:36:42.231411 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 4/6] 10.222.0.21 () {64 vars in 1335 bytes} [Sat Nov 27 20:36:41 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:36:44.696566 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-5df890da-d4a6-430d-b2f1-2a3eb84a5a06 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:44.697644 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-5df890da-d4a6-430d-b2f1-2a3eb84a5a06 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Nov 27 20:36:44.698177 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 3/7] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:44.815353 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-b9b614e1-d6a4-46c3-b968-d748f863e880 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:44.834296 ncdv-master-1 devstack@n-api.service[120214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:36:44.834296 ncdv-master-1 devstack@n-api.service[120214]: warnings.warn(msg) Nov 27 20:36:44.854142 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-b9b614e1-d6a4-46c3-b968-d748f863e880 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148627 Nov 27 20:36:44.854783 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 5/8] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:36:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:36:44.868351 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-e18eed9c-ebe1-4ea5-8ea2-b3f3c5736082 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:44.869939 ncdv-master-1 devstack@n-api.service[120215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:36:44.869939 ncdv-master-1 devstack@n-api.service[120215]: warnings.warn(msg) Nov 27 20:36:44.905215 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-e18eed9c-ebe1-4ea5-8ea2-b3f3c5736082 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040447 Nov 27 20:36:44.906045 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 4/9] 10.222.0.21 () {64 vars in 1335 bytes} [Sat Nov 27 20:36:44 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:36:47.492841 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-b9b614e1-d6a4-46c3-b968-d748f863e880 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:47.493910 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-b9b614e1-d6a4-46c3-b968-d748f863e880 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Nov 27 20:36:47.494470 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:47.564755 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-fc877323-c3ac-43b9-85a0-f91f76a6b74d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "vcpus": 1, "ram": 1024, "swap": 0}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:47.592755 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-fc877323-c3ac-43b9-85a0-f91f76a6b74d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090865 Nov 27 20:36:47.593991 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 5/11] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:36:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:36:47.606915 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-38100dae-6105-4415-9afc-fbdf9645f603 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:47.641493 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-38100dae-6105-4415-9afc-fbdf9645f603 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038042 Nov 27 20:36:47.642191 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 7/12] 10.222.0.21 () {64 vars in 1335 bytes} [Sat Nov 27 20:36:47 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:36:50.388605 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-fc877323-c3ac-43b9-85a0-f91f76a6b74d admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:50.389735 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-fc877323-c3ac-43b9-85a0-f91f76a6b74d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Nov 27 20:36:50.391576 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 6/13] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:50 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:50.475690 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-5cd5a23a-e2a9-495c-be53-7a5dee4f7310 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:50.504676 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-5cd5a23a-e2a9-495c-be53-7a5dee4f7310 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107687 Nov 27 20:36:50.518678 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-070fd408-8990-4ecc-bf43-c182c583af38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:50.523989 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 8/14] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:36:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:36:50.548804 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-070fd408-8990-4ecc-bf43-c182c583af38 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030952 Nov 27 20:36:50.551719 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 7/15] 10.222.0.21 () {64 vars in 1335 bytes} [Sat Nov 27 20:36:50 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:36:53.065003 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-5cd5a23a-e2a9-495c-be53-7a5dee4f7310 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:53.066001 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-5cd5a23a-e2a9-495c-be53-7a5dee4f7310 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 27 20:36:53.066566 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 9/16] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:53.127658 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-809a6976-9f73-4c85-98cf-a1e2104832e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "vcpus": 4, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:53.146795 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-809a6976-9f73-4c85-98cf-a1e2104832e9 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074051 Nov 27 20:36:53.147493 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 8/17] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:36:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:36:53.160237 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-057c1a8a-8439-45e3-8298-bf09aa03f4f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:53.185780 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-057c1a8a-8439-45e3-8298-bf09aa03f4f1 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029182 Nov 27 20:36:53.186356 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 10/18] 10.222.0.21 () {64 vars in 1335 bytes} [Sat Nov 27 20:36:53 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:36:55.669104 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-809a6976-9f73-4c85-98cf-a1e2104832e9 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:55.670108 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-809a6976-9f73-4c85-98cf-a1e2104832e9 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 27 20:36:55.670506 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 9/19] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:55.730009 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-e7472c61-4f24-43e9-9a20-121953868454 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:55.754722 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-e7472c61-4f24-43e9-9a20-121953868454 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077746 Nov 27 20:36:55.758254 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 11/20] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 20:36:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:36:58.283592 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-809a6976-9f73-4c85-98cf-a1e2104832e9 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:36:58.284817 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-809a6976-9f73-4c85-98cf-a1e2104832e9 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Nov 27 20:36:58.287471 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:36:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:36:58.352054 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-b1399d5d-db0d-4c19-ad35-38d61be7e2f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:58.384202 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-b1399d5d-db0d-4c19-ad35-38d61be7e2f5 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.092154 Nov 27 20:36:58.386602 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 12/22] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:36:58 2021] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:36:58.399362 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-211af9fb-6332-46f1-be70-588ce3e2d450 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:36:58.436192 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-211af9fb-6332-46f1-be70-588ce3e2d450 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040487 Nov 27 20:36:58.437162 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 11/23] 10.222.0.21 () {64 vars in 1332 bytes} [Sat Nov 27 20:36:58 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:37:01.212922 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-b1399d5d-db0d-4c19-ad35-38d61be7e2f5 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:01.214780 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-b1399d5d-db0d-4c19-ad35-38d61be7e2f5 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002483 Nov 27 20:37:01.215561 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:37:01 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:01.280739 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-7ca6ad78-9337-4912-b02c-0a2b57468ef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:01.299708 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-7ca6ad78-9337-4912-b02c-0a2b57468ef4 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077763 Nov 27 20:37:01.300257 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 12/25] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:37:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:37:01.315861 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-a123eda9-a3af-45ef-9180-42232114cabc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:01.346091 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-a123eda9-a3af-45ef-9180-42232114cabc admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035788 Nov 27 20:37:01.350113 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 14/26] 10.222.0.21 () {64 vars in 1332 bytes} [Sat Nov 27 20:37:01 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:37:04.286743 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-7ca6ad78-9337-4912-b02c-0a2b57468ef4 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:04.288039 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-7ca6ad78-9337-4912-b02c-0a2b57468ef4 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Nov 27 20:37:04.288303 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 13/27] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:37:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:04.368165 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-c592dadb-7c77-44fd-afe6-8b27696ca19d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:04.396346 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-c592dadb-7c77-44fd-afe6-8b27696ca19d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.100006 Nov 27 20:37:04.397154 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 15/28] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:37:04 2021] POST /compute/v2.1/flavors => generated 406 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:37:04.410113 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-0ca7a478-02fa-4a73-b8d7-272e42c774bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:04.434454 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-0ca7a478-02fa-4a73-b8d7-272e42c774bb admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027921 Nov 27 20:37:04.435071 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1332 bytes} [Sat Nov 27 20:37:04 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:37:06.916521 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-c592dadb-7c77-44fd-afe6-8b27696ca19d admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:06.918635 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-c592dadb-7c77-44fd-afe6-8b27696ca19d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002514 Nov 27 20:37:06.919034 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 16/30] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:37:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:07.025243 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-61c49065-9186-48aa-b20d-c7b3ef840346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large"}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:07.025243 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-61c49065-9186-48aa-b20d-c7b3ef840346 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068977 Nov 27 20:37:07.025243 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 15/31] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:37:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:37:07.026053 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-b0e9d3dc-f0bd-401f-b44a-75418c828ef6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:07.038891 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-b0e9d3dc-f0bd-401f-b44a-75418c828ef6 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026362 Nov 27 20:37:07.039458 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 17/32] 10.222.0.21 () {64 vars in 1332 bytes} [Sat Nov 27 20:37:07 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:37:09.683848 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-61c49065-9186-48aa-b20d-c7b3ef840346 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:09.684899 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-61c49065-9186-48aa-b20d-c7b3ef840346 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Nov 27 20:37:09.685306 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 16/33] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:37:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:09.751480 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-244279d5-2111-4a1c-aa03-a1402a844e69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "swap": 0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:09.771540 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-244279d5-2111-4a1c-aa03-a1402a844e69 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079517 Nov 27 20:37:09.772406 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 18/34] 10.222.0.21 () {64 vars in 1282 bytes} [Sat Nov 27 20:37:09 2021] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:37:09.784569 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-e803a207-daaa-4200-b91f-64911adf0f46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:09.810246 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-e803a207-daaa-4200-b91f-64911adf0f46 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029208 Nov 27 20:37:09.810819 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 17/35] 10.222.0.21 () {64 vars in 1332 bytes} [Sat Nov 27 20:37:09 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:37:34.560527 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-244279d5-2111-4a1c-aa03-a1402a844e69 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:34.561523 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-244279d5-2111-4a1c-aa03-a1402a844e69 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Nov 27 20:37:34.561914 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 19/36] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:37:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:34.619021 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-b30e2360-5902-4237-9f93-6d6f12b64501 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:34.636460 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-b30e2360-5902-4237-9f93-6d6f12b64501 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067904 Nov 27 20:37:34.637000 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 20:37:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:37:36.320448 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-244279d5-2111-4a1c-aa03-a1402a844e69 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:36.321452 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-244279d5-2111-4a1c-aa03-a1402a844e69 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 27 20:37:36.321851 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 20/38] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:36.572865 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-2f173c95-bb8c-4e1a-80cd-02faaab55a6d admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:36.578389 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.wsgi [None req-2f173c95-bb8c-4e1a-80cd-02faaab55a6d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 27 20:37:36.578968 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-2f173c95-bb8c-4e1a-80cd-02faaab55a6d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:37:36.579818 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-2f173c95-bb8c-4e1a-80cd-02faaab55a6d admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057989 Nov 27 20:37:36.580322 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 19/39] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:37:36 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 27 20:37:36.590518 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-d68467dd-038c-4484-92d1-936a78a36026 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:36.610509 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-d68467dd-038c-4484-92d1-936a78a36026 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024098 Nov 27 20:37:36.611041 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 21/40] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:37:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:37:36.631501 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-69e88e3f-287f-4a8b-82b4-dbf5907e6edb admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:36.654097 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-69e88e3f-287f-4a8b-82b4-dbf5907e6edb admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026086 Nov 27 20:37:36.654613 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 20/41] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:37:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:37:36.664320 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-e0b42a7f-971b-400c-a981-f9ade39b0d28 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:36.669805 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.wsgi [None req-e0b42a7f-971b-400c-a981-f9ade39b0d28 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 27 20:37:36.670378 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-e0b42a7f-971b-400c-a981-f9ade39b0d28 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:37:36.671163 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-e0b42a7f-971b-400c-a981-f9ade39b0d28 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010435 Nov 27 20:37:36.671704 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 22/42] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:37:36 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 27 20:37:38.242649 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-69e88e3f-287f-4a8b-82b4-dbf5907e6edb admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:38.243675 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-69e88e3f-287f-4a8b-82b4-dbf5907e6edb admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Nov 27 20:37:38.244088 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:38.441703 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-09e7836c-59c5-4ae5-9572-c00b97eeb805 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:38.450074 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.wsgi [None req-09e7836c-59c5-4ae5-9572-c00b97eeb805 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 27 20:37:38.450651 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-09e7836c-59c5-4ae5-9572-c00b97eeb805 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:37:38.451488 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-09e7836c-59c5-4ae5-9572-c00b97eeb805 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060735 Nov 27 20:37:38.452018 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:37:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:38.461742 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-28f56581-2171-4c3c-8105-b5cfce790ed6 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:38.475312 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-28f56581-2171-4c3c-8105-b5cfce790ed6 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017083 Nov 27 20:37:38.475869 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:37:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:37:38.486003 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-93520f48-e5d8-497b-8886-e0e9f78156e9 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:38.500123 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-93520f48-e5d8-497b-8886-e0e9f78156e9 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017363 Nov 27 20:37:38.500656 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:37:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:37:38.511133 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-740f81de-e8d6-442e-b100-22212f8690ab admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:38.516300 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.wsgi [None req-740f81de-e8d6-442e-b100-22212f8690ab admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 27 20:37:38.516852 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-740f81de-e8d6-442e-b100-22212f8690ab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:37:38.517625 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-740f81de-e8d6-442e-b100-22212f8690ab admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010688 Nov 27 20:37:38.518100 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 23/47] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:37:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 27 20:37:40.065723 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-93520f48-e5d8-497b-8886-e0e9f78156e9 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:40.066763 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-93520f48-e5d8-497b-8886-e0e9f78156e9 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 27 20:37:40.067159 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:40.267486 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-be53ce25-bdeb-42db-b6f6-254139d6b1c5 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:40.272622 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.wsgi [None req-be53ce25-bdeb-42db-b6f6-254139d6b1c5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 27 20:37:40.273172 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-be53ce25-bdeb-42db-b6f6-254139d6b1c5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:37:40.273938 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-be53ce25-bdeb-42db-b6f6-254139d6b1c5 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058736 Nov 27 20:37:40.274434 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 24/49] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:37:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:40.284290 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-05ae947f-c0e1-459c-9fd4-5a33e7e9551d admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:40.298159 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-05ae947f-c0e1-459c-9fd4-5a33e7e9551d admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017484 Nov 27 20:37:40.298688 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 26/50] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:37:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:37:40.309394 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:40.322041 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017099 Nov 27 20:37:40.322552 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 25/51] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:37:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:37:40.332026 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-a62f719a-662b-4df5-b79d-70ef93875320 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:40.337139 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.wsgi [None req-a62f719a-662b-4df5-b79d-70ef93875320 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 27 20:37:40.337703 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-a62f719a-662b-4df5-b79d-70ef93875320 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:37:40.338481 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-a62f719a-662b-4df5-b79d-70ef93875320 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009962 Nov 27 20:37:40.338975 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 27/52] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:37:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:41.902429 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:41.903469 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 27 20:37:41.903868 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 26/53] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:42.101917 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-f5eba014-6c0f-4645-b1bf-f9285c66fd16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:42.119820 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-f5eba014-6c0f-4645-b1bf-f9285c66fd16 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068063 Nov 27 20:37:42.120320 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 28/54] 10.222.0.21 () {64 vars in 1235 bytes} [Sat Nov 27 20:37:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:37:43.709851 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:43.710858 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 27 20:37:43.711272 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:43.910058 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-8743975a-9fc6-41f6-a4d0-f733f6ca8d40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:43.927953 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-8743975a-9fc6-41f6-a4d0-f733f6ca8d40 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068058 Nov 27 20:37:43.928670 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1235 bytes} [Sat Nov 27 20:37:43 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:37:45.480717 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:45.481710 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Nov 27 20:37:45.482105 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 28/57] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:45.679742 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-e6cc6066-cc03-49ca-bba0-451849f4b19e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:45.697466 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-e6cc6066-cc03-49ca-bba0-451849f4b19e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068262 Nov 27 20:37:45.697965 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 30/58] 10.222.0.21 () {64 vars in 1235 bytes} [Sat Nov 27 20:37:45 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:37:47.257464 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:47.258453 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Nov 27 20:37:47.258873 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:47.457174 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-93998d70-70ec-4ede-9fd8-1c84fed8d8cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:37:47.474579 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-93998d70-70ec-4ede-9fd8-1c84fed8d8cd admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068624 Nov 27 20:37:47.475067 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 31/60] 10.222.0.21 () {64 vars in 1235 bytes} [Sat Nov 27 20:37:47 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:37:49.040239 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:49.041300 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 27 20:37:49.041719 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 30/61] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:37:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:37:49.248496 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-e1803708-4770-4146-8e96-3535413ba6b2 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:37:49.272737 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-e1803708-4770-4146-8e96-3535413ba6b2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080012 Nov 27 20:37:49.273285 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 32/62] 10.222.0.21 () {60 vars in 1202 bytes} [Sat Nov 27 20:37:49 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:38:38.489511 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:38:38.490569 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-604e5b9e-c8cd-46ed-a1b0-13a137a67284 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Nov 27 20:38:38.490961 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 31/63] 10.222.0.21 () {54 vars in 930 bytes} [Sat Nov 27 20:38:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:38:38.549376 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-5db9496d-9600-46cf-b09d-72d17c9fde08 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:38:38.568750 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-5db9496d-9600-46cf-b09d-72d17c9fde08 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071405 Nov 27 20:38:38.569276 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 33/64] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 20:38:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:38:38.591604 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-45d0722d-b5bc-40e5-98c0-b0b34786a29e admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:38:38.599049 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-45d0722d-b5bc-40e5-98c0-b0b34786a29e admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010973 Nov 27 20:38:38.599590 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 32/65] 10.222.0.21 () {60 vars in 1282 bytes} [Sat Nov 27 20:38:38 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:38:38.611548 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-f751fdd5-09f8-4348-8daa-f7009f9e7d08 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:38:38.619070 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-f751fdd5-09f8-4348-8daa-f7009f9e7d08 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010911 Nov 27 20:38:38.619644 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 34/66] 10.222.0.21 () {60 vars in 1285 bytes} [Sat Nov 27 20:38:38 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:38:38.631675 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-c4c82a94-4476-4d42-b669-1d29f5ec55f2 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:38:38.639227 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-c4c82a94-4476-4d42-b669-1d29f5ec55f2 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011101 Nov 27 20:38:38.639775 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 33/67] 10.222.0.21 () {60 vars in 1285 bytes} [Sat Nov 27 20:38:38 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:38:38.651659 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-09904b3d-59bc-49a3-98d8-80bf54ea6962 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:38:38.659041 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-09904b3d-59bc-49a3-98d8-80bf54ea6962 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011293 Nov 27 20:38:38.659595 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 35/68] 10.222.0.21 () {60 vars in 1282 bytes} [Sat Nov 27 20:38:38 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:40:02.316573 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-943655f8-3801-4982-9762-7f2bf8d56e53 tempest-verify_tempest_config-1084856405 tempest-verify_tempest_config-1084856405-project] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:40:02.318530 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-943655f8-3801-4982-9762-7f2bf8d56e53 tempest-verify_tempest_config-1084856405 tempest-verify_tempest_config-1084856405-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104650 Nov 27 20:40:02.319063 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 34/69] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 20:40:02 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:43:54.292147 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-09904b3d-59bc-49a3-98d8-80bf54ea6962 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:43:54.293193 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-09904b3d-59bc-49a3-98d8-80bf54ea6962 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Nov 27 20:43:54.293615 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:43:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:43:54.550726 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-8c31388d-e524-495a-bf47-429041ccdd32 admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:43:54.551922 ncdv-master-1 devstack@n-api.service[120215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:43:54.551922 ncdv-master-1 devstack@n-api.service[120215]: warnings.warn(msg) Nov 27 20:43:54.553501 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-8c31388d-e524-495a-bf47-429041ccdd32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:43:54.553937 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-8c31388d-e524-495a-bf47-429041ccdd32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:43:54.554727 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-8c31388d-e524-495a-bf47-429041ccdd32 admin admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:43:54.555147 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-8c31388d-e524-495a-bf47-429041ccdd32 admin admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:43:54.594135 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-8c31388d-e524-495a-bf47-429041ccdd32 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.154516 Nov 27 20:43:54.594686 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 35/71] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:43:54 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:43:56.235455 ncdv-master-1 devstack@n-api.service[120214]: DEBUG nova.api.openstack.wsgi [None req-09904b3d-59bc-49a3-98d8-80bf54ea6962 admin admin] Calling method '>' {{(pid=120214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:43:56.236452 ncdv-master-1 devstack@n-api.service[120214]: INFO nova.api.openstack.requestlog [None req-09904b3d-59bc-49a3-98d8-80bf54ea6962 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 27 20:43:56.236878 ncdv-master-1 devstack@n-api.service[120214]: [pid: 120214|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1074 bytes} [Sat Nov 27 20:43:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:43:56.435848 ncdv-master-1 devstack@n-api.service[120215]: DEBUG nova.api.openstack.wsgi [None req-90ebd8ec-b9d2-47de-b6ea-0df97cdc8bec admin admin] Calling method '>' {{(pid=120215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:43:56.436970 ncdv-master-1 devstack@n-api.service[120215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:43:56.436970 ncdv-master-1 devstack@n-api.service[120215]: warnings.warn(msg) Nov 27 20:43:56.438507 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-90ebd8ec-b9d2-47de-b6ea-0df97cdc8bec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:43:56.438952 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-90ebd8ec-b9d2-47de-b6ea-0df97cdc8bec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:43:56.439832 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-90ebd8ec-b9d2-47de-b6ea-0df97cdc8bec admin admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:43:56.440264 ncdv-master-1 devstack@n-api.service[120215]: DEBUG oslo_concurrency.lockutils [None req-90ebd8ec-b9d2-47de-b6ea-0df97cdc8bec admin admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:43:56.462734 ncdv-master-1 devstack@n-api.service[120215]: INFO nova.api.openstack.requestlog [None req-90ebd8ec-b9d2-47de-b6ea-0df97cdc8bec admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.079595 Nov 27 20:43:56.463312 ncdv-master-1 devstack@n-api.service[120215]: [pid: 120215|app: 0|req: 36/73] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:43:56 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:44:42.229737 ncdv-master-1 devstack@n-api.service[120213]: Sat Nov 27 20:44:42 2021 - graceful shutdown triggered... Nov 27 20:44:42.229238 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 27 20:44:42.230882 ncdv-master-1 devstack@n-api.service[120214]: Gracefully killing worker 1 (pid: 120214)... Nov 27 20:44:42.231430 ncdv-master-1 devstack@n-api.service[120215]: Gracefully killing worker 2 (pid: 120215)... Nov 27 20:44:43.230220 ncdv-master-1 devstack@n-api.service[120213]: worker 1 buried after 1 seconds Nov 27 20:44:43.230220 ncdv-master-1 devstack@n-api.service[120213]: worker 2 buried after 1 seconds Nov 27 20:44:43.230220 ncdv-master-1 devstack@n-api.service[120213]: goodbye to uWSGI. Nov 27 20:44:43.231832 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Nov 27 20:44:43.232427 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 27 20:44:43.235236 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Nov 27 20:44:43.269630 ncdv-master-1 devstack@n-api.service[135670]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 27 20:44:43 2021] *** Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: nodename: ncdv-master-1 Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: machine: x86_64 Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: clock source: unix Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: pcre jit disabled Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: detected number of CPU cores: 4 Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: current working directory: / Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: detected binary path: /usr/bin/uwsgi-core Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: your processes number limit is 47680 Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: your memory page size is 4096 bytes Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: detected max file descriptor number: 2048 Nov 27 20:44:43.292157 ncdv-master-1 devstack@n-api.service[135670]: lock engine: pthread robust mutexes Nov 27 20:44:43.293278 ncdv-master-1 devstack@n-api.service[135670]: thunder lock: enabled Nov 27 20:44:43.293278 ncdv-master-1 devstack@n-api.service[135670]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 27 20:44:43.293278 ncdv-master-1 devstack@n-api.service[135670]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 27 20:44:43.343851 ncdv-master-1 devstack@n-api.service[135670]: Python main interpreter initialized at 0x55db923d69c0 Nov 27 20:44:43.343851 ncdv-master-1 devstack@n-api.service[135670]: python threads support enabled Nov 27 20:44:43.343851 ncdv-master-1 devstack@n-api.service[135670]: your server socket listen backlog is limited to 100 connections Nov 27 20:44:43.343851 ncdv-master-1 devstack@n-api.service[135670]: your mercy for graceful operations on workers is 90 seconds Nov 27 20:44:43.344221 ncdv-master-1 devstack@n-api.service[135670]: mapped 403077 bytes (393 KB) for 2 cores Nov 27 20:44:43.344293 ncdv-master-1 devstack@n-api.service[135670]: *** Operational MODE: preforking *** Nov 27 20:44:43.344540 ncdv-master-1 devstack@n-api.service[135670]: *** uWSGI is running in multiple interpreter mode *** Nov 27 20:44:43.344540 ncdv-master-1 devstack@n-api.service[135670]: spawned uWSGI master process (pid: 135670) Nov 27 20:44:43.344767 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Nov 27 20:44:43.346790 ncdv-master-1 devstack@n-api.service[135670]: spawned uWSGI worker 1 (pid: 135679, cores: 1) Nov 27 20:44:43.346790 ncdv-master-1 devstack@n-api.service[135670]: spawned uWSGI worker 2 (pid: 135680, cores: 1) Nov 27 20:44:43.346790 ncdv-master-1 devstack@n-api.service[135670]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 27 20:44:45.337199 ncdv-master-1 devstack@n-api.service[135679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:44:45.337199 ncdv-master-1 devstack@n-api.service[135679]: from cryptography.utils import int_from_bytes Nov 27 20:44:45.337941 ncdv-master-1 devstack@n-api.service[135680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:44:45.337941 ncdv-master-1 devstack@n-api.service[135680]: from cryptography.utils import int_from_bytes Nov 27 20:44:45.338410 ncdv-master-1 devstack@n-api.service[135679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:44:45.338410 ncdv-master-1 devstack@n-api.service[135679]: from cryptography.utils import int_from_bytes Nov 27 20:44:45.338551 ncdv-master-1 devstack@n-api.service[135680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:44:45.338551 ncdv-master-1 devstack@n-api.service[135680]: from cryptography.utils import int_from_bytes Nov 27 20:44:47.769347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 27 20:44:47.770003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 27 20:44:47.770400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 27 20:44:47.770515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 27 20:44:47.770605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 27 20:44:47.770702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 27 20:44:47.770786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 27 20:44:47.770882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 27 20:44:47.770967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 27 20:44:47.771063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 27 20:44:47.771148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.771237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.771382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.771483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.771721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.771825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.772019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.772147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.772346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.772449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.772656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.772757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.772977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.773084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.773295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.773398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.773623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.773718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.773884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.773984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.774197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.774356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.774518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.774614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.774839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.774953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.775147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.775286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.775481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.775627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.775847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.775983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.776119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.776255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.776407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.776510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.776719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.776813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.777219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.777331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.777647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.777777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.777955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.778083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.778424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.778572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.778714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.778873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.778973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.779103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.779227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.779387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.780367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.780496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.780596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.780683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.780767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.780864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.780958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.781890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.782202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.782359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.782527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.782644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.782818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.782916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.783138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.783246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.783499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.783605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.783805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.783913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.784131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.784239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.784460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.784566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.784781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.784907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.785104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.785203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.785408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.785514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.785717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.785832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.786025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.786123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.786344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.786449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.786649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.786762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.786953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.787049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.787203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.787333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.787537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.787638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.787858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.787956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.788181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.788272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.788504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.788617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.788755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.788848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.789024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.789130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.789321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.789419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.789643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.789780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.789986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.790096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.790254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.790416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.790560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.790704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.790869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.790972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.791176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.791313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.791508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.791599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.791816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.791914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.792127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.792219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.792449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.792561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.792760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.792859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.793081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.793180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.793389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.793481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.794221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.794320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.794622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.794716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.794876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.794968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.795186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.795304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.795557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.795651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.795878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.795969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.796192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.796293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.796515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.796614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.796831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.796934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.797140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.797237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.797445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.797536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.797754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.797859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.798073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.798173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.798406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.798506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.798710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.798809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.798945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.799041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.799281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.799389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.799582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.799702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.799959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.800093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.800182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.800275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.800497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.800602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.800809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.800944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.801116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.801214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.801423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.801523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.801731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.801828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.802037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.802137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.802345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.802458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.802652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.802755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.802955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.803046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.803277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.803372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.803587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.803678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.803896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.803995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.804216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.804316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.804534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.804631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.804843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.804944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.805149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.805239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.805452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.805592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.805759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.805867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.806078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.806180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.806386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.806483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.806689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.806793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.807010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.807101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.807352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.807447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.807661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.807769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.807982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.808080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.808287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.808378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.808592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.808685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.808913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.809048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.809212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.809304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.810118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.810262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.810388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.810487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.810697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.810799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.811003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.811097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.811332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.811442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.811644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.811745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.811953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.812044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.812263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.812359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.812566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.812685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.812874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.812974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.813177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.813278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.813499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.813607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.813823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.813924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.814137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.814223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.814466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.814595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.814763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.814866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.815088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.815180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:44:47.815451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.815558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.815788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.815888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.816135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.816238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.816454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.816554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.816792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.816892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.817128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.817233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.817446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.817536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.817763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.817862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.818078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.818176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.818404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.818495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.818717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.818807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.819033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.819180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.819370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.819474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.819690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.819791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.820009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.820108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.820323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.820427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.820645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.820739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.820963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.821071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.821286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.821388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.821601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.821694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.821971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.822109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.822315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.822450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.822640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.822738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.822973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.823594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.823781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.823929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.824076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.824226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.824369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.824520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.824704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.825007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.825158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.825300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.825452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.825605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.825762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.825912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.826055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.826197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.826347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.826489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.826642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.826783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.826932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.827086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.827243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.828483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.828643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.828739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.828825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.828908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.829979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.830118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.830371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.830507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.830601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.830748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.830916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.831056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.831281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.831378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.831586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.831686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.831927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.832028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.832243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.832335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.832562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.832653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.832876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.832992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.833186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.833279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.833498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.833589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.833808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.833909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.834117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.834215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.834445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.834546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.834762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.834865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.835072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.835162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.835407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.835518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.835725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.835825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.836038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.836142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.836359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.836463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.836673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.836763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.836986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.837085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.837302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.837406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.837633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.837733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.837940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.838031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.838256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.838361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.838583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.838677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.838906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.838999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.839215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.839407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.839568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.839670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.839887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.839978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.840195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.840295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.840505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.840681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.840839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.840939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.841147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.841250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.841455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.841553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.841760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.841857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.842067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.842166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.842374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.842466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.842683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.842775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.842994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.843093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.843321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.843433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.843630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.843736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.843936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.844028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.844255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.844352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.844566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.844667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.844880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.844980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.845189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.845288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.845533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.845633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.845843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.845939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.846190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.846282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.846505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.846614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.846818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.846911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.847132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.847231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.847471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.847576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.847784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.847876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.848095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.848186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.848412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.848505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.848726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.848825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.849042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.849135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.849364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.849454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.849675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.849772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.849998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.850096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.850310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.850401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.850640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.850785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.850957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.851050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.851338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.851451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.851659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.851753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.851998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.852312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.852644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.852803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.852969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.853120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.853270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.853486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.853649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.853805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.853961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.854110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.854258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.854427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.854578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.854726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.854874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.855035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.855184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.855371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.855530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.855705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.855855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.856001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.856695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.856810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.857027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.857130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.857352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.857445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.857669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.857762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.858001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.858092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.858321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.858413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.858648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.858748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.858960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.859053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.859348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.859444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.861936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.862953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.863930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.864013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.864242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.864341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.864564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.864657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.864886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.864988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.865201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.865292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.865513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.865605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.865832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.865936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.866140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.866231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.866445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.866546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.866753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.866859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.867063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.867166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.867402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.867552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.867714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.867935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.868064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.868287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.868425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.868639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.868796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.868949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.869047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.869258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.869358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.869647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.869755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.869968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.870218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.870311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.870559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.870659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.870902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.871042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.871221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.871526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.871681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.872756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.872927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.873090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.873272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.873419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.873561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.873716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.873867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.874013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.874153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.874327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.874469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.874628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.874768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.874942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.875085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.875332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.875466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.875608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.875798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.875938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.876224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.876319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.876538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.876645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.876848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.877142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.877242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.877469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.877573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.877810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.878040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.878139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.878381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.878476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.878703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.878797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.879028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.879120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.879377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.879476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.879702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.879796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.880037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.880233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.880373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.880550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.880691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.880883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.880991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.881203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.881321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.881524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.881638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.881835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.881938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.882148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.882242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.882461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.882555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.882779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.882923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.883085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.883176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.883419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.883512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.883736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.883835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.884047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.884140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.884369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.884524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.884679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.884785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.884997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.885090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.885310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.885414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.885628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.885727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.885937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.886071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.886265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.886370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.886576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.886674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.886882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.886972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.887195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.887530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.887626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.887712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.887904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.888005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.888216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.888318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.888561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.888660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.888878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.888977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.889192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.889293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.889524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.889615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.889834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.889936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.890164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.890269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.890473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.890565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.890783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.890889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.891092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.891207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.891431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.891549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.891751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.891909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.892059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.892152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.892372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.892463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.892684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.892830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.893009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.893139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.893303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.893398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.893610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.893712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.893921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.894012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.894230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.894550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.894649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.894864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.894957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.895178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.895294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.895510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.895610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.895825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.895923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.896134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.896226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.896454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.896589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.896765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.896859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.897089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.897215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.897407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.897536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.897730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.897864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.898042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.898169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.898358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.898486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.898675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.898794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.899032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.899160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.899391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.899522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.899712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.899832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.900027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.900147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.900877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.901030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.901030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.901259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.901379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.901591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.901719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.901931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.902895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.903931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.904043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.904152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.904287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.904385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.904589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.904698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.904896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.905072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.905190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.905277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.905502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.905633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.905835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.905932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.906148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.906258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.906466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.906573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.906778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.906895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.907086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.907180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.907475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.907573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.907791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.907886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.908120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.908220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.908485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.908645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.908820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.909003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.909149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.909470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.909756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.909859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.910097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.910195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.910407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.910499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.910730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.910905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.911238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.911372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.911636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.911745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.916209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.916340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.916449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.916548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.916637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.916827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.919996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.920939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.921980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.922955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.923025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.923095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.923174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.923284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.923907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.924076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.924269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.924415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.924580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.924727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.924866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.925013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.925151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.925290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.925437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.925757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.925911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.926059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.926198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.926340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.926502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.926650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.926810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.927995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.928978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.929967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.930084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.930273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.930400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.930585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.930684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.930913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.931018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.931226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.931374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.931624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.931718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.931954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.932057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.932351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.932542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.932660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.932884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.933080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.933184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.933397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.933497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.933712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.933810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.934041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.934162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.934420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.935070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.935242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.935513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.935607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.935865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.935967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.936191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.936289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.936520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.936619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.936855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.937004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.937146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.937379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.937531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.937714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.937820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.938054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.938146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.938386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.938485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.938747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.938861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.939089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.939188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.939427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.939794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.940082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.940353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.940522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.940699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.940861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.941013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.941162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.941310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.941453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.941594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.941742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.941897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.942127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.942302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.942522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.943318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.943481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.943647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.943797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.943950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.944100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.944242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.944393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.944537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.944678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.944819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.944966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.945960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.946895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.947131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.947223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.947499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.947596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.947832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.947938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.948146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.948239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.948479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.948572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.948796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.948889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.949108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.949199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.949423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.949516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.949734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.949826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.950081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.950175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.950397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.950491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.950716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.950810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.951032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.951139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.951369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.951467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.951708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.951809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.952027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.952143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.952367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.952479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.952680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.952776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.952994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.953101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.953323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.953415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.953637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.953736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.953947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.954052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.954266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.954366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.954575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.954717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.954885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.954978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.955194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.955299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.955531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.955622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.955847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.955948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.956160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.956302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.956472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.956572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.956801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.956894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.957115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.957259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.957445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.957588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.957762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.957906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.958076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.958170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.958389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.958497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.958699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.958823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.959048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.959182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.959398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.959568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.959722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.959894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.960047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.960219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.960377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.960539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.960712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.960890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.961031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.961213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.961363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.961565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.961689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.962012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.962136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.962332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.962654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.962976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.963359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.963495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.963690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.963799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.967273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.967407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.967510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.967590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.967825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.967941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.968042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.968141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.968240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.969639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.969751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.969837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.969928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.970479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.971001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.971001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.971001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.971208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.971391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.971902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.972421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.972609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.973045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.973391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.973521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.973778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.974258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.974399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.974626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.975128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.975353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.975635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.976007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.976190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.976347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.976688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.976958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.977072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.977351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.977731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.977873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.978195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.978532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.979224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.979487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.979752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.979875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.980148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.980475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.980798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.981131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.981986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.982195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.982304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.982625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.982954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.983205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.983331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.983655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.983979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.984089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.984307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.984631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.984919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.985033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.985498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.985612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.985831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.986176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.986431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.986542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.986839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.987169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.987555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.987794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.987907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.988199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.988518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.988706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.988822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.989143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.989459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.989635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.989789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.990111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.990424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.990604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.990751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.991073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.991427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.991641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.992004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.992255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.992366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.992658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.992994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.993159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.993320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.993641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.993967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.994103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.994286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.994603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.994878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.994999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.995238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.995570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.995791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.995900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.996188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.996514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.996678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.997198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.998169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.998328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.998488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.998826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.999084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.999195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.999470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:47.999805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.000109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.000280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.000422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.000738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.001054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.001210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.001378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.001688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.002003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.002322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.002634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.002951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.003286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.003595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.004126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.004277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.004728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.004987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.005106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.005424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.005773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.005918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.006075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.006415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.006739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.007060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.007288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.007457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.007787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.008136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.008339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.008748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.009005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.009118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.009429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.009760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.009890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.010087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.010404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.010704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.010826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.011042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.011522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.011701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.012038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.012361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.012597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.012718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.013015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.013386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.013516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.013707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.014026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.014295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.014409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.014659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.015010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.015212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.015357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.015675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.015988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.016134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.016318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.016655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.016910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.017039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.017260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.017579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.017822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.017947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.018228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.018554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.018710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.018865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.019326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.019613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.019756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.019953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.020281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.020599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.020718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.020927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.021257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.021477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.021739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.022091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.022251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.022409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.022748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.023010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.023122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.023444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.023780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.023966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.024074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.024396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.024710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.024849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.025025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.025363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.025623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.025766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.026014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.026350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.026556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.026664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.026986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.027322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.027476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.027769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.028145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.028644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.028772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.028994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.029316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.029558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.029670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.029966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.030387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.030540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.030835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.031183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.031416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.031543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.031836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.032172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.032355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.032508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.032825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.033150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.033480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.033722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.033841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.034119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.034439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.034643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.034813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.035136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.035436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.035549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.035787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.036106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.036357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.036468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.036745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.037079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.037264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.037411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.037747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.038079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.038254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.038436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.038760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.039116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.039387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.039491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.039796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.040108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.040400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.040512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.040653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 27 20:44:48.041160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.041680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.042197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.042768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.043310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.044337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.044919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.045458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.046421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.047044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.047619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.048200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.048767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.049289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.049836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.050366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.050887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.051452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.051979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.052490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.053049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.053585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.054095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.054635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.055167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.055763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.056281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.056818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.057347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.057979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.058595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.059142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.060217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.060738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.061283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.061794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.062163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.062522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.062885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.063212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.063706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.064032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.064459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.064809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.064942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_db.sqlalchemy.engines [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.065133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.065671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.066202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.066579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.066921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.067241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.067721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.068129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.068449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.068788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.069132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.069452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.069820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.070118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.070460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.070828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.071156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.071538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.071857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.072361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.072956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.073503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.074034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.074587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.075665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.076217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.076732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.077253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.077797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.078321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.078855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.079412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.079998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.080626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.081323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.081930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.082521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.083165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.083774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.084405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.085131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.085643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.086155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.086703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.087331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.087865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.088408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.089119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.089656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.090200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.091399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.091980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.092494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.093041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.093590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.094133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.094661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.095194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:44:48.095685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 27 20:44:48.133094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.140022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.context [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=135679) load_cells /opt/stack/nova/nova/context.py:464}} Nov 27 20:44:48.144354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:44:48.145962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:44:48.146807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:44:48.149024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:44:48.159955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_db.sqlalchemy.engines [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.161458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_db.sqlalchemy.engines [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.221326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.context [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=135680) load_cells /opt/stack/nova/nova/context.py:464}} Nov 27 20:44:48.225606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:44:48.227176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:44:48.228050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:44:48.230204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:44:48.241821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.242673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.336807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_db.sqlalchemy.engines [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.409674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_db.sqlalchemy.engines [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:44:48.666663 ncdv-master-1 devstack@n-api.service[135679]: WARNING keystonemiddleware.auth_token [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:44:48.673220 ncdv-master-1 devstack@n-api.service[135679]: WARNING keystonemiddleware.auth_token [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:44:48.749614 ncdv-master-1 devstack@n-api.service[135680]: WARNING keystonemiddleware.auth_token [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:44:48.756834 ncdv-master-1 devstack@n-api.service[135680]: WARNING keystonemiddleware.auth_token [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:44:49.019019 ncdv-master-1 devstack@n-api.service[135679]: WARNING keystonemiddleware.auth_token [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:44:49.024412 ncdv-master-1 devstack@n-api.service[135679]: WARNING keystonemiddleware.auth_token [None req-7d552ecd-3f7d-4ce8-a3d0-1f7021568d30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:44:49.029893 ncdv-master-1 devstack@n-api.service[135679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db923d69c0 pid: 135679 (default app) Nov 27 20:44:49.100220 ncdv-master-1 devstack@n-api.service[135680]: WARNING keystonemiddleware.auth_token [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 20:44:49.105847 ncdv-master-1 devstack@n-api.service[135680]: WARNING keystonemiddleware.auth_token [None req-2c81b823-a29e-40d4-8c2c-79cfbfbf7f46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 20:44:49.111453 ncdv-master-1 devstack@n-api.service[135680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db923d69c0 pid: 135680 (default app) Nov 27 20:45:26.045662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '.version_select at 0x7f15d635d4c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:26.047094 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:26.047094 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:26.053318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=135679) load_cells /opt/stack/nova/nova/compute/api.py:302}} Nov 27 20:45:26.054231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:26.054680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:26.080308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:26.080759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:26.097481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:26.097935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:26.105005 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6dd19742-b561-4b6a-b1c4-b8d34cc286fc tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.114830 Nov 27 20:45:26.105744 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1/1] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 20:45:24 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:26.348324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b5f5372-dc44-44b4-8f1f-95968076eb3f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2084407099", "name": "tempest-test_aggregate-2071058101"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:26.382691 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:26.382691 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:26.384576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-8b5f5372-dc44-44b4-8f1f-95968076eb3f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid b721231c-29fb-4740-9e1a-3d7ad38ab23d for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:45:26.495002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b5f5372-dc44-44b4-8f1f-95968076eb3f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.377423 Nov 27 20:45:26.499413 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1/2] 10.222.0.21 () {60 vars in 1164 bytes} [Sat Nov 27 20:45:26 2021] POST /compute/v2.1/os-aggregates => generated 222 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:26.506884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11e7e751-b463-4539-a559-d472a7091447 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:26.507809 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:26.507809 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:26.527149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11e7e751-b463-4539-a559-d472a7091447 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.024152 Nov 27 20:45:26.527961 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:45:26 2021] GET /compute/v2.1/os-aggregates => generated 303 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:26.538193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db087cdd-5368-443a-a1d2-69d31ce1fc0f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:26.539980 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:26.539980 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:26.555328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db087cdd-5368-443a-a1d2-69d31ce1fc0f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:26.555783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db087cdd-5368-443a-a1d2-69d31ce1fc0f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:27.603851 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db087cdd-5368-443a-a1d2-69d31ce1fc0f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.069196 Nov 27 20:45:27.604971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2/4] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:45:26 2021] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:27.702785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Calling method '.version_select at 0x7f15d62240d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:27.703748 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:27.703748 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:27.705249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:27.705703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:27.719194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:27.719683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:27.730164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:27.730618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:27.736671 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68560a17-ddf7-42f4-a0cd-1772eb5ab0ec tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.464210 Nov 27 20:45:27.737225 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3/5] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 20:45:27 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:27.891959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db087cdd-5368-443a-a1d2-69d31ce1fc0f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:27.893086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db087cdd-5368-443a-a1d2-69d31ce1fc0f tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001749 Nov 27 20:45:27.893423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3/6] 10.222.0.21 () {56 vars in 885 bytes} [Sat Nov 27 20:45:27 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 27 20:45:28.261926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-51973247", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "availability_zone": "tempest-test_az-2084407099"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:28.303405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:28.303855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:28.304651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:28.305239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:28.808916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb342c96-f658-4397-b115-3ecf9415e2e7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:28.810862 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:28.810862 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:28.812569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb342c96-f658-4397-b115-3ecf9415e2e7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:28.813098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb342c96-f658-4397-b115-3ecf9415e2e7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:28.814780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb342c96-f658-4397-b115-3ecf9415e2e7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:28.815498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb342c96-f658-4397-b115-3ecf9415e2e7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:28.848297 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cb342c96-f658-4397-b115-3ecf9415e2e7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.738454 Nov 27 20:45:28.849402 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:45:28 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:28.965947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:45:28.988507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-136a7099-e942-4a6e-a38d-d3c1643994dc tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-955293257", "id": 1664871312, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:28.990239 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:28.990239 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:29.023479 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-136a7099-e942-4a6e-a38d-d3c1643994dc tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.172588 Nov 27 20:45:29.024094 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 5/8] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 20:45:28 2021] POST /compute/v2.1/flavors => generated 448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:45:29.159523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f837f8b-fcb1-4f29-9ff5-7bbd7b187260 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1387932122", "ram": 512, "vcpus": 1, "disk": 10, "id": 36224385, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:29.176732 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f837f8b-fcb1-4f29-9ff5-7bbd7b187260 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.151353 Nov 27 20:45:29.177607 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 6/9] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:29 2021] POST /compute/v2.1/flavors => generated 410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:29.310575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:45:29.311120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:45:29.311713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:45:29.312418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:45:29.312839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:45:29.326947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:29.327435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:29.328636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:29.329243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:29.357062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-123839842", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:29.364080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Getting quotas for project 75de5fe7240c4923a26724fd417391e8. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:45:29.370584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Getting quotas for user c6bda78859f14c7a8f397a209503f28e and project 75de5fe7240c4923a26724fd417391e8. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:45:29.385257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:45:29.388661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:45:29.483987 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d256847-048a-4c55-9b97-ca087f98d485 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512324 Nov 27 20:45:29.484972 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4/10] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:45:29.725555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:45:29.734793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a03d5da6-cb84-4dbe-8913-fc4499562909 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2064843851", "id": 1586202905, "os-flavor-access:is_public": "False"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:29.747162 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:29.747162 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:29.783885 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a03d5da6-cb84-4dbe-8913-fc4499562909 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.297544 Nov 27 20:45:29.785102 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 5/11] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:29 2021] POST /compute/v2.1/flavors => generated 439 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:29.955457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ce67d3b-471b-45dc-ac46-40741a69846f tempest-FlavorsV255TestJSON-1782460764 tempest-FlavorsV255TestJSON-1782460764-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:29.964716 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ce67d3b-471b-45dc-ac46-40741a69846f tempest-FlavorsV255TestJSON-1782460764 tempest-FlavorsV255TestJSON-1782460764-project] 10.222.0.21 "GET /compute/v2.1/flavors/1664871312" status: 200 len: 448 microversion: 2.55 time: 0.178186 Nov 27 20:45:29.965431 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 6/12] 10.222.0.21 () {60 vars in 1198 bytes} [Sat Nov 27 20:45:29 2021] GET /compute/v2.1/flavors/1664871312 => generated 448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:45:30.094290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:45:30.095469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:45:30.096086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:45:30.096749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:45:30.097303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:45:30.112041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:30.112655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:30.114093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:30.115192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:30.182064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Getting quotas for project a53c15d688a541849c224abc382dff55. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:45:30.189115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Getting quotas for user 8eff5913736b4e77ac2b092534edfcd9 and project a53c15d688a541849c224abc382dff55. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:45:30.203681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:45:30.207450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:45:30.241439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b91cb551-8e7d-4df1-ad8d-46afa5fc9725 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.259878 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b91cb551-8e7d-4df1-ad8d-46afa5fc9725 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] HTTP exception thrown: Flavor 36224385 has no extra specs with key hw:cpu_thread_policy. Nov 27 20:45:30.261501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b91cb551-8e7d-4df1-ad8d-46afa5fc9725 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Returning 404 to user: Flavor 36224385 has no extra specs with key hw:cpu_thread_policy. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:30.263440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b91cb551-8e7d-4df1-ad8d-46afa5fc9725 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] 10.222.0.21 "GET /compute/v2.1/flavors/36224385/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.296213 Nov 27 20:45:30.270396 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 7/13] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:45:29 2021] GET /compute/v2.1/flavors/36224385/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:30.278476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c61fc396-66c4-4069-9c9c-65eaed87045d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.279653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c61fc396-66c4-4069-9c9c-65eaed87045d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:30.299593 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-24a69744-c7c0-4070-b2fd-ef0f42a085c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120950 Nov 27 20:45:30.300839 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 7/14] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:45:30.306133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-630a1b92-40a5-4852-b93a-a1879520299a tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e289b137b09743c399e30e4ffa1bab40"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.308349 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.308349 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:30.416122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c61fc396-66c4-4069-9c9c-65eaed87045d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:30.450463 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c61fc396-66c4-4069-9c9c-65eaed87045d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1241 microversion: 2.1 time: 0.178432 Nov 27 20:45:30.452264 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 8/15] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:30 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:30.457326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9dbc31d-7f76-49cc-a2fd-d4943fbb42e6 tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] Action: 'update', calling method: .version_select at 0x7f15d671b820>, body: {"flavor": {"description": "new"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.470700 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.470700 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:30.516977 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9dbc31d-7f76-49cc-a2fd-d4943fbb42e6 tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] 10.222.0.21 "PUT /compute/v2.1/flavors/1664871312" status: 200 len: 449 microversion: 2.55 time: 0.062234 Nov 27 20:45:30.518318 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 9/16] 10.222.0.21 () {62 vars in 1218 bytes} [Sat Nov 27 20:45:30 2021] PUT /compute/v2.1/flavors/1664871312 => generated 449 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:45:30.527185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d623aaa-2868-4da7-b0ea-d1f2b6db05cc tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.529328 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.529328 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:30.531204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1d623aaa-2868-4da7-b0ea-d1f2b6db05cc tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '3c6ba16e4d734dccab91cb1f3df6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0941d60be210490fb2c7c5ecd7226447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:30.536871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d623aaa-2868-4da7-b0ea-d1f2b6db05cc tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:30.538667 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1d623aaa-2868-4da7-b0ea-d1f2b6db05cc tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] 10.222.0.21 "POST /compute/v2.1/flavors/36224385/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.018085 Nov 27 20:45:30.540140 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 10/17] 10.222.0.21 () {60 vars in 1217 bytes} [Sat Nov 27 20:45:30 2021] POST /compute/v2.1/flavors/36224385/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:30.545716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc1dc319-9f15-4af7-95ec-2b31a2621c64 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.546878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc1dc319-9f15-4af7-95ec-2b31a2621c64 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:30.633373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fc1dc319-9f15-4af7-95ec-2b31a2621c64 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:30.647424 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc1dc319-9f15-4af7-95ec-2b31a2621c64 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1219 microversion: 2.1 time: 0.105613 Nov 27 20:45:30.648662 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 11/18] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:30 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:30.653617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9ed2a41-b138-4fc6-9214-b8cd46f8f1d0 tempest-FlavorsV255TestJSON-1782460764 tempest-FlavorsV255TestJSON-1782460764-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.665699 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-630a1b92-40a5-4852-b93a-a1879520299a tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1586202905/action" status: 200 len: 97 microversion: 2.1 time: 0.363098 Nov 27 20:45:30.666369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 8/19] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:30 2021] POST /compute/v2.1/flavors/1586202905/action => generated 97 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:30.672354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf3d5f00-dffc-473a-8031-08aca915e529 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.674804 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.674804 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:30.692179 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9ed2a41-b138-4fc6-9214-b8cd46f8f1d0 tempest-FlavorsV255TestJSON-1782460764 tempest-FlavorsV255TestJSON-1782460764-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 6145 microversion: 2.55 time: 0.042248 Nov 27 20:45:30.692889 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 12/20] 10.222.0.21 () {60 vars in 1186 bytes} [Sat Nov 27 20:45:30 2021] GET /compute/v2.1/flavors/detail => generated 6145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:45:30.697753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e7faac8-3588-4fb4-97ce-8631fc7eb61f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e289b137b09743c399e30e4ffa1bab40"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.699070 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.699070 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:30.737189 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf3d5f00-dffc-473a-8031-08aca915e529 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/36224385/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067810 Nov 27 20:45:30.740331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 9/21] 10.222.0.21 () {60 vars in 1217 bytes} [Sat Nov 27 20:45:30 2021] POST /compute/v2.1/flavors/36224385/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:30.751633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-76db5894-45d9-4b3a-bdaf-f153b750a555 tempest-FlavorsV255TestJSON-1782460764 tempest-FlavorsV255TestJSON-1782460764-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.786488 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-76db5894-45d9-4b3a-bdaf-f153b750a555 tempest-FlavorsV255TestJSON-1782460764 tempest-FlavorsV255TestJSON-1782460764-project] 10.222.0.21 "GET /compute/v2.1/flavors" status: 200 len: 3403 microversion: 2.55 time: 0.044508 Nov 27 20:45:30.787045 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 10/22] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:45:30 2021] GET /compute/v2.1/flavors => generated 3403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:45:30.794801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-038cebf5-394a-45a8-a25f-c925c01013b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.795594 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.795594 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:30.797069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-038cebf5-394a-45a8-a25f-c925c01013b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '3c6ba16e4d734dccab91cb1f3df6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0941d60be210490fb2c7c5ecd7226447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:30.798185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-038cebf5-394a-45a8-a25f-c925c01013b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:30.799037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-038cebf5-394a-45a8-a25f-c925c01013b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] 10.222.0.21 "DELETE /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010341 Nov 27 20:45:30.800196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 11/23] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:45:30 2021] DELETE /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:30.804880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e266be6-5146-4cc5-bdf1-0f5707039720 tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.805896 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.805896 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:30.838441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e266be6-5146-4cc5-bdf1-0f5707039720 tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1664871312" status: 202 len: 0 microversion: 2.55 time: 0.036773 Nov 27 20:45:30.840442 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 12/24] 10.222.0.21 () {60 vars in 1201 bytes} [Sat Nov 27 20:45:30 2021] DELETE /compute/v2.1/flavors/1664871312 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:45:30.846408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a1b4078-3d76-4ae4-9470-bc9c59a3baa1 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.879560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a1b4078-3d76-4ae4-9470-bc9c59a3baa1 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/36224385/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037539 Nov 27 20:45:30.880970 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 13/25] 10.222.0.21 () {60 vars in 1217 bytes} [Sat Nov 27 20:45:30 2021] POST /compute/v2.1/flavors/36224385/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:30.886297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f7ba8c0-48d3-4608-a63d-3f2f7e758ca6 tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.929879 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f7ba8c0-48d3-4608-a63d-3f2f7e758ca6 tempest-FlavorsV255TestJSON-1200446368 tempest-FlavorsV255TestJSON-1200446368-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5706 microversion: 2.55 time: 0.047667 Nov 27 20:45:30.930937 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 14/26] 10.222.0.21 () {60 vars in 1186 bytes} [Sat Nov 27 20:45:30 2021] GET /compute/v2.1/flavors/detail => generated 5706 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:45:30.935945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f108f664-fa9f-43f4-b7d7-4f84f00f7333 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.937304 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:30.937304 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:30.938248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f108f664-fa9f-43f4-b7d7-4f84f00f7333 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '3c6ba16e4d734dccab91cb1f3df6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0941d60be210490fb2c7c5ecd7226447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:30.938877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f108f664-fa9f-43f4-b7d7-4f84f00f7333 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:30.939716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f108f664-fa9f-43f4-b7d7-4f84f00f7333 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045 tempest-FlavorsExtraSpecsNegativeTestJSON-1087201045-project] 10.222.0.21 "PUT /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007652 Nov 27 20:45:30.942394 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 15/27] 10.222.0.21 () {60 vars in 1258 bytes} [Sat Nov 27 20:45:30 2021] PUT /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:30.953109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96006af9-365a-401f-8e34-8a256a52f61a tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:30.964127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-96006af9-365a-401f-8e34-8a256a52f61a tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] HTTP exception thrown: Flavor 36224385 has no extra specs with key hw:cpu_thread_policy. Nov 27 20:45:30.964869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96006af9-365a-401f-8e34-8a256a52f61a tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Returning 404 to user: Flavor 36224385 has no extra specs with key hw:cpu_thread_policy. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:30.966250 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-96006af9-365a-401f-8e34-8a256a52f61a tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/36224385/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.019488 Nov 27 20:45:30.967208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 16/28] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:45:30 2021] DELETE /compute/v2.1/flavors/36224385/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:30.980391 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-4e7faac8-3588-4fb4-97ce-8631fc7eb61f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project e289b137b09743c399e30e4ffa1bab40 combination. Nov 27 20:45:30.981312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b895af04-8429-416c-a52a-a7a9b4c1c086 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:30.981783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e7faac8-3588-4fb4-97ce-8631fc7eb61f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project e289b137b09743c399e30e4ffa1bab40 combination. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:30.983868 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e7faac8-3588-4fb4-97ce-8631fc7eb61f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1586202905/action" status: 409 len: 152 microversion: 2.1 time: 0.288558 Nov 27 20:45:30.988795 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b895af04-8429-416c-a52a-a7a9b4c1c086 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 27 20:45:30.991638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b895af04-8429-416c-a52a-a7a9b4c1c086 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:30.992487 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 13/29] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:30 2021] POST /compute/v2.1/flavors/1586202905/action => generated 152 bytes in 299 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:45:30.994231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b895af04-8429-416c-a52a-a7a9b4c1c086 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "PUT /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019608 Nov 27 20:45:30.995459 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 17/30] 10.222.0.21 () {60 vars in 1258 bytes} [Sat Nov 27 20:45:30 2021] PUT /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:31.006615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1313861-0be2-4309-944e-77c982ef78dd tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e289b137b09743c399e30e4ffa1bab40"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:31.007877 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:31.007877 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:31.013956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ed23d79-385f-4dc5-898d-93bbc42569c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:31.015151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ed23d79-385f-4dc5-898d-93bbc42569c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:31.016872 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ed23d79-385f-4dc5-898d-93bbc42569c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "PUT /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.014630 Nov 27 20:45:31.017634 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 18/31] 10.222.0.21 () {60 vars in 1258 bytes} [Sat Nov 27 20:45:30 2021] PUT /compute/v2.1/flavors/36224385/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:45:31.032461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9627d5cc-40ec-45fa-8f66-2087e29e1310 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.077540 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9627d5cc-40ec-45fa-8f66-2087e29e1310 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/36224385" status: 202 len: 0 microversion: 2.1 time: 0.054842 Nov 27 20:45:31.079444 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 19/32] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:45:31 2021] DELETE /compute/v2.1/flavors/36224385 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:45:31.090907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cc3e340-7442-4c30-8f5b-dc697535c37c tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.114223 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cc3e340-7442-4c30-8f5b-dc697535c37c tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275 tempest-FlavorsExtraSpecsNegativeTestJSON-1618758275-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028967 Nov 27 20:45:31.114223 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 20/33] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:31 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:31.403471 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a1313861-0be2-4309-944e-77c982ef78dd tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1586202905/action" status: 200 len: 21 microversion: 2.1 time: 0.409679 Nov 27 20:45:31.404779 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 14/34] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:30 2021] POST /compute/v2.1/flavors/1586202905/action => generated 21 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:31.414986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bdf46817-5991-4398-9e83-d4a4b43b9564 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.439696 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bdf46817-5991-4398-9e83-d4a4b43b9564 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1586202905" status: 202 len: 0 microversion: 2.1 time: 0.027631 Nov 27 20:45:31.446800 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 21/35] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:45:31 2021] DELETE /compute/v2.1/flavors/1586202905 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:45:31.455972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3bee1c93-c56f-4e30-84eb-5d88e9dbcce9 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.469403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.470045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:31.487295 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3bee1c93-c56f-4e30-84eb-5d88e9dbcce9 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032249 Nov 27 20:45:31.487295 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 15/36] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:31 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:31.502668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6f5ae64-6a1e-4d55-950b-b4cde5c0e22f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-428300684", "id": 1244504957, "os-flavor-access:is_public": "True"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:31.504395 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:31.504395 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:31.504983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:31.505510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:31.506363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:31.506890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:31.535437 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6f5ae64-6a1e-4d55-950b-b4cde5c0e22f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.036767 Nov 27 20:45:31.536051 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 16/37] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:31 2021] POST /compute/v2.1/flavors => generated 437 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:31.546355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d4c36852-27ea-4377-b436-3a2d5f5587cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.547246 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:31.547246 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:31.561754 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d4c36852-27ea-4377-b436-3a2d5f5587cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 27 20:45:31.562429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d4c36852-27ea-4377-b436-3a2d5f5587cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:31.563334 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d4c36852-27ea-4377-b436-3a2d5f5587cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/1244504957/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020585 Nov 27 20:45:31.564085 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 17/38] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 20:45:31 2021] GET /compute/v2.1/flavors/1244504957/os-flavor-access => generated 91 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:45:31.576257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53ca0069-4308-418e-b3f3-530b2c6fca8e tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.577346 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:31.577346 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:31.608399 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53ca0069-4308-418e-b3f3-530b2c6fca8e tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1244504957" status: 202 len: 0 microversion: 2.1 time: 0.036274 Nov 27 20:45:31.608972 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 18/39] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:45:31 2021] DELETE /compute/v2.1/flavors/1244504957 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:45:31.616909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-669f2b7f-9f59-4126-b75f-589fd4dd7943 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.673536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-669f2b7f-9f59-4126-b75f-589fd4dd7943 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059952 Nov 27 20:45:31.683577 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 19/40] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:31 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:31.683577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:31.683577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:31.701268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:31.701720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:31.702543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:31.702982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:31.712475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:31.734277 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51d97629-1537-4897-8661-e670ad4635c9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1289 microversion: 2.1 time: 0.268699 Nov 27 20:45:31.736736 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 22/41] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:31 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1289 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:31.747526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78780e4a-9e15-4464-9e1e-5a76771a307a tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-881019358", "id": 1427177760, "os-flavor-access:is_public": "False"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:31.754166 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:31.754166 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:31.788542 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78780e4a-9e15-4464-9e1e-5a76771a307a tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.050022 Nov 27 20:45:31.795307 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 23/42] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:31 2021] POST /compute/v2.1/flavors => generated 438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:32.161670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:32.183605 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0e348eb-ecf9-4074-9445-85069123945e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1215 microversion: 2.1 time: 0.508412 Nov 27 20:45:32.193473 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 20/43] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:31 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1215 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:32.314991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e0d8dd5-57b7-4052-a27e-64aa639d2aef tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e289b137b09743c399e30e4ffa1bab40"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:32.315735 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:32.315735 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:32.316812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e0d8dd5-57b7-4052-a27e-64aa639d2aef tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '2225ee361ad844ff91886aa430272b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e289b137b09743c399e30e4ffa1bab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:32.318241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e0d8dd5-57b7-4052-a27e-64aa639d2aef tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:32.320037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e0d8dd5-57b7-4052-a27e-64aa639d2aef tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] 10.222.0.21 "POST /compute/v2.1/flavors/1427177760/action" status: 403 len: 130 microversion: 2.1 time: 0.521107 Nov 27 20:45:32.323353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 24/44] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:31 2021] POST /compute/v2.1/flavors/1427177760/action => generated 130 bytes in 525 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:32.372023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a28f8b8-3d8d-472b-9567-8b407b7fd0a4 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:32.373650 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:32.373650 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:32.410811 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a28f8b8-3d8d-472b-9567-8b407b7fd0a4 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1427177760" status: 202 len: 0 microversion: 2.1 time: 0.082838 Nov 27 20:45:32.416200 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 25/45] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:45:32 2021] DELETE /compute/v2.1/flavors/1427177760 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:45:32.449339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44813486-12b2-4e65-998b-f452c88bf85e tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:32.502480 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44813486-12b2-4e65-998b-f452c88bf85e tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079766 Nov 27 20:45:32.503086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 26/46] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:32 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:32.521473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c8e51552-7d72-40c1-9a0d-f70f723a4bb9 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2081250865", "id": 1760349887, "os-flavor-access:is_public": "False"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:32.562172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c8e51552-7d72-40c1-9a0d-f70f723a4bb9 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.046094 Nov 27 20:45:32.564325 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 27/47] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:32 2021] POST /compute/v2.1/flavors => generated 439 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:32.582476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bdf17c0b-ec61-4da6-a185-a16dff441c39 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e289b137b09743c399e30e4ffa1bab40"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:32.667831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0af0916c-27b6-4934-8d50-f7470fab7262 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Calling method '.version_select at 0x7f15d4feaee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:32.669463 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:32.669463 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:32.672129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0af0916c-27b6-4934-8d50-f7470fab7262 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5a0d5f90acaa4a8e9f302362ef518d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:32.672893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0af0916c-27b6-4934-8d50-f7470fab7262 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:32.676055 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0af0916c-27b6-4934-8d50-f7470fab7262 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.489433 Nov 27 20:45:32.676870 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 21/48] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 20:45:32 2021] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 491 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:45:32.704680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1198a4b-066f-4ec5-a8ed-b354b7218676 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Calling method '.version_select at 0x7f15d58c3820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:32.707794 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:32.707794 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:32.709400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d1198a4b-066f-4ec5-a8ed-b354b7218676 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5a0d5f90acaa4a8e9f302362ef518d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:32.712131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1198a4b-066f-4ec5-a8ed-b354b7218676 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:32.714756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1198a4b-066f-4ec5-a8ed-b354b7218676 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027811 Nov 27 20:45:32.715799 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 22/49] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:32 2021] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:32.738528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13b3cd1a-050b-4508-81e7-32c746f4c43f tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Calling method '.version_select at 0x7f15d58dde50>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:32.742456 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:32.742456 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:32.746394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-13b3cd1a-050b-4508-81e7-32c746f4c43f tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5a0d5f90acaa4a8e9f302362ef518d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:32.748681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13b3cd1a-050b-4508-81e7-32c746f4c43f tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:32.749671 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13b3cd1a-050b-4508-81e7-32c746f4c43f tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022634 Nov 27 20:45:32.751399 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 23/50] 10.222.0.21 () {58 vars in 1178 bytes} [Sat Nov 27 20:45:32 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:32.763051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:32.765524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:32.793991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:32.799026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:32.801401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:32.801735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:32.954043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:32.967373 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f58fc4db-1904-470e-bcd5-4b962c255388 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1295 microversion: 2.1 time: 0.212983 Nov 27 20:45:32.969209 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 24/51] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:32 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1295 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:33.172028 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bdf17c0b-ec61-4da6-a185-a16dff441c39 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1760349887/action" status: 200 len: 97 microversion: 2.1 time: 0.593387 Nov 27 20:45:33.176183 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 28/52] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:32 2021] POST /compute/v2.1/flavors/1760349887/action => generated 97 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:33.188611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2bac9fb0-6e50-4c92-bc83-b70899c190d6 tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e289b137b09743c399e30e4ffa1bab40"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:33.190228 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:33.190228 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:33.191485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2bac9fb0-6e50-4c92-bc83-b70899c190d6 tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '2225ee361ad844ff91886aa430272b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e289b137b09743c399e30e4ffa1bab40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:33.192528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2bac9fb0-6e50-4c92-bc83-b70899c190d6 tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:33.193341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2bac9fb0-6e50-4c92-bc83-b70899c190d6 tempest-FlavorsAccessNegativeTestJSON-881209055 tempest-FlavorsAccessNegativeTestJSON-881209055-project] 10.222.0.21 "POST /compute/v2.1/flavors/1760349887/action" status: 403 len: 133 microversion: 2.1 time: 0.010395 Nov 27 20:45:33.194112 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 29/53] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:33 2021] POST /compute/v2.1/flavors/1760349887/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:45:33.202949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:33.203788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:33.210165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:33.210845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:33.211848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:33.212520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:33.287414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:33.296876 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7c93b90-023c-4462-9371-c3b9a5eff2c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1277 microversion: 2.1 time: 0.099154 Nov 27 20:45:33.297451 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 30/54] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:33 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:33.309414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2e81c385-68e5-49a0-9eec-5330908e3b2e tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e289b137b09743c399e30e4ffa1bab40"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:33.311879 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:33.311879 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:33.742775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Calling method '.version_select at 0x7f15d58c3d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:33.745057 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:33.745057 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:33.747645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:33.748585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:33.788393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:33.789584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:33.833166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:33.834791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:33.853035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f32a332d-486a-4fb6-9f00-700d69bc6177 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.881919 Nov 27 20:45:33.855414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 25/55] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:32 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:33.884597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8600a2e9-742c-43cb-9480-c061ac5493f0 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Calling method '.version_select at 0x7f15d4ff7ee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:33.893253 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:33.893253 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:33.899004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8600a2e9-742c-43cb-9480-c061ac5493f0 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5a0d5f90acaa4a8e9f302362ef518d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:33.906103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8600a2e9-742c-43cb-9480-c061ac5493f0 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:33.910142 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8600a2e9-742c-43cb-9480-c061ac5493f0 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.046358 Nov 27 20:45:33.915846 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 26/56] 10.222.0.21 () {58 vars in 1172 bytes} [Sat Nov 27 20:45:33 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:33.941314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40aa4f6d-3f19-4bb3-b5b0-7f3c51d0c56d tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Calling method '.version_select at 0x7f15d4fea940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:33.955288 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-40aa4f6d-3f19-4bb3-b5b0-7f3c51d0c56d tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] HTTP exception thrown: Hypervisor with ID '1c5f8976-76aa-451d-8d38-879bc221dd17' could not be found. Nov 27 20:45:33.959564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40aa4f6d-3f19-4bb3-b5b0-7f3c51d0c56d tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Returning 404 to user: Hypervisor with ID '1c5f8976-76aa-451d-8d38-879bc221dd17' could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:33.960518 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40aa4f6d-3f19-4bb3-b5b0-7f3c51d0c56d tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1c5f8976-76aa-451d-8d38-879bc221dd17/uptime" status: 404 len: 123 microversion: 2.1 time: 0.036459 Nov 27 20:45:33.966925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 27/57] 10.222.0.21 () {58 vars in 1277 bytes} [Sat Nov 27 20:45:33 2021] GET /compute/v2.1/os-hypervisors/1c5f8976-76aa-451d-8d38-879bc221dd17/uptime => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:33.972582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Calling method '.version_select at 0x7f15d4f8b550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:33.973802 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:33.973802 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:33.988518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:33.988983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:34.085491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2e81c385-68e5-49a0-9eec-5330908e3b2e tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1760349887/action" status: 200 len: 21 microversion: 2.1 time: 0.781188 Nov 27 20:45:34.090896 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 31/58] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:33 2021] POST /compute/v2.1/flavors/1760349887/action => generated 21 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:34.098885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:34.103194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:34.120037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:34.122312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:34.144245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:34.153164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:34.155787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:34.159696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:34.177146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:34.177838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:34.196181 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bda8cc10-30e2-4f9e-92da-6facad66cd32 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.227259 Nov 27 20:45:34.197267 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 28/59] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:33 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:34.212771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0c3a888b-a138-4a2b-a6f2-20ba8dd24003 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:34.216842 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:34.216842 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:34.274601 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0c3a888b-a138-4a2b-a6f2-20ba8dd24003 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1760349887" status: 202 len: 0 microversion: 2.1 time: 0.075976 Nov 27 20:45:34.291010 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 29/60] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:45:34 2021] DELETE /compute/v2.1/flavors/1760349887 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:45:34.319594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3fa948ec-42cc-4b8b-afb2-e91a832c1044 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Calling method '.version_select at 0x7f15d4ff74c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:34.324214 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:34.324214 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:34.326026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3fa948ec-42cc-4b8b-afb2-e91a832c1044 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5a0d5f90acaa4a8e9f302362ef518d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:34.332107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3fa948ec-42cc-4b8b-afb2-e91a832c1044 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:34.333049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3fa948ec-42cc-4b8b-afb2-e91a832c1044 tempest-HypervisorAdminNegativeTestJSON-1185654268 tempest-HypervisorAdminNegativeTestJSON-1185654268-project] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.037643 Nov 27 20:45:34.333715 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 30/61] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:45:34 2021] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:34.358493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9532b87d-e09c-4888-b663-4b5838b16567 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:34.393537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:34.411075 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99b279e9-ccc9-4ad5-95bc-f32504132964 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1295 microversion: 2.1 time: 0.313577 Nov 27 20:45:34.437977 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 32/62] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:34 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1295 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:34.449581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:34.451291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:34.459990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:34.460679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:34.461893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:34.462688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:34.470128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9532b87d-e09c-4888-b663-4b5838b16567 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.129842 Nov 27 20:45:34.475168 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 31/63] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:34 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:34.507914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73a53dec-bcc6-4d00-b6ae-52bb3336ba57 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Calling method '.version_select at 0x7f15d4ff7670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:34.527910 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-73a53dec-bcc6-4d00-b6ae-52bb3336ba57 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] HTTP exception thrown: Hypervisor with ID 'fde5622e-8dbb-4d48-acbd-6099761d50d2' could not be found. Nov 27 20:45:34.528513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73a53dec-bcc6-4d00-b6ae-52bb3336ba57 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] Returning 404 to user: Hypervisor with ID 'fde5622e-8dbb-4d48-acbd-6099761d50d2' could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:34.529352 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73a53dec-bcc6-4d00-b6ae-52bb3336ba57 tempest-HypervisorAdminNegativeTestJSON-326380515 tempest-HypervisorAdminNegativeTestJSON-326380515-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/fde5622e-8dbb-4d48-acbd-6099761d50d2" status: 404 len: 123 microversion: 2.1 time: 0.049234 Nov 27 20:45:34.529900 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 32/64] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 20:45:34 2021] GET /compute/v2.1/os-hypervisors/fde5622e-8dbb-4d48-acbd-6099761d50d2 => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:34.534848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-118ee76e-6f93-4f97-a0b7-96b3b0e37393 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1215876708", "id": 1801841112, "os-flavor-access:is_public": "False"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:34.550049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:34.560084 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e35d5318-11c9-43e0-844b-cdff8ce3453c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1277 microversion: 2.1 time: 0.120864 Nov 27 20:45:34.563597 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:34.563597 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:34.564741 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 33/65] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:34 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:34.612125 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-118ee76e-6f93-4f97-a0b7-96b3b0e37393 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.081070 Nov 27 20:45:34.614152 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 33/66] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:34 2021] POST /compute/v2.1/flavors => generated 439 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:34.645073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec6ba1ae-3479-49ee-a069-a7c444dd0282 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ad21beb2525548d0b8ebb140ddae2375"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:34.646784 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:34.646784 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:35.431440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:35.433302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:35.453417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:35.454113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:35.456210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:35.458965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:35.542959 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-ec6ba1ae-3479-49ee-a069-a7c444dd0282 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] HTTP exception thrown: Flavor access not found for 21 / ad21beb2525548d0b8ebb140ddae2375 combination. Nov 27 20:45:35.545461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec6ba1ae-3479-49ee-a069-a7c444dd0282 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Returning 404 to user: Flavor access not found for 21 / ad21beb2525548d0b8ebb140ddae2375 combination. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:35.550854 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec6ba1ae-3479-49ee-a069-a7c444dd0282 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1801841112/action" status: 404 len: 124 microversion: 2.1 time: 0.912969 Nov 27 20:45:35.554750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 34/67] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:45:34 2021] POST /compute/v2.1/flavors/1801841112/action => generated 124 bytes in 917 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:35.574672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e2aa1f07-e643-462d-a1ad-9cf2fd298e1f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:35.577632 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:35.577632 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:35.690617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e2aa1f07-e643-462d-a1ad-9cf2fd298e1f tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1801841112" status: 202 len: 0 microversion: 2.1 time: 0.123677 Nov 27 20:45:35.694093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 35/68] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:45:35 2021] DELETE /compute/v2.1/flavors/1801841112 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:45:35.713127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:35.720361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:35.760974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:35.767100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:35.767100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:35.782082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:35.978324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:35.990022 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60bd6529-d9a2-425e-b514-ca5de3c18c43 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1277 microversion: 2.1 time: 0.293827 Nov 27 20:45:35.991400 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 36/69] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:35 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:35.998871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0162eb3d-bf43-4c3a-8c7e-45e62cea8807 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:36.070936 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0162eb3d-bf43-4c3a-8c7e-45e62cea8807 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067385 Nov 27 20:45:36.073482 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 37/70] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:35 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:36.182463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:36.213496 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-411a69e6-ec45-40f3-9e9e-cdfaf951dc03 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.784622 Nov 27 20:45:36.223593 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 34/71] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:35 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:37.012198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:37.015646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:37.034017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:37.034939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:37.036331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:37.037204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:37.231416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:37.233672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:37.241369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:37.242185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:37.243350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:37.244185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:37.527094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:37.540597 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71857d37-b82e-4f56-8ea2-5fc11a14dc1e tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.534358 Nov 27 20:45:37.542873 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 38/72] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:37 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:38.091906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:38.102362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-058941d3-8da5-4a59-a0ed-6ca7abd29511 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.874542 Nov 27 20:45:38.108640 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 35/73] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:37 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:38.560117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:38.562050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:38.574976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:38.579752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:38.581166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:38.583188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:39.126851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:39.128247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:39.141779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:39.147020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:39.147995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:39.148504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:39.571236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:39.587861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-277a0a0a-7a04-404e-a856-56aaed937635 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 1.031373 Nov 27 20:45:39.593194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 39/74] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:38 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:40.308749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9dd3a5be-c009-4abb-bf8e-947503968782 tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-40929445", "id": 15143199, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:40.310309 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:40.310309 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:40.346878 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9dd3a5be-c009-4abb-bf8e-947503968782 tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 460 microversion: 2.61 time: 0.664078 Nov 27 20:45:40.349117 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 40/75] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 20:45:39 2021] POST /compute/v2.1/flavors => generated 460 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:45:40.373547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:40.383129 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21d1ef65-b60f-44d7-9d9d-5a44fb3347cd tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 1.260303 Nov 27 20:45:40.387450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 36/76] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:39 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:40.982936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7578078-7e51-43c0-94b6-9ab19ca75ee7 tempest-FlavorsV261TestJSON-2069052133 tempest-FlavorsV261TestJSON-2069052133-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.007802 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7578078-7e51-43c0-94b6-9ab19ca75ee7 tempest-FlavorsV261TestJSON-2069052133 tempest-FlavorsV261TestJSON-2069052133-project] 10.222.0.21 "GET /compute/v2.1/flavors/15143199" status: 200 len: 460 microversion: 2.61 time: 0.650399 Nov 27 20:45:41.016590 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 41/77] 10.222.0.21 () {60 vars in 1192 bytes} [Sat Nov 27 20:45:40 2021] GET /compute/v2.1/flavors/15143199 => generated 460 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:45:41.022195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.027425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:41.045080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.045842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.048100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.048805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.078687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-736a8fe3-909c-4632-92f3-7270d1b6f291 req-ed442ff9-9329-4b2f-9219-b0bb51908c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d9f5e3-7112-4787-b2e4-ba60005e60c1", "tag": "99a5e719-2b40-469f-9550-26151b5762fb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:41.080188 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:41.080188 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:41.099539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-736a8fe3-909c-4632-92f3-7270d1b6f291 req-ed442ff9-9329-4b2f-9219-b0bb51908c95 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.099980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-736a8fe3-909c-4632-92f3-7270d1b6f291 req-ed442ff9-9329-4b2f-9219-b0bb51908c95 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.161136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-736a8fe3-909c-4632-92f3-7270d1b6f291 req-ed442ff9-9329-4b2f-9219-b0bb51908c95 service nova] Creating event network-changed:99a5e719-2b40-469f-9550-26151b5762fb for instance 46d9f5e3-7112-4787-b2e4-ba60005e60c1 on nch1-master-1 Nov 27 20:45:41.161691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-736a8fe3-909c-4632-92f3-7270d1b6f291 req-ed442ff9-9329-4b2f-9219-b0bb51908c95 service nova] Acquired lock "compute-rpcapi-router" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:45:41.162847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a38a5a98-5d59-4d97-abab-f2b8399e5d18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.163301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a38a5a98-5d59-4d97-abab-f2b8399e5d18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.164152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a38a5a98-5d59-4d97-abab-f2b8399e5d18 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.164607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a38a5a98-5d59-4d97-abab-f2b8399e5d18 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.187044 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.rpcapi [None req-a38a5a98-5d59-4d97-abab-f2b8399e5d18 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 27 20:45:41.194452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a38a5a98-5d59-4d97-abab-f2b8399e5d18 None None] Releasing lock "compute-rpcapi-router" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:45:41.254845 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a38a5a98-5d59-4d97-abab-f2b8399e5d18 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.865667 Nov 27 20:45:41.256070 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 37/78] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:45:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:41.262654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b8293f8-80b8-4ed4-b2a1-669661806ccd tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:41.264635 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:41.264635 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:41.290682 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b8293f8-80b8-4ed4-b2a1-669661806ccd tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] 10.222.0.21 "PUT /compute/v2.1/flavors/15143199" status: 200 len: 461 microversion: 2.61 time: 0.033179 Nov 27 20:45:41.298995 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 38/79] 10.222.0.21 () {62 vars in 1212 bytes} [Sat Nov 27 20:45:41 2021] PUT /compute/v2.1/flavors/15143199 => generated 461 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:45:41.304780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bdd85040-043c-4f67-92b4-749dd3a1ba2f tempest-FlavorsV261TestJSON-2069052133 tempest-FlavorsV261TestJSON-2069052133-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.329749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bdd85040-043c-4f67-92b4-749dd3a1ba2f tempest-FlavorsV261TestJSON-2069052133 tempest-FlavorsV261TestJSON-2069052133-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 6242 microversion: 2.61 time: 0.029140 Nov 27 20:45:41.330484 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 39/80] 10.222.0.21 () {60 vars in 1186 bytes} [Sat Nov 27 20:45:41 2021] GET /compute/v2.1/flavors/detail => generated 6242 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:45:41.390418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:41.409892 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1e3756dc-e24e-497b-b7b1-47a9bd060702 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.394236 Nov 27 20:45:41.429841 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 42/81] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:41 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:41.444835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba4605c7-9355-47ab-84b2-87aed71d3064 tempest-FlavorsV261TestJSON-2069052133 tempest-FlavorsV261TestJSON-2069052133-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.486953 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba4605c7-9355-47ab-84b2-87aed71d3064 tempest-FlavorsV261TestJSON-2069052133 tempest-FlavorsV261TestJSON-2069052133-project] 10.222.0.21 "GET /compute/v2.1/flavors" status: 200 len: 3149 microversion: 2.61 time: 0.055155 Nov 27 20:45:41.489078 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 43/82] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:45:41 2021] GET /compute/v2.1/flavors => generated 3149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:45:41.498039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.499171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:41.510898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.511829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.513894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.514907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.857758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:41.871342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bee704c8-2ef4-4a1e-9785-50fe19a9a55b tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.377156 Nov 27 20:45:41.872432 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 44/83] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:41 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:41.884353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-272da9ee-f063-4a1c-9805-8d5e5c892d9f tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.888615 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:41.888615 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:41.907879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Calling method '.version_select at 0x7f15d4f77430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.909690 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:41.909690 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:41.917423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.919609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:41.944701 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-272da9ee-f063-4a1c-9805-8d5e5c892d9f tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/15143199" status: 202 len: 0 microversion: 2.61 time: 0.068227 Nov 27 20:45:41.947969 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 45/84] 10.222.0.21 () {60 vars in 1195 bytes} [Sat Nov 27 20:45:41 2021] DELETE /compute/v2.1/flavors/15143199 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:45:41.969135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c78033f-07b7-4163-ab16-1fc4d0f3dd28 tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:41.986036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:41.991348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.045332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.049624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.065527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c78033f-07b7-4163-ab16-1fc4d0f3dd28 tempest-FlavorsV261TestJSON-2032183062 tempest-FlavorsV261TestJSON-2032183062-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.109510 Nov 27 20:45:42.070317 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 46/85] 10.222.0.21 () {60 vars in 1186 bytes} [Sat Nov 27 20:45:41 2021] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:45:42.073429 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a18f6631-6770-46f6-a906-13b667aab911 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.730909 Nov 27 20:45:42.074306 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 40/86] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:41 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:42.093430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Calling method '.version_select at 0x7f15d47095e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:42.099171 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:42.099171 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:42.107086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=135680) load_cells /opt/stack/nova/nova/compute/api.py:302}} Nov 27 20:45:42.107941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.108382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.184775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.185247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.275997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.277919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.290817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e9148170-47c1-4c1d-8093-ee61b7c184c0 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.207957 Nov 27 20:45:42.299301 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 47/87] 10.222.0.21 () {58 vars in 1211 bytes} [Sat Nov 27 20:45:42 2021] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 196 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:42.304755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Calling method '.version_select at 0x7f15d4f77310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:42.305793 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:42.305793 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:42.308138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.308776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.339564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.341696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.364786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.365232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.385370 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5c752fef-34e1-4f09-a88f-efde0af6e2a7 tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.083464 Nov 27 20:45:42.389154 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 41/88] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:42 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:42.399365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1f8e707-5bb5-4a09-ad94-8686aeff4a5d tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Calling method '.version_select at 0x7f15d46c4550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:42.400539 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:42.400539 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:42.402244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1f8e707-5bb5-4a09-ad94-8686aeff4a5d tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.402862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1f8e707-5bb5-4a09-ad94-8686aeff4a5d tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.435467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:42.436334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:42.442360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1f8e707-5bb5-4a09-ad94-8686aeff4a5d tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.443243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1f8e707-5bb5-4a09-ad94-8686aeff4a5d tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.451002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.456317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.458779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.460169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.470125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1f8e707-5bb5-4a09-ad94-8686aeff4a5d tempest-HypervisorAdminUnderV252Test-1776369012 tempest-HypervisorAdminUnderV252Test-1776369012-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.074528 Nov 27 20:45:42.477023 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 48/89] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 20:45:42 2021] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:42.889967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:42.890968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:42.901037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.904905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:42.906667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:42.908968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:43.323903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:43.337960 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-778f1497-0e41-4105-b89b-b95229813fd9 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.453077 Nov 27 20:45:43.339147 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 49/90] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:42 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:43.393162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a5339781-6652-481c-a725-46f27fb32c5f req-428f9cc0-7a97-4d97-bd41-f2335ec1110c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d80b32-2808-471a-8a0e-4be5eef50ad1", "tag": "d41d0e33-705d-4cdf-be42-526f502364c1"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:43.394598 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:43.394598 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:43.451762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a5339781-6652-481c-a725-46f27fb32c5f req-428f9cc0-7a97-4d97-bd41-f2335ec1110c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:43.453032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a5339781-6652-481c-a725-46f27fb32c5f req-428f9cc0-7a97-4d97-bd41-f2335ec1110c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:43.501479 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a5339781-6652-481c-a725-46f27fb32c5f req-428f9cc0-7a97-4d97-bd41-f2335ec1110c service nova] Creating event network-changed:d41d0e33-705d-4cdf-be42-526f502364c1 for instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 on nch2-master-1 Nov 27 20:45:43.506848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a5339781-6652-481c-a725-46f27fb32c5f req-428f9cc0-7a97-4d97-bd41-f2335ec1110c service nova] Acquired lock "compute-rpcapi-router" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:45:43.508727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af76342f-af3e-4a34-a934-ddc90a0e03a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:43.513719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af76342f-af3e-4a34-a934-ddc90a0e03a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:43.514930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af76342f-af3e-4a34-a934-ddc90a0e03a9 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:43.519174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af76342f-af3e-4a34-a934-ddc90a0e03a9 None None] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:43.536019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.compute.rpcapi [None req-af76342f-af3e-4a34-a934-ddc90a0e03a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 27 20:45:43.537600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af76342f-af3e-4a34-a934-ddc90a0e03a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:45:43.598053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af76342f-af3e-4a34-a934-ddc90a0e03a9 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208624 Nov 27 20:45:43.598969 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 50/91] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:45:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:43.851759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:43.873460 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-09671c29-76db-4be0-aa97-460b482106f0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 1.442722 Nov 27 20:45:43.894959 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 42/92] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:42 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:44.359202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:44.360617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:44.380365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:44.386919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:44.387883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:44.388264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:44.734257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:44.747512 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b25a2ce5-2eeb-46aa-863a-5c46f9884233 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.394564 Nov 27 20:45:44.759810 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 51/93] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:44 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:44.898024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:44.898696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:44.914736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:44.919573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:44.920376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:44.920845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:45.320701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:45.336183 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d9b49f6-e15e-424a-b30b-5d37ed159856 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.436904 Nov 27 20:45:45.336183 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 43/94] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:44 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:45.773076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:45.773840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:45.781121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:45.783964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:45.786827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:45.787476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:46.264799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:46.274111 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05711d29-c80e-4443-9de4-03d230306753 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.512666 Nov 27 20:45:46.295313 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 52/95] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:45 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:46.361326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:46.368200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:46.379005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:46.383223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:46.386842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:46.387516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:46.770496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:46.780632 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa2ef979-baf3-41cd-9f93-b517746c2b52 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.433445 Nov 27 20:45:46.781224 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 44/96] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:46 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:47.301198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:47.302937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:47.315462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:47.316504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:47.320514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:47.321422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:47.673914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:47.692102 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-beda993f-555d-42e9-9b8c-00caa427ac85 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.394248 Nov 27 20:45:47.708079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 53/97] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:47 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:47.798162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:47.799029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:47.810949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:47.812753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:47.815188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:47.818830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:48.092067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:48.101459 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68d5b0f0-be4d-4c09-97ff-5114f2077aa9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.307615 Nov 27 20:45:48.102572 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 45/98] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:47 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:48.317210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-692b71a6-ba3e-4045-85bf-ecd67eb9bc43 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1865390524", "ram": 512, "vcpus": 1, "disk": 10, "id": 1863957575, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:48.319744 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:48.319744 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:48.336932 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-692b71a6-ba3e-4045-85bf-ecd67eb9bc43 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.289398 Nov 27 20:45:48.349712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a920210-5e88-4f7b-b6a6-d89ba856f513 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:48.351019 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:48.351019 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:48.357788 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 54/99] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:48 2021] POST /compute/v2.1/flavors => generated 416 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:48.391267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a920210-5e88-4f7b-b6a6-d89ba856f513 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1863957575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045416 Nov 27 20:45:48.403595 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 46/100] 10.222.0.21 () {60 vars in 1223 bytes} [Sat Nov 27 20:45:48 2021] POST /compute/v2.1/flavors/1863957575/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:48.630361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-830a6648-b9a5-4334-8b82-1ec5abab5548 tempest-FlavorsExtraSpecsTestJSON-1794211784 tempest-FlavorsExtraSpecsTestJSON-1794211784-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:48.640885 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-830a6648-b9a5-4334-8b82-1ec5abab5548 tempest-FlavorsExtraSpecsTestJSON-1794211784 tempest-FlavorsExtraSpecsTestJSON-1794211784-project] 10.222.0.21 "GET /compute/v2.1/flavors/1863957575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.242672 Nov 27 20:45:48.651822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-467e1de8-f8dd-43dc-807e-ba7d41a87196 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:48.658703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 55/101] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 20:45:48 2021] GET /compute/v2.1/flavors/1863957575/os-extra_specs => generated 66 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:48.678677 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-467e1de8-f8dd-43dc-807e-ba7d41a87196 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1863957575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029344 Nov 27 20:45:48.688638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-512a785d-0d8d-48c3-81a5-9b84141a69b7 tempest-FlavorsExtraSpecsTestJSON-1794211784 tempest-FlavorsExtraSpecsTestJSON-1794211784-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:48.694518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 47/102] 10.222.0.21 () {60 vars in 1223 bytes} [Sat Nov 27 20:45:48 2021] POST /compute/v2.1/flavors/1863957575/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:48.699513 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-512a785d-0d8d-48c3-81a5-9b84141a69b7 tempest-FlavorsExtraSpecsTestJSON-1794211784 tempest-FlavorsExtraSpecsTestJSON-1794211784-project] 10.222.0.21 "GET /compute/v2.1/flavors/1863957575/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014275 Nov 27 20:45:48.700200 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 56/103] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 20:45:48 2021] GET /compute/v2.1/flavors/1863957575/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:45:48.711330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4fe64409-f661-4e4c-98be-427e0bcefc70 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:48.727577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:48.734999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:48.750432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:48.751245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:48.752295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:48.753919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:48.771889 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4fe64409-f661-4e4c-98be-427e0bcefc70 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1863957575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064784 Nov 27 20:45:48.772561 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 48/104] 10.222.0.21 () {60 vars in 1223 bytes} [Sat Nov 27 20:45:48 2021] POST /compute/v2.1/flavors/1863957575/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:48.788102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4dd3986a-9b42-4e27-af42-ec9f63d7500c tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:48.809454 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4dd3986a-9b42-4e27-af42-ec9f63d7500c tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/1863957575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023203 Nov 27 20:45:48.810095 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 49/105] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 20:45:48 2021] GET /compute/v2.1/flavors/1863957575/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:48.819131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64af21e7-2aca-444a-9c94-695a7c00fdf7 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:48.820356 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:48.820356 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:48.862366 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64af21e7-2aca-444a-9c94-695a7c00fdf7 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "PUT /compute/v2.1/flavors/1863957575/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.046649 Nov 27 20:45:48.863411 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 50/106] 10.222.0.21 () {60 vars in 1264 bytes} [Sat Nov 27 20:45:48 2021] PUT /compute/v2.1/flavors/1863957575/os-extra_specs/hw:numa_nodes => generated 22 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:45:48.895718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a729f1e4-021b-49d7-8051-2cd05b33ad85 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:48.911220 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a729f1e4-021b-49d7-8051-2cd05b33ad85 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/1863957575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027453 Nov 27 20:45:48.912094 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 51/107] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 20:45:48 2021] GET /compute/v2.1/flavors/1863957575/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:48.922649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea7f0f7f-eb87-40c3-8036-916de454f2ad tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:48.923438 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:48.923438 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:48.967029 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea7f0f7f-eb87-40c3-8036-916de454f2ad tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1863957575/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.048674 Nov 27 20:45:48.968648 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 52/108] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 20:45:48 2021] DELETE /compute/v2.1/flavors/1863957575/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:45:48.976249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-367593c4-af36-4d01-a019-9442fd2dadff tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:49.013526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-367593c4-af36-4d01-a019-9442fd2dadff tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1863957575/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.041337 Nov 27 20:45:49.014493 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 53/109] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 20:45:48 2021] DELETE /compute/v2.1/flavors/1863957575/os-extra_specs/hw:cpu_policy => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 27 20:45:49.024117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bebf5d63-cdde-45bb-bbfd-84739ece987b tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:49.037613 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bebf5d63-cdde-45bb-bbfd-84739ece987b tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/1863957575/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018845 Nov 27 20:45:49.038898 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 54/110] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 20:45:49 2021] GET /compute/v2.1/flavors/1863957575/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:45:49.052282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5275311a-5426-445e-81b9-875c5aa9a5b5 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:49.053631 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:49.053631 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:49.060001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:49.070111 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-075300a5-876e-41a2-8933-855e68e21093 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.352475 Nov 27 20:45:49.070782 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 57/111] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:48 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:49.086688 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5275311a-5426-445e-81b9-875c5aa9a5b5 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1863957575" status: 202 len: 0 microversion: 2.1 time: 0.038358 Nov 27 20:45:49.090499 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 55/112] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:45:49 2021] DELETE /compute/v2.1/flavors/1863957575 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:45:49.098732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-566ef5ec-e3be-4c4d-a808-b4d0675f7a41 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:49.121450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:49.122209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:49.137069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:49.137532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:49.142129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:49.142646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:49.281764 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-566ef5ec-e3be-4c4d-a808-b4d0675f7a41 tempest-FlavorsExtraSpecsTestJSON-1105500535 tempest-FlavorsExtraSpecsTestJSON-1105500535-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.186547 Nov 27 20:45:49.282937 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 58/113] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:49 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:49.373242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:49.385147 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0d9c7a1-ae39-461b-853c-49d268a3842c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.267869 Nov 27 20:45:49.386717 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 56/114] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:49 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:50.061897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f45ecfc1-db60-489f-b60e-0b8a086213f8 tempest-InstanceUsageAuditLogTestJSON-79906592 tempest-InstanceUsageAuditLogTestJSON-79906592-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.062671 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.062671 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:50.081941 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f45ecfc1-db60-489f-b60e-0b8a086213f8 tempest-InstanceUsageAuditLogTestJSON-79906592 tempest-InstanceUsageAuditLogTestJSON-79906592-project-admin] 10.222.0.21 "GET /compute/v2.1/os-instance_usage_audit_log/2021-11-27 20:45:49" status: 200 len: 318 microversion: 2.1 time: 0.277562 Nov 27 20:45:50.089904 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 59/115] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 20:45:49 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-11-27%2020%3A45%3A49 => generated 318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.094120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.094939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db1f3bd1-bb21-4c01-b633-963792fd22d2 tempest-InstanceUsageAuditLogTestJSON-79906592 tempest-InstanceUsageAuditLogTestJSON-79906592-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.095842 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.095842 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:50.096604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:50.106109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.107013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.108107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.108733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.109765 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db1f3bd1-bb21-4c01-b633-963792fd22d2 tempest-InstanceUsageAuditLogTestJSON-79906592 tempest-InstanceUsageAuditLogTestJSON-79906592-project-admin] 10.222.0.21 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.018738 Nov 27 20:45:50.115640 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 60/116] 10.222.0.21 () {58 vars in 1184 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.257884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d4747430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.259057 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.259057 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:50.261237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.261866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.280632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.281120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.291572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.292120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.297990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c500a2b6-0d01-47c6-b2da-6b579706e253 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.180932 Nov 27 20:45:50.298952 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 61/117] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.309963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d4643dc0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.310824 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.310824 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:50.312748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.313225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.333584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.334314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.350171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.350978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.359466 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-907b7437-cb80-4ec8-b8dc-b18864f257e2 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.054233 Nov 27 20:45:50.361718 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 62/118] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:50.376335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d47470d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.377384 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.377384 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:50.379749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.380388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.395164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.395968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.420483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.420944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.429223 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6be4b69c-281b-436d-9018-eeeaeb75d3c0 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056521 Nov 27 20:45:50.435506 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 63/119] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.440410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.441041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:50.447823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.448546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.450666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.451431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.512017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:50.519797 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dbdbdefa-3e72-4683-8dc1-9b143e9ec45d tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.436071 Nov 27 20:45:50.532253 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 57/120] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:50.536822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e905a306-1e66-4618-8c61-da3b9545cc70 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d4fb44c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.537606 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.537606 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:50.539105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e905a306-1e66-4618-8c61-da3b9545cc70 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.539574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e905a306-1e66-4618-8c61-da3b9545cc70 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.567015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e905a306-1e66-4618-8c61-da3b9545cc70 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.567489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e905a306-1e66-4618-8c61-da3b9545cc70 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.575151 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e905a306-1e66-4618-8c61-da3b9545cc70 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.041758 Nov 27 20:45:50.575778 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 58/121] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.589517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b5928278-8b91-4973-a7cb-07f864e16f8d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d4fea8b0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.590296 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.590296 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:50.594070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5928278-8b91-4973-a7cb-07f864e16f8d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.595528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5928278-8b91-4973-a7cb-07f864e16f8d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.624578 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b5928278-8b91-4973-a7cb-07f864e16f8d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.038998 Nov 27 20:45:50.631765 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 59/122] 10.222.0.21 () {58 vars in 1178 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.637016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d4f77b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.637842 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.637842 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:50.640026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.640499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.663028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.663800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.678037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.678839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.689987 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74ca435d-2174-4aed-8008-5d085f8408e3 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056495 Nov 27 20:45:50.690951 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 60/123] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.703049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f620e74d-abe1-45d4-86a1-2af9a1e048df tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d58dda60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.708567 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.708567 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:50.711803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f620e74d-abe1-45d4-86a1-2af9a1e048df tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.712348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f620e74d-abe1-45d4-86a1-2af9a1e048df tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.728344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f620e74d-abe1-45d4-86a1-2af9a1e048df tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.729240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f620e74d-abe1-45d4-86a1-2af9a1e048df tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.736357 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f620e74d-abe1-45d4-86a1-2af9a1e048df tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.040107 Nov 27 20:45:50.737185 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 61/124] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:50.741390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:50.750399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-007a2f29-abbd-4e01-ba1d-9d08efaf9e1d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d4feaee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.750687 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ec37416-3a6e-4b5d-bcee-eb643568dd73 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.313848 Nov 27 20:45:50.751716 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.751716 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:50.753645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-007a2f29-abbd-4e01-ba1d-9d08efaf9e1d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.754424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-007a2f29-abbd-4e01-ba1d-9d08efaf9e1d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.754589 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 64/125] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:50.769098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-007a2f29-abbd-4e01-ba1d-9d08efaf9e1d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.770100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-007a2f29-abbd-4e01-ba1d-9d08efaf9e1d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.777246 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-007a2f29-abbd-4e01-ba1d-9d08efaf9e1d tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.030939 Nov 27 20:45:50.785450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 62/126] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:50.789472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Calling method '.version_select at 0x7f15d6ea7940>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:50.792265 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:50.792265 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:50.794114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.794955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.813001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.813687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.830001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:50.831003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:50.874769 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf590645-7e33-493b-a3e4-777814014a76 tempest-HypervisorAdminTestJSON-1603843187 tempest-HypervisorAdminTestJSON-1603843187-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.088370 Nov 27 20:45:50.876052 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 65/127] 10.222.0.21 () {58 vars in 1172 bytes} [Sat Nov 27 20:45:50 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:51.537210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:51.544108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:51.556889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:51.558493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:51.561400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:51.576024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:51.771393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:51.772039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:51.786764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:51.787467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:51.788273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:51.788713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:51.864446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:51.877462 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27350125-de38-42d7-a8dd-d28d345aaf9e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.343544 Nov 27 20:45:51.878200 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 63/128] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:51 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:52.014919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:52.024147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a146d2e-4504-4947-8aa8-ebcdd87ab3cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.256769 Nov 27 20:45:52.025312 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 66/129] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:51 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:52.912863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:52.913802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:52.920825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:52.921546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:52.922423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:52.923090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:53.041279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:53.041842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:53.049361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:53.050030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:53.050887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:53.051454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:53.144015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:53.155055 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d11128e-0b97-4118-946a-14ad9c3fe53e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.257906 Nov 27 20:45:53.158127 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 64/130] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:52 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:53.224586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:53.234792 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b45530bf-042e-4703-b488-1b125a12dadc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.197359 Nov 27 20:45:53.235816 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 67/131] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:53 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:54.174736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.175547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:54.182490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:54.183126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:54.184093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:54.184526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:54.210655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee20bb44-92fb-40ac-8d02-74543feec1e5 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Calling method '.version_select at 0x7f15d4f5f3a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.213637 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.213637 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:54.216842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee20bb44-92fb-40ac-8d02-74543feec1e5 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:54.217866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee20bb44-92fb-40ac-8d02-74543feec1e5 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:54.218995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee20bb44-92fb-40ac-8d02-74543feec1e5 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:54.219789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee20bb44-92fb-40ac-8d02-74543feec1e5 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:54.284005 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee20bb44-92fb-40ac-8d02-74543feec1e5 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.282421 Nov 27 20:45:54.285672 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 65/132] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts => generated 401 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:54.292252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.293096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:54.304509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:54.307307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:54.308859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:54.309572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:54.437158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:54.460271 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5202241-4af3-472f-901d-f096a4afba74 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.289291 Nov 27 20:45:54.461766 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 68/133] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:54.516041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:54.523590 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e622c90-2b5e-48b4-8f57-3cbbce9aead9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.236380 Nov 27 20:45:54.533555 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 66/134] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:54.801116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3347d6f4-e84d-4326-857b-3c015cee2816 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Calling method '.version_select at 0x7f15d46e19d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.803376 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.803376 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:54.808541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3347d6f4-e84d-4326-857b-3c015cee2816 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '0b5a7792dab54c4daa582c88107fbc44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb40949f71d24b4f85ec88db3e96df59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:54.809604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3347d6f4-e84d-4326-857b-3c015cee2816 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.811513 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3347d6f4-e84d-4326-857b-3c015cee2816 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] 10.222.0.21 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.346462 Nov 27 20:45:54.812060 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 69/135] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts => generated 109 bytes in 348 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:54.820778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d1df171-89a4-4769-af86-35549b3183a8 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Calling method '.version_select at 0x7f15d58dd9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.821843 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:reboot failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.821843 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:54.822997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1d1df171-89a4-4769-af86-35549b3183a8 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '0b5a7792dab54c4daa582c88107fbc44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb40949f71d24b4f85ec88db3e96df59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:54.823656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d1df171-89a4-4769-af86-35549b3183a8 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.824593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1d1df171-89a4-4769-af86-35549b3183a8 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] 10.222.0.21 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.007426 Nov 27 20:45:54.825093 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 67/136] 10.222.0.21 () {58 vars in 1190 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:54.834324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19e4cf46-09ce-41c8-b07f-f5a62a066829 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Calling method '.version_select at 0x7f15d46c4d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.835096 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:reboot failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.835096 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:54.848965 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-19e4cf46-09ce-41c8-b07f-f5a62a066829 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 27 20:45:54.850076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19e4cf46-09ce-41c8-b07f-f5a62a066829 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.851193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19e4cf46-09ce-41c8-b07f-f5a62a066829 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.020487 Nov 27 20:45:54.852374 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 70/137] 10.222.0.21 () {58 vars in 1211 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:45:54.862512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a285d7d-7725-4edf-b64a-6b85038a6445 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Calling method '.version_select at 0x7f15d4f8b430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.863384 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.863384 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:54.864720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a285d7d-7725-4edf-b64a-6b85038a6445 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '0b5a7792dab54c4daa582c88107fbc44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb40949f71d24b4f85ec88db3e96df59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:54.865477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a285d7d-7725-4edf-b64a-6b85038a6445 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.866267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a285d7d-7725-4edf-b64a-6b85038a6445 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] 10.222.0.21 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.007981 Nov 27 20:45:54.866775 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 68/138] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:54.878507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ae7abd0-f368-434c-bc5c-805f0c20a302 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Calling method '.version_select at 0x7f15d46c4310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.880332 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.880332 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:54.896304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2ae7abd0-f368-434c-bc5c-805f0c20a302 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 27 20:45:54.897014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ae7abd0-f368-434c-bc5c-805f0c20a302 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.897856 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ae7abd0-f368-434c-bc5c-805f0c20a302 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024625 Nov 27 20:45:54.898940 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 71/139] 10.222.0.21 () {58 vars in 1190 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:45:54.917653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61cee6fa-d684-46e4-9953-f8720701668e tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Calling method '.version_select at 0x7f15d46e11f0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.918587 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:shutdown failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.918587 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:54.920034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61cee6fa-d684-46e4-9953-f8720701668e tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '0b5a7792dab54c4daa582c88107fbc44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb40949f71d24b4f85ec88db3e96df59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:54.920750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61cee6fa-d684-46e4-9953-f8720701668e tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.922289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61cee6fa-d684-46e4-9953-f8720701668e tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] 10.222.0.21 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009006 Nov 27 20:45:54.923184 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 72/140] 10.222.0.21 () {58 vars in 1196 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:54.932462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52aa36b9-2037-4751-9b52-41e20f18c725 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Calling method '.version_select at 0x7f15d46e1af0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.942896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-52aa36b9-2037-4751-9b52-41e20f18c725 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 27 20:45:54.944047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52aa36b9-2037-4751-9b52-41e20f18c725 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.945364 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52aa36b9-2037-4751-9b52-41e20f18c725 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.016909 Nov 27 20:45:54.946482 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 73/141] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:45:54.956378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5dea9983-f3e6-4c41-a14d-d8e12236aa53 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Calling method '.version_select at 0x7f15d4643430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.957166 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:start failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:54.957166 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:54.958367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5dea9983-f3e6-4c41-a14d-d8e12236aa53 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '0b5a7792dab54c4daa582c88107fbc44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb40949f71d24b4f85ec88db3e96df59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:54.959002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5dea9983-f3e6-4c41-a14d-d8e12236aa53 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.959834 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5dea9983-f3e6-4c41-a14d-d8e12236aa53 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] 10.222.0.21 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.007302 Nov 27 20:45:54.960762 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 74/142] 10.222.0.21 () {58 vars in 1193 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:54.969578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44e99053-f2b5-4994-8c9c-d51fa47a8b1c tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Calling method '.version_select at 0x7f15d4612ee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:54.980676 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-44e99053-f2b5-4994-8c9c-d51fa47a8b1c tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 27 20:45:54.981837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44e99053-f2b5-4994-8c9c-d51fa47a8b1c tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.982849 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44e99053-f2b5-4994-8c9c-d51fa47a8b1c tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.016725 Nov 27 20:45:54.983845 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 75/143] 10.222.0.21 () {58 vars in 1214 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:45:54.993445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ce01e16-c6dc-4e52-917b-ec4d9a2530dc tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Action: 'update', calling method: .version_select at 0x7f15d4643430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:54.994577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ce01e16-c6dc-4e52-917b-ec4d9a2530dc tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:54.995563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ce01e16-c6dc-4e52-917b-ec4d9a2530dc tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.005747 Nov 27 20:45:54.996960 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 76/144] 10.222.0.21 () {60 vars in 1189 bytes} [Sat Nov 27 20:45:54 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 27 20:45:55.007345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9de58f35-cc93-4c2d-a390-eb9658685541 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Action: 'update', calling method: .version_select at 0x7f15d6549f70>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:55.009357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9de58f35-cc93-4c2d-a390-eb9658685541 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:55.010749 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9de58f35-cc93-4c2d-a390-eb9658685541 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.008055 Nov 27 20:45:55.011743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 77/145] 10.222.0.21 () {60 vars in 1189 bytes} [Sat Nov 27 20:45:55 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:45:55.021099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af9e7574-5ce3-4ccb-b48b-3e3d9f3c1c79 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Action: 'update', calling method: .version_select at 0x7f15d46e19d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:55.022539 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:55.022539 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:55.024002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-af9e7574-5ce3-4ccb-b48b-3e3d9f3c1c79 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '0b5a7792dab54c4daa582c88107fbc44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb40949f71d24b4f85ec88db3e96df59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:55.025183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af9e7574-5ce3-4ccb-b48b-3e3d9f3c1c79 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:55.025973 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af9e7574-5ce3-4ccb-b48b-3e3d9f3c1c79 tempest-HostsAdminNegativeTestJSON-2018696364 tempest-HostsAdminNegativeTestJSON-2018696364-project] 10.222.0.21 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.008932 Nov 27 20:45:55.031008 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 78/146] 10.222.0.21 () {60 vars in 1189 bytes} [Sat Nov 27 20:45:55 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:45:55.035862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b57987c-f1b1-4d30-a8dc-da35be4283d9 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Action: 'update', calling method: .version_select at 0x7f15d46123a0>, body: {"status": null, "maintenance_mode": null} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:55.037203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b57987c-f1b1-4d30-a8dc-da35be4283d9 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:55.038195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b57987c-f1b1-4d30-a8dc-da35be4283d9 tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.006006 Nov 27 20:45:55.043550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 79/147] 10.222.0.21 () {60 vars in 1189 bytes} [Sat Nov 27 20:45:55 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:45:55.048363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0f1e2ccd-426e-4fbc-9e83-28d24a56ae7d tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Action: 'update', calling method: .version_select at 0x7f15d468c160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:55.051641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.hosts [None req-0f1e2ccd-426e-4fbc-9e83-28d24a56ae7d tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Enabling host nonexistent_hostname. Nov 27 20:45:55.059471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0f1e2ccd-426e-4fbc-9e83-28d24a56ae7d tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 27 20:45:55.060423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0f1e2ccd-426e-4fbc-9e83-28d24a56ae7d tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:55.061456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0f1e2ccd-426e-4fbc-9e83-28d24a56ae7d tempest-HostsAdminNegativeTestJSON-1597020942 tempest-HostsAdminNegativeTestJSON-1597020942-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016601 Nov 27 20:45:55.066463 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 80/148] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:45:55 2021] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:45:55.110486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2fa4ce47-8402-4e93-ad85-2719e337b7f1 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:55.111219 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:55.111219 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:55.113910 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-2fa4ce47-8402-4e93-ad85-2719e337b7f1 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 27 20:45:55.114487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2fa4ce47-8402-4e93-ad85-2719e337b7f1 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:55.117078 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2fa4ce47-8402-4e93-ad85-2719e337b7f1 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744 tempest-InstanceUsageAuditLogNegativeTestJSON-41229744-project-admin] 10.222.0.21 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.227980 Nov 27 20:45:55.117958 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 69/149] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:54 2021] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 27 20:45:55.277601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04471079-8fc6-4a25-ba12-6e79be283b60 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:55.278349 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:55.278349 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:55.279679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04471079-8fc6-4a25-ba12-6e79be283b60 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a502fc0378a74a6cbe8caa84f781e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2116bbaf320a4283b72cbea04c986e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:55.280256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04471079-8fc6-4a25-ba12-6e79be283b60 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:55.281051 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04471079-8fc6-4a25-ba12-6e79be283b60 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] 10.222.0.21 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.157665 Nov 27 20:45:55.284765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 81/150] 10.222.0.21 () {58 vars in 1184 bytes} [Sat Nov 27 20:45:55 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:55.289892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a4aadb5e-7870-4a36-9d4a-b9df80d7a028 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:55.291209 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:55.291209 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:55.292558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a4aadb5e-7870-4a36-9d4a-b9df80d7a028 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a502fc0378a74a6cbe8caa84f781e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2116bbaf320a4283b72cbea04c986e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:55.293175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a4aadb5e-7870-4a36-9d4a-b9df80d7a028 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:45:55.293957 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a4aadb5e-7870-4a36-9d4a-b9df80d7a028 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776 tempest-InstanceUsageAuditLogNegativeTestJSON-567015776-project] 10.222.0.21 "GET /compute/v2.1/os-instance_usage_audit_log/2021-11-27 20:45:55" status: 403 len: 128 microversion: 2.1 time: 0.007776 Nov 27 20:45:55.294448 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 82/151] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 20:45:55 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-11-27%2020%3A45%3A55 => generated 128 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:45:55.382574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fa1f1ea7-0572-42d8-9ca2-ccbfec76c1ff req-ad83a87c-0617-4082-a0fb-2a0edfcd3556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d9f5e3-7112-4787-b2e4-ba60005e60c1", "name": "network-vif-plugged", "status": "completed", "tag": "99a5e719-2b40-469f-9550-26151b5762fb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:55.385109 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:55.385109 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:45:55.392597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fa1f1ea7-0572-42d8-9ca2-ccbfec76c1ff req-ad83a87c-0617-4082-a0fb-2a0edfcd3556 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:55.393043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fa1f1ea7-0572-42d8-9ca2-ccbfec76c1ff req-ad83a87c-0617-4082-a0fb-2a0edfcd3556 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:55.404580 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fa1f1ea7-0572-42d8-9ca2-ccbfec76c1ff req-ad83a87c-0617-4082-a0fb-2a0edfcd3556 service nova] Creating event network-vif-plugged:99a5e719-2b40-469f-9550-26151b5762fb for instance 46d9f5e3-7112-4787-b2e4-ba60005e60c1 on nch1-master-1 Nov 27 20:45:55.409815 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fa1f1ea7-0572-42d8-9ca2-ccbfec76c1ff req-ad83a87c-0617-4082-a0fb-2a0edfcd3556 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257579 Nov 27 20:45:55.410406 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 70/152] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:45:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:55.478072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:55.478760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:55.485094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:55.485737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:55.486701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:55.487976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:55.772492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-110225888", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:55.869783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:45:55.991866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:56.004455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b8b4c66-b0f7-4e0d-abef-649d461c015e tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.528864 Nov 27 20:45:56.014996 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 71/153] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:55 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:56.020513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:56.021378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:56.028658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:56.029776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:56.030924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:56.031775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:56.179568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:56.188932 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6af9b3c7-771a-49b5-be34-09ce8d9df427 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.172502 Nov 27 20:45:56.198312 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 72/154] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:56 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:56.242624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:45:56.243142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:45:56.244292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:45:56.245250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:45:56.245786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:45:56.259645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:56.260645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:56.261836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:56.262521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:56.287707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Getting quotas for project 86ee5c27bb6e4b2d89671817ecd59b63. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:45:56.292739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Getting quotas for user 17a180a783424ce88239c7edb25bafc3 and project 86ee5c27bb6e4b2d89671817ecd59b63. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:45:56.309160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:45:56.312732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:45:56.324271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-85b96940-309f-4709-9013-c8927f5d83cc tempest-NetworksTest-475679791 tempest-NetworksTest-475679791-project-admin] Calling method '.version_select at 0x7f15d4fb4d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:56.383011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39488d71-a231-4816-a718-b9bf7576a408 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043319 Nov 27 20:45:56.383758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 83/155] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 20:45:56.396105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc64efe3-bd84-400a-8fce-dba36490ab78 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:56.397267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc64efe3-bd84-400a-8fce-dba36490ab78 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:56.481701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc64efe3-bd84-400a-8fce-dba36490ab78 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:56.497031 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc64efe3-bd84-400a-8fce-dba36490ab78 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1222 microversion: 2.1 time: 0.105345 Nov 27 20:45:56.497991 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 84/156] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:56 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:56.530597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-85b96940-309f-4709-9013-c8927f5d83cc tempest-NetworksTest-475679791 tempest-NetworksTest-475679791-project-admin] 10.222.0.21 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.339978 Nov 27 20:45:56.531358 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 73/157] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:45:56 2021] GET /compute/v2.1/os-networks => generated 1938 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:56.551501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-028050b4-f58c-4e21-a250-ac8b143e457b tempest-NetworksTest-475679791 tempest-NetworksTest-475679791-project-admin] Calling method '.version_select at 0x7f15d4906700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:56.689114 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-028050b4-f58c-4e21-a250-ac8b143e457b tempest-NetworksTest-475679791 tempest-NetworksTest-475679791-project-admin] 10.222.0.21 "GET /compute/v2.1/os-networks/7e46e7ab-0203-480f-9b07-f121716d4c61" status: 200 len: 652 microversion: 2.1 time: 0.141444 Nov 27 20:45:56.690085 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 85/158] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 20:45:56 2021] GET /compute/v2.1/os-networks/7e46e7ab-0203-480f-9b07-f121716d4c61 => generated 652 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:56.700430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc469bc6-6e23-42d7-bbc8-fc06c8331405 tempest-NetworksTest-475679791 tempest-NetworksTest-475679791-project-admin] Calling method '.version_select at 0x7f15d4fa2700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:56.868929 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc469bc6-6e23-42d7-bbc8-fc06c8331405 tempest-NetworksTest-475679791 tempest-NetworksTest-475679791-project-admin] 10.222.0.21 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.172007 Nov 27 20:45:56.874610 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 74/159] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:45:56 2021] GET /compute/v2.1/os-networks => generated 1938 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:57.023611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:57.024604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:57.039041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:57.039618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:57.040433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:57.040866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:57.205539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:57.206146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:57.217308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:57.217793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:57.218619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:57.219052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:57.291743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:57.301127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-567dff57-d5f2-4260-a6a1-86f4bc4cbe39 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1337 microversion: 2.1 time: 0.282360 Nov 27 20:45:57.311215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 86/160] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:57 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1337 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:57.424423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f9295225-6aab-4e9e-8f17-42fd10b8a46a req-440b7dae-da71-435c-a241-5b826289c485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d80b32-2808-471a-8a0e-4be5eef50ad1", "name": "network-vif-plugged", "status": "completed", "tag": "d41d0e33-705d-4cdf-be42-526f502364c1"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:57.426298 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:57.426298 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:57.435982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f9295225-6aab-4e9e-8f17-42fd10b8a46a req-440b7dae-da71-435c-a241-5b826289c485 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:57.436813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f9295225-6aab-4e9e-8f17-42fd10b8a46a req-440b7dae-da71-435c-a241-5b826289c485 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:57.459974 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f9295225-6aab-4e9e-8f17-42fd10b8a46a req-440b7dae-da71-435c-a241-5b826289c485 service nova] Creating event network-vif-plugged:d41d0e33-705d-4cdf-be42-526f502364c1 for instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 on nch2-master-1 Nov 27 20:45:57.469288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:57.477180 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f9295225-6aab-4e9e-8f17-42fd10b8a46a req-440b7dae-da71-435c-a241-5b826289c485 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056160 Nov 27 20:45:57.478140 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 87/161] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:45:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:45:57.478230 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7931c855-1936-449b-9749-9c15f36ca82d tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.274094 Nov 27 20:45:57.488005 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 75/162] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:57 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:57.523109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:57.524718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:57.532084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:57.532976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:57.534037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:57.534695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:57.660150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:57.675978 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c3e35ec-0edd-4bfc-b28a-bed21489ea81 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1274 microversion: 2.1 time: 0.156894 Nov 27 20:45:57.687952 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 88/163] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:57 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:58.321366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:58.322943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:58.331483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.332403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.334489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.335126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.496986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:58.498323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:58.507039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.507903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.508860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.509538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.541852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:58.549349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-525e1de2-6b99-4609-b6b6-f91e5d19da6a tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1486 microversion: 2.1 time: 0.234135 Nov 27 20:45:58.552467 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 76/164] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:58 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:58.573544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8aeabb90-625a-42ab-b81b-e0377fda827a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:58.574476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8aeabb90-625a-42ab-b81b-e0377fda827a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:58.585027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aeabb90-625a-42ab-b81b-e0377fda827a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.585859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aeabb90-625a-42ab-b81b-e0377fda827a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.586996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aeabb90-625a-42ab-b81b-e0377fda827a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.587477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aeabb90-625a-42ab-b81b-e0377fda827a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.723971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:58.732969 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0b9c295-bf90-47c5-828d-c05e40550acb tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1319 microversion: 2.1 time: 0.242085 Nov 27 20:45:58.743974 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 89/165] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:58 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:58.749384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:58.750170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:45:58.756753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.757614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.759316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:58.759981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:58.838761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:45:58.847853 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40f6a7d8-f04c-4cac-8313-b91e2346e075 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1280 microversion: 2.1 time: 0.102376 Nov 27 20:45:58.851928 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 90/166] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:58 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:45:59.398316 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8aeabb90-625a-42ab-b81b-e0377fda827a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1637 microversion: 2.1 time: 0.829800 Nov 27 20:45:59.403222 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 77/167] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:45:58 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1637 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:45:59.417754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ced5e96c-36bd-4f0e-9b93-04de1b379e92 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:59.419709 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:59.419709 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:59.433539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ced5e96c-36bd-4f0e-9b93-04de1b379e92 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:45:59.444593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ced5e96c-36bd-4f0e-9b93-04de1b379e92 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:45:59.603728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ced5e96c-36bd-4f0e-9b93-04de1b379e92 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.189569 Nov 27 20:45:59.609781 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 91/168] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:45:59 2021] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:45:59.616442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ebcbf71-b51c-4376-a66b-054372deb8b5 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:45:59.617214 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:59.617214 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:59.655565 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ebcbf71-b51c-4376-a66b-054372deb8b5 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.042858 Nov 27 20:45:59.660934 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 92/169] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:45:59 2021] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:45:59.673881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0b5136f-2960-45c8-b4e2-1d627c4c6435 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-363442527"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:45:59.684017 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:59.684017 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:45:59.686104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-b0b5136f-2960-45c8-b4e2-1d627c4c6435 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid a018a9c2-e498-4551-b28d-74a5626e9546 for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:45:59.729628 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0b5136f-2960-45c8-b4e2-1d627c4c6435 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060166 Nov 27 20:45:59.731832 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 93/170] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:45:59 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:46:00.000239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1146653577", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:00.048353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec11b7b0-ec53-4bdf-8f34-193f66723f4c tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Action: 'create', calling method: .version_select at 0x7f15d4627e50>, body: {"keypair": {"name": "tempest-keypair-545479250", "type": "ssh", "user_id": "e9aa6b9f7f784161b008768c5da9db89"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:00.075498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ec11b7b0-ec53-4bdf-8f34-193f66723f4c tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:00.077216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:00.083401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ec11b7b0-ec53-4bdf-8f34-193f66723f4c tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for user ecabbae9ff55474e962adc6cda8a14ba and project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:00.243458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ec11b7b0-ec53-4bdf-8f34-193f66723f4c tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:00.248331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ec11b7b0-ec53-4bdf-8f34-193f66723f4c tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for user ecabbae9ff55474e962adc6cda8a14ba and project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:00.269826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec11b7b0-ec53-4bdf-8f34-193f66723f4c tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.534896 Nov 27 20:46:00.270619 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 94/171] 10.222.0.21 () {62 vars in 1199 bytes} [Sat Nov 27 20:45:59 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 538 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:46:00.280272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b447c178-0909-4c0d-a6ed-74aa94c22128 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:00.281525 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:00.281525 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:00.289950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b447c178-0909-4c0d-a6ed-74aa94c22128 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.290953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b447c178-0909-4c0d-a6ed-74aa94c22128 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.430333 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b447c178-0909-4c0d-a6ed-74aa94c22128 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.158758 Nov 27 20:46:00.432284 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 95/172] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:00 2021] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:00.437379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:00.438099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:00.455166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:00.458085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:00.459423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:00.460211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:00.460652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:00.469212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.469672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.470364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.470478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.470819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.471688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.472080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.472518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.496254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Getting quotas for project 7e7fd405b830467db077102575590b2e. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:00.501572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Getting quotas for user 559cab992ce74bd0b78a639e4001c918 and project 7e7fd405b830467db077102575590b2e. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:00.516051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:00.518760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:00.595159 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5a818b99-ac71-4707-b079-86158ee85380 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079443 Nov 27 20:46:00.607106 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 78/173] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:45:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 20:46:00.627147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:00.627147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:00.627340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.627989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.628100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:00.628966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.629536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.638716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dedb1383-b1cf-4dbe-b84b-33f6e3bc7c84 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1469 microversion: 2.1 time: 0.204314 Nov 27 20:46:00.640118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 96/174] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:00 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:00.646626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58259c6e-591a-4cf1-811f-625d8f094583 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Action: 'create', calling method: .version_select at 0x7f15d46270d0>, body: {"keypair": {"name": "tempest-keypair-647178940", "type": "ssh", "user_id": "e9aa6b9f7f784161b008768c5da9db89"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:00.664794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-58259c6e-591a-4cf1-811f-625d8f094583 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:00.672976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-58259c6e-591a-4cf1-811f-625d8f094583 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for user ecabbae9ff55474e962adc6cda8a14ba and project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:00.767490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-58259c6e-591a-4cf1-811f-625d8f094583 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:00.772174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-58259c6e-591a-4cf1-811f-625d8f094583 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for user ecabbae9ff55474e962adc6cda8a14ba and project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:00.788869 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58259c6e-591a-4cf1-811f-625d8f094583 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.146915 Nov 27 20:46:00.789809 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 97/175] 10.222.0.21 () {62 vars in 1199 bytes} [Sat Nov 27 20:46:00 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:46:00.801975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb496968-3a1c-42cd-bbcc-e946ba11569b tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:00.806419 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:00.806419 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:00.818437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fb496968-3a1c-42cd-bbcc-e946ba11569b tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.026567 Nov 27 20:46:00.819016 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 98/176] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:46:00 2021] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:00.823949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3bbdcce0-db5f-468c-b8e8-839c35ea251d tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:00.824610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3bbdcce0-db5f-468c-b8e8-839c35ea251d tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:00.905338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3bbdcce0-db5f-468c-b8e8-839c35ea251d tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:00.912637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3bbdcce0-db5f-468c-b8e8-839c35ea251d tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1219 microversion: 2.1 time: 0.092615 Nov 27 20:46:00.925408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 99/177] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:00 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:00.931356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1da8867e-0885-4fd9-a3c5-23ffa31e32f5 req-ce528ee3-abe9-4bf7-8f06-94bcaab0c2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "321d86fb-797f-4432-bf01-bdc5917b92ad", "tag": "7d99b7e4-cb69-4555-b647-95cd8ebd5bbe"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:00.933519 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:00.933519 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:00.941757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1da8867e-0885-4fd9-a3c5-23ffa31e32f5 req-ce528ee3-abe9-4bf7-8f06-94bcaab0c2a5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:00.942419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1da8867e-0885-4fd9-a3c5-23ffa31e32f5 req-ce528ee3-abe9-4bf7-8f06-94bcaab0c2a5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:00.956072 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1da8867e-0885-4fd9-a3c5-23ffa31e32f5 req-ce528ee3-abe9-4bf7-8f06-94bcaab0c2a5 service nova] Creating event network-changed:7d99b7e4-cb69-4555-b647-95cd8ebd5bbe for instance 321d86fb-797f-4432-bf01-bdc5917b92ad on nch2-master-1 Nov 27 20:46:00.963968 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1da8867e-0885-4fd9-a3c5-23ffa31e32f5 req-ce528ee3-abe9-4bf7-8f06-94bcaab0c2a5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036289 Nov 27 20:46:00.965170 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 100/178] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:01.041878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:01.058894 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3e040a3-d1a2-4e78-a3ad-d4e3333ae517 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1322 microversion: 2.1 time: 0.447162 Nov 27 20:46:01.059542 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 79/179] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:00 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:01.080685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d72affd-b5f4-47ad-816f-4d720f341277 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Calling method '.version_select at 0x7f15d4e97af0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:01.095415 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d72affd-b5f4-47ad-816f-4d720f341277 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "GET /compute/v2.1/os-keypairs/tempest-keypair-545479250?user_id=e9aa6b9f7f784161b008768c5da9db89" status: 200 len: 705 microversion: 2.10 time: 0.025650 Nov 27 20:46:01.096651 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 80/180] 10.222.0.21 () {60 vars in 1336 bytes} [Sat Nov 27 20:46:01 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-545479250?user_id=e9aa6b9f7f784161b008768c5da9db89 => generated 705 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:01.101625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f7df6a32-8679-472c-b002-67f56dc7a96a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:01.104439 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:01.104439 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:01.160668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7df6a32-8679-472c-b002-67f56dc7a96a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:01.161942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7df6a32-8679-472c-b002-67f56dc7a96a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:01.220189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:01.220784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:01.232515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:01.232969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:01.233907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:01.234358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:01.312625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:46:01.492046 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-546fa920-7695-46c3-941a-e5bf70022447 tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] 10.222.0.21 "DELETE /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 204 len: 0 microversion: 2.1 time: 0.524559 Nov 27 20:46:01.492953 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 101/181] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:00 2021] DELETE /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:46:01.499451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-959da9e1-a57e-467b-b996-71b292af32fc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Action: 'create', calling method: .version_select at 0x7f15d4627550>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-315130399", "type": "ssh"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:01.524072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-959da9e1-a57e-467b-b996-71b292af32fc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:01.529359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-959da9e1-a57e-467b-b996-71b292af32fc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for user ecabbae9ff55474e962adc6cda8a14ba and project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:01.696706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-959da9e1-a57e-467b-b996-71b292af32fc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:01.701151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-959da9e1-a57e-467b-b996-71b292af32fc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Getting quotas for user ecabbae9ff55474e962adc6cda8a14ba and project 3894d6693e524e35b6700cdb0feb9ecf. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:01.708378 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f7df6a32-8679-472c-b002-67f56dc7a96a tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.610443 Nov 27 20:46:01.708987 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 81/182] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:01 2021] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:01.714506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:01.715393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:01.722690 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-959da9e1-a57e-467b-b996-71b292af32fc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.10 time: 0.227711 Nov 27 20:46:01.722903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:01.723338 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 102/183] 10.222.0.21 () {62 vars in 1198 bytes} [Sat Nov 27 20:46:01 2021] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 230 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:46:01.723717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:01.724934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:01.725504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:01.836404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-651389462", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:01.891668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:01.951080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:01.965313 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71bd2216-6a0a-42da-b03f-806b3b4181e1 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1475 microversion: 2.1 time: 0.253972 Nov 27 20:46:01.966801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 82/184] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:01 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1475 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:01.981611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5aacf9b1-5b79-4667-8089-223a42f5c3b3 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:01.983200 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:01.983200 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:02.028308 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5aacf9b1-5b79-4667-8089-223a42f5c3b3 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.056352 Nov 27 20:46:02.037304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 83/185] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:01 2021] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:02.043971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84b46108-474f-4127-9d50-793214ee0a77 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Calling method '.version_select at 0x7f15d4e970d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.048810 ncdv-master-1 devstack@n-api.service[135679]: WARNING oslo_db.sqlalchemy.utils [None req-84b46108-474f-4127-9d50-793214ee0a77 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 27 20:46:02.060324 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84b46108-474f-4127-9d50-793214ee0a77 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "GET /compute/v2.1/os-keypairs?user_id=e9aa6b9f7f784161b008768c5da9db89" status: 200 len: 1112 microversion: 2.10 time: 0.021426 Nov 27 20:46:02.062409 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 84/186] 10.222.0.21 () {60 vars in 1258 bytes} [Sat Nov 27 20:46:02 2021] GET /compute/v2.1/os-keypairs?user_id=e9aa6b9f7f784161b008768c5da9db89 => generated 1112 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:02.070149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.070992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:02.082888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.088149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.089316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.090070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.143350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:02.143777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:02.144250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:02.144656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:02.145063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:02.154197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.154643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.155491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.155936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.174740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Getting quotas for project c8c32b0fff364ad7b9bbaf1fb71e3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:02.178925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Getting quotas for user 1a069b7aa4c94607943e3493c6295fb3 and project c8c32b0fff364ad7b9bbaf1fb71e3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:02.190824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:02.193321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:02.241397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-716d8a78-dff0-4e81-9aa1-1aaab47b32f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516710 Nov 27 20:46:02.242261 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 103/187] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:02.252586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2aabe692-1adb-4b4b-80c0-b5e96a257f80 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-531803588"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:02.254763 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:02.254763 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:02.256066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-2aabe692-1adb-4b4b-80c0-b5e96a257f80 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid fea57768-1696-4932-82d3-3e27fef8b422 for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:02.285967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2aabe692-1adb-4b4b-80c0-b5e96a257f80 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041580 Nov 27 20:46:02.286888 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 104/188] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:02 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:02.298874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14e5edb6-008f-4afc-951d-09878ffccafc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Calling method '.version_select at 0x7f15d45c0820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.328477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-14e5edb6-008f-4afc-951d-09878ffccafc tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-315130399" status: 204 len: 0 microversion: 2.10 time: 0.039488 Nov 27 20:46:02.329469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 105/189] 10.222.0.21 () {60 vars in 1321 bytes} [Sat Nov 27 20:46:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-315130399 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:46:02.338787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.340251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:02.346729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.347284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.348357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.352465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.357759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:02.365944 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-683fe379-6fb7-4f84-a0fd-5c95293cfdb1 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1277 microversion: 2.1 time: 0.302065 Nov 27 20:46:02.377464 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 85/190] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:02 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:02.384749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96496b53-6610-4ac8-820e-42081b8ff512 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:02.386003 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:02.386003 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:02.394446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96496b53-6610-4ac8-820e-42081b8ff512 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.394912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96496b53-6610-4ac8-820e-42081b8ff512 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.512020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:02.521422 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-093f085b-5ddd-40f4-b903-f17f46671a4c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1322 microversion: 2.1 time: 0.186439 Nov 27 20:46:02.522355 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 106/191] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:02 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:02.527440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1120540101", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:02.553131 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96496b53-6610-4ac8-820e-42081b8ff512 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.174335 Nov 27 20:46:02.556468 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 86/192] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:02 2021] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:02.562590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d3ca2f31-c2fd-4b30-8f46-0516298a4134 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Calling method '.version_select at 0x7f15d4e56550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.587523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:02.591197 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d3ca2f31-c2fd-4b30-8f46-0516298a4134 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647178940?user_id=e9aa6b9f7f784161b008768c5da9db89" status: 204 len: 0 microversion: 2.10 time: 0.034328 Nov 27 20:46:02.592094 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 87/193] 10.222.0.21 () {60 vars in 1339 bytes} [Sat Nov 27 20:46:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647178940?user_id=e9aa6b9f7f784161b008768c5da9db89 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:46:02.600232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-189d59b3-4905-48d5-8224-ec6b27b6e3ca tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.601090 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:02.601090 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:02.608952 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-189d59b3-4905-48d5-8224-ec6b27b6e3ca tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.012579 Nov 27 20:46:02.609797 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 88/194] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:46:02 2021] GET /compute/v2.1/os-aggregates => generated 244 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:02.614115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa30cf89-8e49-41fe-a4b2-437bbe64cbf8 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] Calling method '.version_select at 0x7f15d4e97ca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.637707 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa30cf89-8e49-41fe-a4b2-437bbe64cbf8 tempest-KeyPairsV210TestJSON-1851933185 tempest-KeyPairsV210TestJSON-1851933185-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545479250?user_id=e9aa6b9f7f784161b008768c5da9db89" status: 204 len: 0 microversion: 2.10 time: 0.027037 Nov 27 20:46:02.638580 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 89/195] 10.222.0.21 () {60 vars in 1339 bytes} [Sat Nov 27 20:46:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545479250?user_id=e9aa6b9f7f784161b008768c5da9db89 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:46:02.650869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f820ae1-f410-41ad-a8fd-5b58f5c944c5 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:02.652355 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:02.652355 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:02.674931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f820ae1-f410-41ad-a8fd-5b58f5c944c5 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.675457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f820ae1-f410-41ad-a8fd-5b58f5c944c5 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.836412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f820ae1-f410-41ad-a8fd-5b58f5c944c5 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.196343 Nov 27 20:46:02.837988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 90/196] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:02 2021] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:02.849868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-193bbab2-4b7b-4dac-a778-e250c69f0fc0 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:02.851073 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:02.851073 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:02.876308 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-193bbab2-4b7b-4dac-a778-e250c69f0fc0 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.030123 Nov 27 20:46:02.880277 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 91/197] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:02 2021] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:02.892596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-141f467a-074f-40d9-9115-f9f23131c972 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-876465227"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:02.894656 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:02.894656 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:02.896175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-141f467a-074f-40d9-9115-f9f23131c972 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid 544e3af0-da5b-4910-9183-a3137f86bdbd for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:02.913793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:02.914435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:02.915188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:02.915902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:02.916484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:02.928013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.928761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.929795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.930507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.938812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-141f467a-074f-40d9-9115-f9f23131c972 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.051500 Nov 27 20:46:02.940805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 92/198] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:02 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:46:02.959199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Getting quotas for project c8c32b0fff364ad7b9bbaf1fb71e3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:02.966539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Getting quotas for user 1a069b7aa4c94607943e3493c6295fb3 and project c8c32b0fff364ad7b9bbaf1fb71e3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:02.970414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-150ab80b-2c98-439c-b6fb-21eb94ae6607 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:02.972722 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:02.972722 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:02.985544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-150ab80b-2c98-439c-b6fb-21eb94ae6607 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:02.986211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-150ab80b-2c98-439c-b6fb-21eb94ae6607 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:02.990296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:02.992989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:03.073492 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e082d42b-8ab6-45ee-8fa9-fc6fe776348e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549882 Nov 27 20:46:03.079823 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 107/199] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:03.082450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:03.083073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:03.092883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:03.093522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:03.094806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:03.095498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:03.179559 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-150ab80b-2c98-439c-b6fb-21eb94ae6607 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.220257 Nov 27 20:46:03.180310 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 93/200] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:02 2021] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:03.189762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b91aff1f-94f5-4c2a-9ed2-e00105d07551 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:03.195633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b91aff1f-94f5-4c2a-9ed2-e00105d07551 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:03.288991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b91aff1f-94f5-4c2a-9ed2-e00105d07551 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:03.300194 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b91aff1f-94f5-4c2a-9ed2-e00105d07551 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1214 microversion: 2.1 time: 0.115982 Nov 27 20:46:03.301023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 94/201] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:03 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:03.313428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-beb5e98b-6014-4e54-975c-263a3d997d03 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:03.314889 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:03.314889 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:03.333193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-beb5e98b-6014-4e54-975c-263a3d997d03 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:03.333577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-beb5e98b-6014-4e54-975c-263a3d997d03 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:03.362356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:03.372485 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-01f767a9-6372-4113-96de-5e5a6565ad4c tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1475 microversion: 2.1 time: 0.295747 Nov 27 20:46:03.385345 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 108/202] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:03 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1475 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:03.392212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:03.392831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:03.401694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:03.402202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:03.403000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:03.403718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:03.525531 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-beb5e98b-6014-4e54-975c-263a3d997d03 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.221971 Nov 27 20:46:03.531330 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 95/203] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:03 2021] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:03.541986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8ab2332-6c15-4a56-83d8-92fd135cc369 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:03.543718 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:03.543718 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:03.578321 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8ab2332-6c15-4a56-83d8-92fd135cc369 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.044392 Nov 27 20:46:03.581417 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 96/204] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:03 2021] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:03.591853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:03.594226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:03.604895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:03.605553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:03.608631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:03.609275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:03.866962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:03.877536 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3df7388-933e-4363-bed6-55a755e087a5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1319 microversion: 2.1 time: 0.491002 Nov 27 20:46:03.879151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 109/205] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:03 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:03.904116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c56c6ad0-b31f-4eb8-b9f3-845c8cab0b00 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-931047808"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:03.905512 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:03.905512 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:03.906706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-c56c6ad0-b31f-4eb8-b9f3-845c8cab0b00 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid 1e5bb811-9bbc-4665-9d16-72060fb2f24e for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:03.929230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c56c6ad0-b31f-4eb8-b9f3-845c8cab0b00 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.035763 Nov 27 20:46:03.929879 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 110/206] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:03 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:03.940434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-daac334f-8e30-4219-9e0d-0fd9c100fa3a tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-530160005"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:03.941719 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:03.941719 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:03.942880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-daac334f-8e30-4219-9e0d-0fd9c100fa3a tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid 6c352922-d910-41ba-bcbb-92c7e820991e for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:03.969148 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-daac334f-8e30-4219-9e0d-0fd9c100fa3a tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.032309 Nov 27 20:46:03.976003 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 111/207] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:03 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:03.983990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2e948bc2-953f-4a6d-accf-638c94d16190 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:03.985028 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:03.985028 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:04.010863 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2e948bc2-953f-4a6d-accf-638c94d16190 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.031758 Nov 27 20:46:04.015499 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 112/208] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:03 2021] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:04.023132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e4f82d4-469c-4ec1-a172-619a49386092 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.026662 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.026662 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:04.038990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e4f82d4-469c-4ec1-a172-619a49386092 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.040730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e4f82d4-469c-4ec1-a172-619a49386092 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.134731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:04.146178 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68b01f6a-ab35-4227-aa3e-b88d1560c320 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1322 microversion: 2.1 time: 0.562710 Nov 27 20:46:04.146776 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 97/209] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:03 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:04.155598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca057d2c-d670-450c-afef-77605c7a996e tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.157050 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.157050 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.167474 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ca057d2c-d670-450c-afef-77605c7a996e tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 27 20:46:04.169247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca057d2c-d670-450c-afef-77605c7a996e tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:04.170703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca057d2c-d670-450c-afef-77605c7a996e tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.022016 Nov 27 20:46:04.171706 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 98/210] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:46:04 2021] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:04.181321 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e4f82d4-469c-4ec1-a172-619a49386092 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.163690 Nov 27 20:46:04.182680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7313988-d5f9-4c7b-a727-bd18a712aa1b tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.182844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 113/211] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:04.183916 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.183916 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.195332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e884c00-013c-4a23-b46b-e98789ec097f tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.197396 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.197396 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:04.201587 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e7313988-d5f9-4c7b-a727-bd18a712aa1b tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 27 20:46:04.202201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7313988-d5f9-4c7b-a727-bd18a712aa1b tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:04.203233 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7313988-d5f9-4c7b-a727-bd18a712aa1b tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.025944 Nov 27 20:46:04.204144 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 99/212] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:04 2021] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:04.209826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e884c00-013c-4a23-b46b-e98789ec097f tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.210538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e884c00-013c-4a23-b46b-e98789ec097f tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.215068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61bc017b-b742-465f-ab7a-1ba2c0f375b2 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-628071646", "name": "tempest-test_aggregate-1596218520"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.240522 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.240522 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.241834 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-1e884c00-013c-4a23-b46b-e98789ec097f tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] HTTP exception thrown: Aggregate 6 already has host nch1-master-1. Nov 27 20:46:04.242531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-61bc017b-b742-465f-ab7a-1ba2c0f375b2 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid 2b32751c-b151-47d1-98da-859ac0541fd3 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:04.242829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e884c00-013c-4a23-b46b-e98789ec097f tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 409 to user: Aggregate 6 already has host nch1-master-1. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:04.244470 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1e884c00-013c-4a23-b46b-e98789ec097f tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.054986 Nov 27 20:46:04.246092 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 114/213] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 27 20:46:04.256461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0723f763-f158-44d9-9eff-c3a4ea0fb2d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.258104 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.258104 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:04.280397 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61bc017b-b742-465f-ab7a-1ba2c0f375b2 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.070389 Nov 27 20:46:04.281355 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 100/214] 10.222.0.21 () {60 vars in 1164 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates => generated 221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:04.287812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0723f763-f158-44d9-9eff-c3a4ea0fb2d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.288353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0723f763-f158-44d9-9eff-c3a4ea0fb2d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.294253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a1b3cad-a53f-4eef-8794-e240593e3679 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.296638 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.296638 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.355585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a1b3cad-a53f-4eef-8794-e240593e3679 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.067424 Nov 27 20:46:04.359856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 101/215] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:04 2021] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:04.364750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.366005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:04.372852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.373349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.374190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.374619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.457346 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0723f763-f158-44d9-9eff-c3a4ea0fb2d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.205948 Nov 27 20:46:04.466975 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 115/216] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:04.472775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83f9648e-dd0c-4b1c-988b-8ea4ae766583 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.474237 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.474237 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:04.488068 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-83f9648e-dd0c-4b1c-988b-8ea4ae766583 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 27 20:46:04.489211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83f9648e-dd0c-4b1c-988b-8ea4ae766583 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:04.489704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83f9648e-dd0c-4b1c-988b-8ea4ae766583 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.021096 Nov 27 20:46:04.494171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:04.502475 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 116/217] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:46:04 2021] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:04.512626 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d2a48c2-a923-4f05-b89c-cb934a9053e6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1266 microversion: 2.1 time: 0.150182 Nov 27 20:46:04.512626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 102/218] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:04 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:04.514990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.516109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:04.519969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c99cf815-a6fb-4700-b525-a5b51f3b045b tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.522150 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.522150 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.544373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.545473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.546397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.550916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.573245 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c99cf815-a6fb-4700-b525-a5b51f3b045b tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.060276 Nov 27 20:46:04.574128 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 103/219] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:04 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:04.606014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c1e0a04-18ae-42d6-a63f-3e7febd04daa tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:04.608543 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.608543 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.630924 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-6c1e0a04-18ae-42d6-a63f-3e7febd04daa tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 27 20:46:04.631794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c1e0a04-18ae-42d6-a63f-3e7febd04daa tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:04.633384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6c1e0a04-18ae-42d6-a63f-3e7febd04daa tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.051438 Nov 27 20:46:04.637569 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 104/220] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:04 2021] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:04.658380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc35cdf0-6930-4611-ad04-d265ccbca84e tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-704126733"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.660613 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.660613 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.663582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-bc35cdf0-6930-4611-ad04-d265ccbca84e tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid d473a5e3-da2b-4433-9ab3-f7f966b30661 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:04.727227 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc35cdf0-6930-4611-ad04-d265ccbca84e tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.086558 Nov 27 20:46:04.732166 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 105/221] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:04.760727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-01abd912-f4af-4d6a-a451-840e1d7918d2 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-720453300"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.766175 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.766175 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.770727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-01abd912-f4af-4d6a-a451-840e1d7918d2 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Generated uuid 31f432eb-0fb6-4cf7-8d40-c4f02bcfd0d3 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:04.809789 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-01abd912-f4af-4d6a-a451-840e1d7918d2 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.073418 Nov 27 20:46:04.810600 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 106/222] 10.222.0.21 () {62 vars in 1204 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates => generated 245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:04.834215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e41d2f49-66b9-4887-9240-187547ac97fa tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-474785693"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.835687 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.835687 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.839864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-e41d2f49-66b9-4887-9240-187547ac97fa tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid e620b0df-cbe1-4ff9-bb81-0f784e304839 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:04.883413 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e41d2f49-66b9-4887-9240-187547ac97fa tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061954 Nov 27 20:46:04.893737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 107/223] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:04.909582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-921556d4-379e-4da9-ac8f-cfefebe60b60 req-5716c706-a8e4-41f0-a92e-b47dafeee50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d80b32-2808-471a-8a0e-4be5eef50ad1", "name": "network-vif-deleted", "tag": "d41d0e33-705d-4cdf-be42-526f502364c1"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:04.911057 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:04.911057 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:04.920170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-921556d4-379e-4da9-ac8f-cfefebe60b60 req-5716c706-a8e4-41f0-a92e-b47dafeee50f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:04.920909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-921556d4-379e-4da9-ac8f-cfefebe60b60 req-5716c706-a8e4-41f0-a92e-b47dafeee50f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:04.935043 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-921556d4-379e-4da9-ac8f-cfefebe60b60 req-5716c706-a8e4-41f0-a92e-b47dafeee50f service nova] Creating event network-vif-deleted:d41d0e33-705d-4cdf-be42-526f502364c1 for instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 on nch2-master-1 Nov 27 20:46:04.940821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-921556d4-379e-4da9-ac8f-cfefebe60b60 req-5716c706-a8e4-41f0-a92e-b47dafeee50f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045593 Nov 27 20:46:04.942008 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 108/224] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:04.954741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:04.967829 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0e010aa-b9c7-41c6-82e5-79fe5368c807 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 200 len: 1433 microversion: 2.1 time: 0.463987 Nov 27 20:46:04.968625 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 117/225] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:04 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 1433 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:04.980173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79681679-fbd4-4a11-9e97-2e49fe372148 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1271307086"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:05.170635 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:05.170635 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:05.233806 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79681679-fbd4-4a11-9e97-2e49fe372148 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.261681 Nov 27 20:46:05.237155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 118/226] 10.222.0.21 () {62 vars in 1209 bytes} [Sat Nov 27 20:46:04 2021] PUT /compute/v2.1/os-aggregates/9 => generated 299 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:05.251143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:05.253409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:05.283036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:05.283558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:05.285984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:05.286843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:05.378427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ada41056-7907-4a06-b10a-8ca97aee28ca tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:05.380027 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:05.380027 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:05.380940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ada41056-7907-4a06-b10a-8ca97aee28ca tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0ca311be98bf4394a3b15147b308f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8f0c34da8b4307bec3f04575d55849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:05.383942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ada41056-7907-4a06-b10a-8ca97aee28ca tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:05.384825 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ada41056-7907-4a06-b10a-8ca97aee28ca tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] 10.222.0.21 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.441402 Nov 27 20:46:05.389134 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 109/227] 10.222.0.21 () {60 vars in 1190 bytes} [Sat Nov 27 20:46:04 2021] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 446 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:05.401212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d96555f7-ade9-4cbe-bb48-ca10b5cd6999 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:05.404406 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:05.404406 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:05.424426 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d96555f7-ade9-4cbe-bb48-ca10b5cd6999 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.034131 Nov 27 20:46:05.432428 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 110/228] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:05 2021] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:05.437439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:05.438182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:05.455445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:05.455904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:05.461253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:05.465338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:05.774258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:05.795535 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-37d05193-51e9-460e-b579-0059956e41ac tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1322 microversion: 2.1 time: 0.367067 Nov 27 20:46:05.797713 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 111/229] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:05 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:05.812214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6b88eb1-47bc-46e6-8629-02690d178551 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:05.815541 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:05.815541 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:05.820987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:05.826608 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6b88eb1-47bc-46e6-8629-02690d178551 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.026087 Nov 27 20:46:05.827942 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 112/230] 10.222.0.21 () {60 vars in 1189 bytes} [Sat Nov 27 20:46:05 2021] GET /compute/v2.1/os-aggregates/9 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:05.829076 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c4877b2-51a6-453b-a9b7-f5fca7f6ab35 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1319 microversion: 2.1 time: 0.590149 Nov 27 20:46:05.834061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 119/231] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:05 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:05.836806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-398aee91-cbe1-4956-bf6f-edad7797392d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:05.838114 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:05.838114 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:05.839105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05feec16-4c3d-4390-886c-ec42869d9ef9 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:05.848442 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:05.848442 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:05.876658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05feec16-4c3d-4390-886c-ec42869d9ef9 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.040913 Nov 27 20:46:05.877750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 120/232] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:46:05 2021] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:05.884680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:05.885852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:05.893485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-398aee91-cbe1-4956-bf6f-edad7797392d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.063220 Nov 27 20:46:05.894366 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 113/233] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:05 2021] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:05.896154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:05.897570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:05.899172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:05.899934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:05.903563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4c77465d-bd7a-4e7e-bef1-1157a2117f57 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:05.905728 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:05.905728 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:05.931637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c77465d-bd7a-4e7e-bef1-1157a2117f57 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:05.932278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c77465d-bd7a-4e7e-bef1-1157a2117f57 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.032342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:06.039608 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-060cea40-874b-43c2-8dec-8583c21363b6 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1272 microversion: 2.1 time: 0.159886 Nov 27 20:46:06.051016 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 121/234] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:05 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:06.051016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0aa08dee-7f7b-4437-a601-3a51eca76896 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.051016 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.051016 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:06.052632 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0aa08dee-7f7b-4437-a601-3a51eca76896 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.010909 Nov 27 20:46:06.053555 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 122/235] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:06 2021] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.063553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1155157-1b96-4437-b9c0-42b866b8e746 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-112403991"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.065156 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.065156 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:06.066604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-d1155157-1b96-4437-b9c0-42b866b8e746 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid 34c8202b-c774-4c0b-b0a6-11e538d182ed for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:06.075669 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4c77465d-bd7a-4e7e-bef1-1157a2117f57 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 314 microversion: 2.41 time: 0.176468 Nov 27 20:46:06.076356 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 114/236] 10.222.0.21 () {62 vars in 1231 bytes} [Sat Nov 27 20:46:05 2021] POST /compute/v2.1/os-aggregates/9/action => generated 314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:06.085166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.087268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:06.100478 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1155157-1b96-4437-b9c0-42b866b8e746 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045527 Nov 27 20:46:06.101703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 123/237] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.113507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1799002-e102-4538-aff3-0ba2ba157623 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.114572 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.114572 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:06.114797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.115929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.117000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.123244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.148544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1799002-e102-4538-aff3-0ba2ba157623 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.038181 Nov 27 20:46:06.155029 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 124/238] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:06 2021] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:06.158097 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] HTTP exception thrown: Instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 could not be found. Nov 27 20:46:06.158817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Returning 404 to user: Instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:06.160140 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c12c16bb-2e3d-41df-94d0-ae0c25c21b55 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 404 len: 111 microversion: 2.1 time: 0.082616 Nov 27 20:46:06.160699 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 115/239] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:06 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:06.162263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-050c80d7-707c-4537-8e92-959ab55d8224 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.166195 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.166195 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:06.170435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-297476112"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.171927 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.171927 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.181099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.181554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.189647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.190096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.192033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-050c80d7-707c-4537-8e92-959ab55d8224 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.197846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-050c80d7-707c-4537-8e92-959ab55d8224 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.209301 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-297476112 could not be found. Nov 27 20:46:06.210396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-297476112 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:06.212408 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e09967d-d54b-4129-bada-476670e1b1d3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.045641 Nov 27 20:46:06.214175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 116/240] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:06.220591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6cf79ac7-b2d4-409c-a471-122b0f0421d3 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1318743701", "availability_zone": "tempest-test_az-2133563037"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.222592 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.222592 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.224486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-6cf79ac7-b2d4-409c-a471-122b0f0421d3 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid b3dea249-2854-443a-901d-7d9a9e9b7a0c for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:06.263107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6cf79ac7-b2d4-409c-a471-122b0f0421d3 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.047549 Nov 27 20:46:06.263804 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 117/241] 10.222.0.21 () {60 vars in 1164 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 223 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.277924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5bc3d1df-1374-497f-ad69-c42922b63d2a tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.278752 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.278752 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.317598 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5bc3d1df-1374-497f-ad69-c42922b63d2a tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.051050 Nov 27 20:46:06.318621 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 118/242] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:06 2021] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:06.337721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-57cec648-4085-4d07-8a1d-5ca40a14862c tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1318743701_new", "availability_zone": "tempest-test_az-2133563037_new"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.397126 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-050c80d7-707c-4537-8e92-959ab55d8224 tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 299 microversion: 2.41 time: 0.239989 Nov 27 20:46:06.397626 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 125/243] 10.222.0.21 () {62 vars in 1231 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates/9/action => generated 299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:06.404438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70219121-10e5-4306-ad50-346883c210e3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.406134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70219121-10e5-4306-ad50-346883c210e3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:06.406952 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70219121-10e5-4306-ad50-346883c210e3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.008341 Nov 27 20:46:06.407897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 126/244] 10.222.0.21 () {60 vars in 1164 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:46:06.421027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2075011827", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.437495 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.437495 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.479290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57cec648-4085-4d07-8a1d-5ca40a14862c tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.479965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57cec648-4085-4d07-8a1d-5ca40a14862c tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.504202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:06.546716 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-57cec648-4085-4d07-8a1d-5ca40a14862c tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.226010 Nov 27 20:46:06.547345 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 119/245] 10.222.0.21 () {60 vars in 1172 bytes} [Sat Nov 27 20:46:06 2021] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.552107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18375e0e-fa3f-43ae-929f-70e1c2e80f4f tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.553318 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.553318 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.588877 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18375e0e-fa3f-43ae-929f-70e1c2e80f4f tempest-AggregatesAdminTestV241-1590321952 tempest-AggregatesAdminTestV241-1590321952-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.040048 Nov 27 20:46:06.589704 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 120/246] 10.222.0.21 () {60 vars in 1192 bytes} [Sat Nov 27 20:46:06 2021] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.595155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5f26852-9119-46c8-8783-19adba031135 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.596921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5f26852-9119-46c8-8783-19adba031135 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:06.598149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a5f26852-9119-46c8-8783-19adba031135 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.006597 Nov 27 20:46:06.598881 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 121/247] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:46:06.607755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2543d979-57b0-41de-ae7c-2a1a6aca19b3 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.608560 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.608560 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.634018 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2543d979-57b0-41de-ae7c-2a1a6aca19b3 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.032928 Nov 27 20:46:06.635098 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 122/248] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:46:06 2021] GET /compute/v2.1/os-aggregates => generated 340 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.648590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4fc626bd-2596-4365-8017-5234bbca31ec tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1849142037"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.651725 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.651725 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.652972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4fc626bd-2596-4365-8017-5234bbca31ec tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0ca311be98bf4394a3b15147b308f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8f0c34da8b4307bec3f04575d55849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:06.654012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4fc626bd-2596-4365-8017-5234bbca31ec tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:06.655620 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4fc626bd-2596-4365-8017-5234bbca31ec tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.019053 Nov 27 20:46:06.656638 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 123/249] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:06.662167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97a80684-e06a-4e89-bd23-c302697d2614 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.663942 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.663942 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.711917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97a80684-e06a-4e89-bd23-c302697d2614 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.053886 Nov 27 20:46:06.719737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 124/250] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:06 2021] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:06.724726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ec480d5-d76f-4819-9aac-236c3ac7a3d8 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1590990769"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.726024 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.726024 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.728681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-9ec480d5-d76f-4819-9aac-236c3ac7a3d8 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid 9ccbb777-5e62-41dc-a45d-c108a3b165ff for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:06.758128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ec480d5-d76f-4819-9aac-236c3ac7a3d8 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036922 Nov 27 20:46:06.759421 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 125/251] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.765051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d29e5d4-a15f-478e-9da6-61c76538be68 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1695319312"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.766267 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.766267 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.767741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-4d29e5d4-a15f-478e-9da6-61c76538be68 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Generated uuid 998cfc15-5aa5-4cbe-a6f6-771f3dcd8e75 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:06.803021 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d29e5d4-a15f-478e-9da6-61c76538be68 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041973 Nov 27 20:46:06.810985 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 126/252] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:06.817130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e45f2ef8-c835-4ca1-98f8-a86115d47ba3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1590990769"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:06.818672 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:06.818672 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:06.820516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-e45f2ef8-c835-4ca1-98f8-a86115d47ba3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid 7a9f9ad2-5392-4a83-8998-84c5b5f70255 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:06.831273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e45f2ef8-c835-4ca1-98f8-a86115d47ba3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1590990769 already exists. Nov 27 20:46:06.835201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e45f2ef8-c835-4ca1-98f8-a86115d47ba3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1590990769 already exists. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:06.835201 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e45f2ef8-c835-4ca1-98f8-a86115d47ba3 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.021563 Nov 27 20:46:06.835603 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 127/253] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/os-aggregates => generated 111 bytes in 24 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:06.845121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:06.846436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:06.859749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.860210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:06.862051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:06.863756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.093513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:07.105899 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7a89f18a-578a-4de3-93e9-f6d38c78926e tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1322 microversion: 2.1 time: 0.267846 Nov 27 20:46:07.107307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 128/254] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:06 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:07.132101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebd482a7-c182-4984-a346-fd7f0f702e12 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:07.134125 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:07.134125 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:07.146772 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebd482a7-c182-4984-a346-fd7f0f702e12 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.037665 Nov 27 20:46:07.159450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 129/255] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:46:07 2021] GET /compute/v2.1/os-aggregates => generated 446 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:07.177685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a57a6af-13bb-4a8b-94c8-3e89faaf36bb tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:07.179027 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:07.179027 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:07.225616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5a57a6af-13bb-4a8b-94c8-3e89faaf36bb tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.064795 Nov 27 20:46:07.226550 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 130/256] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:07 2021] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:07.234240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:07.237430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:07.254267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.257667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.258795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.259422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.331649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:07.332144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:07.332546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:07.333274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:07.334027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:07.352643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.353428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.355862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.357476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.408182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Getting quotas for project a53c15d688a541849c224abc382dff55. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:07.412450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Getting quotas for user 8eff5913736b4e77ac2b092534edfcd9 and project a53c15d688a541849c224abc382dff55. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:07.425789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:07.428250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:07.523596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f89b72a0-bab0-41df-9acd-186a48cddce9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109354 Nov 27 20:46:07.524820 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 127/257] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:07.539301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cd965ec7-f6dd-4750-8e2e-43c0c9fbdcb0 req-b19a475e-4b17-4c91-a656-b10f7ec4dbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f46dedc-d8cb-41e0-9019-d0aa61cceb49", "tag": "8cbd7b7d-2628-4d2c-9c48-0f983c4e788b"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:07.547928 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:07.547928 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:07.565153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd965ec7-f6dd-4750-8e2e-43c0c9fbdcb0 req-b19a475e-4b17-4c91-a656-b10f7ec4dbd3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.566624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd965ec7-f6dd-4750-8e2e-43c0c9fbdcb0 req-b19a475e-4b17-4c91-a656-b10f7ec4dbd3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.589211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:07.595774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cd965ec7-f6dd-4750-8e2e-43c0c9fbdcb0 req-b19a475e-4b17-4c91-a656-b10f7ec4dbd3 service nova] Creating event network-changed:8cbd7b7d-2628-4d2c-9c48-0f983c4e788b for instance 3f46dedc-d8cb-41e0-9019-d0aa61cceb49 on nch1-master-1 Nov 27 20:46:07.605271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6242d25-0b6a-475d-91c5-276ec5b24fbf tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1319 microversion: 2.1 time: 0.374391 Nov 27 20:46:07.605271 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 131/258] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:07 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:07.609303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:07.610266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:07.614522 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cd965ec7-f6dd-4750-8e2e-43c0c9fbdcb0 req-b19a475e-4b17-4c91-a656-b10f7ec4dbd3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083086 Nov 27 20:46:07.616182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 128/259] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:07.621567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.622261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.640580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d7dfb2a-5203-495c-8db3-c6a787362f64 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:07.643184 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:07.643184 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:07.647804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.650444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.691176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d7dfb2a-5203-495c-8db3-c6a787362f64 tempest-AggregatesAdminTestJSON-1780747336 tempest-AggregatesAdminTestJSON-1780747336-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.073036 Nov 27 20:46:07.705328 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 129/260] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:07 2021] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:07.710329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6b2390f-1482-4503-a096-5ffdb82d15d7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-73747782"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:07.715960 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:07.715960 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:07.717261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-e6b2390f-1482-4503-a096-5ffdb82d15d7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid 88dad6f3-6c1a-431b-ba77-9b4de8c79257 for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:07.754448 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6b2390f-1482-4503-a096-5ffdb82d15d7 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047957 Nov 27 20:46:07.761345 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 130/261] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:07 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:07.769024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3ea13666-1a72-47fd-bda4-c1989d2bc624 req-945976ce-cb67-4ff3-9620-ee330e1e5649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321d86fb-797f-4432-bf01-bdc5917b92ad", "name": "network-vif-plugged", "status": "completed", "tag": "7d99b7e4-cb69-4555-b647-95cd8ebd5bbe"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:07.771020 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:07.771020 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:07.785490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3ea13666-1a72-47fd-bda4-c1989d2bc624 req-945976ce-cb67-4ff3-9620-ee330e1e5649 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.786864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3ea13666-1a72-47fd-bda4-c1989d2bc624 req-945976ce-cb67-4ff3-9620-ee330e1e5649 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.812509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3ea13666-1a72-47fd-bda4-c1989d2bc624 req-945976ce-cb67-4ff3-9620-ee330e1e5649 service nova] Creating event network-vif-plugged:7d99b7e4-cb69-4555-b647-95cd8ebd5bbe for instance 321d86fb-797f-4432-bf01-bdc5917b92ad on nch2-master-1 Nov 27 20:46:07.825669 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3ea13666-1a72-47fd-bda4-c1989d2bc624 req-945976ce-cb67-4ff3-9620-ee330e1e5649 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062233 Nov 27 20:46:07.826894 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 131/262] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:07.834328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-62b29f3a-64a9-454c-a300-8b0192aaf411 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:07.836115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-62b29f3a-64a9-454c-a300-8b0192aaf411 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:07.947431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-62b29f3a-64a9-454c-a300-8b0192aaf411 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:07.962380 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-62b29f3a-64a9-454c-a300-8b0192aaf411 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1220 microversion: 2.1 time: 0.133406 Nov 27 20:46:07.963090 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 132/263] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:07 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:07.973763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:07.976016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:07.984767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.985460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:07.986872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:07.987698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:08.037350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:46:08.319722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5ee46f8-dd72-406e-9d59-24e1516cda63 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "DELETE /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 204 len: 0 microversion: 2.1 time: 0.352479 Nov 27 20:46:08.321091 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 133/264] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:07 2021] DELETE /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:46:08.337987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-32fb3167-0cde-4769-9699-2bed3ca525aa tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:08.341166 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:08.341166 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:08.344413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-32fb3167-0cde-4769-9699-2bed3ca525aa tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0ca311be98bf4394a3b15147b308f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8f0c34da8b4307bec3f04575d55849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:08.345098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-32fb3167-0cde-4769-9699-2bed3ca525aa tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:08.347759 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-32fb3167-0cde-4769-9699-2bed3ca525aa tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.023914 Nov 27 20:46:08.350865 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 134/265] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:08 2021] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:08.365400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:08.371598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:08.392632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:08.393016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:08.398681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:08.403732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:08.742281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:08.758667 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24dca16c-942f-4212-a3c8-ebcd9ce80438 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1314 microversion: 2.1 time: 1.152482 Nov 27 20:46:08.779863 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 132/266] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:07 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1314 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:08.792050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:08.803096 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c000dea4-c3fb-4024-8576-c56604c8590d tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1322 microversion: 2.1 time: 0.448872 Nov 27 20:46:08.812560 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 135/267] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:08 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:08.822525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:08.824772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:08.825831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28fda676-ce63-407b-adb6-7430cc073995 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:08.826770 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:08.826770 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:08.835188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:08.835188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:08.842981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:08.843599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:08.885122 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28fda676-ce63-407b-adb6-7430cc073995 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.071141 Nov 27 20:46:08.885714 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 136/268] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:08 2021] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:08.894313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:08.894928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:08.914737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:08.915200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:08.916047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:08.916493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:09.396466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:09.406538 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c41911b4-c0dd-40a7-a0ce-d2d049ec3395 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1470 microversion: 2.1 time: 0.610140 Nov 27 20:46:09.407934 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 133/269] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:08 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:09.420099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d58a68c-5150-4918-81e5-945ac22a656d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:09.421064 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:09.421064 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:09.447075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-4d58a68c-5150-4918-81e5-945ac22a656d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 27 20:46:09.447703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d58a68c-5150-4918-81e5-945ac22a656d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:09.456115 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d58a68c-5150-4918-81e5-945ac22a656d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045610 Nov 27 20:46:09.456839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 134/270] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:09 2021] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:09.473684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:09.475056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:09.488017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:09.492173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:09.493833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:09.494594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:09.630551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:09.638165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9294568c-f8ab-4634-837e-c6642300e8c8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1290 microversion: 2.1 time: 0.180153 Nov 27 20:46:09.639110 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 135/271] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:09 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1290 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:09.659309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:09.667455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c462620c-ae39-4114-b080-3887971655f6 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1319 microversion: 2.1 time: 0.776670 Nov 27 20:46:09.679949 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 137/272] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:08 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:09.691077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5e9c60c-19e5-4635-98ff-31e75cab7c0d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-445118617"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:09.692648 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:09.692648 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:09.694179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-b5e9c60c-19e5-4635-98ff-31e75cab7c0d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid 17c5a7e6-31db-4461-970f-4bbb452f90c7 for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:09.730907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5e9c60c-19e5-4635-98ff-31e75cab7c0d tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049042 Nov 27 20:46:09.731728 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 138/273] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:09 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:09.961258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2066681576", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:09.998113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-78e4ebcd-8038-48a9-885a-6ed91299033e req-eba6f9a8-32b2-427f-afb6-90efe935ba32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77", "tag": "41eff457-e562-48bc-bb0b-6db9a9bacf92"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:10.000525 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:10.000525 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:10.009268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-78e4ebcd-8038-48a9-885a-6ed91299033e req-eba6f9a8-32b2-427f-afb6-90efe935ba32 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.009960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-78e4ebcd-8038-48a9-885a-6ed91299033e req-eba6f9a8-32b2-427f-afb6-90efe935ba32 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.023186 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-78e4ebcd-8038-48a9-885a-6ed91299033e req-eba6f9a8-32b2-427f-afb6-90efe935ba32 service nova] Creating event network-changed:41eff457-e562-48bc-bb0b-6db9a9bacf92 for instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 on nch2-master-1 Nov 27 20:46:10.030546 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-78e4ebcd-8038-48a9-885a-6ed91299033e req-eba6f9a8-32b2-427f-afb6-90efe935ba32 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291672 Nov 27 20:46:10.031359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 139/274] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:10.042849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53a134aa-8632-447b-af7e-d396b2ad5198 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:10.044444 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:10.044444 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:10.046355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53a134aa-8632-447b-af7e-d396b2ad5198 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0ca311be98bf4394a3b15147b308f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8f0c34da8b4307bec3f04575d55849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:10.047322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53a134aa-8632-447b-af7e-d396b2ad5198 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:10.048741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53a134aa-8632-447b-af7e-d396b2ad5198 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] 10.222.0.21 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013885 Nov 27 20:46:10.049486 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 140/275] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:10 2021] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:10.056391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:10.057358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:10.069141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.069707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.070611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.071867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.074071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:10.523196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:10.534902 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-14aee349-64a7-4e06-9877-3387a8a7b4b2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1314 microversion: 2.1 time: 0.483298 Nov 27 20:46:10.548550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 141/276] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:10 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:10.553514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:10.554299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:10.570882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.571241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.572304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.572919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.715721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:10.716138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:10.716607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:10.717161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:10.717572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:10.726792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.728160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.729246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.729914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.757207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:10.762594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for user 3cb6bc63929648388ac9648823d4ca88 and project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:10.777582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:10.781051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:10.853349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d89962b-2d42-4fef-8da3-dedee19eeb9e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213062 Nov 27 20:46:10.854791 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 136/277] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:10.874979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc0846e1-ae47-4772-9c76-9efff73c3229 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:10.876262 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:10.876262 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:10.907759 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc0846e1-ae47-4772-9c76-9efff73c3229 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.050842 Nov 27 20:46:10.908726 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 137/278] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:10 2021] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:10.933931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:10.939133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:10.959532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.960499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:10.962725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:10.964325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.144939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:11.153352 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a289fe61-7d27-46b3-8dae-cce0640aa1a1 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1471 microversion: 2.1 time: 0.603635 Nov 27 20:46:11.154434 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 142/279] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:10 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:11.158877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.159684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:11.171120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.171607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.173912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.177124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.292324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:11.321230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc097324-b527-4f18-b8d2-cfca3c5772fc tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1278 microversion: 2.1 time: 0.162323 Nov 27 20:46:11.322052 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 143/280] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:11 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:11.338637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.342830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:11.357190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.357840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.360206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.361321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.554438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:11.569080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c229c64f-5ddf-4eb3-b41a-6ff816dbd8d8 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1470 microversion: 2.1 time: 0.647321 Nov 27 20:46:11.571004 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 138/281] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:10 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:11.585388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7cf33c23-bdb4-48bd-9daa-7d5650dcb75c req-8881681f-b569-4226-ab34-f592f7b4b78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f46dedc-d8cb-41e0-9019-d0aa61cceb49", "name": "network-vif-plugged", "status": "completed", "tag": "8cbd7b7d-2628-4d2c-9c48-0f983c4e788b"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:11.587962 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:11.587962 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:11.595369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7cf33c23-bdb4-48bd-9daa-7d5650dcb75c req-8881681f-b569-4226-ab34-f592f7b4b78a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.596252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7cf33c23-bdb4-48bd-9daa-7d5650dcb75c req-8881681f-b569-4226-ab34-f592f7b4b78a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.609958 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7cf33c23-bdb4-48bd-9daa-7d5650dcb75c req-8881681f-b569-4226-ab34-f592f7b4b78a service nova] Creating event network-vif-plugged:8cbd7b7d-2628-4d2c-9c48-0f983c4e788b for instance 3f46dedc-d8cb-41e0-9019-d0aa61cceb49 on nch1-master-1 Nov 27 20:46:11.616880 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7cf33c23-bdb4-48bd-9daa-7d5650dcb75c req-8881681f-b569-4226-ab34-f592f7b4b78a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039984 Nov 27 20:46:11.617790 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 139/282] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:11.626000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.627479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:11.634475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.635228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.636318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.637166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.713544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:11.731057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:11.739345 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dafdef79-8a2d-46c7-acba-0d273f6de476 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1217 microversion: 2.1 time: 0.120042 Nov 27 20:46:11.740688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3abe2695-31ee-42f6-be74-1b98d9e810cc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1319 microversion: 2.1 time: 0.415616 Nov 27 20:46:11.741454 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 140/283] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:11 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:11.742565 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 144/284] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:11 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:11.758750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.759244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:11.769179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab2e7207-a61b-4c34-a78c-5275d97e5433 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.770423 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:11.770423 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:11.778914 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ab2e7207-a61b-4c34-a78c-5275d97e5433 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 27 20:46:11.779921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab2e7207-a61b-4c34-a78c-5275d97e5433 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:11.780950 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab2e7207-a61b-4c34-a78c-5275d97e5433 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.028538 Nov 27 20:46:11.782011 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 141/285] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:46:11 2021] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:11.787499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.788377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:11.789401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.790352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.791142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.791598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.798365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.799021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.800080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.800596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.846597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:11.847285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:11.848381 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35c09568-d97d-47da-a5c1-c80186b3b1c0 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.102128 Nov 27 20:46:11.848897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 145/286] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:46:11 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad/diagnostics => generated 117 bytes in 106 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:11.856509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebc53df9-5579-463c-9cb0-9973fc9773ef tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.857429 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:11.857429 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:11.865459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ebc53df9-5579-463c-9cb0-9973fc9773ef tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0ca311be98bf4394a3b15147b308f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8f0c34da8b4307bec3f04575d55849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:11.866409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebc53df9-5579-463c-9cb0-9973fc9773ef tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:11.868289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebc53df9-5579-463c-9cb0-9973fc9773ef tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] 10.222.0.21 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018254 Nov 27 20:46:11.869374 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 146/287] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:46:11 2021] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:11.878045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:11.878990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:11.887351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.887950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.888830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:11.889421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:11.916932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:46:12.048346 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e8119d8-ef3b-4c04-bc71-0bed3e8e9a2c tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "DELETE /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 204 len: 0 microversion: 2.1 time: 0.175409 Nov 27 20:46:12.048346 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 147/288] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:11 2021] DELETE /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:46:12.055112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e17d50d9-134b-42c0-bfa5-0eb14fd493ae tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1769521555"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:12.057164 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:12.057164 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:12.058805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.aggregate [None req-e17d50d9-134b-42c0-bfa5-0eb14fd493ae tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid b338fa54-2ed6-4708-a035-8984e76e8fdd for aggregate {{(pid=135680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:12.097723 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e17d50d9-134b-42c0-bfa5-0eb14fd493ae tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047682 Nov 27 20:46:12.099050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 148/289] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:12 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:12.105660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:12.106681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:12.114381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.114744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.115560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.115991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.262988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:12.272294 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e77dba90-d1f9-4dc7-bd07-49b252a34ea3 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1314 microversion: 2.1 time: 0.488664 Nov 27 20:46:12.276542 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 142/290] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:11 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:12.286721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7d37c1fe-6449-4361-b11a-d77c64d41415 req-83116607-9a1b-4ed3-8405-95c54aae0286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32c10d2-9032-4865-b174-8e5c54748d97", "tag": "61486de3-700a-473b-8c7d-f6d50698c8b0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:12.290915 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:12.290915 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:12.310172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7d37c1fe-6449-4361-b11a-d77c64d41415 req-83116607-9a1b-4ed3-8405-95c54aae0286 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.311573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7d37c1fe-6449-4361-b11a-d77c64d41415 req-83116607-9a1b-4ed3-8405-95c54aae0286 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.326944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:12.339517 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2680300f-b20e-4851-b27b-fbe856a1e500 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1477 microversion: 2.1 time: 0.238664 Nov 27 20:46:12.340536 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 149/291] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:12 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:12.344748 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7d37c1fe-6449-4361-b11a-d77c64d41415 req-83116607-9a1b-4ed3-8405-95c54aae0286 service nova] Creating event network-changed:61486de3-700a-473b-8c7d-f6d50698c8b0 for instance d32c10d2-9032-4865-b174-8e5c54748d97 on nch1-master-1 Nov 27 20:46:12.345407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1107fdd-a83a-467f-a3a9-d40e595fa48c tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:12.346620 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:12.346620 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:12.356507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1107fdd-a83a-467f-a3a9-d40e595fa48c tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.356956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1107fdd-a83a-467f-a3a9-d40e595fa48c tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.368991 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7d37c1fe-6449-4361-b11a-d77c64d41415 req-83116607-9a1b-4ed3-8405-95c54aae0286 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089724 Nov 27 20:46:12.370274 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 143/292] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:12.386679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2e037864-7751-4fb8-ae0e-7846d9bc5421 req-245ed3c4-b61b-4915-a35a-4acbfe79ec7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d9f5e3-7112-4787-b2e4-ba60005e60c1", "name": "network-vif-deleted", "tag": "99a5e719-2b40-469f-9550-26151b5762fb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:12.396430 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:12.396430 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:12.416912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2e037864-7751-4fb8-ae0e-7846d9bc5421 req-245ed3c4-b61b-4915-a35a-4acbfe79ec7f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.417737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2e037864-7751-4fb8-ae0e-7846d9bc5421 req-245ed3c4-b61b-4915-a35a-4acbfe79ec7f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.438856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2e037864-7751-4fb8-ae0e-7846d9bc5421 req-245ed3c4-b61b-4915-a35a-4acbfe79ec7f service nova] Creating event network-vif-deleted:99a5e719-2b40-469f-9550-26151b5762fb for instance 46d9f5e3-7112-4787-b2e4-ba60005e60c1 on nch1-master-1 Nov 27 20:46:12.446113 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2e037864-7751-4fb8-ae0e-7846d9bc5421 req-245ed3c4-b61b-4915-a35a-4acbfe79ec7f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073205 Nov 27 20:46:12.447307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 144/293] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:12.453068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:12.453950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:12.463183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.463934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.465254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.465882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.530126 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1107fdd-a83a-467f-a3a9-d40e595fa48c tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.188308 Nov 27 20:46:12.531931 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 150/294] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:46:12 2021] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:12.545241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ef60fea-6d83-42cb-a08e-d7016c2d0241 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:12.546874 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:12.546874 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:12.548151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2ef60fea-6d83-42cb-a08e-d7016c2d0241 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0ca311be98bf4394a3b15147b308f7f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8f0c34da8b4307bec3f04575d55849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:12.549187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ef60fea-6d83-42cb-a08e-d7016c2d0241 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:12.550189 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ef60fea-6d83-42cb-a08e-d7016c2d0241 tempest-AggregatesAdminNegativeTestJSON-1949267879 tempest-AggregatesAdminNegativeTestJSON-1949267879-project] 10.222.0.21 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.012057 Nov 27 20:46:12.550956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 151/295] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:46:12 2021] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:12.561821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d210d102-d522-4a87-92c8-72bf12cb0e68 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:12.576915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d210d102-d522-4a87-92c8-72bf12cb0e68 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.577940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d210d102-d522-4a87-92c8-72bf12cb0e68 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.745547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d210d102-d522-4a87-92c8-72bf12cb0e68 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.189167 Nov 27 20:46:12.746408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 152/296] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:46:12 2021] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:12.755786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:12.756400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:12.766370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.766825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.779309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.779777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.823802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.824265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.824741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lazy-loading 'fault' on Instance uuid 46d9f5e3-7112-4787-b2e4-ba60005e60c1 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:12.895128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bda78859f14c7a8f397a209503f28e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75de5fe7240c4923a26724fd417391e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:12.903382 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5643a380-be89-4367-b534-9396643fdef4 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 200 len: 1305 microversion: 2.1 time: 0.155346 Nov 27 20:46:12.917173 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 153/297] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:12 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:12.921570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e97372df-884f-40e0-b541-6b52201f1134 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:12.924350 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:12.924350 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:12.943691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:12.969059 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98385e53-edc0-4703-99f8-bd87afd843cf tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.515894 Nov 27 20:46:12.969701 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 145/298] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:12 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:12.977611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:12.981898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e97372df-884f-40e0-b541-6b52201f1134 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.062987 Nov 27 20:46:12.984287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:12.988000 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 154/299] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:12 2021] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:12.991129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.991614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.992453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:12.992899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:12.993920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:12.995155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:13.003123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.003801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.007317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.007317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.107043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:13.116546 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-292c6af4-6b75-4fa3-81de-601533a5cfc3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1271 microversion: 2.1 time: 0.145632 Nov 27 20:46:13.118834 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 146/300] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:12 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:13.129637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb87b6a1-f213-4e65-8d42-c3fbe19ea34c tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1948695"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:13.131057 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:13.131057 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:13.141349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-cb87b6a1-f213-4e65-8d42-c3fbe19ea34c tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Generated uuid 87345688-9f2f-405e-b92c-8b5cca457c47 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 20:46:13.173468 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb87b6a1-f213-4e65-8d42-c3fbe19ea34c tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.052676 Nov 27 20:46:13.181345 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 147/301] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 20:46:13 2021] POST /compute/v2.1/os-aggregates => generated 196 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:13.308553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:13.326202 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17720313-ab76-44b7-8abc-84dc9ac61408 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1319 microversion: 2.1 time: 0.336982 Nov 27 20:46:13.331606 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 155/302] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:12 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:13.347677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:13.349458 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:13.349458 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:13.359611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.359804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.370459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.371349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.372098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Calling method '.version_select at 0x7f15d4589f70>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:13.372916 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:13.372916 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:13.374404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.375023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.392668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.393119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.403514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.404180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.405057 ncdv-master-1 devstack@n-api.service[135680]: ERROR nova.api.openstack.compute.aggregates [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 27 20:46:13.405994 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 27 20:46:13.407686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:13.410382 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83dda6c1-5404-476e-841c-93a84761ee73 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.082435 Nov 27 20:46:13.414065 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 156/303] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 20:46:13 2021] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:13.418684 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b754bcf8-369b-4dd4-be04-6a6aac185d4b tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.236095 Nov 27 20:46:13.422508 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 148/304] 10.222.0.21 () {60 vars in 1186 bytes} [Sat Nov 27 20:46:13 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:13.423373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:13.424060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:13.434085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:13.436489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:13.437609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.438186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.438971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.439762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.446153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.447400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.451059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.453547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.826297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:13.835960 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ab3a65c-460d-4850-bef7-487fc4ef7c0b tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1477 microversion: 2.1 time: 0.412245 Nov 27 20:46:13.848922 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 149/305] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:13 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1477 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:13.848922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f0727381-6b16-446f-b903-f81e1109f380 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:13.848922 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:13.848922 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:13.872664 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f0727381-6b16-446f-b903-f81e1109f380 tempest-AggregatesAdminNegativeTestJSON-1431510469 tempest-AggregatesAdminNegativeTestJSON-1431510469-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.032707 Nov 27 20:46:13.873495 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 150/306] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:13 2021] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 20:46:13.884184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8021db62-e77e-4662-b411-c899f48b0337 tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Calling method '.version_select at 0x7f15d459fd30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:13.885475 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:13.885475 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:13.888900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021db62-e77e-4662-b411-c899f48b0337 tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.889782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021db62-e77e-4662-b411-c899f48b0337 tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.907308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021db62-e77e-4662-b411-c899f48b0337 tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.907930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021db62-e77e-4662-b411-c899f48b0337 tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.916738 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8021db62-e77e-4662-b411-c899f48b0337 tempest-HypervisorAdminV228Test-117704407 tempest-HypervisorAdminV228Test-117704407-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.040846 Nov 27 20:46:13.919203 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 151/307] 10.222.0.21 () {60 vars in 1192 bytes} [Sat Nov 27 20:46:13 2021] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:13.936139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:13.938429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] [instance: 46d9f5e3-7112-4787-b2e4-ba60005e60c1] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:13.948149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:13.954393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.957392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.958316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:13.958803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:13.969503 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0cd724c6-90fa-49eb-b9e8-26bb05aa1f49 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1314 microversion: 2.1 time: 0.556321 Nov 27 20:46:13.970098 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 157/308] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:13 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:13.996988 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] HTTP exception thrown: Instance 46d9f5e3-7112-4787-b2e4-ba60005e60c1 could not be found. Nov 27 20:46:13.997598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] Returning 404 to user: Instance 46d9f5e3-7112-4787-b2e4-ba60005e60c1 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:13.998432 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43c12ebf-3d25-471e-8ebd-e20f566db3b2 tempest-AggregatesAdminTestJSON-1453461987 tempest-AggregatesAdminTestJSON-1453461987-project] 10.222.0.21 "GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1" status: 404 len: 111 microversion: 2.1 time: 0.077958 Nov 27 20:46:13.998986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 152/309] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:13 2021] GET /compute/v2.1/servers/46d9f5e3-7112-4787-b2e4-ba60005e60c1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:46:14.002339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:14.005505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:14.021542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.021991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.022786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.023218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.137328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:14.137936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:14.147740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.148298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.149265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.149707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.622908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:14.639627 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97f74738-65e5-4369-adb3-e8d57817ca38 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.654668 Nov 27 20:46:14.640331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 158/310] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:13 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:14.645139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:14.652013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:14.663771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.668649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.669702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.670138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.691039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:14.715962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1660ee4a-03d5-4ea7-afa6-09e28f80bae4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.581198 Nov 27 20:46:14.729292 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 153/311] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:14 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:14.745880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ca0ce679-404e-4193-9c2b-64fbd186d5d1 req-0aff05be-cea8-4b0d-8fe8-3f42b407280e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76a34a6-fb51-4685-af0f-03a76c89c2f0", "tag": "504292fa-16a1-4d42-9aed-d4f56d8c892f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:14.750961 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:14.750961 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:14.770477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ca0ce679-404e-4193-9c2b-64fbd186d5d1 req-0aff05be-cea8-4b0d-8fe8-3f42b407280e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.771766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ca0ce679-404e-4193-9c2b-64fbd186d5d1 req-0aff05be-cea8-4b0d-8fe8-3f42b407280e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.803242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ca0ce679-404e-4193-9c2b-64fbd186d5d1 req-0aff05be-cea8-4b0d-8fe8-3f42b407280e service nova] Creating event network-changed:504292fa-16a1-4d42-9aed-d4f56d8c892f for instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 on nch2-master-1 Nov 27 20:46:14.814672 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ca0ce679-404e-4193-9c2b-64fbd186d5d1 req-0aff05be-cea8-4b0d-8fe8-3f42b407280e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081919 Nov 27 20:46:14.818068 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 154/312] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:14.860239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:14.861050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:14.871035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.871747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:14.872642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:14.874184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:15.217323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:15.226159 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-213473b3-9dd0-472b-80c0-d8a8e0e5bdfd tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1469 microversion: 2.1 time: 0.584507 Nov 27 20:46:15.240398 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 159/313] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:14 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1469 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:15.246785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:15.247677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:15.254209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:15.255036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:15.256311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:15.256955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:15.265255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a180a783424ce88239c7edb25bafc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ee5c27bb6e4b2d89671817ecd59b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:15.273960 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62d43633-b9fb-4643-9ea0-dd66ef8f65f9 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 200 len: 1477 microversion: 2.1 time: 0.421007 Nov 27 20:46:15.294571 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 155/314] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:14 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:15.621441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-320325633", "block_migration": true, "disk_over_commit": false}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:15.622827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:15.630364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:15.631052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:15.632330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:15.637341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.091740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lazy-loading 'flavor' on Instance uuid 3f46dedc-d8cb-41e0-9019-d0aa61cceb49 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:16.145490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Going to try to live migrate instance to tempest-host-320325633 {{(pid=135679) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:46:16.153290 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] HTTP exception thrown: Compute host tempest-host-320325633 could not be found. Nov 27 20:46:16.154295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Returning 400 to user: Compute host tempest-host-320325633 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:16.155846 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c69eb9c-1322-4aab-8b16-2d315e7a9dee tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49/action" status: 400 len: 99 microversion: 2.1 time: 0.857085 Nov 27 20:46:16.160146 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 156/315] 10.222.0.21 () {60 vars in 1278 bytes} [Sat Nov 27 20:46:15 2021] POST /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49/action => generated 99 bytes in 865 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:16.165950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:16.166740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:16.173848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.174556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.175635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.176271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.196315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:16.208202 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e3d657e-42d9-4161-8fd7-56693708621e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1314 microversion: 2.1 time: 0.964441 Nov 27 20:46:16.211557 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 160/316] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:15 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:16.223900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:16.228051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:16.236324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.237149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.238295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.238888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.519528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:16.541511 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-750d009e-fa00-43ce-b8bf-730aa8e705b8 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.379991 Nov 27 20:46:16.542299 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 157/317] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:16 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:16.555352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8455bd60-2f68-4c8a-ac2c-f19b09e42ca4 req-5c1372b5-e5c8-4a77-81d4-5cbec9b67e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321d86fb-797f-4432-bf01-bdc5917b92ad", "name": "network-vif-deleted", "tag": "7d99b7e4-cb69-4555-b647-95cd8ebd5bbe"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:16.557924 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:16.557924 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:16.576053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8455bd60-2f68-4c8a-ac2c-f19b09e42ca4 req-5c1372b5-e5c8-4a77-81d4-5cbec9b67e00 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.580238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8455bd60-2f68-4c8a-ac2c-f19b09e42ca4 req-5c1372b5-e5c8-4a77-81d4-5cbec9b67e00 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.598778 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8455bd60-2f68-4c8a-ac2c-f19b09e42ca4 req-5c1372b5-e5c8-4a77-81d4-5cbec9b67e00 service nova] Creating event network-vif-deleted:7d99b7e4-cb69-4555-b647-95cd8ebd5bbe for instance 321d86fb-797f-4432-bf01-bdc5917b92ad on nch2-master-1 Nov 27 20:46:16.619845 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8455bd60-2f68-4c8a-ac2c-f19b09e42ca4 req-5c1372b5-e5c8-4a77-81d4-5cbec9b67e00 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073778 Nov 27 20:46:16.622667 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 158/318] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:16.642863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:16.643604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:16.666271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.668267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.670966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.672095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.727729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:16.738153 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-887d28ca-c240-4793-8e2e-3d812023e457 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.524871 Nov 27 20:46:16.741233 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 161/319] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:16 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:16.764320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:16.764320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] [instance: 321d86fb-797f-4432-bf01-bdc5917b92ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:16.791214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.792112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.793087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:16.793580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:16.823023 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] HTTP exception thrown: Instance 321d86fb-797f-4432-bf01-bdc5917b92ad could not be found. Nov 27 20:46:16.823763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] Returning 404 to user: Instance 321d86fb-797f-4432-bf01-bdc5917b92ad could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:16.827595 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a345fb60-44a2-494d-8622-e294c7ab9927 tempest-ServerDiagnosticsNegativeTest-388393273 tempest-ServerDiagnosticsNegativeTest-388393273-project] 10.222.0.21 "GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad" status: 404 len: 111 microversion: 2.1 time: 0.080148 Nov 27 20:46:16.828651 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 162/320] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:16 2021] GET /compute/v2.1/servers/321d86fb-797f-4432-bf01-bdc5917b92ad => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:17.063767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5f55e09f-27c8-47f7-8523-c0310c8ccc7a req-8a10e1e5-9902-4a1e-bf43-3f3f55578aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32c10d2-9032-4865-b174-8e5c54748d97", "name": "network-vif-plugged", "status": "completed", "tag": "61486de3-700a-473b-8c7d-f6d50698c8b0"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:17.065932 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:17.065932 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:17.079178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5f55e09f-27c8-47f7-8523-c0310c8ccc7a req-8a10e1e5-9902-4a1e-bf43-3f3f55578aa7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:17.083939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5f55e09f-27c8-47f7-8523-c0310c8ccc7a req-8a10e1e5-9902-4a1e-bf43-3f3f55578aa7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:17.109339 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5f55e09f-27c8-47f7-8523-c0310c8ccc7a req-8a10e1e5-9902-4a1e-bf43-3f3f55578aa7 service nova] Creating event network-vif-plugged:61486de3-700a-473b-8c7d-f6d50698c8b0 for instance d32c10d2-9032-4865-b174-8e5c54748d97 on nch1-master-1 Nov 27 20:46:17.121304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5f55e09f-27c8-47f7-8523-c0310c8ccc7a req-8a10e1e5-9902-4a1e-bf43-3f3f55578aa7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062730 Nov 27 20:46:17.127940 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 163/321] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:46:17.227853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:17.228694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:17.247614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:17.248050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:17.248853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:17.249287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:17.277817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:17.286899 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ec4376a-3fb2-4ff2-b1f7-2214c75400ae tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1469 microversion: 2.1 time: 0.661877 Nov 27 20:46:17.290432 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 159/322] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:16 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1469 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:17.558854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:17.559506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:17.569251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:17.574506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:17.575782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:17.576407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:17.728574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:17.739024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff11db38-80dc-44d8-a0fb-d1ffecfa3d7d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1314 microversion: 2.1 time: 0.514823 Nov 27 20:46:17.743624 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 164/323] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:17 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:17.763244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:17.764050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:17.770829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:17.772202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:17.773216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:17.773898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:17.973365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:17.983966 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-716426a0-778d-41b1-892b-acf1d17f7294 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.224226 Nov 27 20:46:17.995369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 165/324] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:17 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:18.000866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-990914005", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:18.057524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:18.072682 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0bd917ae-4212-4c88-9f2a-a43388704e97 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.518635 Nov 27 20:46:18.073457 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 160/325] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:17 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:18.078161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:18.581964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:18.582585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:18.583146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:18.583747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:18.584425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:18.603540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:18.604005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:18.604810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:18.608373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:18.637246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Getting quotas for project 7e7fd405b830467db077102575590b2e. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:18.643640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Getting quotas for user 559cab992ce74bd0b78a639e4001c918 and project 7e7fd405b830467db077102575590b2e. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:18.652049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7aef351b-0726-4536-a113-7af50081aae4 req-2adffa94-cc0f-47cb-89d3-4bed3d802f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c83605-57d7-4d81-a8ee-b30279bafd6f", "tag": "315cf87c-c809-4b39-b8ec-ef3d92d438f0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:18.654915 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:18.654915 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:18.660886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:18.663825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:18.674275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7aef351b-0726-4536-a113-7af50081aae4 req-2adffa94-cc0f-47cb-89d3-4bed3d802f20 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:18.674717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7aef351b-0726-4536-a113-7af50081aae4 req-2adffa94-cc0f-47cb-89d3-4bed3d802f20 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:18.703964 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7aef351b-0726-4536-a113-7af50081aae4 req-2adffa94-cc0f-47cb-89d3-4bed3d802f20 service nova] Creating event network-changed:315cf87c-c809-4b39-b8ec-ef3d92d438f0 for instance 14c83605-57d7-4d81-a8ee-b30279bafd6f on nch2-master-1 Nov 27 20:46:18.712778 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7aef351b-0726-4536-a113-7af50081aae4 req-2adffa94-cc0f-47cb-89d3-4bed3d802f20 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065561 Nov 27 20:46:18.713379 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 161/326] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:18.726085 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6782fd7a-47ad-46b6-b1f4-33414c13ca26 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729193 Nov 27 20:46:18.728232 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 166/327] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:18.739090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eaba16b5-98d1-4710-b2dc-0f93046cc5f8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:18.739972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eaba16b5-98d1-4710-b2dc-0f93046cc5f8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:18.764077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:18.764533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:18.778806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:18.780115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:18.781337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:18.784505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:18.920897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eaba16b5-98d1-4710-b2dc-0f93046cc5f8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:18.930956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eaba16b5-98d1-4710-b2dc-0f93046cc5f8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1218 microversion: 2.1 time: 0.196413 Nov 27 20:46:18.942575 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 162/328] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:18 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:19.002342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:19.003226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:19.015361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:19.017222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:19.018166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:19.023192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:19.280890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:19.292544 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e7452c2-3607-4421-bd10-1b772458efdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.293437 Nov 27 20:46:19.302106 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 163/329] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:18 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:19.302106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:19.302106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:19.309808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:19.310249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:19.311031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:19.311477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:19.517012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:19.530266 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-642f2fd3-a8f6-4de9-ade0-6eab91b7ad7e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1314 microversion: 2.1 time: 0.772196 Nov 27 20:46:19.536744 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 167/330] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:18 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:19.537838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:19.549922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9ead7fff-6b6a-44f4-b0d7-877d6ee52a55 req-6c02946b-3e77-4eb9-b79a-e8763bab8da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77", "name": "network-vif-plugged", "status": "completed", "tag": "41eff457-e562-48bc-bb0b-6db9a9bacf92"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:19.557152 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:19.557152 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:19.571167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-788c463d-1aad-48e7-a4f2-1946e887376f tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.275752 Nov 27 20:46:19.572193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 164/331] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:19 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:19.575151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9ead7fff-6b6a-44f4-b0d7-877d6ee52a55 req-6c02946b-3e77-4eb9-b79a-e8763bab8da7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:19.575516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9ead7fff-6b6a-44f4-b0d7-877d6ee52a55 req-6c02946b-3e77-4eb9-b79a-e8763bab8da7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:19.608734 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9ead7fff-6b6a-44f4-b0d7-877d6ee52a55 req-6c02946b-3e77-4eb9-b79a-e8763bab8da7 service nova] Creating event network-vif-plugged:41eff457-e562-48bc-bb0b-6db9a9bacf92 for instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 on nch2-master-1 Nov 27 20:46:19.619178 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9ead7fff-6b6a-44f4-b0d7-877d6ee52a55 req-6c02946b-3e77-4eb9-b79a-e8763bab8da7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080495 Nov 27 20:46:19.627651 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 168/332] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:19.948383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:19.949149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:19.961830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:19.962874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:19.964133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:19.964978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.061929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:20.072648 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4fd52bdd-70be-4ab7-b22d-3c5097c8bcfc tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1270 microversion: 2.1 time: 0.128148 Nov 27 20:46:20.083146 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 165/333] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:19 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:20.312777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:20.313499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:20.321487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.322493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.324513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.326442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.548880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:20.549936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:20.556202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.557830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.561247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.564955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.716583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:20.724387 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-33b97719-ca17-4fe4-b9c0-1f45b572c6a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.418044 Nov 27 20:46:20.735379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 169/334] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:20 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:20.741067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:20.741937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:20.748332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.749077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.750100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.750766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.884138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:20.899572 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-60192e76-6e08-4ed5-b4cb-b5af1cfeac74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1464 microversion: 2.1 time: 0.351900 Nov 27 20:46:20.900597 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 166/335] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:20 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:20.916580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:20.917188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:20.928677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.929121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.929936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:20.930374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:20.959549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:20.967841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2ce8049-a1fc-495f-980a-fde12b7a8c83 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.230566 Nov 27 20:46:20.968417 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 170/336] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:20 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:21.089889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:21.090523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:21.105536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:21.106096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:21.109500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:21.112095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:21.284990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:21.300687 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3716f1cf-8f23-4704-8045-180bb657f57c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1276 microversion: 2.1 time: 0.214556 Nov 27 20:46:21.304974 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 171/337] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:21 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:21.659892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f620367e-3114-4b0a-9b51-38f19a1fe8a0 req-db23955e-6fa4-436d-9046-e774126c134d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76a34a6-fb51-4685-af0f-03a76c89c2f0", "name": "network-vif-plugged", "status": "completed", "tag": "504292fa-16a1-4d42-9aed-d4f56d8c892f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:21.662632 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:21.662632 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:21.693747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f620367e-3114-4b0a-9b51-38f19a1fe8a0 req-db23955e-6fa4-436d-9046-e774126c134d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:21.697493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f620367e-3114-4b0a-9b51-38f19a1fe8a0 req-db23955e-6fa4-436d-9046-e774126c134d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:21.755231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f620367e-3114-4b0a-9b51-38f19a1fe8a0 req-db23955e-6fa4-436d-9046-e774126c134d service nova] Creating event network-vif-plugged:504292fa-16a1-4d42-9aed-d4f56d8c892f for instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 on nch2-master-1 Nov 27 20:46:21.821922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f620367e-3114-4b0a-9b51-38f19a1fe8a0 req-db23955e-6fa4-436d-9046-e774126c134d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118642 Nov 27 20:46:21.832523 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 172/338] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:21.849723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:21.854994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:21.876742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:21.877557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:21.879272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:21.879882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.010096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:22.028963 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ad76d2f-c992-433c-9b31-6c7382143743 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1313 microversion: 2.1 time: 1.115712 Nov 27 20:46:22.030367 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 167/339] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:20 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1313 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:22.046980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.047827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:22.063646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.064187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.071130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.073368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.264292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:22.272121 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf85b984-667d-4364-abf7-3641bb0be14b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.438194 Nov 27 20:46:22.283123 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 173/340] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:21 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:22.435884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e309a3f9-a704-4dea-8a6e-c510c7be017d tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.457101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e309a3f9-a704-4dea-8a6e-c510c7be017d tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.172384 Nov 27 20:46:22.466381 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 174/341] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:22.553304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42b62d6c-d57c-41e2-bebe-c7347f97f209 tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.556151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b62d6c-d57c-41e2-bebe-c7347f97f209 tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.556793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b62d6c-d57c-41e2-bebe-c7347f97f209 tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.557895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b62d6c-d57c-41e2-bebe-c7347f97f209 tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.564314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:22.585202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b62d6c-d57c-41e2-bebe-c7347f97f209 tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.596816 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9525937-4f40-49fc-8c52-8146e3eb0073 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.562636 Nov 27 20:46:22.598213 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 168/342] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:22.618280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.621633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:22.638394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.638845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.643840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.644297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.666998 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42b62d6c-d57c-41e2-bebe-c7347f97f209 tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] 10.222.0.21 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.199390 Nov 27 20:46:22.680248 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 175/343] 10.222.0.21 () {58 vars in 1163 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:46:22.685247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2adef51-567a-49b9-8d29-86659d42a69b tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.710287 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2adef51-567a-49b9-8d29-86659d42a69b tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.028363 Nov 27 20:46:22.711063 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 176/344] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors => generated 2594 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:22.722303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26ff5f02-bdc6-486e-99e9-8cc9c4bf010e tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.723155 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:22.723155 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:22.725085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26ff5f02-bdc6-486e-99e9-8cc9c4bf010e tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.725539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26ff5f02-bdc6-486e-99e9-8cc9c4bf010e tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.726435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26ff5f02-bdc6-486e-99e9-8cc9c4bf010e tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:22.727024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26ff5f02-bdc6-486e-99e9-8cc9c4bf010e tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:22.752180 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26ff5f02-bdc6-486e-99e9-8cc9c4bf010e tempest-AZAdminV2TestJSON-2129231549 tempest-AZAdminV2TestJSON-2129231549-project-admin] 10.222.0.21 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.039881 Nov 27 20:46:22.759704 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 177/345] 10.222.0.21 () {58 vars in 1184 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:22.768135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff83af27-b5f6-4154-9262-4f26b95ad621 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.777939 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff83af27-b5f6-4154-9262-4f26b95ad621 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014774 Nov 27 20:46:22.779703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 178/346] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:22.791368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-044712a0-d473-49f9-b58a-e901e9985ffd tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.806152 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-044712a0-d473-49f9-b58a-e901e9985ffd tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019105 Nov 27 20:46:22.807825 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 179/347] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:22.822747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c341005f-770a-4dd9-abb6-0334f61e8933 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.854300 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c341005f-770a-4dd9-abb6-0334f61e8933 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.039444 Nov 27 20:46:22.855524 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 180/348] 10.222.0.21 () {58 vars in 1164 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:22.869613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3da0f24e-e259-431f-a5a9-47eea9f1bc18 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.879811 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3da0f24e-e259-431f-a5a9-47eea9f1bc18 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014630 Nov 27 20:46:22.881165 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 181/349] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:22.894402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cb68747-d033-4df2-a227-9b0b156d9ba8 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.924001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cb68747-d033-4df2-a227-9b0b156d9ba8 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033756 Nov 27 20:46:22.933914 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 182/350] 10.222.0.21 () {58 vars in 1168 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:22.939493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71d5c46a-9a79-4af4-92fc-0654d42b88ac tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.952310 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71d5c46a-9a79-4af4-92fc-0654d42b88ac tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017019 Nov 27 20:46:22.961349 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 183/351] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:22.979712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-33e6791c-ce05-4d50-b429-6c2d825c7595 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:22.996390 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-33e6791c-ce05-4d50-b429-6c2d825c7595 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023666 Nov 27 20:46:22.996983 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 184/352] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:23.008692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5442a28-2028-4c5c-b281-5f16e879e4f3 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.048663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c5442a28-2028-4c5c-b281-5f16e879e4f3 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.043593 Nov 27 20:46:23.049822 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 185/353] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.054695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.055539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:23.063825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:23.064744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:23.065691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:23.066449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:23.154314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:23.167887 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-80c9e5b8-e479-4dd8-8c16-a8fa3ab9d6e0 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1318 microversion: 2.1 time: 0.565983 Nov 27 20:46:23.171231 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 169/354] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:22 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.176502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91b84395-ce9a-4517-ace4-6779a1366ec2 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.196132 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91b84395-ce9a-4517-ace4-6779a1366ec2 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023815 Nov 27 20:46:23.203078 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 170/355] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:23.209054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f3df2ef-4931-484d-ae2f-47c37965054f tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.237910 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f3df2ef-4931-484d-ae2f-47c37965054f tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.033298 Nov 27 20:46:23.247408 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 171/356] 10.222.0.21 () {58 vars in 1143 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.255844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee5a966c-a206-4e42-96b1-4085a1929941 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.267243 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee5a966c-a206-4e42-96b1-4085a1929941 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016522 Nov 27 20:46:23.268825 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 172/357] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:46:23.314660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-713be84b-8338-4aa9-88f7-88ee588353c8 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.338385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:23.346204 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f2c2ff4-136f-4836-968a-73c08ec79e02 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1463 microversion: 2.1 time: 0.295177 Nov 27 20:46:23.350468 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 186/358] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1463 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.355730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.356332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:23.380919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:23.382423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:23.384144 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-713be84b-8338-4aa9-88f7-88ee588353c8 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.107329 Nov 27 20:46:23.392389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:23.392389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:23.392670 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 173/359] 10.222.0.21 () {58 vars in 1147 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.400142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bfc131f3-4bc4-4302-a987-7493249b9822 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.415201 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bfc131f3-4bc4-4302-a987-7493249b9822 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020686 Nov 27 20:46:23.422337 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 174/360] 10.222.0.21 () {58 vars in 1139 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:23.432485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97608b56-4bfb-493a-b50c-86a1170ee3b7 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.442261 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97608b56-4bfb-493a-b50c-86a1170ee3b7 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013901 Nov 27 20:46:23.443750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 175/361] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:23.454127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8125f02b-822d-45cf-bf16-db19937441d6 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.507326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8125f02b-822d-45cf-bf16-db19937441d6 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.055547 Nov 27 20:46:23.512644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 176/362] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.528515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f23ff795-2df5-414a-87fd-46a45ed0ac24 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.566700 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f23ff795-2df5-414a-87fd-46a45ed0ac24 tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045259 Nov 27 20:46:23.567941 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 177/363] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.574813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2078814445", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:23.669330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:23.759343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:23.766937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00d1cff7-6edf-49a7-b28f-8be95af6270b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.415699 Nov 27 20:46:23.767902 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 187/364] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:23.776678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-277956c1-ddcf-4a5d-aff7-c13700cc763d tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.803917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-277956c1-ddcf-4a5d-aff7-c13700cc763d tempest-FlavorsV2TestJSON-2113033482 tempest-FlavorsV2TestJSON-2113033482-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031790 Nov 27 20:46:23.814007 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 188/365] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:23.821549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:23.827187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:23.841320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:23.841772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:23.842578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:23.844441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.149362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:24.163059 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f12fde4-81e4-4c69-a0fe-04fa1eaa99aa tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1320 microversion: 2.1 time: 0.347687 Nov 27 20:46:24.166243 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 189/366] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:23 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:24.171592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-114f0b17-7982-4de7-a80e-043b6e9455f9 req-ad311f32-e657-4674-b0b7-47b7d3b6d77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c83605-57d7-4d81-a8ee-b30279bafd6f", "name": "network-vif-plugged", "status": "completed", "tag": "315cf87c-c809-4b39-b8ec-ef3d92d438f0"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:24.173155 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:24.173155 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:24.183628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-114f0b17-7982-4de7-a80e-043b6e9455f9 req-ad311f32-e657-4674-b0b7-47b7d3b6d77d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.184442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-114f0b17-7982-4de7-a80e-043b6e9455f9 req-ad311f32-e657-4674-b0b7-47b7d3b6d77d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.199616 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-114f0b17-7982-4de7-a80e-043b6e9455f9 req-ad311f32-e657-4674-b0b7-47b7d3b6d77d service nova] Creating event network-vif-plugged:315cf87c-c809-4b39-b8ec-ef3d92d438f0 for instance 14c83605-57d7-4d81-a8ee-b30279bafd6f on nch2-master-1 Nov 27 20:46:24.205824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-114f0b17-7982-4de7-a80e-043b6e9455f9 req-ad311f32-e657-4674-b0b7-47b7d3b6d77d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037999 Nov 27 20:46:24.206665 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 190/367] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:24.213095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8a9d76ed-a408-4eda-aeab-6b30a206c8a4 req-a81613c8-daba-452d-91d9-a635d8496adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927d4c83-0a2a-4237-90fb-edae98280a7d", "tag": "cc80c785-1cc6-4355-ac2e-daab2c4b016b"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:24.227481 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:24.227481 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:24.236963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8a9d76ed-a408-4eda-aeab-6b30a206c8a4 req-a81613c8-daba-452d-91d9-a635d8496adc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.237775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8a9d76ed-a408-4eda-aeab-6b30a206c8a4 req-a81613c8-daba-452d-91d9-a635d8496adc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.268456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8a9d76ed-a408-4eda-aeab-6b30a206c8a4 req-a81613c8-daba-452d-91d9-a635d8496adc service nova] Creating event network-changed:cc80c785-1cc6-4355-ac2e-daab2c4b016b for instance 927d4c83-0a2a-4237-90fb-edae98280a7d on nch1-master-1 Nov 27 20:46:24.283651 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8a9d76ed-a408-4eda-aeab-6b30a206c8a4 req-a81613c8-daba-452d-91d9-a635d8496adc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075358 Nov 27 20:46:24.285285 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 191/368] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:24.292279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:24.293095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:24.310421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.311287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.312322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.313012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.456817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:24.457277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:24.457666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:24.458244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:24.458795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:24.477497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.478040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.480189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.483855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.529962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Getting quotas for project c8c32b0fff364ad7b9bbaf1fb71e3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:24.532358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:24.542080 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-615f1691-7d54-471c-8eae-808f36ec6589 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1318 microversion: 2.1 time: 0.254324 Nov 27 20:46:24.551603 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 192/369] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:24 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:24.551721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Getting quotas for user 1a069b7aa4c94607943e3493c6295fb3 and project c8c32b0fff364ad7b9bbaf1fb71e3a67. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:24.565132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:24.567700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:24.626459 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7fec54f6-5f8a-4785-a637-e46ebb7557b1 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054993 Nov 27 20:46:24.629720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 178/370] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:24.638409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07534172-adda-4198-a21a-61f0880e3188 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:24.640205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07534172-adda-4198-a21a-61f0880e3188 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:24.786984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:24.788131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:24.801655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.803822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.805943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:24.808287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:24.810325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-07534172-adda-4198-a21a-61f0880e3188 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:24.820746 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07534172-adda-4198-a21a-61f0880e3188 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1214 microversion: 2.1 time: 0.185971 Nov 27 20:46:24.822280 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 193/371] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:24 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:25.103959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:25.119751 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc3ea07e-dfec-4557-a7d7-abb914992cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1313 microversion: 2.1 time: 0.336810 Nov 27 20:46:25.121850 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 179/372] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:24 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:25.182275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:25.183348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:25.202257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.202715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.208867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.209681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.539946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:25.551039 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0475412d-6c8c-4f35-a173-93988104c0b9 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1470 microversion: 2.1 time: 0.372386 Nov 27 20:46:25.552543 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 194/373] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:25 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1470 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:25.568245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-182effd5-9cf1-4366-9eb7-b1e148d5f79d tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:25.568460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:25.569110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:25.570687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-182effd5-9cf1-4366-9eb7-b1e148d5f79d tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:25.577771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-182effd5-9cf1-4366-9eb7-b1e148d5f79d tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.577916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.578132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-182effd5-9cf1-4366-9eb7-b1e148d5f79d tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.579580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.580039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-182effd5-9cf1-4366-9eb7-b1e148d5f79d tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.580368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.580799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-182effd5-9cf1-4366-9eb7-b1e148d5f79d tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.580945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.749413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-182effd5-9cf1-4366-9eb7-b1e148d5f79d tempest-DeleteServersAdminTestJSON-594647049 tempest-DeleteServersAdminTestJSON-594647049-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0/action" status: 202 len: 0 microversion: 2.1 time: 0.185065 Nov 27 20:46:25.751114 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 195/374] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:25 2021] POST /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:46:25.762452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:25.764688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:25.778291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.780205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.782366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.784226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.878781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:25.880444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:25.881527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lazy-loading 'fault' on Instance uuid f76a34a6-fb51-4685-af0f-03a76c89c2f0 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:26.287410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:26.298012 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c6b6f4d-14f8-4e33-baac-2e8ffc7f6da8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1318 microversion: 2.1 time: 0.742281 Nov 27 20:46:26.312384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 180/375] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:25 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1318 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:26.323996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:26.324621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:26.336874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.338712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.340934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.342832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.450803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:26.459056 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c1adcb8-c5a7-4a2a-aa8c-0c49a84c8380 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1272 microversion: 2.1 time: 0.145267 Nov 27 20:46:26.459729 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 181/376] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:26 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:26.465009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:26.465792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:26.471839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.472463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.473411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.473996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.489326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:26.498819 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-24322c76-7da0-4c3c-88e3-030857c08d45 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1453 microversion: 2.1 time: 0.743656 Nov 27 20:46:26.515206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 196/377] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:25 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1453 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:26.634812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:26.642819 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-821b9d84-c47f-4e82-8ced-7931d3f702fe tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1463 microversion: 2.1 time: 0.181921 Nov 27 20:46:26.643885 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 182/378] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:26 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:26.659855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:26.660752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:26.670209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.671370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.672484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.673083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.716156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:46:26.888210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ac69dc6-2ed0-454a-905e-7de4d2dc00c7 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 204 len: 0 microversion: 2.1 time: 0.242156 Nov 27 20:46:26.895039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-997a81b2-5315-488c-b9d0-fac54d696f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d4317670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:26.897052 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:26.897052 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:26.900867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-997a81b2-5315-488c-b9d0-fac54d696f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.901573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-997a81b2-5315-488c-b9d0-fac54d696f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.903869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-997a81b2-5315-488c-b9d0-fac54d696f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.907911 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 183/379] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:26 2021] DELETE /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:46:26.910549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-997a81b2-5315-488c-b9d0-fac54d696f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.963418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-997a81b2-5315-488c-b9d0-fac54d696f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.446642 Nov 27 20:46:26.965031 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 197/380] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:46:26 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:26.971088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:26.971963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:26.991733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.993102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:26.994106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:26.994545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.038643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.039421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.040020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lazy-loading 'fault' on Instance uuid f76a34a6-fb51-4685-af0f-03a76c89c2f0 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:27.345822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee1c1e47-2763-4645-8559-3dc8ad0a09e3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:27.347134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ee1c1e47-2763-4645-8559-3dc8ad0a09e3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:27.363006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee1c1e47-2763-4645-8559-3dc8ad0a09e3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.363793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee1c1e47-2763-4645-8559-3dc8ad0a09e3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.364845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee1c1e47-2763-4645-8559-3dc8ad0a09e3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.367192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee1c1e47-2763-4645-8559-3dc8ad0a09e3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.458530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:27.468609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-268ad1c4-1475-40bb-a8ba-91fc46d8aaf5 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1459 microversion: 2.1 time: 0.502203 Nov 27 20:46:27.471794 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 198/381] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:26 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1459 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:27.476453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-69f52674-5712-4433-a302-5ffce3b279cd tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d4317c10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:27.479685 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:27.479685 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:27.482615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69f52674-5712-4433-a302-5ffce3b279cd tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.484361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69f52674-5712-4433-a302-5ffce3b279cd tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.486675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69f52674-5712-4433-a302-5ffce3b279cd tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.488622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69f52674-5712-4433-a302-5ffce3b279cd tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.539346 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-69f52674-5712-4433-a302-5ffce3b279cd tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.065777 Nov 27 20:46:27.546801 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 199/382] 10.222.0.21 () {58 vars in 1138 bytes} [Sat Nov 27 20:46:27 2021] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:27.551689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:27.553288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:27.564426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.565912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.566996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.569231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.878172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:27.887030 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c8e2d0ed-67fe-4ebc-8dba-4834bde2924e tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1318 microversion: 2.1 time: 0.339007 Nov 27 20:46:27.887954 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 200/383] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:27 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:27.903457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:27.904999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:27.918370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.918661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.922716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:27.923964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:27.986456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee1c1e47-2763-4645-8559-3dc8ad0a09e3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1614 microversion: 2.1 time: 1.075402 Nov 27 20:46:27.989179 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 184/384] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:26 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1614 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:28.004441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7dd4d22e-345c-4bdd-8922-66df575def6a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d45be790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:28.008201 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:28.008201 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:28.012781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dd4d22e-345c-4bdd-8922-66df575def6a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:28.013346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dd4d22e-345c-4bdd-8922-66df575def6a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:28.014330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dd4d22e-345c-4bdd-8922-66df575def6a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:28.014966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dd4d22e-345c-4bdd-8922-66df575def6a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:28.046159 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7dd4d22e-345c-4bdd-8922-66df575def6a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.055196 Nov 27 20:46:28.047583 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 185/385] 10.222.0.21 () {58 vars in 1144 bytes} [Sat Nov 27 20:46:27 2021] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:46:28.374340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:28.385589 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41a50333-ac51-4296-a2c7-cc73041ee194 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1314 microversion: 2.1 time: 0.492389 Nov 27 20:46:28.396561 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 201/386] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:27 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:28.406629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:28.407221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:28.419842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:28.420302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:28.421105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:28.424097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-444364714", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "979446f3-8da8-4e53-af09-3da825cab09f"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:28.430151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:28.547742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] validate_networks() for [('979446f3-8da8-4e53-af09-3da825cab09f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:28.972993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1b2ee0ab190e4d4d9005d8d9f432f414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59ee766273440ad9e1b4b17af7c1c2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:28.973625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] flavor_id is None. Assuming migration. {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 27 20:46:28.974083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 20:46:29.585328 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd9866d0-23ad-4818-b95c-86bed5d97201 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f/action" status: 202 len: 0 microversion: 2.1 time: 1.185277 Nov 27 20:46:29.586314 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 202/387] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:28 2021] POST /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f/action => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:29.593041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb83dc01-4604-4479-a579-c67107312f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d42adaf0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:29.594335 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:29.594335 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:29.596071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb83dc01-4604-4479-a579-c67107312f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.596606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb83dc01-4604-4479-a579-c67107312f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.597489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb83dc01-4604-4479-a579-c67107312f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.598075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb83dc01-4604-4479-a579-c67107312f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.634563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fb83dc01-4604-4479-a579-c67107312f3a tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.046926 Nov 27 20:46:29.635557 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 203/388] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:46:29 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:29.640154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:29.640887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:29.648832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.649290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.650091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.650536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.689492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.689948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.690416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lazy-loading 'fault' on Instance uuid f76a34a6-fb51-4685-af0f-03a76c89c2f0 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:29.738719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eff5913736b4e77ac2b092534edfcd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53c15d688a541849c224abc382dff55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:29.746887 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed522061-3e25-4cc8-aff9-8b81e2eef897 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 200 len: 1417 microversion: 2.1 time: 0.110210 Nov 27 20:46:29.747868 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 204/389] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:29 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 1417 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:29.752352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:29.752959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:29.759885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.760511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.761322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.761767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.962570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:29.963146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:29.963606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:29.964006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:29.964412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:29.975501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.976481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:29.977302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:29.977733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.029061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:30.030203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:30.039176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4508b472-6678-4ccb-8aed-d6cebffd7cff tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1318 microversion: 2.1 time: 0.289593 Nov 27 20:46:30.039799 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 205/390] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:29 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:30.046288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for user 2d326a07ce104727bec8ae98dabea64d and project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:30.053570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f0e23e40-bb6d-41ce-b701-68eb0a4ebb63 req-045a5237-3d52-462b-8894-c16fe6e407ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e727772-99b2-45c0-9110-ac8dce65e2ae", "tag": "921d53f1-521d-4cdd-b823-85f92a7d7fd4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:30.056329 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:30.056329 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:30.068211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f0e23e40-bb6d-41ce-b701-68eb0a4ebb63 req-045a5237-3d52-462b-8894-c16fe6e407ce service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.068878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f0e23e40-bb6d-41ce-b701-68eb0a4ebb63 req-045a5237-3d52-462b-8894-c16fe6e407ce service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.080901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:30.082312 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f0e23e40-bb6d-41ce-b701-68eb0a4ebb63 req-045a5237-3d52-462b-8894-c16fe6e407ce service nova] Creating event network-changed:921d53f1-521d-4cdd-b823-85f92a7d7fd4 for instance 7e727772-99b2-45c0-9110-ac8dce65e2ae on nch2-master-1 Nov 27 20:46:30.083667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:30.088621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f0e23e40-bb6d-41ce-b701-68eb0a4ebb63 req-045a5237-3d52-462b-8894-c16fe6e407ce service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046256 Nov 27 20:46:30.089412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 206/391] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:30.191975 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96864b3a-6bb8-4443-9ef4-78fe6656c941 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.142825 Nov 27 20:46:30.192807 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 186/392] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 20:46:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 20:46:30.203498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:30.204320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:30.220820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.221481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.222418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.223003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.442339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddad5449-6fbf-4500-897d-d4e206d37c36 tempest-AZAdminNegativeTestJSON-912258812 tempest-AZAdminNegativeTestJSON-912258812-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:30.443205 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:30.443205 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:30.444505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ddad5449-6fbf-4500-897d-d4e206d37c36 tempest-AZAdminNegativeTestJSON-912258812 tempest-AZAdminNegativeTestJSON-912258812-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '65774597003f4490b5f87a9d5961adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b989c20b5c4459b1d9c5c1a375640b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:30.445192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddad5449-6fbf-4500-897d-d4e206d37c36 tempest-AZAdminNegativeTestJSON-912258812 tempest-AZAdminNegativeTestJSON-912258812-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:30.446003 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddad5449-6fbf-4500-897d-d4e206d37c36 tempest-AZAdminNegativeTestJSON-912258812 tempest-AZAdminNegativeTestJSON-912258812-project] 10.222.0.21 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.355355 Nov 27 20:46:30.450321 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 207/393] 10.222.0.21 () {58 vars in 1184 bytes} [Sat Nov 27 20:46:30 2021] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 360 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:30.469963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:30.471513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:30.488417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.491297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.491297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.491297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.784719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:30.795655 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a911b835-705c-45ce-bca5-00ae25f4f7ac tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1472 microversion: 2.1 time: 0.337063 Nov 27 20:46:30.799924 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 208/394] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:30 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:30.817078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f79b7352-513e-43bb-81e0-e3227d0508f0 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d417b3a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:30.820078 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:30.820078 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:30.827973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79b7352-513e-43bb-81e0-e3227d0508f0 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.828859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79b7352-513e-43bb-81e0-e3227d0508f0 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.830188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79b7352-513e-43bb-81e0-e3227d0508f0 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.831536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79b7352-513e-43bb-81e0-e3227d0508f0 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.891872 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f79b7352-513e-43bb-81e0-e3227d0508f0 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.088867 Nov 27 20:46:30.896728 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 209/395] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:46:30 2021] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:30.902276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9b98341b-2ff6-4766-aa92-c2c7506b01b9 req-8c25381f-2905-42a9-a231-b54dee22c54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76a34a6-fb51-4685-af0f-03a76c89c2f0", "name": "network-vif-deleted", "tag": "504292fa-16a1-4d42-9aed-d4f56d8c892f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:30.922035 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:30.922035 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:30.948923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9b98341b-2ff6-4766-aa92-c2c7506b01b9 req-8c25381f-2905-42a9-a231-b54dee22c54b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:30.951512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9b98341b-2ff6-4766-aa92-c2c7506b01b9 req-8c25381f-2905-42a9-a231-b54dee22c54b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:30.970742 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9b98341b-2ff6-4766-aa92-c2c7506b01b9 req-8c25381f-2905-42a9-a231-b54dee22c54b service nova] Creating event network-vif-deleted:504292fa-16a1-4d42-9aed-d4f56d8c892f for instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 on nch2-master-1 Nov 27 20:46:30.997370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9b98341b-2ff6-4766-aa92-c2c7506b01b9 req-8c25381f-2905-42a9-a231-b54dee22c54b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099085 Nov 27 20:46:30.997962 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 210/396] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:31.018663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.019542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.035062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.035718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.036379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.036813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.173762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:31.189860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:31.192011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:31.197320 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d925cf04-d552-498c-ac61-4e81eab6160f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1265 microversion: 2.25 time: 0.198247 Nov 27 20:46:31.201795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 211/397] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:30 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:31.208828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.213969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.229693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.231423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.232225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.235750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.280821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] HTTP exception thrown: Instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 could not be found. Nov 27 20:46:31.284014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Returning 404 to user: Instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:31.285506 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3511fb66-0a90-44cf-a4cc-74c43b014d60 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 404 len: 111 microversion: 2.1 time: 0.082501 Nov 27 20:46:31.286390 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 212/398] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:31.298583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b2ae9675-3dbf-45b6-8387-001aaea4ddb6 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d41405e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.301900 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:31.301900 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:31.306590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2ae9675-3dbf-45b6-8387-001aaea4ddb6 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.307149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2ae9675-3dbf-45b6-8387-001aaea4ddb6 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.308320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2ae9675-3dbf-45b6-8387-001aaea4ddb6 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.308769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2ae9675-3dbf-45b6-8387-001aaea4ddb6 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.321078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:31.333305 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74c7c49d-9af1-4085-a7c2-343377805a59 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1314 microversion: 2.1 time: 1.132782 Nov 27 20:46:31.334955 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 187/399] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:30 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1314 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:31.341959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.343341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.359661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.360354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.361353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.362098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.391677 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b2ae9675-3dbf-45b6-8387-001aaea4ddb6 tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.103938 Nov 27 20:46:31.396387 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 213/400] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:31.406636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4fd44911-71ae-4085-84f9-c936263a983c req-06b31cf5-8819-469b-87aa-dc7873a98adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927d4c83-0a2a-4237-90fb-edae98280a7d", "name": "network-vif-plugged", "status": "completed", "tag": "cc80c785-1cc6-4355-ac2e-daab2c4b016b"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:31.411059 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:31.411059 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:31.432966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4fd44911-71ae-4085-84f9-c936263a983c req-06b31cf5-8819-469b-87aa-dc7873a98adf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.437714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4fd44911-71ae-4085-84f9-c936263a983c req-06b31cf5-8819-469b-87aa-dc7873a98adf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.466686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4fd44911-71ae-4085-84f9-c936263a983c req-06b31cf5-8819-469b-87aa-dc7873a98adf service nova] Creating event network-vif-plugged:cc80c785-1cc6-4355-ac2e-daab2c4b016b for instance 927d4c83-0a2a-4237-90fb-edae98280a7d on nch1-master-1 Nov 27 20:46:31.473859 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4fd44911-71ae-4085-84f9-c936263a983c req-06b31cf5-8819-469b-87aa-dc7873a98adf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075374 Nov 27 20:46:31.479974 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 214/401] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:31.487326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.488242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.496024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.496861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.497837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.498940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.516981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] HTTP exception thrown: Instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 could not be found. Nov 27 20:46:31.518187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Returning 404 to user: Instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:31.519295 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-269af1cc-f478-45fc-86ff-cfc80efcf920 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 404 len: 111 microversion: 2.1 time: 0.037534 Nov 27 20:46:31.520229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 215/402] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:31 2021] DELETE /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:31.527048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86cbea5d-92d7-4da5-89a7-f2449399376c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d42b7f70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.528214 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:31.528214 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:31.535767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86cbea5d-92d7-4da5-89a7-f2449399376c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.536963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86cbea5d-92d7-4da5-89a7-f2449399376c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.552016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86cbea5d-92d7-4da5-89a7-f2449399376c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.552837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86cbea5d-92d7-4da5-89a7-f2449399376c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.584713 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86cbea5d-92d7-4da5-89a7-f2449399376c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 598 microversion: 2.1 time: 0.062914 Nov 27 20:46:31.589339 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 216/403] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 598 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:31.598091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.600401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f76a34a6-fb51-4685-af0f-03a76c89c2f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.617787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.618245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.619621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.620071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.652146 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] HTTP exception thrown: Instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 could not be found. Nov 27 20:46:31.652772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Returning 404 to user: Instance f76a34a6-fb51-4685-af0f-03a76c89c2f0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:31.653875 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-119f9e8e-e77a-42cb-99b8-2c225593a4ec tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0" status: 404 len: 111 microversion: 2.1 time: 0.063531 Nov 27 20:46:31.657610 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 217/404] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/servers/f76a34a6-fb51-4685-af0f-03a76c89c2f0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:31.662259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9af22b4b-9a7b-4b8e-a18b-eacbbacedc8c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Calling method '.version_select at 0x7f15d4140430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.663042 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:31.663042 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:31.670299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9af22b4b-9a7b-4b8e-a18b-eacbbacedc8c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.694074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9af22b4b-9a7b-4b8e-a18b-eacbbacedc8c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.717592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9af22b4b-9a7b-4b8e-a18b-eacbbacedc8c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.718520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9af22b4b-9a7b-4b8e-a18b-eacbbacedc8c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.762316 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9af22b4b-9a7b-4b8e-a18b-eacbbacedc8c tempest-HostsAdminTestJSON-1032627434 tempest-HostsAdminTestJSON-1032627434-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.103574 Nov 27 20:46:31.762940 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 218/405] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:31.768193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.768689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.775800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.776231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.779793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.780578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.802743 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] HTTP exception thrown: Instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 could not be found. Nov 27 20:46:31.803842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Returning 404 to user: Instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:31.804728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a74cac94-820f-4286-bdc2-a590732974e0 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 404 len: 111 microversion: 2.1 time: 0.040680 Nov 27 20:46:31.809179 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 219/406] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:31 2021] DELETE /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:31.815528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.816246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] [instance: f6d80b32-2808-471a-8a0e-4be5eef50ad1] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.826935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.829100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.830276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.830395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.864421 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] HTTP exception thrown: Instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 could not be found. Nov 27 20:46:31.865074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] Returning 404 to user: Instance f6d80b32-2808-471a-8a0e-4be5eef50ad1 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:31.867125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-697a4f6a-9c4b-4e2f-9ea9-1cf1a76a9e75 tempest-DeleteServersAdminTestJSON-1921123353 tempest-DeleteServersAdminTestJSON-1921123353-project] 10.222.0.21 "GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1" status: 404 len: 111 microversion: 2.1 time: 0.056737 Nov 27 20:46:31.873574 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 220/407] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/servers/f6d80b32-2808-471a-8a0e-4be5eef50ad1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:31.890762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:31.892944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:31.905323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.905772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.906631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:31.907135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:31.967069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:31.993080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cddbc4bb-2d7e-40b4-a4ec-228729e1f6e7 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1318 microversion: 2.1 time: 0.655511 Nov 27 20:46:31.994021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 188/408] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:32.217865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:32.218468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:32.224624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:32.227536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:32.233139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:32.233812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:32.380502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:32.393429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2b24d60-4100-4b55-8a72-589fe17316d7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1472 microversion: 2.1 time: 0.514966 Nov 27 20:46:32.394073 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 221/409] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:31 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1472 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:32.406976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:32.408871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:32.409648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:32.416914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:32.417549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:32.419037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:32.419677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:32.428331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:32.430745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:32.446543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-336b39c7-83fe-4afb-97e8-c26a75209112 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1331 microversion: 2.25 time: 0.232424 Nov 27 20:46:32.447689 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 189/410] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:32 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1331 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:33.011668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:33.017115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:33.024739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:33.025621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:33.026844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:33.027542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:33.288837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:33.305588 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e9671b30-2dfd-4b50-aeac-f9a1547278ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1314 microversion: 2.1 time: 0.898040 Nov 27 20:46:33.307130 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 222/411] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:32 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:33.411479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:33.412455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:33.426128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:33.426584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:33.427496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:33.428002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:33.796855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:33.814880 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9df45148-5e76-4792-bced-6c30bf6ce7e8 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1318 microversion: 2.1 time: 0.807774 Nov 27 20:46:33.815947 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 190/412] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:33 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:33.822243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:33.823144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:33.832517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:33.833355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:33.836753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:33.838198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:33.966109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:33.974720 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-631fd587-d60a-4d56-b1ed-9a30185878fc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1472 microversion: 2.1 time: 0.566808 Nov 27 20:46:33.976328 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 223/413] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:33 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1472 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:34.220609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:34.247043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:34.265791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:34.270363 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0eb39177-29d3-456e-b6b9-e0cae7f95531 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.452731 Nov 27 20:46:34.271165 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 191/414] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:33 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:34.324293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:34.324979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:34.337071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:34.338643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:34.345457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:34.346191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:34.839626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:34.840445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:34.862191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:34.862644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:34.863552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:34.864055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.008131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:35.021336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a2cd8f6-aaec-4ed3-892b-e432f95d57cc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1314 microversion: 2.1 time: 0.702077 Nov 27 20:46:35.024122 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 224/415] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:34 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:35.046716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:35.048428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:35.078339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.078827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.079738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.082948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.462971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:35.480039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:35.488053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-942d29d7-b468-4d2c-b492-ff8d7bdc2c93 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.462753 Nov 27 20:46:35.488647 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 225/416] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:35 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:35.494136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d4117d0f-80d1-4f48-a681-68dcf10f339a tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1467 microversion: 2.1 time: 0.660907 Nov 27 20:46:35.502212 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 192/417] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:34 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1467 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:35.514792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-80a18ca3-0107-44b4-aecb-51134b118541 req-d0179779-3ca8-4477-89b6-048e0982edaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e727772-99b2-45c0-9110-ac8dce65e2ae", "name": "network-vif-plugged", "status": "completed", "tag": "921d53f1-521d-4cdd-b823-85f92a7d7fd4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:35.521720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:35.522590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:35.522738 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:35.522738 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:35.533912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.540552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.541754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.542348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.547092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80a18ca3-0107-44b4-aecb-51134b118541 req-d0179779-3ca8-4477-89b6-048e0982edaf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.547650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80a18ca3-0107-44b4-aecb-51134b118541 req-d0179779-3ca8-4477-89b6-048e0982edaf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.579593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-80a18ca3-0107-44b4-aecb-51134b118541 req-d0179779-3ca8-4477-89b6-048e0982edaf service nova] Creating event network-vif-plugged:921d53f1-521d-4cdd-b823-85f92a7d7fd4 for instance 7e727772-99b2-45c0-9110-ac8dce65e2ae on nch2-master-1 Nov 27 20:46:35.591781 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-80a18ca3-0107-44b4-aecb-51134b118541 req-d0179779-3ca8-4477-89b6-048e0982edaf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085471 Nov 27 20:46:35.592414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 193/418] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:35.608328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:35.610249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:35.623025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.628032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.629124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.629810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.768301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lazy-loading 'flavor' on Instance uuid 927d4c83-0a2a-4237-90fb-edae98280a7d {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:35.896201 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1d707ae-01da-4fa9-a998-7bff32c7ca53 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d/action" status: 202 len: 0 microversion: 2.1 time: 0.299109 Nov 27 20:46:35.903477 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 194/419] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:35 2021] POST /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:35.915381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e1e1cda8-1b74-4945-9815-2efabc64117b req-647a665e-04da-4e1e-b699-22baf551fa42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0d3056-c6e0-415c-b5a5-28fea06f98b3", "tag": "e37a2959-a2b3-4d7f-9dd6-d943c2ac302c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:35.917379 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:35.917379 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:35.942511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e1e1cda8-1b74-4945-9815-2efabc64117b req-647a665e-04da-4e1e-b699-22baf551fa42 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:35.943153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e1e1cda8-1b74-4945-9815-2efabc64117b req-647a665e-04da-4e1e-b699-22baf551fa42 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:35.956936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e1e1cda8-1b74-4945-9815-2efabc64117b req-647a665e-04da-4e1e-b699-22baf551fa42 service nova] Creating event network-changed:e37a2959-a2b3-4d7f-9dd6-d943c2ac302c for instance df0d3056-c6e0-415c-b5a5-28fea06f98b3 on nch2-master-1 Nov 27 20:46:35.966330 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e1e1cda8-1b74-4945-9815-2efabc64117b req-647a665e-04da-4e1e-b699-22baf551fa42 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061143 Nov 27 20:46:35.967173 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 195/420] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:35.982566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:35.983714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:36.001090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:36.001536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:36.002323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:36.002752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:36.077305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:36.109326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:36.113902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:36.115376 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30570da5-9926-43dd-aa60-48ec63d11be4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.597374 Nov 27 20:46:36.118208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 226/421] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:35 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:36.128653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:36.132591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:36.144360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:36.145049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:36.146052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:36.146710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:36.409856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:36.426566 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45da7a98-284a-4200-8f03-8d9b7ccec056 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1475 microversion: 2.1 time: 0.457754 Nov 27 20:46:36.441500 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 196/422] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:35 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:36.506717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:36.508262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:36.522160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:36.523155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:36.530502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:36.530969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:36.765443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:36.778864 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a8c8eb3a-1213-4564-83e8-8e0b0050882a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1314 microversion: 2.1 time: 0.656346 Nov 27 20:46:36.791026 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 227/423] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:36 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:37.138684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:37.140437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:37.159659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:37.162625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:37.164205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:37.164641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:37.172344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:37.185646 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-038bcf67-bfc2-4c1e-903f-1dc11810bed7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.678844 Nov 27 20:46:37.186290 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 197/424] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:36 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:37.449082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:37.449766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:37.465008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:37.466802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:37.470911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:37.473470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:37.867050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:37.879372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:37.884483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:37.887839 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ced4174f-1e9f-42ce-a2cc-96e6580aa5ee tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.755402 Nov 27 20:46:37.888970 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 228/425] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:37 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:46:37.893899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:37.894712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:37.919111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:37.920434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:37.923781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:37.925260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:38.228694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:38.238128 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9bb4ed70-786d-4b73-b343-f344522ac0e4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1464 microversion: 2.1 time: 0.347820 Nov 27 20:46:38.242173 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 229/426] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:37 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1464 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:38.262484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:38.263857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:38.291839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:38.292888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:38.294145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:38.294643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:38.536262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:38.548772 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9fedd4eb-eb5b-4485-8e1a-0559ce5b7e0c tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1458 microversion: 2.1 time: 1.103380 Nov 27 20:46:38.551078 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 198/427] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:37 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1458 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:38.650489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:38.661774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb94a709-35ed-438a-8e0f-d6562e737783 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.415671 Nov 27 20:46:38.667601 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 230/428] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:38 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:38.675485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9013d2f-c0cd-4ec9-8a39-c2686c490e3f tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:38.676359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9013d2f-c0cd-4ec9-8a39-c2686c490e3f tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:38.688337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9013d2f-c0cd-4ec9-8a39-c2686c490e3f tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:38.690160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9013d2f-c0cd-4ec9-8a39-c2686c490e3f tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:38.692639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9013d2f-c0cd-4ec9-8a39-c2686c490e3f tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:38.693463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9013d2f-c0cd-4ec9-8a39-c2686c490e3f tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.153505 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9013d2f-c0cd-4ec9-8a39-c2686c490e3f tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1609 microversion: 2.1 time: 0.483590 Nov 27 20:46:39.155344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 231/429] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:38 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1609 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:39.160386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:39.161120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:39.175733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.176443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.177919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.179523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.243671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed1b73ef-48b3-4850-96dd-bee5507c12f3 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:39.247544 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:39.247544 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:39.249262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed1b73ef-48b3-4850-96dd-bee5507c12f3 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Searching by: {'deleted': False, 'project_id': '03e6f572dbff4069a27888a2ddfaf435'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:39.264596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed1b73ef-48b3-4850-96dd-bee5507c12f3 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.268759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed1b73ef-48b3-4850-96dd-bee5507c12f3 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.269723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed1b73ef-48b3-4850-96dd-bee5507c12f3 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.270347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed1b73ef-48b3-4850-96dd-bee5507c12f3 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.391815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:39.404138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:39.406268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:39.407744 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d00ea4d-4e09-40db-a4c7-b11fadfa76db tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.251555 Nov 27 20:46:39.408617 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 232/430] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:39 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:39.413370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ee5bc81-0ee6-4184-94b6-80d39d2de416 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:39.414854 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:39.414854 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:39.418778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ee5bc81-0ee6-4184-94b6-80d39d2de416 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.419465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ee5bc81-0ee6-4184-94b6-80d39d2de416 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.420504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ee5bc81-0ee6-4184-94b6-80d39d2de416 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.421118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ee5bc81-0ee6-4184-94b6-80d39d2de416 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.461833 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ee5bc81-0ee6-4184-94b6-80d39d2de416 tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051965 Nov 27 20:46:39.465613 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed1b73ef-48b3-4850-96dd-bee5507c12f3 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.912670 Nov 27 20:46:39.475213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 233/431] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:46:39 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:39.478379 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 199/432] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:38 2021] GET /compute/v2.1/servers/detail => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:46:39.483795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:39.485895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:39.499870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.500828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.502573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.503501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.552704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Lazy-loading 'flavor' on Instance uuid 927d4c83-0a2a-4237-90fb-edae98280a7d {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:39.575011 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 927d4c83-0a2a-4237-90fb-edae98280a7d while it is in vm_state suspended Nov 27 20:46:39.576105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 927d4c83-0a2a-4237-90fb-edae98280a7d while it is in vm_state suspended {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:39.577697 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca6f6e95-b9a5-4ca8-99d2-9db213fc71dd tempest-LiveMigrationNegativeTest-1284411537 tempest-LiveMigrationNegativeTest-1284411537-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d/action" status: 409 len: 155 microversion: 2.1 time: 0.098277 Nov 27 20:46:39.585656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 200/433] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:39 2021] POST /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:46:39.592044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:39.598928 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:39.598928 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:39.602177 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:39.602177 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:39.604380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Searching by: {'deleted': False} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:39.611524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.612944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.614566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.615232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.813818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:46:39.894442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Calling method '.version_select at 0x7f15d41550d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:39.895559 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:39.895559 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:39.898299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.898962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.913907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.914830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.925720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.926418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.933931 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fcca5834-6c1e-4036-a7db-8df779718950 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.454739 Nov 27 20:46:39.936650 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 234/434] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:39 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:39.951568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:39.952528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:39.961523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.961979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.964584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.965276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:39.966276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:39.966945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:40.010309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:46:40.121303 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-29ee9a0e-ec07-42b9-b0eb-7fae3c6a2f0b tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "DELETE /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 204 len: 0 microversion: 2.1 time: 0.170608 Nov 27 20:46:40.121303 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 235/435] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:39 2021] DELETE /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:46:40.180041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a133a85a-6846-4c37-bd6c-65e820f8a285 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2027620266", "id": 1547942224, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:40.182110 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:40.182110 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:40.205448 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a133a85a-6846-4c37-bd6c-65e820f8a285 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.085998 Nov 27 20:46:40.206793 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 236/436] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:40 2021] POST /compute/v2.1/flavors => generated 430 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:40.224778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:40.226530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:40.240351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:40.243472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:40.245573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:40.246275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:40.443240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:40.456649 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d84ad9d9-4ac2-45fd-a980-5031d78f7325 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.248478 Nov 27 20:46:40.457795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 237/437] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:40 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:40.521554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1754573739", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:40.589912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] validate_networks() for [('928a9d2f-c6ce-4a29-a19b-6db7d0d4717b', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:40.634792 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a64f92d2-f160-42fe-a7f6-09d6ec33578f tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11118 microversion: 2.1 time: 1.047635 Nov 27 20:46:40.635685 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 201/438] 10.222.0.21 () {58 vars in 1170 bytes} [Sat Nov 27 20:46:39 2021] GET /compute/v2.1/servers/detail?all_tenants= => generated 11118 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:40.808970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-754bdac5-565a-4ca3-a1b3-2b9a3ea226ce tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] Calling method '.version_select at 0x7f15d43bf550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:40.809757 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:40.809757 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:40.811028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-754bdac5-565a-4ca3-a1b3-2b9a3ea226ce tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd1761841a6264d6fb141c30558642673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d3787c7e8440b59ed83b4791025546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:40.811691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-754bdac5-565a-4ca3-a1b3-2b9a3ea226ce tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:40.812607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-754bdac5-565a-4ca3-a1b3-2b9a3ea226ce tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.172033 Nov 27 20:46:40.813754 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 202/439] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 20:46:40 2021] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 178 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:40.832123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:40.832830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:40.842899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:40.843412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:40.844264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:40.844701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.077990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:41.087770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b515b8a1-69a7-418b-b5d8-cd1fd6746e10 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1464 microversion: 2.1 time: 0.268889 Nov 27 20:46:41.093646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:41.094062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:41.094531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:41.094928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:41.095360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:41.098414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 203/440] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:40 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1464 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:41.106171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1fe74f2-e1eb-421a-8e92-a786c507c436 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.107159 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:41.107159 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:41.113698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.114162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.114966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.115452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.132678 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1fe74f2-e1eb-421a-8e92-a786c507c436 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1547942224" status: 202 len: 0 microversion: 2.1 time: 0.032084 Nov 27 20:46:41.133443 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 204/441] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:46:41 2021] DELETE /compute/v2.1/flavors/1547942224 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:41.138716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.139505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:41.144400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Getting quotas for project bba5dc062b60481085531bc034e45209. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:41.146098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.148740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.149471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Getting quotas for user 9322591436e34060a46c6f145dca61d7 and project bba5dc062b60481085531bc034e45209. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:41.149833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.151560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.168522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:41.170908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:41.230524 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e03496b8-370a-43fa-8aae-6e587bb91331 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771235 Nov 27 20:46:41.237604 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 238/442] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:41.243234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19b90d73-e6e3-42fe-ad2d-cda5c5de91bb tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.246878 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:41.246878 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:41.249154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19b90d73-e6e3-42fe-ad2d-cda5c5de91bb tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Searching by: {'deleted': False, 'project_id': '03e6f572dbff4069a27888a2ddfaf435'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:41.296425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b90d73-e6e3-42fe-ad2d-cda5c5de91bb tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.296882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b90d73-e6e3-42fe-ad2d-cda5c5de91bb tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.297713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b90d73-e6e3-42fe-ad2d-cda5c5de91bb tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.298155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b90d73-e6e3-42fe-ad2d-cda5c5de91bb tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.443332 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19b90d73-e6e3-42fe-ad2d-cda5c5de91bb tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/detail?tenant_id=c8c32b0fff364ad7b9bbaf1fb71e3a67" status: 200 len: 15 microversion: 2.1 time: 0.204285 Nov 27 20:46:41.455369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 239/443] 10.222.0.21 () {58 vars in 1230 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/servers/detail?tenant_id=c8c32b0fff364ad7b9bbaf1fb71e3a67 => generated 15 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:46:41.455369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50c3a235-246d-46b1-bca6-7265bde6be5d tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Calling method '.version_select at 0x7f15d41405e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.455369 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:41.455369 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:41.456512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50c3a235-246d-46b1-bca6-7265bde6be5d tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.456971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50c3a235-246d-46b1-bca6-7265bde6be5d tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.476596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-50c3a235-246d-46b1-bca6-7265bde6be5d tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 27 20:46:41.477347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50c3a235-246d-46b1-bca6-7265bde6be5d tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:41.478051 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50c3a235-246d-46b1-bca6-7265bde6be5d tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.031084 Nov 27 20:46:41.484266 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 240/444] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:41.488095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e284ed8e-13b6-483e-91ed-014f9534aeac tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.509143 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e284ed8e-13b6-483e-91ed-014f9534aeac tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027499 Nov 27 20:46:41.525190 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 241/445] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:41.529937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e60840d1-77ed-4709-8ceb-0513525d5833 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.530872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e60840d1-77ed-4709-8ceb-0513525d5833 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:41.600303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e60840d1-77ed-4709-8ceb-0513525d5833 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:41.610436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e60840d1-77ed-4709-8ceb-0513525d5833 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1224 microversion: 2.1 time: 0.083577 Nov 27 20:46:41.611110 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 242/446] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:41.626211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.629777 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:41.629777 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:41.631931 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:41.631931 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:41.633601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Searching by: {'tenant_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'deleted': False} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:41.642424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:41.654403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.654984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.655717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:41.656055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.656588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.657212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:41.662485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8d913ae0-f661-4801-950e-0bf5a3052738 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.527929 Nov 27 20:46:41.666855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 205/447] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:41.674020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.674623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:41.693048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.695541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:46:41.695666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.699420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.699905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.831305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.831702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:41.981952 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-502e56f7-7343-4d4c-9668-3ccb8ce997a8 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c8c32b0fff364ad7b9bbaf1fb71e3a67" status: 200 len: 4827 microversion: 2.1 time: 0.359545 Nov 27 20:46:41.982830 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 243/448] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c8c32b0fff364ad7b9bbaf1fb71e3a67 => generated 4827 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:41.993001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Calling method '.version_select at 0x7f15d42f8a60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:41.994210 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:41.994210 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:41.997304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:41.997861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.026052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.026758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.052011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.052458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.062963 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cedf8f45-0d71-4e06-af41-d146e4e482ee tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078485 Nov 27 20:46:42.068325 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 244/449] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:42.076865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20bd61ee-10d8-4ad9-832b-4fc45adf1426 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-175511624", "id": 2057495854, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:42.078677 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:42.078677 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:42.096346 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20bd61ee-10d8-4ad9-832b-4fc45adf1426 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.025202 Nov 27 20:46:42.097754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 245/450] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:42 2021] POST /compute/v2.1/flavors => generated 416 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:42.108293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-662ccd51-d159-485f-b7ff-9d0b1edd6e23 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.113288 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:42.113288 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:42.115717 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:42.115717 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:42.118916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-662ccd51-d159-485f-b7ff-9d0b1edd6e23 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Searching by: {'tenant_id': '03e6f572dbff4069a27888a2ddfaf435', 'deleted': False} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:42.127732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-662ccd51-d159-485f-b7ff-9d0b1edd6e23 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.129136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-662ccd51-d159-485f-b7ff-9d0b1edd6e23 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.130227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-662ccd51-d159-485f-b7ff-9d0b1edd6e23 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.131152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-662ccd51-d159-485f-b7ff-9d0b1edd6e23 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.165272 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-662ccd51-d159-485f-b7ff-9d0b1edd6e23 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=03e6f572dbff4069a27888a2ddfaf435" status: 200 len: 15 microversion: 2.1 time: 0.064269 Nov 27 20:46:42.165945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 246/451] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=03e6f572dbff4069a27888a2ddfaf435 => generated 15 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:46:42.170727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-227833db-ccc6-44db-a606-39a287079a87 tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] Calling method '.version_select at 0x7f15d4155280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.171854 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:42.171854 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:42.173357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-227833db-ccc6-44db-a606-39a287079a87 tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd1761841a6264d6fb141c30558642673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d3787c7e8440b59ed83b4791025546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:42.174122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-227833db-ccc6-44db-a606-39a287079a87 tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:42.175029 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-227833db-ccc6-44db-a606-39a287079a87 tempest-HypervisorAdminNegativeUnderV252Test-1488756591 tempest-HypervisorAdminNegativeUnderV252Test-1488756591-project] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008080 Nov 27 20:46:42.180593 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 247/452] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:42.185101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.185853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:42.195368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.203346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.204392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.204841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.349510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:42.384046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6cbbd23-541d-4e4b-a4cf-4fdb19e002b9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.715004 Nov 27 20:46:42.389056 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 206/453] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:41 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:42.440406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0960784-1cf9-4405-b25a-f422c2a0f540 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.520231 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0960784-1cf9-4405-b25a-f422c2a0f540 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.129656 Nov 27 20:46:42.520849 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 207/454] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:42.545101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-82caf0ae-53c8-446b-981b-d0c6b4c93208 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.552058 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:42.552058 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:42.554191 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-82caf0ae-53c8-446b-981b-d0c6b4c93208 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.019576 Nov 27 20:46:42.562674 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 208/455] 10.222.0.21 () {58 vars in 1188 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:46:42.577662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1994a604-7ec4-4277-b71b-2b63d7bf9082 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Calling method '.version_select at 0x7f15d4186d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.579494 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:42.579494 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:42.581357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1994a604-7ec4-4277-b71b-2b63d7bf9082 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.582193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1994a604-7ec4-4277-b71b-2b63d7bf9082 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.607412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1994a604-7ec4-4277-b71b-2b63d7bf9082 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] HTTP exception thrown: No hypervisor matching 'da420971-8943-4c0f-9e4d-e919d2f2bc46' could be found. Nov 27 20:46:42.613304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1994a604-7ec4-4277-b71b-2b63d7bf9082 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] Returning 404 to user: No hypervisor matching 'da420971-8943-4c0f-9e4d-e919d2f2bc46' could be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:42.616623 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1994a604-7ec4-4277-b71b-2b63d7bf9082 tempest-HypervisorAdminNegativeUnderV252Test-116589955 tempest-HypervisorAdminNegativeUnderV252Test-116589955-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors/da420971-8943-4c0f-9e4d-e919d2f2bc46/servers" status: 404 len: 123 microversion: 2.1 time: 0.051903 Nov 27 20:46:42.617837 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 209/456] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/os-hypervisors/da420971-8943-4c0f-9e4d-e919d2f2bc46/servers => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:42.636945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54f29b69-b6d8-416a-adbd-cb3ccb914bca tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.638091 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:42.638091 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:42.670866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54f29b69-b6d8-416a-adbd-cb3ccb914bca tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/2057495854" status: 202 len: 0 microversion: 2.1 time: 0.051702 Nov 27 20:46:42.675629 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 210/457] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:46:42 2021] DELETE /compute/v2.1/flavors/2057495854 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:42.687780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-189adb25-dc21-4d53-9cb8-e99561d40c83 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:42.689069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-189adb25-dc21-4d53-9cb8-e99561d40c83 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:42.709051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-189adb25-dc21-4d53-9cb8-e99561d40c83 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.714353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-189adb25-dc21-4d53-9cb8-e99561d40c83 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.715589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-189adb25-dc21-4d53-9cb8-e99561d40c83 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.716386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-189adb25-dc21-4d53-9cb8-e99561d40c83 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.721035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:42.736798 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10720575-66f5-443b-bc3a-e6713cfda7ba tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1464 microversion: 2.1 time: 0.557765 Nov 27 20:46:42.751758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 248/458] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1464 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:42.761844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.763455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:42.779941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.780574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.782623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.785793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.887633 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-189adb25-dc21-4d53-9cb8-e99561d40c83 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action" status: 202 len: 0 microversion: 2.1 time: 0.210482 Nov 27 20:46:42.888572 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 211/459] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:42 2021] POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:42.896436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3997b6cc-8540-48de-8c9d-7439a6a8bb22 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.935301 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3997b6cc-8540-48de-8c9d-7439a6a8bb22 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045523 Nov 27 20:46:42.958771 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 212/460] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:42.971207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:42.978157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:42.990386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.991868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:42.992842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:42.997307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:43.113906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:43.132453 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fffa5c1b-a615-43e0-a327-9a60c7728943 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1276 microversion: 2.1 time: 0.378387 Nov 27 20:46:43.135842 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 249/461] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1276 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:43.155857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:43.165927 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:43.165927 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:43.170700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:43.171630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:43.187664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:43.191642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:43.192539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:43.192985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:43.392912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:46:43.522724 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7db754bf-80e0-4a8a-90b5-bdc7e1b1aaf9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.384684 Nov 27 20:46:43.528352 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 250/462] 10.222.0.21 () {58 vars in 1149 bytes} [Sat Nov 27 20:46:43 2021] GET /compute/v2.1/servers?status=error => generated 338 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:43.532001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0c3cabaa-f9ca-48b9-b7a0-c6949b342c6f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1455586191", "id": 815704255, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:43.541142 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:43.541142 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:43.567839 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0c3cabaa-f9ca-48b9-b7a0-c6949b342c6f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.041790 Nov 27 20:46:43.572136 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 251/463] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:43 2021] POST /compute/v2.1/flavors => generated 426 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:43.585478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:43.588572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:43.610040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:43.611411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:43.612497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:43.613005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:43.910399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:43.935487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:43.942827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:43.944856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a227f166-a426-4307-8cd2-e0e65136a0d2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.984633 Nov 27 20:46:43.945631 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 213/464] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:42 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:43.953132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b5fb0ef-6c16-4817-a3c9-1f7984ad6791 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:43.954715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b5fb0ef-6c16-4817-a3c9-1f7984ad6791 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:43.976502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b5fb0ef-6c16-4817-a3c9-1f7984ad6791 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:43.977292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b5fb0ef-6c16-4817-a3c9-1f7984ad6791 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:43.978505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b5fb0ef-6c16-4817-a3c9-1f7984ad6791 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:43.979138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b5fb0ef-6c16-4817-a3c9-1f7984ad6791 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.122298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b5fb0ef-6c16-4817-a3c9-1f7984ad6791 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action" status: 202 len: 0 microversion: 2.1 time: 0.173754 Nov 27 20:46:44.122986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 214/465] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:43 2021] POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:44.132599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-720b9f75-7e43-49ad-b945-6dbf4130a197 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:44.134776 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:44.134776 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:44.136213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:44.152414 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6830235c-689e-4499-a10e-227c44a3e75e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.573831 Nov 27 20:46:44.164886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 252/466] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:43 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:44.179715 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-720b9f75-7e43-49ad-b945-6dbf4130a197 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/815704255" status: 202 len: 0 microversion: 2.1 time: 0.054364 Nov 27 20:46:44.182732 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 215/467] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:46:44 2021] DELETE /compute/v2.1/flavors/815704255 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:44.193266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:44.194334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:44.196637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-70b3afff-2d28-45ac-a996-f8828e8e8093 req-3afa72ad-877e-41b0-9802-c1574d907fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927d4c83-0a2a-4237-90fb-edae98280a7d", "name": "network-vif-deleted", "tag": "cc80c785-1cc6-4355-ac2e-daab2c4b016b"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:44.198737 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:44.198737 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:44.221240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-70b3afff-2d28-45ac-a996-f8828e8e8093 req-3afa72ad-877e-41b0-9802-c1574d907fd9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.221712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-70b3afff-2d28-45ac-a996-f8828e8e8093 req-3afa72ad-877e-41b0-9802-c1574d907fd9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.229342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.229826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.230624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.231054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.250165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-70b3afff-2d28-45ac-a996-f8828e8e8093 req-3afa72ad-877e-41b0-9802-c1574d907fd9 service nova] Creating event network-vif-deleted:cc80c785-1cc6-4355-ac2e-daab2c4b016b for instance 927d4c83-0a2a-4237-90fb-edae98280a7d on nch1-master-1 Nov 27 20:46:44.287215 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-70b3afff-2d28-45ac-a996-f8828e8e8093 req-3afa72ad-877e-41b0-9802-c1574d907fd9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102636 Nov 27 20:46:44.303976 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 216/468] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:44.343655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a2c5adb-e894-42ea-aec3-ac1d94168967 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:44.344741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a2c5adb-e894-42ea-aec3-ac1d94168967 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:44.356169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a2c5adb-e894-42ea-aec3-ac1d94168967 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.356987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a2c5adb-e894-42ea-aec3-ac1d94168967 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.357987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a2c5adb-e894-42ea-aec3-ac1d94168967 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.358869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a2c5adb-e894-42ea-aec3-ac1d94168967 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.379341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.379945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.382187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lazy-loading 'fault' on Instance uuid 927d4c83-0a2a-4237-90fb-edae98280a7d {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:44.587982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:44.612206 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8574fcd9-ddb0-4def-b7ed-4c02eeb45f47 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 200 len: 1308 microversion: 2.1 time: 0.434678 Nov 27 20:46:44.613627 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 253/469] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:44 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:44.616594 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a2c5adb-e894-42ea-aec3-ac1d94168967 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1614 microversion: 2.1 time: 0.308747 Nov 27 20:46:44.617547 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 217/470] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:44 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1614 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:44.620360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:44.621181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:44.628991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f9b9fb9-9d37-47c6-be98-e366806b248a tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:44.634241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.634899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.638499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.639170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.676030 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f9b9fb9-9d37-47c6-be98-e366806b248a tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057305 Nov 27 20:46:44.684155 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 218/471] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:44 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:44.699584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7772b8a-6160-45c5-bce5-ab85302fa1ab tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:44.700348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7772b8a-6160-45c5-bce5-ab85302fa1ab tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:44.713180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7772b8a-6160-45c5-bce5-ab85302fa1ab tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.713631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7772b8a-6160-45c5-bce5-ab85302fa1ab tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.714418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7772b8a-6160-45c5-bce5-ab85302fa1ab tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:44.731843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7772b8a-6160-45c5-bce5-ab85302fa1ab tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:44.910105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:44.922133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4eafceb0-3663-444f-b1b5-aec10bc0ca55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1282 microversion: 2.1 time: 0.307019 Nov 27 20:46:44.925703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 254/472] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:44 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1282 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:44.937142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90b3d158-80f7-4e57-b1cc-ef3b9e823638 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-837995571", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:44.938233 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:44.938233 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:44.969961 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-90b3d158-80f7-4e57-b1cc-ef3b9e823638 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.043152 Nov 27 20:46:44.970564 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 255/473] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:44 2021] POST /compute/v2.1/flavors => generated 506 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:44.988393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:44.989037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:45.012877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.013342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.014133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.014856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.093218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7772b8a-6160-45c5-bce5-ab85302fa1ab tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1614 microversion: 2.1 time: 0.407964 Nov 27 20:46:45.102356 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 219/474] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:44 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1614 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:45.116696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7bfb59d6-63c9-4c07-9b62-9a12d574d38b tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.117839 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.117839 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:45.142860 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7bfb59d6-63c9-4c07-9b62-9a12d574d38b tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/df8b0d16-61fd-444d-8b80-1706127e37dc" status: 202 len: 0 microversion: 2.1 time: 0.037804 Nov 27 20:46:45.143903 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 220/475] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:45 2021] DELETE /compute/v2.1/flavors/df8b0d16-61fd-444d-8b80-1706127e37dc => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:45.155730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.160701 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.160701 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:45.167192 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.167192 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:45.169153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:45.176216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.176947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.178188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.178850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.292391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:46:45.361719 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27be26f2-e49f-4f75-ac46-45fa6df96df9 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1324 microversion: 2.1 time: 0.216460 Nov 27 20:46:45.363141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 221/476] 10.222.0.21 () {58 vars in 1189 bytes} [Sat Nov 27 20:46:45 2021] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:45.367879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0cbce6a6-1713-404c-a83f-f2039f757a39 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.398273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0cbce6a6-1713-404c-a83f-f2039f757a39 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033754 Nov 27 20:46:45.399142 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 222/477] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:45 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:45.403805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.404665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:45.412560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.413587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.414849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.415994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.587297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:45.608180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:45.613421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:45.616463 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-823926c2-f49e-4e80-9ae0-fd1595373302 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.644290 Nov 27 20:46:45.619223 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 256/478] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:44 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:45.625008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07d0da86-684d-4636-85fb-508a1e71f8fe tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.644240 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.644240 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:45.650999 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.650999 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:45.656488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07d0da86-684d-4636-85fb-508a1e71f8fe tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:46:45.677692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07d0da86-684d-4636-85fb-508a1e71f8fe tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.683174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07d0da86-684d-4636-85fb-508a1e71f8fe tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.684579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07d0da86-684d-4636-85fb-508a1e71f8fe tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.685218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07d0da86-684d-4636-85fb-508a1e71f8fe tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.705345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:45.713781 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bfc8365c-8d9d-46fb-9b78-2b117909ba2a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.313289 Nov 27 20:46:45.714361 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 223/479] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:45 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:45.726661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb7f120f-6b2c-4fb9-8dc0-6296266a6231 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1906517369", "id": "8c5733a1-793f-4154-ada6-24e4b61ce73f", "os-flavor-access:is_public": "True"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:45.729058 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.729058 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:45.761946 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb7f120f-6b2c-4fb9-8dc0-6296266a6231 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.039194 Nov 27 20:46:45.763771 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 224/480] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:45 2021] POST /compute/v2.1/flavors => generated 507 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:45.776410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ecd2660e-006f-412e-b8c7-9b33ab20350b req-59a24c74-9b5b-4087-8bc3-ff1d0c138ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0d3056-c6e0-415c-b5a5-28fea06f98b3", "name": "network-vif-plugged", "status": "completed", "tag": "e37a2959-a2b3-4d7f-9dd6-d943c2ac302c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:45.778507 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.778507 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:45.789172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ecd2660e-006f-412e-b8c7-9b33ab20350b req-59a24c74-9b5b-4087-8bc3-ff1d0c138ae7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.789896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ecd2660e-006f-412e-b8c7-9b33ab20350b req-59a24c74-9b5b-4087-8bc3-ff1d0c138ae7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.803787 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ecd2660e-006f-412e-b8c7-9b33ab20350b req-59a24c74-9b5b-4087-8bc3-ff1d0c138ae7 service nova] Creating event network-vif-plugged:e37a2959-a2b3-4d7f-9dd6-d943c2ac302c for instance df0d3056-c6e0-415c-b5a5-28fea06f98b3 on nch2-master-1 Nov 27 20:46:45.809852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ecd2660e-006f-412e-b8c7-9b33ab20350b req-59a24c74-9b5b-4087-8bc3-ff1d0c138ae7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043858 Nov 27 20:46:45.815334 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 225/481] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:45.822214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.825199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 927d4c83-0a2a-4237-90fb-edae98280a7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:45.837651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.838444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.839427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.840866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.877215 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] HTTP exception thrown: Instance 927d4c83-0a2a-4237-90fb-edae98280a7d could not be found. Nov 27 20:46:45.878073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Returning 404 to user: Instance 927d4c83-0a2a-4237-90fb-edae98280a7d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:45.879413 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89f717aa-0ade-4b5f-b884-ca5b22f96aea tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d" status: 404 len: 111 microversion: 2.1 time: 0.062108 Nov 27 20:46:45.881008 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 226/482] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:45 2021] GET /compute/v2.1/servers/927d4c83-0a2a-4237-90fb-edae98280a7d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:45.892686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-881bd167-a9c8-49cf-88b4-cbaed4fe3b21 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.893837 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:45.893837 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:45.933412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-881bd167-a9c8-49cf-88b4-cbaed4fe3b21 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/8c5733a1-793f-4154-ada6-24e4b61ce73f" status: 202 len: 0 microversion: 2.1 time: 0.050969 Nov 27 20:46:45.934758 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 227/483] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:45 2021] DELETE /compute/v2.1/flavors/8c5733a1-793f-4154-ada6-24e4b61ce73f => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:45.936781 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07d0da86-684d-4636-85fb-508a1e71f8fe tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.315015 Nov 27 20:46:45.937380 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 257/484] 10.222.0.21 () {58 vars in 1195 bytes} [Sat Nov 27 20:46:45 2021] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:46:45.946649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.947800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:45.955806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:45.956277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.956432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:45.957231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.958422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.961409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.978287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.978749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:45.979579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:45.980022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.015175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:46:46.167540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:46.202776 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e621c97e-e31e-49a1-8f7f-bd809805abcb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 204 len: 0 microversion: 2.1 time: 0.266378 Nov 27 20:46:46.204378 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-327575af-6988-446c-95e0-cbc162703780 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1282 microversion: 2.1 time: 0.255318 Nov 27 20:46:46.205556 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 228/485] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:46:45 2021] DELETE /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:46:46.206423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 258/486] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:45 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1282 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:46.218826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8bd34c16-7fb7-4e96-8863-cee56fd79616 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:46.219986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-562d285a-569e-491f-b036-71d3a6da47f8 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:46.220844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8bd34c16-7fb7-4e96-8863-cee56fd79616 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:46.232687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bd34c16-7fb7-4e96-8863-cee56fd79616 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.233593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bd34c16-7fb7-4e96-8863-cee56fd79616 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.234785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bd34c16-7fb7-4e96-8863-cee56fd79616 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.235741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bd34c16-7fb7-4e96-8863-cee56fd79616 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.281707 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-562d285a-569e-491f-b036-71d3a6da47f8 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073579 Nov 27 20:46:46.286361 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 229/487] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:46 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:46.293524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:46.297157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:46.315158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.315158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.316811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.317116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.470642 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8bd34c16-7fb7-4e96-8863-cee56fd79616 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action" status: 202 len: 0 microversion: 2.1 time: 0.262264 Nov 27 20:46:46.471625 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 259/488] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:46 2021] POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:46.477900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0343ea1-bc10-447e-a3b5-ad75963f2a4c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1070195030", "id": 1043144753, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:46.484399 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:46.484399 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:46.525145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0343ea1-bc10-447e-a3b5-ad75963f2a4c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.049402 Nov 27 20:46:46.527123 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 260/489] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:46 2021] POST /compute/v2.1/flavors => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:46.542403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:46.546220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:46.588922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.589497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.593158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.596577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.731648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:46.744509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-37bc7248-ab39-4e2a-b96a-57bc64679862 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1475 microversion: 2.1 time: 0.457107 Nov 27 20:46:46.757368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 230/490] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:46 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1475 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:46.767584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-41bb35f0-2d28-4630-a9fb-2653ffef40f7 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:46.776653 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-41bb35f0-2d28-4630-a9fb-2653ffef40f7 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/1043144753" status: 200 len: 414 microversion: 2.1 time: 0.018018 Nov 27 20:46:46.777909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 231/491] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:46:46 2021] GET /compute/v2.1/flavors/1043144753 => generated 414 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:46.782542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:46.783677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:46.790097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.790803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.791800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.792399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.796343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:46.804671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:46.805206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:46.805619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:46.806032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:46.938877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:46.951716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.952183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:46.952989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:46.953431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.021562 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0c010bd-3d8e-4b3f-8c8d-008e22f05458 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action" status: 202 len: 1067 microversion: 2.1 time: 0.489844 Nov 27 20:46:47.022311 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 261/492] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:46:46 2021] POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action => generated 1067 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 20:46:47.047586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:47.048200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:47.059753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.060219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.061025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.061454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.065857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:47.077490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:47.079002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:47.080167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8422e46a-a3cc-4130-bfff-6e2cdb71a2a6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1361 microversion: 2.25 time: 0.301159 Nov 27 20:46:47.087855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 232/493] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:46 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:47.442775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6dfe5d16-9488-4577-8f65-c959e0fe0295 tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:47.467591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6dfe5d16-9488-4577-8f65-c959e0fe0295 tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.378361 Nov 27 20:46:47.468756 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 233/494] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:47 2021] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:47.475034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:47.476980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:47.495431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.497243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.498342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.499051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.706961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:47.721253 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-01ad0cf6-d23e-4d74-85be-63842058bb42 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.678508 Nov 27 20:46:47.722439 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 262/495] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:47 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:47.730871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:47.732353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:47.741229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.742072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.743151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.743838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.792301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:47.800879 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ab30f8c-d8e2-476b-afdf-0fb92314147a tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1471 microversion: 2.1 time: 0.330723 Nov 27 20:46:47.808288 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 234/496] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:47 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:47.821678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d3830ea0-6ae4-40bf-9215-6b90df170e1f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:47.822720 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:47.822720 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:47.876636 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d3830ea0-6ae4-40bf-9215-6b90df170e1f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1043144753" status: 202 len: 0 microversion: 2.1 time: 0.066884 Nov 27 20:46:47.878252 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 235/497] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:46:47 2021] DELETE /compute/v2.1/flavors/1043144753 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:47.885950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:47.888203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:47.896528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.897986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:47.898989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:47.899472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:48.311564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:48.321780 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f00bd916-94dd-4a9d-b520-ccc171e41589 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1324 microversion: 2.1 time: 0.598089 Nov 27 20:46:48.322969 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 263/498] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:47 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1324 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:48.342766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1a71902-7c7f-4021-a412-e4344a06dc9f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:48.366109 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1a71902-7c7f-4021-a412-e4344a06dc9f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041449 Nov 27 20:46:48.367382 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 264/499] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:48 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:48.372581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:48.373422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:48.386314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:48.386999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:48.388028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:48.388655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:48.435882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:48.450989 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a4043c8-fa94-465b-9bed-73f4c9dabefb tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1475 microversion: 2.1 time: 0.571174 Nov 27 20:46:48.452803 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 236/500] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:47 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1475 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:48.469409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b311b665-477a-49f9-a510-8344fefe5eed tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1956872386", "id": 1382160165, "os-flavor-access:is_public": "False"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:48.476640 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:48.476640 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:48.517632 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b311b665-477a-49f9-a510-8344fefe5eed tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.063512 Nov 27 20:46:48.519578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 237/501] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:48 2021] POST /compute/v2.1/flavors => generated 430 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:48.532247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b91a58e-d606-43e4-bd58-6f831e33d9ac tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "1382160165"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:48.552474 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-2b91a58e-d606-43e4-bd58-6f831e33d9ac tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] HTTP exception thrown: Flavor 1382160165 could not be found. Nov 27 20:46:48.553334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b91a58e-d606-43e4-bd58-6f831e33d9ac tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] Returning 400 to user: Flavor 1382160165 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:48.554333 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b91a58e-d606-43e4-bd58-6f831e33d9ac tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.027240 Nov 27 20:46:48.555935 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 238/502] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:48 2021] POST /compute/v2.1/servers => generated 81 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:48.571607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-803e2491-55b6-46bd-9c06-3e5324c7a087 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:48.579958 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:48.579958 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:48.610054 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-803e2491-55b6-46bd-9c06-3e5324c7a087 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1382160165" status: 202 len: 0 microversion: 2.1 time: 0.048738 Nov 27 20:46:48.611184 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 239/503] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:46:48 2021] DELETE /compute/v2.1/flavors/1382160165 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:46:48.619523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6cac329-c9a1-4051-a782-05818b221825 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:48.688585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6cac329-c9a1-4051-a782-05818b221825 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073239 Nov 27 20:46:48.702132 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 240/504] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:48 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:48.716070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f338ef86-db10-461d-85b5-972df3d691d6 req-a63100fe-6820-454b-82e7-883337d2eef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad5d6f1-7c37-47dc-a199-429ece8deb71", "tag": "8be29504-a892-4d2c-b932-707aa3ac7d18"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:48.717646 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:48.717646 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:48.734227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f338ef86-db10-461d-85b5-972df3d691d6 req-a63100fe-6820-454b-82e7-883337d2eef5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:48.736356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f338ef86-db10-461d-85b5-972df3d691d6 req-a63100fe-6820-454b-82e7-883337d2eef5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:48.765026 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f338ef86-db10-461d-85b5-972df3d691d6 req-a63100fe-6820-454b-82e7-883337d2eef5 service nova] Creating event network-changed:8be29504-a892-4d2c-b932-707aa3ac7d18 for instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 on nch1-master-1 Nov 27 20:46:48.771054 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f338ef86-db10-461d-85b5-972df3d691d6 req-a63100fe-6820-454b-82e7-883337d2eef5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077304 Nov 27 20:46:48.771421 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 241/505] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:48.777989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0494c35-094a-46d7-89d8-1ac7aed25a05 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1382883574", "id": 623664683, "os-flavor-access:is_public": "False"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:48.780480 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:48.780480 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:48.805779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0494c35-094a-46d7-89d8-1ac7aed25a05 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.031568 Nov 27 20:46:48.807400 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 242/506] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:48 2021] POST /compute/v2.1/flavors => generated 412 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:48.822326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:48.828257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:48.841031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:48.841685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:48.842791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:48.843426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:48.924112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:48.937633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:48.939599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:48.941672 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04f9e5ee-3156-40eb-8580-7e381d90894c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1556 microversion: 2.25 time: 0.573074 Nov 27 20:46:48.957636 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 265/507] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:48 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1556 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:48.971665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bec1c480-450d-415c-961b-04e631fb7ec9 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1795699606", "id": 1617516746, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:48.977246 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:48.977246 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:49.008633 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bec1c480-450d-415c-961b-04e631fb7ec9 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.047164 Nov 27 20:46:49.012353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 266/508] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:48 2021] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:49.018360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:49.023846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:49.036096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.041283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:49.042802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.044176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:49.351551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:49.360748 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28adbe4f-6f72-46e6-9378-27bb57efb591 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1471 microversion: 2.1 time: 0.346677 Nov 27 20:46:49.373705 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 267/509] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:49 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:49.528305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:49.542462 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-219bdac4-deb5-44a8-9b78-7ea888a1a5e6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.733790 Nov 27 20:46:49.544021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 243/510] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:48 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:49.552766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e06cc1e-483d-4335-9c31-18ae12647dbc tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:49.592188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e06cc1e-483d-4335-9c31-18ae12647dbc tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.046518 Nov 27 20:46:49.594494 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 244/511] 10.222.0.21 () {58 vars in 1168 bytes} [Sat Nov 27 20:46:49 2021] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:49.604452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:49.606639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:49.620922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.622046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:49.623558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.626509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:49.750948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:49.751596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:49.762050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.767603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:49.768631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.771687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:49.926990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:49.934963 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-100d2499-18d5-4093-8eb3-2272937df02d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1324 microversion: 2.1 time: 0.339479 Nov 27 20:46:49.939512 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 245/512] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:49 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:49.950733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:49.951494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:49.960367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.963801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:49.968230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:49.968965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.044085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.047933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.055071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lazy-loading 'fault' on Instance uuid 3f46dedc-d8cb-41e0-9019-d0aa61cceb49 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:50.202496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid df0d3056-c6e0-415c-b5a5-28fea06f98b3 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:50.205315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559cab992ce74bd0b78a639e4001c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7fd405b830467db077102575590b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:50.216125 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6c6d1f1-9766-4e04-977b-263bbdd90ea5 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 200 len: 1309 microversion: 2.1 time: 0.275449 Nov 27 20:46:50.219483 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 246/513] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:49 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:50.234575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-79359120-aa6f-498c-b0a1-b67ace69f6ca req-64518e47-b450-48f5-b03c-5e9185dd2400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f46dedc-d8cb-41e0-9019-d0aa61cceb49", "name": "network-vif-deleted", "tag": "8cbd7b7d-2628-4d2c-9c48-0f983c4e788b"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:50.239125 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:50.239125 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:50.262179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-79359120-aa6f-498c-b0a1-b67ace69f6ca req-64518e47-b450-48f5-b03c-5e9185dd2400 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.262636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-79359120-aa6f-498c-b0a1-b67ace69f6ca req-64518e47-b450-48f5-b03c-5e9185dd2400 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.319560 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-79359120-aa6f-498c-b0a1-b67ace69f6ca req-64518e47-b450-48f5-b03c-5e9185dd2400 service nova] Creating event network-vif-deleted:8cbd7b7d-2628-4d2c-9c48-0f983c4e788b for instance 3f46dedc-d8cb-41e0-9019-d0aa61cceb49 on nch1-master-1 Nov 27 20:46:50.332718 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-79359120-aa6f-498c-b0a1-b67ace69f6ca req-64518e47-b450-48f5-b03c-5e9185dd2400 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110403 Nov 27 20:46:50.333366 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 247/514] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:50.347735 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9203af4c-320a-498b-bbd2-af223883c589 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 2048 microversion: 2.25 time: 0.983388 Nov 27 20:46:50.349227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ced6b503-bf71-4972-9bd1-07fe84b53226 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.359830 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 268/515] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:49 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 2048 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:50.369813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ced6b503-bf71-4972-9bd1-07fe84b53226 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.035135 Nov 27 20:46:50.375306 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 248/516] 10.222.0.21 () {58 vars in 1176 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:50.381889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.382724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:50.384942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3cb9b40-1e51-4f12-81ad-62fdeb858f84 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.395990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.398523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.399954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.400983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.411706 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3cb9b40-1e51-4f12-81ad-62fdeb858f84 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.030694 Nov 27 20:46:50.413039 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 249/517] 10.222.0.21 () {58 vars in 1170 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:46:50.433059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.436063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:50.463627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.464128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.464952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.465392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.708437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:50.716049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f7598d1c-beef-46a3-a2fa-a8c9107e42a0 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1471 microversion: 2.1 time: 0.299652 Nov 27 20:46:50.716634 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 250/518] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:50.728223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-04c56d49-c701-44af-8326-564354d9aebd tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.749942 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-04c56d49-c701-44af-8326-564354d9aebd tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.032254 Nov 27 20:46:50.754691 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 251/519] 10.222.0.21 () {58 vars in 1168 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:50.768328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.769004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:50.778822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.779196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.780036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.780475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.829012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid df0d3056-c6e0-415c-b5a5-28fea06f98b3 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:50.866677 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba5ad666-bb50-4e6a-a3de-010516d50d96 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 2048 microversion: 2.25 time: 0.492414 Nov 27 20:46:50.867931 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 269/520] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 2048 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:50.872997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d79abb33-5643-4337-992a-4d5339410c9e tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.898434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d79abb33-5643-4337-992a-4d5339410c9e tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.029196 Nov 27 20:46:50.906467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 270/521] 10.222.0.21 () {58 vars in 1168 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:50.919645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fcf0022c-5cc5-44af-8b36-9a542ec1491c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:50.921177 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:50.921177 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:50.927120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf0022c-5cc5-44af-8b36-9a542ec1491c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.927875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf0022c-5cc5-44af-8b36-9a542ec1491c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.931833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf0022c-5cc5-44af-8b36-9a542ec1491c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:50.932702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf0022c-5cc5-44af-8b36-9a542ec1491c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:50.991597 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fcf0022c-5cc5-44af-8b36-9a542ec1491c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.067114 Nov 27 20:46:50.995323 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 271/522] 10.222.0.21 () {60 vars in 1216 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:46:51.010056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f983d7b0-4e04-4df8-b998-d909fd24a493 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:51.047012 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f983d7b0-4e04-4df8-b998-d909fd24a493 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.050281 Nov 27 20:46:51.059530 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 272/523] 10.222.0.21 () {58 vars in 1174 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:51.064987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:51.065758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:51.074239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:51.075925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:51.077125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:51.077837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:51.224248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:51.234389 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e728a92e-53d3-4287-9550-3424c36c4d89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.478411 Nov 27 20:46:51.239516 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 252/524] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:50 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:51.250652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:51.251857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:51.263077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:51.263911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:51.264978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:51.265638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:51.305543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'flavor' on Instance uuid df0d3056-c6e0-415c-b5a5-28fea06f98b3 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:46:51.322791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Going to try to live migrate instance to nch1-master-1 {{(pid=135679) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:46:51.860452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:51.868699 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0467fd60-780f-4b41-b0ee-b848e6206531 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1324 microversion: 2.1 time: 0.807796 Nov 27 20:46:51.872795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 273/525] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:51 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:51.879350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f59f4c68-2c52-4c67-9a75-f573c1cf6327 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:52.185491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f59f4c68-2c52-4c67-9a75-f573c1cf6327 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.311411 Nov 27 20:46:52.186811 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 274/526] 10.222.0.21 () {58 vars in 1172 bytes} [Sat Nov 27 20:46:51 2021] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:52.192877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:52.194671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] [instance: 3f46dedc-d8cb-41e0-9019-d0aa61cceb49] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:52.200994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:52.201692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:52.202640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:52.203226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:52.232089 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] HTTP exception thrown: Instance 3f46dedc-d8cb-41e0-9019-d0aa61cceb49 could not be found. Nov 27 20:46:52.234567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] Returning 404 to user: Instance 3f46dedc-d8cb-41e0-9019-d0aa61cceb49 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:46:52.243016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45103a0c-88d6-4107-ab4c-d7c02ba21049 tempest-LiveMigrationNegativeTest-260313426 tempest-LiveMigrationNegativeTest-260313426-project] 10.222.0.21 "GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49" status: 404 len: 111 microversion: 2.1 time: 0.054201 Nov 27 20:46:52.243563 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 275/527] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:52 2021] GET /compute/v2.1/servers/3f46dedc-d8cb-41e0-9019-d0aa61cceb49 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:46:52.260809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:52.263867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:52.280324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:52.281005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:52.281995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:52.284347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:52.628740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:52.639649 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b90f1ecc-6ea2-49a1-b858-e74f6db03f4c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1471 microversion: 2.1 time: 0.394420 Nov 27 20:46:52.641508 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 276/528] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:52 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:52.647800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-278f7972-0f5f-45f7-850f-5272ed59115a tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:52.674201 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-278f7972-0f5f-45f7-850f-5272ed59115a tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.030909 Nov 27 20:46:52.675827 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 277/529] 10.222.0.21 () {58 vars in 1168 bytes} [Sat Nov 27 20:46:52 2021] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:52.680841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:52.681593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:52.690459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:52.691120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:52.694813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:52.696823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:52.986772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:52.997502 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-18183cd9-3d0b-4146-a01f-162ee5b3b82c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.321386 Nov 27 20:46:52.998087 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 278/530] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:52 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:53.015174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a6162c3-7c12-45e0-980a-cc8bc9a63098 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:53.024281 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:53.024281 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:53.056395 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a6162c3-7c12-45e0-980a-cc8bc9a63098 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1617516746" status: 202 len: 0 microversion: 2.1 time: 0.050834 Nov 27 20:46:53.065551 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 279/531] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:46:53 2021] DELETE /compute/v2.1/flavors/1617516746 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:53.078173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:53.081355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:53.092180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:53.108601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:53.110560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:53.113714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:53.489177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:53.508074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f87b4915-7796-41fc-8ded-044c12ea9267 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1324 microversion: 2.1 time: 0.440980 Nov 27 20:46:53.510624 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 280/532] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:53 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:53.647775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1748624074", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "324306ab-fd63-4c3d-9f56-7119b3413ec6"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:53.746724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] validate_networks() for [('324306ab-fd63-4c3d-9f56-7119b3413ec6', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:46:54.192722 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-575ae455-028d-43c3-acfc-2c8f34a778bc tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3/action" status: 202 len: 0 microversion: 2.25 time: 2.951867 Nov 27 20:46:54.194490 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 253/533] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:46:51 2021] POST /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3/action => generated 0 bytes in 2954 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:46:54.203060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99f654ea-69a5-47cc-93b7-762c3a8f334c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:54.246780 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99f654ea-69a5-47cc-93b7-762c3a8f334c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050883 Nov 27 20:46:54.264051 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 254/534] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:54 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:54.292450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:54.293264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:54.316441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:54.316903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:54.317743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:54.318186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:54.803433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:54.815133 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2e646565-90ce-4d41-9cf2-5a92a8fd9a74 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1471 microversion: 2.1 time: 0.547680 Nov 27 20:46:54.817150 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 255/535] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:54 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:54.828941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:54.837265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:46:54.838008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:54.838475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:46:54.839094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:46:54.840150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:46:54.841152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:46:54.848744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:54.849511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:54.852751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:54.854311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:54.875615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:54.876084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:54.876899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:54.877363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:54.923376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:46:54.934546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for user 1d46c71936aa4118aa36a9e95b95c4f5 and project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:46:54.962543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:46:54.965093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:46:55.065919 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92a2e690-0c73-44e8-aacd-ae41e0a76acc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553524 Nov 27 20:46:55.073952 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 281/536] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:46:55.091491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:55.095693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:55.111831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:55.137934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:55.139727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:55.145105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:55.273405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:55.284238 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5473ea70-18b8-4c40-9331-791935d11d03 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.463828 Nov 27 20:46:55.284816 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 256/537] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:54 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:55.297239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-690ad738-2c04-4ce7-87c6-fe7a4a6d5b7a tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:55.311310 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:55.311310 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:55.363587 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-690ad738-2c04-4ce7-87c6-fe7a4a6d5b7a tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/623664683" status: 202 len: 0 microversion: 2.1 time: 0.069901 Nov 27 20:46:55.364160 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 257/538] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:46:55 2021] DELETE /compute/v2.1/flavors/623664683 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:55.377558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:55.380532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:55.390288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:55.391220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:55.399929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:55.400431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:55.698715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:55.714238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:55.727425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:55.729034 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1eb006a0-a95c-4dd5-ab7a-d450fa13cb37 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1566 microversion: 2.25 time: 0.653747 Nov 27 20:46:55.732434 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 282/539] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:55 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1566 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:55.750934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-157c8c53-1457-49d7-b7dc-f856161076de tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:55.756999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-157c8c53-1457-49d7-b7dc-f856161076de tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:55.866579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-157c8c53-1457-49d7-b7dc-f856161076de tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:55.891190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:55.906351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-157c8c53-1457-49d7-b7dc-f856161076de tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1211 microversion: 2.1 time: 0.161812 Nov 27 20:46:55.907010 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 283/540] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:55 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1211 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:55.910852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-44f7b465-8861-4887-bed6-1aaf20b97301 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1324 microversion: 2.1 time: 0.541878 Nov 27 20:46:55.928182 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 258/541] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:55 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:55.933855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8db51164-aa4e-41ef-9ba6-f1a22948e20c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:55.958015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:55.968236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:55.968465 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8db51164-aa4e-41ef-9ba6-f1a22948e20c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046415 Nov 27 20:46:55.969167 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 284/542] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:55 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:55.981722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:55.981722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:55.981722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:55.986110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-470c2f49-608e-4c59-96b6-7f7bd9706c50 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1818194146", "id": 779316100, "os-flavor-access:is_public": "False"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:55.986486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:55.987713 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:55.987713 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:56.012513 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-470c2f49-608e-4c59-96b6-7f7bd9706c50 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.030556 Nov 27 20:46:56.014348 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 285/543] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:55 2021] POST /compute/v2.1/flavors => generated 412 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:46:56.030837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d66e740-7ac2-4b01-94f1-c443746c0d8f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.051799 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d66e740-7ac2-4b01-94f1-c443746c0d8f tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029888 Nov 27 20:46:56.061588 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 286/544] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:56 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:56.067805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-286df3a0-b2ab-4a05-8d89-9dec4d71cf8b tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.090657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-286df3a0-b2ab-4a05-8d89-9dec4d71cf8b tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026564 Nov 27 20:46:56.100519 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 287/545] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:56 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:46:56.107984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a4fc41e-0b7f-4ba6-80de-24c521864f87 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.111469 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:56.111469 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:56.162238 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a4fc41e-0b7f-4ba6-80de-24c521864f87 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/779316100" status: 202 len: 0 microversion: 2.1 time: 0.058916 Nov 27 20:46:56.165241 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 288/546] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:46:56 2021] DELETE /compute/v2.1/flavors/779316100 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:56.191423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5cfc0396-111f-4be3-9b53-2b669a9f9d8c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.253521 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5cfc0396-111f-4be3-9b53-2b669a9f9d8c tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077784 Nov 27 20:46:56.254830 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 289/547] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:56 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:56.271086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d67fd16-c180-4a83-95d0-9eaec299ee03 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-649276258", "id": 1585012655, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:56.339720 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d67fd16-c180-4a83-95d0-9eaec299ee03 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.058728 Nov 27 20:46:56.344301 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 290/548] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:46:56 2021] POST /compute/v2.1/flavors => generated 413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:56.357783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.368723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:56.404788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:56.405228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:56.406223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:56.408480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:56.468844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:56.478077 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4424c933-7509-45ca-9561-fa0bb20db92c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1471 microversion: 2.1 time: 0.545657 Nov 27 20:46:56.483961 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 259/549] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:55 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1471 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:56.488742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ba12a45c-2469-4dec-9446-4a2fdbcff5b1 tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.565076 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ba12a45c-2469-4dec-9446-4a2fdbcff5b1 tempest-FlavorsAdminTestJSON-481694989 tempest-FlavorsAdminTestJSON-481694989-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.079417 Nov 27 20:46:56.566314 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 260/550] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:56 2021] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:56.587643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-634723c1-c81f-4394-8ab4-8746c91828df tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.588622 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:56.588622 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:56.623408 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-634723c1-c81f-4394-8ab4-8746c91828df tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1585012655" status: 202 len: 0 microversion: 2.1 time: 0.044483 Nov 27 20:46:56.627007 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 261/551] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:46:56 2021] DELETE /compute/v2.1/flavors/1585012655 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:46:56.632265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8be1efe1-b726-4c3e-b653-0793d75b7f14 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.684919 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8be1efe1-b726-4c3e-b653-0793d75b7f14 tempest-FlavorsAdminTestJSON-1857819789 tempest-FlavorsAdminTestJSON-1857819789-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054703 Nov 27 20:46:56.689491 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 262/552] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:46:56 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:56.750998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:56.751690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:56.769248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:56.772329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:56.776890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:56.777450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:57.299395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:57.313064 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00ac3415-e413-4f1f-b91a-45984234696e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1477 microversion: 2.1 time: 0.965418 Nov 27 20:46:57.315491 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 291/553] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:56 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1477 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:57.330164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:57.331213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:57.342414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:57.352025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:57.354194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:57.355056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:57.463577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:57.471835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:57.487368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:57.488812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8eeacc52-9bbd-446e-9bf7-4b9d5ff279ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1566 microversion: 2.25 time: 0.742617 Nov 27 20:46:57.490286 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 263/554] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:56 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1566 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:57.508454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:57.509097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:57.525520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:57.539425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:57.540476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:57.540934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:57.618839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:57.632016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-caab2d77-00c0-48ba-bcc4-9d2f9c3fac44 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1269 microversion: 2.1 time: 0.313516 Nov 27 20:46:57.651100 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 292/555] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:57 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1269 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:57.666483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-708d7635-7019-4a3c-9111-b5721205ac4d req-8986a0a1-925b-4605-9ed4-4040e48bf4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0d3056-c6e0-415c-b5a5-28fea06f98b3", "name": "network-vif-unplugged", "status": "completed", "tag": "e37a2959-a2b3-4d7f-9dd6-d943c2ac302c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:57.668734 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:57.668734 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:57.688210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-708d7635-7019-4a3c-9111-b5721205ac4d req-8986a0a1-925b-4605-9ed4-4040e48bf4a0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:57.689100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-708d7635-7019-4a3c-9111-b5721205ac4d req-8986a0a1-925b-4605-9ed4-4040e48bf4a0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:57.720699 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-708d7635-7019-4a3c-9111-b5721205ac4d req-8986a0a1-925b-4605-9ed4-4040e48bf4a0 service nova] Creating event network-vif-unplugged:e37a2959-a2b3-4d7f-9dd6-d943c2ac302c for instance df0d3056-c6e0-415c-b5a5-28fea06f98b3 on nch2-master-1 Nov 27 20:46:57.736825 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-708d7635-7019-4a3c-9111-b5721205ac4d req-8986a0a1-925b-4605-9ed4-4040e48bf4a0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083778 Nov 27 20:46:57.742562 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 293/556] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:57.777669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:57.779850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:57.795145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:57.795408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:57.796882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:57.797685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:58.777080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:58.794763 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c56bc5b-eede-42b3-9580-f6a5c4d4e129 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1471 microversion: 2.1 time: 1.049615 Nov 27 20:46:58.796099 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 294/557] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:57 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1471 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:58.802688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-45875f0f-847f-42c6-8ccd-fc52817199f5 req-49739be3-9ba2-49ef-b10a-b74b57ccec9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad5d6f1-7c37-47dc-a199-429ece8deb71", "name": "network-vif-plugged", "status": "completed", "tag": "8be29504-a892-4d2c-b932-707aa3ac7d18"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:58.805438 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:58.805438 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:46:58.814724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-45875f0f-847f-42c6-8ccd-fc52817199f5 req-49739be3-9ba2-49ef-b10a-b74b57ccec9e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:58.815861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-45875f0f-847f-42c6-8ccd-fc52817199f5 req-49739be3-9ba2-49ef-b10a-b74b57ccec9e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:58.837024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-45875f0f-847f-42c6-8ccd-fc52817199f5 req-49739be3-9ba2-49ef-b10a-b74b57ccec9e service nova] Creating event network-vif-plugged:8be29504-a892-4d2c-b932-707aa3ac7d18 for instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 on nch1-master-1 Nov 27 20:46:58.844686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-45875f0f-847f-42c6-8ccd-fc52817199f5 req-49739be3-9ba2-49ef-b10a-b74b57ccec9e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046642 Nov 27 20:46:58.845938 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 295/558] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:58.858473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:58.862114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:58.870924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:58.872332 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d30d4e1-2e0b-43d7-9f48-2516e52c89eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1324 microversion: 2.1 time: 1.380740 Nov 27 20:46:58.875854 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 264/559] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:57 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1324 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:58.882949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:58.889221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:58.890076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:58.891044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:58.895485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:58.896788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:58.908462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:58.913071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:58.914295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:58.917793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:59.479535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:59.490435 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2e184f0f-bb5d-4faf-a93b-9856ada2bf38 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1476 microversion: 2.1 time: 0.643037 Nov 27 20:46:59.493666 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 296/560] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:58 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1476 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:59.500457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:59.501986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:59.522973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:59.523963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:59.524979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:59.525562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:59.602602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:59.611144 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-afdc5910-4507-47b5-93f3-0832495a3692 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1269 microversion: 2.1 time: 0.116337 Nov 27 20:46:59.611804 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 297/561] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:59 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:46:59.785185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:59.795414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:59.797221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:46:59.798865 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a92fda0-f110-4198-879a-79b795b812e1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1566 microversion: 2.25 time: 0.921626 Nov 27 20:46:59.800864 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 265/562] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:46:58 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1566 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:46:59.805854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-482f1b8a-7971-4ee4-9612-bc3078d2bbc1 req-c9d4d1f1-2b29-4a05-9099-abe306f26a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0d3056-c6e0-415c-b5a5-28fea06f98b3", "tag": "e37a2959-a2b3-4d7f-9dd6-d943c2ac302c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:46:59.808434 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:46:59.808434 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:46:59.816193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-482f1b8a-7971-4ee4-9612-bc3078d2bbc1 req-c9d4d1f1-2b29-4a05-9099-abe306f26a90 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:59.816927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-482f1b8a-7971-4ee4-9612-bc3078d2bbc1 req-c9d4d1f1-2b29-4a05-9099-abe306f26a90 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:59.829841 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-482f1b8a-7971-4ee4-9612-bc3078d2bbc1 req-c9d4d1f1-2b29-4a05-9099-abe306f26a90 service nova] Creating event network-changed:e37a2959-a2b3-4d7f-9dd6-d943c2ac302c for instance df0d3056-c6e0-415c-b5a5-28fea06f98b3 on nch2-master-1 Nov 27 20:46:59.836500 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-482f1b8a-7971-4ee4-9612-bc3078d2bbc1 req-c9d4d1f1-2b29-4a05-9099-abe306f26a90 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034220 Nov 27 20:46:59.841334 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 266/563] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:46:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:46:59.846980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:46:59.847782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:46:59.855816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:59.856548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:59.857616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:46:59.858245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:46:59.925886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-48f7f865-fd50-473b-85a7-8fa48b35dbf9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Calling method '.version_select at 0x7f15d4140ee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:00.203666 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-48f7f865-fd50-473b-85a7-8fa48b35dbf9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b" status: 200 len: 371 microversion: 2.1 time: 0.590512 Nov 27 20:47:00.204136 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 298/564] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:46:59 2021] GET /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b => generated 371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:00.209547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-23f89158-f912-497c-8122-861354878793 req-ad54d4bf-757a-4f3d-9c59-ff877c01c9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c83605-57d7-4d81-a8ee-b30279bafd6f", "name": "network-vif-unplugged", "status": "completed", "tag": "315cf87c-c809-4b39-b8ec-ef3d92d438f0"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:00.211400 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:00.211400 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:00.219426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-23f89158-f912-497c-8122-861354878793 req-ad54d4bf-757a-4f3d-9c59-ff877c01c9da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:00.219876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-23f89158-f912-497c-8122-861354878793 req-ad54d4bf-757a-4f3d-9c59-ff877c01c9da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:00.233215 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-23f89158-f912-497c-8122-861354878793 req-ad54d4bf-757a-4f3d-9c59-ff877c01c9da service nova] Creating event network-vif-unplugged:315cf87c-c809-4b39-b8ec-ef3d92d438f0 for instance 14c83605-57d7-4d81-a8ee-b30279bafd6f on nch1-master-1 Nov 27 20:47:00.266397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-23f89158-f912-497c-8122-861354878793 req-ad54d4bf-757a-4f3d-9c59-ff877c01c9da service nova] Instance 14c83605-57d7-4d81-a8ee-b30279bafd6f is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:47:00.297246 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-23f89158-f912-497c-8122-861354878793 req-ad54d4bf-757a-4f3d-9c59-ff877c01c9da service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091523 Nov 27 20:47:00.298343 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 299/565] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:00.304462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:00.305348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:00.311970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:00.324440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:00.325203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:00.330811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:00.508781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:00.518554 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2edbbdcb-3c6f-48b5-a720-fb79721e9f83 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1477 microversion: 2.1 time: 0.674622 Nov 27 20:47:00.519156 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 267/566] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:46:59 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1477 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:00.536263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-688f86a4-ac2d-4a4e-b876-8b3cbfaa5c89 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Action: 'update', calling method: .version_select at 0x7f15c7fa79d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:00.539005 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:00.539005 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:00.704967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-688f86a4-ac2d-4a4e-b876-8b3cbfaa5c89 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:00.705418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-688f86a4-ac2d-4a4e-b876-8b3cbfaa5c89 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:00.706237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-688f86a4-ac2d-4a4e-b876-8b3cbfaa5c89 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:00.706667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-688f86a4-ac2d-4a4e-b876-8b3cbfaa5c89 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:00.851960 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-688f86a4-ac2d-4a4e-b876-8b3cbfaa5c89 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b" status: 200 len: 328 microversion: 2.1 time: 0.329388 Nov 27 20:47:00.853250 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 268/567] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:47:00 2021] PUT /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b => generated 328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:00.862800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:00.864140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:00.875511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:00.876510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:00.879452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:00.880279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:00.902160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:00.912824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5097941c-8f1f-40e9-9850-b37315e1b528 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1324 microversion: 2.1 time: 0.612563 Nov 27 20:47:00.924150 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 300/568] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:00 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1324 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:01.123817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-720186c3-c092-48d5-8a77-0a0f160a9add tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:01.140127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-720186c3-c092-48d5-8a77-0a0f160a9add tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.211794 Nov 27 20:47:01.146728 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 301/569] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:47:00 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:01.153886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:01.157387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:01.172220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:01.177130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:01.179407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:01.179869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:01.425854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:01.438506 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e95f1799-309b-4771-ab7d-0afc24266466 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1311 microversion: 2.1 time: 0.291163 Nov 27 20:47:01.441553 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 302/570] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:01 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:01.446921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:01.447998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:01.456223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:01.457278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:01.458501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:01.460075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:01.549052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:01.557184 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebae7add-da5a-4921-a140-116738d74c14 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1476 microversion: 2.1 time: 0.702305 Nov 27 20:47:01.560302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 269/571] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:00 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1476 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:01.570390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53971c80-2fed-415e-82f7-5dc723898a1f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:01.577833 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:01.577833 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:01.596491 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53971c80-2fed-415e-82f7-5dc723898a1f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b" status: 202 len: 0 microversion: 2.1 time: 0.030642 Nov 27 20:47:01.601218 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 270/572] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 20:47:01 2021] DELETE /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:01.649787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:01.661628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:01.665366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:01.666753 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ec2d5b9-c921-4aeb-822f-0e2d566eec1a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1566 microversion: 2.25 time: 0.223869 Nov 27 20:47:01.677139 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 303/573] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:01 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:01.677139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:01.677139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:01.680685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:01.681137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:01.681941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:01.682380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:01.900407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:01.924578 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf74cf95-1eb9-40e8-8e37-c416ed2fc883 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1477 microversion: 2.1 time: 0.255480 Nov 27 20:47:01.936594 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 304/574] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:01 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:01.952803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a411aa98-9b1f-4f6f-82ec-a2e0730519c7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Calling method '.version_select at 0x7f15d42f8310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:02.045212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7723b92-2b8c-4c32-928b-0f137fbe39be tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1163518984", "id": 1678249805, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:02.047894 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:02.047894 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:02.082536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7723b92-2b8c-4c32-928b-0f137fbe39be tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.479965 Nov 27 20:47:02.083147 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 271/575] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:47:01 2021] POST /compute/v2.1/flavors => generated 425 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:02.094263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:02.095159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:02.104604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:02.105649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:02.107009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:02.108160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:02.595494 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a411aa98-9b1f-4f6f-82ec-a2e0730519c7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b" status: 200 len: 371 microversion: 2.1 time: 0.654526 Nov 27 20:47:02.596084 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 305/576] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:47:01 2021] GET /compute/v2.1/os-quota-sets/a4aae3b510a74fb49d23b02db72af80b => generated 371 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:02.614932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ba3dfa4-83f2-4666-afe6-7301b85cb0ec tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:02.643459 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ba3dfa4-83f2-4666-afe6-7301b85cb0ec tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.043385 Nov 27 20:47:02.646664 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 306/577] 10.222.0.21 () {58 vars in 1181 bytes} [Sat Nov 27 20:47:02 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:47:02.671791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f6df431c-2724-4ef1-9094-5ed7d5c16114 req-faa5b28c-9090-4053-b116-65ff8c841183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c83605-57d7-4d81-a8ee-b30279bafd6f", "tag": "315cf87c-c809-4b39-b8ec-ef3d92d438f0"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:02.676010 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:02.676010 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:02.694422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f6df431c-2724-4ef1-9094-5ed7d5c16114 req-faa5b28c-9090-4053-b116-65ff8c841183 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:02.695352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f6df431c-2724-4ef1-9094-5ed7d5c16114 req-faa5b28c-9090-4053-b116-65ff8c841183 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:02.709342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f6df431c-2724-4ef1-9094-5ed7d5c16114 req-faa5b28c-9090-4053-b116-65ff8c841183 service nova] Creating event network-changed:315cf87c-c809-4b39-b8ec-ef3d92d438f0 for instance 14c83605-57d7-4d81-a8ee-b30279bafd6f on nch1-master-1 Nov 27 20:47:02.716723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-f6df431c-2724-4ef1-9094-5ed7d5c16114 req-faa5b28c-9090-4053-b116-65ff8c841183 service nova] Instance 14c83605-57d7-4d81-a8ee-b30279bafd6f is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:47:02.730508 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f6df431c-2724-4ef1-9094-5ed7d5c16114 req-faa5b28c-9090-4053-b116-65ff8c841183 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080763 Nov 27 20:47:02.732275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 307/578] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:02.740851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:02.742185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:02.751699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:02.752660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:02.754005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:02.754752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:02.876864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:02.887154 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0c7f66be-bbaa-40da-8981-17703fb4ecc8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1521 microversion: 2.1 time: 0.794576 Nov 27 20:47:02.889480 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 272/579] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:02 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1521 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:02.910489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:02.911130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:02.933480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:02.935604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:02.938737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:02.939823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:03.050881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:03.063091 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7182ffe1-736e-487e-853d-172e1eab598c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1311 microversion: 2.1 time: 0.328694 Nov 27 20:47:03.063726 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 308/580] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:02 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1311 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:03.069210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47a1cbdf-3936-4052-8e7b-d354d407137a tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1330053569", "id": 872004157, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:03.071020 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:03.071020 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:03.131194 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47a1cbdf-3936-4052-8e7b-d354d407137a tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.064753 Nov 27 20:47:03.140703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 309/581] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:47:03 2021] POST /compute/v2.1/flavors => generated 422 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:03.153616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:03.154240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:03.175458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:03.175935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:03.179557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:03.180025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:03.376508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:03.391800 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab626bb9-f0f1-42f8-830f-a9bebc632ae7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1474 microversion: 2.1 time: 0.499793 Nov 27 20:47:03.393239 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 273/582] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:02 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1474 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:03.398300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aaf8f672-d4b5-4216-a242-a96208e84d05 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'create', calling method: .version_select at 0x7f15d4074a60>, body: {"pool": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:03.440095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:03.449065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:03.451582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:03.453176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ad6cfe6-d201-4f52-ab91-3011b2d400e2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1566 microversion: 2.25 time: 0.311044 Nov 27 20:47:03.454549 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 310/583] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:03 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1566 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:03.459813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61554ca3-25d8-4e0c-bc6a-62b4e64a4454 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Calling method '.version_select at 0x7f15d449ec10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:03.779029 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61554ca3-25d8-4e0c-bc6a-62b4e64a4454 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.322592 Nov 27 20:47:03.779995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 311/584] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:47:03 2021] GET /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9/defaults => generated 371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:03.784768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:03.790134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:03.812801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:03.815121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:03.816909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:03.818227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:04.190134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:04.202168 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89273382-93de-4572-aea2-935502ddb2a9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1477 microversion: 2.1 time: 0.420630 Nov 27 20:47:04.212472 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 312/585] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:03 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:04.216117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80f635fd-524b-4052-9d00-201ce1fc8dc4 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:04.224355 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80f635fd-524b-4052-9d00-201ce1fc8dc4 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011841 Nov 27 20:47:04.224927 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 313/586] 10.222.0.21 () {58 vars in 1181 bytes} [Sat Nov 27 20:47:04 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:47:04.487615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-562d23c9-fe97-478f-8f72-f9ec47492d32 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] Action: 'create', calling method: .version_select at 0x7f15d42f8310>, body: {"security_group": {"name": "tempest-securitygroup-1389615832", "description": "tempest-description-956363302"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:05.028264 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-562d23c9-fe97-478f-8f72-f9ec47492d32 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.802291 Nov 27 20:47:05.030031 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 314/587] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:47:04 2021] POST /compute/v2.1/os-security-groups => generated 220 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:05.034898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4ab35d1f-a697-4178-97b1-b746e93048bc req-76d2bd17-b937-48f0-abb1-7cede3f236b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77", "name": "network-vif-unplugged", "status": "completed", "tag": "41eff457-e562-48bc-bb0b-6db9a9bacf92"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:05.038619 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:05.038619 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:05.050295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4ab35d1f-a697-4178-97b1-b746e93048bc req-76d2bd17-b937-48f0-abb1-7cede3f236b5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:05.050956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4ab35d1f-a697-4178-97b1-b746e93048bc req-76d2bd17-b937-48f0-abb1-7cede3f236b5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:05.064360 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4ab35d1f-a697-4178-97b1-b746e93048bc req-76d2bd17-b937-48f0-abb1-7cede3f236b5 service nova] Creating event network-vif-unplugged:41eff457-e562-48bc-bb0b-6db9a9bacf92 for instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 on nch2-master-1 Nov 27 20:47:05.070235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4ab35d1f-a697-4178-97b1-b746e93048bc req-76d2bd17-b937-48f0-abb1-7cede3f236b5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038687 Nov 27 20:47:05.071494 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 315/588] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:05 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:05.076894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:05.077952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:05.098788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:05.100072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:05.101126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:05.102368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:05.269824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:05.277699 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a22ed85f-b5f0-4dd0-82ff-e5423345297a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1311 microversion: 2.1 time: 0.204762 Nov 27 20:47:05.278291 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 316/589] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:05 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:05.294151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97a5d528-ab69-4849-8ce6-460bc47dc3f3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Action: 'update', calling method: .version_select at 0x7f15d4305ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:05.297526 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:05.297526 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:05.366312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a5d528-ab69-4849-8ce6-460bc47dc3f3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:05.366770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a5d528-ab69-4849-8ce6-460bc47dc3f3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:05.368122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a5d528-ab69-4849-8ce6-460bc47dc3f3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:05.368566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a5d528-ab69-4849-8ce6-460bc47dc3f3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:05.433600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97a5d528-ab69-4849-8ce6-460bc47dc3f3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a" status: 200 len: 328 microversion: 2.1 time: 0.154232 Nov 27 20:47:05.434400 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 317/590] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:47:05 2021] PUT /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a => generated 328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:05.438729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-857c0356-fa7c-4eec-ba13-da4d74f77303 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'create', calling method: .version_select at 0x7f15d4317700>, body: {"keypair": {"name": "tempest-keypair-126826238"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:05.453518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-857c0356-fa7c-4eec-ba13-da4d74f77303 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for project 68857c7effec496aa99ff78b76521109. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:47:05.457158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-857c0356-fa7c-4eec-ba13-da4d74f77303 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for user 5af01920574741f381a5dfefd9282bfc and project 68857c7effec496aa99ff78b76521109. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:47:05.779682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-857c0356-fa7c-4eec-ba13-da4d74f77303 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for project 68857c7effec496aa99ff78b76521109. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:47:05.783479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-857c0356-fa7c-4eec-ba13-da4d74f77303 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for user 5af01920574741f381a5dfefd9282bfc and project 68857c7effec496aa99ff78b76521109. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:47:05.797033 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-857c0356-fa7c-4eec-ba13-da4d74f77303 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.361730 Nov 27 20:47:05.797620 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 318/591] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:47:05 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:05.802013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:05.803350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:05.809252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:05.809707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:05.810498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:05.810938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.015980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:06.025811 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f54faeb4-c9b3-4ffe-bbf4-9a38f9dcc6af tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1471 microversion: 2.1 time: 0.227069 Nov 27 20:47:06.033408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 319/592] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:05 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:06.039564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:06.040143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:06.047659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.048118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.048933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.049416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.104480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aaf8f672-d4b5-4216-a242-a96208e84d05 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.709848 Nov 27 20:47:06.106104 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 274/593] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:47:03 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:06.111409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5397bdbd-8c71-4765-a2e7-a0f79f015bac req-31b14bd2-8de1-44dc-ac43-2bb603c5a29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f4ea83-2296-4bfd-b8ca-fbc2e03738c3", "tag": "bb36450b-f6f8-40a8-b587-c2c25520c90d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:06.113411 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:06.113411 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:06.127316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5397bdbd-8c71-4765-a2e7-a0f79f015bac req-31b14bd2-8de1-44dc-ac43-2bb603c5a29c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.127910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5397bdbd-8c71-4765-a2e7-a0f79f015bac req-31b14bd2-8de1-44dc-ac43-2bb603c5a29c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.152781 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5397bdbd-8c71-4765-a2e7-a0f79f015bac req-31b14bd2-8de1-44dc-ac43-2bb603c5a29c service nova] Creating event network-changed:bb36450b-f6f8-40a8-b587-c2c25520c90d for instance 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 on nch1-master-1 Nov 27 20:47:06.159605 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5397bdbd-8c71-4765-a2e7-a0f79f015bac req-31b14bd2-8de1-44dc-ac43-2bb603c5a29c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051782 Nov 27 20:47:06.161112 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 275/594] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:06.168886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9e92d89-264b-4cb2-855c-45a162d79296 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] Action: 'create', calling method: .version_select at 0x7f15c7fb09d0>, body: {"security_group": {"name": "tempest-securitygroup-1869691982", "description": "tempest-description-388085327"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:06.263948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:06.273637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:06.275956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:06.277388 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d14f8c9-e91a-4018-88cb-1dd7a50eae24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1566 microversion: 2.25 time: 0.249689 Nov 27 20:47:06.278159 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 320/595] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:06 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:06.284113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:06.284896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:06.297299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.298345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.299443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.301351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.516626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:06.525047 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b256ea9-9a17-4477-a8e6-e205c536c10c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1463 microversion: 2.1 time: 0.244514 Nov 27 20:47:06.525618 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 321/596] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:06 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:06.538670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1171154-0be1-4bce-8e5a-3ef670f3773f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Calling method '.version_select at 0x7f15d44b1d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:06.613527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1171154-0be1-4bce-8e5a-3ef670f3773f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.614160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1171154-0be1-4bce-8e5a-3ef670f3773f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.615063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1171154-0be1-4bce-8e5a-3ef670f3773f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.615534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1171154-0be1-4bce-8e5a-3ef670f3773f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.635309 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1171154-0be1-4bce-8e5a-3ef670f3773f tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a/detail" status: 200 len: 916 microversion: 2.1 time: 0.108434 Nov 27 20:47:06.635933 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 322/597] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:47:06 2021] GET /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a/detail => generated 916 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:06.640876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-965fbd1f-7d21-46fb-bd4b-98f0ed849dc6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:06.641782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-965fbd1f-7d21-46fb-bd4b-98f0ed849dc6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:06.648498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-965fbd1f-7d21-46fb-bd4b-98f0ed849dc6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.649334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-965fbd1f-7d21-46fb-bd4b-98f0ed849dc6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.650397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-965fbd1f-7d21-46fb-bd4b-98f0ed849dc6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.651012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-965fbd1f-7d21-46fb-bd4b-98f0ed849dc6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.684942 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9e92d89-264b-4cb2-855c-45a162d79296 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.522069 Nov 27 20:47:06.687236 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 276/598] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:47:06 2021] POST /compute/v2.1/os-security-groups => generated 220 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:06.696702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1648078152", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:06.751888 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-965fbd1f-7d21-46fb-bd4b-98f0ed849dc6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f/action" status: 204 len: 0 microversion: 2.1 time: 0.114370 Nov 27 20:47:06.755772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 323/599] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:06 2021] POST /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f/action => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:47:06.762572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:06.763533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:06.773463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.774110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.775237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:06.775915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:06.785559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] validate_networks() for [('928a9d2f-c6ce-4a29-a19b-6db7d0d4717b', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:47:07.035450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:07.048212 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44793989-0ed3-4802-942c-887ed84aa971 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1311 microversion: 2.1 time: 0.293897 Nov 27 20:47:07.059877 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 324/600] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:06 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:07.069324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:07.070498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:07.086063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:07.097388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:07.098793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:07.100065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:07.395027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:07.416422 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65c787ba-8b41-4a07-ab76-4b83088fc339 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1463 microversion: 2.1 time: 0.353737 Nov 27 20:47:07.425568 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 325/601] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:07 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1463 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:07.592133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba126de8-aca8-44dc-86bb-78954b88fe59 tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] Action: 'create', calling method: .version_select at 0x7f15d42ad8b0>, body: {"security_group": {"name": "tempest-securitygroup-994390933", "description": "tempest-description-357097894"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:07.952491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:47:07.953986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:47:07.954859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:47:07.955471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:47:07.956167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:47:07.969481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:07.970535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:07.972271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:07.973063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.010772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Getting quotas for project bba5dc062b60481085531bc034e45209. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:47:08.017408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Getting quotas for user 9322591436e34060a46c6f145dca61d7 and project bba5dc062b60481085531bc034e45209. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:47:08.032878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:47:08.037722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:47:08.108010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8182b677-c885-4708-ada7-a0eb08826ec8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418897 Nov 27 20:47:08.111340 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 277/602] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:47:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:47:08.120426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:08.121980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:08.131093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.131972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.132631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.133180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.311854 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba126de8-aca8-44dc-86bb-78954b88fe59 tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.884728 Nov 27 20:47:08.313381 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 326/603] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:47:07 2021] POST /compute/v2.1/os-security-groups => generated 219 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:08.318756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Action: 'update', calling method: .version_select at 0x7f15d42addc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:08.320904 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:08.320904 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:08.399320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.399773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.400584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.401015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.437953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.438876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.439913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.440375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.484231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:08.492519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eeeee5d2-2e2f-4df7-a721-18449b41cdc4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1471 microversion: 2.1 time: 0.379748 Nov 27 20:47:08.493669 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 278/604] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:08 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1471 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:08.498435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:08.499303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:08.508860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.509758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.510805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.511708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.517097 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5ef47df-e632-4955-a60c-f36308c4f578 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a?user_id=64a9a2965ca3428ca61072d671945b37" status: 200 len: 328 microversion: 2.1 time: 0.202343 Nov 27 20:47:08.518029 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 327/605] 10.222.0.21 () {60 vars in 1342 bytes} [Sat Nov 27 20:47:08 2021] PUT /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a?user_id=64a9a2965ca3428ca61072d671945b37 => generated 328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:08.524686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:08.526381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:08.534377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.535465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.536913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.537926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.632705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:47:08.633218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:47:08.633925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:47:08.634508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:47:08.635151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:47:08.723715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:08.731194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.731949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.732979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.733796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.777740 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-32c3b736-11a6-4f4e-8d49-4b9255e9081b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action" status: 202 len: 1067 microversion: 2.1 time: 0.255105 Nov 27 20:47:08.778495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 328/606] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:08 2021] POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action => generated 1067 bytes in 260 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 20:47:08.783823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-579a69d3-fff0-4713-a7d0-d49c30607541 req-bcdd5789-48c6-48d7-b9b7-24944925aaad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77", "name": "network-vif-plugged", "status": "completed", "tag": "41eff457-e562-48bc-bb0b-6db9a9bacf92"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:08.785736 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:08.785736 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:08.795055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:08.806193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:08.808070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:08.809542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-579a69d3-fff0-4713-a7d0-d49c30607541 req-bcdd5789-48c6-48d7-b9b7-24944925aaad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.809933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-579a69d3-fff0-4713-a7d0-d49c30607541 req-bcdd5789-48c6-48d7-b9b7-24944925aaad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.818621 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb2fc579-adc4-4b62-9029-467967b1d16c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1556 microversion: 2.25 time: 0.323573 Nov 27 20:47:08.821234 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 279/607] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:08 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1556 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:08.826112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:08.827070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:08.834289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-579a69d3-fff0-4713-a7d0-d49c30607541 req-bcdd5789-48c6-48d7-b9b7-24944925aaad service nova] Creating event network-vif-plugged:41eff457-e562-48bc-bb0b-6db9a9bacf92 for instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 on nch2-master-1 Nov 27 20:47:08.834953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.843368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.845073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.845799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.846773 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-579a69d3-fff0-4713-a7d0-d49c30607541 req-bcdd5789-48c6-48d7-b9b7-24944925aaad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066701 Nov 27 20:47:08.848286 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 329/608] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:08.857833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:08.858520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:08.866228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.866668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.867739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:08.868179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:08.998130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:09.007326 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2bea013c-0bb7-4b3c-b29f-76a532c4301d tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1220 microversion: 2.1 time: 0.155956 Nov 27 20:47:09.017943 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 330/609] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:08 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:09.023701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49d156c2-1fc2-403e-8793-870147593d98 tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] Action: 'create', calling method: .version_select at 0x7f15d42ad790>, body: {"security_group": {"name": "tempest-securitygroup-1898830144", "description": "tempest-description-940474095"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:09.077617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:09.088572 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d627f5c3-77b4-464b-95ea-c284103b63f6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1311 microversion: 2.1 time: 0.266062 Nov 27 20:47:09.089389 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 280/610] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:08 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:09.104895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-508dc587-6448-4bc0-81e1-3c5e3a58ad6b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Calling method '.version_select at 0x7f15c7fdc3a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:09.192456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49d156c2-1fc2-403e-8793-870147593d98 tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.179090 Nov 27 20:47:09.193934 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 331/611] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:47:09 2021] POST /compute/v2.1/os-security-groups => generated 220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:09.204417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:09.204417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:09.217703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:09.219124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:09.220151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:09.221005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:09.238900 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-508dc587-6448-4bc0-81e1-3c5e3a58ad6b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a?user_id=64a9a2965ca3428ca61072d671945b37" status: 200 len: 370 microversion: 2.1 time: 0.138680 Nov 27 20:47:09.241352 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 281/612] 10.222.0.21 () {58 vars in 1322 bytes} [Sat Nov 27 20:47:09 2021] GET /compute/v2.1/os-quota-sets/2055b31564c840d798bc8024f85ee32a?user_id=64a9a2965ca3428ca61072d671945b37 => generated 370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:09.247084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e111268-7498-47f5-809a-1bc07156c14d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '.version_select at 0x7f15c7f9faf0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:09.249440 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:09.249440 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:09.251366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e111268-7498-47f5-809a-1bc07156c14d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:09.252068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e111268-7498-47f5-809a-1bc07156c14d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:09.274819 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e111268-7498-47f5-809a-1bc07156c14d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 860 microversion: 2.25 time: 0.032059 Nov 27 20:47:09.275989 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 282/613] 10.222.0.21 () {60 vars in 1183 bytes} [Sat Nov 27 20:47:09 2021] GET /compute/v2.1/os-migrations => generated 860 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:09.281238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1422558790", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "872004157", "adminPass": "***", "networks": [{"uuid": "7a2f3da6-fc07-4bd8-b994-fc2cede22518"}], "security_groups": [{"name": "tempest-securitygroup--1211467980"}], "key_name": "tempest-keypair-126826238", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:09.424809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] validate_networks() for [('7a2f3da6-fc07-4bd8-b994-fc2cede22518', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:47:09.517097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:09.538220 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f406ead-c928-41ae-81d2-b6d82f7d060e tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.339827 Nov 27 20:47:09.545130 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 332/614] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:09 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:09.558847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3404d99-d4ac-4b5f-a57f-439b2e5a8c32 tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] Calling method '.version_select at 0x7f15d44bc0d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:09.902171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:47:09.902677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:47:09.903305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:47:09.903769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:47:09.904216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:47:09.912762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:09.913215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:09.914018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:09.914439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:09.932268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for project 68857c7effec496aa99ff78b76521109. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:47:09.936102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for user 5af01920574741f381a5dfefd9282bfc and project 68857c7effec496aa99ff78b76521109. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:47:09.947214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:47:09.949404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:47:09.997580 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07e9cb1b-9863-47b3-9180-ff1cea9fd68c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.720466 Nov 27 20:47:09.998473 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 283/615] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:47:09 2021] POST /compute/v2.1/servers => generated 402 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:47:10.003212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:10.004023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:10.010658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.011068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:10.011904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.012530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:10.164039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid df0d3056-c6e0-415c-b5a5-28fea06f98b3 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:47:10.226141 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c08a47b6-a813-41e4-ad6d-b1d20fc591ea tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 2048 microversion: 2.25 time: 0.226347 Nov 27 20:47:10.226977 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 284/616] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:09 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 2048 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:10.248230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:10.249155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:10.263729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.264551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:10.265554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.268065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:10.480623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:10.490773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8aea653-238c-4c18-a93f-37e9434a7567 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1463 microversion: 2.1 time: 0.246367 Nov 27 20:47:10.491383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 285/617] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:10 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1463 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:10.501799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1a5762c-575d-4bb2-9c52-870aeed3fca0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Calling method '.version_select at 0x7f15c7f9faf0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:10.790694 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a1a5762c-575d-4bb2-9c52-870aeed3fca0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.292133 Nov 27 20:47:10.791703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 286/618] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:47:10 2021] GET /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9/defaults => generated 371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:10.799870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:10.800932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:10.813311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.814651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:10.815925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.816558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:10.896104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:10.903268 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9fa2ff67-198d-426d-8920-3a50b25041e6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1314 microversion: 2.1 time: 0.110398 Nov 27 20:47:10.904443 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 287/619] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:10 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1314 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:10.911179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:10.911179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:10.917854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.918319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:10.919136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:10.919608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:11.066717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:11.075027 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49284d7f-d2d5-464a-87f9-a3aec1f93573 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1324 microversion: 2.1 time: 0.169498 Nov 27 20:47:11.075819 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 288/620] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:10 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:11.079933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:11.080533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:11.086985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:11.087453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:11.088228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:11.088654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:11.254418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:11.267783 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22924ae6-df08-44cf-9239-26ccff0e0e0a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1311 microversion: 2.1 time: 0.190602 Nov 27 20:47:11.279205 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 289/621] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:11 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1311 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:11.284386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-779429098", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "979446f3-8da8-4e53-af09-3da825cab09f"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:11.354878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] validate_networks() for [('979446f3-8da8-4e53-af09-3da825cab09f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:47:11.756417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:47:11.756836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:47:11.757380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:47:11.757792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:47:11.758347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:47:11.771149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:11.771633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:11.772466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:11.772899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:11.988170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:47:11.992531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for user 2d326a07ce104727bec8ae98dabea64d and project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:47:12.003483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:47:12.006106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:47:12.052493 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-300e32f4-77a4-4b36-9406-bde918ae5250 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.772016 Nov 27 20:47:12.057854 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 290/622] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 20:47:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 20:47:12.061450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34c6c826-3e7f-42ad-9de4-fe4e8f0b7a29 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:12.062220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34c6c826-3e7f-42ad-9de4-fe4e8f0b7a29 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:12.070289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34c6c826-3e7f-42ad-9de4-fe4e8f0b7a29 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.070739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34c6c826-3e7f-42ad-9de4-fe4e8f0b7a29 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.071551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34c6c826-3e7f-42ad-9de4-fe4e8f0b7a29 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.071984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34c6c826-3e7f-42ad-9de4-fe4e8f0b7a29 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.224021 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34c6c826-3e7f-42ad-9de4-fe4e8f0b7a29 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1614 microversion: 2.1 time: 0.169404 Nov 27 20:47:12.224919 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 291/623] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:12 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1614 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:12.229259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:12.230097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:12.244289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.245006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.245810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.246558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.406268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:12.415978 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac9f0143-76e2-481b-8690-a85693018d29 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.189993 Nov 27 20:47:12.416569 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 292/624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:12 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:12.421374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-727e9038-8af4-47a8-b63a-f57e649de123 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Action: 'update', calling method: .version_select at 0x7f15d4186d30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:12.423625 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:12.423625 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:12.494422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727e9038-8af4-47a8-b63a-f57e649de123 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.495158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727e9038-8af4-47a8-b63a-f57e649de123 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.496481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727e9038-8af4-47a8-b63a-f57e649de123 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.496947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727e9038-8af4-47a8-b63a-f57e649de123 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.720934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-727e9038-8af4-47a8-b63a-f57e649de123 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9" status: 200 len: 329 microversion: 2.1 time: 0.303093 Nov 27 20:47:12.721897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 293/625] 10.222.0.21 () {60 vars in 1262 bytes} [Sat Nov 27 20:47:12 2021] PUT /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9 => generated 329 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:12.727151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cc8085ce-5eec-4b4c-8ba1-1da693bf5642 req-f74aa138-1e1a-464b-baf6-e28c15c5a011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c83605-57d7-4d81-a8ee-b30279bafd6f", "name": "network-vif-plugged", "status": "completed", "tag": "315cf87c-c809-4b39-b8ec-ef3d92d438f0"}, {"server_uuid": "76f4ea83-2296-4bfd-b8ca-fbc2e03738c3", "name": "network-vif-plugged", "status": "completed", "tag": "bb36450b-f6f8-40a8-b587-c2c25520c90d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:12.729081 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:12.729081 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:12.737920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cc8085ce-5eec-4b4c-8ba1-1da693bf5642 req-f74aa138-1e1a-464b-baf6-e28c15c5a011 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.738354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cc8085ce-5eec-4b4c-8ba1-1da693bf5642 req-f74aa138-1e1a-464b-baf6-e28c15c5a011 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.755123 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cc8085ce-5eec-4b4c-8ba1-1da693bf5642 req-f74aa138-1e1a-464b-baf6-e28c15c5a011 service nova] Creating event network-vif-plugged:315cf87c-c809-4b39-b8ec-ef3d92d438f0 for instance 14c83605-57d7-4d81-a8ee-b30279bafd6f on nch1-master-1 Nov 27 20:47:12.755674 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cc8085ce-5eec-4b4c-8ba1-1da693bf5642 req-f74aa138-1e1a-464b-baf6-e28c15c5a011 service nova] Creating event network-vif-plugged:bb36450b-f6f8-40a8-b587-c2c25520c90d for instance 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 on nch1-master-1 Nov 27 20:47:12.763795 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cc8085ce-5eec-4b4c-8ba1-1da693bf5642 req-f74aa138-1e1a-464b-baf6-e28c15c5a011 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040675 Nov 27 20:47:12.764832 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 294/626] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:12 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:12.772764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-77ba80c4-f149-4218-b1c7-8e76f397d4bd req-d712cae0-5ed5-4335-a945-7cc9179ed192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207cc77c-fd33-4974-8dc3-35a483bfd761", "tag": "2fee0259-c961-4dfb-8c3d-3f133072bbe7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:12.774219 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:12.774219 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:12.785071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-77ba80c4-f149-4218-b1c7-8e76f397d4bd req-d712cae0-5ed5-4335-a945-7cc9179ed192 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.786781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-77ba80c4-f149-4218-b1c7-8e76f397d4bd req-d712cae0-5ed5-4335-a945-7cc9179ed192 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.801036 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-77ba80c4-f149-4218-b1c7-8e76f397d4bd req-d712cae0-5ed5-4335-a945-7cc9179ed192 service nova] Creating event network-changed:2fee0259-c961-4dfb-8c3d-3f133072bbe7 for instance 207cc77c-fd33-4974-8dc3-35a483bfd761 on nch2-master-1 Nov 27 20:47:12.808095 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-77ba80c4-f149-4218-b1c7-8e76f397d4bd req-d712cae0-5ed5-4335-a945-7cc9179ed192 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038711 Nov 27 20:47:12.809307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 295/627] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:12.814595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:12.815341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:12.823963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.824279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:12.825385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:12.826010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.044046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:13.055757 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f44728f9-34a8-406e-80d0-5fd0251dbc48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.245439 Nov 27 20:47:13.056979 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 296/628] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:12 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:13.062024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:13.062877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:13.074120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.074777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.076184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.076541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.213045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:13.231339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:13.233846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:13.235898 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af1e73e8-2297-4137-84dc-b7840f397c70 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1321 microversion: 2.25 time: 0.176871 Nov 27 20:47:13.246462 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 297/629] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:13 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:13.259751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:13.267136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:13.278124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.278673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.279719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.280253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.495227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:13.503417 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bccc315a-bbe8-40f0-b99e-ddaf7ed40a55 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1324 microversion: 2.1 time: 0.254664 Nov 27 20:47:13.504221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 298/630] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:13 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:13.517978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-44117928-0a82-4f96-8ba3-58e5e4adb12d tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '.version_select at 0x7f15c7f9fb80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:13.519770 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:13.519770 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:13.521935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44117928-0a82-4f96-8ba3-58e5e4adb12d tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.522647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44117928-0a82-4f96-8ba3-58e5e4adb12d tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.530449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-44117928-0a82-4f96-8ba3-58e5e4adb12d tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.016283 Nov 27 20:47:13.531220 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 299/631] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:47:13 2021] GET /compute/v2.1/os-migrations => generated 793 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:13.541331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:13.542116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:13.549459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.549625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.550400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.550856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.761966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:13.774871 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d43cbc8-df80-4f66-b3b8-8dd49e5360af tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1311 microversion: 2.1 time: 0.242486 Nov 27 20:47:13.786389 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 300/632] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:13 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1311 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:13.791470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e49c1e7-5e38-4dd4-bec9-a7c8b2b54a37 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Action: 'update', calling method: .version_select at 0x7f15d4175af0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:13.794682 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:13.794682 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:13.907353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e49c1e7-5e38-4dd4-bec9-a7c8b2b54a37 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.908072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e49c1e7-5e38-4dd4-bec9-a7c8b2b54a37 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:13.909229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e49c1e7-5e38-4dd4-bec9-a7c8b2b54a37 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:13.909986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e49c1e7-5e38-4dd4-bec9-a7c8b2b54a37 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:14.401847 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e49c1e7-5e38-4dd4-bec9-a7c8b2b54a37 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9" status: 200 len: 329 microversion: 2.1 time: 0.614195 Nov 27 20:47:14.402368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 301/633] 10.222.0.21 () {60 vars in 1262 bytes} [Sat Nov 27 20:47:13 2021] PUT /compute/v2.1/os-quota-sets/f3a8d93b8e0a432991b59ad1dd23a4c9 => generated 329 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:14.414832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:14.415458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:14.423102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:14.429696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:14.429696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:14.429696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:14.489490 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3404d99-d4ac-4b5f-a57f-439b2e5a8c32 tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] 10.222.0.21 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12426 microversion: 2.1 time: 4.942743 Nov 27 20:47:14.491224 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 333/634] 10.222.0.21 () {58 vars in 1190 bytes} [Sat Nov 27 20:47:09 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12426 bytes in 4945 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:14.497648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1469093510", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:14.563837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:47:14.696205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:14.713214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a39023af-bc75-4089-a817-64219aa40bcc tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.301516 Nov 27 20:47:14.725310 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 302/635] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:14 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:14.731288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:14.735113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:14.742969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:14.743939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:14.745128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:14.745325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:14.968542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:47:14.969062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:47:14.969611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:47:14.970094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:47:14.970610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:47:14.981228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:14.981997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:14.983209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:14.983938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.003776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:15.004568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:47:15.008901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for user 3cb6bc63929648388ac9648823d4ca88 and project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:47:15.011323 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-076f6d29-ffb0-46a3-8b4c-26c8a70ccafc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.284605 Nov 27 20:47:15.015744 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 303/636] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:14 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:15.020149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:15.020798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:15.033549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.034020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.034627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:47:15.034867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.035405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.039579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:47:15.092260 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d94f6f84-69a3-4086-9cf9-bbefeed13d10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599670 Nov 27 20:47:15.093523 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 334/637] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:47:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:47:15.098170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6cb227b-fb09-46f0-b0c9-c2c352e48e2e tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] Calling method '.version_select at 0x7f15d42ad8b0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:15.340844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:15.350384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:15.351925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:15.353046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff17a556-4f33-422f-85f5-4cd8e0662e10 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.336446 Nov 27 20:47:15.353820 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 304/638] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:15 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:15.360213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:15.361149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:15.371666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.372118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.372890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.373333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.399094 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6cb227b-fb09-46f0-b0c9-c2c352e48e2e tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.304219 Nov 27 20:47:15.399754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 335/639] 10.222.0.21 () {58 vars in 1190 bytes} [Sat Nov 27 20:47:15 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:15.404185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:15.405652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:15.423556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.424474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.425900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.426504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.600295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:15.612462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-90ddca1a-5b36-4ad5-93c2-bf9bebe9ef10 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1495 microversion: 2.1 time: 0.211526 Nov 27 20:47:15.614202 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 336/640] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:15 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1495 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:15.625008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-30463407-01bc-4eda-b136-04f3834230de req-257e4e48-3bd6-4b0e-8534-667e3cee38bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f864ad9-b187-4c7e-a890-af76116d06ea", "tag": "3c6e79a9-ba6d-49b0-b965-1eb45c6fa910"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:15.627307 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:15.627307 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:15.635572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-30463407-01bc-4eda-b136-04f3834230de req-257e4e48-3bd6-4b0e-8534-667e3cee38bb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.636343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-30463407-01bc-4eda-b136-04f3834230de req-257e4e48-3bd6-4b0e-8534-667e3cee38bb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.649901 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-30463407-01bc-4eda-b136-04f3834230de req-257e4e48-3bd6-4b0e-8534-667e3cee38bb service nova] Creating event network-changed:3c6e79a9-ba6d-49b0-b965-1eb45c6fa910 for instance 1f864ad9-b187-4c7e-a890-af76116d06ea on nch2-master-1 Nov 27 20:47:15.654707 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-30463407-01bc-4eda-b136-04f3834230de req-257e4e48-3bd6-4b0e-8534-667e3cee38bb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Nov 27 20:47:15.655380 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 337/641] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:15.662152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:15.662860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:15.670166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.670847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.671856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.672452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.719943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:15.736977 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9540dbad-fdaf-485c-8032-5d6c58803605 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1324 microversion: 2.1 time: 0.378265 Nov 27 20:47:15.740184 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 305/642] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:15 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:15.751798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-83f12e60-b080-4aa2-9f3e-50087c6c05ae req-b84c5657-99a4-4130-8ea5-f3dee4dec348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9efc26-9fde-4032-8074-261f852463fc", "tag": "3978ebd3-dcc3-49e6-8a90-afe04b6c5d93"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:15.753333 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:15.753333 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:15.772751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-83f12e60-b080-4aa2-9f3e-50087c6c05ae req-b84c5657-99a4-4130-8ea5-f3dee4dec348 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:15.773205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-83f12e60-b080-4aa2-9f3e-50087c6c05ae req-b84c5657-99a4-4130-8ea5-f3dee4dec348 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:15.785279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-83f12e60-b080-4aa2-9f3e-50087c6c05ae req-b84c5657-99a4-4130-8ea5-f3dee4dec348 service nova] Creating event network-changed:3978ebd3-dcc3-49e6-8a90-afe04b6c5d93 for instance bb9efc26-9fde-4032-8074-261f852463fc on nch2-master-1 Nov 27 20:47:15.787686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:15.791158 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-83f12e60-b080-4aa2-9f3e-50087c6c05ae req-b84c5657-99a4-4130-8ea5-f3dee4dec348 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049320 Nov 27 20:47:15.792653 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 306/643] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:15.797819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec26ec30-5673-4e09-bff7-a7540340cb2e tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] Calling method '.version_select at 0x7f15d40bc940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:15.799402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d1ac6f1-1216-4cdd-982a-b04987382544 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1217 microversion: 2.1 time: 0.142645 Nov 27 20:47:15.801342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 338/644] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:15 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:16.162390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c86aa18-de2f-40e8-8179-a4445708429e tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:16.163186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c86aa18-de2f-40e8-8179-a4445708429e tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:16.169864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c86aa18-de2f-40e8-8179-a4445708429e tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.170418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c86aa18-de2f-40e8-8179-a4445708429e tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:16.171434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c86aa18-de2f-40e8-8179-a4445708429e tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.171916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c86aa18-de2f-40e8-8179-a4445708429e tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:16.251429 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ec26ec30-5673-4e09-bff7-a7540340cb2e tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/a0efb78e-a638-4446-a911-158f2c16325f" status: 202 len: 0 microversion: 2.1 time: 0.457328 Nov 27 20:47:16.257270 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 307/645] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:47:15 2021] DELETE /compute/v2.1/os-security-groups/a0efb78e-a638-4446-a911-158f2c16325f => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:16.265052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:16.267419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:16.279316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.279867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:16.281379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.282269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:16.439394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c86aa18-de2f-40e8-8179-a4445708429e tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1646 microversion: 2.1 time: 0.636005 Nov 27 20:47:16.440577 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 339/646] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:15 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1646 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:16.445731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:16.446696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:16.459881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.460607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:16.461582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.462183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:16.656154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:16.664156 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b082727-ca50-4a78-a135-7b6641053f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.222558 Nov 27 20:47:16.664732 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 340/647] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:16 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:16.669161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ccfb689-798b-469e-be87-5a0e13e0af7b tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] Calling method '.version_select at 0x7f15d42ad8b0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:16.848980 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ccfb689-798b-469e-be87-5a0e13e0af7b tempest-SecurityGroupsTestAdminJSON-1036712305 tempest-SecurityGroupsTestAdminJSON-1036712305-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/b39b5e99-dfed-49eb-9219-9b73dae968f6" status: 202 len: 0 microversion: 2.1 time: 0.183115 Nov 27 20:47:16.849647 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 341/648] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:47:16 2021] DELETE /compute/v2.1/os-security-groups/b39b5e99-dfed-49eb-9219-9b73dae968f6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:16.854896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:16.855663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:16.862773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.863372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:16.864924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:16.874846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.019614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:17.027829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:17.029352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:17.030501 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd603a31-7199-44ed-a592-2b09e049d81a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.179523 Nov 27 20:47:17.031070 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 342/649] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:16 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:17.035595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02615eef-ecae-46d1-b72d-69bceccfc61f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:17.036748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02615eef-ecae-46d1-b72d-69bceccfc61f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:17.043038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02615eef-ecae-46d1-b72d-69bceccfc61f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.043539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02615eef-ecae-46d1-b72d-69bceccfc61f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.044376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02615eef-ecae-46d1-b72d-69bceccfc61f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.044757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02615eef-ecae-46d1-b72d-69bceccfc61f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.075585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:17.091429 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9c36e1d-89c1-49de-8fdc-9c12fcb4e40c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.833162 Nov 27 20:47:17.102853 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 308/650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:16 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:17.113639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:17.116523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:17.130355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.131056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.133750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.134364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.199695 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02615eef-ecae-46d1-b72d-69bceccfc61f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1646 microversion: 2.1 time: 0.167521 Nov 27 20:47:17.200598 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 343/651] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:17 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1646 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:17.205149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:17.206038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:17.212210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.212925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.213807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.214308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.290651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:17.298712 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47932cd2-5956-4b68-a474-fd2ea837c01f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1271 microversion: 2.1 time: 0.097096 Nov 27 20:47:17.300498 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 344/652] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:17 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:17.307508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41e0ebaa-856a-4c8b-a533-fa53141105d9 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] Calling method '.version_select at 0x7f15c7f7d3a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:17.683744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:17.694568 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bdc7ba83-e8a4-4289-98e8-8245c3eb121f tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1324 microversion: 2.1 time: 0.589627 Nov 27 20:47:17.695592 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 309/653] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:17 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1324 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:17.704901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05593fd2-bbd2-4d63-94d1-7b97ba4159f5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:17.708334 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:17.708334 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:17.715422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05593fd2-bbd2-4d63-94d1-7b97ba4159f5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.716404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05593fd2-bbd2-4d63-94d1-7b97ba4159f5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.717358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05593fd2-bbd2-4d63-94d1-7b97ba4159f5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.719949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05593fd2-bbd2-4d63-94d1-7b97ba4159f5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.792782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05593fd2-bbd2-4d63-94d1-7b97ba4159f5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091623 Nov 27 20:47:17.806114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 310/654] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:47:17 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:17.813792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:17.817888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:17.825663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.827000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.828080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.828761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.898949 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41e0ebaa-856a-4c8b-a533-fa53141105d9 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/3f276871-ca6b-48c9-82f4-a8a127f84853" status: 202 len: 0 microversion: 2.1 time: 0.596643 Nov 27 20:47:17.902802 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 345/655] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:47:17 2021] DELETE /compute/v2.1/os-security-groups/3f276871-ca6b-48c9-82f4-a8a127f84853 => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:17.910054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:17.912850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:17.922302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.922992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:17.924386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:17.925037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:18.011484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lazy-loading 'flavor' on Instance uuid 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:47:18.068250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Going to try to live migrate instance to nch2-master-1 {{(pid=135680) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:47:18.182309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:18.189527 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-17ad5879-1a03-49f1-9e33-f3e6fef42bcb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.380240 Nov 27 20:47:18.190307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 311/656] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:17 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:18.203764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da616f23-b3a4-486c-af2d-7cf2fa2508e9 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] Calling method '.version_select at 0x7f15d4130160>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:18.630839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da616f23-b3a4-486c-af2d-7cf2fa2508e9 tempest-SecurityGroupsTestAdminJSON-1695080009 tempest-SecurityGroupsTestAdminJSON-1695080009-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/d3e9c264-710c-466e-b1d4-3f957cac4515" status: 202 len: 0 microversion: 2.1 time: 0.430172 Nov 27 20:47:18.631880 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 312/657] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:47:18 2021] DELETE /compute/v2.1/os-security-groups/d3e9c264-710c-466e-b1d4-3f957cac4515 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:18.638925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:18.639800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:18.655653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:18.656243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:18.657303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:18.658441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:18.990452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:18.999978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:19.001558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:19.002866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f1cc9bf7-8fc3-409c-ac59-1ef0342b2711 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.369963 Nov 27 20:47:19.003544 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 313/658] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:18 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:19.019467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:19.020906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:19.028785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:19.029682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:19.030960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:19.031829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:19.293971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:19.302565 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54d0034a-5ac8-450d-9a7f-6af9db213d35 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.297943 Nov 27 20:47:19.304205 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 314/659] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:19 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:19.310809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:19.311534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:19.332491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:19.334332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:19.335275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:19.335823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:19.567713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:19.587552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc73066c-ca69-4635-9570-dd05d906ca89 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1313 microversion: 2.1 time: 0.281718 Nov 27 20:47:19.599282 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 315/660] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:19 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:19.605137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:19.606069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:19.615820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:19.616553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:19.617369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:19.617999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:19.874737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:19.884087 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb93939b-2f08-4092-b303-1bfdc6f54f1e tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1324 microversion: 2.1 time: 0.283415 Nov 27 20:47:19.885350 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 316/661] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:19 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:20.230560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-942ba3a8-0a2b-4a3c-abed-d3921ca34b3d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Action: 'update', calling method: .version_select at 0x7f15c7fb95e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:20.232276 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:20.232276 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:20.505915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-942ba3a8-0a2b-4a3c-abed-d3921ca34b3d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.506527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-942ba3a8-0a2b-4a3c-abed-d3921ca34b3d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.507180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-942ba3a8-0a2b-4a3c-abed-d3921ca34b3d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.507646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-942ba3a8-0a2b-4a3c-abed-d3921ca34b3d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.598642 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-942ba3a8-0a2b-4a3c-abed-d3921ca34b3d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e" status: 200 len: 240 microversion: 2.36 time: 0.710234 Nov 27 20:47:20.600049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 317/662] 10.222.0.21 () {62 vars in 1302 bytes} [Sat Nov 27 20:47:19 2021] PUT /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e => generated 240 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:20.619923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:20.620543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:20.627334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.628045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.629136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.630300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.769637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3fbd5eef-a087-47dd-bea9-18f946814212 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3/action" status: 202 len: 0 microversion: 2.1 time: 2.867917 Nov 27 20:47:20.770578 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 346/663] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:17 2021] POST /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3/action => generated 0 bytes in 2870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:20.776169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-803deacd-770b-4f8f-83d3-9e958c9d1fc4 req-e03bdb11-4b9f-4d53-908e-b064e72b236f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207cc77c-fd33-4974-8dc3-35a483bfd761", "name": "network-vif-plugged", "status": "completed", "tag": "2fee0259-c961-4dfb-8c3d-3f133072bbe7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:20.778454 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:20.778454 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:20.789128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-803deacd-770b-4f8f-83d3-9e958c9d1fc4 req-e03bdb11-4b9f-4d53-908e-b064e72b236f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.790010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-803deacd-770b-4f8f-83d3-9e958c9d1fc4 req-e03bdb11-4b9f-4d53-908e-b064e72b236f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.803114 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-803deacd-770b-4f8f-83d3-9e958c9d1fc4 req-e03bdb11-4b9f-4d53-908e-b064e72b236f service nova] Creating event network-vif-plugged:2fee0259-c961-4dfb-8c3d-3f133072bbe7 for instance 207cc77c-fd33-4974-8dc3-35a483bfd761 on nch2-master-1 Nov 27 20:47:20.808445 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-803deacd-770b-4f8f-83d3-9e958c9d1fc4 req-e03bdb11-4b9f-4d53-908e-b064e72b236f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036357 Nov 27 20:47:20.809217 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 347/664] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:20.815440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a9e75426-0de9-438f-8b44-0931e7dca81d req-f8232e16-5895-4d25-8ad9-44351543d432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81016c57-65b3-485d-bcfa-990f3b12fd24", "tag": "75279561-8c7c-4017-8974-2a5bc6d0661c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:20.817919 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:20.817919 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:20.826950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a9e75426-0de9-438f-8b44-0931e7dca81d req-f8232e16-5895-4d25-8ad9-44351543d432 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.827672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a9e75426-0de9-438f-8b44-0931e7dca81d req-f8232e16-5895-4d25-8ad9-44351543d432 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.840763 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a9e75426-0de9-438f-8b44-0931e7dca81d req-f8232e16-5895-4d25-8ad9-44351543d432 service nova] Creating event network-changed:75279561-8c7c-4017-8974-2a5bc6d0661c for instance 81016c57-65b3-485d-bcfa-990f3b12fd24 on nch1-master-1 Nov 27 20:47:20.847133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a9e75426-0de9-438f-8b44-0931e7dca81d req-f8232e16-5895-4d25-8ad9-44351543d432 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036087 Nov 27 20:47:20.849226 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 348/665] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:20.857382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:20.858306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:20.867173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.867900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.869058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.869978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.909984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:20.924191 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-52314c27-dc8f-4cf4-bd8d-0db3f3ba3d41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.322952 Nov 27 20:47:20.925180 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 318/666] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:20 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:20.937990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:20.938717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:20.958814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.960609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:20.962930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:20.966177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.050754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:21.060062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:21.062264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:21.063412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87da8198-b4e5-41fc-aaac-0b25ee4699e0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.211612 Nov 27 20:47:21.064126 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 349/667] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:20 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:21.069555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:21.070317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:21.079070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.079779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.080752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.081329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.281807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:21.293166 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13854034-fb91-4bc6-b5aa-5699e5293c2c tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.366672 Nov 27 20:47:21.294356 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 319/668] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:20 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:21.303821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b02e9723-e9a4-4104-afcc-f510a7ecbd88 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Calling method '.version_select at 0x7f15c7fa7c10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:21.308583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:21.320932 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5b2865e-3ed2-4302-9b65-30a98c2b87c2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1313 microversion: 2.1 time: 0.255581 Nov 27 20:47:21.321504 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 350/669] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:21 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:21.325935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:21.326668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:21.336157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.336611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.337413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.337890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.602115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:21.610315 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e2a3cd1-054e-4d2c-bdf2-e266f504e84c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.287535 Nov 27 20:47:21.610896 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 351/670] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:21 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:21.615617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:21.616517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:21.623164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.623923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.624934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.625605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.673447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b02e9723-e9a4-4104-afcc-f510a7ecbd88 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.673968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b02e9723-e9a4-4104-afcc-f510a7ecbd88 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.674824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b02e9723-e9a4-4104-afcc-f510a7ecbd88 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.675271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b02e9723-e9a4-4104-afcc-f510a7ecbd88 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.702829 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b02e9723-e9a4-4104-afcc-f510a7ecbd88 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e/detail" status: 200 len: 672 microversion: 2.36 time: 0.406930 Nov 27 20:47:21.703842 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 320/671] 10.222.0.21 () {60 vars in 1303 bytes} [Sat Nov 27 20:47:21 2021] GET /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e/detail => generated 672 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:21.857003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Action: 'update', calling method: .version_select at 0x7f15c7fb91f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:21.860451 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:21.860451 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:21.963213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:21.970780 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-220f6b48-e10e-412b-ab3e-5904be05fc58 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1324 microversion: 2.1 time: 0.358533 Nov 27 20:47:21.971746 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 352/672] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:21 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:21.976783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:21.977494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:21.984300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.985022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:21.986026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:21.986826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.028456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.028946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.029766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.030207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.065301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.065777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.066573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.067859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.143701 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1818728b-07a5-4011-b72c-2d036705d96e tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e?user_id=47e04e53c91a459da6146e5c52efc841" status: 200 len: 240 microversion: 2.36 time: 0.290593 Nov 27 20:47:22.144670 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 321/673] 10.222.0.21 () {62 vars in 1383 bytes} [Sat Nov 27 20:47:21 2021] PUT /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e?user_id=47e04e53c91a459da6146e5c52efc841 => generated 240 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:47:22.153875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:22.154633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:22.161493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.161986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.162776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.163770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.312025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:22.321411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:22.322896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:22.324010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f156125-d649-44f3-b952-c2a96e4adb2a tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.178187 Nov 27 20:47:22.325047 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 322/674] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:22 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:22.328743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4c558cb2-d363-4c37-a089-be6e73aa8fb5 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Calling method '.version_select at 0x7f15c7fdc9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:22.334408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:22.343884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db3e7133-6d13-47fd-bdb5-96deabdf33ce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.370794 Nov 27 20:47:22.344856 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 353/675] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:21 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:22.350544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:22.351231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:22.357250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.358197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.358802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.359437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.425505 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4c558cb2-d363-4c37-a089-be6e73aa8fb5 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e?user_id=47e04e53c91a459da6146e5c52efc841" status: 200 len: 282 microversion: 2.36 time: 0.099756 Nov 27 20:47:22.431753 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 323/676] 10.222.0.21 () {60 vars in 1363 bytes} [Sat Nov 27 20:47:22 2021] GET /compute/v2.1/os-quota-sets/f55cafe46c304ef18fdfa71c9e03fd4e?user_id=47e04e53c91a459da6146e5c52efc841 => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:22.433446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:22.434067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:22.447402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.447968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.448892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.449446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.649616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:22.657083 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-64c7873c-b565-48c9-b147-f634efa942f5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.310941 Nov 27 20:47:22.657670 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 354/677] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:22 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:22.669712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:22.670547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:22.680359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.680814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.681623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.682064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.742157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:22.753011 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e76e14c5-fd95-4faf-9a1a-2439c337c944 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1313 microversion: 2.1 time: 0.324719 Nov 27 20:47:22.754034 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 324/678] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:22 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:22.809270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-36cbff56-db53-4b61-af7e-d4b51f217dde req-6304130b-cc99-4c6c-aafa-012711af47cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f4ea83-2296-4bfd-b8ca-fbc2e03738c3", "name": "network-vif-unplugged", "status": "completed", "tag": "bb36450b-f6f8-40a8-b587-c2c25520c90d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:22.810832 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:22.810832 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:22.818713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-36cbff56-db53-4b61-af7e-d4b51f217dde req-6304130b-cc99-4c6c-aafa-012711af47cf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:22.819280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-36cbff56-db53-4b61-af7e-d4b51f217dde req-6304130b-cc99-4c6c-aafa-012711af47cf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:22.830866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-36cbff56-db53-4b61-af7e-d4b51f217dde req-6304130b-cc99-4c6c-aafa-012711af47cf service nova] Creating event network-vif-unplugged:bb36450b-f6f8-40a8-b587-c2c25520c90d for instance 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 on nch1-master-1 Nov 27 20:47:22.837565 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-36cbff56-db53-4b61-af7e-d4b51f217dde req-6304130b-cc99-4c6c-aafa-012711af47cf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032380 Nov 27 20:47:22.838628 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 325/679] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:22 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:47:22.981025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:22.989095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:22.991169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:23.006183 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e965a939-5c26-43a9-9580-245ac76a929b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.340315 Nov 27 20:47:23.011943 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 355/680] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:22 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:23.013323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.013910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.014829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.015378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.346157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:23.347484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:23.367165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.368742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.370718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.371418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.431768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:23.441530 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e38bc5d7-a11e-40b5-bafe-dc37f45c4cb0 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 200 len: 1520 microversion: 2.1 time: 0.457232 Nov 27 20:47:23.456266 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 326/681] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:22 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:47:23.463654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:23.464581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:23.470664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.471459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.472612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.473885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.698758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:23.711933 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e09f852-e605-4a2a-a7b2-8a5aeebe236f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.252737 Nov 27 20:47:23.723192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:23.724224 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 327/682] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:23 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:23.733131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'action', calling method: .version_select at 0x7f15d650d790>, body: {"addFloatingIp": {"address": "172.35.3.175"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:23.736941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:23.738584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:23.743672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:23.748961 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37c0e188-c929-4904-8f79-15816a143463 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.406397 Nov 27 20:47:23.750566 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 356/683] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:23 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:23.758251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:23.759797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:23.766968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.767554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.768264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.769157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.771070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.771805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.773535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:23.774624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:23.857755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Acquired lock "refresh_cache-4ad5d6f1-7c37-47dc-a199-429ece8deb71" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:47:24.089327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:24.103322 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc88e3f0-b98a-4969-94db-9d536ddb8de5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.350287 Nov 27 20:47:24.104998 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 357/684] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:23 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:24.115431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:24.117876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:24.135651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:24.136683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:24.137969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:24.138415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:24.380484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:24.390647 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9634d44-bbb6-4c76-b58e-6ad30883fcdd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1313 microversion: 2.1 time: 0.284153 Nov 27 20:47:24.391750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 358/685] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:24 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:24.398250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3af5d2d7-4083-4f3e-827e-723289d0acf6 req-80615034-8859-478f-bb97-0e8d2b098298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9efc26-9fde-4032-8074-261f852463fc", "name": "network-vif-plugged", "status": "completed", "tag": "3978ebd3-dcc3-49e6-8a90-afe04b6c5d93"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:24.400939 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:24.400939 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:24.410123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3af5d2d7-4083-4f3e-827e-723289d0acf6 req-80615034-8859-478f-bb97-0e8d2b098298 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:24.410944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3af5d2d7-4083-4f3e-827e-723289d0acf6 req-80615034-8859-478f-bb97-0e8d2b098298 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:24.431203 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3af5d2d7-4083-4f3e-827e-723289d0acf6 req-80615034-8859-478f-bb97-0e8d2b098298 service nova] Creating event network-vif-plugged:3978ebd3-dcc3-49e6-8a90-afe04b6c5d93 for instance bb9efc26-9fde-4032-8074-261f852463fc on nch2-master-1 Nov 27 20:47:24.438339 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3af5d2d7-4083-4f3e-827e-723289d0acf6 req-80615034-8859-478f-bb97-0e8d2b098298 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045073 Nov 27 20:47:24.438956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 359/686] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:24.452482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:24.457654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:24.466270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:24.469931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:24.471032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:24.471711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:24.751179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:24.765498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-34b4994c-a77e-4f78-a035-76ef839e0762 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.323836 Nov 27 20:47:24.775432 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 360/687] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:24 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:24.787637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:24.790250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:24.802608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:24.803565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:24.804549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:24.805348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:25.004703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:25.015057 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e456ef71-265a-4160-ae01-c99e23256bc0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.238164 Nov 27 20:47:25.017717 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 361/688] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:24 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:25.025710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:25.026658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:25.033976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:25.034652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:25.036405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:25.037097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:25.511984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:25.523910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:25.525503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:25.531400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-74cedd47-cf4f-4b12-9d9c-f99b64ac909b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.507142 Nov 27 20:47:25.533265 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 362/689] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:25 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:25.543466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0311ffec-d6c9-43b1-a8fc-77b3469bb1d6 req-d4afe52d-6231-4ffa-a668-4689793792cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f4ea83-2296-4bfd-b8ca-fbc2e03738c3", "tag": "bb36450b-f6f8-40a8-b587-c2c25520c90d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:25.545287 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:25.545287 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:25.555935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0311ffec-d6c9-43b1-a8fc-77b3469bb1d6 req-d4afe52d-6231-4ffa-a668-4689793792cf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:25.556623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0311ffec-d6c9-43b1-a8fc-77b3469bb1d6 req-d4afe52d-6231-4ffa-a668-4689793792cf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:25.583013 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0311ffec-d6c9-43b1-a8fc-77b3469bb1d6 req-d4afe52d-6231-4ffa-a668-4689793792cf service nova] Creating event network-changed:bb36450b-f6f8-40a8-b587-c2c25520c90d for instance 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 on nch1-master-1 Nov 27 20:47:25.595328 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0311ffec-d6c9-43b1-a8fc-77b3469bb1d6 req-d4afe52d-6231-4ffa-a668-4689793792cf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055905 Nov 27 20:47:25.599628 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 363/690] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:25.606450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:25.607339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:25.628361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:25.629047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:25.630054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:25.630656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:25.846120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:25.854416 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-29bbaf3c-2aec-468b-86a4-69a35abac6ee tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.253107 Nov 27 20:47:25.865492 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 364/691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:25 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:25.871732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:25.872547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:25.880147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:25.880590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:25.881386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:25.881996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.034319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:26.043915 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d79a1e88-8e6c-4311-b1e4-84b8bd6e2115 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1313 microversion: 2.1 time: 0.176600 Nov 27 20:47:26.053900 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 365/692] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:25 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:26.053900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:26.053900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:26.055992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.056551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.057382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.057827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.279689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:26.289978 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6859337e-9461-4935-8cfd-a5fa6d7b56b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.243932 Nov 27 20:47:26.290657 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 366/693] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:26 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:26.308307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:26.308942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:26.319105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.319588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.320390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.320821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.576459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:26.584060 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86bbc386-2ebd-4ff3-8f07-c595ba02a922 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.292524 Nov 27 20:47:26.585202 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 367/694] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:26 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:26.590076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2d2f85af-c815-4d97-ba3f-cca91c31b46f req-a2a360e0-ea47-48dd-b9c3-0a8735b760d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f864ad9-b187-4c7e-a890-af76116d06ea", "name": "network-vif-plugged", "status": "completed", "tag": "3c6e79a9-ba6d-49b0-b965-1eb45c6fa910"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:26.592256 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:26.592256 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:26.600493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2d2f85af-c815-4d97-ba3f-cca91c31b46f req-a2a360e0-ea47-48dd-b9c3-0a8735b760d8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.601250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2d2f85af-c815-4d97-ba3f-cca91c31b46f req-a2a360e0-ea47-48dd-b9c3-0a8735b760d8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.617403 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2d2f85af-c815-4d97-ba3f-cca91c31b46f req-a2a360e0-ea47-48dd-b9c3-0a8735b760d8 service nova] Creating event network-vif-plugged:3c6e79a9-ba6d-49b0-b965-1eb45c6fa910 for instance 1f864ad9-b187-4c7e-a890-af76116d06ea on nch2-master-1 Nov 27 20:47:26.624566 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2d2f85af-c815-4d97-ba3f-cca91c31b46f req-a2a360e0-ea47-48dd-b9c3-0a8735b760d8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038029 Nov 27 20:47:26.625335 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 368/695] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:26.633354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:26.634239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:26.643674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.644497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.645886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.647365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.905052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:26.917164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:26.919092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:26.920753 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-218c0ddf-cd1d-4555-8a48-0e39b1a5b123 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.293392 Nov 27 20:47:26.921504 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 369/696] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:26 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:26.926898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:26.927855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:26.936066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.937003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:26.938115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:26.938714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:27.106613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:27.123609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c43580a2-18b6-4614-93e7-09bda9e3021f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.198289 Nov 27 20:47:27.124995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 370/697] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:26 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:27.130786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:27.131777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:27.139034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:27.140118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:27.141391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:27.141854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:27.347533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:27.368019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28940f05-0153-4e91-b66c-5c03146a3cce tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1313 microversion: 2.1 time: 0.241709 Nov 27 20:47:27.368845 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 371/698] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:27 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:27.390372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:27.391022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:27.416235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:27.417270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:27.418283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:27.418877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:27.481564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Building network info cache for instance {{(pid=135679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:47:27.718039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:27.730278 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a843e08e-065d-4d9f-b8aa-5e54714270fa tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.343149 Nov 27 20:47:27.736344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 372/699] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:27 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:27.749380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1b18e557-8f38-4bdc-bb84-433e856d5dcd req-ce021ab0-56d0-4e2b-b0e6-d5a17a869cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad5d6f1-7c37-47dc-a199-429ece8deb71", "tag": "8be29504-a892-4d2c-b932-707aa3ac7d18"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:27.753556 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:27.753556 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:27.767509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1b18e557-8f38-4bdc-bb84-433e856d5dcd req-ce021ab0-56d0-4e2b-b0e6-d5a17a869cc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:27.767958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1b18e557-8f38-4bdc-bb84-433e856d5dcd req-ce021ab0-56d0-4e2b-b0e6-d5a17a869cc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:27.790134 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1b18e557-8f38-4bdc-bb84-433e856d5dcd req-ce021ab0-56d0-4e2b-b0e6-d5a17a869cc7 service nova] Creating event network-changed:8be29504-a892-4d2c-b932-707aa3ac7d18 for instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 on nch1-master-1 Nov 27 20:47:27.805150 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1b18e557-8f38-4bdc-bb84-433e856d5dcd req-ce021ab0-56d0-4e2b-b0e6-d5a17a869cc7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066519 Nov 27 20:47:27.805773 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 373/700] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:27.819696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:27.821462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:27.835636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:27.837660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:27.840606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:27.843900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:28.237463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:28.247810 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-934ea8ad-6d08-4546-9434-bb3b03f2711c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.440805 Nov 27 20:47:28.258518 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 374/701] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:27 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:28.258518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:28.258518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:28.268318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:28.268932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:28.269860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:28.270419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:28.678435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:28.691036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:28.692621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:28.697800 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61eb4721-ff2c-4a5f-9998-9e2c5f9e2284 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.446098 Nov 27 20:47:28.699549 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 375/702] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:28 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:28.717963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:28.727954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:28.734484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:28.734943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:28.736152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:28.736597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:28.817520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Updating instance_info_cache with network_info: [{"id": "8be29504-a892-4d2c-b932-707aa3ac7d18", "address": "fa:16:3e:dd:6e:b6", "network": {"id": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051844631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bba5dc062b60481085531bc034e45209", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8be29504-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:47:28.840391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Releasing lock "refresh_cache-4ad5d6f1-7c37-47dc-a199-429ece8deb71" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:47:28.841878 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-503af9d0-793e-4257-95c0-71be517bd84a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action" status: 202 len: 0 microversion: 2.1 time: 5.115707 Nov 27 20:47:28.843518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 328/703] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:23 2021] POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action => generated 0 bytes in 5118 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:47:28.852092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:28.853077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:28.862887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:28.864166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:28.865870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:28.869098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:29.020289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:29.030288 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b307915f-99b5-402a-b454-c37ce51804b9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.319165 Nov 27 20:47:29.036201 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 376/704] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:28 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:29.042219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-c27d837c-3b8e-4200-bf1a-7ba8adaec183 req-5ab38dd2-f67c-46e3-bd30-49bc9f339d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81016c57-65b3-485d-bcfa-990f3b12fd24", "name": "network-vif-plugged", "status": "completed", "tag": "75279561-8c7c-4017-8974-2a5bc6d0661c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:29.049435 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:29.049435 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:29.061870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c27d837c-3b8e-4200-bf1a-7ba8adaec183 req-5ab38dd2-f67c-46e3-bd30-49bc9f339d69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:29.063796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c27d837c-3b8e-4200-bf1a-7ba8adaec183 req-5ab38dd2-f67c-46e3-bd30-49bc9f339d69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:29.099490 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-c27d837c-3b8e-4200-bf1a-7ba8adaec183 req-5ab38dd2-f67c-46e3-bd30-49bc9f339d69 service nova] Creating event network-vif-plugged:75279561-8c7c-4017-8974-2a5bc6d0661c for instance 81016c57-65b3-485d-bcfa-990f3b12fd24 on nch1-master-1 Nov 27 20:47:29.109217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-c27d837c-3b8e-4200-bf1a-7ba8adaec183 req-5ab38dd2-f67c-46e3-bd30-49bc9f339d69 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071374 Nov 27 20:47:29.114932 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 377/705] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:29.126715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:29.128809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:29.144234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:29.146479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:29.152126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:29.152888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:29.494351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:29.507195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f2384359-c692-4370-bd01-86c6eb29af5f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.390222 Nov 27 20:47:29.509142 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 378/706] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:29 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:29.514245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'action', calling method: .version_select at 0x7f15d650c790>, body: {"addFloatingIp": {"address": "172.35.3.175"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:29.516188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:29.525590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:29.526103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:29.526916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:29.527444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:29.616445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Acquired lock "refresh_cache-207cc77c-fd33-4974-8dc3-35a483bfd761" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:47:29.645232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:29.653947 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0a89517c-59dc-494d-b85d-ae31c1b14a4d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1313 microversion: 2.1 time: 0.808944 Nov 27 20:47:29.655231 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 329/707] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:28 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1313 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:29.668282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:29.669698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:29.677602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:29.678434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:29.679515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:29.680319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:30.093679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:30.117146 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d46612e6-85f2-4223-a033-fb98795e60fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.460221 Nov 27 20:47:30.120277 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 330/708] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:29 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:30.125303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:30.125943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:30.141281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:30.143021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:30.143890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:30.147525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:30.591456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:30.604329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:30.618573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:30.639188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-984af42c-75b8-477c-ae81-91ecebc43e4e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.498570 Nov 27 20:47:30.641535 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 331/709] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:30 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:30.654017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:30.655475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:30.668169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:30.668937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:30.670425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:30.671188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:31.031365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:31.040104 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a9f6294-f4ee-430b-8393-a03f1c80b639 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.395902 Nov 27 20:47:31.048411 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 332/710] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:30 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:31.056018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:31.058530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:31.080246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:31.082597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:31.086613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:31.087678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:31.577166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:31.588429 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6dbf487f-eecf-4be5-a067-07a886b77e57 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.538477 Nov 27 20:47:31.589119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 333/711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:31 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:31.609401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:31.609401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:31.621344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:31.622229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:31.623755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:31.626643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:31.903776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:31.915033 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b1f2c2e-2557-4536-b9a7-7717fc5c14db tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1462 microversion: 2.1 time: 0.310221 Nov 27 20:47:31.917153 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 334/712] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:31 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1462 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:31.940459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:31.941444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:31.962628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:31.963362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:31.964383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:31.964985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:32.278608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:32.290351 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-60768cb3-0a9e-4c10-9b12-4fa409d4ee06 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.371860 Nov 27 20:47:32.305552 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 335/713] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:31 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:32.305552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:32.305868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:32.315305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:32.316523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:32.317501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:32.317956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:32.514924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:32.528756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:32.532795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:32.534009 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-395c769d-f355-4990-8a7d-ac4197a982f0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.234569 Nov 27 20:47:32.537581 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 336/714] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:32 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:32.574390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:32.574390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:32.593982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:32.594654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:32.600832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:32.600832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:32.768141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:32.776341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Old instance type m1.heat2, new instance type m1.heat {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 20:47:32.783642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:47:32.784480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:47:32.785226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:47:32.785822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:47:32.786443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:47:32.967405 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b5e9dc0f-8469-4709-9b6f-79a028424e69 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24/action" status: 202 len: 0 microversion: 2.1 time: 0.412223 Nov 27 20:47:32.969624 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 337/715] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:32 2021] POST /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:32.979010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:32.983471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:32.995117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:32.999309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:33.019083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:33.020099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:33.877939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:33.886650 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-856792d9-e6be-4caf-84d0-e1ec4db3ec3b tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.915231 Nov 27 20:47:33.893785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 338/716] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:32 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:33.906684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:33.907522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:33.919514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:33.921147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:33.924102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:33.925544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:34.138248 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.neutron [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] re-assign floating IP 172.35.3.175 from instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 Nov 27 20:47:34.276440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Building network info cache for instance {{(pid=135680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:47:34.340870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:34.356770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c1ac71c6-ac57-4a1c-b3f0-420a61fae8c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.460886 Nov 27 20:47:34.366516 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 339/717] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:33 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:34.369325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:34.370212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:34.387553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:34.388272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:34.392383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:34.393628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:34.859164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:34.871150 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e0bde20-6345-4a77-ab90-3741ff9accf6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1471 microversion: 2.1 time: 0.508762 Nov 27 20:47:34.882003 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 340/718] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:34 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1471 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:34.891327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:34.895999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:34.905545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:34.911993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:34.913088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:34.913683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:35.311916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Updating instance_info_cache with network_info: [{"id": "8be29504-a892-4d2c-b932-707aa3ac7d18", "address": "fa:16:3e:dd:6e:b6", "network": {"id": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051844631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bba5dc062b60481085531bc034e45209", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8be29504-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:47:35.355164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Building network info cache for instance {{(pid=135680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:47:35.586880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:35.594920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3cd1e90d-644f-4ce8-bce9-dd953f188472 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.710977 Nov 27 20:47:35.606500 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 341/719] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:34 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:35.630322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:35.631337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:35.637934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:35.639777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:35.641040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:35.641712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.072770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:36.087974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:36.089820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:36.091152 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d54baa2-69fb-406a-8166-cae9463b3116 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.483132 Nov 27 20:47:36.092594 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 342/720] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:35 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:36.099672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-85117e1f-515a-4f0f-a30e-facdc0467d20 req-7ba21ec4-6cc3-40e3-b9e1-ed3559ace8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad5d6f1-7c37-47dc-a199-429ece8deb71", "tag": "8be29504-a892-4d2c-b932-707aa3ac7d18"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:36.115376 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:36.115376 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:36.143927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-85117e1f-515a-4f0f-a30e-facdc0467d20 req-7ba21ec4-6cc3-40e3-b9e1-ed3559ace8d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:36.145780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-85117e1f-515a-4f0f-a30e-facdc0467d20 req-7ba21ec4-6cc3-40e3-b9e1-ed3559ace8d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.171703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-85117e1f-515a-4f0f-a30e-facdc0467d20 req-7ba21ec4-6cc3-40e3-b9e1-ed3559ace8d2 service nova] Creating event network-changed:8be29504-a892-4d2c-b932-707aa3ac7d18 for instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 on nch1-master-1 Nov 27 20:47:36.180000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-85117e1f-515a-4f0f-a30e-facdc0467d20 req-7ba21ec4-6cc3-40e3-b9e1-ed3559ace8d2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084432 Nov 27 20:47:36.181958 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 343/721] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:36.209546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:36.210601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:36.221929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:36.223161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.224381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:36.224998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.290635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Updating instance_info_cache with network_info: [{"id": "2fee0259-c961-4dfb-8c3d-3f133072bbe7", "address": "fa:16:3e:df:40:55", "network": {"id": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051844631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bba5dc062b60481085531bc034e45209", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2fee0259-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:47:36.305389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Releasing lock "refresh_cache-207cc77c-fd33-4974-8dc3-35a483bfd761" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:47:36.306339 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3251749b-1b43-4236-8629-c5651d39187a tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761/action" status: 202 len: 0 microversion: 2.1 time: 6.796510 Nov 27 20:47:36.309708 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 379/722] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:29 2021] POST /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761/action => generated 0 bytes in 6800 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:47:36.317556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:36.324104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:36.331873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:36.332568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.333602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:36.334449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.731434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:36.741125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2bcd9fa2-fe83-41bb-814e-795a381ab2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.430219 Nov 27 20:47:36.751660 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 380/723] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:36 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:36.757191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:36.758018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:36.767173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:36.767989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.768977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:36.770134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:36.930731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:36.948107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f157753-df00-4694-8e34-1459b951fdf2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.764438 Nov 27 20:47:36.949090 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 344/724] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:36 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:36.959850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'action', calling method: .version_select at 0x7f15d650d310>, body: {"removeFloatingIp": {"address": "172.35.3.175"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:37.452818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:37.461810 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2cd30830-055f-499f-a6d3-55fb04f90ffc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1471 microversion: 2.1 time: 0.708704 Nov 27 20:47:37.463017 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 381/725] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:36 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1471 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:37.468144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:37.469625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:37.478348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:37.479016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:37.480641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:37.482479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:37.740294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:37.762977 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49df7a3b-4ca8-4721-8074-fad01fb039b5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.298587 Nov 27 20:47:37.764778 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 382/726] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:37 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:37.769416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:37.776409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:37.777174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:37.778305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:37.778968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:37.788190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:37.788806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:37.796471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:37.798948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:37.805625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:37.808232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:38.148251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:38.159701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:38.162038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:38.165682 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-beb402bd-7ead-40c1-8239-765376309675 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1361 microversion: 2.25 time: 0.399299 Nov 27 20:47:38.171818 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 383/727] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:37 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:38.177149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:38.185553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:38.199448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:38.201097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:38.203902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:38.205983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:38.466839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] HTTP exception thrown: Floating IP 172.35.3.175 is not associated with instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71. Nov 27 20:47:38.467805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Returning 409 to user: Floating IP 172.35.3.175 is not associated with instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:47:38.468821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7374fc4d-df14-473a-9b2c-807a0b839204 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action" status: 409 len: 146 microversion: 2.1 time: 1.518365 Nov 27 20:47:38.469573 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 345/728] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:36 2021] POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action => generated 146 bytes in 1520 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:47:38.476185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:38.477254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:38.484159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:38.484606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:38.485384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:38.489146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:38.720821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:38.730149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:38.730638 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e640efc6-7466-4346-b3a7-f7c91700c450 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.259621 Nov 27 20:47:38.731454 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 346/729] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:38 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:38.736750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4c22cb73-3fe5-4c64-997a-1f75e621fbe6 req-9ff1869d-6c71-490c-a7c7-8f9cf45e8402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207cc77c-fd33-4974-8dc3-35a483bfd761", "tag": "2fee0259-c961-4dfb-8c3d-3f133072bbe7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:38.738999 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:38.738999 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:38.739429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2df6066-fd0d-4b5e-b909-ed92d62195c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1505 microversion: 2.1 time: 0.566253 Nov 27 20:47:38.747792 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 384/730] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:38 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:38.748906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4c22cb73-3fe5-4c64-997a-1f75e621fbe6 req-9ff1869d-6c71-490c-a7c7-8f9cf45e8402 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:38.749356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4c22cb73-3fe5-4c64-997a-1f75e621fbe6 req-9ff1869d-6c71-490c-a7c7-8f9cf45e8402 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:38.773480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4c22cb73-3fe5-4c64-997a-1f75e621fbe6 req-9ff1869d-6c71-490c-a7c7-8f9cf45e8402 service nova] Creating event network-changed:2fee0259-c961-4dfb-8c3d-3f133072bbe7 for instance 207cc77c-fd33-4974-8dc3-35a483bfd761 on nch2-master-1 Nov 27 20:47:38.780776 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4c22cb73-3fe5-4c64-997a-1f75e621fbe6 req-9ff1869d-6c71-490c-a7c7-8f9cf45e8402 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047702 Nov 27 20:47:38.781942 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 347/731] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:38.793305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.175"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:38.956091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e054c635-1e46-48cd-b518-f7a79c2469f0 tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] Calling method '.version_select at 0x7f15d448a700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:38.986956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:38.995050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:38.995618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:38.996293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:38.996728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:39.219426 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e054c635-1e46-48cd-b518-f7a79c2469f0 tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.469501 Nov 27 20:47:39.220302 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 385/732] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:47:38 2021] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:47:39.226187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:39.227082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:39.248603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:39.250523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:39.251651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:39.252271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:39.376597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Acquired lock "refresh_cache-207cc77c-fd33-4974-8dc3-35a483bfd761" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:47:39.856123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:39.876389 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb2c82db-6c9b-4b94-a373-41df7a3cfde9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.653792 Nov 27 20:47:39.883715 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 386/733] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:39 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:39.888840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:39.890630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:39.908022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:39.911886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:39.913365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:39.917708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:40.699541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:40.709582 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-799b7553-f5e4-4953-8dee-25ed94575d33 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1388 microversion: 2.1 time: 0.824361 Nov 27 20:47:40.721503 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 387/734] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:39 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1388 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:40.728139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:40.728987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:40.736538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:40.737229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:40.738734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:40.739398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:41.214719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Building network info cache for instance {{(pid=135679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:47:41.245689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:41.260444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:41.262502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:41.263704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b8d2bab-fc78-4f39-ac4e-eb5f2494d325 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1556 microversion: 2.25 time: 0.540745 Nov 27 20:47:41.264269 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 388/735] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:40 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1556 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:41.273307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a809b3da-f344-45a9-9e7d-ebdc247a690c tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] Action: 'create', calling method: .version_select at 0x7f15c7c5f310>, body: {"pool": "non_exist_pool"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:41.342370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a809b3da-f344-45a9-9e7d-ebdc247a690c tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] HTTP exception thrown: Floating IP pool not found. Nov 27 20:47:41.342991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a809b3da-f344-45a9-9e7d-ebdc247a690c tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] Returning 404 to user: Floating IP pool not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:47:41.343842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a809b3da-f344-45a9-9e7d-ebdc247a690c tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.078663 Nov 27 20:47:41.348811 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 389/736] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:47:41 2021] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:47:41.351965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:41.352582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:41.369807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:41.370580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:41.371899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:41.372324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:41.854201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:41.864293 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51853a5d-7b37-4733-b37e-357eed830afa tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.518048 Nov 27 20:47:41.875648 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 390/737] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:41 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:41.882228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:41.883037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:41.890055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:41.890761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:41.891761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:41.892197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:41.978337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Updating instance_info_cache with network_info: [{"id": "2fee0259-c961-4dfb-8c3d-3f133072bbe7", "address": "fa:16:3e:df:40:55", "network": {"id": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051844631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bba5dc062b60481085531bc034e45209", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap2fee0259-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:47:41.993182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Releasing lock "refresh_cache-207cc77c-fd33-4974-8dc3-35a483bfd761" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:47:41.994106 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a355e1ac-0504-4e60-92ce-a79e7bba88f8 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761/action" status: 202 len: 0 microversion: 2.1 time: 3.210726 Nov 27 20:47:41.995167 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 348/738] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:38 2021] POST /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761/action => generated 0 bytes in 3213 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:47:41.999556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:42.000169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:42.007179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.007699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.008485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.008921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.118724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:42.129087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-be9d2fec-807a-4c49-aaeb-ff3bfb70a6b8 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1495 microversion: 2.1 time: 0.251339 Nov 27 20:47:42.131109 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 391/739] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:41 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1495 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:42.153891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-dce62a31-c843-44d9-b7de-e5f7b3089087 req-9cb2e64f-b9e5-4e8a-a690-421699142e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207cc77c-fd33-4974-8dc3-35a483bfd761", "tag": "2fee0259-c961-4dfb-8c3d-3f133072bbe7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:42.155019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:42.155545 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:42.155545 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:42.163465 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7ff41eb-46c4-4a5f-854b-830eb0a69fa8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.166654 Nov 27 20:47:42.164399 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 349/740] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:41 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:42.167458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dce62a31-c843-44d9-b7de-e5f7b3089087 req-9cb2e64f-b9e5-4e8a-a690-421699142e62 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.167891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dce62a31-c843-44d9-b7de-e5f7b3089087 req-9cb2e64f-b9e5-4e8a-a690-421699142e62 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.169161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:42.169769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:42.176797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.177300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.178094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.178527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.186423 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-dce62a31-c843-44d9-b7de-e5f7b3089087 req-9cb2e64f-b9e5-4e8a-a690-421699142e62 service nova] Creating event network-changed:2fee0259-c961-4dfb-8c3d-3f133072bbe7 for instance 207cc77c-fd33-4974-8dc3-35a483bfd761 on nch2-master-1 Nov 27 20:47:42.193532 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-dce62a31-c843-44d9-b7de-e5f7b3089087 req-9cb2e64f-b9e5-4e8a-a690-421699142e62 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043420 Nov 27 20:47:42.194138 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 392/741] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:42.205168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-002d6bf1-d279-4349-aaa5-9ff698b44e0b tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] Calling method '.version_select at 0x7f15c7cbca60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:42.304620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-002d6bf1-d279-4349-aaa5-9ff698b44e0b tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3d6cf6eb-88f1-4bfc-8c14-1ac25e65c0c9 could not be found", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:47:42.306145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-002d6bf1-d279-4349-aaa5-9ff698b44e0b tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] HTTP exception thrown: Floating IP not found for ID 3d6cf6eb-88f1-4bfc-8c14-1ac25e65c0c9 Nov 27 20:47:42.306930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-002d6bf1-d279-4349-aaa5-9ff698b44e0b tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] Returning 404 to user: Floating IP not found for ID 3d6cf6eb-88f1-4bfc-8c14-1ac25e65c0c9 {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:47:42.308034 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-002d6bf1-d279-4349-aaa5-9ff698b44e0b tempest-FloatingIPsNegativeTestJSON-823184708 tempest-FloatingIPsNegativeTestJSON-823184708-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/3d6cf6eb-88f1-4bfc-8c14-1ac25e65c0c9" status: 404 len: 111 microversion: 2.1 time: 0.111943 Nov 27 20:47:42.308748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 393/742] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:47:42 2021] DELETE /compute/v2.1/os-floating-ips/3d6cf6eb-88f1-4bfc-8c14-1ac25e65c0c9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:47:42.315449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:42.316356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:42.325681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.326314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.327303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.327939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.485345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid bb9efc26-9fde-4032-8074-261f852463fc {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:47:42.523709 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-251b92be-bd98-4ad6-8bdb-f1ddc2b97a0c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 2048 microversion: 2.25 time: 0.358083 Nov 27 20:47:42.524608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 350/743] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:42 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 2048 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:42.531102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:42.531899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:42.543164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.543958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.544974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.545606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.577420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:47:42.686684 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c4bfa4d7-7a42-49e2-b13c-c35e0c3ad6ef tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "DELETE /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 204 len: 0 microversion: 2.1 time: 0.158991 Nov 27 20:47:42.687687 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 351/744] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:47:42 2021] DELETE /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:47:42.704765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96a86e10-2609-4f51-9dfc-2c2a5ddf73d1 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '.version_select at 0x7f15c7dcadc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:42.706190 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:42.706190 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:42.707830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96a86e10-2609-4f51-9dfc-2c2a5ddf73d1 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.708352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96a86e10-2609-4f51-9dfc-2c2a5ddf73d1 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.720925 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96a86e10-2609-4f51-9dfc-2c2a5ddf73d1 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.019622 Nov 27 20:47:42.721068 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 352/745] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:47:42 2021] GET /compute/v2.1/os-migrations => generated 1568 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:42.726606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:42.727397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:42.739478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.739925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:42.740836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:42.741373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.100597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:43.132359 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b707ed1a-0c30-455f-9f4c-3fb1ccff8a6e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1586 microversion: 2.1 time: 0.818493 Nov 27 20:47:43.148932 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 394/746] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:42 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1586 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:43.165285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.175"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:43.167115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:43.182622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.185790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.187686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.192315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.227599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid bb9efc26-9fde-4032-8074-261f852463fc {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:47:43.246116 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e90e04c5-6da9-4b30-ad03-e8c5a5418b5c tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 2048 microversion: 2.25 time: 0.524019 Nov 27 20:47:43.247374 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 353/747] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:42 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 2048 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:43.254106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8e4a699-0e02-4c1a-9d41-d5ed0d4b0901 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:43.254923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8e4a699-0e02-4c1a-9d41-d5ed0d4b0901 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:43.260531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Acquired lock "refresh_cache-4ad5d6f1-7c37-47dc-a199-429ece8deb71" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:47:43.264448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8e4a699-0e02-4c1a-9d41-d5ed0d4b0901 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.269503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8e4a699-0e02-4c1a-9d41-d5ed0d4b0901 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.270405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8e4a699-0e02-4c1a-9d41-d5ed0d4b0901 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.271059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8e4a699-0e02-4c1a-9d41-d5ed0d4b0901 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.477162 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8e4a699-0e02-4c1a-9d41-d5ed0d4b0901 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1646 microversion: 2.1 time: 0.228526 Nov 27 20:47:43.483232 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 354/748] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:43 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1646 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:43.497877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:43.502596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:43.516598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.517165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.522946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.523591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.796340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:43.805400 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c91d3761-7657-4295-9dd8-28093f88f356 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.321043 Nov 27 20:47:43.805976 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 355/749] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:43 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:43.815144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78eeb5fd-c2a4-4e56-a0c5-f0fcb7eb7800 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:43.815669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78eeb5fd-c2a4-4e56-a0c5-f0fcb7eb7800 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:43.827725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78eeb5fd-c2a4-4e56-a0c5-f0fcb7eb7800 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.828195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78eeb5fd-c2a4-4e56-a0c5-f0fcb7eb7800 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.829069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78eeb5fd-c2a4-4e56-a0c5-f0fcb7eb7800 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:43.829550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78eeb5fd-c2a4-4e56-a0c5-f0fcb7eb7800 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:43.974812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78eeb5fd-c2a4-4e56-a0c5-f0fcb7eb7800 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167629 Nov 27 20:47:43.975498 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 356/750] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:47:43 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:43.991957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:43.992574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:44.031152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:44.031665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:44.034370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:44.039678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:44.263712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:44.271889 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d5f15f3f-3b2e-4901-a420-8cd9b5ad5a9f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.295299 Nov 27 20:47:44.283221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 357/751] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:43 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:44.291398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b8fbdba-d39e-4fed-88f0-87137e9aa1c7 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:44.298729 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:44.298729 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:44.303216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8fbdba-d39e-4fed-88f0-87137e9aa1c7 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:44.304004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8fbdba-d39e-4fed-88f0-87137e9aa1c7 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:44.305199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8fbdba-d39e-4fed-88f0-87137e9aa1c7 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:44.305806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b8fbdba-d39e-4fed-88f0-87137e9aa1c7 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:44.346659 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b8fbdba-d39e-4fed-88f0-87137e9aa1c7 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.061799 Nov 27 20:47:44.348629 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 358/752] 10.222.0.21 () {60 vars in 1216 bytes} [Sat Nov 27 20:47:44 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:44.353236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-369624737", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "324306ab-fd63-4c3d-9f56-7119b3413ec6"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:44.442018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] validate_networks() for [('324306ab-fd63-4c3d-9f56-7119b3413ec6', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:47:45.596766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:47:45.598026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:47:45.598225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:47:45.598629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:47:45.599035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:47:45.613500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:45.614309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:45.615733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:45.616454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:45.639749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:47:45.649552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for user 1d46c71936aa4118aa36a9e95b95c4f5 and project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:47:45.672621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:47:45.677549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:47:45.804838 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6fe1e983-feb8-4812-acf6-8356afc3a318 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446533 Nov 27 20:47:45.809027 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 359/753] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:47:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:47:45.822732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13722bec-b65e-47cc-b637-f32b8886b249 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:45.823207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13722bec-b65e-47cc-b637-f32b8886b249 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:45.835244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13722bec-b65e-47cc-b637-f32b8886b249 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:45.835901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13722bec-b65e-47cc-b637-f32b8886b249 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:45.836782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13722bec-b65e-47cc-b637-f32b8886b249 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:45.837296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13722bec-b65e-47cc-b637-f32b8886b249 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:45.952737 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13722bec-b65e-47cc-b637-f32b8886b249 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc/action" status: 202 len: 0 microversion: 2.25 time: 0.142329 Nov 27 20:47:45.958429 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 360/754] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:47:45 2021] POST /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:47:45.964447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:45.966378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:45.999222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.002535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:46.003619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.004593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:46.402069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:46.414876 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff7081c3-f774-4a88-9411-bad9c6a6c1f4 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1472 microversion: 2.1 time: 0.458534 Nov 27 20:47:46.419471 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 361/755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:45 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1472 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:46.426184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:46.427087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:46.435964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.436681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:46.437977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.439156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:46.681910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:46.692322 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d924dd4-854d-48bc-bfb3-d69348346ee4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.275236 Nov 27 20:47:46.704432 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 362/756] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:46 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:46.720492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:46.721440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:46.730663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.731897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:46.732935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.733567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:46.867944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:46.889225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-390b5e0b-05ea-44d6-9d66-7773a55d6eda tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1214 microversion: 2.1 time: 0.179755 Nov 27 20:47:46.906662 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 363/757] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:46 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:46.916296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:46.916296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:46.932450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.932893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:46.935606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:46.948695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:47.289230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid bb9efc26-9fde-4032-8074-261f852463fc {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:47:47.307376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f96bc717-72e0-49d7-8999-d0abe2f4ce11 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 2033 microversion: 2.25 time: 0.406068 Nov 27 20:47:47.308330 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 364/758] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:46 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 2033 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:47.320829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e2c234c7-0d66-49ae-8754-9a5b799567b6 req-c86e83df-8ebf-4181-a0e3-eaa762403cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207cc77c-fd33-4974-8dc3-35a483bfd761", "name": "network-vif-deleted", "tag": "2fee0259-c961-4dfb-8c3d-3f133072bbe7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:47.322639 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:47.322639 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:47.381044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e2c234c7-0d66-49ae-8754-9a5b799567b6 req-c86e83df-8ebf-4181-a0e3-eaa762403cb0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:47.381044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e2c234c7-0d66-49ae-8754-9a5b799567b6 req-c86e83df-8ebf-4181-a0e3-eaa762403cb0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:47.398226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e2c234c7-0d66-49ae-8754-9a5b799567b6 req-c86e83df-8ebf-4181-a0e3-eaa762403cb0 service nova] Creating event network-vif-deleted:2fee0259-c961-4dfb-8c3d-3f133072bbe7 for instance 207cc77c-fd33-4974-8dc3-35a483bfd761 on nch2-master-1 Nov 27 20:47:47.404377 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e2c234c7-0d66-49ae-8754-9a5b799567b6 req-c86e83df-8ebf-4181-a0e3-eaa762403cb0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094256 Nov 27 20:47:47.408967 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 365/759] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:47.416461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:47.418326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:47.440026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:47.441525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:47.442196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:47.442689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:47.507517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'flavor' on Instance uuid bb9efc26-9fde-4032-8074-261f852463fc {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:47:47.546008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Going to try to live migrate instance to nch1-master-1 {{(pid=135679) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:47:48.517282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Building network info cache for instance {{(pid=135680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:47:51.314457 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6a54d9a-0a81-4c22-9b8f-137302e0398e tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc/action" status: 202 len: 0 microversion: 2.25 time: 3.903875 Nov 27 20:47:51.317384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 366/760] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:47:47 2021] POST /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc/action => generated 0 bytes in 3908 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:47:51.324494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:51.326091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:51.376746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:51.379322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:51.382731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:51.386479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.167917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Updating instance_info_cache with network_info: [{"id": "8be29504-a892-4d2c-b932-707aa3ac7d18", "address": "fa:16:3e:dd:6e:b6", "network": {"id": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051844631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bba5dc062b60481085531bc034e45209", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8be29504-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:47:52.189916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Releasing lock "refresh_cache-4ad5d6f1-7c37-47dc-a199-429ece8deb71" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:47:52.191124 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-69e01c9e-5d09-4ebf-a1ce-e757e6787263 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action" status: 202 len: 0 microversion: 2.1 time: 9.040111 Nov 27 20:47:52.191863 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 395/761] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:43 2021] POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action => generated 0 bytes in 9042 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:47:52.198366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:52.201295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:52.221468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.222579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.224028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.224470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.405621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:52.414540 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1e606a19-8a27-419c-8548-16dbe7d95128 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1478 microversion: 2.1 time: 1.095710 Nov 27 20:47:52.424337 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 367/762] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:51 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1478 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:52.430911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:52.431866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:52.439813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.441096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.442148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.442830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.512210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:52.520745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d8814a4-0334-4935-a539-04a1eb1211d0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.327805 Nov 27 20:47:52.523556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 396/763] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:52 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:52.529969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b9dad0a5-2934-4efd-9a80-94a098ccbfe5 req-3fe4782b-45b9-4b3f-8087-38b24c6df815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad5d6f1-7c37-47dc-a199-429ece8deb71", "tag": "8be29504-a892-4d2c-b932-707aa3ac7d18"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:52.533774 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:52.533774 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:52.556268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b9dad0a5-2934-4efd-9a80-94a098ccbfe5 req-3fe4782b-45b9-4b3f-8087-38b24c6df815 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.559443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b9dad0a5-2934-4efd-9a80-94a098ccbfe5 req-3fe4782b-45b9-4b3f-8087-38b24c6df815 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.581160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b9dad0a5-2934-4efd-9a80-94a098ccbfe5 req-3fe4782b-45b9-4b3f-8087-38b24c6df815 service nova] Creating event network-changed:8be29504-a892-4d2c-b932-707aa3ac7d18 for instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 on nch1-master-1 Nov 27 20:47:52.595399 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b9dad0a5-2934-4efd-9a80-94a098ccbfe5 req-3fe4782b-45b9-4b3f-8087-38b24c6df815 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070392 Nov 27 20:47:52.600743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 397/764] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:52.614028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-167786d8-ff06-4ccc-999f-ed1757e77529 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:52.615516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-167786d8-ff06-4ccc-999f-ed1757e77529 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:52.635371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167786d8-ff06-4ccc-999f-ed1757e77529 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.637504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167786d8-ff06-4ccc-999f-ed1757e77529 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.639581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167786d8-ff06-4ccc-999f-ed1757e77529 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.643019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167786d8-ff06-4ccc-999f-ed1757e77529 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.738341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-167786d8-ff06-4ccc-999f-ed1757e77529 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 14 microversion: 2.1 time: 0.135168 Nov 27 20:47:52.742552 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 398/765] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:52 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:47:52.749635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-213a92a2-ca39-4d75-8de4-9e2433711a6a req-3a0fc7e9-daed-4d43-8af9-63f3f069bf13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4389e3d2-cc9e-40e6-8a2f-d59d54421ab9", "tag": "b51ad6c9-008a-470c-b58c-4307b66fbeca"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:52.755357 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:52.755357 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:52.773664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-213a92a2-ca39-4d75-8de4-9e2433711a6a req-3a0fc7e9-daed-4d43-8af9-63f3f069bf13 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.775853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-213a92a2-ca39-4d75-8de4-9e2433711a6a req-3a0fc7e9-daed-4d43-8af9-63f3f069bf13 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.815341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-213a92a2-ca39-4d75-8de4-9e2433711a6a req-3a0fc7e9-daed-4d43-8af9-63f3f069bf13 service nova] Creating event network-changed:b51ad6c9-008a-470c-b58c-4307b66fbeca for instance 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 on nch1-master-1 Nov 27 20:47:52.828316 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-213a92a2-ca39-4d75-8de4-9e2433711a6a req-3a0fc7e9-daed-4d43-8af9-63f3f069bf13 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080109 Nov 27 20:47:52.832586 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 399/766] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:52.839884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:52.840570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:52.866449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.869674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:52.871073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:52.874538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:53.171731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:53.186648 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e906a12f-c665-4957-b6b1-6f7adfbfef26 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1310 microversion: 2.1 time: 0.761092 Nov 27 20:47:53.197753 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 368/767] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:52 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1310 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:53.204735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-191996e3-3150-4f75-9e33-112660ddd0b4 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '.version_select at 0x7f15c7df2b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:53.506681 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-191996e3-3150-4f75-9e33-112660ddd0b4 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips/e7d09a21-c5dc-472f-8c81-48956b80e10e" status: 200 len: 185 microversion: 2.1 time: 0.307381 Nov 27 20:47:53.508080 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 369/768] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:47:53 2021] GET /compute/v2.1/os-floating-ips/e7d09a21-c5dc-472f-8c81-48956b80e10e => generated 185 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:53.514071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:53.517283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:53.536526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:53.538788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:53.539891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:53.542886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:53.828635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:53.846081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:53.853588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:53.856875 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80f1c55d-e52d-43a1-afa4-39168331bae0 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1566 microversion: 2.25 time: 1.022031 Nov 27 20:47:53.866567 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 400/769] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:52 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1566 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:53.884633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Action: 'action', calling method: .version_select at 0x7f15d650c310>, body: {"removeFloatingIp": {"address": "172.35.3.175"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:54.366465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:54.366465 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-601df4bd-1756-4b4b-b1fb-d810d25612ed tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1478 microversion: 2.1 time: 0.856507 Nov 27 20:47:54.366683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 370/770] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:53 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1478 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:54.374439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:54.375453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:54.382341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:54.383144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:54.384208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:54.384850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:54.407796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:54.445254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:54.451786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:54.453085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:54.457135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:55.044387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:55.053349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2731f19a-3e74-4396-b702-a17908a6a765 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.685712 Nov 27 20:47:55.079948 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 371/771] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:54 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:55.091879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7209f058-f626-42c3-bf5d-3eaf32ac119c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:55.098960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7209f058-f626-42c3-bf5d-3eaf32ac119c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:55.137738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7209f058-f626-42c3-bf5d-3eaf32ac119c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:55.138790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7209f058-f626-42c3-bf5d-3eaf32ac119c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:55.139908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7209f058-f626-42c3-bf5d-3eaf32ac119c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:55.141839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7209f058-f626-42c3-bf5d-3eaf32ac119c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:55.322904 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7209f058-f626-42c3-bf5d-3eaf32ac119c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 14 microversion: 2.1 time: 0.241442 Nov 27 20:47:55.324034 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 372/772] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:55 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:47:55.339340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:55.340087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:55.367922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:55.368366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:55.371736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:55.372372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:55.776880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Acquired lock "refresh_cache-4ad5d6f1-7c37-47dc-a199-429ece8deb71" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:47:55.963007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:55.972077 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15669f83-6ff6-43ea-a214-299a44737372 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1310 microversion: 2.1 time: 0.639462 Nov 27 20:47:55.972660 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 373/773] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:55 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1310 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:55.983628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f456da13-a796-4235-96ac-2aee37be53ae req-bc637aff-99d9-4aa9-b506-4c3b71e48333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f864ad9-b187-4c7e-a890-af76116d06ea", "tag": "3c6e79a9-ba6d-49b0-b965-1eb45c6fa910"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:55.985155 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:55.985155 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:56.024505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f456da13-a796-4235-96ac-2aee37be53ae req-bc637aff-99d9-4aa9-b506-4c3b71e48333 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:56.024964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f456da13-a796-4235-96ac-2aee37be53ae req-bc637aff-99d9-4aa9-b506-4c3b71e48333 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:56.068247 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f456da13-a796-4235-96ac-2aee37be53ae req-bc637aff-99d9-4aa9-b506-4c3b71e48333 service nova] Creating event network-changed:3c6e79a9-ba6d-49b0-b965-1eb45c6fa910 for instance 1f864ad9-b187-4c7e-a890-af76116d06ea on nch2-master-1 Nov 27 20:47:56.074930 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f456da13-a796-4235-96ac-2aee37be53ae req-bc637aff-99d9-4aa9-b506-4c3b71e48333 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094786 Nov 27 20:47:56.080212 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 374/774] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:56.094357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:56.097334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:56.131961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:56.132762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:56.133794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:56.134689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:56.686145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:56.703602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:56.705328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:56.706745 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e089c2b-7393-47f7-8c93-0d84bbe93690 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1566 microversion: 2.25 time: 0.623569 Nov 27 20:47:56.718759 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 375/775] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:56 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1566 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:56.724051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fb509b5f-8f4d-4f4b-939f-bb757f9674f0 req-3788e43a-94ea-4f02-99a4-bed00f7e74bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9efc26-9fde-4032-8074-261f852463fc", "name": "network-vif-unplugged", "status": "completed", "tag": "3978ebd3-dcc3-49e6-8a90-afe04b6c5d93"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:56.725816 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:56.725816 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:56.733606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fb509b5f-8f4d-4f4b-939f-bb757f9674f0 req-3788e43a-94ea-4f02-99a4-bed00f7e74bf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:56.734316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fb509b5f-8f4d-4f4b-939f-bb757f9674f0 req-3788e43a-94ea-4f02-99a4-bed00f7e74bf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:56.758821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fb509b5f-8f4d-4f4b-939f-bb757f9674f0 req-3788e43a-94ea-4f02-99a4-bed00f7e74bf service nova] Creating event network-vif-unplugged:3978ebd3-dcc3-49e6-8a90-afe04b6c5d93 for instance bb9efc26-9fde-4032-8074-261f852463fc on nch2-master-1 Nov 27 20:47:56.765230 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fb509b5f-8f4d-4f4b-939f-bb757f9674f0 req-3788e43a-94ea-4f02-99a4-bed00f7e74bf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044281 Nov 27 20:47:56.766320 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 376/776] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:56.776162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:56.777038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:56.783853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:56.785690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:56.786730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:56.787403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:57.275388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:57.287012 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d0f9394-56be-4c58-a79e-163d555e37f2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1463 microversion: 2.1 time: 0.519198 Nov 27 20:47:57.287646 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 377/777] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:56 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1463 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:57.301569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:57.302504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:57.322249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:57.325907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:57.328143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:57.328919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:57.757950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:57.770065 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e52c020-62cf-4634-9914-7b7e0d5c2eba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.481381 Nov 27 20:47:57.770661 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 378/778] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:57 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:57.790223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3173e432-cb79-46f7-b25f-1017a1d3a820 req-67a79a66-cee2-40b0-b984-6369db1c3349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77", "name": "network-vif-unplugged", "status": "completed", "tag": "41eff457-e562-48bc-bb0b-6db9a9bacf92"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:57.794285 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:57.794285 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:57.806433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3173e432-cb79-46f7-b25f-1017a1d3a820 req-67a79a66-cee2-40b0-b984-6369db1c3349 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:57.807290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3173e432-cb79-46f7-b25f-1017a1d3a820 req-67a79a66-cee2-40b0-b984-6369db1c3349 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:57.821388 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3173e432-cb79-46f7-b25f-1017a1d3a820 req-67a79a66-cee2-40b0-b984-6369db1c3349 service nova] Creating event network-vif-unplugged:41eff457-e562-48bc-bb0b-6db9a9bacf92 for instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 on nch2-master-1 Nov 27 20:47:57.828195 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3173e432-cb79-46f7-b25f-1017a1d3a820 req-67a79a66-cee2-40b0-b984-6369db1c3349 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041501 Nov 27 20:47:57.829263 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 379/779] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:57.839433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e2b7c33a-92f3-4bff-b2b8-46de00f4ba11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:57.840475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e2b7c33a-92f3-4bff-b2b8-46de00f4ba11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:57.861237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2b7c33a-92f3-4bff-b2b8-46de00f4ba11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:57.862020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2b7c33a-92f3-4bff-b2b8-46de00f4ba11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:57.863545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2b7c33a-92f3-4bff-b2b8-46de00f4ba11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:57.864336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2b7c33a-92f3-4bff-b2b8-46de00f4ba11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:57.973022 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e2b7c33a-92f3-4bff-b2b8-46de00f4ba11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 16400 microversion: 2.1 time: 0.142262 Nov 27 20:47:57.977830 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 380/780] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:57 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 16400 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:57.986365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:57.987437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:58.004554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:58.005748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:58.006856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:58.008874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:58.263187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Building network info cache for instance {{(pid=135680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:47:58.403225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:58.413898 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0e72308-22c0-4804-a614-0ac8afc70718 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1310 microversion: 2.1 time: 0.434373 Nov 27 20:47:58.415592 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 381/781] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:57 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1310 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:58.420981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d5d4edc3-5d2e-4c34-b307-d8690bce0ee0 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:58.422226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d5d4edc3-5d2e-4c34-b307-d8690bce0ee0 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:58.437426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5d4edc3-5d2e-4c34-b307-d8690bce0ee0 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:58.438321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5d4edc3-5d2e-4c34-b307-d8690bce0ee0 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:58.439874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5d4edc3-5d2e-4c34-b307-d8690bce0ee0 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:58.449664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5d4edc3-5d2e-4c34-b307-d8690bce0ee0 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:58.638176 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d5d4edc3-5d2e-4c34-b307-d8690bce0ee0 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action" status: 202 len: 0 microversion: 2.1 time: 0.221155 Nov 27 20:47:58.639566 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 382/782] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:58 2021] POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:58.648231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:58.650549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:58.671938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:58.679940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:58.681600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:58.682779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:58.998120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:59.007944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:59.009459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:59.010657 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-380cd42d-9cdd-4be4-afc3-df1abe949638 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1566 microversion: 2.25 time: 0.369923 Nov 27 20:47:59.011224 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 383/783] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:47:58 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1566 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:47:59.017950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:59.023154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.035877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.036326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.037116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.037548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.079303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.079760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.080216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lazy-loading 'fault' on Instance uuid 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:47:59.158088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Updating instance_info_cache with network_info: [{"id": "8be29504-a892-4d2c-b932-707aa3ac7d18", "address": "fa:16:3e:dd:6e:b6", "network": {"id": "928a9d2f-c6ce-4a29-a19b-6db7d0d4717b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1051844631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bba5dc062b60481085531bc034e45209", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8be29504-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:47:59.172816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Releasing lock "refresh_cache-4ad5d6f1-7c37-47dc-a199-429ece8deb71" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:47:59.173783 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3f5bad5-6054-4c89-84c4-fe7793a0d848 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action" status: 202 len: 0 microversion: 2.1 time: 5.305785 Nov 27 20:47:59.174797 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 401/784] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:53 2021] POST /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71/action => generated 0 bytes in 5307 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:47:59.182606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2b29e12d-eb7e-4beb-a10d-02e5b4b5ed99 req-5924d5f3-69ee-4dba-836a-ad6ee4428454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad5d6f1-7c37-47dc-a199-429ece8deb71", "tag": "8be29504-a892-4d2c-b932-707aa3ac7d18"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:59.207523 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:59.207523 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:47:59.217527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2b29e12d-eb7e-4beb-a10d-02e5b4b5ed99 req-5924d5f3-69ee-4dba-836a-ad6ee4428454 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.217977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2b29e12d-eb7e-4beb-a10d-02e5b4b5ed99 req-5924d5f3-69ee-4dba-836a-ad6ee4428454 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.244958 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2b29e12d-eb7e-4beb-a10d-02e5b4b5ed99 req-5924d5f3-69ee-4dba-836a-ad6ee4428454 service nova] Creating event network-changed:8be29504-a892-4d2c-b932-707aa3ac7d18 for instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 on nch1-master-1 Nov 27 20:47:59.258961 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2b29e12d-eb7e-4beb-a10d-02e5b4b5ed99 req-5924d5f3-69ee-4dba-836a-ad6ee4428454 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077816 Nov 27 20:47:59.259642 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 402/785] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:59.260101 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-199a0f1b-e13d-4038-995c-010554c39a65 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1597 microversion: 2.1 time: 0.246014 Nov 27 20:47:59.272626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:59.272626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.273997 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 384/786] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:59 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1597 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:59.279355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-33b2cef5-3073-4150-9aa1-dc5be07d0e28 req-7a36ce2d-22f1-4143-b32a-98b400747297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9efc26-9fde-4032-8074-261f852463fc", "tag": "3978ebd3-dcc3-49e6-8a90-afe04b6c5d93"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:59.281281 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:47:59.281281 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:47:59.285379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.285692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.286491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.286930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.302144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-33b2cef5-3073-4150-9aa1-dc5be07d0e28 req-7a36ce2d-22f1-4143-b32a-98b400747297 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.309932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-33b2cef5-3073-4150-9aa1-dc5be07d0e28 req-7a36ce2d-22f1-4143-b32a-98b400747297 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.331930 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-33b2cef5-3073-4150-9aa1-dc5be07d0e28 req-7a36ce2d-22f1-4143-b32a-98b400747297 service nova] Creating event network-changed:3978ebd3-dcc3-49e6-8a90-afe04b6c5d93 for instance bb9efc26-9fde-4032-8074-261f852463fc on nch2-master-1 Nov 27 20:47:59.343757 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-33b2cef5-3073-4150-9aa1-dc5be07d0e28 req-7a36ce2d-22f1-4143-b32a-98b400747297 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068219 Nov 27 20:47:59.347060 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 385/787] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:47:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:59.368865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-258c49ba-c8d8-4829-9cfc-ce31475412f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:59.371295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-258c49ba-c8d8-4829-9cfc-ce31475412f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.379434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-258c49ba-c8d8-4829-9cfc-ce31475412f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.380356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-258c49ba-c8d8-4829-9cfc-ce31475412f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.381403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-258c49ba-c8d8-4829-9cfc-ce31475412f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.382072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-258c49ba-c8d8-4829-9cfc-ce31475412f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.436356 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-258c49ba-c8d8-4829-9cfc-ce31475412f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 16400 microversion: 2.1 time: 0.087368 Nov 27 20:47:59.437422 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 386/788] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:59 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 16400 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:47:59.447706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:59.448695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.463364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.463947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.469040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.469621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.491404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] HTTP exception thrown: Instance 207cc77c-fd33-4974-8dc3-35a483bfd761 could not be found. Nov 27 20:47:59.492295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Returning 404 to user: Instance 207cc77c-fd33-4974-8dc3-35a483bfd761 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:47:59.493908 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eed6b985-3b83-4413-9878-da285308e401 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "DELETE /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 404 len: 111 microversion: 2.1 time: 0.054935 Nov 27 20:47:59.494899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 387/789] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:47:59 2021] DELETE /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:47:59.500417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7c5105f-41f1-45b6-964b-45e32caf2716 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:47:59.501944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7c5105f-41f1-45b6-964b-45e32caf2716 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.512013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7c5105f-41f1-45b6-964b-45e32caf2716 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.513296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7c5105f-41f1-45b6-964b-45e32caf2716 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.514337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7c5105f-41f1-45b6-964b-45e32caf2716 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.515224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7c5105f-41f1-45b6-964b-45e32caf2716 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.552580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:47:59.560867 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4dae4274-def6-4cbe-95c4-0ee5e5d277d6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.299965 Nov 27 20:47:59.571696 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 403/790] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:59 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:47:59.628681 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7c5105f-41f1-45b6-964b-45e32caf2716 tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action" status: 202 len: 0 microversion: 2.1 time: 0.132257 Nov 27 20:47:59.632578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 388/791] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:47:59 2021] POST /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:47:59.639005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:59.639825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.655698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.656170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.657052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.657495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.792729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3de3a76e-86d7-4b12-8e87-bf26c5e149c6 tempest-AbsoluteLimitsTestJSON-1316281405 tempest-AbsoluteLimitsTestJSON-1316281405-project] Calling method '.version_select at 0x7f15c7f77a60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:59.812048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de3a76e-86d7-4b12-8e87-bf26c5e149c6 tempest-AbsoluteLimitsTestJSON-1316281405 tempest-AbsoluteLimitsTestJSON-1316281405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.812556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de3a76e-86d7-4b12-8e87-bf26c5e149c6 tempest-AbsoluteLimitsTestJSON-1316281405 tempest-AbsoluteLimitsTestJSON-1316281405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.813710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de3a76e-86d7-4b12-8e87-bf26c5e149c6 tempest-AbsoluteLimitsTestJSON-1316281405 tempest-AbsoluteLimitsTestJSON-1316281405-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.815336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de3a76e-86d7-4b12-8e87-bf26c5e149c6 tempest-AbsoluteLimitsTestJSON-1316281405 tempest-AbsoluteLimitsTestJSON-1316281405-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.851308 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3de3a76e-86d7-4b12-8e87-bf26c5e149c6 tempest-AbsoluteLimitsTestJSON-1316281405 tempest-AbsoluteLimitsTestJSON-1316281405-project] 10.222.0.21 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.278029 Nov 27 20:47:59.852473 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 404/792] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:59 2021] GET /compute/v2.1/limits => generated 511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:47:59.865083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:59.865885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 207cc77c-fd33-4974-8dc3-35a483bfd761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.882598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.883365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.884315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.884905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.915022 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] HTTP exception thrown: Instance 207cc77c-fd33-4974-8dc3-35a483bfd761 could not be found. Nov 27 20:47:59.925665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Returning 404 to user: Instance 207cc77c-fd33-4974-8dc3-35a483bfd761 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:47:59.926732 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ccf50fd4-f33f-41a0-89f4-d04d2faee7e1 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761" status: 404 len: 111 microversion: 2.1 time: 0.073102 Nov 27 20:47:59.933017 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 405/793] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:59 2021] GET /compute/v2.1/servers/207cc77c-fd33-4974-8dc3-35a483bfd761 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:47:59.937918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e83cd9d7-0497-403c-8778-0108fcb8e0cc tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:47:59.948179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e83cd9d7-0497-403c-8778-0108fcb8e0cc tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:47:59.954898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83cd9d7-0497-403c-8778-0108fcb8e0cc tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.959562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83cd9d7-0497-403c-8778-0108fcb8e0cc tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:47:59.960669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83cd9d7-0497-403c-8778-0108fcb8e0cc tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:47:59.961294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83cd9d7-0497-403c-8778-0108fcb8e0cc tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:00.333248 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e83cd9d7-0497-403c-8778-0108fcb8e0cc tempest-ServersAdminTestJSON-1568972249 tempest-ServersAdminTestJSON-1568972249-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1614 microversion: 2.1 time: 0.398799 Nov 27 20:48:00.334005 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 406/794] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:59 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1614 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:00.348968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-528bfc90-00f1-499b-a22d-89ceac2c9dcb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '.version_select at 0x7f15c7c7eaf0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:00.835531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:00.850622 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22a1a700-a3f2-43aa-a717-d9fbd5d61a8b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1310 microversion: 2.1 time: 1.213988 Nov 27 20:48:00.861116 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 389/795] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:47:59 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1310 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:00.882142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:00.883597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:00.890872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:00.891901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:00.894010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:00.894794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:01.234754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:01.246645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:01.252197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:01.256269 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47aea5c1-03aa-4ba2-87f0-36dfc83315d3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1566 microversion: 2.25 time: 0.392838 Nov 27 20:48:01.260067 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 390/796] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:00 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1566 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:01.274321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:01.275226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:01.285327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:01.285846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:01.286681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:01.287122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:01.339553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:48:01.531507 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40ec6621-b106-4dcf-829e-ff7a05053bd8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 204 len: 0 microversion: 2.1 time: 0.268865 Nov 27 20:48:01.537560 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 391/797] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:48:01 2021] DELETE /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:48:01.548008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22eeae76-2db8-4aa5-8d38-d0117c50240e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:01.551053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22eeae76-2db8-4aa5-8d38-d0117c50240e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:01.571179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22eeae76-2db8-4aa5-8d38-d0117c50240e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:01.572442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22eeae76-2db8-4aa5-8d38-d0117c50240e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:01.574978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22eeae76-2db8-4aa5-8d38-d0117c50240e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:01.575533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22eeae76-2db8-4aa5-8d38-d0117c50240e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:01.656863 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22eeae76-2db8-4aa5-8d38-d0117c50240e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 16400 microversion: 2.1 time: 0.119024 Nov 27 20:48:01.659579 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 392/798] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:01 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 16400 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:01.674830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:01.681117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:01.695289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:01.695289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:01.695289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:01.695289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.047859 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-528bfc90-00f1-499b-a22d-89ceac2c9dcb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/e7d09a21-c5dc-472f-8c81-48956b80e10e" status: 202 len: 0 microversion: 2.1 time: 1.712865 Nov 27 20:48:02.054161 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 407/799] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:48:00 2021] DELETE /compute/v2.1/os-floating-ips/e7d09a21-c5dc-472f-8c81-48956b80e10e => generated 0 bytes in 1720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:48:02.060793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d0d7d02d-ad8f-499b-95df-42cd1c88920b req-a499ff7b-a07f-41b4-b192-d3cc38453b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4389e3d2-cc9e-40e6-8a2f-d59d54421ab9", "name": "network-vif-plugged", "status": "completed", "tag": "b51ad6c9-008a-470c-b58c-4307b66fbeca"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:02.064178 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:02.064178 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:02.074505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:02.078474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d0d7d02d-ad8f-499b-95df-42cd1c88920b req-a499ff7b-a07f-41b4-b192-d3cc38453b7e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.079695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d0d7d02d-ad8f-499b-95df-42cd1c88920b req-a499ff7b-a07f-41b4-b192-d3cc38453b7e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.082416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb928e34-8351-46e8-afc2-e7796f77e125 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.420890 Nov 27 20:48:02.084954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 393/800] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:01 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:02.092201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:02.092809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:02.094691 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d0d7d02d-ad8f-499b-95df-42cd1c88920b req-a499ff7b-a07f-41b4-b192-d3cc38453b7e service nova] Creating event network-vif-plugged:b51ad6c9-008a-470c-b58c-4307b66fbeca for instance 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 on nch1-master-1 Nov 27 20:48:02.103504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d0d7d02d-ad8f-499b-95df-42cd1c88920b req-a499ff7b-a07f-41b4-b192-d3cc38453b7e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046433 Nov 27 20:48:02.104678 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 408/801] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:02.110581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.115571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.116540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.117284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.139921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:02.141092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:02.165684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.166874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.168846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.170186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.406815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:02.415160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebaa53ca-2539-47e8-9c47-18ed223d6377 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1310 microversion: 2.1 time: 0.309099 Nov 27 20:48:02.424726 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 409/802] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:02 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1310 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:02.424726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:02.424726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:02.433447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.436597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.437443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.437889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.470432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:48:02.473742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:02.492182 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27cea758-a531-4009-bf86-d5518bcd5f08 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1470 microversion: 2.1 time: 0.393477 Nov 27 20:48:02.493063 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 394/803] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:02 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:02.498786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:02.499429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:02.510667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.511114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.512967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.514184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.570069 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-18e96a0a-4b65-4661-9828-53e72cbed763 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 204 len: 0 microversion: 2.1 time: 0.151837 Nov 27 20:48:02.570875 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 410/804] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:48:02 2021] DELETE /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:48:02.579056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:02.580017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:02.586895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.587613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.588658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.589263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.773324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:02.781366 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-922928ac-0eb1-4bfc-9bef-0656837980dc tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1527 microversion: 2.1 time: 0.206220 Nov 27 20:48:02.783292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 411/805] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:02 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1527 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:02.788593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0e09ea3-e3ae-4ea3-9942-336769d8133b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:02.790065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0e09ea3-e3ae-4ea3-9942-336769d8133b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:02.796208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0e09ea3-e3ae-4ea3-9942-336769d8133b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.796967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0e09ea3-e3ae-4ea3-9942-336769d8133b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.797764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0e09ea3-e3ae-4ea3-9942-336769d8133b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:02.798503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0e09ea3-e3ae-4ea3-9942-336769d8133b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:02.808899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:02.825392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:02.827892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:02.835128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-027ed71c-b6a8-4a79-8287-23747e86709b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1566 microversion: 2.25 time: 0.336155 Nov 27 20:48:02.836068 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 395/806] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:02 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1566 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:02.860739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0e09ea3-e3ae-4ea3-9942-336769d8133b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.075086 Nov 27 20:48:02.866119 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 412/807] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:02 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:03.101833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:03.103610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:03.139320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.144628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:03.146005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.147498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:03.432990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:03.433707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:03.443879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.447990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:03.449043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.449742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:03.456270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:03.466061 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a176a61-ec87-4498-aeaa-6004b61f60e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.367738 Nov 27 20:48:03.468868 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 396/808] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:03 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:03.509684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:03.510416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:03.518711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.525694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:03.527110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.527746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:03.718468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:03.728639 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-93c0cd04-f5f2-43c0-af1b-adbb2ccff403 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1470 microversion: 2.1 time: 0.222655 Nov 27 20:48:03.746759 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 397/809] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:03 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:03.801953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:03.802559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:03.828717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.831441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:03.833264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:03.833717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.047817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:04.060474 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32e273c3-9f95-4af7-8a89-b7bc646756b2 tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1527 microversion: 2.1 time: 0.262977 Nov 27 20:48:04.071333 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 398/810] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:03 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1527 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:04.071333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:04.071333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:04.079077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.079767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.080852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.081674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.176777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:04.184889 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a98ebe85-d847-4774-8e92-bf5e7bfa28fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1310 microversion: 2.1 time: 0.756332 Nov 27 20:48:04.187944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 413/811] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:03 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1310 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:04.193188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ecad07df-5ab3-470d-8b9e-cf943c05937f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:04.208539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ecad07df-5ab3-470d-8b9e-cf943c05937f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:04.215638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecad07df-5ab3-470d-8b9e-cf943c05937f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.216368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecad07df-5ab3-470d-8b9e-cf943c05937f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.217341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecad07df-5ab3-470d-8b9e-cf943c05937f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.217937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecad07df-5ab3-470d-8b9e-cf943c05937f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.292469 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ecad07df-5ab3-470d-8b9e-cf943c05937f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.103077 Nov 27 20:48:04.293360 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 414/812] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:04 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:04.300986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b8b45e7f-2de7-4b1e-8893-16ecd94c0dd8 req-2040a985-61c1-4743-8d56-0a187cad6774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77", "name": "network-vif-plugged", "status": "completed", "tag": "41eff457-e562-48bc-bb0b-6db9a9bacf92"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:04.313191 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:04.313191 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:04.328683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b8b45e7f-2de7-4b1e-8893-16ecd94c0dd8 req-2040a985-61c1-4743-8d56-0a187cad6774 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.329398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b8b45e7f-2de7-4b1e-8893-16ecd94c0dd8 req-2040a985-61c1-4743-8d56-0a187cad6774 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.339540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:04.347627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:04.357231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b8b45e7f-2de7-4b1e-8893-16ecd94c0dd8 req-2040a985-61c1-4743-8d56-0a187cad6774 service nova] Creating event network-vif-plugged:41eff457-e562-48bc-bb0b-6db9a9bacf92 for instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 on nch2-master-1 Nov 27 20:48:04.363425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:04.364720 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c90b94a-f4a2-4706-88cc-8cf823cbcfdc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1541 microversion: 2.25 time: 0.301947 Nov 27 20:48:04.365312 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 399/813] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:04 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1541 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:04.373036 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b8b45e7f-2de7-4b1e-8893-16ecd94c0dd8 req-2040a985-61c1-4743-8d56-0a187cad6774 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078107 Nov 27 20:48:04.378188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 415/814] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:04.383092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7dc072a1-61bd-4cb8-956a-0cdf4fd9ac5b tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '.version_select at 0x7f15c7dcadc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:04.385987 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:04.385987 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:04.388668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dc072a1-61bd-4cb8-956a-0cdf4fd9ac5b tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.389146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dc072a1-61bd-4cb8-956a-0cdf4fd9ac5b tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.416571 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7dc072a1-61bd-4cb8-956a-0cdf4fd9ac5b tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 2121 microversion: 2.25 time: 0.037999 Nov 27 20:48:04.419233 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 400/815] 10.222.0.21 () {60 vars in 1183 bytes} [Sat Nov 27 20:48:04 2021] GET /compute/v2.1/os-migrations => generated 2121 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:48:04.434012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:04.445778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:04.459425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.460760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.462504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.463769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.488179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:04.489592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:04.500467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.503350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.504862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.506069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.733478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid bb9efc26-9fde-4032-8074-261f852463fc {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:48:04.761816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:04.776885 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9aa50f2-4bbd-4a20-be08-72654eb66751 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.292700 Nov 27 20:48:04.784252 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b2d57dc-f384-42b3-a21e-058064ec77bb tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 2033 microversion: 2.25 time: 0.357085 Nov 27 20:48:04.785275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 416/816] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:04 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 2033 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:04.790368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:04.791338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:04.793588 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 401/817] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:04 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:04.804390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.805471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:04.806497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:04.810113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:05.038694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:05.047169 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58a92666-b40c-4c88-ada4-6cf6e76c0d04 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 200 len: 1428 microversion: 2.1 time: 0.260620 Nov 27 20:48:05.047991 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 417/818] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:04 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 1428 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:05.077843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:05.078624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:05.087508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:05.091398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:05.093890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:05.102393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:05.144884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-249715346", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "979446f3-8da8-4e53-af09-3da825cab09f"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:05.262803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] validate_networks() for [('979446f3-8da8-4e53-af09-3da825cab09f', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:05.570065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9322591436e34060a46c6f145dca61d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5dc062b60481085531bc034e45209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:05.578824 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c939f68c-fb3f-4007-86b9-38e8e48eb0eb tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 200 len: 1527 microversion: 2.1 time: 0.504727 Nov 27 20:48:05.579429 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 402/819] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:05 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 1527 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:05.606618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9439bd84-1db0-4eb3-b6cc-a99173d18b34 req-16593dd4-5716-4c10-a93c-33daa17d0a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e727772-99b2-45c0-9110-ac8dce65e2ae", "name": "network-vif-deleted", "tag": "921d53f1-521d-4cdd-b823-85f92a7d7fd4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:05.608795 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:05.608795 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:05.626674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9439bd84-1db0-4eb3-b6cc-a99173d18b34 req-16593dd4-5716-4c10-a93c-33daa17d0a21 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:05.627518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9439bd84-1db0-4eb3-b6cc-a99173d18b34 req-16593dd4-5716-4c10-a93c-33daa17d0a21 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:05.648920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9439bd84-1db0-4eb3-b6cc-a99173d18b34 req-16593dd4-5716-4c10-a93c-33daa17d0a21 service nova] Creating event network-vif-deleted:921d53f1-521d-4cdd-b823-85f92a7d7fd4 for instance 7e727772-99b2-45c0-9110-ac8dce65e2ae on nch2-master-1 Nov 27 20:48:05.656094 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9439bd84-1db0-4eb3-b6cc-a99173d18b34 req-16593dd4-5716-4c10-a93c-33daa17d0a21 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070096 Nov 27 20:48:05.657203 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 403/820] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:05.665351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:05.666213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:05.675770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:05.676150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:05.677133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:05.677942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.013101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:06.016921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:06.017657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:06.021424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:06.022019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:06.022774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:06.032146 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c2c69212-6e4d-413a-a969-f09b93aedd29 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1494 microversion: 2.1 time: 0.372254 Nov 27 20:48:06.032943 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 404/821] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:05 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1494 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:06.041831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.042711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.044341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.045213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.078499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:06.084780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for user 2d326a07ce104727bec8ae98dabea64d and project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:06.102413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:06.105679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:06.186952 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-64466bf1-d2a1-4d56-a1f6-5f62927fb2d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.046632 Nov 27 20:48:06.194030 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 418/822] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 20:48:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 27 20:48:06.199857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7677e951-26bd-4193-8529-ddc7194444c3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:06.200858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7677e951-26bd-4193-8529-ddc7194444c3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.221148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7677e951-26bd-4193-8529-ddc7194444c3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.221608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7677e951-26bd-4193-8529-ddc7194444c3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.222413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7677e951-26bd-4193-8529-ddc7194444c3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.224006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7677e951-26bd-4193-8529-ddc7194444c3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.263815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34dda0dc-f0c6-4315-a7e2-6b77d4b05737 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Calling method '.version_select at 0x7f15c7d65b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.286357 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7677e951-26bd-4193-8529-ddc7194444c3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.090986 Nov 27 20:48:06.287408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 419/823] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:06 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:06.292337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4909124c-728e-4854-8b32-6a68a2a31893 req-ad537c5e-6493-492b-96f5-28d69893df5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad5d6f1-7c37-47dc-a199-429ece8deb71", "name": "network-vif-deleted", "tag": "8be29504-a892-4d2c-b932-707aa3ac7d18"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:06.293222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-34dda0dc-f0c6-4315-a7e2-6b77d4b05737 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f1b80cd2-e694-4d4e-8995-1bf843786557 does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:48:06.293990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-34dda0dc-f0c6-4315-a7e2-6b77d4b05737 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Neutron security group f1b80cd2-e694-4d4e-8995-1bf843786557 not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:48:06.294132 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:06.294132 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:06.295003 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-34dda0dc-f0c6-4315-a7e2-6b77d4b05737 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] HTTP exception thrown: Security group f1b80cd2-e694-4d4e-8995-1bf843786557 does not exist Nov 27 20:48:06.295003 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-e902a1a7-ea89-4437-a730-19f8794841c4'] Nov 27 20:48:06.296403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34dda0dc-f0c6-4315-a7e2-6b77d4b05737 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Returning 404 to user: Security group f1b80cd2-e694-4d4e-8995-1bf843786557 does not exist Nov 27 20:48:06.296403 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-e902a1a7-ea89-4437-a730-19f8794841c4'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:06.297627 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34dda0dc-f0c6-4315-a7e2-6b77d4b05737 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/f1b80cd2-e694-4d4e-8995-1bf843786557" status: 404 len: 194 microversion: 2.1 time: 0.263986 Nov 27 20:48:06.298314 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 405/824] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:48:06 2021] DELETE /compute/v2.1/os-security-groups/f1b80cd2-e694-4d4e-8995-1bf843786557 => generated 194 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:06.309789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.310680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.321893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4909124c-728e-4854-8b32-6a68a2a31893 req-ad537c5e-6493-492b-96f5-28d69893df5d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.322046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.322341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4909124c-728e-4854-8b32-6a68a2a31893 req-ad537c5e-6493-492b-96f5-28d69893df5d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.323089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.324184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.324807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.341447 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4909124c-728e-4854-8b32-6a68a2a31893 req-ad537c5e-6493-492b-96f5-28d69893df5d service nova] Creating event network-vif-deleted:8be29504-a892-4d2c-b932-707aa3ac7d18 for instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 on nch1-master-1 Nov 27 20:48:06.353660 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4909124c-728e-4854-8b32-6a68a2a31893 req-ad537c5e-6493-492b-96f5-28d69893df5d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064879 Nov 27 20:48:06.354377 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 420/825] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:06.362221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7edddb50-b7f3-485b-8f4e-888fcefc6eaf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.362814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7edddb50-b7f3-485b-8f4e-888fcefc6eaf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.372568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7edddb50-b7f3-485b-8f4e-888fcefc6eaf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.373637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7edddb50-b7f3-485b-8f4e-888fcefc6eaf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.374630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7edddb50-b7f3-485b-8f4e-888fcefc6eaf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.375083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7edddb50-b7f3-485b-8f4e-888fcefc6eaf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.570393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:06.581774 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b56ce2c6-f4fa-4093-a194-3db19912b526 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.280192 Nov 27 20:48:06.583460 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 406/826] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:06 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:06.591821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.593029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 7e727772-99b2-45c0-9110-ac8dce65e2ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.599370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7edddb50-b7f3-485b-8f4e-888fcefc6eaf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1645 microversion: 2.1 time: 0.242569 Nov 27 20:48:06.600422 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 421/827] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:06 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1645 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:06.604547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.605136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.606271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.606904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.615854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9906403-5391-470f-907a-b54abd1915fc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.616461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9906403-5391-470f-907a-b54abd1915fc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.645232 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] HTTP exception thrown: Instance 7e727772-99b2-45c0-9110-ac8dce65e2ae could not be found. Nov 27 20:48:06.645911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Returning 404 to user: Instance 7e727772-99b2-45c0-9110-ac8dce65e2ae could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:06.646732 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e1d072c-2e4b-41d4-915e-b7d0eea31dc2 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae" status: 404 len: 111 microversion: 2.1 time: 0.061833 Nov 27 20:48:06.647302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 407/828] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:06 2021] GET /compute/v2.1/servers/7e727772-99b2-45c0-9110-ac8dce65e2ae => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:06.654524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c83e249-c7b9-4918-9b46-bcc364a9edc6 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005960 Nov 27 20:48:06.656034 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 408/829] 10.222.0.21 () {58 vars in 1163 bytes} [Sat Nov 27 20:48:06 2021] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 27 20:48:06.663769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.665381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] [instance: 4ad5d6f1-7c37-47dc-a199-429ece8deb71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.673522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.674809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.675882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.676547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c9906403-5391-470f-907a-b54abd1915fc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:06.676709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.685040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c9906403-5391-470f-907a-b54abd1915fc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:06.686726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c9906403-5391-470f-907a-b54abd1915fc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:06.687749 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9906403-5391-470f-907a-b54abd1915fc tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1261 microversion: 2.25 time: 0.085804 Nov 27 20:48:06.688539 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 422/830] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:06 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:06.693346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42e7e66b-f053-44fb-8a0d-6efc471997c0 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.693926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42e7e66b-f053-44fb-8a0d-6efc471997c0 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.700638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e7e66b-f053-44fb-8a0d-6efc471997c0 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.701006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e7e66b-f053-44fb-8a0d-6efc471997c0 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.701792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e7e66b-f053-44fb-8a0d-6efc471997c0 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.702689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e7e66b-f053-44fb-8a0d-6efc471997c0 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.704319 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] HTTP exception thrown: Instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 could not be found. Nov 27 20:48:06.705012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] Returning 404 to user: Instance 4ad5d6f1-7c37-47dc-a199-429ece8deb71 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:06.705983 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1fc5f0cd-8812-4690-9751-f0e2f12b6ddf tempest-FloatingIPsAssociationTestJSON-1607325997 tempest-FloatingIPsAssociationTestJSON-1607325997-project] 10.222.0.21 "GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71" status: 404 len: 111 microversion: 2.1 time: 0.048985 Nov 27 20:48:06.710441 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 409/831] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:06 2021] GET /compute/v2.1/servers/4ad5d6f1-7c37-47dc-a199-429ece8deb71 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:06.715922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:06.717905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:06.725620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.726316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.727387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:06.728231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:06.776645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:48:06.922087 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efdc3dd5-4a74-4c14-85d6-684cd9f8e70f tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 204 len: 0 microversion: 2.1 time: 0.210158 Nov 27 20:48:06.926478 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 410/832] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:48:06 2021] DELETE /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:48:06.934320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1cc68482-b805-4e4f-a094-f1b2b8307ea3 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Calling method '.version_select at 0x7f15d4421e50>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.050523 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42e7e66b-f053-44fb-8a0d-6efc471997c0 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1645 microversion: 2.1 time: 0.360943 Nov 27 20:48:07.054226 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 423/833] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:06 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1645 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:07.068894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.069594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:07.085185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.085765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.086637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.087146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.173316 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1cc68482-b805-4e4f-a094-f1b2b8307ea3 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.244285 Nov 27 20:48:07.174792 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 411/834] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:48:06 2021] GET /compute/v2.1/os-security-groups => generated 707 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:07.179275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-894bbdb8-37c0-4258-ad7e-1f5e0ad9337b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.180651 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:07.180651 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:07.183429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894bbdb8-37c0-4258-ad7e-1f5e0ad9337b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.183894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894bbdb8-37c0-4258-ad7e-1f5e0ad9337b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.184727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894bbdb8-37c0-4258-ad7e-1f5e0ad9337b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.185162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894bbdb8-37c0-4258-ad7e-1f5e0ad9337b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.214347 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-894bbdb8-37c0-4258-ad7e-1f5e0ad9337b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038457 Nov 27 20:48:07.215105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 412/835] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:48:07 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:07.220237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a8bd6cc-eac2-420d-b9da-70183d6088de tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Calling method '.version_select at 0x7f15c7fdcf70>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.306093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:07.315308 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f467c157-6165-4ae0-b08f-864288c1fc16 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1470 microversion: 2.1 time: 0.259571 Nov 27 20:48:07.328503 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 424/836] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:07 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:07.334109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79079ebe-2340-47ac-ac28-e7c06976334b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:07.334659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-79079ebe-2340-47ac-ac28-e7c06976334b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:07.344691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79079ebe-2340-47ac-ac28-e7c06976334b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.345148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79079ebe-2340-47ac-ac28-e7c06976334b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.350902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79079ebe-2340-47ac-ac28-e7c06976334b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.351409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79079ebe-2340-47ac-ac28-e7c06976334b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.371657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-9a8bd6cc-eac2-420d-b9da-70183d6088de tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:48:07.372376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-9a8bd6cc-eac2-420d-b9da-70183d6088de tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 27 20:48:07.372376 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-f30b5738-da18-4815-85a0-f2f9ecc3a07f'] Nov 27 20:48:07.372931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a8bd6cc-eac2-420d-b9da-70183d6088de tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 27 20:48:07.372931 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-f30b5738-da18-4815-85a0-f2f9ecc3a07f'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:07.373756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a8bd6cc-eac2-420d-b9da-70183d6088de tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/7f4e7ec0-7e33-427b-8344-0b0ef73794eb" status: 400 len: 182 microversion: 2.1 time: 0.157725 Nov 27 20:48:07.374467 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 413/837] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:48:07 2021] DELETE /compute/v2.1/os-security-groups/7f4e7ec0-7e33-427b-8344-0b0ef73794eb => generated 182 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:48:07.379320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0eed78f-81a0-4248-9456-242faf5d0b15 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:07.380346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0eed78f-81a0-4248-9456-242faf5d0b15 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:07.386889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0eed78f-81a0-4248-9456-242faf5d0b15 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.387627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0eed78f-81a0-4248-9456-242faf5d0b15 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.388169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0eed78f-81a0-4248-9456-242faf5d0b15 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.388611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0eed78f-81a0-4248-9456-242faf5d0b15 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.438669 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0eed78f-81a0-4248-9456-242faf5d0b15 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.063125 Nov 27 20:48:07.439328 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 414/838] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:07 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:07.444862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48430157-1226-4b39-8b50-88a3847843b0 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Calling method '.version_select at 0x7f15c7ddd550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.471524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-48430157-1226-4b39-8b50-88a3847843b0 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a5921b1-155f-4854-8775-c4060912819b does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:48:07.472185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-48430157-1226-4b39-8b50-88a3847843b0 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Neutron security group 5a5921b1-155f-4854-8775-c4060912819b not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:48:07.472765 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-48430157-1226-4b39-8b50-88a3847843b0 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] HTTP exception thrown: Security group 5a5921b1-155f-4854-8775-c4060912819b does not exist Nov 27 20:48:07.472765 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-e1f21193-3bfa-44e8-bff5-10ce2b2a9982'] Nov 27 20:48:07.473463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48430157-1226-4b39-8b50-88a3847843b0 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Returning 404 to user: Security group 5a5921b1-155f-4854-8775-c4060912819b does not exist Nov 27 20:48:07.473463 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-e1f21193-3bfa-44e8-bff5-10ce2b2a9982'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:07.474326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48430157-1226-4b39-8b50-88a3847843b0 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/5a5921b1-155f-4854-8775-c4060912819b" status: 404 len: 194 microversion: 2.1 time: 0.033416 Nov 27 20:48:07.480988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 415/839] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:48:07 2021] GET /compute/v2.1/os-security-groups/5a5921b1-155f-4854-8775-c4060912819b => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:07.492731 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79079ebe-2340-47ac-ac28-e7c06976334b tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9/action" status: 202 len: 0 microversion: 2.1 time: 0.165431 Nov 27 20:48:07.494269 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 425/840] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:07 2021] POST /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:48:07.495891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-739ebcc8-fa85-4b3c-a567-923c710af298 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Action: 'update', calling method: .version_select at 0x7f15c7d90820>, body: {"security_group": {"name": "tempest-sg-2008706476", "description": "tempest-description-1436417875"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:07.512490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a4c3b8b-8561-4c14-862e-066680a7a792 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.516286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a4c3b8b-8561-4c14-862e-066680a7a792 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:07.540831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a4c3b8b-8561-4c14-862e-066680a7a792 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.541466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a4c3b8b-8561-4c14-862e-066680a7a792 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.543115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a4c3b8b-8561-4c14-862e-066680a7a792 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.545518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a4c3b8b-8561-4c14-862e-066680a7a792 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.557489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-739ebcc8-fa85-4b3c-a567-923c710af298 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 77c699e1-2f76-464a-a2fd-f89d41f9ba68 does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:48:07.558804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-739ebcc8-fa85-4b3c-a567-923c710af298 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Neutron security group 77c699e1-2f76-464a-a2fd-f89d41f9ba68 not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:48:07.559392 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-739ebcc8-fa85-4b3c-a567-923c710af298 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] HTTP exception thrown: Security group 77c699e1-2f76-464a-a2fd-f89d41f9ba68 does not exist Nov 27 20:48:07.559392 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-0cb1f85a-feca-4cbf-b62d-8285834c330d'] Nov 27 20:48:07.560337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-739ebcc8-fa85-4b3c-a567-923c710af298 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] Returning 404 to user: Security group 77c699e1-2f76-464a-a2fd-f89d41f9ba68 does not exist Nov 27 20:48:07.560337 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-0cb1f85a-feca-4cbf-b62d-8285834c330d'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:07.561140 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-739ebcc8-fa85-4b3c-a567-923c710af298 tempest-SecurityGroupsNegativeTestJSON-1727030840 tempest-SecurityGroupsNegativeTestJSON-1727030840-project] 10.222.0.21 "PUT /compute/v2.1/os-security-groups/77c699e1-2f76-464a-a2fd-f89d41f9ba68" status: 404 len: 194 microversion: 2.1 time: 0.073268 Nov 27 20:48:07.569978 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 416/841] 10.222.0.21 () {60 vars in 1289 bytes} [Sat Nov 27 20:48:07 2021] PUT /compute/v2.1/os-security-groups/77c699e1-2f76-464a-a2fd-f89d41f9ba68 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:07.600153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.601050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:07.618299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.618780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.619991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.620438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.920167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:07.936644 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1de0602a-2384-4e60-8cdb-cb43be0f79be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.340281 Nov 27 20:48:07.947983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 417/842] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:07 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:07.954462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:07.955353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:07.964685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.965818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:07.966810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:07.967279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:08.021381 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a4c3b8b-8561-4c14-862e-066680a7a792 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1650 microversion: 2.1 time: 0.522649 Nov 27 20:48:08.021969 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 426/843] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:07 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1650 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:08.112461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:08.122786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:08.124329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:08.125450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-231b02be-3980-469f-9cdd-b4b2adc14bd8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1319 microversion: 2.25 time: 0.176412 Nov 27 20:48:08.126072 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 418/844] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:07 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:08.335930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:08.336539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:08.350867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:08.351341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:08.352199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:08.352641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:08.449957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea980c0b-7058-4cbd-b937-3b996eadd8b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:08.450901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ea980c0b-7058-4cbd-b937-3b996eadd8b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:08.460241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea980c0b-7058-4cbd-b937-3b996eadd8b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:08.460753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea980c0b-7058-4cbd-b937-3b996eadd8b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:08.461576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea980c0b-7058-4cbd-b937-3b996eadd8b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:08.461975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea980c0b-7058-4cbd-b937-3b996eadd8b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:08.524522 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea980c0b-7058-4cbd-b937-3b996eadd8b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.077672 Nov 27 20:48:08.525777 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 419/845] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:08 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:48:08.867278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:08.879630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b6f4c0e-3062-4894-8261-af8faaea64d5 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1470 microversion: 2.1 time: 0.547196 Nov 27 20:48:08.891932 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 427/846] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:08 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1470 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:08.962184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:08.964141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:08.976785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:08.977519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:08.978739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:08.979406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:09.038837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d362db74-db44-4ab8-9a21-5e76834809f8 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:09.039476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d362db74-db44-4ab8-9a21-5e76834809f8 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:09.045422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d362db74-db44-4ab8-9a21-5e76834809f8 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:09.047976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d362db74-db44-4ab8-9a21-5e76834809f8 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:09.048603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d362db74-db44-4ab8-9a21-5e76834809f8 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:09.049515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d362db74-db44-4ab8-9a21-5e76834809f8 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:09.555154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:09.563781 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b655581-4aa3-4ffd-9b72-0020b2db2e33 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.610053 Nov 27 20:48:09.564883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 420/847] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:08 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:09.594825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:09.603646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:09.627752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:09.628619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:09.633524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:09.634464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:09.911965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:09.919741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:09.921645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:09.928652 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43f7be76-cfc5-47be-a74c-cb3053ba185c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.356538 Nov 27 20:48:09.929489 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 421/848] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:09 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:09.937796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7059f3b7-7bc8-4509-b2b1-c6d4ab33d9c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:09.938733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7059f3b7-7bc8-4509-b2b1-c6d4ab33d9c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:09.957311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7059f3b7-7bc8-4509-b2b1-c6d4ab33d9c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:09.958049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7059f3b7-7bc8-4509-b2b1-c6d4ab33d9c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:09.959734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7059f3b7-7bc8-4509-b2b1-c6d4ab33d9c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:09.960478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7059f3b7-7bc8-4509-b2b1-c6d4ab33d9c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.009633 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7059f3b7-7bc8-4509-b2b1-c6d4ab33d9c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.078896 Nov 27 20:48:10.010307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 422/849] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:09 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:10.019426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-6997e767-823e-498d-968b-f6673a70ea11 req-90ee912e-7c94-4cd2-8d0a-e50b87e5afce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32c10d2-9032-4865-b174-8e5c54748d97", "name": "network-vif-deleted", "tag": "61486de3-700a-473b-8c7d-f6d50698c8b0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:10.021710 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:10.021710 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:10.038952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6997e767-823e-498d-968b-f6673a70ea11 req-90ee912e-7c94-4cd2-8d0a-e50b87e5afce service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.044085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6997e767-823e-498d-968b-f6673a70ea11 req-90ee912e-7c94-4cd2-8d0a-e50b87e5afce service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.077242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-6997e767-823e-498d-968b-f6673a70ea11 req-90ee912e-7c94-4cd2-8d0a-e50b87e5afce service nova] Creating event network-vif-deleted:61486de3-700a-473b-8c7d-f6d50698c8b0 for instance d32c10d2-9032-4865-b174-8e5c54748d97 on nch1-master-1 Nov 27 20:48:10.088719 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-6997e767-823e-498d-968b-f6673a70ea11 req-90ee912e-7c94-4cd2-8d0a-e50b87e5afce service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076870 Nov 27 20:48:10.094871 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 423/850] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:10.098152 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d362db74-db44-4ab8-9a21-5e76834809f8 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1630 microversion: 2.1 time: 1.063165 Nov 27 20:48:10.102060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:10.102998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:10.115001 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 428/851] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:09 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1630 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:10.121816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.122706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.129624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:10.131223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.132010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.140694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:10.163687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.164491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.167348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.168016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.235428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.237366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.238039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lazy-loading 'fault' on Instance uuid d32c10d2-9032-4865-b174-8e5c54748d97 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:48:10.241085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lazy-loading 'flavor' on Instance uuid 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:48:10.295598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Going to try to live migrate instance to nch2-master-1 {{(pid=135680) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:48:10.350463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:10.374850 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ed654f7-46f8-47dd-8e66-18a632ef7c50 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 200 len: 1304 microversion: 2.1 time: 0.273983 Nov 27 20:48:10.375488 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 424/852] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:10 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 1304 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:10.581978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:10.583055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:10.599798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.600256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.606376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.606838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.902886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:10.910553 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96ec63d9-c055-4a55-a431-5993a76ea434 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1476 microversion: 2.1 time: 0.332851 Nov 27 20:48:10.920263 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 425/853] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:10 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:10.946228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:10.947057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:10.957060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.957592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:10.958452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:10.958880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:11.484723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:11.505118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:11.507617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:11.508979 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47e9a7f9-d14e-46fb-ac87-0b638164c0a2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.566459 Nov 27 20:48:11.510020 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 426/854] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:10 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:48:11.518298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23c9acce-b282-4a0c-94ec-066de294c4a4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:11.520885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23c9acce-b282-4a0c-94ec-066de294c4a4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:11.536598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23c9acce-b282-4a0c-94ec-066de294c4a4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:11.537263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23c9acce-b282-4a0c-94ec-066de294c4a4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:11.538224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23c9acce-b282-4a0c-94ec-066de294c4a4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:11.538817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23c9acce-b282-4a0c-94ec-066de294c4a4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:11.620752 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23c9acce-b282-4a0c-94ec-066de294c4a4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.109310 Nov 27 20:48:11.622191 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 427/855] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:11 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:11.632584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:11.633538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: d32c10d2-9032-4865-b174-8e5c54748d97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:11.652899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:11.653607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:11.657096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:11.657345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:11.674543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] HTTP exception thrown: Instance d32c10d2-9032-4865-b174-8e5c54748d97 could not be found. Nov 27 20:48:11.675549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Returning 404 to user: Instance d32c10d2-9032-4865-b174-8e5c54748d97 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:11.676597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-26200634-9770-4a2a-a827-02ac5fc3c362 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97" status: 404 len: 111 microversion: 2.1 time: 0.053127 Nov 27 20:48:11.680623 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 428/856] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:11 2021] GET /compute/v2.1/servers/d32c10d2-9032-4865-b174-8e5c54748d97 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:11.686864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:11.687578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:11.707272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:11.707959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:11.708925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:11.711040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:11.803096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:48:11.974620 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bce90bf8-a790-4db8-aefd-3bfcfc74bbb8 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "DELETE /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 204 len: 0 microversion: 2.1 time: 0.292363 Nov 27 20:48:11.978909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 429/857] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:48:11 2021] DELETE /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:48:11.985946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:11.986711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:12.005214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:12.007789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:12.008838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:12.011556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:12.452879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:12.462245 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da5cd52b-823b-4caf-aa3e-040181e293e0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1475 microversion: 2.1 time: 0.485176 Nov 27 20:48:12.466264 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 430/858] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:11 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1475 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:12.473160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:12.481203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:12.493644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:12.496869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:12.499544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:12.504910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:12.887191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:12.897739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-01fa62f3-1500-45ee-bfaa-df4d32afa4f9 tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1469 microversion: 2.1 time: 0.428029 Nov 27 20:48:12.898268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 431/859] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:12 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1469 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:12.902937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-047f18a6-cdc4-4371-b68e-c3ae3f435dd2 req-f3c9ccfb-68c0-4087-88c2-751efeaed0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be38ef7-cbe4-41c9-8180-148457627022", "tag": "f6b877dc-2544-4729-b562-12b62148f13d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:12.904523 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:12.904523 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:12.931232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-047f18a6-cdc4-4371-b68e-c3ae3f435dd2 req-f3c9ccfb-68c0-4087-88c2-751efeaed0f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:12.931977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-047f18a6-cdc4-4371-b68e-c3ae3f435dd2 req-f3c9ccfb-68c0-4087-88c2-751efeaed0f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:12.950537 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-047f18a6-cdc4-4371-b68e-c3ae3f435dd2 req-f3c9ccfb-68c0-4087-88c2-751efeaed0f8 service nova] Creating event network-changed:f6b877dc-2544-4729-b562-12b62148f13d for instance 5be38ef7-cbe4-41c9-8180-148457627022 on nch2-master-1 Nov 27 20:48:12.960691 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-047f18a6-cdc4-4371-b68e-c3ae3f435dd2 req-f3c9ccfb-68c0-4087-88c2-751efeaed0f8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060790 Nov 27 20:48:12.962214 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 432/860] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:12.977868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:12.978833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:12.990801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:12.995034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:12.996139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:12.996743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:13.356090 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6c28540-373b-4875-969e-d766f9b80af5 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9/action" status: 202 len: 0 microversion: 2.1 time: 3.237868 Nov 27 20:48:13.357046 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 429/861] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:10 2021] POST /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9/action => generated 0 bytes in 3241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:48:13.364271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26e8aa5e-af3f-42f8-9e7d-fbb3a60fa5fd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:13.365675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26e8aa5e-af3f-42f8-9e7d-fbb3a60fa5fd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:13.395721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26e8aa5e-af3f-42f8-9e7d-fbb3a60fa5fd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:13.401871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26e8aa5e-af3f-42f8-9e7d-fbb3a60fa5fd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:13.407005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26e8aa5e-af3f-42f8-9e7d-fbb3a60fa5fd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:13.407732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26e8aa5e-af3f-42f8-9e7d-fbb3a60fa5fd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:13.449360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:13.458122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:13.462206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:13.463656 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9eb8d77-e1f5-47e9-886e-7a9d3e5b1073 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.500063 Nov 27 20:48:13.464779 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 433/862] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:12 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:13.469801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:13.471038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:13.477171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:13.477918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:13.478954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:13.479635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:13.529246 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26e8aa5e-af3f-42f8-9e7d-fbb3a60fa5fd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.170919 Nov 27 20:48:13.558215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 430/863] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:13 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:13.582000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:13.584119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:13.594547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:13.595284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:13.596968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:13.597568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:13.865570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:13.882532 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05d9fdc3-5de0-4bec-b99f-7e5d01f11bf0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.416441 Nov 27 20:48:13.885359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 434/864] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:13 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:14.093756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-539822771", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "325efdd2-0df2-4453-9d05-e00eab372342"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:14.199579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] validate_networks() for [('325efdd2-0df2-4453-9d05-e00eab372342', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:14.641498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:14.654291 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a72a771a-73bc-427e-8b6d-e3e52c553b4e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1473 microversion: 2.1 time: 1.094100 Nov 27 20:48:14.654784 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 431/865] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:13 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1473 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:14.667323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:14.674059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:14.717962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:14.732090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:14.736919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:14.743100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.029964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a069b7aa4c94607943e3493c6295fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:15.042998 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a615e5b0-8a7d-476e-9676-83c1cf9c80ca tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 200 len: 1298 microversion: 2.1 time: 0.376214 Nov 27 20:48:15.044061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 432/866] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:14 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 1298 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:15.056021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:15.059114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:15.082313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.082769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.083608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.084043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.219198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:15.220291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:15.220945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:15.221679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:15.222480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:15.240624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.241409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.242607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.246324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.284744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Getting quotas for project 72659aa0252c4e7491effb8522dd5a1c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:15.296777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Getting quotas for user bb85b086594c4389b15420a56941c229 and project 72659aa0252c4e7491effb8522dd5a1c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:15.315470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:15.318574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:15.405001 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e545e16-3f2d-4777-af84-5da45ba193f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513863 Nov 27 20:48:15.412250 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 435/867] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:15.419359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ee9f9dc-b033-4e84-977e-515f811692f8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:15.420524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ee9f9dc-b033-4e84-977e-515f811692f8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:15.430228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ee9f9dc-b033-4e84-977e-515f811692f8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.430919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ee9f9dc-b033-4e84-977e-515f811692f8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.432246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ee9f9dc-b033-4e84-977e-515f811692f8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.433387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ee9f9dc-b033-4e84-977e-515f811692f8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.542628 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ee9f9dc-b033-4e84-977e-515f811692f8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.128596 Nov 27 20:48:15.543878 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 436/868] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:15 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:15.557439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3c28630c-bae7-417d-b0b2-ae19dabd752c req-aee7c477-a197-409d-a5a5-805a4210995a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c2ea24-9d6c-4f22-a5f2-b77f798cfc77", "name": "network-vif-deleted", "tag": "41eff457-e562-48bc-bb0b-6db9a9bacf92"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:15.560423 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:15.560423 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:15.583082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3c28630c-bae7-417d-b0b2-ae19dabd752c req-aee7c477-a197-409d-a5a5-805a4210995a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.583954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3c28630c-bae7-417d-b0b2-ae19dabd752c req-aee7c477-a197-409d-a5a5-805a4210995a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.622593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3c28630c-bae7-417d-b0b2-ae19dabd752c req-aee7c477-a197-409d-a5a5-805a4210995a service nova] Creating event network-vif-deleted:41eff457-e562-48bc-bb0b-6db9a9bacf92 for instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 on nch2-master-1 Nov 27 20:48:15.639148 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3c28630c-bae7-417d-b0b2-ae19dabd752c req-aee7c477-a197-409d-a5a5-805a4210995a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093261 Nov 27 20:48:15.644903 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 437/869] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:15.685470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:15.695320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:15.735494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.741327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:15.742777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:15.743510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:16.067225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:16.091549 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-654b772d-6133-47da-88b8-936fdc912837 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.443429 Nov 27 20:48:16.111419 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 438/870] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:15 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:16.133046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1099892893", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "325efdd2-0df2-4453-9d05-e00eab372342"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:16.281731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:16.292865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:16.294372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:16.295519 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-088d25e4-832a-46a1-8ea6-844e767eac67 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 1.248289 Nov 27 20:48:16.303079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] validate_networks() for [('325efdd2-0df2-4453-9d05-e00eab372342', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:16.315699 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 433/871] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:15 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:16.324089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:16.324702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:16.352061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:16.352509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:16.353303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:16.353735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:16.887126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:16.895285 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81c26743-7a54-43e0-a448-3a4e0ec32e83 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1470 microversion: 2.1 time: 0.578371 Nov 27 20:48:16.912939 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 434/872] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:16 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1470 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:16.922600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:16.927089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] [instance: 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:16.946886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:16.947455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:16.955895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:16.956338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:17.028799 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] HTTP exception thrown: Instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 could not be found. Nov 27 20:48:17.029138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] Returning 404 to user: Instance 05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:48:17.030110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e84044e1-0699-469a-bc9c-807c3d1a804d tempest-ServersAdminTestJSON-295645475 tempest-ServersAdminTestJSON-295645475-project] 10.222.0.21 "GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77" status: 404 len: 111 microversion: 2.1 time: 0.116088 Nov 27 20:48:17.037659 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 435/873] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:16 2021] GET /compute/v2.1/servers/05c2ea24-9d6c-4f22-a5f2-b77f798cfc77 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:17.058774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f09d396-44be-4e3a-a547-cfcd70f7ade4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:17.061138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f09d396-44be-4e3a-a547-cfcd70f7ade4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:17.072409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f09d396-44be-4e3a-a547-cfcd70f7ade4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:17.073345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f09d396-44be-4e3a-a547-cfcd70f7ade4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:17.084034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f09d396-44be-4e3a-a547-cfcd70f7ade4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:17.084394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f09d396-44be-4e3a-a547-cfcd70f7ade4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:17.172659 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f09d396-44be-4e3a-a547-cfcd70f7ade4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.133578 Nov 27 20:48:17.175440 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 436/874] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:17 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:17.204175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9735c6a-12e3-4588-a1e4-1201f8429940 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:17.211419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9735c6a-12e3-4588-a1e4-1201f8429940 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:17.240535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9735c6a-12e3-4588-a1e4-1201f8429940 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:17.242387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9735c6a-12e3-4588-a1e4-1201f8429940 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:17.247154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9735c6a-12e3-4588-a1e4-1201f8429940 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:17.248569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9735c6a-12e3-4588-a1e4-1201f8429940 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:17.421852 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9735c6a-12e3-4588-a1e4-1201f8429940 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24/action" status: 204 len: 0 microversion: 2.1 time: 0.242988 Nov 27 20:48:17.428193 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 437/875] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:17 2021] POST /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24/action => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:48:17.442551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e5a165f3-0583-4dd6-a8c6-6f4126b5187f req-2fdf3677-d533-4a09-80ca-3c7890bd3953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81016c57-65b3-485d-bcfa-990f3b12fd24", "name": "network-vif-unplugged", "status": "completed", "tag": "75279561-8c7c-4017-8974-2a5bc6d0661c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:17.446877 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:17.446877 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:17.465653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e5a165f3-0583-4dd6-a8c6-6f4126b5187f req-2fdf3677-d533-4a09-80ca-3c7890bd3953 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:17.466009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e5a165f3-0583-4dd6-a8c6-6f4126b5187f req-2fdf3677-d533-4a09-80ca-3c7890bd3953 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:17.496616 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e5a165f3-0583-4dd6-a8c6-6f4126b5187f req-2fdf3677-d533-4a09-80ca-3c7890bd3953 service nova] Creating event network-vif-unplugged:75279561-8c7c-4017-8974-2a5bc6d0661c for instance 81016c57-65b3-485d-bcfa-990f3b12fd24 on nch1-master-1 Nov 27 20:48:17.512150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-e5a165f3-0583-4dd6-a8c6-6f4126b5187f req-2fdf3677-d533-4a09-80ca-3c7890bd3953 service nova] Instance 81016c57-65b3-485d-bcfa-990f3b12fd24 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:48:17.529199 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e5a165f3-0583-4dd6-a8c6-6f4126b5187f req-2fdf3677-d533-4a09-80ca-3c7890bd3953 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096889 Nov 27 20:48:17.530079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 438/876] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:17.539279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:17.542261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:17.559386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:17.560144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:17.561555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:17.562434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:18.005235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:18.006259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:18.007931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:18.008593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:18.018856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:18.075702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:18.084133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:18.090270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:18.095909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:18.250119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Getting quotas for project 72659aa0252c4e7491effb8522dd5a1c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:18.282811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:18.295324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Getting quotas for user bb85b086594c4389b15420a56941c229 and project 72659aa0252c4e7491effb8522dd5a1c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:18.296037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08999d27-9d4e-4c6f-9cbd-f4bb6965ce3e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.764074 Nov 27 20:48:18.305541 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 439/877] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:17 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:18.325968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:18.327343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:18.347537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:18.349143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:18.352647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:18.353318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:18.377094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:18.390953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:18.578260 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc447d90-5719-4e72-84b0-081bc681a4aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.465628 Nov 27 20:48:18.579302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 439/878] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 2467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:18.600020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:18.600659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:18.649706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:18.650174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:18.651004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:18.651478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:19.227745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:19.243451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:19.248937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:19.253227 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb95d02b-9297-41ad-aff3-7bedb2ac9234 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.944539 Nov 27 20:48:19.255121 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 440/879] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:18 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:19.268930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7c7af546-6d7d-4ade-a521-1f9521d63c08 req-659065df-828a-4899-b766-d13bd56a4cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4389e3d2-cc9e-40e6-8a2f-d59d54421ab9", "name": "network-vif-unplugged", "status": "completed", "tag": "b51ad6c9-008a-470c-b58c-4307b66fbeca"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:19.274711 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:19.274711 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:19.302662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7c7af546-6d7d-4ade-a521-1f9521d63c08 req-659065df-828a-4899-b766-d13bd56a4cd1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:19.304478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7c7af546-6d7d-4ade-a521-1f9521d63c08 req-659065df-828a-4899-b766-d13bd56a4cd1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:19.335766 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7c7af546-6d7d-4ade-a521-1f9521d63c08 req-659065df-828a-4899-b766-d13bd56a4cd1 service nova] Creating event network-vif-unplugged:b51ad6c9-008a-470c-b58c-4307b66fbeca for instance 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 on nch1-master-1 Nov 27 20:48:19.347207 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7c7af546-6d7d-4ade-a521-1f9521d63c08 req-659065df-828a-4899-b766-d13bd56a4cd1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088636 Nov 27 20:48:19.351048 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 441/880] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:19.373427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6506fdf1-75e2-49f6-b999-e38df7f2a653 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:19.376365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6506fdf1-75e2-49f6-b999-e38df7f2a653 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:19.397519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6506fdf1-75e2-49f6-b999-e38df7f2a653 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:19.399136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6506fdf1-75e2-49f6-b999-e38df7f2a653 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:19.400232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6506fdf1-75e2-49f6-b999-e38df7f2a653 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:19.402160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6506fdf1-75e2-49f6-b999-e38df7f2a653 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:19.500850 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6506fdf1-75e2-49f6-b999-e38df7f2a653 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.144827 Nov 27 20:48:19.502134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 442/881] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:19 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:19.520916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1104010118", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "451", "networks": [{"uuid": "325efdd2-0df2-4453-9d05-e00eab372342"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:19.631063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] validate_networks() for [('325efdd2-0df2-4453-9d05-e00eab372342', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:19.839322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:19.852270 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dd140a8d-cd4a-4c1d-b3d6-a5274f568363 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1470 microversion: 2.1 time: 1.264622 Nov 27 20:48:19.863139 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 440/882] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:18 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1470 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:19.868504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:19.869852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:19.881678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:19.882542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:19.884017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:19.884822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:20.366896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:20.386702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e684d02-f9e1-4f27-924f-14d13701ffde tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.521847 Nov 27 20:48:20.396832 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 441/883] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:19 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:20.405223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:20.405831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:20.452406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:20.455337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:20.460283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:20.461738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:20.647649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:20.660275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:20.662553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:20.668174 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f015cd1f-a1f3-47b3-ae01-bf093dc07862 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.269929 Nov 27 20:48:20.670523 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 442/884] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:20 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:20.691602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b336c61-fe37-4649-89df-4ad9c2e5c063 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:20.694230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b336c61-fe37-4649-89df-4ad9c2e5c063 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:20.709627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b336c61-fe37-4649-89df-4ad9c2e5c063 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:20.710513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b336c61-fe37-4649-89df-4ad9c2e5c063 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:20.711626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b336c61-fe37-4649-89df-4ad9c2e5c063 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:20.712276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b336c61-fe37-4649-89df-4ad9c2e5c063 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:20.801073 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b336c61-fe37-4649-89df-4ad9c2e5c063 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.128474 Nov 27 20:48:20.804725 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 443/885] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:20 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:20.873220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:20.875080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:20.895515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:20.897528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:20.901981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:20.903268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:21.267129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:21.277074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-08d7d598-f787-415c-9bb4-8f475b5a3b79 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1470 microversion: 2.1 time: 0.410766 Nov 27 20:48:21.278352 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 444/886] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:20 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:21.413973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:21.414614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:21.422263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:21.422719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:21.425213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:21.426672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:21.615909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:21.636730 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9194e306-22b5-45dc-9d30-3392a527b3e4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.226799 Nov 27 20:48:21.637880 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 445/887] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:21 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:21.756196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:21.756706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:21.757258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:21.758090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:21.759028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:21.774113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:21.780188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:21.781617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:21.782220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:21.803802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Getting quotas for project 72659aa0252c4e7491effb8522dd5a1c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:21.808988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Getting quotas for user bb85b086594c4389b15420a56941c229 and project 72659aa0252c4e7491effb8522dd5a1c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:21.824112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:21.827089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:21.966087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a60a0829-6a62-4eba-bdba-60ad631dcda3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.454943 Nov 27 20:48:21.968452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 443/888] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:21.971083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1891439634", "imageRef": "e9e94eab-f18a-4539-a280-01f038bc9fb2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9b43f6b5-8fe9-4060-8bba-ace1af710c22"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:21.980848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4faf1e20-dd3a-4fc2-a969-f2c28888d2d3 req-80bb5131-7bbf-48ae-b78e-38f509cb054e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4389e3d2-cc9e-40e6-8a2f-d59d54421ab9", "tag": "b51ad6c9-008a-470c-b58c-4307b66fbeca"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:21.983242 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:21.983242 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:21.993069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4faf1e20-dd3a-4fc2-a969-f2c28888d2d3 req-80bb5131-7bbf-48ae-b78e-38f509cb054e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:21.994108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4faf1e20-dd3a-4fc2-a969-f2c28888d2d3 req-80bb5131-7bbf-48ae-b78e-38f509cb054e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:22.017673 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4faf1e20-dd3a-4fc2-a969-f2c28888d2d3 req-80bb5131-7bbf-48ae-b78e-38f509cb054e service nova] Creating event network-changed:b51ad6c9-008a-470c-b58c-4307b66fbeca for instance 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 on nch1-master-1 Nov 27 20:48:22.024455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4faf1e20-dd3a-4fc2-a969-f2c28888d2d3 req-80bb5131-7bbf-48ae-b78e-38f509cb054e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051795 Nov 27 20:48:22.026043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 444/889] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:22.056545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:22.062002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:22.077464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:22.078448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:22.080246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:22.080911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:22.108029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] validate_networks() for [('9b43f6b5-8fe9-4060-8bba-ace1af710c22', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:23.192526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:23.205101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:23.206908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:23.208310 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e438a4da-f516-4717-ae93-9ea713891da7 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 1.180766 Nov 27 20:48:23.209108 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 445/890] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:22 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:23.215287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d58a8893-4c9b-4f6d-8c38-909ab17732cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:23.216989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d58a8893-4c9b-4f6d-8c38-909ab17732cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:23.224868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d58a8893-4c9b-4f6d-8c38-909ab17732cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.225711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d58a8893-4c9b-4f6d-8c38-909ab17732cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.227512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d58a8893-4c9b-4f6d-8c38-909ab17732cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.228217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d58a8893-4c9b-4f6d-8c38-909ab17732cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.231409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:23.232417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:23.233228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:23.233810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:23.234218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:23.250747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.251783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.252890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.254638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.279166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Getting quotas for project a6d0433d36494c339de083939adfa30d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:23.284278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Getting quotas for user 4230d9b8ef6540bfbc4f034885d418e8 and project a6d0433d36494c339de083939adfa30d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:23.296345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:23.298960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9e94eab-f18a-4539-a280-01f038bc9fb2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:23.300028 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d58a8893-4c9b-4f6d-8c38-909ab17732cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.089295 Nov 27 20:48:23.306995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 446/891] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:23 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:23.328356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:23.331549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:23.358964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.359996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-93a82997-b380-4081-b5ec-47550c1e1694 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720711 Nov 27 20:48:23.360147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.361280 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 446/892] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:23.366138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:23.367126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.367514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:23.367889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.376000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.377710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.378676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.379315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.655692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:23.670327 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17a33d42-9795-468e-ace9-1e4ade6980d6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1273 microversion: 2.1 time: 0.360583 Nov 27 20:48:23.670917 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 447/893] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:23 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1273 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:23.682880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6d1f892e-ff54-4d94-bae1-f4646984158c req-b04aa24f-0741-49cc-afa1-7a9955b92339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be38ef7-cbe4-41c9-8180-148457627022", "name": "network-vif-plugged", "status": "completed", "tag": "f6b877dc-2544-4729-b562-12b62148f13d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:23.685356 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:23.685356 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:23.695159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6d1f892e-ff54-4d94-bae1-f4646984158c req-b04aa24f-0741-49cc-afa1-7a9955b92339 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.707155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6d1f892e-ff54-4d94-bae1-f4646984158c req-b04aa24f-0741-49cc-afa1-7a9955b92339 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.728514 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6d1f892e-ff54-4d94-bae1-f4646984158c req-b04aa24f-0741-49cc-afa1-7a9955b92339 service nova] Creating event network-vif-plugged:f6b877dc-2544-4729-b562-12b62148f13d for instance 5be38ef7-cbe4-41c9-8180-148457627022 on nch2-master-1 Nov 27 20:48:23.741376 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6d1f892e-ff54-4d94-bae1-f4646984158c req-b04aa24f-0741-49cc-afa1-7a9955b92339 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064821 Nov 27 20:48:23.742638 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 448/894] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:23.765481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:23.768102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:23.781333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.782328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:23.784144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:23.785034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:24.127509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:24.140334 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4add9345-cba3-4a00-bf6b-b12ab818f5f3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1462 microversion: 2.1 time: 0.777789 Nov 27 20:48:24.141708 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 447/895] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:23 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1462 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:24.148116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3db49653-476f-4ff7-b932-ea36821fc014 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:24.149054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3db49653-476f-4ff7-b932-ea36821fc014 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:24.364713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3db49653-476f-4ff7-b932-ea36821fc014 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:24.382823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:24.387527 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3db49653-476f-4ff7-b932-ea36821fc014 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1222 microversion: 2.1 time: 0.243521 Nov 27 20:48:24.400451 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 448/896] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:24 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:24.417419 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba601d3b-a84a-477f-95f9-0f189a79a5fd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.672748 Nov 27 20:48:24.419563 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 449/897] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:23 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:24.440219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:24.444687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:24.462265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:24.465469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:24.468887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:24.470524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:24.617593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-729675845", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:24.698354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:25.327705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:25.342296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:25.342786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:25.343303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:25.343716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:25.344696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:25.349299 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3af3514a-dd93-481a-985c-abdc0d332abb tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1462 microversion: 2.1 time: 0.926281 Nov 27 20:48:25.349679 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 450/898] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:24 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1462 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:25.357721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:25.358632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:25.365453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:25.366741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:25.367784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:25.368534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:25.371692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:25.374215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:25.375134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:25.378368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:25.417736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:25.421876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:25.440644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:25.443290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:25.510551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-37a70997-b299-4c34-9461-0dad54f51e53 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106421 Nov 27 20:48:25.517120 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 449/899] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:25.525180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68bccebf-1de0-4a16-9351-2e0d5b3d07ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:25.526573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68bccebf-1de0-4a16-9351-2e0d5b3d07ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:25.536343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68bccebf-1de0-4a16-9351-2e0d5b3d07ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:25.537026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68bccebf-1de0-4a16-9351-2e0d5b3d07ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:25.550446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68bccebf-1de0-4a16-9351-2e0d5b3d07ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:25.551188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68bccebf-1de0-4a16-9351-2e0d5b3d07ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:26.005673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:26.024659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:26.034220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:26.037016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7fc9fcfe-d1ed-4815-a245-45d0573c8ba4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.685620 Nov 27 20:48:26.044544 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 451/900] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:25 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:26.061721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:26.064887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:26.090352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:26.091236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:26.092241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:26.092859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:26.726425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:26.739475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1fdd0ac-3f36-427d-a7c0-09a0e8d52eaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.691283 Nov 27 20:48:26.741533 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 452/901] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:26 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:26.749699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5efd6c61-a394-462f-8bd0-49482a49f973 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '.version_select at 0x7f15c7c02820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:26.761517 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:26.761517 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:26.764087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5efd6c61-a394-462f-8bd0-49482a49f973 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:26.765550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5efd6c61-a394-462f-8bd0-49482a49f973 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:26.810912 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5efd6c61-a394-462f-8bd0-49482a49f973 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.066403 Nov 27 20:48:26.811909 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 453/902] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:48:26 2021] GET /compute/v2.1/os-migrations => generated 2336 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:26.816726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:26.818747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:26.853140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:26.853882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:26.854851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:26.855489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.292300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:27.309451 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15f0f03d-a574-4087-b97e-ca6eb0fa84dd tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.495867 Nov 27 20:48:27.320006 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 454/903] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:26 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:27.337204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:27.340603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:27.363536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.363990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.365391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.365842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.604512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:27.613841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-32d96702-1824-4444-98b3-fb87d72ab9d3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.296856 Nov 27 20:48:27.614775 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 455/904] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:27 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:27.619945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:27.620829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:27.628486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.629406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.630417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.631080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.729667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:27.738046 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b17db27-2097-40c7-8896-f1eb0c4d8245 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1220 microversion: 2.1 time: 0.121875 Nov 27 20:48:27.738636 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 456/905] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:27 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1220 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:27.744465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a6ee5413-0239-433b-86b1-e31e52a515e3 req-670b77a2-c30e-4c63-8de9-8763584325ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81016c57-65b3-485d-bcfa-990f3b12fd24", "name": "network-vif-plugged", "status": "completed", "tag": "75279561-8c7c-4017-8974-2a5bc6d0661c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:27.746288 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:27.746288 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:27.754458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a6ee5413-0239-433b-86b1-e31e52a515e3 req-670b77a2-c30e-4c63-8de9-8763584325ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.755139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a6ee5413-0239-433b-86b1-e31e52a515e3 req-670b77a2-c30e-4c63-8de9-8763584325ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.768418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a6ee5413-0239-433b-86b1-e31e52a515e3 req-670b77a2-c30e-4c63-8de9-8763584325ab service nova] Creating event network-vif-plugged:75279561-8c7c-4017-8974-2a5bc6d0661c for instance 81016c57-65b3-485d-bcfa-990f3b12fd24 on nch1-master-1 Nov 27 20:48:27.774361 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a6ee5413-0239-433b-86b1-e31e52a515e3 req-670b77a2-c30e-4c63-8de9-8763584325ab service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034116 Nov 27 20:48:27.775050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 457/906] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:27.782845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1c9ffe66-878b-4b88-9983-d8c9e17c1893 req-bd878ff2-2c15-4fd3-9278-8f9becc963cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aa58d27-298b-455d-8185-f926aa730620", "tag": "b3fdcccc-7383-40d8-8be2-9440dff6baff"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:27.784460 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:27.784460 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:27.791905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1c9ffe66-878b-4b88-9983-d8c9e17c1893 req-bd878ff2-2c15-4fd3-9278-8f9becc963cd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.792348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1c9ffe66-878b-4b88-9983-d8c9e17c1893 req-bd878ff2-2c15-4fd3-9278-8f9becc963cd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.805582 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1c9ffe66-878b-4b88-9983-d8c9e17c1893 req-bd878ff2-2c15-4fd3-9278-8f9becc963cd service nova] Creating event network-changed:b3fdcccc-7383-40d8-8be2-9440dff6baff for instance 5aa58d27-298b-455d-8185-f926aa730620 on nch2-master-1 Nov 27 20:48:27.810471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1c9ffe66-878b-4b88-9983-d8c9e17c1893 req-bd878ff2-2c15-4fd3-9278-8f9becc963cd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033616 Nov 27 20:48:27.811071 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 458/907] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:27.817037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4de0e0a9-4abc-4998-8af0-555a81804fdb tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:27.823929 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4de0e0a9-4abc-4998-8af0-555a81804fdb tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011388 Nov 27 20:48:27.824469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 459/908] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:48:27 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:27.832226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:27.832946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:27.841208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.841660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.842469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:27.842900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:27.994365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:28.003952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:28.005476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:28.006604 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-308b8dea-6584-4d37-9083-9a0baeb75a61 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.178288 Nov 27 20:48:28.007148 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 460/909] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:27 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:28.021615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:28.022410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:28.028693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:28.029401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:28.030351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:28.030939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:28.300780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:28.309383 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f3dcbd8e-bb85-4ddd-b641-068f9ad38f9a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.290570 Nov 27 20:48:28.310066 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 461/910] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:28 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:28.345117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97b09bac-4dac-4862-8ab4-c11815a2d355 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1329446751", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:28.347623 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:28.347623 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:28.383742 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97b09bac-4dac-4862-8ab4-c11815a2d355 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.072096 Nov 27 20:48:28.385236 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 462/911] 10.222.0.21 () {60 vars in 1145 bytes} [Sat Nov 27 20:48:28 2021] POST /compute/v2.1/flavors => generated 499 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:28.390212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:28.391058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:28.401480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:28.402087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:28.402985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:28.403554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:28.674117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:28.693749 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7b9cac2d-46f3-443b-9aa0-6a04a0b4af61 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.306841 Nov 27 20:48:28.695177 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 463/912] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:28 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:28.709251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-776bf59b-f6f6-4929-b8c6-4dd9e9f379da tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:28.723297 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-776bf59b-f6f6-4929-b8c6-4dd9e9f379da tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023510 Nov 27 20:48:28.724084 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 464/913] 10.222.0.21 () {58 vars in 1181 bytes} [Sat Nov 27 20:48:28 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:48:28.728981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:28.729591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:28.758718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:28.762628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:28.763551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:28.767480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:29.146564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:29.154529 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1aa8f5eb-5f09-446a-aa6d-b44d1a04290a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.429417 Nov 27 20:48:29.155716 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 465/914] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:28 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:29.178632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:29.179239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:29.188902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:29.189693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:29.191935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:29.192761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:29.356356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:29.377040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30c7340a-1747-4157-b884-e7bdcddf39bc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1220 microversion: 2.1 time: 0.218939 Nov 27 20:48:29.380692 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 466/915] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:29 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1220 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:29.390570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1375019298", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "44c36477-c127-4ecd-99d6-3a9a800a053f"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:29.507644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:30.057259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:30.058126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:30.059063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:30.063180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:30.064416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:30.105359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:30.106092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:30.107129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:30.107780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:30.139349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:30.147423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for user 3cb6bc63929648388ac9648823d4ca88 and project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:30.181569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:30.188162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:30.258470 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed688067-0b18-4182-ae87-42a3a6cfd8f8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875990 Nov 27 20:48:30.260088 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 467/916] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:30.265420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:30.266354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:30.274302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:30.275056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:30.276138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:30.276884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:30.872717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:30.886518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:30.889563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:30.891234 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f2dbaa8f-cf11-4492-9a23-9cbb15853c24 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.629673 Nov 27 20:48:30.892451 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 468/917] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:30 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:30.906337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:30.910613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:30.925231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:30.928527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:30.929603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:30.930253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.231790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:31.239877 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-789e2171-1a8e-4797-b4c1-a216e265ae49 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.346228 Nov 27 20:48:31.240466 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 469/918] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:30 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:31.245947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:31.246766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:31.257447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.257903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.258708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.259147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.459094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:31.468937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5016bf90-99d5-4368-aa3e-7340df7a2234 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.226297 Nov 27 20:48:31.470782 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 470/919] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:31 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:31.478791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:31.479755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:31.490656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.491108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.491940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.492379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.629636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:31.645812 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-243c8f60-c7b1-4b49-bb7d-95db3fec8a22 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.173700 Nov 27 20:48:31.655342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 471/920] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:31 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:31.655342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:31.655342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:31.658995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.659490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.660298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.660737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.737458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:31.746300 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cdc782e4-4fc0-49f7-9e3b-e1b90ab4fb56 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1283 microversion: 2.1 time: 0.098860 Nov 27 20:48:31.747280 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 472/921] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:31 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:31.752841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:31.753632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:31.759743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.760197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.760996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:31.761431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:31.825220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:31.835621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e07e4209-1392-4c68-9ac7-b1a19b33a8f9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1220 microversion: 2.1 time: 0.087079 Nov 27 20:48:31.843321 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 473/922] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:31 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:31.899996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1217430319", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "60e77827-dbf6-4642-b5e9-3d8f4c2fcaa9"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:31.953161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] validate_networks() for [('60e77827-dbf6-4642-b5e9-3d8f4c2fcaa9', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:32.623365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:32.623866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:32.624416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:32.624899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:32.625381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:32.637695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:32.638540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:32.639483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:32.639998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:32.668651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Getting quotas for project e11cec7060094963bccef4d0cadba71d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:32.674577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Getting quotas for user 367987f33e48490a94602847ed0881e7 and project e11cec7060094963bccef4d0cadba71d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:32.689321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:32.691423 ncdv-master-1 devstack@n-api.service[135680]: WARNING nova.utils [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1217430319 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-121743031 Nov 27 20:48:32.692405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:32.739894 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca95996b-2bef-478d-9fd3-b3de57cce2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900975 Nov 27 20:48:32.741001 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 474/923] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:32.746310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:32.747141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:32.754900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:32.755579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:32.756488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:32.760257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:32.925979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:32.936407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:32.941605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:32.942274 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3baed1a-9016-4554-a36b-ee919c10ee3b tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.200218 Nov 27 20:48:32.945660 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 475/924] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:32 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:32.956079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:32.958210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:32.977886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:32.978517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:32.979404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:32.980377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:33.336419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:33.345874 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97e8a24f-b879-4e71-9f76-b4cd04e6f50d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.399173 Nov 27 20:48:33.347101 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 476/925] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:32 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:33.351434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:33.352041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:33.358705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:33.359399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:33.361113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:33.361556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:33.625286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:33.635948 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1fae3493-9bf1-41b4-930c-cc39c27bf0ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.287696 Nov 27 20:48:33.645432 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 477/926] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:33 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:33.645432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:33.645432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:33.650407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:33.650785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:33.651613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:33.652231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:33.909887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:33.917653 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73f1c2b8-8af4-4bcc-9a7a-68bd158c0195 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.279447 Nov 27 20:48:33.930597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 478/927] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:33 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:33.947586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:33.951461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:33.963849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:33.964581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:33.967168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:33.967851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.080894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.089330 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb4dbe36-8924-4329-9c4b-c22a43692075 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1236 microversion: 2.1 time: 0.157540 Nov 27 20:48:34.100083 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 479/928] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:33 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1236 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:34.104169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:34.104782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:34.112897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.113347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.114125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.114573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.192368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.200768 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ab1e146-a3d7-4c6a-8462-d9e1abeb0362 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1283 microversion: 2.1 time: 0.099694 Nov 27 20:48:34.201480 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 480/929] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:34 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1283 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:34.205485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:34.206084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:34.216264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.216638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.217435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.217871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.282479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.295769 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-337034cd-bb44-4406-8a12-e6dc52c0e6f2 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1220 microversion: 2.1 time: 0.093600 Nov 27 20:48:34.306493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 481/930] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:34 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:34.306493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:34.306493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:34.308226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.308809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.309607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.310042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.466405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.476904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.478740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.479921 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60eabfb1-11be-4472-b6f5-afb88a440148 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.182623 Nov 27 20:48:34.480486 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 482/931] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:34 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:34.485657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:34.486230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:34.502727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.503181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.504024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.504453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.666732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.674923 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5bcb577f-8561-4285-a4c1-792d41d23a73 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.193374 Nov 27 20:48:34.675772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 483/932] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:34 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:34.687340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:34.688302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:34.694968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.695443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.696244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.696677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.853633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:34.862569 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd7d75fe-e5bb-4659-b007-62faa0c05800 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.179602 Nov 27 20:48:34.863372 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 484/933] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:34 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:34.935743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:34.937444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:34.944019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.944636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:34.945462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:34.945971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.100704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.114235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d85dab5-dafd-429c-964c-43e88946bbf3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.181861 Nov 27 20:48:35.115032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 485/934] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:34 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:35.119960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:35.120667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:35.131025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.131741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.132628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.133291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.205010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.215222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e3e98d9-3448-4c4c-8622-810878b77614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1236 microversion: 2.1 time: 0.098894 Nov 27 20:48:35.215938 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 486/935] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:35 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:35.229761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:35.230247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:35.239279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.242217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.243308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.244445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.310823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.318920 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d233bb65-f281-4964-a182-a6afb82f7577 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1283 microversion: 2.1 time: 0.092970 Nov 27 20:48:35.328379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 487/936] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:35 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:35.333591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:35.334205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:35.340793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.341005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.342163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.342163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.420442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.428900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf2b896c-6812-49c7-abf6-4cc805b167e1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1220 microversion: 2.1 time: 0.098788 Nov 27 20:48:35.429680 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 488/937] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:35 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:35.499961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:35.500690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:35.508342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.508926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.509845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.510635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.649747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.658294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.659840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.660946 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df5f5127-de3b-499f-955f-16e238021af2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.165135 Nov 27 20:48:35.661514 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 489/938] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:35 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:48:35.692405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:35.693015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:35.699157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.699663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.700447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.700882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.840579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:35.864236 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-076b6c2a-69c0-4d36-b6da-a31ca4091457 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.175647 Nov 27 20:48:35.865097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 490/939] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:35 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:35.884438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:35.885412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:35.892282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.893036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:35.894043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:35.894681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.032601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.040868 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f8dd6f8-a3bb-4e44-83a7-dd0605cae19c tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.160054 Nov 27 20:48:36.041614 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 491/940] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:35 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:36.132510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:36.133407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:36.160650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.161863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.162762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.163501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.184008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68bccebf-1de0-4a16-9351-2e0d5b3d07ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 10.665259 Nov 27 20:48:36.185373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 450/941] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:25 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 10667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:36.233384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:36.234363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:36.243011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.243896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.244798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.245339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.316163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.327004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0111c10-daf1-45ee-a68f-856073c26d2d tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1236 microversion: 2.1 time: 0.098336 Nov 27 20:48:36.331097 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 451/942] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:36 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:36.336673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:36.337445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:36.343864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.345073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.346038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.346472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.415628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.423533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-551f7e95-69f4-4f17-8a7b-cb59cd914d16 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1283 microversion: 2.1 time: 0.090904 Nov 27 20:48:36.429791 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 452/943] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:36 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:36.445772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:36.446665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:36.453417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.454397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.455280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.455794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.526603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.538916 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f18253c1-cac3-4fad-9833-e4650537371e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1220 microversion: 2.1 time: 0.095999 Nov 27 20:48:36.539261 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 453/944] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:36 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:36.590864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.600204 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f92385e4-0453-4615-aa1d-786cb5ff545f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.471755 Nov 27 20:48:36.600965 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 492/945] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:36 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:36.678876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:36.679540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:36.685583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.686041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.687009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.687762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.837166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.847190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.848762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:36.850684 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7ebdbc9-35a0-46d5-9dc6-e645d3414af9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.175564 Nov 27 20:48:36.854204 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 454/946] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:36 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:36.888314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:36.889007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:36.895966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.896488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:36.897328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:36.897825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.063276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:37.066318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:37.083705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.100349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.101457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.105285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.313665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:37.336019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78b7d462-db63-454b-8c78-ddd94056320c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.451280 Nov 27 20:48:37.336668 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 493/947] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:36 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:37.369376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fa5e00d-632b-4232-b208-4ddf559d6ecd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:37.370372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fa5e00d-632b-4232-b208-4ddf559d6ecd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:37.392119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa5e00d-632b-4232-b208-4ddf559d6ecd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.392559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa5e00d-632b-4232-b208-4ddf559d6ecd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.393547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa5e00d-632b-4232-b208-4ddf559d6ecd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.394155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa5e00d-632b-4232-b208-4ddf559d6ecd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.466304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fa5e00d-632b-4232-b208-4ddf559d6ecd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.107222 Nov 27 20:48:37.471584 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 494/948] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:37 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:37.476555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:37.477241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:37.495787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.496234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.497674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.497674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.657551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:37.666416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-69f3fd90-d15f-4cd4-ae31-f2e48d049f48 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.612386 Nov 27 20:48:37.666998 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 455/949] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:37 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:37.671939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:37.672768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:37.681522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.682237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.683028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.683506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.700596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:37.714617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-13826f0f-e8e7-413a-b0a4-8f76647eeea3 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1284 microversion: 2.1 time: 0.237463 Nov 27 20:48:37.716170 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 495/950] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:37 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:37.729956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:37.731396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:37.746044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.746763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.747750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.749036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.858747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:37.873038 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7a15cca6-a62c-4cd8-8cb5-f11e020a21ca tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1275 microversion: 2.1 time: 0.204130 Nov 27 20:48:37.875176 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 456/951] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:37 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:37.882491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:37.883558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:37.892186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.893183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.894645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.895863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.911039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:37.921760 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2523a2f7-6294-4a12-ab9d-e67ab175dc35 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1212 microversion: 2.1 time: 0.204252 Nov 27 20:48:37.923193 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 496/952] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:37 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1212 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:37.931988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:37.932787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:37.949512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.950267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:37.952991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:37.958665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.284073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:38.315372 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-983767b3-5f00-445c-8ad6-c3dc7f31e9ca tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.420136 Nov 27 20:48:38.319093 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 457/953] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:37 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:38.358517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:38.359593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:38.373231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.374259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.376298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.377385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.772185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:38.782547 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07339c3b-70d8-4e2a-8b86-c91129460a58 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.429508 Nov 27 20:48:38.785136 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 458/954] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:38 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:38.794762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d11f3f64-3951-4e58-ba78-6c83cdfb68c9 req-deda8c81-ba05-4c90-9ae7-8101b10af877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2262a9bd-9524-4919-8024-e41473beec99", "tag": "0958f265-00aa-4105-b49f-7b7659b442d8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:38.797147 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:38.797147 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:38.806705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:38.808758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d11f3f64-3951-4e58-ba78-6c83cdfb68c9 req-deda8c81-ba05-4c90-9ae7-8101b10af877 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.809448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d11f3f64-3951-4e58-ba78-6c83cdfb68c9 req-deda8c81-ba05-4c90-9ae7-8101b10af877 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.821085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:38.822819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:38.824299 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3bb70aeb-866b-42c5-a8dd-1707be76b99f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1361 microversion: 2.25 time: 0.899980 Nov 27 20:48:38.827872 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 497/955] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:37 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1361 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:38.830288 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d11f3f64-3951-4e58-ba78-6c83cdfb68c9 req-deda8c81-ba05-4c90-9ae7-8101b10af877 service nova] Creating event network-changed:0958f265-00aa-4105-b49f-7b7659b442d8 for instance 2262a9bd-9524-4919-8024-e41473beec99 on nch2-master-1 Nov 27 20:48:38.832760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8fc15609-eff3-44fc-b482-18f1adcf516f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:38.833744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8fc15609-eff3-44fc-b482-18f1adcf516f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:38.846592 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d11f3f64-3951-4e58-ba78-6c83cdfb68c9 req-deda8c81-ba05-4c90-9ae7-8101b10af877 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054472 Nov 27 20:48:38.848173 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 459/956] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:38.852468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc15609-eff3-44fc-b482-18f1adcf516f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.852941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc15609-eff3-44fc-b482-18f1adcf516f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.853738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc15609-eff3-44fc-b482-18f1adcf516f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.858151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:38.859275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc15609-eff3-44fc-b482-18f1adcf516f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.862881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:38.873763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.874567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.875697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.876715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.961101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8fc15609-eff3-44fc-b482-18f1adcf516f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.130561 Nov 27 20:48:38.961847 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 498/957] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:38 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:38.971034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:38.971859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:38.980057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.981269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:38.982559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:38.985582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.179441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:39.198578 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b67dd9f9-5365-4460-b0c8-07a45dc009e0 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1290 microversion: 2.1 time: 0.235505 Nov 27 20:48:39.199856 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 499/958] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:38 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1290 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:39.209592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:39.210491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:39.217899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.218799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.220490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.221271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.405524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:39.419104 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9707fad0-41c9-481e-97af-9a9c13022f54 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.568540 Nov 27 20:48:39.421004 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 460/959] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:38 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:39.445639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:39.447780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:39.471553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.472669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.474416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.475186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.493781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:39.504171 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72114426-1417-485f-a5bb-b3a82cf2ae21 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1337 microversion: 2.1 time: 0.302825 Nov 27 20:48:39.504767 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 500/960] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:39 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1337 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:39.510143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-588fe655-eb64-486a-83fa-e7ceded1cdbf req-0ffec054-03b2-4bc2-b1a1-16bde62ab44a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476f7662-3487-44f6-9f58-943deb3cde93", "tag": "0cb03dce-7858-4441-8989-6186f64291e0"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:39.514119 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:39.514119 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:39.529690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-588fe655-eb64-486a-83fa-e7ceded1cdbf req-0ffec054-03b2-4bc2-b1a1-16bde62ab44a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.530318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-588fe655-eb64-486a-83fa-e7ceded1cdbf req-0ffec054-03b2-4bc2-b1a1-16bde62ab44a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.552569 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-588fe655-eb64-486a-83fa-e7ceded1cdbf req-0ffec054-03b2-4bc2-b1a1-16bde62ab44a service nova] Creating event network-changed:0cb03dce-7858-4441-8989-6186f64291e0 for instance 476f7662-3487-44f6-9f58-943deb3cde93 on nch1-master-1 Nov 27 20:48:39.565989 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-588fe655-eb64-486a-83fa-e7ceded1cdbf req-0ffec054-03b2-4bc2-b1a1-16bde62ab44a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058663 Nov 27 20:48:39.567646 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 501/961] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:39.576801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:39.578460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:39.587113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.587745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.588723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.589268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.901836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:39.909936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eefa1ea9-e1ed-4565-8d23-7382c4406409 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1274 microversion: 2.1 time: 0.476888 Nov 27 20:48:39.921480 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 461/962] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:39 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1274 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:39.926971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:39.927641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:39.933980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.934670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:39.935536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:39.935981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.225218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:40.235494 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20e26055-ac2c-4ba2-b83f-684c81d43dfe tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.666429 Nov 27 20:48:40.237731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 502/963] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:39 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:40.242884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:40.244487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:40.253120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.253894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.255052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.255827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.489041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:40.499585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46673292-fc14-4865-bc6d-49f29963ec77 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.576514 Nov 27 20:48:40.511530 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 462/964] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:39 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:40.517818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1d717ec-1f95-49ed-bd6b-3a7a0c809f55 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:40.520216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1d717ec-1f95-49ed-bd6b-3a7a0c809f55 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:40.531065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d717ec-1f95-49ed-bd6b-3a7a0c809f55 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.532990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d717ec-1f95-49ed-bd6b-3a7a0c809f55 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.533904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d717ec-1f95-49ed-bd6b-3a7a0c809f55 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.534994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1d717ec-1f95-49ed-bd6b-3a7a0c809f55 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.593450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1d717ec-1f95-49ed-bd6b-3a7a0c809f55 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.079131 Nov 27 20:48:40.595177 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 463/965] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:40 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:40.601345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:40.603396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:40.612946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.614316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.616293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.616910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.760995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:40.770332 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-06b18808-aaa3-4dab-a0bf-18cbaac5f758 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1290 microversion: 2.1 time: 0.173597 Nov 27 20:48:40.771819 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 464/966] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:40 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1290 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:40.777444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:40.778929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:40.785834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.786589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.787600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.788190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.854947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:40.864276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:40.869445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:40.875106 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa8d770c-1b6d-4014-929c-ca513738fb09 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1556 microversion: 2.25 time: 0.635757 Nov 27 20:48:40.880992 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 503/967] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:40 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1556 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:40.888935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:40.896006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:40.908416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.909287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:40.910561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:40.911165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:41.258127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:41.270552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4171bf89-8247-49e3-a950-28086f6f8ebb tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.497403 Nov 27 20:48:41.271508 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 465/968] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:40 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:41.276335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:41.276933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:41.283987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:41.284431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:41.285215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:41.285645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:41.800112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid 5be38ef7-cbe4-41c9-8180-148457627022 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:48:41.818556 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fea697bd-b239-4b44-99d9-12f2ecee4a78 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 2048 microversion: 2.25 time: 0.545973 Nov 27 20:48:41.835551 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 466/969] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:41 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 2048 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:41.839211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:41.840474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:41.857085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:41.857683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:41.860181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:41.860739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:41.903968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:41.912449 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c782186-192b-465e-98e0-6b7a884c3ff5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 1.029871 Nov 27 20:48:41.915978 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 504/970] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:40 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:41.922770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:41.927952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:41.941694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:41.942138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:41.945113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:41.945572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:42.418014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:42.421538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:42.430860 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5182566f-e993-42af-812f-045be4b5936e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.598491 Nov 27 20:48:42.431489 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 467/971] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:41 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:42.433127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71fd2813-f164-427f-9ca5-7346a4418d3c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1504 microversion: 2.1 time: 0.515557 Nov 27 20:48:42.434130 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 505/972] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:41 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:42.439586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:42.440362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:42.445668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-839db99e-c445-4fe7-bc8c-78bd3576c023 req-bae06bd1-0e3c-4075-a5b9-b9f40fc8ea34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26eee3c3-56bb-48c8-b5fc-f88ab39670f0", "tag": "64da879e-2956-4a5b-a220-c740193b8ae4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:42.447281 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:42.447281 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:42.448294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:42.449026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:42.451132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:42.452877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:42.464660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-839db99e-c445-4fe7-bc8c-78bd3576c023 req-bae06bd1-0e3c-4075-a5b9-b9f40fc8ea34 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:42.465123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-839db99e-c445-4fe7-bc8c-78bd3576c023 req-bae06bd1-0e3c-4075-a5b9-b9f40fc8ea34 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:42.486936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-839db99e-c445-4fe7-bc8c-78bd3576c023 req-bae06bd1-0e3c-4075-a5b9-b9f40fc8ea34 service nova] Creating event network-changed:64da879e-2956-4a5b-a220-c740193b8ae4 for instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 on nch1-master-1 Nov 27 20:48:42.497212 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-839db99e-c445-4fe7-bc8c-78bd3576c023 req-bae06bd1-0e3c-4075-a5b9-b9f40fc8ea34 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064429 Nov 27 20:48:42.504030 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 468/973] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:42.509553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e093bae6-87d2-4938-bf0b-4e85022ffe4c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:42.520763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e093bae6-87d2-4938-bf0b-4e85022ffe4c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:42.527298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e093bae6-87d2-4938-bf0b-4e85022ffe4c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:42.527971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e093bae6-87d2-4938-bf0b-4e85022ffe4c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:42.528972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e093bae6-87d2-4938-bf0b-4e85022ffe4c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:42.529575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e093bae6-87d2-4938-bf0b-4e85022ffe4c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:42.630946 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e093bae6-87d2-4938-bf0b-4e85022ffe4c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.122664 Nov 27 20:48:42.633410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 469/974] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:42 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:42.646859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:42.648123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:42.659443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:42.659842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:42.660972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:42.661970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.046390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:43.069704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98e7ac68-75b8-4dbe-bcea-3fb7440b7619 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.632722 Nov 27 20:48:43.072923 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 506/975] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:42 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:43.087310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3edbfdca-9226-4b84-b1fb-f258065272b2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:43.089608 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:43.089608 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:43.091836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3edbfdca-9226-4b84-b1fb-f258065272b2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.093517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3edbfdca-9226-4b84-b1fb-f258065272b2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.094747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3edbfdca-9226-4b84-b1fb-f258065272b2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.095772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3edbfdca-9226-4b84-b1fb-f258065272b2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.131761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3edbfdca-9226-4b84-b1fb-f258065272b2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.057113 Nov 27 20:48:43.132840 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 507/976] 10.222.0.21 () {60 vars in 1216 bytes} [Sat Nov 27 20:48:43 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:43.137625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:43.147786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:43.155152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.155973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.157087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.157678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.363151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:43.378922 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a68445b-48d0-4f06-896e-a55644102ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.741644 Nov 27 20:48:43.380655 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 470/977] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:42 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:43.395460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:43.397026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:43.408132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.408585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.409444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.409892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.826028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:43.841436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1121bb76-6895-4727-9a2f-b1d715162228 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.704716 Nov 27 20:48:43.845213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 508/978] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:43 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:43.854253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:43.855038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:43.874673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.875689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.876949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:43.886510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:43.964910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:43.973519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c35cad27-8ed0-4922-9da1-af07457e483e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.589369 Nov 27 20:48:43.974135 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 471/979] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:43 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:43.979179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:43.979821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:44.001387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.010645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.010645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.010645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.408127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:44.423211 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2c29adfc-7080-47c6-9ac9-329642149f06 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.574927 Nov 27 20:48:44.426567 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 509/980] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:43 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:44.440890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-32190587-adad-40d9-ab6e-02fe4b2c3dfb req-880783bb-dc3f-4053-ad96-84f80350db3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:44.447166 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:44.447166 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:44.464746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-32190587-adad-40d9-ab6e-02fe4b2c3dfb req-880783bb-dc3f-4053-ad96-84f80350db3b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.466135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-32190587-adad-40d9-ab6e-02fe4b2c3dfb req-880783bb-dc3f-4053-ad96-84f80350db3b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.483741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-32190587-adad-40d9-ab6e-02fe4b2c3dfb req-880783bb-dc3f-4053-ad96-84f80350db3b service nova] Creating event network-changed:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch1-master-1 Nov 27 20:48:44.491143 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-32190587-adad-40d9-ab6e-02fe4b2c3dfb req-880783bb-dc3f-4053-ad96-84f80350db3b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062869 Nov 27 20:48:44.492325 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 510/981] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:44.499066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d14924fd-0098-4f53-8526-d95772ffbee8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:44.501132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d14924fd-0098-4f53-8526-d95772ffbee8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:44.526498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14924fd-0098-4f53-8526-d95772ffbee8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.527999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14924fd-0098-4f53-8526-d95772ffbee8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.528797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14924fd-0098-4f53-8526-d95772ffbee8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.530610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14924fd-0098-4f53-8526-d95772ffbee8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.556453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:44.565162 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c96648ab-d3d5-424b-8f3e-d4f1dc692f4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1479 microversion: 2.1 time: 0.589992 Nov 27 20:48:44.582043 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 472/982] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:43 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1479 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:44.591033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:44.596051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:44.611393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.612080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.614121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.614735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.630916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d14924fd-0098-4f53-8526-d95772ffbee8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.137359 Nov 27 20:48:44.638774 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 511/983] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:44 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:44.651957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:44.653196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:44.679959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.680590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:44.682691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:44.689136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.028470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:45.037770 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6300165e-af6b-47ae-bf5c-df7acc8c6f12 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.399306 Nov 27 20:48:45.039042 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 512/984] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:44 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:45.050349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0e14bb7f-45e8-43df-82d5-993b0dceab28 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '.version_select at 0x7f15c7bfe1f0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:45.052602 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:45.052602 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:45.070597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e14bb7f-45e8-43df-82d5-993b0dceab28 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.077896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e14bb7f-45e8-43df-82d5-993b0dceab28 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.112269 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0e14bb7f-45e8-43df-82d5-993b0dceab28 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.071644 Nov 27 20:48:45.112959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 513/985] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:48:45 2021] GET /compute/v2.1/os-migrations => generated 2338 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:45.120571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-865a1224-e295-4cf2-8a4d-af7b1a975ce1 req-79db3b4e-1589-427f-8634-524cd9d23091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d615db49-b01d-4c93-94ea-1ce4a60493e4", "tag": "eabaf35a-0b10-4c47-9a45-f879a9b99282"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:45.125701 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:45.125701 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:45.139160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-865a1224-e295-4cf2-8a4d-af7b1a975ce1 req-79db3b4e-1589-427f-8634-524cd9d23091 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.139957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-865a1224-e295-4cf2-8a4d-af7b1a975ce1 req-79db3b4e-1589-427f-8634-524cd9d23091 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.163621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-865a1224-e295-4cf2-8a4d-af7b1a975ce1 req-79db3b4e-1589-427f-8634-524cd9d23091 service nova] Creating event network-changed:eabaf35a-0b10-4c47-9a45-f879a9b99282 for instance d615db49-b01d-4c93-94ea-1ce4a60493e4 on nch1-master-1 Nov 27 20:48:45.176698 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-865a1224-e295-4cf2-8a4d-af7b1a975ce1 req-79db3b4e-1589-427f-8634-524cd9d23091 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062028 Nov 27 20:48:45.178814 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 514/986] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:45.183931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:45.184825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:45.192897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.193545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.194553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.195189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.205098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:45.217700 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce0d4891-672d-4b1e-b21d-f9ede67ea8e2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.632231 Nov 27 20:48:45.219491 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 473/987] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:44 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:45.226501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:45.228850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:45.238311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.239074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.240540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.241173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.480426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:45.488162 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42a6cb6a-3227-4f2b-9db6-99eb44c32341 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.308088 Nov 27 20:48:45.488841 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 515/988] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:45 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:45.493554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20245a33-6bec-4fcd-af2f-8408cefddae7 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:45.494250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20245a33-6bec-4fcd-af2f-8408cefddae7 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:45.503555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20245a33-6bec-4fcd-af2f-8408cefddae7 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.504478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20245a33-6bec-4fcd-af2f-8408cefddae7 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.509247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20245a33-6bec-4fcd-af2f-8408cefddae7 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.510443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20245a33-6bec-4fcd-af2f-8408cefddae7 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.608231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:45.621948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a67f9ab8-a915-47f0-9dee-d7b2fa72193d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.399371 Nov 27 20:48:45.630036 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 474/989] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:45 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:45.637023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b64507f-704e-47d8-bc31-15c1c144f092 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "531124a5-0591-4505-b7a9-fd42aca352f7", "device": "/dev/xvdb"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:45.646226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b64507f-704e-47d8-bc31-15c1c144f092 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:45.653484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b64507f-704e-47d8-bc31-15c1c144f092 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.654334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b64507f-704e-47d8-bc31-15c1c144f092 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.655494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b64507f-704e-47d8-bc31-15c1c144f092 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.656278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b64507f-704e-47d8-bc31-15c1c144f092 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.777574 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20245a33-6bec-4fcd-af2f-8408cefddae7 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1630 microversion: 2.1 time: 0.287600 Nov 27 20:48:45.790842 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 516/990] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:45 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1630 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:45.804630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7558c32a-b7ba-4017-a17d-5c0a036fe156 req-66240399-f165-4450-95b9-602e67e7d800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa58d27-298b-455d-8185-f926aa730620", "name": "network-vif-plugged", "status": "completed", "tag": "b3fdcccc-7383-40d8-8be2-9440dff6baff"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:45.806760 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:45.806760 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:45.816044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7558c32a-b7ba-4017-a17d-5c0a036fe156 req-66240399-f165-4450-95b9-602e67e7d800 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.816489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7558c32a-b7ba-4017-a17d-5c0a036fe156 req-66240399-f165-4450-95b9-602e67e7d800 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.830094 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7558c32a-b7ba-4017-a17d-5c0a036fe156 req-66240399-f165-4450-95b9-602e67e7d800 service nova] Creating event network-vif-plugged:b3fdcccc-7383-40d8-8be2-9440dff6baff for instance 5aa58d27-298b-455d-8185-f926aa730620 on nch2-master-1 Nov 27 20:48:45.836073 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7558c32a-b7ba-4017-a17d-5c0a036fe156 req-66240399-f165-4450-95b9-602e67e7d800 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043036 Nov 27 20:48:45.837972 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 517/991] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:45.841780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:45.842545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:45.852028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.852742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:45.853981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:45.854175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.066688 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b64507f-704e-47d8-bc31-15c1c144f092 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "POST /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.434857 Nov 27 20:48:46.067652 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 475/992] 10.222.0.21 () {62 vars in 1363 bytes} [Sat Nov 27 20:48:45 2021] POST /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:46.087180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d166a0df-8d5b-4989-8ddb-1fa3e31df7c4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:46.088722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d166a0df-8d5b-4989-8ddb-1fa3e31df7c4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:46.120095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d166a0df-8d5b-4989-8ddb-1fa3e31df7c4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.120547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d166a0df-8d5b-4989-8ddb-1fa3e31df7c4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.137887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d166a0df-8d5b-4989-8ddb-1fa3e31df7c4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.139525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d166a0df-8d5b-4989-8ddb-1fa3e31df7c4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.180017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:46.188301 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc4ef4d4-df47-4f9e-ad83-056c643b6aa9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.350168 Nov 27 20:48:46.189153 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 518/993] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:45 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:46.193952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2128291748", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "324306ab-fd63-4c3d-9f56-7119b3413ec6"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:46.259311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] validate_networks() for [('324306ab-fd63-4c3d-9f56-7119b3413ec6', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:46.702480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:46.703612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:46.703929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:46.704337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:46.704746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:46.714000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.714539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.715385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.715873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.734909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:46.738834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for user 1d46c71936aa4118aa36a9e95b95c4f5 and project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:46.749877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:46.752245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:46.798125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-90cd45b9-cd98-456a-b11c-0a70684c1f32 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607696 Nov 27 20:48:46.798867 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 519/994] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:48:46.803145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:46.803846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:46.809796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.810316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.811158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.811685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.945480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:46.953052 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02035be0-fce4-407f-96a0-415869844c4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.152981 Nov 27 20:48:46.953568 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 520/995] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:46 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:46.958208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:46.958804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:46.966937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.967422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:46.968192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:46.968621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.124736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:47.134348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f2d0b353-ae03-42a7-b545-ea7bc15865d3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.179630 Nov 27 20:48:47.135010 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 521/996] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:46 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:47.139188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:47.139983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:47.146557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.147181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.148000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.148945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.282747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:47.290153 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a8463048-01e5-4f3f-a9f7-b1be4750a294 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.154186 Nov 27 20:48:47.290719 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 522/997] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:47 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:47.294924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0ae139f7-c704-43c7-bd69-2466eddd2a1a req-43e0f658-5ca9-45dc-910b-71da6ccbd886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca701c1d-30e3-471a-881e-6d51c9bbef61", "tag": "8ad22e26-c654-4c33-99af-7729f8c1726b"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:47.296571 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:47.296571 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:47.303462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0ae139f7-c704-43c7-bd69-2466eddd2a1a req-43e0f658-5ca9-45dc-910b-71da6ccbd886 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.303905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0ae139f7-c704-43c7-bd69-2466eddd2a1a req-43e0f658-5ca9-45dc-910b-71da6ccbd886 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.314323 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0ae139f7-c704-43c7-bd69-2466eddd2a1a req-43e0f658-5ca9-45dc-910b-71da6ccbd886 service nova] Creating event network-changed:8ad22e26-c654-4c33-99af-7729f8c1726b for instance ca701c1d-30e3-471a-881e-6d51c9bbef61 on nch1-master-1 Nov 27 20:48:47.319390 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0ae139f7-c704-43c7-bd69-2466eddd2a1a req-43e0f658-5ca9-45dc-910b-71da6ccbd886 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027534 Nov 27 20:48:47.319983 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 523/998] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:47.324720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:47.325420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:47.331500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.331948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.332744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.333172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.533182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:47.540442 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20c970f1-6ce3-4fc4-8128-666cfe6feb48 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.219387 Nov 27 20:48:47.541010 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 524/999] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:47 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:47.545285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:47.545938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:47.551696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.552139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.552937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.553366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.634509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:47.642509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac72d1ac-8e19-43d3-afc6-7e98db21afe1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1215 microversion: 2.1 time: 0.100536 Nov 27 20:48:47.643127 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 525/1000] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:47 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:47.647408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:47.648009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:47.654284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.654734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.655541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.655983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.865097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:47.873065 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f64e217-2dbf-4d26-9759-4df87de8d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.228877 Nov 27 20:48:47.874118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 526/1001] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:47 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:47.892119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-011bc1c9-4811-49fb-8d19-9082d69ff961 req-0ccfe6e0-386d-47b8-8ddc-9a2898222654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2262a9bd-9524-4919-8024-e41473beec99", "name": "network-vif-plugged", "status": "completed", "tag": "0958f265-00aa-4105-b49f-7b7659b442d8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:47.893858 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:47.893858 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:47.901409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-011bc1c9-4811-49fb-8d19-9082d69ff961 req-0ccfe6e0-386d-47b8-8ddc-9a2898222654 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.901952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-011bc1c9-4811-49fb-8d19-9082d69ff961 req-0ccfe6e0-386d-47b8-8ddc-9a2898222654 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.913522 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-011bc1c9-4811-49fb-8d19-9082d69ff961 req-0ccfe6e0-386d-47b8-8ddc-9a2898222654 service nova] Creating event network-vif-plugged:0958f265-00aa-4105-b49f-7b7659b442d8 for instance 2262a9bd-9524-4919-8024-e41473beec99 on nch2-master-1 Nov 27 20:48:47.918430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-011bc1c9-4811-49fb-8d19-9082d69ff961 req-0ccfe6e0-386d-47b8-8ddc-9a2898222654 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 Nov 27 20:48:47.919352 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 527/1002] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:48:47.970626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:47.971340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:47.981276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.981717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:47.982495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:47.982954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.113591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:48.121072 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37e3eb74-9cb8-4f12-97f9-e831c0a37ef7 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.154910 Nov 27 20:48:48.125950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 528/1003] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:47 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:48.151463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:48.152076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:48.158674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.159135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.159947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.160404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.303127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:48.310462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f542403-0b8b-40cf-a162-2e3b4fb99715 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.162990 Nov 27 20:48:48.311037 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 529/1004] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:48 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:48.315898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:48.316492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:48.322079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.322518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.323314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.323779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.460372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:48.467790 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19a6f29b-e24e-4161-99d5-dbec19d93225 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.155798 Nov 27 20:48:48.468443 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 530/1005] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:48 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:48.556733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:48.557335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:48.563991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.564477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.565750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.566186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.750749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:48.761063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5032178-cde9-444a-80d5-74a4cc37bdfa tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.207917 Nov 27 20:48:48.761890 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 531/1006] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:48 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:48.766888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:48.768231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:48.774146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.774739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.775545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.775976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.839480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:48.847471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f08f1ad6-1b34-42c8-96c3-b3d76410e9d6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1215 microversion: 2.1 time: 0.084795 Nov 27 20:48:48.848359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 532/1007] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:48 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:48.889621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:48.890276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:48.896649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.897097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:48.897945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:48.898383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.030194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:49.037523 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-317c9460-830a-4e09-afd0-8a5f8ee7b47b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.151572 Nov 27 20:48:49.038087 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 533/1008] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:48 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:49.139456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:49.140067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:49.146488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.146945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.147746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.148187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.280637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:49.288160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-74f01e7b-2b59-49e4-b3d1-32f1194cb83c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.152303 Nov 27 20:48:49.288809 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 534/1009] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:49 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:49.327385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:49.327990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:49.333807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.334254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.335027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.335488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.464896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:49.472133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2bfbaf64-685b-4f1f-acf1-fb33dda6a873 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.148251 Nov 27 20:48:49.472704 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 535/1010] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:49 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:49.484742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:49.485360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:49.492264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.492713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.493773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.494209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.626225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:49.635080 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed0c78d4-8668-4033-8c42-d18d5b86c744 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.153801 Nov 27 20:48:49.635754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 536/1011] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:49 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:49.684296 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d166a0df-8d5b-4989-8ddb-1fa3e31df7c4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 3.615000 Nov 27 20:48:49.688125 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 476/1012] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:46 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 3617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:49.778323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:49.778935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:49.786238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.786776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.787808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.788316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.873101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:49.873720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:49.881347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.882030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.883099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:49.883716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:49.964917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:49.973221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-416f8bec-fb63-41c2-8ed6-bbe59fa3084e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1263 microversion: 2.1 time: 0.112117 Nov 27 20:48:49.979398 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 477/1013] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:49 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1263 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:49.985791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fccc4de9-a1b5-46fa-a6ee-645bfb76ddf7 req-9f3982de-409a-4780-a7ee-f5c9ee38c654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476f7662-3487-44f6-9f58-943deb3cde93", "name": "network-vif-plugged", "status": "completed", "tag": "0cb03dce-7858-4441-8989-6186f64291e0"}, {"server_uuid": "26eee3c3-56bb-48c8-b5fc-f88ab39670f0", "name": "network-vif-plugged", "status": "completed", "tag": "64da879e-2956-4a5b-a220-c740193b8ae4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:49.989051 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:49.989051 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:49.994687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:50.001880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fccc4de9-a1b5-46fa-a6ee-645bfb76ddf7 req-9f3982de-409a-4780-a7ee-f5c9ee38c654 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.002716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fccc4de9-a1b5-46fa-a6ee-645bfb76ddf7 req-9f3982de-409a-4780-a7ee-f5c9ee38c654 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.005990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9464945-65c5-4f03-abb2-8fd6cf1ba8e5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.231421 Nov 27 20:48:50.010960 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 537/1014] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:49 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:50.016574 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fccc4de9-a1b5-46fa-a6ee-645bfb76ddf7 req-9f3982de-409a-4780-a7ee-f5c9ee38c654 service nova] Creating event network-vif-plugged:0cb03dce-7858-4441-8989-6186f64291e0 for instance 476f7662-3487-44f6-9f58-943deb3cde93 on nch1-master-1 Nov 27 20:48:50.017008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fccc4de9-a1b5-46fa-a6ee-645bfb76ddf7 req-9f3982de-409a-4780-a7ee-f5c9ee38c654 service nova] Creating event network-vif-plugged:64da879e-2956-4a5b-a220-c740193b8ae4 for instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 on nch1-master-1 Nov 27 20:48:50.024006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fccc4de9-a1b5-46fa-a6ee-645bfb76ddf7 req-9f3982de-409a-4780-a7ee-f5c9ee38c654 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048580 Nov 27 20:48:50.024609 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 478/1015] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:49 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:50.053749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:50.054368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:50.060308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.060761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.061548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.062011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.263947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:50.273528 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8324c5dd-ed82-496c-b0d1-9a1c82a18289 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.223110 Nov 27 20:48:50.274393 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 538/1016] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:50 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:50.311292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:50.312715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:50.327496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.328789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.332254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.333255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.518713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:50.528205 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb257ff8-0f7d-42f7-ad7e-da3e07f29d50 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.225518 Nov 27 20:48:50.539359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 479/1017] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:50 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:50.545471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:50.546160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:50.556217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.556642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.557427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.557860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.654838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:50.656023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:50.669037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.669514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.670478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.674059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.858065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:50.867125 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6cef83ac-f509-4615-a60c-5bdb7ae24711 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1322 microversion: 2.1 time: 0.216972 Nov 27 20:48:50.871330 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 480/1018] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:50 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:50.874499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eca780b8-c7ac-449d-bbe2-cba0bb37d01a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:50.875497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eca780b8-c7ac-449d-bbe2-cba0bb37d01a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:50.883134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca780b8-c7ac-449d-bbe2-cba0bb37d01a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.883827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca780b8-c7ac-449d-bbe2-cba0bb37d01a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.884854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca780b8-c7ac-449d-bbe2-cba0bb37d01a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:50.885457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca780b8-c7ac-449d-bbe2-cba0bb37d01a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:50.909313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:50.917797 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ebbe3b1-0a42-4f7a-8204-2e5ccf866170 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1321 microversion: 2.1 time: 0.377919 Nov 27 20:48:50.918536 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 539/1019] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:50 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:50.941799 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eca780b8-c7ac-449d-bbe2-cba0bb37d01a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.070733 Nov 27 20:48:50.946401 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 481/1020] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:50 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:50.993768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:50.993768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:51.000692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.001814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.002796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.003424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.024305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:51.025246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:51.036279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.038049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.040934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.041988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.115604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:51.128430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f823411b-25fc-459a-bc4a-69cfc6e6388c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1269 microversion: 2.1 time: 0.141114 Nov 27 20:48:51.138081 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 540/1021] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:50 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:51.224153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:51.231991 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22e6e080-6049-4a31-bb85-fc87aa6f9808 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.211337 Nov 27 20:48:51.232852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 482/1022] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:51 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:51.291810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:51.292537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:51.299740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.300316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.301168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.301675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.516954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:51.525231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4fef5b4-3478-4175-8878-eff7245e1ac9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.237073 Nov 27 20:48:51.535661 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 541/1023] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:51 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:51.546222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:51.546946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:51.554184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.554666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.555498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.555934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.744417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:51.751982 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5dd1aaab-8172-4052-a1c5-9ac696d431ac tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.210270 Nov 27 20:48:51.752544 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 483/1024] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:51 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:51.884102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:51.884700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:51.891074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.891575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.892953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.893395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.935494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:51.936260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:51.943418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.943864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:51.944657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:51.945128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.086490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:52.094184 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9512640-c4a7-4bcd-8972-65240820221b tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1513 microversion: 2.1 time: 0.162457 Nov 27 20:48:52.094771 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 484/1025] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:51 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:52.106644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81528ecd-ba43-48e6-9a7f-83a0dea1a432 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:52.106644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81528ecd-ba43-48e6-9a7f-83a0dea1a432 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:52.106956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81528ecd-ba43-48e6-9a7f-83a0dea1a432 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.107455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81528ecd-ba43-48e6-9a7f-83a0dea1a432 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.108260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81528ecd-ba43-48e6-9a7f-83a0dea1a432 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.108902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81528ecd-ba43-48e6-9a7f-83a0dea1a432 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.157388 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81528ecd-ba43-48e6-9a7f-83a0dea1a432 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.061310 Nov 27 20:48:52.158039 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 485/1026] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:52 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:52.163214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1090befc-c495-4645-925e-390728a8bb6f req-460f7b36-b948-4dea-bb26-718d3e2cc5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "name": "network-vif-plugged", "status": "completed", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:52.164725 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:52.164725 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:52.172730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1090befc-c495-4645-925e-390728a8bb6f req-460f7b36-b948-4dea-bb26-718d3e2cc5a8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.173184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1090befc-c495-4645-925e-390728a8bb6f req-460f7b36-b948-4dea-bb26-718d3e2cc5a8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.185714 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1090befc-c495-4645-925e-390728a8bb6f req-460f7b36-b948-4dea-bb26-718d3e2cc5a8 service nova] Creating event network-vif-plugged:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch1-master-1 Nov 27 20:48:52.191085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1090befc-c495-4645-925e-390728a8bb6f req-460f7b36-b948-4dea-bb26-718d3e2cc5a8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031571 Nov 27 20:48:52.191983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 486/1027] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:52.196680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:52.197379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:52.204263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.204729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.206097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.206539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.350719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:52.358225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32084c18-afad-4102-b258-32549a238bfd tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1512 microversion: 2.1 time: 0.165317 Nov 27 20:48:52.358874 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 487/1028] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:52 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:52.368945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:52.368945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:52.370295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.371011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.371861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.372322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.418791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:52.427044 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2dfaad8f-e781-4b26-9414-be3eb03a8340 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1509 microversion: 2.1 time: 0.546585 Nov 27 20:48:52.438599 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 542/1029] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:51 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1509 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:52.446859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:52.446859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:52.459399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.460108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.461256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.461845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.560614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:52.569268 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ec22d9d-58e1-404d-a488-f12381bb6985 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.208882 Nov 27 20:48:52.576452 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 488/1030] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:52 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:52.576452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:52.576911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:52.590293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.593839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.594676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.595125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.731982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:52.744217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-33a17492-a59d-4c1e-b116-ce7a88d96d32 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.302917 Nov 27 20:48:52.755593 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 543/1031] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:52 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:52.761185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:52.762047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:52.765589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:52.770507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.771158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.772228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.772881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.781856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2f56485d-0635-4072-930d-1b29a41c2c5d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99" status: 200 len: 1512 microversion: 2.1 time: 0.210603 Nov 27 20:48:52.782439 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 489/1032] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:52 2021] GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99 => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:52.788319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:52.789158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:52.797027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.797830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.799578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:52.800191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:52.976025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:52.998851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66fda604-52c4-47c1-87d1-b40460c86614 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.214242 Nov 27 20:48:53.001717 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 490/1033] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:52 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:53.006927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:53.010757 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:53.010757 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:53.012767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.013665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:53.029141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.029848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.030951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.031711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.046682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.092447 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5611a22b-3223-44e1-a08f-3e61edff5ef6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.334342 Nov 27 20:48:53.093117 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 544/1034] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:52 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:53.104133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-73a3daaa-4f0a-44ee-acd5-f8ad9d7e0fec req-00bd276e-f71c-4098-a64d-61238e7500c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96245ad6-b6b6-4017-aff5-81689a46b3a3", "tag": "91a3e20c-c74b-4366-a10a-a264f88012cb"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:53.106930 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:53.106930 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:53.116471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-73a3daaa-4f0a-44ee-acd5-f8ad9d7e0fec req-00bd276e-f71c-4098-a64d-61238e7500c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.117092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-73a3daaa-4f0a-44ee-acd5-f8ad9d7e0fec req-00bd276e-f71c-4098-a64d-61238e7500c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.135432 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-73a3daaa-4f0a-44ee-acd5-f8ad9d7e0fec req-00bd276e-f71c-4098-a64d-61238e7500c3 service nova] Creating event network-changed:91a3e20c-c74b-4366-a10a-a264f88012cb for instance 96245ad6-b6b6-4017-aff5-81689a46b3a3 on nch2-master-1 Nov 27 20:48:53.141112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-73a3daaa-4f0a-44ee-acd5-f8ad9d7e0fec req-00bd276e-f71c-4098-a64d-61238e7500c3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045475 Nov 27 20:48:53.143928 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 545/1035] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:53.144975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:53.171638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b54c0fc8-be1a-448b-85a2-b87d8c9ab6aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:53.174195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b54c0fc8-be1a-448b-85a2-b87d8c9ab6aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:53.182427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b54c0fc8-be1a-448b-85a2-b87d8c9ab6aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.183342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b54c0fc8-be1a-448b-85a2-b87d8c9ab6aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.184444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b54c0fc8-be1a-448b-85a2-b87d8c9ab6aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.184928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b54c0fc8-be1a-448b-85a2-b87d8c9ab6aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.221477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.227700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.228156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.238702 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b54c0fc8-be1a-448b-85a2-b87d8c9ab6aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.071878 Nov 27 20:48:53.240521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 546/1036] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:53 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:48:53.345244 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1d83579-58c6-47b3-903e-fa95cb3a6864 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.344320 Nov 27 20:48:53.346454 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 491/1037] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 20:48:52 2021] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:53.365792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:53.369723 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:53.369723 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:53.370762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.371614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-539822771', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:53.378128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.378566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.379454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.379921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.507802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:53.577468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.583571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.584032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.586349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:53.587025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:53.593057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.593578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.594493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.595073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.735844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.744733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74fda181-ef71-435f-a80a-c923eeba2b09 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.162694 Nov 27 20:48:53.754446 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 492/1038] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:53 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:53.761629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:53.762273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:53.769054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.769491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.770273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.770815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.797750 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebd01bfe-7f57-42de-8653-07b33e3f4303 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-539822771" status: 200 len: 1515 microversion: 2.1 time: 0.436446 Nov 27 20:48:53.798737 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 547/1039] 10.222.0.21 () {58 vars in 1260 bytes} [Sat Nov 27 20:48:53 2021] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-539822771 => generated 1515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:53.815834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:53.819050 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:53.819050 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:53.820141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.821132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:53.826575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.827023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.827887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:53.828350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:53.928881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:53.930508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:53.936572 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed6c3d03-09b5-437c-974c-10d1fb23025e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1379 microversion: 2.1 time: 0.178511 Nov 27 20:48:53.946152 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 493/1040] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:53 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1379 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:53.997110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:54.004876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.005334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.016799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:54.018737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:54.025882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.026427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.027506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.028062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.166383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:54.173609 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a9ab58a-0453-401d-9e34-1682fccf337c tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.160896 Nov 27 20:48:54.174186 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 494/1041] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:54 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:54.179509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd33332-c012-4d3f-89d3-348f26863f24"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:54.180606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:54.187680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.188693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.190036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.190466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.201335 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9164ede-0e32-448e-a018-2a4a39c038ea tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.388987 Nov 27 20:48:54.201932 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 548/1042] 10.222.0.21 () {58 vars in 1172 bytes} [Sat Nov 27 20:48:53 2021] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:54.207152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:54.207965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:54.213935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.214725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.215804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.216391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.395938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:54.409257 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5fde424-3a19-4985-91b4-5be3e013ddde tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.205798 Nov 27 20:48:54.411137 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 549/1043] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:54 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:54.417785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:54.422234 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:54.422234 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:54.424438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:54.425261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.servers [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Removing options 'limit' from query {{(pid=135680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 27 20:48:54.426430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:54.433219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.434060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.435211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.435773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.474121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:54.481426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.482092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.506272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a73e0cb6-8a3b-4c1b-8134-c4eaf11205b5 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "POST /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329967 Nov 27 20:48:54.511888 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 495/1044] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:48:54 2021] POST /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:54.517213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4847ed91-834d-446b-9a26-667bdd6dd4c7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:54.518145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4847ed91-834d-446b-9a26-667bdd6dd4c7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:54.530789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4847ed91-834d-446b-9a26-667bdd6dd4c7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.531331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4847ed91-834d-446b-9a26-667bdd6dd4c7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.532092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4847ed91-834d-446b-9a26-667bdd6dd4c7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.532532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4847ed91-834d-446b-9a26-667bdd6dd4c7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.608999 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4847ed91-834d-446b-9a26-667bdd6dd4c7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 24573 microversion: 2.1 time: 0.095636 Nov 27 20:48:54.613917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 496/1045] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:54 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 24573 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:54.619429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ee2a9842-1f3e-43ff-87ec-d9bfa79e3c52 req-efc4ff86-e0fd-45a0-919b-d9bc90432c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca701c1d-30e3-471a-881e-6d51c9bbef61", "name": "network-vif-plugged", "status": "completed", "tag": "8ad22e26-c654-4c33-99af-7729f8c1726b"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:54.620923 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:54.620923 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:54.629811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ee2a9842-1f3e-43ff-87ec-d9bfa79e3c52 req-efc4ff86-e0fd-45a0-919b-d9bc90432c4f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.630447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ee2a9842-1f3e-43ff-87ec-d9bfa79e3c52 req-efc4ff86-e0fd-45a0-919b-d9bc90432c4f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.657296 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ee2a9842-1f3e-43ff-87ec-d9bfa79e3c52 req-efc4ff86-e0fd-45a0-919b-d9bc90432c4f service nova] Creating event network-vif-plugged:8ad22e26-c654-4c33-99af-7729f8c1726b for instance ca701c1d-30e3-471a-881e-6d51c9bbef61 on nch1-master-1 Nov 27 20:48:54.666159 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ee2a9842-1f3e-43ff-87ec-d9bfa79e3c52 req-efc4ff86-e0fd-45a0-919b-d9bc90432c4f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050820 Nov 27 20:48:54.671674 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 497/1046] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:54.681532 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-efcbecd5-51e7-4a7c-951d-f412303065aa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.267678 Nov 27 20:48:54.682648 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 550/1047] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:48:54 2021] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:54.700896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:54.704729 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:54.704729 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:54.706142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:54.707018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:54.707481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:54.708092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:54.712961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.713490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.714421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.714891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.716188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.716636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.717821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.718729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.830606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:54.931948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47243ee9-36e8-47ec-b963-180f8c943ce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.234837 Nov 27 20:48:54.938935 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 498/1048] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:48:54 2021] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:54.938935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:54.940242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:54.945683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.946166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.948204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:54.948204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:54.962170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid 5be38ef7-cbe4-41c9-8180-148457627022 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:48:54.976554 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73b5745d-7016-4d2e-9664-86444135e09d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 2126 microversion: 2.25 time: 0.272947 Nov 27 20:48:54.977556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 551/1049] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:54 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 2126 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:48:54.987845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:54.991999 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:54.991999 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:54.993036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:54.993771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.servers [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Removing options 'limit' from query {{(pid=135680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 27 20:48:54.994456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:54.999919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.000364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.001207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.002151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.088031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:55.092661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:55.102119 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-def6df47-1f46-4309-820b-9e71bc555500 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.168075 Nov 27 20:48:55.102735 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 499/1050] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:54 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:55.107527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:55.108154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:55.114767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.115426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.116407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.116873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.154416 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0de28c2-4526-4657-afc4-84037987f5f6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.175938 Nov 27 20:48:55.160795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 552/1051] 10.222.0.21 () {58 vars in 1149 bytes} [Sat Nov 27 20:48:54 2021] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:55.160795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:55.161523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:55.167605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.168052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.168822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.169252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.194290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'flavor' on Instance uuid 5be38ef7-cbe4-41c9-8180-148457627022 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:48:55.206278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Going to try to live migrate instance to nch1-master-1 {{(pid=135680) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:48:55.264706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:55.275387 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e14d345d-2b42-486e-ab78-b802edbafe88 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1529 microversion: 2.1 time: 0.171402 Nov 27 20:48:55.276181 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 500/1052] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:55 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1529 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:55.281521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:55.285620 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:55.285620 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:55.287152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:55.288255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:55.294444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.295030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.295986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.296691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.390288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:55.449948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18478ae5-80d6-487f-b94e-ff7bda9e5fbb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.172188 Nov 27 20:48:55.450534 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 501/1053] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:48:55 2021] GET /compute/v2.1/servers => generated 1011 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:55.455272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:55.456068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:55.462041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.462489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.463405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.463847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.607304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:55.615325 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34e1362d-e62c-46fd-b104-5ef7f1885c4f tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.163468 Nov 27 20:48:55.616040 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 502/1054] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:55 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:55.623304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:55.624112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:55.631018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.631684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.632646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.633108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.775091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:55.783912 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ac22864-20db-40ff-8e76-5846e9b45e7f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1529 microversion: 2.1 time: 0.166759 Nov 27 20:48:55.784490 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 503/1055] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:55 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1529 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:55.788760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:55.789282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:55.795602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.796049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.796825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.797252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.941246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:55.949063 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e3eecbcb-4182-4728-a293-c431eba09107 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1316 microversion: 2.1 time: 0.163558 Nov 27 20:48:55.950513 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 504/1056] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:55 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:55.956472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:55.959720 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:55.959720 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:55.960701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:55.961346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:55.973091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.973536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:55.974333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:55.974763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.059146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:56.117215 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54908fec-b213-4eeb-9449-71cd80db4928 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.165366 Nov 27 20:48:56.117898 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 505/1057] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:48:55 2021] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:56.122305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fff39354-f395-4e90-9b90-4d818721e8c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:56.123210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fff39354-f395-4e90-9b90-4d818721e8c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:56.130807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fff39354-f395-4e90-9b90-4d818721e8c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.131324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fff39354-f395-4e90-9b90-4d818721e8c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.132332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fff39354-f395-4e90-9b90-4d818721e8c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.133022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fff39354-f395-4e90-9b90-4d818721e8c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.192379 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fff39354-f395-4e90-9b90-4d818721e8c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.073124 Nov 27 20:48:56.193038 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 506/1058] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:56 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:56.198609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-854b0a8e-9b91-4488-b42c-91ff5184b564 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.199470 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:56.199470 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:56.217777 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-854b0a8e-9b91-4488-b42c-91ff5184b564 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/44c36477-c127-4ecd-99d6-3a9a800a053f" status: 202 len: 0 microversion: 2.1 time: 0.023547 Nov 27 20:48:56.218518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 507/1059] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:48:56 2021] DELETE /compute/v2.1/flavors/44c36477-c127-4ecd-99d6-3a9a800a053f => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:48:56.224038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.224898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:56.232418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.232868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.233644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.234172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.300716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b5e1a6e-9c9c-48f0-b28b-adbe34db81ba tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/action" status: 202 len: 0 microversion: 2.25 time: 1.144087 Nov 27 20:48:56.301325 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 553/1060] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:48:55 2021] POST /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/action => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:48:56.306324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.311076 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:56.311076 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:56.312868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.314099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.servers [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Removing options 'limit' from query {{(pid=135680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 27 20:48:56.315082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:56.327838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.328282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.329305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.330374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.361438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3a162084-398c-44c8-b388-9952e8050874 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.058938 Nov 27 20:48:56.369050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 554/1061] 10.222.0.21 () {58 vars in 1139 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:56.373592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-561a3228-617a-4fb3-9a98-d6b7638bd369 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.394711 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-561a3228-617a-4fb3-9a98-d6b7638bd369 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.024413 Nov 27 20:48:56.399535 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 555/1062] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:56.407343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.407969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:56.414066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.414405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.414904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.419961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.420618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.423001 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e824af5-413a-45a3-8734-d47ae3e20914 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.202918 Nov 27 20:48:56.423693 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 508/1063] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:56.435890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.440028 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:56.440028 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:56.446448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.446448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-539822771', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:56.451752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.452218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.453076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.453501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.538878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:56.595294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.600987 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1197bb6d-d018-4c97-8c04-0114c19d9fc8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-539822771" status: 200 len: 345 microversion: 2.1 time: 0.169516 Nov 27 20:48:56.601823 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 509/1064] 10.222.0.21 () {58 vars in 1239 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-539822771 => generated 345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:56.605066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.606244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:56.606917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.607185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:56.608053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef4fd251-1d2c-481f-936e-0bf985313d92 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.207036 Nov 27 20:48:56.608818 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 556/1065] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:56.613651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.614102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.614879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.615344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.623926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2961c2af-2ad2-40bb-a744-37e645a9d71c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:56.630836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2961c2af-2ad2-40bb-a744-37e645a9d71c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.631405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2961c2af-2ad2-40bb-a744-37e645a9d71c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.643981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.649918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Old instance type tempest-test_resize_flavor_-1329446751, new instance type m1.heat {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 20:48:56.655895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:56.656313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:56.656785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:56.657313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:56.657761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:56.695953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2961c2af-2ad2-40bb-a744-37e645a9d71c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Going to try to stop instance {{(pid=135680) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 20:48:56.740214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b35859e-77cd-4736-80c8-4df2ad7a6366 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835/action" status: 202 len: 0 microversion: 2.1 time: 0.137002 Nov 27 20:48:56.740990 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 510/1066] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:56 2021] POST /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:48:56.745666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.746273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:56.754204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.754690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.755557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.756242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.761624 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2961c2af-2ad2-40bb-a744-37e645a9d71c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "POST /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620/action" status: 202 len: 0 microversion: 2.1 time: 0.140528 Nov 27 20:48:56.765568 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 557/1067] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:56 2021] POST /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:48:56.769375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-41ff48ca-3067-4e5b-a046-9608c1dd0cb4 req-29154f0e-cda8-4519-8888-6cc0f6a852a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615db49-b01d-4c93-94ea-1ce4a60493e4", "name": "network-vif-plugged", "status": "completed", "tag": "eabaf35a-0b10-4c47-9a45-f879a9b99282"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:56.771440 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:56.771440 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:48:56.780295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-41ff48ca-3067-4e5b-a046-9608c1dd0cb4 req-29154f0e-cda8-4519-8888-6cc0f6a852a9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.781164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-41ff48ca-3067-4e5b-a046-9608c1dd0cb4 req-29154f0e-cda8-4519-8888-6cc0f6a852a9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.795728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-41ff48ca-3067-4e5b-a046-9608c1dd0cb4 req-29154f0e-cda8-4519-8888-6cc0f6a852a9 service nova] Creating event network-vif-plugged:eabaf35a-0b10-4c47-9a45-f879a9b99282 for instance d615db49-b01d-4c93-94ea-1ce4a60493e4 on nch1-master-1 Nov 27 20:48:56.802784 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-41ff48ca-3067-4e5b-a046-9608c1dd0cb4 req-29154f0e-cda8-4519-8888-6cc0f6a852a9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038400 Nov 27 20:48:56.803784 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 558/1068] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:56.808890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.809581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:56.816707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.817158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.818001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.818486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.964151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:56.974761 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b287f2ff-4e0a-4e41-81e0-89b2e93e99f4 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.232866 Nov 27 20:48:56.983518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 511/1069] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:56.983518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:56.983518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:56.990240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.990829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:56.991826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:56.992549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.084028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:57.093034 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0215a24f-ebb7-4a54-8c42-e47a1001744a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1538 microversion: 2.1 time: 0.287157 Nov 27 20:48:57.094152 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 559/1070] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1538 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:57.103225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:57.103988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:57.110128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.110577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.112058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.112499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.187106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:57.195339 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28a89dc5-3316-4888-ad42-36a44c767b4f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.218728 Nov 27 20:48:57.196104 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 512/1071] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:56 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:57.207401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48ef10ca-b1ad-45f7-90c6-ab418a20579b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:57.208424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48ef10ca-b1ad-45f7-90c6-ab418a20579b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:57.214778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48ef10ca-b1ad-45f7-90c6-ab418a20579b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.215228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48ef10ca-b1ad-45f7-90c6-ab418a20579b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.216170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48ef10ca-b1ad-45f7-90c6-ab418a20579b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.216554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48ef10ca-b1ad-45f7-90c6-ab418a20579b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.271088 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48ef10ca-b1ad-45f7-90c6-ab418a20579b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.067863 Nov 27 20:48:57.275005 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 513/1072] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:57 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:57.275175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:57.282745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-33d9b01d-9275-4b81-a255-099a217e7b66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1465 microversion: 2.1 time: 0.186455 Nov 27 20:48:57.283783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 560/1073] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:57 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1465 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:57.352421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e935e02-41c5-4f40-bbfc-357ce66f7d2e tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:57.353116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e935e02-41c5-4f40-bbfc-357ce66f7d2e tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:57.360063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e935e02-41c5-4f40-bbfc-357ce66f7d2e tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.360510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e935e02-41c5-4f40-bbfc-357ce66f7d2e tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.361358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e935e02-41c5-4f40-bbfc-357ce66f7d2e tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.361767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e935e02-41c5-4f40-bbfc-357ce66f7d2e tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.440359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:57.441094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:57.448856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.449675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.450399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.450840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.651214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:57.660172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ebe51de-f73f-4918-9177-e39d4b3d5185 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.223709 Nov 27 20:48:57.664111 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 561/1074] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:57 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:57.677383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:57.678264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:57.686397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.686851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.687674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:57.688116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:57.695181 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e935e02-41c5-4f40-bbfc-357ce66f7d2e tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1616 microversion: 2.1 time: 0.398487 Nov 27 20:48:57.696300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 514/1075] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:57 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1616 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:57.712086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d457a94-188e-44ce-93bf-063dbfa821cd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: .version_select at 0x7f15c7a254c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-796105363", "policies": ["affinity"]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:57.731225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-3d457a94-188e-44ce-93bf-063dbfa821cd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:57.735427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-3d457a94-188e-44ce-93bf-063dbfa821cd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:57.805106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-3d457a94-188e-44ce-93bf-063dbfa821cd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:57.812405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-3d457a94-188e-44ce-93bf-063dbfa821cd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:57.828826 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d457a94-188e-44ce-93bf-063dbfa821cd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.120357 Nov 27 20:48:57.830354 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 515/1076] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 20:48:57 2021] POST /compute/v2.1/os-server-groups => generated 187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:48:57.889673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-836808307", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "19ef2532-367d-4b30-bcf3-220fa35a38fe"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:57.906557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:57.916556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:57.918043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:57.919953 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2058cbe9-4e7a-4c05-b5b0-78307f13b3ef tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.254043 Nov 27 20:48:57.920841 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 562/1077] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:57 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:57.977635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:48:57.992019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:57.992620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:58.000201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.000697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.001568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.002004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.162917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:58.170425 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c849ea32-04a3-4dfc-8c6e-0d5dc131ea4b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1332 microversion: 2.1 time: 0.181963 Nov 27 20:48:58.171182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 563/1078] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:57 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:58.183786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:58.184391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:58.190841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.191193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.192006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.192448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.248987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:48:58.250238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:48:58.250944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:48:58.252196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:48:58.252831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:48:58.280799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.281353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.283086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.283617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.308280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:58.320096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:58.340128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Going to run 2 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:48:58.343792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:58.358308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:58.367577 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78d8dba3-0d91-4b54-8e39-c353a7374772 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1538 microversion: 2.1 time: 0.187011 Nov 27 20:48:58.370393 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 564/1079] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:58 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1538 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:58.375095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:58.379774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:58.396748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.399300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.400572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.401301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.405869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=135679) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Nov 27 20:48:58.427604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:58.431678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:58.489515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:58.493832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:58.509868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=21735147-42d2-4c01-a74b-7ac91c6ac723,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:48:58.582302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:58.587978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:58.643661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:48:58.648349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:48:58.698424 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efd36fff-dc6e-451c-9db3-353f8e20b86d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.811787 Nov 27 20:48:58.703917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 516/1080] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:48:57 2021] POST /compute/v2.1/servers => generated 32 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Nov 27 20:48:58.711067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0926e51a-f0f4-45b1-9400-5c6430b89f56 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:58.712528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0926e51a-f0f4-45b1-9400-5c6430b89f56 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:58.719289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0926e51a-f0f4-45b1-9400-5c6430b89f56 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.719876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0926e51a-f0f4-45b1-9400-5c6430b89f56 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.721790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0926e51a-f0f4-45b1-9400-5c6430b89f56 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.722235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0926e51a-f0f4-45b1-9400-5c6430b89f56 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.742045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:58.756265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-305fad36-b4ba-48ea-bcf5-121274862afb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.384402 Nov 27 20:48:58.757094 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 565/1081] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:58 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:58.769442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:58.770477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:58.779719 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0926e51a-f0f4-45b1-9400-5c6430b89f56 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.074337 Nov 27 20:48:58.779973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.784279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.784462 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 517/1082] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:58 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:48:58.784553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.784553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.788248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:58.791662 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:48:58.791662 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:48:58.793048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:58.793798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Searching by: {'deleted': False, 'project_id': 'c03fae8406904a0da2046c097555cf58'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:48:58.817562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.818061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.818903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:58.819465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:58.870528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:48:58.912020 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84432e8d-a69a-4856-99ef-7c5d0424d7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.124682 Nov 27 20:48:58.915298 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 518/1083] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:48:58 2021] GET /compute/v2.1/servers => generated 1001 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:58.922785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46f22d11-d056-47c8-9abc-1e1029d6b7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:58.924289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46f22d11-d056-47c8-9abc-1e1029d6b7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:59.002594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46f22d11-d056-47c8-9abc-1e1029d6b7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.011046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46f22d11-d056-47c8-9abc-1e1029d6b7f1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1218 microversion: 2.1 time: 0.091939 Nov 27 20:48:59.015397 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 519/1084] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:58 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:59.022979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:59.024373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:59.034927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.035574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.036988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.037535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.071940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.085208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a388d721-07a0-4beb-9fd4-1c6533774406 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.325784 Nov 27 20:48:59.086077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 566/1085] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:58 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:59.190186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:59.191197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:59.200140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.200922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.202541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.203235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.228792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.238440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.241158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.242764 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70f4d82b-5d8f-4338-a287-771c2f778d91 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.230200 Nov 27 20:48:59.243674 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 520/1086] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:48:59 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:48:59.370099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.377824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-838c40cd-cd22-4a37-aee8-019ea1530091 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1535 microversion: 2.1 time: 0.194480 Nov 27 20:48:59.378439 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 567/1087] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:59 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1535 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:59.387560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:59.388261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:59.397554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85497bb3-cd98-4993-9955-1e456186bbc5 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'create', calling method: .version_select at 0x7f15d449e700>, body: {"pool": "7e46e7ab-0203-480f-9b07-f121716d4c61"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:59.400169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.400973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.402238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.402363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.577095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.588409 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7323275-b055-4820-82e8-f777f8fc35c0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.204722 Nov 27 20:48:59.589302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 521/1088] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:59 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:48:59.776595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:48:59.777800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:59.786359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.786900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.788095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.788760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.948046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:48:59.955542 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d74a814-4724-4d1d-8f2c-d3028e2cdb8d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.185532 Nov 27 20:48:59.957294 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 522/1089] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:48:59 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:48:59.961966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-968d5443-0a20-4790-a935-91fb9416c2d4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:48:59.962951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-968d5443-0a20-4790-a935-91fb9416c2d4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:48:59.968903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-968d5443-0a20-4790-a935-91fb9416c2d4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.969357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-968d5443-0a20-4790-a935-91fb9416c2d4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:48:59.970189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-968d5443-0a20-4790-a935-91fb9416c2d4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:48:59.970773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-968d5443-0a20-4790-a935-91fb9416c2d4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.019457 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-968d5443-0a20-4790-a935-91fb9416c2d4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.060520 Nov 27 20:49:00.021325 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 523/1090] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:48:59 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:00.028797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-277f7231-dab7-4bf0-b189-3b4d284491e4 req-e05ae814-8547-4ee9-94b0-9e65772b4f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96245ad6-b6b6-4017-aff5-81689a46b3a3", "name": "network-vif-plugged", "status": "completed", "tag": "91a3e20c-c74b-4366-a10a-a264f88012cb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:00.030847 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:00.030847 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:00.042720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-277f7231-dab7-4bf0-b189-3b4d284491e4 req-e05ae814-8547-4ee9-94b0-9e65772b4f67 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.043184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-277f7231-dab7-4bf0-b189-3b4d284491e4 req-e05ae814-8547-4ee9-94b0-9e65772b4f67 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.057779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-277f7231-dab7-4bf0-b189-3b4d284491e4 req-e05ae814-8547-4ee9-94b0-9e65772b4f67 service nova] Creating event network-vif-plugged:91a3e20c-c74b-4366-a10a-a264f88012cb for instance 96245ad6-b6b6-4017-aff5-81689a46b3a3 on nch2-master-1 Nov 27 20:49:00.063169 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-277f7231-dab7-4bf0-b189-3b4d284491e4 req-e05ae814-8547-4ee9-94b0-9e65772b4f67 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039554 Nov 27 20:49:00.064436 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 524/1091] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:00.069281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:00.070073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:00.079276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.079773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.080581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.081093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.167950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:00.176331 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48cafc53-c88a-45f1-9a3d-55076b45730a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1214 microversion: 2.1 time: 0.110684 Nov 27 20:49:00.184268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 525/1092] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:00 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:00.184268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:00.184268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:00.188315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.188882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.192055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.192585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.346116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:00.355404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f1c97131-0699-4f8a-ae82-46a918c24658 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.176969 Nov 27 20:49:00.356259 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 526/1093] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:00 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:00.362068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b338370b-f753-426d-aae9-daea1fc293ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:00.363377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b338370b-f753-426d-aae9-daea1fc293ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:00.369936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b338370b-f753-426d-aae9-daea1fc293ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.370380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b338370b-f753-426d-aae9-daea1fc293ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.371155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b338370b-f753-426d-aae9-daea1fc293ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.371629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b338370b-f753-426d-aae9-daea1fc293ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.405525 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b338370b-f753-426d-aae9-daea1fc293ff tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048074 Nov 27 20:49:00.406437 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 527/1094] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:49:00 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:00.411963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:00.412564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:00.418430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.418868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.419850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.420285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.564186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:00.574058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:00.575820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:00.577182 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70a01c47-12e0-41b1-a121-cfcb303c34b2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.169794 Nov 27 20:49:00.586866 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 528/1095] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:00 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:00.586866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:00.586866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:00.593663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.594493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.595983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:00.596464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:00.894489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lazy-loading 'services' on Instance uuid 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:01.009536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8556e084-d402-4d41-a2be-8c7d838ef083 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "DELETE /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments/5fd33332-c012-4d3f-89d3-348f26863f24" status: 202 len: 0 microversion: 2.1 time: 0.430351 Nov 27 20:49:01.010190 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 529/1096] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 20:49:00 2021] DELETE /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments/5fd33332-c012-4d3f-89d3-348f26863f24 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:49:01.021089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:01.021912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:01.033644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.034766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.036004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.037682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.277717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:01.287949 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aa636a11-eb0b-4f92-ac49-a001a7500e59 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.275354 Nov 27 20:49:01.288584 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 530/1097] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:01 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:01.294427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:01.295280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:01.303380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.304596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.305477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.305916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.458277 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85497bb3-cd98-4993-9955-1e456186bbc5 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.065746 Nov 27 20:49:01.460303 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 568/1098] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:48:59 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:01.465849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6828ed21-8bbb-4d8c-8a3d-8a108aa9f394 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:01.469108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6828ed21-8bbb-4d8c-8a3d-8a108aa9f394 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:01.479823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6828ed21-8bbb-4d8c-8a3d-8a108aa9f394 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.481266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6828ed21-8bbb-4d8c-8a3d-8a108aa9f394 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.482469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6828ed21-8bbb-4d8c-8a3d-8a108aa9f394 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.483080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6828ed21-8bbb-4d8c-8a3d-8a108aa9f394 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.556478 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6828ed21-8bbb-4d8c-8a3d-8a108aa9f394 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.093426 Nov 27 20:49:01.558643 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 569/1099] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:01 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:01.565854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:01.566572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:01.575584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.576470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.577424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.578025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.671707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:01.680485 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a0497b8-a1e6-42ed-ba9b-cd839c71d78d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1276 microversion: 2.1 time: 0.120429 Nov 27 20:49:01.681158 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 570/1100] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:01 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:01.685934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:01.686783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:01.694108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.694698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.695739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.696235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.748917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:01.758678 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa4ec5e5-d30d-40f9-afd7-97ad2d8c553e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.468533 Nov 27 20:49:01.769557 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 531/1101] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:01 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:01.780108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.197"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:01.781352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:01.789277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.789277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.789656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:01.790045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:01.839245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Acquired lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:49:02.047693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:02.057587 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dfb86abe-ec2c-4fa8-8493-3effb54e8307 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1311 microversion: 2.1 time: 0.375131 Nov 27 20:49:02.060025 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 571/1102] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:01 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1311 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:02.070695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:02.074949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:02.084926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:02.086621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:02.087366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:02.087814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:02.461104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:02.481349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:02.483137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:02.484568 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-31ba9886-0e01-46a1-a5f8-f8f52d7e5233 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.423595 Nov 27 20:49:02.485333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 572/1103] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:02 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:02.490629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7a376965-04d2-495e-86e6-4296585615d5 req-4272537b-8689-46da-a9ce-701671f9cee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be38ef7-cbe4-41c9-8180-148457627022", "name": "network-vif-unplugged", "status": "completed", "tag": "f6b877dc-2544-4729-b562-12b62148f13d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:02.492284 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:02.492284 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:02.512216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7a376965-04d2-495e-86e6-4296585615d5 req-4272537b-8689-46da-a9ce-701671f9cee1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:02.512854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7a376965-04d2-495e-86e6-4296585615d5 req-4272537b-8689-46da-a9ce-701671f9cee1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:02.545043 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7a376965-04d2-495e-86e6-4296585615d5 req-4272537b-8689-46da-a9ce-701671f9cee1 service nova] Creating event network-vif-unplugged:f6b877dc-2544-4729-b562-12b62148f13d for instance 5be38ef7-cbe4-41c9-8180-148457627022 on nch2-master-1 Nov 27 20:49:02.553488 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7a376965-04d2-495e-86e6-4296585615d5 req-4272537b-8689-46da-a9ce-701671f9cee1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065830 Nov 27 20:49:02.555521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 573/1104] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:02.565664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:02.566748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:02.583422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:02.585862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:02.588045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:02.592584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.011238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:03.020450 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-417ae317-6fd7-4e3e-8d39-81abebcc1ce0 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.463426 Nov 27 20:49:03.021037 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 574/1105] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:02 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:03.031656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19f1785b-f639-4df0-a2b4-0db997da17f6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:03.034709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19f1785b-f639-4df0-a2b4-0db997da17f6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:03.046433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19f1785b-f639-4df0-a2b4-0db997da17f6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.049516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19f1785b-f639-4df0-a2b4-0db997da17f6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.050697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19f1785b-f639-4df0-a2b4-0db997da17f6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.051375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19f1785b-f639-4df0-a2b4-0db997da17f6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.133722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19f1785b-f639-4df0-a2b4-0db997da17f6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.106620 Nov 27 20:49:03.136079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 575/1106] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:03 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:03.145055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:03.146297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:03.160599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.161512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.163318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.163994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.395201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:03.395201 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f16599f7-2f2c-4cd8-b00a-88f286d38294 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.253753 Nov 27 20:49:03.395201 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 576/1107] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:03 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:03.403916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:03.404252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:03.425299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.426022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.427043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.427519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.677161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:03.684858 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e55ef27c-17fe-418e-8a0f-e098dc93f772 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.290756 Nov 27 20:49:03.695391 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 577/1108] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:03 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:03.695391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:03.698147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:03.705734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.706444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.707460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.708082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.906094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:03.916035 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04cd98c2-5596-4447-9aff-c4f79621a4fc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1494 microversion: 2.1 time: 0.228967 Nov 27 20:49:03.917464 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 578/1109] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:03 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1494 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:03.922605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e980ec9-7df6-4203-8824-6f4418d06de0 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:03.924428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e980ec9-7df6-4203-8824-6f4418d06de0 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:03.934797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e980ec9-7df6-4203-8824-6f4418d06de0 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.935357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e980ec9-7df6-4203-8824-6f4418d06de0 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:03.936239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e980ec9-7df6-4203-8824-6f4418d06de0 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:03.936677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e980ec9-7df6-4203-8824-6f4418d06de0 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:04.210714 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e980ec9-7df6-4203-8824-6f4418d06de0 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.291978 Nov 27 20:49:04.211412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 579/1110] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:49:03 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments => generated 25 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:49:04.216310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:04.217251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:04.226262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:04.226704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:04.227619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:04.228306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:04.350312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Building network info cache for instance {{(pid=135679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:49:04.518378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:04.535144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:04.538652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:04.541498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e338cbf-7d84-41c3-ae34-6ff0623233d9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.328077 Nov 27 20:49:04.553542 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 580/1111] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:04 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:04.553542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0ab64603-9270-4c60-abd5-b712a92d3e3d req-4ffb134f-8661-4e27-b887-4d52119e0d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6c668f-a112-487a-83a3-dd50f8dc252b", "tag": "062acbc0-509c-4546-aa47-d13c4188e1bf"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:04.553542 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:04.553542 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:04.569922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0ab64603-9270-4c60-abd5-b712a92d3e3d req-4ffb134f-8661-4e27-b887-4d52119e0d43 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:04.571134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0ab64603-9270-4c60-abd5-b712a92d3e3d req-4ffb134f-8661-4e27-b887-4d52119e0d43 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:04.587038 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0ab64603-9270-4c60-abd5-b712a92d3e3d req-4ffb134f-8661-4e27-b887-4d52119e0d43 service nova] Creating event network-changed:062acbc0-509c-4546-aa47-d13c4188e1bf for instance 4d6c668f-a112-487a-83a3-dd50f8dc252b on nch2-master-1 Nov 27 20:49:04.594558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0ab64603-9270-4c60-abd5-b712a92d3e3d req-4ffb134f-8661-4e27-b887-4d52119e0d43 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046923 Nov 27 20:49:04.596226 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 581/1112] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:04.602090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-309af4d9-b49c-4e28-ae6b-1032b4ad9bcf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:04.603020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-309af4d9-b49c-4e28-ae6b-1032b4ad9bcf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:04.610385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309af4d9-b49c-4e28-ae6b-1032b4ad9bcf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:04.611682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309af4d9-b49c-4e28-ae6b-1032b4ad9bcf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:04.612662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309af4d9-b49c-4e28-ae6b-1032b4ad9bcf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:04.613262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309af4d9-b49c-4e28-ae6b-1032b4ad9bcf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:04.841388 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-309af4d9-b49c-4e28-ae6b-1032b4ad9bcf tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1645 microversion: 2.1 time: 0.243019 Nov 27 20:49:04.843575 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 582/1113] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:04 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1645 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:04.850804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:04.851673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:04.859222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:04.859908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:04.861509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:04.864338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.085426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Updating instance_info_cache with network_info: [{"id": "eabaf35a-0b10-4c47-9a45-f879a9b99282", "address": "fa:16:3e:d5:70:b2", "network": {"id": "60e77827-dbf6-4642-b5e9-3d8f4c2fcaa9", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-367222729-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e11cec7060094963bccef4d0cadba71d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapeabaf35a-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:49:05.098062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Releasing lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:49:05.098913 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d93ed8a-3b8f-46c8-84b8-229f7672dbef tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action" status: 202 len: 0 microversion: 2.1 time: 3.323165 Nov 27 20:49:05.103312 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 532/1114] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:01 2021] POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action => generated 0 bytes in 3333 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:49:05.108526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-80651877-28a3-4e2a-b46b-e9e4f616b658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:05.109535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-80651877-28a3-4e2a-b46b-e9e4f616b658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:05.116171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80651877-28a3-4e2a-b46b-e9e4f616b658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.116623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80651877-28a3-4e2a-b46b-e9e4f616b658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.117399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80651877-28a3-4e2a-b46b-e9e4f616b658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.118254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80651877-28a3-4e2a-b46b-e9e4f616b658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.136483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:05.147867 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-82cca887-cf49-40ce-93b8-7fa54b024074 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.302685 Nov 27 20:49:05.148582 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 583/1115] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:04 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:05.154636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02299060-3955-4f86-8d82-7aedd422219b tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:05.155751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02299060-3955-4f86-8d82-7aedd422219b tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:05.163835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02299060-3955-4f86-8d82-7aedd422219b tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.164153 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-80651877-28a3-4e2a-b46b-e9e4f616b658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.059354 Nov 27 20:49:05.164664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02299060-3955-4f86-8d82-7aedd422219b tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.165162 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 533/1116] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:05 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:05.165531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02299060-3955-4f86-8d82-7aedd422219b tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.166934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02299060-3955-4f86-8d82-7aedd422219b tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.170311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:05.171004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:05.177996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.178556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.179408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.179849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.203302 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02299060-3955-4f86-8d82-7aedd422219b tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053019 Nov 27 20:49:05.203930 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 584/1117] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:49:05 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:49:05.214536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f67d8d10-6bc9-4772-a14e-a7b09eaa0558 req-6bb161e7-e9da-4ed8-986f-f4b78cbca0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be38ef7-cbe4-41c9-8180-148457627022", "tag": "f6b877dc-2544-4729-b562-12b62148f13d"}, {"name": "network-changed", "server_uuid": "21735147-42d2-4c01-a74b-7ac91c6ac723", "tag": "381881ef-aefe-442f-b7f9-355ca72b0903"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:05.216301 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:05.216301 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:05.224847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f67d8d10-6bc9-4772-a14e-a7b09eaa0558 req-6bb161e7-e9da-4ed8-986f-f4b78cbca0f6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.225229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f67d8d10-6bc9-4772-a14e-a7b09eaa0558 req-6bb161e7-e9da-4ed8-986f-f4b78cbca0f6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.242243 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f67d8d10-6bc9-4772-a14e-a7b09eaa0558 req-6bb161e7-e9da-4ed8-986f-f4b78cbca0f6 service nova] Creating event network-changed:f6b877dc-2544-4729-b562-12b62148f13d for instance 5be38ef7-cbe4-41c9-8180-148457627022 on nch2-master-1 Nov 27 20:49:05.243216 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f67d8d10-6bc9-4772-a14e-a7b09eaa0558 req-6bb161e7-e9da-4ed8-986f-f4b78cbca0f6 service nova] Creating event network-changed:381881ef-aefe-442f-b7f9-355ca72b0903 for instance 21735147-42d2-4c01-a74b-7ac91c6ac723 on nch2-master-1 Nov 27 20:49:05.251865 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f67d8d10-6bc9-4772-a14e-a7b09eaa0558 req-6bb161e7-e9da-4ed8-986f-f4b78cbca0f6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039785 Nov 27 20:49:05.252831 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 585/1118] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:05 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:05.261166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:05.263290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:05.278970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.281833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.285465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.286495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.396892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:05.404662 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54eea7db-5eaa-48af-88a3-bea3cf74267a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.237988 Nov 27 20:49:05.406172 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 534/1119] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:05 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:05.411952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68faf200-e740-4c2f-8bef-c2291f06be6f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:05.413622 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:05.413622 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:05.415777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68faf200-e740-4c2f-8bef-c2291f06be6f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.416354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68faf200-e740-4c2f-8bef-c2291f06be6f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.417299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68faf200-e740-4c2f-8bef-c2291f06be6f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.418172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68faf200-e740-4c2f-8bef-c2291f06be6f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.455455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68faf200-e740-4c2f-8bef-c2291f06be6f tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046948 Nov 27 20:49:05.456709 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 535/1120] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:49:05 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:05.461541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-82e6f525-6d78-4c24-af61-c3b241475516 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'create', calling method: .version_select at 0x7f15c7ca0550>, body: {"pool": "7e46e7ab-0203-480f-9b07-f121716d4c61"} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:05.561960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:05.578795 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-200f7ceb-80ea-4095-89f0-72695a2146cb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.324027 Nov 27 20:49:05.580595 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 586/1121] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:05 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:05.585580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:05.586802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:05.602209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.603566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.605200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.605653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.638527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:49:05.760494 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d413a56-a4fd-4963-b7a6-1ad0988034d1 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "DELETE /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 204 len: 0 microversion: 2.1 time: 0.178008 Nov 27 20:49:05.761342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 587/1122] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:49:05 2021] DELETE /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:49:05.777207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:05.777966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:05.785897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.786398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:05.787356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:05.787785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.022540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:06.032888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:06.034844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:06.036407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9904f41a-2c94-4235-91a6-fa5bad3ddc9d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.266614 Nov 27 20:49:06.047580 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 588/1123] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:05 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:06.052573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:06.053328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:06.059848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.060411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.061401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.061968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.227192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:06.234544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-039a7341-9f20-437a-aa3d-50d434e4fd70 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1515 microversion: 2.1 time: 0.185752 Nov 27 20:49:06.235113 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 589/1124] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:06 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:06.249694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:06.250706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:06.258290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.258863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.259673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.260111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.402629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:06.410558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e8ba0581-0c80-4abc-8229-2eff0381d7cc tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.164361 Nov 27 20:49:06.411138 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 590/1125] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:06 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:06.415805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-318dc225-e4c1-4381-b6f2-933add150985 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:06.417311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-318dc225-e4c1-4381-b6f2-933add150985 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:06.423345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-318dc225-e4c1-4381-b6f2-933add150985 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.423808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-318dc225-e4c1-4381-b6f2-933add150985 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.424608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-318dc225-e4c1-4381-b6f2-933add150985 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.425051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-318dc225-e4c1-4381-b6f2-933add150985 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.469291 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-318dc225-e4c1-4381-b6f2-933add150985 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.056890 Nov 27 20:49:06.473511 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 591/1126] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:06 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:06.475431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:06.476123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:06.483017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.483502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.484285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.484725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.621183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:06.629172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cae0f901-16d1-44bb-b53c-6a511ab7a880 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.157559 Nov 27 20:49:06.629743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 592/1127] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:06 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:06.634087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:06.634690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:06.640443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.640892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.642240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.642680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.778583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:06.786977 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23ee4fcc-25fd-45eb-92d5-78118937d9e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.156234 Nov 27 20:49:06.787590 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 593/1128] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:06 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:06.791980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-90fd5173-49e6-44c4-bd9c-79688c56afda req-31860088-b025-4eba-be01-8881b4976556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d615db49-b01d-4c93-94ea-1ce4a60493e4", "tag": "eabaf35a-0b10-4c47-9a45-f879a9b99282"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:06.793548 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:06.793548 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:06.800689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-90fd5173-49e6-44c4-bd9c-79688c56afda req-31860088-b025-4eba-be01-8881b4976556 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.801146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-90fd5173-49e6-44c4-bd9c-79688c56afda req-31860088-b025-4eba-be01-8881b4976556 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.816989 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-90fd5173-49e6-44c4-bd9c-79688c56afda req-31860088-b025-4eba-be01-8881b4976556 service nova] Creating event network-changed:eabaf35a-0b10-4c47-9a45-f879a9b99282 for instance d615db49-b01d-4c93-94ea-1ce4a60493e4 on nch1-master-1 Nov 27 20:49:06.821863 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-90fd5173-49e6-44c4-bd9c-79688c56afda req-31860088-b025-4eba-be01-8881b4976556 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033169 Nov 27 20:49:06.822553 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 594/1129] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:06.985450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b14533d9-f939-4624-ad41-41738f650b8a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc5e1853-9753-4aec-9663-f67f2c4249be", "device": "/dev/xvdb"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:06.987866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b14533d9-f939-4624-ad41-41738f650b8a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:06.994404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14533d9-f939-4624-ad41-41738f650b8a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.994862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14533d9-f939-4624-ad41-41738f650b8a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:06.995696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14533d9-f939-4624-ad41-41738f650b8a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:06.996163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14533d9-f939-4624-ad41-41738f650b8a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.335036 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b14533d9-f939-4624-ad41-41738f650b8a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "POST /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353534 Nov 27 20:49:07.339964 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 595/1130] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:49:06 2021] POST /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:07.353717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:07.355148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:07.373538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.373994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.375401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.376223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.619755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:07.629866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:07.631460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:07.632676 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-95454d62-ca04-407c-bb27-62e3aa4752fa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.291620 Nov 27 20:49:07.633235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 596/1131] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:07 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:07.637771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:07.638578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:07.646330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.647035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.648015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.648622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.796552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-82e6f525-6d78-4c24-af61-c3b241475516 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.338509 Nov 27 20:49:07.803960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 536/1132] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:49:05 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:07.809655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:07.810245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:07.817854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.818321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.819458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.819960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.908390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:07.925195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1d6839c6-3963-48ea-918a-7b343d619567 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1515 microversion: 2.1 time: 0.290724 Nov 27 20:49:07.925804 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 597/1133] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:07 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:07.942873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-67b11728-28de-4bc0-965f-6b3c90edbcf7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:07.944177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-67b11728-28de-4bc0-965f-6b3c90edbcf7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:07.967630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b11728-28de-4bc0-965f-6b3c90edbcf7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.968099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b11728-28de-4bc0-965f-6b3c90edbcf7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:07.970121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b11728-28de-4bc0-965f-6b3c90edbcf7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:07.970582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b11728-28de-4bc0-965f-6b3c90edbcf7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.009119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:08.017993 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24a0f4cb-fc7e-4cae-8731-ac1bd3497d6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.212626 Nov 27 20:49:08.030465 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 537/1134] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:07 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:08.030465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:08.030465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:08.033175 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-67b11728-28de-4bc0-965f-6b3c90edbcf7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.105503 Nov 27 20:49:08.037672 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 598/1135] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:07 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:08.038531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.038993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.040003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.040602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.044282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:08.045160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:08.052736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.053423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.054458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.055088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.207548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:08.214813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fee45e6a-fa25-4b19-8918-7585054810aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.192002 Nov 27 20:49:08.215882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 538/1136] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:08 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:08.229540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.189"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:08.230994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:08.237791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.238554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.239602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.240284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.249497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:08.258878 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9887e51f-a262-4655-aa31-7e3001fdc057 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.219391 Nov 27 20:49:08.271278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 599/1137] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:08 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:08.273729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Acquired lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:49:08.653982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:08.654590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:08.663338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.663862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.664920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.665473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.698200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.3.189 (329c2187-88e5-4338-82ca-8dcac2295acb) with port eabaf35a-0b10-4c47-9a45-f879a9b99282 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7e46e7ab-0203-480f-9b07-f121716d4c61.", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:49:08.698820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Releasing lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:49:08.700019 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] HTTP exception thrown: Cannot associate floating IP 172.35.3.189 (329c2187-88e5-4338-82ca-8dcac2295acb) with port eabaf35a-0b10-4c47-9a45-f879a9b99282 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7e46e7ab-0203-480f-9b07-f121716d4c61. Nov 27 20:49:08.700019 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-3cdbffb5-28e3-4eb5-a4a0-b944a60ca9f6'] Nov 27 20:49:08.701120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Returning 400 to user: Cannot associate floating IP 172.35.3.189 (329c2187-88e5-4338-82ca-8dcac2295acb) with port eabaf35a-0b10-4c47-9a45-f879a9b99282 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 7e46e7ab-0203-480f-9b07-f121716d4c61. Nov 27 20:49:08.701120 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-3cdbffb5-28e3-4eb5-a4a0-b944a60ca9f6'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:08.702383 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49998d27-605c-4227-91b9-bd72b895a8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action" status: 400 len: 381 microversion: 2.1 time: 0.476502 Nov 27 20:49:08.703035 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 539/1138] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:08 2021] POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action => generated 381 bytes in 478 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:49:08.712771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72190533-8b80-454c-87fd-8e91b2a66511 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '.version_select at 0x7f15c7cafee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:08.862673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:08.873674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:08.875193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:08.876473 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a44cff0-e9fc-4d15-81a8-2b57b1a093de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.226317 Nov 27 20:49:08.877033 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 600/1139] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:08 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:08.881646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-192f423f-2302-48f5-8456-ce30a0d55fb4 req-04edc16f-366f-4fcd-9952-74027adf70f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eee3c3-56bb-48c8-b5fc-f88ab39670f0", "name": "network-vif-deleted", "tag": "64da879e-2956-4a5b-a220-c740193b8ae4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:08.883364 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:08.883364 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:08.890876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-192f423f-2302-48f5-8456-ce30a0d55fb4 req-04edc16f-366f-4fcd-9952-74027adf70f1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.891366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-192f423f-2302-48f5-8456-ce30a0d55fb4 req-04edc16f-366f-4fcd-9952-74027adf70f1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.903762 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-192f423f-2302-48f5-8456-ce30a0d55fb4 req-04edc16f-366f-4fcd-9952-74027adf70f1 service nova] Creating event network-vif-deleted:64da879e-2956-4a5b-a220-c740193b8ae4 for instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 on nch1-master-1 Nov 27 20:49:08.910841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-192f423f-2302-48f5-8456-ce30a0d55fb4 req-04edc16f-366f-4fcd-9952-74027adf70f1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 Nov 27 20:49:08.915207 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 601/1140] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:08.947977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:08.949075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:08.955693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.956151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:08.956964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:08.957410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.004759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.005221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.005684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lazy-loading 'fault' on Instance uuid 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:09.049429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4230d9b8ef6540bfbc4f034885d418e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0433d36494c339de083939adfa30d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:09.057402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9cb21e52-6d47-4bee-a182-4091e0affa99 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 200 len: 1308 microversion: 2.1 time: 0.118638 Nov 27 20:49:09.058172 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 602/1141] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:08 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:09.062554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:09.063161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:09.069197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.069660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.070458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.070911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.223053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:09.231465 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99b6f201-5df9-404d-810f-522a2eaeee68 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.172188 Nov 27 20:49:09.232085 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 603/1142] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:09 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:09.237385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00a6c828-b8e3-40e4-a7c4-0adfb0c9c10a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:09.238439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00a6c828-b8e3-40e4-a7c4-0adfb0c9c10a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:09.244517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a6c828-b8e3-40e4-a7c4-0adfb0c9c10a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.244979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a6c828-b8e3-40e4-a7c4-0adfb0c9c10a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.245774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a6c828-b8e3-40e4-a7c4-0adfb0c9c10a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.246216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a6c828-b8e3-40e4-a7c4-0adfb0c9c10a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.288677 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00a6c828-b8e3-40e4-a7c4-0adfb0c9c10a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.055327 Nov 27 20:49:09.289534 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 604/1143] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:09 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:09.294301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:09.294997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:09.302633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.303087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.303912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.304385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.450802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:09.459669 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f1d4b14-9857-489a-8b72-47095d4de39d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.168794 Nov 27 20:49:09.463428 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 605/1144] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:09 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:09.465300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:09.465914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:09.473145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.473597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.474400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.474850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.640829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:09.647392 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72190533-8b80-454c-87fd-8e91b2a66511 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/329c2187-88e5-4338-82ca-8dcac2295acb" status: 202 len: 0 microversion: 2.1 time: 0.939201 Nov 27 20:49:09.648479 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 540/1145] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:49:08 2021] DELETE /compute/v2.1/os-floating-ips/329c2187-88e5-4338-82ca-8dcac2295acb => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:49:09.649102 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-84ef4ae5-3b8d-4bda-a6a2-651d45a55ae5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.187441 Nov 27 20:49:09.649671 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 606/1146] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:09 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:09.656190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.197"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:09.786568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:09.793569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.794211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.795012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.795500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.894473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:09.895079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:09.901828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.902280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:09.903060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:09.903543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.039682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:10.048633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:10.050256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:10.051483 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dda663a5-0efa-4ee1-af38-3e920d64c089 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.161329 Nov 27 20:49:10.052082 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 607/1147] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:09 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:49:10.074657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:10.075296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:10.083790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.084754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.085693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.086689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.086819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Acquired lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:49:10.101391 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] HTTP exception thrown: Instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 could not be found. Nov 27 20:49:10.101993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Returning 404 to user: Instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:10.102981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35047fd8-3dc3-4662-8f56-b8483c62f236 tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 404 len: 111 microversion: 2.1 time: 0.032789 Nov 27 20:49:10.103778 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 608/1148] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:10 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:49:10.249365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:10.250060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:10.261914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.262379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.263180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.263651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.418241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:10.432977 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5fce5217-c701-44a9-8011-e43b96e92da8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.187280 Nov 27 20:49:10.443358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 609/1149] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:10 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:10.443358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7283b859-1c61-42c0-b6d6-5cc96663de11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:10.443358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7283b859-1c61-42c0-b6d6-5cc96663de11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:10.446469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7283b859-1c61-42c0-b6d6-5cc96663de11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.446925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7283b859-1c61-42c0-b6d6-5cc96663de11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.447753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7283b859-1c61-42c0-b6d6-5cc96663de11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.448195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7283b859-1c61-42c0-b6d6-5cc96663de11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.498373 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7283b859-1c61-42c0-b6d6-5cc96663de11 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.063435 Nov 27 20:49:10.499035 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 610/1150] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:10 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:10.511830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:10.512539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:10.519922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.520581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.521105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.521546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.698745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:10.712207 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4bbaa80-d7d7-4d5c-a7f1-a08f439e5204 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.211578 Nov 27 20:49:10.712909 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 611/1151] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:10 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:10.717894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:10.718893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:10.726553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.727052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.727948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.728425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.900461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:10.910078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d45e8a65-0c30-4ecb-9a64-2febb9e752a2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.195823 Nov 27 20:49:10.913335 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 612/1152] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:10 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:10.919274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ab4d5f7-e6c0-44dc-80f2-06fa90e01b4d tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:10.920189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9ab4d5f7-e6c0-44dc-80f2-06fa90e01b4d tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:10.931421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ab4d5f7-e6c0-44dc-80f2-06fa90e01b4d tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.931886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ab4d5f7-e6c0-44dc-80f2-06fa90e01b4d tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:10.932938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ab4d5f7-e6c0-44dc-80f2-06fa90e01b4d tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:10.933592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ab4d5f7-e6c0-44dc-80f2-06fa90e01b4d tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:11.081591 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ab4d5f7-e6c0-44dc-80f2-06fa90e01b4d tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1691 microversion: 2.1 time: 0.166944 Nov 27 20:49:11.092880 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 613/1153] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:10 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:11.099538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:11.100144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:11.106250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:11.106698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:11.107557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:11.107993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:11.268475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:11.284248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:11.286592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:11.288133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-508426ea-6b26-430e-98e5-934499a471ca tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1644 microversion: 2.25 time: 0.193238 Nov 27 20:49:11.289030 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 614/1154] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:11 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1644 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:11.305159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:11.306795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:11.314366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:11.315106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:11.316233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:11.316610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:11.343140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lazy-loading 'flavor' on Instance uuid 96245ad6-b6b6-4017-aff5-81689a46b3a3 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:11.359749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Going to try to live migrate instance to nch1-master-1 {{(pid=135680) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:49:11.453614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Building network info cache for instance {{(pid=135679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:49:12.108943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Updating instance_info_cache with network_info: [{"id": "eabaf35a-0b10-4c47-9a45-f879a9b99282", "address": "fa:16:3e:d5:70:b2", "network": {"id": "60e77827-dbf6-4642-b5e9-3d8f4c2fcaa9", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-367222729-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e11cec7060094963bccef4d0cadba71d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapeabaf35a-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:49:12.125102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Releasing lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:49:12.127068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d3187ce8-73de-4ea6-a882-413cd4816f13 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action" status: 202 len: 0 microversion: 2.1 time: 2.474771 Nov 27 20:49:12.128131 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 541/1155] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:09 2021] POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action => generated 0 bytes in 2476 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Nov 27 20:49:12.138423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:12.139215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:12.147033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.147940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.151455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.152416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.315407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:12.325969 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2d7d1bd-b541-48f5-80c5-475b6dac318a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.196203 Nov 27 20:49:12.326694 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 542/1156] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:12 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:12.333447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-71c316b0-9384-4c20-affd-2bcb796b4cd3 req-7c47c18a-cb79-4cec-9424-d40a15eb8379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d615db49-b01d-4c93-94ea-1ce4a60493e4", "tag": "eabaf35a-0b10-4c47-9a45-f879a9b99282"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:12.335435 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:12.335435 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:12.343131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-71c316b0-9384-4c20-affd-2bcb796b4cd3 req-7c47c18a-cb79-4cec-9424-d40a15eb8379 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.343534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-71c316b0-9384-4c20-affd-2bcb796b4cd3 req-7c47c18a-cb79-4cec-9424-d40a15eb8379 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.358358 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-71c316b0-9384-4c20-affd-2bcb796b4cd3 req-7c47c18a-cb79-4cec-9424-d40a15eb8379 service nova] Creating event network-changed:eabaf35a-0b10-4c47-9a45-f879a9b99282 for instance d615db49-b01d-4c93-94ea-1ce4a60493e4 on nch1-master-1 Nov 27 20:49:12.366024 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-71c316b0-9384-4c20-affd-2bcb796b4cd3 req-7c47c18a-cb79-4cec-9424-d40a15eb8379 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037969 Nov 27 20:49:12.367683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 543/1157] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:12.374025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-acffc0bc-363a-46cf-ad02-b27a63c8c046 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:12.375037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-acffc0bc-363a-46cf-ad02-b27a63c8c046 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:12.381940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acffc0bc-363a-46cf-ad02-b27a63c8c046 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.382398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acffc0bc-363a-46cf-ad02-b27a63c8c046 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.383200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acffc0bc-363a-46cf-ad02-b27a63c8c046 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.383663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acffc0bc-363a-46cf-ad02-b27a63c8c046 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.452189 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-acffc0bc-363a-46cf-ad02-b27a63c8c046 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.082221 Nov 27 20:49:12.453580 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 544/1158] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:12 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:12.461161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:12.463032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:12.473592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.474434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.475876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.476331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.718454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:12.728367 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02c333e5-d03e-4e51-91c2-1a5eab65015d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.273326 Nov 27 20:49:12.738251 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 545/1159] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:12 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:12.744230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:12.745069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:12.752309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.753007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.753969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.754587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.928295 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b21d8f1c-3c68-4604-b511-aa07b3545186 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/action" status: 202 len: 0 microversion: 2.1 time: 1.636846 Nov 27 20:49:12.931032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:12.931900 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 615/1160] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:11 2021] POST /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/action => generated 0 bytes in 1642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:49:12.943388 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f23100c-1a4c-4270-95a0-2013d113536e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.203713 Nov 27 20:49:12.943981 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 546/1161] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:12 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:12.947978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:12.950003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:12.959178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7a6a458-2567-4907-a5f0-32af4a0cc64b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '.version_select at 0x7f15c787ca60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:12.982276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.983043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:12.984695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:12.986424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.029454 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] HTTP exception thrown: Instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 could not be found. Nov 27 20:49:13.031560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Returning 404 to user: Instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:13.034930 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17506f50-c843-4c6b-8aa6-a7bf1aba1b3f tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "DELETE /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 404 len: 111 microversion: 2.1 time: 0.093020 Nov 27 20:49:13.035583 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 616/1162] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:49:12 2021] DELETE /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:49:13.048128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:13.048847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:13.060616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.061073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.062184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.062473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.305352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:13.313077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:13.316893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:13.322336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9bb93d22-9219-444c-a72c-57d71a4dd2fd tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1634 microversion: 2.25 time: 0.281357 Nov 27 20:49:13.323129 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 617/1163] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:13 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1634 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:13.332755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cf2e875a-d3fd-4380-9c81-3c8bd81d9d11 req-1541bf83-8772-41d6-8e46-5f4d969dc2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6c668f-a112-487a-83a3-dd50f8dc252b", "name": "network-vif-plugged", "status": "completed", "tag": "062acbc0-509c-4546-aa47-d13c4188e1bf"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:13.335174 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:13.335174 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:13.345487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cf2e875a-d3fd-4380-9c81-3c8bd81d9d11 req-1541bf83-8772-41d6-8e46-5f4d969dc2d1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.345932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cf2e875a-d3fd-4380-9c81-3c8bd81d9d11 req-1541bf83-8772-41d6-8e46-5f4d969dc2d1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.357452 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cf2e875a-d3fd-4380-9c81-3c8bd81d9d11 req-1541bf83-8772-41d6-8e46-5f4d969dc2d1 service nova] Creating event network-vif-plugged:062acbc0-509c-4546-aa47-d13c4188e1bf for instance 4d6c668f-a112-487a-83a3-dd50f8dc252b on nch2-master-1 Nov 27 20:49:13.363670 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cf2e875a-d3fd-4380-9c81-3c8bd81d9d11 req-1541bf83-8772-41d6-8e46-5f4d969dc2d1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038105 Nov 27 20:49:13.364581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 618/1164] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:13.370493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:13.371185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:13.377405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.377930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.378639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.379070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.557114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:13.573572 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-463d7027-5972-4b35-8704-8316a6a5debd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.206915 Nov 27 20:49:13.574281 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 619/1165] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:13 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:13.578549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:13.579755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] [instance: 26eee3c3-56bb-48c8-b5fc-f88ab39670f0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:13.593467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.593886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.595288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.595719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.609435 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] HTTP exception thrown: Instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 could not be found. Nov 27 20:49:13.610309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] Returning 404 to user: Instance 26eee3c3-56bb-48c8-b5fc-f88ab39670f0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:13.610919 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-334fa016-306f-483d-91cc-91245f6b4c9e tempest-AttachSCSIVolumeTestJSON-1788431328 tempest-AttachSCSIVolumeTestJSON-1788431328-project] 10.222.0.21 "GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0" status: 404 len: 111 microversion: 2.1 time: 0.035900 Nov 27 20:49:13.611826 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 620/1166] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:13 2021] GET /compute/v2.1/servers/26eee3c3-56bb-48c8-b5fc-f88ab39670f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:49:13.616662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ec2bf8b-c656-4ce5-9da5-5cf29b9316ec tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '.version_select at 0x7f15c7fb9820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:13.618520 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:13.618520 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:13.620587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ec2bf8b-c656-4ce5-9da5-5cf29b9316ec tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.621045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ec2bf8b-c656-4ce5-9da5-5cf29b9316ec tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.634249 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ec2bf8b-c656-4ce5-9da5-5cf29b9316ec tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 4289 microversion: 2.25 time: 0.021286 Nov 27 20:49:13.635139 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 621/1167] 10.222.0.21 () {60 vars in 1183 bytes} [Sat Nov 27 20:49:13 2021] GET /compute/v2.1/os-migrations => generated 4289 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:13.639568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:13.640196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:13.649167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.649167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.649394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.649772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.883022 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7a6a458-2567-4907-a5f0-32af4a0cc64b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/c18165d3-cb84-40c1-ad3e-77ec8193e538" status: 202 len: 0 microversion: 2.1 time: 0.928883 Nov 27 20:49:13.888266 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 547/1168] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:49:12 2021] DELETE /compute/v2.1/os-floating-ips/c18165d3-cb84-40c1-ad3e-77ec8193e538 => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:49:13.893236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28d2f014-18eb-4da6-92c3-4818ecda2fc7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:13.894224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28d2f014-18eb-4da6-92c3-4818ecda2fc7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:13.898018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:13.901341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d2f014-18eb-4da6-92c3-4818ecda2fc7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.901790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d2f014-18eb-4da6-92c3-4818ecda2fc7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.902571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d2f014-18eb-4da6-92c3-4818ecda2fc7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.903004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d2f014-18eb-4da6-92c3-4818ecda2fc7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.907289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70f45751-d4ca-412d-aed7-c9dd8f28f76e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.270063 Nov 27 20:49:13.907289 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 622/1169] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:13 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:13.911511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:13.912270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:13.921894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.922635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.923584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:13.924618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:13.999997 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28d2f014-18eb-4da6-92c3-4818ecda2fc7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.110483 Nov 27 20:49:14.001677 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 548/1170] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:13 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:14.008700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.009411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.018386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.018838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.019671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.020111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.124551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid 5be38ef7-cbe4-41c9-8180-148457627022 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:14.144804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04ce7bcf-cd79-47fb-ad4a-8153bc8dff47 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 2126 microversion: 2.25 time: 0.236526 Nov 27 20:49:14.145970 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 623/1171] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:13 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 2126 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:14.150728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3077af12-8853-4555-966e-37a3b1af9901 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:14.152139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3077af12-8853-4555-966e-37a3b1af9901 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:14.152933 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3077af12-8853-4555-966e-37a3b1af9901 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action" status: 400 len: 142 microversion: 2.1 time: 0.005912 Nov 27 20:49:14.153598 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 624/1172] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:14 2021] POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action => generated 142 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:49:14.163438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.164087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.173678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.174125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.174918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.178706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:14.186229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.186530 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee9ecb3f-e2b8-4c21-8036-6519ed8751c1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.181666 Nov 27 20:49:14.187114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 549/1173] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:14 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:14.196988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:14.198663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.205268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.205944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.206949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.207830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.241204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Acquired lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:49:14.363460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Releasing lock "refresh_cache-d615db49-b01d-4c93-94ea-1ce4a60493e4" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:49:14.363460 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] HTTP exception thrown: floating IP not found Nov 27 20:49:14.363994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Returning 404 to user: floating IP not found {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:14.364933 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9f0b3aa-c962-48bc-ac4d-2ac4f4bfa692 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action" status: 404 len: 67 microversion: 2.1 time: 0.176637 Nov 27 20:49:14.367308 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 550/1174] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:14 2021] POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action => generated 67 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:49:14.370894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.371551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.377875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.378329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.379439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.379879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.461689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:14.470209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d06c5451-0a8c-4170-95de-6c89d596a93e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.310278 Nov 27 20:49:14.471369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 625/1175] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:14 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:14.475543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8dda78c3-63dc-494e-b5d0-c680e40d37f6 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:14.509069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid 5be38ef7-cbe4-41c9-8180-148457627022 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:14.521562 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21ed6fea-e386-4dde-987a-2fa523e18667 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 2126 microversion: 2.25 time: 0.154826 Nov 27 20:49:14.522131 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 551/1176] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:14 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 2126 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:14.591627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.592235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.599571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.600148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.601028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.601543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.685419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lazy-loading 'services' on Instance uuid 5be38ef7-cbe4-41c9-8180-148457627022 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:14.759835 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-35f99cbd-2756-48a0-b88e-92bcc9f3a19c tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments/531124a5-0591-4505-b7a9-fd42aca352f7" status: 202 len: 0 microversion: 2.25 time: 0.171956 Nov 27 20:49:14.760458 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 552/1177] 10.222.0.21 () {60 vars in 1456 bytes} [Sat Nov 27 20:49:14 2021] DELETE /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments/531124a5-0591-4505-b7a9-fd42aca352f7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:49:14.765786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.766981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.773354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.774049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.775019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.775667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.841544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-8dda78c3-63dc-494e-b5d0-c680e40d37f6 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 27 20:49:14.841875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8dda78c3-63dc-494e-b5d0-c680e40d37f6 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:14.842709 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8dda78c3-63dc-494e-b5d0-c680e40d37f6 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action" status: 404 len: 88 microversion: 2.1 time: 0.370885 Nov 27 20:49:14.848132 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 626/1178] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:14 2021] POST /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4/action => generated 88 bytes in 377 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:49:14.856541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19ae1eca-87f2-49f8-bb35-b5aa1e23bf62 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.857523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19ae1eca-87f2-49f8-bb35-b5aa1e23bf62 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.879881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19ae1eca-87f2-49f8-bb35-b5aa1e23bf62 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.879881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19ae1eca-87f2-49f8-bb35-b5aa1e23bf62 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.879881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19ae1eca-87f2-49f8-bb35-b5aa1e23bf62 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.879881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19ae1eca-87f2-49f8-bb35-b5aa1e23bf62 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.925501 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19ae1eca-87f2-49f8-bb35-b5aa1e23bf62 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076101 Nov 27 20:49:14.929550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 627/1179] 10.222.0.21 () {60 vars in 1342 bytes} [Sat Nov 27 20:49:14 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:14.929719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:14.931397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.931908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.936855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b26b935d-4c97-4223-968e-3412183f10d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.174941 Nov 27 20:49:14.937432 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 553/1180] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:14 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:14.941796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.942143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:14.942373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.943072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:14.944958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.945496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.949817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.950265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.951056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:14.951518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:14.973580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:49:15.060806 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b348674-0b2c-42ed-9286-af26a27d7f7b tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 204 len: 0 microversion: 2.1 time: 0.132681 Nov 27 20:49:15.061980 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 628/1181] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:49:14 2021] DELETE /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:49:15.068885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86968c3a-2b62-4232-8346-64c5bfcc3f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:15.069881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86968c3a-2b62-4232-8346-64c5bfcc3f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:15.076902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86968c3a-2b62-4232-8346-64c5bfcc3f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.077222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86968c3a-2b62-4232-8346-64c5bfcc3f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.078069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86968c3a-2b62-4232-8346-64c5bfcc3f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.078446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86968c3a-2b62-4232-8346-64c5bfcc3f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.109955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:15.118541 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce44404f-ab7a-4979-a3fe-cdf583b81da1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.179608 Nov 27 20:49:15.119750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 554/1182] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:14 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:15.124427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:15.125236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:15.133087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.133618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.134661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.135290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.138336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86968c3a-2b62-4232-8346-64c5bfcc3f05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.074458 Nov 27 20:49:15.139801 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 629/1183] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:15 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:15.213124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:15.215224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:15.222861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.223497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.224305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.224752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.283508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:15.291646 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6acb4fe8-65aa-41b9-9ec2-cc92d731b37a tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1541 microversion: 2.1 time: 0.170714 Nov 27 20:49:15.292472 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 555/1184] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:15 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1541 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:15.379749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d88e8bc5-d7f8-48af-b1ce-2fd6b953e7b5 req-17108f4e-6aeb-42e8-83cd-2a868fa87c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21735147-42d2-4c01-a74b-7ac91c6ac723", "name": "network-vif-plugged", "status": "completed", "tag": "381881ef-aefe-442f-b7f9-355ca72b0903"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:15.381742 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:15.381742 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:15.389426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d88e8bc5-d7f8-48af-b1ce-2fd6b953e7b5 req-17108f4e-6aeb-42e8-83cd-2a868fa87c41 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.389939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d88e8bc5-d7f8-48af-b1ce-2fd6b953e7b5 req-17108f4e-6aeb-42e8-83cd-2a868fa87c41 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.402330 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d88e8bc5-d7f8-48af-b1ce-2fd6b953e7b5 req-17108f4e-6aeb-42e8-83cd-2a868fa87c41 service nova] Creating event network-vif-plugged:381881ef-aefe-442f-b7f9-355ca72b0903 for instance 21735147-42d2-4c01-a74b-7ac91c6ac723 on nch2-master-1 Nov 27 20:49:15.407303 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d88e8bc5-d7f8-48af-b1ce-2fd6b953e7b5 req-17108f4e-6aeb-42e8-83cd-2a868fa87c41 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032424 Nov 27 20:49:15.408133 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 556/1185] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:49:15.489004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:15.489582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:15.496691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.497197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.498067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.498516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.559853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:15.568012 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99dfda62-5c0a-47c9-a0dd-3352eae2d20e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1318 microversion: 2.1 time: 0.360513 Nov 27 20:49:15.568809 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 630/1186] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:15 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:15.688086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:15.698227 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a963a5bb-27db-4d1d-843d-302bbac00788 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.214023 Nov 27 20:49:15.699555 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 557/1187] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:15 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:15.937384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea67ea40-7171-4ca1-98fc-de96a93ba379 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:15.939000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea67ea40-7171-4ca1-98fc-de96a93ba379 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:15.946264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea67ea40-7171-4ca1-98fc-de96a93ba379 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.946718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea67ea40-7171-4ca1-98fc-de96a93ba379 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.947540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea67ea40-7171-4ca1-98fc-de96a93ba379 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.947987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea67ea40-7171-4ca1-98fc-de96a93ba379 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.956775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:15.958178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:15.966176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.966968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.968148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:15.968956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:15.984087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea67ea40-7171-4ca1-98fc-de96a93ba379 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.050531 Nov 27 20:49:15.984731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 631/1188] 10.222.0.21 () {60 vars in 1342 bytes} [Sat Nov 27 20:49:15 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:16.136935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:16.137908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:16.149452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.150977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.152206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.152809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.156343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:16.170183 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55cbfd05-a9d3-4617-9d9d-6e7325f2ba87 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.218421 Nov 27 20:49:16.181308 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 558/1189] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:15 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:16.187046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48b1fea6-41c3-4418-a3c5-a55e328f7e5a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:16.188985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48b1fea6-41c3-4418-a3c5-a55e328f7e5a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:16.195164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b1fea6-41c3-4418-a3c5-a55e328f7e5a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.195647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b1fea6-41c3-4418-a3c5-a55e328f7e5a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.196917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b1fea6-41c3-4418-a3c5-a55e328f7e5a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.196917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b1fea6-41c3-4418-a3c5-a55e328f7e5a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.266929 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48b1fea6-41c3-4418-a3c5-a55e328f7e5a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.084189 Nov 27 20:49:16.271247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 559/1190] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:16 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:16.311507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:16.312389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:16.323625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.330826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.332036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.332484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.418879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:16.431832 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85e72a77-2111-4d37-aac5-2c5200631a34 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.298747 Nov 27 20:49:16.432721 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 632/1191] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:16 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:16.584817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:16.585479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:16.595442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.595964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.596826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.597245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.741549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:16.747525 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8948ebb-540f-4f41-b1d9-db693ef1445e tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1541 microversion: 2.1 time: 0.440645 Nov 27 20:49:16.748108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 560/1192] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:16 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1541 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:16.769297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:16.771955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:16.780764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.782744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.784044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.784980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.912100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:16.919937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46ac2e44-6be2-442d-b3eb-e7d02a88d116 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1468 microversion: 2.1 time: 0.339047 Nov 27 20:49:16.920514 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 633/1193] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:16 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1468 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:16.937439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:16.939304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:16.947013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.947916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:16.949036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:16.949967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.061838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:17.071750 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71fbd12d-fd82-4e78-8cc8-70ac96b9d246 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.314735 Nov 27 20:49:17.072632 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 561/1194] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:16 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:17.189173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:17.189795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:17.197455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.199482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.200473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.202840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.232826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:17.247415 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba0842fc-e82c-4274-bb2b-a6327a2e8691 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 200 len: 1318 microversion: 2.1 time: 0.309097 Nov 27 20:49:17.248371 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 634/1195] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:16 2021] GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:17.278762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a813b01c-3985-4cd4-b290-f0f00191a7d5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:17.280098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a813b01c-3985-4cd4-b290-f0f00191a7d5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:17.292005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a813b01c-3985-4cd4-b290-f0f00191a7d5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.306359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a813b01c-3985-4cd4-b290-f0f00191a7d5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.309763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a813b01c-3985-4cd4-b290-f0f00191a7d5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.310226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a813b01c-3985-4cd4-b290-f0f00191a7d5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.424604 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a813b01c-3985-4cd4-b290-f0f00191a7d5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.149252 Nov 27 20:49:17.429999 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 635/1196] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:17 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:49:17.449808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:17.450754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:17.460046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.465979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.466949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.468852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.614240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:17.622621 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ba909c6-996c-40c9-98aa-d9f5390a5a72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.437228 Nov 27 20:49:17.624176 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 562/1197] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:17 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:17.746378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:17.757948 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1d8d892d-cec9-45a0-a1a4-c4e857cfcbde tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.312989 Nov 27 20:49:17.765003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:17.766614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:17.776804 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 636/1198] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:17 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:17.781390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.783318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.786095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.787151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.924412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f9362e9e-8c97-4dab-a94b-e3480ac73a50 req-b3be5c66-8e81-4a9a-beca-4563845a3edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615db49-b01d-4c93-94ea-1ce4a60493e4", "name": "network-vif-deleted", "tag": "eabaf35a-0b10-4c47-9a45-f879a9b99282"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:17.926283 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:17.926283 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:17.945513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f9362e9e-8c97-4dab-a94b-e3480ac73a50 req-b3be5c66-8e81-4a9a-beca-4563845a3edd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:17.945878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367987f33e48490a94602847ed0881e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11cec7060094963bccef4d0cadba71d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:17.946001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f9362e9e-8c97-4dab-a94b-e3480ac73a50 req-b3be5c66-8e81-4a9a-beca-4563845a3edd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:17.956410 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b538cafe-93af-4b94-bb84-19ff59e9a8ad tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 200 len: 1499 microversion: 2.1 time: 0.196131 Nov 27 20:49:17.958175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 563/1199] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:17 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 1499 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:17.986535 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f9362e9e-8c97-4dab-a94b-e3480ac73a50 req-b3be5c66-8e81-4a9a-beca-4563845a3edd service nova] Creating event network-vif-deleted:eabaf35a-0b10-4c47-9a45-f879a9b99282 for instance d615db49-b01d-4c93-94ea-1ce4a60493e4 on nch1-master-1 Nov 27 20:49:18.001591 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f9362e9e-8c97-4dab-a94b-e3480ac73a50 req-b3be5c66-8e81-4a9a-beca-4563845a3edd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081032 Nov 27 20:49:18.002230 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 637/1200] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:49:18.089261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:18.089882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:18.102027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.107368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.123987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.125293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.271646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:18.272959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:18.288253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.290353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.291295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.291731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.565666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:18.574085 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b9c9eae7-aed9-4d5a-a393-981ecbfcdde8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 200 len: 1467 microversion: 2.1 time: 0.310631 Nov 27 20:49:18.589742 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 638/1201] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:18 2021] GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 1467 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:18.598668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5994947-69f7-4a0f-8aba-f9c7cda9d91e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:18.600325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5994947-69f7-4a0f-8aba-f9c7cda9d91e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:18.606785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5994947-69f7-4a0f-8aba-f9c7cda9d91e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.607325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5994947-69f7-4a0f-8aba-f9c7cda9d91e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.608299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5994947-69f7-4a0f-8aba-f9c7cda9d91e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.608806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5994947-69f7-4a0f-8aba-f9c7cda9d91e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.667308 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5994947-69f7-4a0f-8aba-f9c7cda9d91e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.075671 Nov 27 20:49:18.669965 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 639/1202] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:18 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:18.676510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:18.680898 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:18.680898 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:18.686916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:18.688273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Searching by: {'reservation_id': 'r-0vkzt0i2', 'deleted': False, 'project_id': 'c03fae8406904a0da2046c097555cf58'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:18.708101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.708774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.711817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.712775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.849940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:18.864484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:18.882033 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-504b2ba0-4516-49ed-b4ee-cd6a472de0a3 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.794806 Nov 27 20:49:18.892063 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 564/1203] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:18 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:18.899238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:18.899871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:18.924806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.926382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:18.927572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:18.929576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.009026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:19.019657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.020985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.222627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:19.226220 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c3cd6ae-ae37-45d4-b18a-de6d4cb81874 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/detail?reservation_id=r-0vkzt0i2" status: 200 len: 2928 microversion: 2.1 time: 0.554513 Nov 27 20:49:19.227109 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 640/1204] 10.222.0.21 () {58 vars in 1196 bytes} [Sat Nov 27 20:49:18 2021] GET /compute/v2.1/servers/detail?reservation_id=r-0vkzt0i2 => generated 2928 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:19.231066 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b3e5946-c2bf-4758-8293-0bb867289868 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.337927 Nov 27 20:49:19.232098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:19.233137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:19.241845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.242536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.244090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.244746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.245439 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 565/1205] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:18 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:19.254917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:19.255574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] [instance: d615db49-b01d-4c93-94ea-1ce4a60493e4] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:19.272930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.273394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.274202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.274641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.305998 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] HTTP exception thrown: Instance d615db49-b01d-4c93-94ea-1ce4a60493e4 could not be found. Nov 27 20:49:19.306594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] Returning 404 to user: Instance d615db49-b01d-4c93-94ea-1ce4a60493e4 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:19.307453 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-477cce62-708e-4950-9478-e62725c6d565 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035 tempest-FloatingIPsAssociationNegativeTestJSON-1140836035-project] 10.222.0.21 "GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4" status: 404 len: 111 microversion: 2.1 time: 0.060980 Nov 27 20:49:19.314949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 566/1206] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:19 2021] GET /compute/v2.1/servers/d615db49-b01d-4c93-94ea-1ce4a60493e4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:49:19.326172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad1b0908-8334-4803-a51b-374572bcd04f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:19.363766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_groups [None req-ad1b0908-8334-4803-a51b-374572bcd04f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Querying cell fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) for 2 instances {{(pid=135679) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 27 20:49:19.368559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad1b0908-8334-4803-a51b-374572bcd04f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.369277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad1b0908-8334-4803-a51b-374572bcd04f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.430736 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad1b0908-8334-4803-a51b-374572bcd04f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups/19ef2532-367d-4b30-bcf3-220fa35a38fe" status: 200 len: 265 microversion: 2.1 time: 0.111774 Nov 27 20:49:19.432596 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 567/1207] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:49:19 2021] GET /compute/v2.1/os-server-groups/19ef2532-367d-4b30-bcf3-220fa35a38fe => generated 265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:19.449146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7a19b82-b9b2-4808-8090-40f2711cd049 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:19.449301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7a19b82-b9b2-4808-8090-40f2711cd049 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:19.459000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a19b82-b9b2-4808-8090-40f2711cd049 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.459562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a19b82-b9b2-4808-8090-40f2711cd049 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.460612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a19b82-b9b2-4808-8090-40f2711cd049 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.461245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a19b82-b9b2-4808-8090-40f2711cd049 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.472484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:19.486517 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-575ac07c-da9b-4003-8bcc-fe302bd88c3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.257859 Nov 27 20:49:19.498536 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 641/1208] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:19 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:19.683048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41850116-40c2-4342-8ff1-e707b6391e57 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:19.686173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41850116-40c2-4342-8ff1-e707b6391e57 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:19.701099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41850116-40c2-4342-8ff1-e707b6391e57 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.701689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41850116-40c2-4342-8ff1-e707b6391e57 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.702775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41850116-40c2-4342-8ff1-e707b6391e57 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.703400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41850116-40c2-4342-8ff1-e707b6391e57 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.756604 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41850116-40c2-4342-8ff1-e707b6391e57 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.079286 Nov 27 20:49:19.759105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 642/1209] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:19 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:49:19.892180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7a19b82-b9b2-4808-8090-40f2711cd049 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 200 len: 1618 microversion: 2.1 time: 0.451824 Nov 27 20:49:19.893344 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 568/1210] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:19 2021] GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 1618 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:19.908586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fddc8e68-71a4-4ec7-80f9-25c08c9a99c1 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:19.909465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:19.909958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fddc8e68-71a4-4ec7-80f9-25c08c9a99c1 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:19.910158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:19.916748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc8e68-71a4-4ec7-80f9-25c08c9a99c1 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.917460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc8e68-71a4-4ec7-80f9-25c08c9a99c1 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.918511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc8e68-71a4-4ec7-80f9-25c08c9a99c1 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.919189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc8e68-71a4-4ec7-80f9-25c08c9a99c1 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.923846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.924396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:19.925858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:19.927647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:20.246994 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fddc8e68-71a4-4ec7-80f9-25c08c9a99c1 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 200 len: 1619 microversion: 2.1 time: 0.340523 Nov 27 20:49:20.247960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 569/1211] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:19 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 1619 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:20.256154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1f4300e8-b1da-41cf-ab6f-adaf6937ccdb req-b203cb34-a090-41cb-92ac-4f2ee33bd655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96245ad6-b6b6-4017-aff5-81689a46b3a3", "name": "network-vif-unplugged", "status": "completed", "tag": "91a3e20c-c74b-4366-a10a-a264f88012cb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:20.259106 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:20.259106 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:20.272504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1f4300e8-b1da-41cf-ab6f-adaf6937ccdb req-b203cb34-a090-41cb-92ac-4f2ee33bd655 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:20.273303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1f4300e8-b1da-41cf-ab6f-adaf6937ccdb req-b203cb34-a090-41cb-92ac-4f2ee33bd655 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:20.290666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:20.298011 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1f4300e8-b1da-41cf-ab6f-adaf6937ccdb req-b203cb34-a090-41cb-92ac-4f2ee33bd655 service nova] Creating event network-vif-unplugged:91a3e20c-c74b-4366-a10a-a264f88012cb for instance 96245ad6-b6b6-4017-aff5-81689a46b3a3 on nch2-master-1 Nov 27 20:49:20.302965 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97cc7876-7f1b-49da-86d1-197dbc5c51a1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.399482 Nov 27 20:49:20.304134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 643/1212] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:19 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:20.311676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:20.315735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:20.317619 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1f4300e8-b1da-41cf-ab6f-adaf6937ccdb req-b203cb34-a090-41cb-92ac-4f2ee33bd655 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066256 Nov 27 20:49:20.318479 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 570/1213] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:20 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:20.326631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05a2998a-048f-4b14-bb53-239524593f88 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: .version_select at 0x7f15c7ca0b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-585695124", "policies": ["anti-affinity"]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:20.329737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:20.331162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:20.332313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:20.332964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:20.351138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-05a2998a-048f-4b14-bb53-239524593f88 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:20.359976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-05a2998a-048f-4b14-bb53-239524593f88 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:20.443489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-05a2998a-048f-4b14-bb53-239524593f88 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:20.453961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-05a2998a-048f-4b14-bb53-239524593f88 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:20.476569 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05a2998a-048f-4b14-bb53-239524593f88 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.156273 Nov 27 20:49:20.479414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 571/1214] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 20:49:20 2021] POST /compute/v2.1/os-server-groups => generated 192 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:20.506587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:20.508634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:20.525130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:20.526473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:20.530704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:20.533897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:20.685288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:20.694363 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-54684941-49fa-4184-b502-f2f356b3c08d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.388815 Nov 27 20:49:20.700357 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 644/1215] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:20 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:20.705462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1694646354", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2806f1c8-ce1c-4445-9cca-6347ca84de05"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:20.831208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:49:20.841391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:20.855962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45e6ff1f-de04-4bf4-a208-21b3d9ccc6c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.355352 Nov 27 20:49:20.860646 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 572/1216] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:20 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:20.878238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abf8e5ec-de7c-410a-a789-2bab8c884aa1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:20.879198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abf8e5ec-de7c-410a-a789-2bab8c884aa1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:20.902231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf8e5ec-de7c-410a-a789-2bab8c884aa1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:20.902612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf8e5ec-de7c-410a-a789-2bab8c884aa1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:20.903471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf8e5ec-de7c-410a-a789-2bab8c884aa1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:20.903921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf8e5ec-de7c-410a-a789-2bab8c884aa1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:21.055851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abf8e5ec-de7c-410a-a789-2bab8c884aa1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.184954 Nov 27 20:49:21.068255 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 573/1217] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:20 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:21.321538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:21.322270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:21.334307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:21.335727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:21.336532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:21.336967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:21.606370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:49:21.607072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:49:21.607784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:49:21.608428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:49:21.609251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:49:21.639481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:21.645361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:21.645824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:21.647638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:21.648366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:21.648944 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81d0efb4-dc22-44ed-948d-01e366c89622 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.331496 Nov 27 20:49:21.649531 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 574/1218] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:21 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:21.674876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:21.681132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:21.699725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Going to run 2 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:49:21.702843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:49:21.720615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:21.721231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:21.731817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:21.733844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:21.734973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:21.736422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:21.760827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=135680) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Nov 27 20:49:21.785466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:21.789636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:21.840834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:21.845926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:21.867208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=352412c0-8ac8-4c44-810a-ce588efeafcd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:49:21.939755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:21.947511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:21.990461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:21.994917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:22.036077 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-044e653e-885c-445e-a4a3-94a843ff2c2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.334115 Nov 27 20:49:22.037112 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 645/1219] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:49:20 2021] POST /compute/v2.1/servers => generated 32 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 27 20:49:22.041945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:22.042632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:22.048867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.049425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.050281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.050720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.431516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:22.456356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f8cf174b-0a6c-498c-9ee3-d7bce296921d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.418320 Nov 27 20:49:22.456967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 646/1220] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:22 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:22.474105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:22.479945 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:22.479945 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:22.484292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:22.492051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Searching by: {'deleted': False, 'project_id': 'c03fae8406904a0da2046c097555cf58'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:22.495438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:22.509969 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6430dc5b-3838-44aa-b7f1-5f338aa6d240 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.793188 Nov 27 20:49:22.514095 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 575/1221] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:21 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:22.525778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e8b1a8b-18ea-45c7-ab29-c4cd37b7bbb2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:22.530173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e8b1a8b-18ea-45c7-ab29-c4cd37b7bbb2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:22.543097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e8b1a8b-18ea-45c7-ab29-c4cd37b7bbb2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.551101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e8b1a8b-18ea-45c7-ab29-c4cd37b7bbb2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.555904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e8b1a8b-18ea-45c7-ab29-c4cd37b7bbb2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.556090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.556447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.559364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e8b1a8b-18ea-45c7-ab29-c4cd37b7bbb2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.562009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.565236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.653143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:22.682702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e8b1a8b-18ea-45c7-ab29-c4cd37b7bbb2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.164247 Nov 27 20:49:22.683954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 576/1222] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:22 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:22.690320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-923e1145-9dcd-4f02-b688-63ea1c282e72 req-569c67e6-cb71-41ae-ac25-4f995a93d605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96245ad6-b6b6-4017-aff5-81689a46b3a3", "tag": "91a3e20c-c74b-4366-a10a-a264f88012cb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:22.693696 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:22.693696 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:22.702917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-923e1145-9dcd-4f02-b688-63ea1c282e72 req-569c67e6-cb71-41ae-ac25-4f995a93d605 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.703303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-923e1145-9dcd-4f02-b688-63ea1c282e72 req-569c67e6-cb71-41ae-ac25-4f995a93d605 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.721913 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a28585d9-b737-445f-b250-1f9780d047fa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.261755 Nov 27 20:49:22.723479 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 647/1223] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:49:22 2021] GET /compute/v2.1/servers => generated 1663 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:22.724511 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-923e1145-9dcd-4f02-b688-63ea1c282e72 req-569c67e6-cb71-41ae-ac25-4f995a93d605 service nova] Creating event network-changed:91a3e20c-c74b-4366-a10a-a264f88012cb for instance 96245ad6-b6b6-4017-aff5-81689a46b3a3 on nch2-master-1 Nov 27 20:49:22.729666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:22.730431 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-923e1145-9dcd-4f02-b688-63ea1c282e72 req-569c67e6-cb71-41ae-ac25-4f995a93d605 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044825 Nov 27 20:49:22.731640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:22.731952 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 577/1224] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:22.739685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6d54497-bf5b-46a5-9c09-42b78dc66bcb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:22.740846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6d54497-bf5b-46a5-9c09-42b78dc66bcb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:22.761281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.763385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.765093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:22.765470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:22.894278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f6d54497-bf5b-46a5-9c09-42b78dc66bcb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:22.910230 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6d54497-bf5b-46a5-9c09-42b78dc66bcb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1219 microversion: 2.1 time: 0.176425 Nov 27 20:49:22.927136 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 578/1225] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:22 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:23.008229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:23.020106 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-791a92b9-b277-4949-8366-93818734d8f7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.294500 Nov 27 20:49:23.021179 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 648/1226] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:22 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:23.474067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:23.474683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:23.496342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:23.496969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:23.498698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:23.501766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:23.530018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:23.530779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:23.551139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:23.551792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:23.564086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:23.564677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:24.024627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:24.039316 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43921f3e-aa43-4d6f-99e8-132ab26c9b65 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.570144 Nov 27 20:49:24.044030 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 579/1227] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:23 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:24.052056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ac75364-2961-4952-a233-04fd219eb899 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:24.053433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ac75364-2961-4952-a233-04fd219eb899 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:24.069087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ac75364-2961-4952-a233-04fd219eb899 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:24.077279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ac75364-2961-4952-a233-04fd219eb899 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:24.081029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ac75364-2961-4952-a233-04fd219eb899 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:24.082520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ac75364-2961-4952-a233-04fd219eb899 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:24.138042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:24.148296 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07107a7e-e130-4948-82ae-d19adcbcd1dd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.622242 Nov 27 20:49:24.154707 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 649/1228] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:23 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:24.168180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:24.168180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:24.181819 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ac75364-2961-4952-a233-04fd219eb899 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.135563 Nov 27 20:49:24.184466 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 580/1229] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:24 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:24.197590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:24.197903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:24.204137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:24.204594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:24.208803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:24.209497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:24.222918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:24.224598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:24.224598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:24.224598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:24.379146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:24.390901 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-afae0476-fbf2-4ea6-8568-02ff9a089c82 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1215 microversion: 2.1 time: 0.232325 Nov 27 20:49:24.403398 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 650/1230] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:24 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:24.679093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:24.687159 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16afb59e-c5f4-42d2-a050-991fe1a41369 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.500292 Nov 27 20:49:24.688008 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 581/1231] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:24 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:25.060660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:25.061371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:25.072742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.073286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.084018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.084945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.170834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:25.172995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:25.183854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.184645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.185712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.186734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.640149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:25.664664 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43623cf7-6c53-4298-8189-88ddef08d2b7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.496010 Nov 27 20:49:25.665635 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 582/1232] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:25 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:25.676054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e87edb5-e31f-4788-8f80-60e493846a09 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:25.677929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e87edb5-e31f-4788-8f80-60e493846a09 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:25.692100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e87edb5-e31f-4788-8f80-60e493846a09 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.696676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e87edb5-e31f-4788-8f80-60e493846a09 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.698430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e87edb5-e31f-4788-8f80-60e493846a09 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.699892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e87edb5-e31f-4788-8f80-60e493846a09 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.761476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e87edb5-e31f-4788-8f80-60e493846a09 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.092857 Nov 27 20:49:25.762156 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 583/1233] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:25 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:25.768467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:25.770019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:25.782391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.783123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.784133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.784770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.887957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:25.903615 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a79908d9-33b3-43eb-b27f-d3dedd48a9ea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1277 microversion: 2.1 time: 0.139839 Nov 27 20:49:25.914046 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 584/1234] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:25 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:25.915549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:25.916175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:25.927434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.928188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:25.930323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:25.931049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:26.279915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:26.298484 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7b8cf3b1-ff0d-491f-a502-2a4bfb9f1681 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 1.241301 Nov 27 20:49:26.300223 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 651/1235] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:25 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:26.322268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:26.334341 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53c5a555-c4fc-4076-be50-01fd578821ed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1522 microversion: 2.1 time: 0.425974 Nov 27 20:49:26.345522 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 585/1236] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:25 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:26.683168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:26.684071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:26.691306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:26.691770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:26.692575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:26.693018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:26.774121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7cd0d0c8-90fa-425a-9bce-c003e90a897b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:26.775124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7cd0d0c8-90fa-425a-9bce-c003e90a897b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:26.797317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cd0d0c8-90fa-425a-9bce-c003e90a897b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:26.797769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cd0d0c8-90fa-425a-9bce-c003e90a897b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:26.798569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cd0d0c8-90fa-425a-9bce-c003e90a897b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:26.800937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cd0d0c8-90fa-425a-9bce-c003e90a897b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:26.849327 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7cd0d0c8-90fa-425a-9bce-c003e90a897b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.079516 Nov 27 20:49:26.854307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 586/1237] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:26 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:49:26.928543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:26.929327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:26.950557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:26.951018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:26.952079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:26.953796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:27.069229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:27.105159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:27.112775 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f1c5f021-1e56-4987-84ab-374614f445e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1277 microversion: 2.1 time: 0.162985 Nov 27 20:49:27.114300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 587/1238] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:26 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:27.130422 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2f9aab6-84e2-4c0e-8a00-c618fb38c237 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.448664 Nov 27 20:49:27.142876 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 652/1239] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:26 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:27.317728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:27.318710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:27.339930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:27.340706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:27.341747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:27.342554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:27.352473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:27.354126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:27.364074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:27.368431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:27.373344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:27.376017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:27.828715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:27.842062 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b918ff7-4548-43dc-8513-faeba9cfb3d5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1499 microversion: 2.1 time: 0.494009 Nov 27 20:49:27.842664 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 653/1240] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:27 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:27.865641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:27.878815 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:27.878815 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:27.884782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:27.886092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:27.899542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:27.900290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:27.903714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:27.905165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:27.938484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:27.977520 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-273815c3-7375-4f00-a87f-fce4e310bce6 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.118127 Nov 27 20:49:27.978346 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 654/1241] 10.222.0.21 () {58 vars in 1153 bytes} [Sat Nov 27 20:49:27 2021] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:27.987587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37d214ed-29e3-4433-867c-2b8893bc97e7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:28.000169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37d214ed-29e3-4433-867c-2b8893bc97e7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:28.007401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37d214ed-29e3-4433-867c-2b8893bc97e7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.008105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37d214ed-29e3-4433-867c-2b8893bc97e7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.009162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37d214ed-29e3-4433-867c-2b8893bc97e7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.009777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37d214ed-29e3-4433-867c-2b8893bc97e7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.059415 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37d214ed-29e3-4433-867c-2b8893bc97e7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.077160 Nov 27 20:49:28.060353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 655/1242] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:27 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:28.066677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df912777-8bc0-413c-8ae0-d56f074f4aaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:28.075566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df912777-8bc0-413c-8ae0-d56f074f4aaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.076264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df912777-8bc0-413c-8ae0-d56f074f4aaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.118233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-df912777-8bc0-413c-8ae0-d56f074f4aaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Going to try to start instance {{(pid=135680) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 27 20:49:28.220013 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df912777-8bc0-413c-8ae0-d56f074f4aaa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "POST /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620/action" status: 202 len: 0 microversion: 2.1 time: 0.157967 Nov 27 20:49:28.220739 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 656/1243] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:28 2021] POST /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:49:28.238776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:28.240312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:28.253312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.253774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.254581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.255081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.449284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:28.459412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8504e055-f0ea-4787-a7a9-2d47c2a983e7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1277 microversion: 2.1 time: 0.237133 Nov 27 20:49:28.472689 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 657/1244] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:28 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:28.472689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:28.473139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:28.489799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.490552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.491573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.492180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.740938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:28.754826 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-369db829-c212-4528-80ea-e65bcc63bc26 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 1.440805 Nov 27 20:49:28.755466 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 588/1245] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:27 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:28.762503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:28.770501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:28.781513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.792033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.793149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:28.793739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:28.948438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:28.975980 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8477ca08-76a0-4f12-aba3-fe3234459bf4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.505185 Nov 27 20:49:28.977516 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 658/1246] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:28 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:29.072695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f450ed8-900b-4645-be04-bada760cb1e1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:29.074058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f450ed8-900b-4645-be04-bada760cb1e1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:29.089266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f450ed8-900b-4645-be04-bada760cb1e1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:29.089940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f450ed8-900b-4645-be04-bada760cb1e1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:29.091327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f450ed8-900b-4645-be04-bada760cb1e1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:29.092026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f450ed8-900b-4645-be04-bada760cb1e1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:29.183967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f450ed8-900b-4645-be04-bada760cb1e1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.115024 Nov 27 20:49:29.184895 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 659/1247] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:29 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:49:29.481395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:29.482158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:29.503228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:29.503776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:29.504605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:29.505322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:29.537225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:29.557433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90ab5441-b3b2-465f-9bf9-5a62ce69bd4d tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1508 microversion: 2.1 time: 0.800466 Nov 27 20:49:29.558048 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 589/1248] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:28 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1508 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:29.774490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:29.775874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:29.784985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:29.786940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:29.787987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:29.788825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.144306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:30.158385 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7adf0940-1a53-41d5-8b99-c218058b5814 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.387008 Nov 27 20:49:30.159362 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 590/1249] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:29 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:30.164547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:30.165376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:30.177770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.179080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.182305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.183796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.401948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:30.414363 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b5f134d4-d2a8-490a-baa5-343f610f7afc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.253581 Nov 27 20:49:30.416198 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 591/1250] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:30 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:30.436717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2919e4f-7555-4fd5-ba8e-e48c446a47aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:30.438533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2919e4f-7555-4fd5-ba8e-e48c446a47aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:30.451238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2919e4f-7555-4fd5-ba8e-e48c446a47aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.451801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2919e4f-7555-4fd5-ba8e-e48c446a47aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.453481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2919e4f-7555-4fd5-ba8e-e48c446a47aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.454147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2919e4f-7555-4fd5-ba8e-e48c446a47aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.530065 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2919e4f-7555-4fd5-ba8e-e48c446a47aa tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.112218 Nov 27 20:49:30.531100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 592/1251] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:30 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:30.578978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:30.579876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:30.597162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.597620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.598419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.603362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.705894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:30.718735 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e25060a5-4797-4fe8-ba08-fc67888022d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 1.241027 Nov 27 20:49:30.719375 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 660/1252] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:29 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:30.895517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:30.912907 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ba68378-9520-49f4-8c80-bfb00aeee6c2 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1512 microversion: 2.1 time: 0.337564 Nov 27 20:49:30.915240 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 593/1253] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:30 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:30.939111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:30.945143 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:30.945143 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:30.946971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:30.947646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.servers [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Removing options 'limit' from query {{(pid=135680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 27 20:49:30.948574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:30.949996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.950633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.952132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.952798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.954734 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5b058c7-f137-4557-b3d6-c2a319262458 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020900 Nov 27 20:49:30.955661 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 661/1254] 10.222.0.21 () {58 vars in 1139 bytes} [Sat Nov 27 20:49:30 2021] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:49:30.967505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:30.968121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:30.975098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.975597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:30.976541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:30.976996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:31.181700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:31.182298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:31.189525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:31.189974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:31.190979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:31.191443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:31.400497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:31.418711 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-699eba0c-a0db-407c-8064-a7a740dbc945 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1512 microversion: 2.1 time: 0.455337 Nov 27 20:49:31.431894 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 594/1255] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:30 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:31.443167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b323c0bd-6850-45f5-867e-72e1dfa0c5ab req-f81a21bc-e775-497b-9b72-f362c8584414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "352412c0-8ac8-4c44-810a-ce588efeafcd", "tag": "03656c06-3cc8-4fda-a16b-4029c1b5ca5e"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:31.445875 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:31.445875 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:31.471740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b323c0bd-6850-45f5-867e-72e1dfa0c5ab req-f81a21bc-e775-497b-9b72-f362c8584414 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:31.473494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b323c0bd-6850-45f5-867e-72e1dfa0c5ab req-f81a21bc-e775-497b-9b72-f362c8584414 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:31.543508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b323c0bd-6850-45f5-867e-72e1dfa0c5ab req-f81a21bc-e775-497b-9b72-f362c8584414 service nova] Creating event network-changed:03656c06-3cc8-4fda-a16b-4029c1b5ca5e for instance 352412c0-8ac8-4c44-810a-ce588efeafcd on nch2-master-1 Nov 27 20:49:31.567798 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b323c0bd-6850-45f5-867e-72e1dfa0c5ab req-f81a21bc-e775-497b-9b72-f362c8584414 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129277 Nov 27 20:49:31.569400 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 595/1256] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:31.576145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:31.578090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:31.588893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:31.589606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:31.608148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:31.610583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:31.787239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:31.810073 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de5b0d70-5c85-4ecb-a5b0-80103b4f3be7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1543 microversion: 2.1 time: 0.630198 Nov 27 20:49:31.812618 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 662/1257] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:31 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1543 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:31.821781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:31.827560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:31.845237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:31.846423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:31.847531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:31.847972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:32.447602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:32.462677 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a02c7663-d981-4dcf-92ae-a94c636782f7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1550 microversion: 2.1 time: 0.887763 Nov 27 20:49:32.475314 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 596/1258] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:31 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1550 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:32.480398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38e55de4-87fa-4a80-9e4b-31d3d876c6d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:32.481576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:32.481966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-38e55de4-87fa-4a80-9e4b-31d3d876c6d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:32.490686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e55de4-87fa-4a80-9e4b-31d3d876c6d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:32.491272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e55de4-87fa-4a80-9e4b-31d3d876c6d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:32.492473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e55de4-87fa-4a80-9e4b-31d3d876c6d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:32.493691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e55de4-87fa-4a80-9e4b-31d3d876c6d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:32.494112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-313b7dc8-b59f-44e6-b3fa-49229917ce5f tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99" status: 200 len: 1512 microversion: 2.1 time: 0.677939 Nov 27 20:49:32.495520 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 663/1259] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:31 2021] GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99 => generated 1512 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:32.517563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:32.519497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:32.527520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:32.528265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:32.529376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:32.529966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:32.560865 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38e55de4-87fa-4a80-9e4b-31d3d876c6d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.082800 Nov 27 20:49:32.563175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 597/1260] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:32 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:32.572040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:32.576223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:32.587863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:32.589129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:32.591820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:32.594132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:33.149510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:33.159390 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6b4bda5-0de7-4c38-a524-ba0b467411ba tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1513 microversion: 2.1 time: 0.594265 Nov 27 20:49:33.160309 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 598/1261] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:32 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1513 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:33.164944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:33.166029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:33.176758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:33.177591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:33.178603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:33.179381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:33.243141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:33.254662 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6aac79bf-9826-4390-a5b7-841f41e13323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 0.754658 Nov 27 20:49:33.255754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 664/1262] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:32 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:33.264909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:33.269797 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:33.269797 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:33.271330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:33.272449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:33.514929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:33.527396 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-470a7048-ced7-4a2a-8695-63dfd77e9641 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1542 microversion: 2.1 time: 0.362724 Nov 27 20:49:33.528696 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 599/1263] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:33 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1542 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:33.544331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:33.545480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:33.559511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:33.560634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:33.562065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:33.562736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:33.630548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:33.632494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:33.634723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:33.635398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:33.796646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:33.960119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:33.983273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf9b293e-0427-4c61-a9e9-9c907017e6b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1540 microversion: 2.1 time: 0.453090 Nov 27 20:49:33.983512 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-efe702fd-de5e-4ffc-9eca-80b4aa81afdc tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.726138 Nov 27 20:49:33.984991 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 665/1264] 10.222.0.21 () {58 vars in 1153 bytes} [Sat Nov 27 20:49:33 2021] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:34.005031 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 600/1265] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:33 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1540 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:34.006428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d50689e1-0444-4513-805e-92faa41af728 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:34.009311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d50689e1-0444-4513-805e-92faa41af728 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:34.017545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d50689e1-0444-4513-805e-92faa41af728 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.018441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d50689e1-0444-4513-805e-92faa41af728 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.019661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d50689e1-0444-4513-805e-92faa41af728 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.020332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d50689e1-0444-4513-805e-92faa41af728 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.021345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cf728909-c695-4079-bd92-bf88ebf3d054 req-56de6ef0-a51c-44c4-875a-12ccf8eafc88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff456cbf-e87f-45d6-bc23-eda1680f7319", "tag": "f7eb3780-8e46-4709-b050-efac2b428838"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:34.023049 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:34.023049 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:34.046204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cf728909-c695-4079-bd92-bf88ebf3d054 req-56de6ef0-a51c-44c4-875a-12ccf8eafc88 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.046985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cf728909-c695-4079-bd92-bf88ebf3d054 req-56de6ef0-a51c-44c4-875a-12ccf8eafc88 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.072006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cf728909-c695-4079-bd92-bf88ebf3d054 req-56de6ef0-a51c-44c4-875a-12ccf8eafc88 service nova] Creating event network-changed:f7eb3780-8e46-4709-b050-efac2b428838 for instance ff456cbf-e87f-45d6-bc23-eda1680f7319 on nch1-master-1 Nov 27 20:49:34.090631 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cf728909-c695-4079-bd92-bf88ebf3d054 req-56de6ef0-a51c-44c4-875a-12ccf8eafc88 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083936 Nov 27 20:49:34.091244 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 601/1266] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:34.103673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:34.105867 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d50689e1-0444-4513-805e-92faa41af728 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.109482 Nov 27 20:49:34.107889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:34.113249 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 666/1267] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:33 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:34.126672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b55c1e1-3776-48e1-824f-ae14205cb7a2 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '.version_select at 0x7f15c7cbcc10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:34.128151 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:34.128151 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:34.129080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.129718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.131719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.132441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.132974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b55c1e1-3776-48e1-824f-ae14205cb7a2 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.133485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b55c1e1-3776-48e1-824f-ae14205cb7a2 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.166383 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b55c1e1-3776-48e1-824f-ae14205cb7a2 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 3502 microversion: 2.1 time: 0.051608 Nov 27 20:49:34.175873 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 667/1268] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:49:34 2021] GET /compute/v2.1/os-migrations => generated 3502 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:34.181726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-063238a4-75c9-4969-b9c7-bfe0e2f7ad92 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:34.183007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-063238a4-75c9-4969-b9c7-bfe0e2f7ad92 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:34.200546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-063238a4-75c9-4969-b9c7-bfe0e2f7ad92 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.202181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-063238a4-75c9-4969-b9c7-bfe0e2f7ad92 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.205676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-063238a4-75c9-4969-b9c7-bfe0e2f7ad92 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.206594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-063238a4-75c9-4969-b9c7-bfe0e2f7ad92 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.485960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:34.514843 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-816949de-3557-4d8e-ad69-3ed55db805e4 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1512 microversion: 2.1 time: 0.416043 Nov 27 20:49:34.523515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 602/1269] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:34 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:34.527077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:34.527736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:34.552565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.553029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.554890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.555569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.906244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:34.919128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-51c5dcc1-bd0c-4e26-a5be-aeff02cd2cd8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 0.397129 Nov 27 20:49:34.924209 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 603/1270] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:34 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:34.932513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:34.934125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:34.951956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.954600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:34.959381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:34.960419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:35.305120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:35.323220 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e0de4de-0ab5-4062-8e1a-200755eee01c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99" status: 200 len: 1512 microversion: 2.1 time: 0.397416 Nov 27 20:49:35.331469 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 604/1271] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:34 2021] GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99 => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:35.335783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:35.336589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:35.354567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:35.355049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:35.357094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:35.357549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:35.521494 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-063238a4-75c9-4969-b9c7-bfe0e2f7ad92 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1691 microversion: 2.1 time: 1.342700 Nov 27 20:49:35.534702 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 668/1272] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:34 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1691 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:35.548088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45df82dc-0747-41cc-9e81-2997868ac6a9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:35.549035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45df82dc-0747-41cc-9e81-2997868ac6a9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:35.557207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45df82dc-0747-41cc-9e81-2997868ac6a9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:35.557671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45df82dc-0747-41cc-9e81-2997868ac6a9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:35.558475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45df82dc-0747-41cc-9e81-2997868ac6a9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:35.558914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45df82dc-0747-41cc-9e81-2997868ac6a9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:35.641356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45df82dc-0747-41cc-9e81-2997868ac6a9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.097035 Nov 27 20:49:35.647054 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 669/1273] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:35 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:35.654257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:35.656430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:35.665712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:35.667012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:35.668337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:35.670148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.172443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:36.186319 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db53bc16-2f82-415b-9ba7-0e39785db230 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1542 microversion: 2.1 time: 0.860975 Nov 27 20:49:36.203161 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 605/1274] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:35 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1542 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:36.209552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f786b92-74a7-4cc2-92fa-4edd2f01999a tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:36.210420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f786b92-74a7-4cc2-92fa-4edd2f01999a tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:36.217129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f786b92-74a7-4cc2-92fa-4edd2f01999a tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.217823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f786b92-74a7-4cc2-92fa-4edd2f01999a tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.219577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f786b92-74a7-4cc2-92fa-4edd2f01999a tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.220195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f786b92-74a7-4cc2-92fa-4edd2f01999a tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.235993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:36.251141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5c4e2d1-28ee-45ee-b30e-96b737b3e00a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1513 microversion: 2.1 time: 0.600684 Nov 27 20:49:36.254395 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 670/1275] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:35 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1513 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:36.269337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:36.270631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:36.293373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.293856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.294693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.295141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.623013 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f786b92-74a7-4cc2-92fa-4edd2f01999a tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1691 microversion: 2.1 time: 0.417123 Nov 27 20:49:36.627869 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 606/1276] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:36 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1691 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:36.663687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-14d4036f-2af9-4699-8bae-27e7f33e8e43 req-0f1a1c04-d4fd-4295-a5ec-2a71e01258ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "name": "network-vif-unplugged", "status": "completed", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}, {"name": "network-changed", "server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:36.668531 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:36.668531 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:36.684701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-14d4036f-2af9-4699-8bae-27e7f33e8e43 req-0f1a1c04-d4fd-4295-a5ec-2a71e01258ca service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.685648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-14d4036f-2af9-4699-8bae-27e7f33e8e43 req-0f1a1c04-d4fd-4295-a5ec-2a71e01258ca service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.699920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-14d4036f-2af9-4699-8bae-27e7f33e8e43 req-0f1a1c04-d4fd-4295-a5ec-2a71e01258ca service nova] Creating event network-vif-unplugged:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch2-master-1 Nov 27 20:49:36.700821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-14d4036f-2af9-4699-8bae-27e7f33e8e43 req-0f1a1c04-d4fd-4295-a5ec-2a71e01258ca service nova] Creating event network-changed:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch2-master-1 Nov 27 20:49:36.710706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-14d4036f-2af9-4699-8bae-27e7f33e8e43 req-0f1a1c04-d4fd-4295-a5ec-2a71e01258ca service nova] Instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:49:36.724198 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-14d4036f-2af9-4699-8bae-27e7f33e8e43 req-0f1a1c04-d4fd-4295-a5ec-2a71e01258ca service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.094272 Nov 27 20:49:36.725875 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 607/1277] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:36 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:36.731826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:36.735901 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:36.735901 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:36.737560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:36.739997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:36.747272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.748011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.749002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.750171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.788691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:36.901316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:36.934527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:36.935230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:36.990171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:37.000018 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e603fe63-d96e-48be-92d0-07ab45d67d3d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 0.744160 Nov 27 20:49:37.000607 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 671/1278] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:36 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:37.009093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6eca7d05-5f7c-4740-8e11-6eb56336007c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:37.016300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6eca7d05-5f7c-4740-8e11-6eb56336007c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:37.033149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6eca7d05-5f7c-4740-8e11-6eb56336007c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.033864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6eca7d05-5f7c-4740-8e11-6eb56336007c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.034827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6eca7d05-5f7c-4740-8e11-6eb56336007c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.037811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6eca7d05-5f7c-4740-8e11-6eb56336007c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.106459 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6eca7d05-5f7c-4740-8e11-6eb56336007c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.100850 Nov 27 20:49:37.107656 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 672/1279] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:37 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:37.116374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:37.116962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:37.138861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.139605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.143746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.146446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.206715 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efbd01a5-bc4e-4257-98ab-8f162119c1b5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.478828 Nov 27 20:49:37.221062 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 608/1280] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:49:36 2021] GET /compute/v2.1/servers/detail => generated 4520 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:37.221062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:37.221062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:37.226883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.231816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.232760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.233219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.451301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lazy-loading 'services' on Instance uuid 96245ad6-b6b6-4017-aff5-81689a46b3a3 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:37.658066 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3dcf038-1456-4a04-b4b4-9765a271d284 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "DELETE /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments/fc5e1853-9753-4aec-9663-f67f2c4249be" status: 202 len: 0 microversion: 2.1 time: 0.548772 Nov 27 20:49:37.660075 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 673/1281] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 20:49:37 2021] DELETE /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments/fc5e1853-9753-4aec-9663-f67f2c4249be => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:49:37.683149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:37.687355 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:37.687355 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:37.695234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:37.696569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:37.697649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:37.712263 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d84f93f2-b2ee-4d67-9eac-4a24319b5d8d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1542 microversion: 2.1 time: 0.503118 Nov 27 20:49:37.719304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 609/1282] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:37 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1542 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:37.749273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ecc84b6-cc78-4645-acb2-25c0285fcab2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:37.754606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ecc84b6-cc78-4645-acb2-25c0285fcab2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:37.776558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ecc84b6-cc78-4645-acb2-25c0285fcab2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.781142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ecc84b6-cc78-4645-acb2-25c0285fcab2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.784477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ecc84b6-cc78-4645-acb2-25c0285fcab2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:37.784945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ecc84b6-cc78-4645-acb2-25c0285fcab2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:37.832633 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ecc84b6-cc78-4645-acb2-25c0285fcab2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098480 Nov 27 20:49:37.833645 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 610/1283] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:49:37 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:38.019124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:38.020068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:38.027686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.028411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:38.030085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.031492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:38.381160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:38.391119 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b970d9df-324b-4e44-8cd7-34ca177c7c11 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 0.377352 Nov 27 20:49:38.396230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 611/1284] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:38 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:38.408716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-056eb4b1-65ce-4a09-8e13-d33c02bb85c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:38.410099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-056eb4b1-65ce-4a09-8e13-d33c02bb85c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:38.423018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-056eb4b1-65ce-4a09-8e13-d33c02bb85c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.435890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-056eb4b1-65ce-4a09-8e13-d33c02bb85c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:38.437459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-056eb4b1-65ce-4a09-8e13-d33c02bb85c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.438003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-056eb4b1-65ce-4a09-8e13-d33c02bb85c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:38.497497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-056eb4b1-65ce-4a09-8e13-d33c02bb85c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.099591 Nov 27 20:49:38.506711 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 612/1285] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:38 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:38.738315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:38.739026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:38.778309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.781868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:38.782818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.783304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:38.965887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.967133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:38.968669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:38.969707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.045392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:39.050848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:39.059606 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66b1aca3-3880-4a07-b36e-3734a16f8fb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1474 microversion: 2.1 time: 0.325826 Nov 27 20:49:39.060729 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 613/1286] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:38 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:39.065870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9ae4a30-6ed6-4ecf-b2cc-c7c330909968 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:39.066953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9ae4a30-6ed6-4ecf-b2cc-c7c330909968 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:39.073181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ae4a30-6ed6-4ecf-b2cc-c7c330909968 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.073880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ae4a30-6ed6-4ecf-b2cc-c7c330909968 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.074951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ae4a30-6ed6-4ecf-b2cc-c7c330909968 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.075762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ae4a30-6ed6-4ecf-b2cc-c7c330909968 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.107938 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9ae4a30-6ed6-4ecf-b2cc-c7c330909968 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046001 Nov 27 20:49:39.109665 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 614/1287] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:49:39 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:49:39.116120 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27ac7aa9-974c-4a04-8079-a15c2bb04efa tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 1.454614 Nov 27 20:49:39.120538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 674/1288] 10.222.0.21 () {58 vars in 1149 bytes} [Sat Nov 27 20:49:37 2021] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:39.139807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:39.151535 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:39.151535 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:39.152991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:39.154238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:39.164467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.167818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.168892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.170589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.359795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:39.413554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:39.414291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:39.425350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.426058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.427051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.434236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.478503 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c45a3545-cf27-4df1-b5cd-e71ae7c55249 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.348798 Nov 27 20:49:39.479837 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 615/1289] 10.222.0.21 () {58 vars in 1211 bytes} [Sat Nov 27 20:49:39 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:39.500063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:39.503643 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:39.503643 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:39.504703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:39.505404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:39.542150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.544563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.548744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.549395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.706791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:39.927125 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e76766b5-8dd0-4ff0-8a85-4544a9849da1 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.438937 Nov 27 20:49:39.928935 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 616/1290] 10.222.0.21 () {58 vars in 1195 bytes} [Sat Nov 27 20:49:39 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:39.941275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91bed8bf-ec0c-44a8-9067-c33d6eb8d243 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:39.946009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91bed8bf-ec0c-44a8-9067-c33d6eb8d243 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:39.959877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91bed8bf-ec0c-44a8-9067-c33d6eb8d243 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.960342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91bed8bf-ec0c-44a8-9067-c33d6eb8d243 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:39.964053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91bed8bf-ec0c-44a8-9067-c33d6eb8d243 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:39.964687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91bed8bf-ec0c-44a8-9067-c33d6eb8d243 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:40.037508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91bed8bf-ec0c-44a8-9067-c33d6eb8d243 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.105686 Nov 27 20:49:40.038633 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 617/1291] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:39 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:40.050421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:40.064266 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:40.064266 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:40.065744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:40.066767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'name': '-539822771', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:40.076497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:40.077184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:40.078493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:40.079162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:40.314787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:40.470186 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4343f079-87de-414d-81c6-0ae22ed21eed tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?name=-539822771" status: 200 len: 345 microversion: 2.1 time: 0.430109 Nov 27 20:49:40.470993 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 618/1292] 10.222.0.21 () {58 vars in 1155 bytes} [Sat Nov 27 20:49:40 2021] GET /compute/v2.1/servers?name=-539822771 => generated 345 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:40.485586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:40.486300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:40.515044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:40.516067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:40.517180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:40.517847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:40.680675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:40.700527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5144482-7fb7-4c1a-a3c2-c0b8367aefa1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 1.288350 Nov 27 20:49:40.702248 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 675/1293] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:39 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:40.731750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:40.751835 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:40.751835 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:40.760314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:40.762273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:40.787265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:40.797160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:40.799865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:40.802526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:40.916830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:40.925839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b7f9e0d-b731-4657-bd3f-07d3ed94388f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1474 microversion: 2.1 time: 0.452970 Nov 27 20:49:40.929431 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 619/1294] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:40 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1474 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:40.941480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5f9c341e-b58a-4206-ac80-51f124c29908 req-fe5c3a83-8353-4ab9-bac2-68c44bc5e35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352412c0-8ac8-4c44-810a-ce588efeafcd", "name": "network-vif-plugged", "status": "completed", "tag": "03656c06-3cc8-4fda-a16b-4029c1b5ca5e"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:40.945346 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:40.945346 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:40.969761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5f9c341e-b58a-4206-ac80-51f124c29908 req-fe5c3a83-8353-4ab9-bac2-68c44bc5e35e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:40.973434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5f9c341e-b58a-4206-ac80-51f124c29908 req-fe5c3a83-8353-4ab9-bac2-68c44bc5e35e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.007640 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5f9c341e-b58a-4206-ac80-51f124c29908 req-fe5c3a83-8353-4ab9-bac2-68c44bc5e35e service nova] Creating event network-vif-plugged:03656c06-3cc8-4fda-a16b-4029c1b5ca5e for instance 352412c0-8ac8-4c44-810a-ce588efeafcd on nch2-master-1 Nov 27 20:49:41.029393 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5f9c341e-b58a-4206-ac80-51f124c29908 req-fe5c3a83-8353-4ab9-bac2-68c44bc5e35e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095669 Nov 27 20:49:41.037861 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 620/1295] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:41.049142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:41.059392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f1011f6-38b0-464f-8d03-7a6300d206d1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:41.070713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f1011f6-38b0-464f-8d03-7a6300d206d1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:41.079609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f1011f6-38b0-464f-8d03-7a6300d206d1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.081285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f1011f6-38b0-464f-8d03-7a6300d206d1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.082339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f1011f6-38b0-464f-8d03-7a6300d206d1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.083014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f1011f6-38b0-464f-8d03-7a6300d206d1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.140864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f1011f6-38b0-464f-8d03-7a6300d206d1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.092904 Nov 27 20:49:41.142254 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 621/1296] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:41 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:41.173798 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75a9cbc9-cb0f-4d56-aaac-bd30b531a439 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.459470 Nov 27 20:49:41.174852 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 676/1297] 10.222.0.21 () {58 vars in 1153 bytes} [Sat Nov 27 20:49:40 2021] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:41.186080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:41.190780 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:41.190780 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:41.191922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:41.192695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-53982277', 'deleted': False, 'project_id': '72659aa0252c4e7491effb8522dd5a1c'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:41.217228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.223398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.227417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.228108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.396998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:41.465714 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-509e0e89-49d4-488e-af31-877897db2c10 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-53982277" status: 200 len: 345 microversion: 2.1 time: 0.283217 Nov 27 20:49:41.473985 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 622/1298] 10.222.0.21 () {58 vars in 1225 bytes} [Sat Nov 27 20:49:41 2021] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-53982277 => generated 345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:41.478912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:41.479501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:41.486454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.486906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.487859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.488675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.553151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:49:41.722681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:41.724156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:41.740497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.744343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.746647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.748198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.785742 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4363032-984b-43f5-bc1c-69cb0e14a93a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "DELETE /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 204 len: 0 microversion: 2.1 time: 0.310582 Nov 27 20:49:41.800111 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 677/1299] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:49:41 2021] DELETE /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:49:41.813489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:41.818383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:41.831911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.834179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:41.841514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:41.842267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:42.003889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:42.015696 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-901e5a99-3ff0-415e-97bc-c9fbfbc58e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 0.301386 Nov 27 20:49:42.027100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 623/1300] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:41 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:42.040195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:42.040836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:42.089484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:42.089973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:42.090838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:42.091350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:42.448396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:42.465271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:42.469642 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ec54c0b-22a5-494a-8a5f-0afc36c64530 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1519 microversion: 2.1 time: 0.662251 Nov 27 20:49:42.470711 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 678/1301] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:41 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1519 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:42.476091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ed5356f-f455-412f-b673-5aed0030911a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:42.477542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ed5356f-f455-412f-b673-5aed0030911a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:42.486428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ed5356f-f455-412f-b673-5aed0030911a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:42.487343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ed5356f-f455-412f-b673-5aed0030911a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:42.488413 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46aeae03-656e-4f09-b563-856114af2ea9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1474 microversion: 2.1 time: 0.459768 Nov 27 20:49:42.488791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ed5356f-f455-412f-b673-5aed0030911a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:42.489406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ed5356f-f455-412f-b673-5aed0030911a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:42.491724 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 624/1302] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:42 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1474 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:42.556300 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ed5356f-f455-412f-b673-5aed0030911a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.083915 Nov 27 20:49:42.562504 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 679/1303] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:42 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:43.033986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:43.034584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:43.045818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.052482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.054242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.054875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.078449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ff61060f-986f-43ac-8da8-29946752673e req-384152a3-b60d-45c3-bef4-c3b87f5b3f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff456cbf-e87f-45d6-bc23-eda1680f7319", "name": "network-vif-plugged", "status": "completed", "tag": "f7eb3780-8e46-4709-b050-efac2b428838"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:43.081160 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:43.081160 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:43.108996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ff61060f-986f-43ac-8da8-29946752673e req-384152a3-b60d-45c3-bef4-c3b87f5b3f70 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.109449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ff61060f-986f-43ac-8da8-29946752673e req-384152a3-b60d-45c3-bef4-c3b87f5b3f70 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.144003 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ff61060f-986f-43ac-8da8-29946752673e req-384152a3-b60d-45c3-bef4-c3b87f5b3f70 service nova] Creating event network-vif-plugged:f7eb3780-8e46-4709-b050-efac2b428838 for instance ff456cbf-e87f-45d6-bc23-eda1680f7319 on nch1-master-1 Nov 27 20:49:43.152986 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ff61060f-986f-43ac-8da8-29946752673e req-384152a3-b60d-45c3-bef4-c3b87f5b3f70 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079367 Nov 27 20:49:43.153676 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 680/1304] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:49:43.395988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:43.404476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61421f49-b3a4-4137-a9fa-67870430434c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 0.374573 Nov 27 20:49:43.407582 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 625/1305] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:43 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:43.488494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:43.489541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:43.504610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.505526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.507228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.508992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.509126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:43.510302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:43.519106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.521142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.522214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.526303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.732012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:43.757984 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7878c39-5c23-4e2b-afea-5ece4ad56c9d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1471 microversion: 2.1 time: 0.242100 Nov 27 20:49:43.763161 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 626/1306] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:43 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:43.780741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-25a856c6-62fc-43ad-9121-6789581aed1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:43.782458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-25a856c6-62fc-43ad-9121-6789581aed1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:43.803482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25a856c6-62fc-43ad-9121-6789581aed1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.803947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25a856c6-62fc-43ad-9121-6789581aed1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.804764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25a856c6-62fc-43ad-9121-6789581aed1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.805203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25a856c6-62fc-43ad-9121-6789581aed1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.874948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-25a856c6-62fc-43ad-9121-6789581aed1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.110262 Nov 27 20:49:43.878962 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 627/1307] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:43 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:43.885019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:43.886549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:43.905080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.905994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.908053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.908557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.956248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.956696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.957517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:43.957981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:43.984398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:43.989956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for user 3cb6bc63929648388ac9648823d4ca88 and project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:44.137446 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da61348a-a52e-46eb-a9ea-af35280f1a10 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835/action" status: 202 len: 0 microversion: 2.1 time: 0.259402 Nov 27 20:49:44.138856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 628/1308] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:43 2021] POST /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:49:44.156818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:44.157677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:44.166218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:44.167047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:44.168283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:44.168718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:44.274058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:44.286228 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-09258e6e-6f62-412c-80af-876a6b8c8821 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1519 microversion: 2.1 time: 0.801871 Nov 27 20:49:44.287038 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 681/1309] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:43 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1519 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:44.353936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:44.365293 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4341a0a9-d947-4e81-a749-deb4d572f0c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1470 microversion: 2.1 time: 0.217282 Nov 27 20:49:44.375472 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 629/1310] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:44 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:44.432862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:44.433412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:44.440966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:44.449833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:44.451026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:44.451812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:44.886343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97b1a4c7-f747-42d0-9d32-9d1bf4d54f88 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:44.887435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-97b1a4c7-f747-42d0-9d32-9d1bf4d54f88 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:44.902673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97b1a4c7-f747-42d0-9d32-9d1bf4d54f88 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:44.903427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97b1a4c7-f747-42d0-9d32-9d1bf4d54f88 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:44.904689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97b1a4c7-f747-42d0-9d32-9d1bf4d54f88 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:44.905011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97b1a4c7-f747-42d0-9d32-9d1bf4d54f88 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:44.958908 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97b1a4c7-f747-42d0-9d32-9d1bf4d54f88 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.075624 Nov 27 20:49:44.963668 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 630/1311] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:44 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:49:45.182641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:45.209082 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03d96d1a-a551-4e13-94a8-88a476402024 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1319 microversion: 2.1 time: 0.787599 Nov 27 20:49:45.226835 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 682/1312] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:44 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1319 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:45.306141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:45.307639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:45.319578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:45.320134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:45.327431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:45.328299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:45.386316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:45.387787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:45.400301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:45.401059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:45.401861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:45.402306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:45.632048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:45.655058 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc5967ad-0768-400c-90aa-771bfa9a78e8 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1519 microversion: 2.1 time: 0.347184 Nov 27 20:49:45.658307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 631/1313] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:45 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1519 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:45.972256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-242f8624-a280-45ba-9472-cea978686b8e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:45.973294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-242f8624-a280-45ba-9472-cea978686b8e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:45.992926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-242f8624-a280-45ba-9472-cea978686b8e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:45.993752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-242f8624-a280-45ba-9472-cea978686b8e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:45.994818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-242f8624-a280-45ba-9472-cea978686b8e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:45.995759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-242f8624-a280-45ba-9472-cea978686b8e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:46.110833 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-242f8624-a280-45ba-9472-cea978686b8e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.143479 Nov 27 20:49:46.111852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 632/1314] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:45 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:46.241914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:46.245476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:46.265442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:46.267049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:46.285502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:46.286540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:46.739559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:46.762214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1285e4c5-1210-495f-bbe2-11dc2546948c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1469 microversion: 2.1 time: 0.531485 Nov 27 20:49:46.766581 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 633/1315] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:46 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1469 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:46.772094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7a06d6d7-b5f9-472f-a119-410ad50dea60 req-2624d4c5-e4f9-4790-b3c8-b15c4b4b7c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476f7662-3487-44f6-9f58-943deb3cde93", "name": "network-vif-deleted", "tag": "0cb03dce-7858-4441-8989-6186f64291e0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:46.774055 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:46.774055 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:46.814069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7a06d6d7-b5f9-472f-a119-410ad50dea60 req-2624d4c5-e4f9-4790-b3c8-b15c4b4b7c4f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:46.815421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7a06d6d7-b5f9-472f-a119-410ad50dea60 req-2624d4c5-e4f9-4790-b3c8-b15c4b4b7c4f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:46.832059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:46.841985 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17de97b4-c553-4536-9918-978f7b58e147 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1470 microversion: 2.1 time: 1.459582 Nov 27 20:49:46.852243 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 683/1316] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:45 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1470 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:49:46.898165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7a06d6d7-b5f9-472f-a119-410ad50dea60 req-2624d4c5-e4f9-4790-b3c8-b15c4b4b7c4f service nova] Creating event network-vif-deleted:0cb03dce-7858-4441-8989-6186f64291e0 for instance 476f7662-3487-44f6-9f58-943deb3cde93 on nch1-master-1 Nov 27 20:49:46.911649 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7a06d6d7-b5f9-472f-a119-410ad50dea60 req-2624d4c5-e4f9-4790-b3c8-b15c4b4b7c4f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138327 Nov 27 20:49:46.913006 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 634/1317] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:46.932129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:46.936979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:46.957138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:46.957885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:46.958899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:46.963941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:47.019964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:47.020676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:47.021308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lazy-loading 'fault' on Instance uuid 476f7662-3487-44f6-9f58-943deb3cde93 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:47.251537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-540d8b28-fac8-42c4-9a8a-445b408e97dd tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Action: 'create', calling method: .version_select at 0x7f15d41a08b0>, body: {"pool": null} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:47.313853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:47.362513 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8735c2a6-b4ee-40d2-813a-bb4775958379 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 200 len: 1311 microversion: 2.1 time: 0.417050 Nov 27 20:49:47.375654 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 635/1318] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:46 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 1311 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:47.382671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:47.386353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:47.429452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:47.429452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:47.429452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:47.434479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:48.104050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:48.113737 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ba4fe07-294f-4e3f-817d-e21234513dd1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd" status: 200 len: 1468 microversion: 2.1 time: 0.736150 Nov 27 20:49:48.130084 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 636/1319] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:47 2021] GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd => generated 1468 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:48.139025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b56f672-f7a5-43dc-bd06-d0618bb08f1d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:48.147002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b56f672-f7a5-43dc-bd06-d0618bb08f1d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:48.162590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b56f672-f7a5-43dc-bd06-d0618bb08f1d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:48.163122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b56f672-f7a5-43dc-bd06-d0618bb08f1d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:48.164022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b56f672-f7a5-43dc-bd06-d0618bb08f1d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:48.164454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b56f672-f7a5-43dc-bd06-d0618bb08f1d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:48.269218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b56f672-f7a5-43dc-bd06-d0618bb08f1d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.137211 Nov 27 20:49:48.270652 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 637/1320] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:48 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:48.281779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-39324ac9-7de9-4c01-842a-9063eb8911c6 req-e32c2ece-f98b-46cc-b088-45226c88de2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "name": "network-vif-plugged", "status": "completed", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:48.286049 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:48.286049 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:48.309562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-39324ac9-7de9-4c01-842a-9063eb8911c6 req-e32c2ece-f98b-46cc-b088-45226c88de2a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:48.311926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-39324ac9-7de9-4c01-842a-9063eb8911c6 req-e32c2ece-f98b-46cc-b088-45226c88de2a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:48.338744 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-39324ac9-7de9-4c01-842a-9063eb8911c6 req-e32c2ece-f98b-46cc-b088-45226c88de2a service nova] Creating event network-vif-plugged:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch2-master-1 Nov 27 20:49:48.356786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-39324ac9-7de9-4c01-842a-9063eb8911c6 req-e32c2ece-f98b-46cc-b088-45226c88de2a service nova] Instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:49:48.387342 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-39324ac9-7de9-4c01-842a-9063eb8911c6 req-e32c2ece-f98b-46cc-b088-45226c88de2a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114155 Nov 27 20:49:48.387967 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 638/1321] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:48.399796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:48.402650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:48.419764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:48.425152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:48.426400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:48.427007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:48.899027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:48.909276 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff4d16bb-8266-4043-a7b1-95d009c515c8 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1470 microversion: 2.1 time: 0.519829 Nov 27 20:49:48.927049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 639/1322] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:48 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1470 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:48.935369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:48.942815 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:48.942815 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:48.945301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:48.948632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Searching by: {'reservation_id': 'r-zai00dth', 'deleted': False, 'project_id': 'c03fae8406904a0da2046c097555cf58'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:49:48.966699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:48.967327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:48.969661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:48.974879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:49.295187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:49:49.461591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:49.482492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:49.484664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:49.970066 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab852149-70d3-4377-bb14-5ffeed8067bb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/detail?reservation_id=r-zai00dth" status: 200 len: 2930 microversion: 2.1 time: 1.046188 Nov 27 20:49:49.970524 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 640/1323] 10.222.0.21 () {58 vars in 1196 bytes} [Sat Nov 27 20:49:48 2021] GET /compute/v2.1/servers/detail?reservation_id=r-zai00dth => generated 2930 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:49.987418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:49.990749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 476f7662-3487-44f6-9f58-943deb3cde93] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:49.999935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.000388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.004210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.004733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.046820 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] HTTP exception thrown: Instance 476f7662-3487-44f6-9f58-943deb3cde93 could not be found. Nov 27 20:49:50.047929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Returning 404 to user: Instance 476f7662-3487-44f6-9f58-943deb3cde93 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:50.055920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ead40610-4039-4306-a9a8-bf64ad97b210 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93" status: 404 len: 111 microversion: 2.1 time: 0.078087 Nov 27 20:49:50.069906 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 641/1324] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:49 2021] GET /compute/v2.1/servers/476f7662-3487-44f6-9f58-943deb3cde93 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:49:50.092150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6aebeaca-779e-494f-92c2-9f5941625ec9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:50.098610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6aebeaca-779e-494f-92c2-9f5941625ec9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:50.118650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aebeaca-779e-494f-92c2-9f5941625ec9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.119822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aebeaca-779e-494f-92c2-9f5941625ec9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.124586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aebeaca-779e-494f-92c2-9f5941625ec9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.125971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aebeaca-779e-494f-92c2-9f5941625ec9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.232367 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6aebeaca-779e-494f-92c2-9f5941625ec9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.159958 Nov 27 20:49:50.233913 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 642/1325] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:50 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:50.249686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:50.250386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:50.287594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.288090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.289083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.289524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.367032 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-540d8b28-fac8-42c4-9a8a-445b408e97dd tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.512375 Nov 27 20:49:50.369214 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 684/1326] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:49:46 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:50.384040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-840e6c22-0d16-4fef-8920-443d626bf7d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:50.415735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_groups [None req-840e6c22-0d16-4fef-8920-443d626bf7d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Querying cell fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) for 2 instances {{(pid=135680) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 27 20:49:50.416867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-840e6c22-0d16-4fef-8920-443d626bf7d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.417508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-840e6c22-0d16-4fef-8920-443d626bf7d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.480719 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-840e6c22-0d16-4fef-8920-443d626bf7d7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups/2806f1c8-ce1c-4445-9cca-6347ca84de05" status: 200 len: 270 microversion: 2.1 time: 0.110205 Nov 27 20:49:50.483002 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 685/1327] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:49:50 2021] GET /compute/v2.1/os-server-groups/2806f1c8-ce1c-4445-9cca-6347ca84de05 => generated 270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:50.493259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:50.494053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:50.512886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.513373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.515761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.516407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.563231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:49:50.695627 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-134cbdba-b47d-4e4a-be35-685fb3c3f54e tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99" status: 204 len: 0 microversion: 2.1 time: 0.210578 Nov 27 20:49:50.696628 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 686/1328] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:49:50 2021] DELETE /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:49:50.703368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a8e39d93-cc3b-4ace-aced-2bf4b49574a3 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Action: 'create', calling method: .version_select at 0x7f15d44b1040>, body: {"pool": null} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:50.909623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:50.922221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75a49226-8005-4433-b131-efbe533310d4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1470 microversion: 2.1 time: 0.685125 Nov 27 20:49:50.923410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 643/1329] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:50 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1470 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:50.936224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2b8a154-9874-47d6-936d-6d443117e20a tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:50.937278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2b8a154-9874-47d6-936d-6d443117e20a tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:50.945499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2b8a154-9874-47d6-936d-6d443117e20a tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.946512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2b8a154-9874-47d6-936d-6d443117e20a tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:50.947789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2b8a154-9874-47d6-936d-6d443117e20a tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:50.948506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2b8a154-9874-47d6-936d-6d443117e20a tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:51.177224 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2b8a154-9874-47d6-936d-6d443117e20a tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd" status: 200 len: 1619 microversion: 2.1 time: 0.251307 Nov 27 20:49:51.187289 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 644/1330] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:50 2021] GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd => generated 1619 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:51.187289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:51.187289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:51.199475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:51.201627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:51.202663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:51.204509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:51.398166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:51.407428 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d351b06a-b05f-4d14-9435-2d29e76cf3b7 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99" status: 200 len: 1518 microversion: 2.1 time: 0.228061 Nov 27 20:49:51.417737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 645/1331] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:51 2021] GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99 => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:51.482740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f7dfc19-8c6e-4295-9b0a-64665a140301 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'create', calling method: .version_select at 0x7f15c7f9f550>, body: {"keypair": {"name": "tempest-keypair-545153221"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:51.501664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9f7dfc19-8c6e-4295-9b0a-64665a140301 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for project 3452ada55fe043918a4bf028d75b070d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:51.506042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9f7dfc19-8c6e-4295-9b0a-64665a140301 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for user dd54936ebf874a45800b444b942c6e76 and project 3452ada55fe043918a4bf028d75b070d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:51.607813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9f7dfc19-8c6e-4295-9b0a-64665a140301 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for project 3452ada55fe043918a4bf028d75b070d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:51.611632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9f7dfc19-8c6e-4295-9b0a-64665a140301 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for user dd54936ebf874a45800b444b942c6e76 and project 3452ada55fe043918a4bf028d75b070d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:51.625271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f7dfc19-8c6e-4295-9b0a-64665a140301 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.206251 Nov 27 20:49:51.625879 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 646/1332] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:49:51 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:51.630840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d27eb11e-0385-4829-9f0c-ed6902b0d486 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:51.631949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d27eb11e-0385-4829-9f0c-ed6902b0d486 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:51.637264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d27eb11e-0385-4829-9f0c-ed6902b0d486 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:51.637721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d27eb11e-0385-4829-9f0c-ed6902b0d486 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:51.638511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d27eb11e-0385-4829-9f0c-ed6902b0d486 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:51.639665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d27eb11e-0385-4829-9f0c-ed6902b0d486 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:51.841304 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d27eb11e-0385-4829-9f0c-ed6902b0d486 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 200 len: 1620 microversion: 2.1 time: 0.213624 Nov 27 20:49:51.844526 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 647/1333] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:51 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 1620 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:51.864809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6bc5560-fb7e-4bda-8327-4506402df110 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:51.866584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6bc5560-fb7e-4bda-8327-4506402df110 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:51.891591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6bc5560-fb7e-4bda-8327-4506402df110 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:51.899097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6bc5560-fb7e-4bda-8327-4506402df110 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:51.900092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6bc5560-fb7e-4bda-8327-4506402df110 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:51.900763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6bc5560-fb7e-4bda-8327-4506402df110 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:51.960077 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6bc5560-fb7e-4bda-8327-4506402df110 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.114230 Nov 27 20:49:51.960780 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 648/1334] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:51 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:51.978650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-405587c9-675a-45f1-aaaa-056896070e5b req-3d414fa9-0796-4311-a6c8-ebc3b8802f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "name": "network-vif-unplugged", "status": "completed", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:51.982135 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:51.982135 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:52.005071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-405587c9-675a-45f1-aaaa-056896070e5b req-3d414fa9-0796-4311-a6c8-ebc3b8802f1c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:52.005361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-405587c9-675a-45f1-aaaa-056896070e5b req-3d414fa9-0796-4311-a6c8-ebc3b8802f1c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:52.032945 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-405587c9-675a-45f1-aaaa-056896070e5b req-3d414fa9-0796-4311-a6c8-ebc3b8802f1c service nova] Creating event network-vif-unplugged:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch1-master-1 Nov 27 20:49:52.055709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-405587c9-675a-45f1-aaaa-056896070e5b req-3d414fa9-0796-4311-a6c8-ebc3b8802f1c service nova] Instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:49:52.105712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-405587c9-675a-45f1-aaaa-056896070e5b req-3d414fa9-0796-4311-a6c8-ebc3b8802f1c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143594 Nov 27 20:49:52.112204 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 649/1335] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:51 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:52.127812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:52.129702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:52.142194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:52.142983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:52.147530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:52.148192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:52.554866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:52.568376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32377fe5-1b11-4a08-ab26-b039bde24cb2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1536 microversion: 2.1 time: 0.452273 Nov 27 20:49:52.569186 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 650/1336] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:52 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1536 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:52.584789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1159049070", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "979446f3-8da8-4e53-af09-3da825cab09f"}], "block_device_mapping_v2": [{"uuid": "96fb951e-cc34-4858-9c6f-c24a0ea53a71", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:52.722193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] validate_networks() for [('979446f3-8da8-4e53-af09-3da825cab09f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:49:53.789044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:49:53.789640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:49:53.796490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:49:53.797263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:49:53.797714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:49:53.846292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:53.846736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:53.851660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:53.852139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:53.901530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:53.909416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Getting quotas for user 2d326a07ce104727bec8ae98dabea64d and project a9eca53282994b4094a056750bb24ccb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:54.056202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:49:54.058685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96fb951e-cc34-4858-9c6f-c24a0ea53a71',volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:49:54.209972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ea61f01-7fe0-4c73-a1bb-9ff5a50b16ac tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.639570 Nov 27 20:49:54.210619 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 651/1337] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 20:49:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 20:49:54.218241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1364509406", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "ca701c1d-30e3-471a-881e-6d51c9bbef61"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:54.275703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:49:54.508686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a8e39d93-cc3b-4ace-aced-2bf4b49574a3 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.810340 Nov 27 20:49:54.519960 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 687/1338] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:49:50 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:54.533151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:54.537210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:54.549495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:54.551551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:54.567869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:54.568855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:54.643097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:54.643828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:54.644697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lazy-loading 'fault' on Instance uuid 2262a9bd-9524-4919-8024-e41473beec99 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:49:54.763401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:54.782495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-77b8de11-5c8e-4e62-9dd1-de854741ae62 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99" status: 200 len: 1311 microversion: 2.1 time: 0.257281 Nov 27 20:49:54.784861 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 688/1339] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:54 2021] GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99 => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:54.792080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f26f286-d343-4d5e-a1cc-045c29c84c47 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:54.796572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f26f286-d343-4d5e-a1cc-045c29c84c47 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:54.805192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f26f286-d343-4d5e-a1cc-045c29c84c47 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:54.806166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f26f286-d343-4d5e-a1cc-045c29c84c47 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:54.807954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f26f286-d343-4d5e-a1cc-045c29c84c47 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:54.809727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f26f286-d343-4d5e-a1cc-045c29c84c47 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:54.859891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:49:54.860386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:49:54.860816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:49:54.861452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:49:54.861876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:49:54.871911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:54.872395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:54.873244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:54.874336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:54.879475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f26f286-d343-4d5e-a1cc-045c29c84c47 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.092194 Nov 27 20:49:54.880935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 689/1340] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:54 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:54.888702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-185457545", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "324306ab-fd63-4c3d-9f56-7119b3413ec6"}], "block_device_mapping_v2": [{"uuid": "d11b7295-70ad-482a-85d7-2803b1944190", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:54.896043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:54.906110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:54.922045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:49:54.924828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:49:55.002956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ec1dcc26-0bbd-4383-be36-988e624f9e0e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791027 Nov 27 20:49:55.010214 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 652/1341] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:49:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:49:55.016244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:55.017709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:55.026506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:55.027205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:55.028834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:55.029456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:55.044854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] validate_networks() for [('324306ab-fd63-4c3d-9f56-7119b3413ec6', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:49:55.288097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:55.314722 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4af1ad97-cd77-4d7c-bb5b-0f6f99331191 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1536 microversion: 2.1 time: 0.299811 Nov 27 20:49:55.315417 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 653/1342] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:55 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1536 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:55.324040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-077d425f-a367-4e5a-a622-48f274a7ce6a req-0fe876eb-6a11-4d12-8d92-7cf2b92d4426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:55.327857 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:55.327857 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:49:55.338481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-077d425f-a367-4e5a-a622-48f274a7ce6a req-0fe876eb-6a11-4d12-8d92-7cf2b92d4426 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:55.338931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-077d425f-a367-4e5a-a622-48f274a7ce6a req-0fe876eb-6a11-4d12-8d92-7cf2b92d4426 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:55.357836 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-077d425f-a367-4e5a-a622-48f274a7ce6a req-0fe876eb-6a11-4d12-8d92-7cf2b92d4426 service nova] Creating event network-changed:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch1-master-1 Nov 27 20:49:55.363754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-077d425f-a367-4e5a-a622-48f274a7ce6a req-0fe876eb-6a11-4d12-8d92-7cf2b92d4426 service nova] Instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:49:55.381932 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-077d425f-a367-4e5a-a622-48f274a7ce6a req-0fe876eb-6a11-4d12-8d92-7cf2b92d4426 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064925 Nov 27 20:49:55.386266 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 654/1343] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:55.392524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:55.393286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:55.401620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:55.402086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:55.402871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:55.403360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:55.505191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:55.517357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:55.519085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:55.523314 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-341489f8-bf36-4f6b-9d69-e69fcdd91828 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1233 microversion: 2.25 time: 0.135773 Nov 27 20:49:55.534883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 655/1344] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:55 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1233 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:55.539957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6eff25c3-e8df-4f01-88f8-96d265eccd9f tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Action: 'create', calling method: .version_select at 0x7f15c734f670>, body: {"pool": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:56.306430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:49:56.307411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:49:56.308054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:49:56.308652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:49:56.309225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:49:56.334280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:56.335073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:56.336224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:56.336828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:56.363802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:56.368554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Getting quotas for user 1d46c71936aa4118aa36a9e95b95c4f5 and project 149906b8a2744176929b4d314a0de57d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:56.453360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:49:56.459734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d11b7295-70ad-482a-85d7-2803b1944190',volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:49:56.735594 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b13e1121-fe03-400a-9e92-1dbb78a6ae1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.852358 Nov 27 20:49:56.736898 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 690/1345] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:49:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:49:56.742893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1716968325", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "be9122ae-5461-41a9-8128-1bf0198a3d43"}], "security_groups": [{"name": "tempest-securitygroup--1463997876"}], "key_name": "tempest-keypair-545153221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:57.013646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] validate_networks() for [('be9122ae-5461-41a9-8128-1bf0198a3d43', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:49:57.803071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6eff25c3-e8df-4f01-88f8-96d265eccd9f tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.266645 Nov 27 20:49:57.804384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 656/1346] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:49:55 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:57.809106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:57.810030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:57.821095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:57.825140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:57.826924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:57.828050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:57.919048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:57.928836 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-50b7a2f9-a80a-43d8-9075-65dee913ea56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1275 microversion: 2.1 time: 0.123039 Nov 27 20:49:57.939411 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 657/1347] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:57 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:57.945460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:57.946476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 2262a9bd-9524-4919-8024-e41473beec99] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:57.957111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:57.958463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:57.960413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:57.961023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:57.989359 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] HTTP exception thrown: Instance 2262a9bd-9524-4919-8024-e41473beec99 could not be found. Nov 27 20:49:57.990233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Returning 404 to user: Instance 2262a9bd-9524-4919-8024-e41473beec99 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:49:57.991432 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70271e54-1599-4859-86a1-6d641157d20a tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99" status: 404 len: 111 microversion: 2.1 time: 0.050554 Nov 27 20:49:57.992680 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 658/1348] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:57 2021] GET /compute/v2.1/servers/2262a9bd-9524-4919-8024-e41473beec99 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:49:57.999558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7661aae2-e2d7-40ea-ba78-0e97b27937a5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:58.001360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7661aae2-e2d7-40ea-ba78-0e97b27937a5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:58.018786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7661aae2-e2d7-40ea-ba78-0e97b27937a5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.020183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7661aae2-e2d7-40ea-ba78-0e97b27937a5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.021233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7661aae2-e2d7-40ea-ba78-0e97b27937a5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.021877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7661aae2-e2d7-40ea-ba78-0e97b27937a5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.079529 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7661aae2-e2d7-40ea-ba78-0e97b27937a5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.084567 Nov 27 20:49:58.080762 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 659/1349] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:49:57 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:49:58.086141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:58.087085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:58.095659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.096107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.096915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.097352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.443333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:58.456552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fef638d9-e2b6-4f54-a192-73673a0406ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1529 microversion: 2.1 time: 0.374190 Nov 27 20:49:58.457452 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 660/1350] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:58 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1529 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:58.462383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:58.463245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:58.480980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.481957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.483582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.484261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.506137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for project 3452ada55fe043918a4bf028d75b070d. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:58.512703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for user dd54936ebf874a45800b444b942c6e76 and project 3452ada55fe043918a4bf028d75b070d. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:58.540340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:49:58.540809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:49:58.541300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:49:58.549164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:49:58.550542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:49:58.574760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.575219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.578511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.578975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.607087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:58.617074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:58.618804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:58.619925 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ec77fd4-7566-4aa5-a370-5d1fb7d48d40 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1239 microversion: 2.25 time: 0.161327 Nov 27 20:49:58.629192 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 661/1351] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:49:58 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1239 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:49:58.630432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for project 3452ada55fe043918a4bf028d75b070d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:49:58.637382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:58.641251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:58.643112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Getting quotas for user dd54936ebf874a45800b444b942c6e76 and project 3452ada55fe043918a4bf028d75b070d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:49:58.659263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.662457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.663719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.664958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.673569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:49:58.681110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:49:58.764467 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f4a37670-0569-475d-bac6-1cc9854686f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.026012 Nov 27 20:49:58.766701 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 691/1352] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:49:56 2021] POST /compute/v2.1/servers => generated 407 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:49:58.779200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1bef4a33-459e-4025-b4ed-23a3e2b6acca req-0099997c-76f2-4701-b471-111243263982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2262a9bd-9524-4919-8024-e41473beec99", "name": "network-vif-deleted", "tag": "0958f265-00aa-4105-b49f-7b7659b442d8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:58.784693 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:49:58.784693 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:49:58.801469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1bef4a33-459e-4025-b4ed-23a3e2b6acca req-0099997c-76f2-4701-b471-111243263982 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.803369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1bef4a33-459e-4025-b4ed-23a3e2b6acca req-0099997c-76f2-4701-b471-111243263982 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.816581 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1bef4a33-459e-4025-b4ed-23a3e2b6acca req-0099997c-76f2-4701-b471-111243263982 service nova] Creating event network-vif-deleted:0958f265-00aa-4105-b49f-7b7659b442d8 for instance 2262a9bd-9524-4919-8024-e41473beec99 on nch2-master-1 Nov 27 20:49:58.823211 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1bef4a33-459e-4025-b4ed-23a3e2b6acca req-0099997c-76f2-4701-b471-111243263982 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054193 Nov 27 20:49:58.824708 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 692/1353] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:49:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:49:58.830253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c18a393-b47a-4572-a515-f66cb82655d0 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Action: 'create', calling method: .version_select at 0x7f15c76b83a0>, body: {"pool": null} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:49:58.927953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:58.944595 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1871a999-a1f3-46aa-8c56-38d70c9c84c4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1168 microversion: 2.1 time: 0.314013 Nov 27 20:49:58.947892 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 662/1354] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:58 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1168 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:58.967637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:58.969268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:58.976204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.976973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:58.978460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:58.979546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:59.024310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:49:59.190057 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ded95b38-f886-499b-887e-5a0defbb2b74 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 204 len: 0 microversion: 2.1 time: 0.226683 Nov 27 20:49:59.191607 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 663/1355] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:49:58 2021] DELETE /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:49:59.206032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:59.208271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:59.231914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:59.233411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:59.234568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:59.236268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:59.700484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:59.714195 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-037afc1e-beb0-4d93-9508-5821a458444f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1529 microversion: 2.1 time: 0.521056 Nov 27 20:49:59.715719 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 664/1356] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:59 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1529 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:59.723157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:59.724173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:49:59.732324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:59.734461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:59.735621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:49:59.736419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:49:59.976352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:49:59.990204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88863423-3892-4b55-8ccc-0cecf4212005 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1265 microversion: 2.1 time: 0.271487 Nov 27 20:49:59.991066 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 665/1357] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:59 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:49:59.997408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:49:59.997908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:00.016431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.017149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.018505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.019843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.361054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:00.372454 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d742ce4-d0de-4c90-b162-5bbdc55b75d9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1317 microversion: 2.1 time: 0.378906 Nov 27 20:50:00.374074 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 666/1358] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:49:59 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:00.378850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f48f3d3c-9bbd-4958-816d-e494193111c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:00.379871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f48f3d3c-9bbd-4958-816d-e494193111c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:00.392341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48f3d3c-9bbd-4958-816d-e494193111c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.393094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48f3d3c-9bbd-4958-816d-e494193111c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.400293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48f3d3c-9bbd-4958-816d-e494193111c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.401673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48f3d3c-9bbd-4958-816d-e494193111c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.480712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f48f3d3c-9bbd-4958-816d-e494193111c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.104922 Nov 27 20:50:00.481705 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 667/1359] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:00 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:00.487393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:00.489547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:00.497962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.498579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.499535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.500070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.728302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:00.737109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45d50a5e-3726-4b9e-a00d-7926fd03c4c5 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1518 microversion: 2.1 time: 0.254179 Nov 27 20:50:00.737777 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 668/1360] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:00 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:00.742602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:00.743311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:00.749753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.750285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.751185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.751704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.892544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:00.901984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:00.903627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:00.905420 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca2675b8-d05f-483f-9ace-ba50c63fef97 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.166458 Nov 27 20:50:00.906088 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 669/1361] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:00 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:00.910599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f8cabf9-c63c-4374-9b40-1c54bd325080 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:00.911773 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:00.911773 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:00.919049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-6f8cabf9-c63c-4374-9b40-1c54bd325080 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] HTTP exception thrown: Flavor 44c36477-c127-4ecd-99d6-3a9a800a053f could not be found. Nov 27 20:50:00.920620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f8cabf9-c63c-4374-9b40-1c54bd325080 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Returning 404 to user: Flavor 44c36477-c127-4ecd-99d6-3a9a800a053f could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:50:00.921712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f8cabf9-c63c-4374-9b40-1c54bd325080 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/44c36477-c127-4ecd-99d6-3a9a800a053f" status: 404 len: 109 microversion: 2.1 time: 0.014621 Nov 27 20:50:00.922667 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 670/1362] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:50:00 2021] DELETE /compute/v2.1/flavors/44c36477-c127-4ecd-99d6-3a9a800a053f => generated 109 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:50:00.927427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:00.928226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:00.938117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.940015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:00.941034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:00.941471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:01.122274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:01.131803 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ae164bb-ac14-4ae4-b557-e8d424d9e56b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.207891 Nov 27 20:50:01.132383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 671/1363] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:00 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:01.138089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f9d5702a-f783-4680-8859-bd9f429c967f req-eb57511e-0f97-4c8d-b789-6a23ad45610e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f6fefc-0619-4cd0-9361-aa81a9a2f30a", "tag": "e02b8cc1-0258-4858-9965-ca7f6004dc39"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:01.139631 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:01.139631 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:01.147417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f9d5702a-f783-4680-8859-bd9f429c967f req-eb57511e-0f97-4c8d-b789-6a23ad45610e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:01.147938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f9d5702a-f783-4680-8859-bd9f429c967f req-eb57511e-0f97-4c8d-b789-6a23ad45610e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:01.160326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f9d5702a-f783-4680-8859-bd9f429c967f req-eb57511e-0f97-4c8d-b789-6a23ad45610e service nova] Creating event network-changed:e02b8cc1-0258-4858-9965-ca7f6004dc39 for instance 63f6fefc-0619-4cd0-9361-aa81a9a2f30a on nch2-master-1 Nov 27 20:50:01.165436 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f9d5702a-f783-4680-8859-bd9f429c967f req-eb57511e-0f97-4c8d-b789-6a23ad45610e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031896 Nov 27 20:50:01.166050 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 672/1364] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:01.172723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:01.173422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:01.187393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:01.187963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:01.188827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:01.189329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:01.265818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:01.276556 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a4af20ad-33ac-48d0-81b1-d5fae4f770b0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1327 microversion: 2.1 time: 0.108626 Nov 27 20:50:01.279966 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 673/1365] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:01 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:01.285500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1441409878", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:01.343999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:50:02.196268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:50:02.196847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:50:02.197324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:50:02.197855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:50:02.198355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:50:02.211935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.212519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.214362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.214919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.237837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:50:02.247798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Getting quotas for user 3cb6bc63929648388ac9648823d4ca88 and project 04a17517c2104eeba56ce3a7cd915fb0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:50:02.263413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:50:02.266548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:50:02.319217 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7fc3fcb7-7cfa-42e1-a1ca-fad35259edba tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037958 Nov 27 20:50:02.324630 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 674/1366] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:50:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:50:02.329282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:02.329905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:02.338813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.339293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.340111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.340558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.580499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:02.590242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-200f4b74-6a82-4b42-a5c6-2edd3ff98047 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1317 microversion: 2.1 time: 0.268526 Nov 27 20:50:02.590827 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 675/1367] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:02 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:02.605503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e7c12039-986b-444c-b8da-1dc3c89beadf req-53924b5e-dc63-401c-a61a-2f8eae1ab3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecb697a-9c98-475c-9836-19f15d3c9194", "tag": "cab30d0b-bd13-4963-a8fd-40f8283c83c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:02.608554 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:02.608554 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:02.619490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e7c12039-986b-444c-b8da-1dc3c89beadf req-53924b5e-dc63-401c-a61a-2f8eae1ab3aa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.620719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e7c12039-986b-444c-b8da-1dc3c89beadf req-53924b5e-dc63-401c-a61a-2f8eae1ab3aa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.634819 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e7c12039-986b-444c-b8da-1dc3c89beadf req-53924b5e-dc63-401c-a61a-2f8eae1ab3aa service nova] Creating event network-changed:cab30d0b-bd13-4963-a8fd-40f8283c83c7 for instance 5ecb697a-9c98-475c-9836-19f15d3c9194 on nch2-master-1 Nov 27 20:50:02.641454 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e7c12039-986b-444c-b8da-1dc3c89beadf req-53924b5e-dc63-401c-a61a-2f8eae1ab3aa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048411 Nov 27 20:50:02.642599 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 676/1368] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:02.650033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f72dbef3-00f0-48da-8427-1e8cf7267132 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:02.652054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f72dbef3-00f0-48da-8427-1e8cf7267132 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:02.660390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72dbef3-00f0-48da-8427-1e8cf7267132 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.661682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72dbef3-00f0-48da-8427-1e8cf7267132 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.662615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72dbef3-00f0-48da-8427-1e8cf7267132 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.663111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72dbef3-00f0-48da-8427-1e8cf7267132 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.729558 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f72dbef3-00f0-48da-8427-1e8cf7267132 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.084292 Nov 27 20:50:02.730296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 677/1369] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:02 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:02.744516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:02.745252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:02.754125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.754578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:02.755404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:02.755841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.064324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:03.079639 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-83d46391-59c8-404f-b59b-5d0f77300cdb tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1518 microversion: 2.1 time: 0.342864 Nov 27 20:50:03.086985 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 678/1370] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:02 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1518 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:03.097104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:03.100003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:03.113410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.136853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.138044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.138736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.393903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:03.404841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:03.406749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:03.408177 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45a8e69c-f309-404f-a97b-1453ecd8b859 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.318619 Nov 27 20:50:03.408966 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 679/1371] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:03 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:03.414519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:03.415474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:03.427341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.428124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.429269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.430378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.454701 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c18a393-b47a-4572-a515-f66cb82655d0 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.628477 Nov 27 20:50:03.456325 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 693/1372] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:49:58 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:03.462184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:03.463171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:03.471161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.471964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.472973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.473625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.741866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:03.751756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53d7cd7f-0138-4b07-bbde-78f7cb470345 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.341282 Nov 27 20:50:03.762366 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 680/1373] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:03 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:03.771219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:03.774230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:03.796839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.797303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.798141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:03.798556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:03.954815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:03.976187 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c81c2cac-e59f-4310-a31e-8d526f49b8c7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1271 microversion: 2.1 time: 0.212548 Nov 27 20:50:03.987473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:03.987873 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 681/1374] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:03 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:03.987873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-53770ad7-f921-42f7-b3ef-1e88ffa59b32 req-b14c4b33-d4f0-42ab-bb1a-a859e166286f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "name": "network-vif-plugged", "status": "completed", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:03.987873 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:03.987873 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:03.994900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a8e3b59-32fb-422f-8a76-f94693971c48 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.536914 Nov 27 20:50:03.995385 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 694/1375] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:03 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:04.004647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-53770ad7-f921-42f7-b3ef-1e88ffa59b32 req-b14c4b33-d4f0-42ab-bb1a-a859e166286f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.004647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-53770ad7-f921-42f7-b3ef-1e88ffa59b32 req-b14c4b33-d4f0-42ab-bb1a-a859e166286f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.011676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6ab0940-d01b-413f-8585-ac70dd3a2c97 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Calling method '.version_select at 0x7f15c76b85e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:04.025911 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-53770ad7-f921-42f7-b3ef-1e88ffa59b32 req-b14c4b33-d4f0-42ab-bb1a-a859e166286f service nova] Creating event network-vif-plugged:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch1-master-1 Nov 27 20:50:04.031434 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-53770ad7-f921-42f7-b3ef-1e88ffa59b32 req-b14c4b33-d4f0-42ab-bb1a-a859e166286f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051240 Nov 27 20:50:04.033710 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 682/1376] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:04.038788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:04.039789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:04.046976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.048036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.049201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.049854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.302440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:04.332106 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c30fc12c-1cc7-4b5f-bc6c-bc8540fbb1ec tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1317 microversion: 2.1 time: 0.296853 Nov 27 20:50:04.333337 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 683/1377] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:04 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:04.339917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b5281c5-267e-4b2c-8fdc-2bbcbf73e76f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:04.340857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b5281c5-267e-4b2c-8fdc-2bbcbf73e76f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:04.351898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5281c5-267e-4b2c-8fdc-2bbcbf73e76f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.353159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5281c5-267e-4b2c-8fdc-2bbcbf73e76f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.353961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5281c5-267e-4b2c-8fdc-2bbcbf73e76f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.354557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5281c5-267e-4b2c-8fdc-2bbcbf73e76f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.408398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b5281c5-267e-4b2c-8fdc-2bbcbf73e76f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.073634 Nov 27 20:50:04.409773 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 684/1378] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:04 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:04.414876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:04.416614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:04.432824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.433633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.434633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.435192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.454686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6ab0940-d01b-413f-8585-ac70dd3a2c97 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips/1495bafe-c530-4816-9599-372898ca9a66" status: 200 len: 141 microversion: 2.1 time: 0.458079 Nov 27 20:50:04.455293 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 695/1379] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:50:03 2021] GET /compute/v2.1/os-floating-ips/1495bafe-c530-4816-9599-372898ca9a66 => generated 141 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:04.460443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:04.461354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:04.473539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.475940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.477997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.487715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.534710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.535470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.536076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lazy-loading 'fault' on Instance uuid 5aa58d27-298b-455d-8185-f926aa730620 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:50:04.592926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85b086594c4389b15420a56941c229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72659aa0252c4e7491effb8522dd5a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:04.601465 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-263913ef-dfd4-4935-8c96-78e0d0fd5c85 tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 200 len: 1310 microversion: 2.1 time: 0.190274 Nov 27 20:50:04.602713 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 685/1380] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:04 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 1310 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:04.610893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f235f271-7b7c-414f-b160-26762f7ad0cf tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Calling method '.version_select at 0x7f15c7d0dd30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:04.853148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:04.882688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:04.885526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:04.886966 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0df71ea-08b3-4673-8094-fbce19d1cf5f tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.429923 Nov 27 20:50:04.888284 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 696/1381] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:04 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:04.895429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:04.896348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:04.906102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.906969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:04.908036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:04.908738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:05.201861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:05.216592 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1e35aa30-4534-401b-a70c-9782eea03a33 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.325522 Nov 27 20:50:05.217678 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 697/1382] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:04 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:05.222680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-300cd2e4-a055-4a5e-833a-a2971910fe9d req-5164391b-274a-4b29-9c40-671b071d4fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa58d27-298b-455d-8185-f926aa730620", "name": "network-vif-deleted", "tag": "b3fdcccc-7383-40d8-8be2-9440dff6baff"}, {"name": "network-changed", "server_uuid": "f37efb1e-42bf-4d0f-8311-b4254fa2ce71", "tag": "24c3bbfe-097d-44dd-b015-ded002b7cd5e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:05.224718 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:05.224718 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:05.234804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-300cd2e4-a055-4a5e-833a-a2971910fe9d req-5164391b-274a-4b29-9c40-671b071d4fc1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:05.235285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-300cd2e4-a055-4a5e-833a-a2971910fe9d req-5164391b-274a-4b29-9c40-671b071d4fc1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:05.250003 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-300cd2e4-a055-4a5e-833a-a2971910fe9d req-5164391b-274a-4b29-9c40-671b071d4fc1 service nova] Creating event network-vif-deleted:b3fdcccc-7383-40d8-8be2-9440dff6baff for instance 5aa58d27-298b-455d-8185-f926aa730620 on nch2-master-1 Nov 27 20:50:05.251070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-300cd2e4-a055-4a5e-833a-a2971910fe9d req-5164391b-274a-4b29-9c40-671b071d4fc1 service nova] Creating event network-changed:24c3bbfe-097d-44dd-b015-ded002b7cd5e for instance f37efb1e-42bf-4d0f-8311-b4254fa2ce71 on nch1-master-1 Nov 27 20:50:05.259615 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-300cd2e4-a055-4a5e-833a-a2971910fe9d req-5164391b-274a-4b29-9c40-671b071d4fc1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040468 Nov 27 20:50:05.260477 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 698/1383] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:05 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:05.265892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:05.266963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:05.274368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:05.274912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:05.275794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:05.276294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:05.956539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:05.978834 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40301035-69ec-4c09-bde9-e60db6dca79b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.716767 Nov 27 20:50:05.980645 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 699/1384] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:05 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:05.986217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:05.987160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:06.000909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.001632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.003763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.004395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.070164 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f235f271-7b7c-414f-b160-26762f7ad0cf tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/1495bafe-c530-4816-9599-372898ca9a66" status: 202 len: 0 microversion: 2.1 time: 1.466485 Nov 27 20:50:06.070748 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 686/1385] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:50:04 2021] DELETE /compute/v2.1/os-floating-ips/1495bafe-c530-4816-9599-372898ca9a66 => generated 0 bytes in 1468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:50:06.082967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:06.083848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:06.090925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.092346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.093400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.094250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.321812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:06.336702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ecb4c28-bf38-497a-957a-ddd6e1b825e9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1317 microversion: 2.1 time: 0.258422 Nov 27 20:50:06.343630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:06.346606 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 687/1386] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:06 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:06.354061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-767a1432-d487-4dc8-980a-103bc713306c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:06.355614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-767a1432-d487-4dc8-980a-103bc713306c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:06.371105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f079d9c-8d82-4c77-84bf-579ecfd35c55 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.389306 Nov 27 20:50:06.374821 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 700/1387] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:05 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:06.377648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767a1432-d487-4dc8-980a-103bc713306c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.378294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767a1432-d487-4dc8-980a-103bc713306c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.380270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767a1432-d487-4dc8-980a-103bc713306c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.380885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767a1432-d487-4dc8-980a-103bc713306c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.384600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:06.385393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] [instance: 5aa58d27-298b-455d-8185-f926aa730620] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:06.402376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.404797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.407608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.408116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.431332 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] HTTP exception thrown: Instance 5aa58d27-298b-455d-8185-f926aa730620 could not be found. Nov 27 20:50:06.432357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] Returning 404 to user: Instance 5aa58d27-298b-455d-8185-f926aa730620 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:50:06.433208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-14a4b269-cb56-46f2-a0ef-833ac258411c tempest-ListServerFiltersTestJSON-981524550 tempest-ListServerFiltersTestJSON-981524550-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620" status: 404 len: 111 microversion: 2.1 time: 0.057400 Nov 27 20:50:06.438224 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 701/1388] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:06 2021] GET /compute/v2.1/servers/5aa58d27-298b-455d-8185-f926aa730620 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:50:06.452619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:06.453424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:06.453682 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-767a1432-d487-4dc8-980a-103bc713306c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.105512 Nov 27 20:50:06.454798 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 688/1389] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:06 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:06.462938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.463679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.464501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86ba6741-3806-4077-a3d0-9196174f6fad tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Calling method '.version_select at 0x7f15c734f790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:06.464848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.465443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.734818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:06.743809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:06.746121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:06.747428 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3b1c8a4-edf0-4159-856c-566801d553f1 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.307508 Nov 27 20:50:06.748086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 702/1390] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:06 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:06.752889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:06.753502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:06.760929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.761386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.762202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.762633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.902209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:06.910725 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b09c2fae-7a44-43b4-86da-e059418456e9 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.161291 Nov 27 20:50:06.920828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 703/1391] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:06 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:06.920828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0050b509-a8d5-44e7-a06f-0903f9be5e96 req-a5089822-5408-4521-a901-fb9c5d986019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:06.920828 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:06.920828 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:06.925789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0050b509-a8d5-44e7-a06f-0903f9be5e96 req-a5089822-5408-4521-a901-fb9c5d986019 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:06.926234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0050b509-a8d5-44e7-a06f-0903f9be5e96 req-a5089822-5408-4521-a901-fb9c5d986019 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:06.937531 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0050b509-a8d5-44e7-a06f-0903f9be5e96 req-a5089822-5408-4521-a901-fb9c5d986019 service nova] Creating event network-changed:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch1-master-1 Nov 27 20:50:06.942307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0050b509-a8d5-44e7-a06f-0903f9be5e96 req-a5089822-5408-4521-a901-fb9c5d986019 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029685 Nov 27 20:50:06.943167 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 704/1392] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:06.997414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:06.998222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:07.004678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.005129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.005913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.006351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.126803 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86ba6741-3806-4077-a3d0-9196174f6fad tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.670676 Nov 27 20:50:07.128701 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 689/1393] 10.222.0.21 () {58 vars in 1163 bytes} [Sat Nov 27 20:50:06 2021] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:50:07.141868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2f7a13eb-afdc-4f58-be48-2762d8d89f7c tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Calling method '.version_select at 0x7f15c7d80b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:07.158825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:07.166644 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-359af3ff-77fa-4651-b9a6-7c0731f27871 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.173223 Nov 27 20:50:07.167369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 705/1394] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:06 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:07.300263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b13cbe78-4147-4846-ac48-ac87b56e0f77 req-954236c0-aa2f-422b-82ca-f615d9059c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99c91ae-1196-4fdf-af86-c9c0c7a47bb2", "tag": "69669768-ef11-486a-bf97-be4dc7401b97"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:07.302005 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:07.302005 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:07.309406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b13cbe78-4147-4846-ac48-ac87b56e0f77 req-954236c0-aa2f-422b-82ca-f615d9059c61 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.309925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b13cbe78-4147-4846-ac48-ac87b56e0f77 req-954236c0-aa2f-422b-82ca-f615d9059c61 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.322384 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b13cbe78-4147-4846-ac48-ac87b56e0f77 req-954236c0-aa2f-422b-82ca-f615d9059c61 service nova] Creating event network-changed:69669768-ef11-486a-bf97-be4dc7401b97 for instance b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 on nch2-master-1 Nov 27 20:50:07.327424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b13cbe78-4147-4846-ac48-ac87b56e0f77 req-954236c0-aa2f-422b-82ca-f615d9059c61 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030894 Nov 27 20:50:07.328057 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 706/1395] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:50:07.354115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:07.354728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:07.363142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.363627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.364408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.364839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.574608 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2f7a13eb-afdc-4f58-be48-2762d8d89f7c tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.438916 Nov 27 20:50:07.583731 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 690/1396] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:50:07 2021] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:07.592083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:07.593402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:07.601971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.602775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.603877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.604596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.721308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:07.732944 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-95d261fc-bc38-4bc2-8dc7-0c45523dd7d4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1317 microversion: 2.1 time: 0.381350 Nov 27 20:50:07.733532 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 707/1397] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:07 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:07.746146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-399145f5-da40-414b-9523-72d7761f87f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:07.754841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-399145f5-da40-414b-9523-72d7761f87f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:07.761556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399145f5-da40-414b-9523-72d7761f87f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.761991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399145f5-da40-414b-9523-72d7761f87f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.763308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399145f5-da40-414b-9523-72d7761f87f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.764287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399145f5-da40-414b-9523-72d7761f87f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.822404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-399145f5-da40-414b-9523-72d7761f87f1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.085619 Nov 27 20:50:07.829665 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 708/1398] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:07 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:07.843709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89a84666-2c7e-413e-9504-60195cb8448d tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Calling method '.version_select at 0x7f15c77ff040>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:07.885789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:07.894366 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f601803-7683-482b-a0b2-b52884aebc4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.309151 Nov 27 20:50:07.894949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 691/1399] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:07 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:07.908970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:07.909814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:07.916258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.916921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:07.917873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:07.919096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.150066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:08.158692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:08.160475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:08.161749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f7db8b07-8a6a-42ac-923d-f3ca54a169d8 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.256372 Nov 27 20:50:08.173021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 692/1400] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:07 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:08.178224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:08.179086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:08.185381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:08.186078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.187023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:08.187634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.455530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:08.464304 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f05277c-18de-441c-9aad-6727735a671a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.289646 Nov 27 20:50:08.465487 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 693/1401] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:08 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:08.473131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:08.473999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:08.483104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:08.493126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.494318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:08.494925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.645337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:08.653446 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d99f8d0f-6f25-4b24-a5b4-a80b95553173 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.185646 Nov 27 20:50:08.654846 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 694/1402] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:08 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:08.749558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:08.750174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:08.756264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:08.756747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.757533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:08.757990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.940680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:08.948662 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3759455-b277-49f9-b713-a2b1a02dd1a1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1317 microversion: 2.1 time: 0.203480 Nov 27 20:50:08.949220 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 695/1403] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:08 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:08.958251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1354a952-0561-422b-b700-fb7d4138cee2 req-c443c83d-721b-4692-87f0-9b4cd66ce132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f6fefc-0619-4cd0-9361-aa81a9a2f30a", "name": "network-vif-plugged", "status": "completed", "tag": "e02b8cc1-0258-4858-9965-ca7f6004dc39"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:08.961754 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:08.961754 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:08.972898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1354a952-0561-422b-b700-fb7d4138cee2 req-c443c83d-721b-4692-87f0-9b4cd66ce132 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:08.974108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1354a952-0561-422b-b700-fb7d4138cee2 req-c443c83d-721b-4692-87f0-9b4cd66ce132 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:08.999335 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1354a952-0561-422b-b700-fb7d4138cee2 req-c443c83d-721b-4692-87f0-9b4cd66ce132 service nova] Creating event network-vif-plugged:e02b8cc1-0258-4858-9965-ca7f6004dc39 for instance 63f6fefc-0619-4cd0-9361-aa81a9a2f30a on nch2-master-1 Nov 27 20:50:09.006788 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1354a952-0561-422b-b700-fb7d4138cee2 req-c443c83d-721b-4692-87f0-9b4cd66ce132 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056142 Nov 27 20:50:09.008100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 696/1404] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:09.017674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c17db31-ed13-4e9b-be2a-000156832504 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:09.019534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c17db31-ed13-4e9b-be2a-000156832504 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:09.041600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c17db31-ed13-4e9b-be2a-000156832504 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.041990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c17db31-ed13-4e9b-be2a-000156832504 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.042811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c17db31-ed13-4e9b-be2a-000156832504 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.043610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c17db31-ed13-4e9b-be2a-000156832504 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.115627 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c17db31-ed13-4e9b-be2a-000156832504 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.105352 Nov 27 20:50:09.124417 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 697/1405] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:09 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:09.131970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:09.133078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:09.144577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.145035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.146216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.147705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.252663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89a84666-2c7e-413e-9504-60195cb8448d tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/01623020-4189-4c8a-a8b9-b2c581b9b292" status: 202 len: 0 microversion: 2.1 time: 1.421038 Nov 27 20:50:09.256097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 709/1406] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:50:07 2021] DELETE /compute/v2.1/os-floating-ips/01623020-4189-4c8a-a8b9-b2c581b9b292 => generated 0 bytes in 1423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:50:09.260447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:09.268602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:09.278203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.279490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.280539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.281264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.330381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:09.338135 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9612a695-8a5c-4ba3-8384-4c6e9363eb2d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.212157 Nov 27 20:50:09.338958 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 698/1407] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:09 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:09.350882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33bbb8aa-8911-47ac-bc5b-3f36e738879c tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Calling method '.version_select at 0x7f15c7fb9700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:09.479988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:09.501331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:09.507523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:09.509391 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae165d0e-82a8-4bda-9009-f14bd9110062 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.254160 Nov 27 20:50:09.510451 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 710/1408] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:09 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:09.525563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:09.526471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:09.546027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.546687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.547705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.548527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.714313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:09.722607 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a68284c-cab6-4433-9417-8f9b83b158db tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.210767 Nov 27 20:50:09.732740 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 711/1409] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:09 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:09.732740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:09.732740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:09.735849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.736454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.737237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.737667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.881662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:09.890268 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-635f3afc-83d0-4526-a751-370cd7905cd2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.165377 Nov 27 20:50:09.891115 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 712/1410] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:09 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:09.965816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:09.966471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:09.976312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.976765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:09.977559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:09.977991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.120852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:10.131684 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc84cdd8-f388-492d-87a6-fe69fe1cddff tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1317 microversion: 2.1 time: 0.169462 Nov 27 20:50:10.132720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 713/1411] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:09 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:10.137608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86c90e37-021e-4ecd-a67f-491cacb1c253 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:10.139538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86c90e37-021e-4ecd-a67f-491cacb1c253 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:10.146819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86c90e37-021e-4ecd-a67f-491cacb1c253 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.147509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86c90e37-021e-4ecd-a67f-491cacb1c253 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.148503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86c90e37-021e-4ecd-a67f-491cacb1c253 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.149090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86c90e37-021e-4ecd-a67f-491cacb1c253 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.186409 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33bbb8aa-8911-47ac-bc5b-3f36e738879c tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/cbe5feb7-93e2-4f67-b9e9-dd77b5141a4b" status: 202 len: 0 microversion: 2.1 time: 0.846094 Nov 27 20:50:10.187182 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 699/1412] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:50:09 2021] DELETE /compute/v2.1/os-floating-ips/cbe5feb7-93e2-4f67-b9e9-dd77b5141a4b => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:50:10.195118 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86c90e37-021e-4ecd-a67f-491cacb1c253 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.060929 Nov 27 20:50:10.196399 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 714/1413] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:10 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:10.197418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11e91302-926e-490b-9a96-1baddced9b63 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] Calling method '.version_select at 0x7f15c7378e50>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:10.355624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:10.356948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:10.364761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.365213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.366005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.366444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.521868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:10.529336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75537e84-4188-4b13-929f-ae412495753b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.178278 Nov 27 20:50:10.529918 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 715/1414] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:10 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:10.651097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-100175004", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": "none"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:10.718597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:50:10.718996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:50:10.719489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:50:10.719899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:50:10.720300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:50:10.730303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.730986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.732509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.733113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.753248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Getting quotas for project 49bcc58fc8444ca188eb8b273931ea09. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:50:10.757466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Getting quotas for user ce7415c3ef574fde8b4e378d3f787cbc and project 49bcc58fc8444ca188eb8b273931ea09. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:50:10.770606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:50:10.772989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:50:10.826955 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d4fa3da-d3f1-4e3a-aee1-939bea416cf5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.295193 Nov 27 20:50:10.827607 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 716/1415] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 20:50:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 20:50:10.831986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:10.832590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:10.857305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.857771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:10.863360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:10.864290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.004551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11e91302-926e-490b-9a96-1baddced9b63 tempest-FloatingIPDetailsTestJSON-573350019 tempest-FloatingIPDetailsTestJSON-573350019-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/f0d9fd7e-62c4-4e04-81ef-f5bbbe02db8e" status: 202 len: 0 microversion: 2.1 time: 0.812139 Nov 27 20:50:11.005141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 700/1416] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:50:10 2021] DELETE /compute/v2.1/os-floating-ips/f0d9fd7e-62c4-4e04-81ef-f5bbbe02db8e => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:50:11.009715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:11.010332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:11.017529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.018169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.018974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.019448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.075040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.084003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.086031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.087415 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-953c654a-c802-4c40-9725-a6c46cb5786e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.258846 Nov 27 20:50:11.088348 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 717/1417] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:10 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:11.094604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc432175-23b0-4654-9514-1cdb02797b15 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:11.095459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bc432175-23b0-4654-9514-1cdb02797b15 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:11.179431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.189525 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46fc6bf1-92e3-4da5-8a66-0214ed47a3c1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.182777 Nov 27 20:50:11.190620 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 701/1418] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:11 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:11.207808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:11.208843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:11.218550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.219051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.219958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.220669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.400540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.411353 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-286acbaf-54bc-421d-be8d-1f777352f5c4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.206925 Nov 27 20:50:11.412766 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 702/1419] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:11 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:11.420432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:11.422716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:11.439027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.439655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.440558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.441923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.495292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bc432175-23b0-4654-9514-1cdb02797b15 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.502864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bc432175-23b0-4654-9514-1cdb02797b15 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.504400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bc432175-23b0-4654-9514-1cdb02797b15 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.505539 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc432175-23b0-4654-9514-1cdb02797b15 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1277 microversion: 2.57 time: 0.415910 Nov 27 20:50:11.506301 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 718/1420] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:11 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1277 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:11.522581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9811aeac-a657-45b6-abbd-e24599d58bf0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:11.524267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9811aeac-a657-45b6-abbd-e24599d58bf0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:11.534665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9811aeac-a657-45b6-abbd-e24599d58bf0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.535464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9811aeac-a657-45b6-abbd-e24599d58bf0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.536685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9811aeac-a657-45b6-abbd-e24599d58bf0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.537138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9811aeac-a657-45b6-abbd-e24599d58bf0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.588409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9811aeac-a657-45b6-abbd-e24599d58bf0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.080693 Nov 27 20:50:11.589216 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 719/1421] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:11 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:11.596453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:11.597396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:11.605235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.606098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.607089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.607714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.628094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.635951 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c96b3a3-a991-4a2a-9067-72ef6bd92e37 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1466 microversion: 2.1 time: 0.221365 Nov 27 20:50:11.636905 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 703/1422] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:11 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1466 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:11.654714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d2bb451-0b73-46d0-bc61-44ff8043b42c tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:11.655885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d2bb451-0b73-46d0-bc61-44ff8043b42c tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:11.662993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d2bb451-0b73-46d0-bc61-44ff8043b42c tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.663534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d2bb451-0b73-46d0-bc61-44ff8043b42c tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.664371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d2bb451-0b73-46d0-bc61-44ff8043b42c tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:11.664794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d2bb451-0b73-46d0-bc61-44ff8043b42c tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:11.804204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d2bb451-0b73-46d0-bc61-44ff8043b42c tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1617 microversion: 2.1 time: 0.153817 Nov 27 20:50:11.804829 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 704/1423] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:11 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1617 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:11.833257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:11.840870 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c01b5c8f-67e2-4fd5-b9dd-47288a6851bd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.250249 Nov 27 20:50:11.842208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 720/1424] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:11 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:11.917284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1002849373", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["ca701c1d-30e3-471a-881e-6d51c9bbef61"]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:11.972234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:50:12.105828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:12.106441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:12.117168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.117629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.118432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.124600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.239547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:50:12.240086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:50:12.240789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:50:12.241302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:50:12.242679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:50:12.252434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.253352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.255224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.256209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.276906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:50:12.282797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:50:12.294819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:50:12.297461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:50:12.348819 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c7dba39b-0c9f-482e-9574-1eb5168f09b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435022 Nov 27 20:50:12.354271 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 705/1425] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:50:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:50:12.361098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:12.361724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:12.371284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.372649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.374790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.375486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.408863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.417344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.418852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.422403 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-025b647a-53cb-45ef-8eef-923b654e6f77 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.320283 Nov 27 20:50:12.426269 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 721/1426] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:12 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:12.430802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e9a4241-8aeb-453a-87ef-632728a3895e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:12.431439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e9a4241-8aeb-453a-87ef-632728a3895e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:12.572859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6e9a4241-8aeb-453a-87ef-632728a3895e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.580004 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e9a4241-8aeb-453a-87ef-632728a3895e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1217 microversion: 2.1 time: 0.152668 Nov 27 20:50:12.580585 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 722/1427] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:12 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:12.582346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.588410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:12.590943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:12.592114 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-caa6bb7e-1bfa-45d8-b713-1d67d368916d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.241617 Nov 27 20:50:12.592951 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 706/1428] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:12 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:12.598902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.599384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.600178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.600612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.604367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f60d3cdc-1555-4d83-9edf-686d1c17461e req-d2639de3-2c33-4854-9458-1a2bb2a393c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecb697a-9c98-475c-9836-19f15d3c9194", "name": "network-vif-plugged", "status": "completed", "tag": "cab30d0b-bd13-4963-a8fd-40f8283c83c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:12.606392 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:12.606392 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:12.619466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f60d3cdc-1555-4d83-9edf-686d1c17461e req-d2639de3-2c33-4854-9458-1a2bb2a393c2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.619921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f60d3cdc-1555-4d83-9edf-686d1c17461e req-d2639de3-2c33-4854-9458-1a2bb2a393c2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.634648 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f60d3cdc-1555-4d83-9edf-686d1c17461e req-d2639de3-2c33-4854-9458-1a2bb2a393c2 service nova] Creating event network-vif-plugged:cab30d0b-bd13-4963-a8fd-40f8283c83c7 for instance 5ecb697a-9c98-475c-9836-19f15d3c9194 on nch2-master-1 Nov 27 20:50:12.641423 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f60d3cdc-1555-4d83-9edf-686d1c17461e req-d2639de3-2c33-4854-9458-1a2bb2a393c2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042202 Nov 27 20:50:12.642022 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 707/1429] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:12.648248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:12.649374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:12.668267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.679763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.680669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.681123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.835376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.848630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.853128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:12.856394 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd0cd041-00b2-4c8d-9cc5-e1d186a8f2cc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1335 microversion: 2.57 time: 0.212921 Nov 27 20:50:12.857385 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 708/1430] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:12 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1335 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:12.875489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bce1a94e-4859-4306-b765-de68c577f23c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:12.879484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bce1a94e-4859-4306-b765-de68c577f23c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:12.886878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce1a94e-4859-4306-b765-de68c577f23c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.887360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce1a94e-4859-4306-b765-de68c577f23c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.888885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce1a94e-4859-4306-b765-de68c577f23c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.889461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bce1a94e-4859-4306-b765-de68c577f23c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.937418 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bce1a94e-4859-4306-b765-de68c577f23c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.078640 Nov 27 20:50:12.938712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 709/1431] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:12 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:12.960006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:12.960742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:12.971296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.972013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:12.972823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:12.974338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.089460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.111056 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60c2717c-1afe-488e-9359-30264beccf2b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.523664 Nov 27 20:50:13.144750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 723/1432] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:12 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:13.245492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.255096 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2b53503-7701-49c2-810e-11b1f44df2ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.315182 Nov 27 20:50:13.266190 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 710/1433] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:12 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:13.440794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:13.441669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:13.448178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.448635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.449437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.449880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.596781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:13.604220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:13.614376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.614825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.615639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.616073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.633575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.650680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.652955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.654350 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f73dcae6-ca09-450a-8e34-0f6a0e668af4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.217304 Nov 27 20:50:13.665904 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 724/1434] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:13 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:13.671745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:13.672663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:13.679010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.679800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.680847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.681567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.716986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.724735 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d52586bd-77cc-464c-b38d-284fac21fb94 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1269 microversion: 2.1 time: 0.131527 Nov 27 20:50:13.725940 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 711/1435] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:13 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:13.844306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.853834 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46041912-50af-4302-bc32-0ddae6bdd2a4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.186432 Nov 27 20:50:13.854494 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 725/1436] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:13 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:13.879064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:13.879789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:13.886547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.887215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.888183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.888770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.958617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-769d8a1b-ddfb-42e4-a26c-2cb50fc5f2ee tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:13.960766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-769d8a1b-ddfb-42e4-a26c-2cb50fc5f2ee tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:13.973023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-769d8a1b-ddfb-42e4-a26c-2cb50fc5f2ee tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.973487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-769d8a1b-ddfb-42e4-a26c-2cb50fc5f2ee tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.974293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-769d8a1b-ddfb-42e4-a26c-2cb50fc5f2ee tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:13.975684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-769d8a1b-ddfb-42e4-a26c-2cb50fc5f2ee tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:13.977801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.990323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.992298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:13.995855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-936a3c5e-639c-48c8-bd61-aa9844b882a3 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1335 microversion: 2.57 time: 0.122068 Nov 27 20:50:13.996541 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 712/1437] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:13 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1335 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:14.041597 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-769d8a1b-ddfb-42e4-a26c-2cb50fc5f2ee tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.096384 Nov 27 20:50:14.042343 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 726/1438] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:13 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:14.133791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:14.134755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:14.142617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.143076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.143916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.147841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.278039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:14.282120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:14.314719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.315391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.316431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.318013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.406935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:14.415502 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-26b8d7d0-7395-4d12-a9df-2dc035ddee6e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.285243 Nov 27 20:50:14.416216 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 713/1439] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:14 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:14.578384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:14.588330 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-305b5441-36c1-4ee6-8af5-fa614fe0c397 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.319526 Nov 27 20:50:14.598878 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 727/1440] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:14 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:14.660680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fcbfaa35-c189-4841-9065-77060d44d507 req-28a80537-db0d-43b6-8402-8a959ab37060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "name": "network-vif-plugged", "status": "completed", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}, {"server_uuid": "f37efb1e-42bf-4d0f-8311-b4254fa2ce71", "name": "network-vif-plugged", "status": "completed", "tag": "24c3bbfe-097d-44dd-b015-ded002b7cd5e"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:14.662703 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:14.662703 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:14.673465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fcbfaa35-c189-4841-9065-77060d44d507 req-28a80537-db0d-43b6-8402-8a959ab37060 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.673723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:14.674360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:14.674763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fcbfaa35-c189-4841-9065-77060d44d507 req-28a80537-db0d-43b6-8402-8a959ab37060 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.688347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.688802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.689613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.690059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.699355 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fcbfaa35-c189-4841-9065-77060d44d507 req-28a80537-db0d-43b6-8402-8a959ab37060 service nova] Creating event network-vif-plugged:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch1-master-1 Nov 27 20:50:14.700235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fcbfaa35-c189-4841-9065-77060d44d507 req-28a80537-db0d-43b6-8402-8a959ab37060 service nova] Creating event network-vif-plugged:24c3bbfe-097d-44dd-b015-ded002b7cd5e for instance f37efb1e-42bf-4d0f-8311-b4254fa2ce71 on nch1-master-1 Nov 27 20:50:14.707513 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fcbfaa35-c189-4841-9065-77060d44d507 req-28a80537-db0d-43b6-8402-8a959ab37060 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050437 Nov 27 20:50:14.713582 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 714/1441] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:14 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:14.762800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:14.766303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:14.790651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.791116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:14.791956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:14.792391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.145758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.155655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a86d1f03-4a46-4ca0-b3e9-69235285f866 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.412179 Nov 27 20:50:15.156255 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 715/1442] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:14 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:15.174207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:15.187992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:15.197948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.198916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.213677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.214689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.234125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.247285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.257623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.259086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-14ea8c5a-9797-4510-9da5-fb91ffb13433 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1281 microversion: 2.25 time: 0.590373 Nov 27 20:50:15.260099 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 728/1443] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:14 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1281 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:50:15.265198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:15.265998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:15.272493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.273174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.274131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.274722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.435060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.446707 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebdddd1b-32d1-4d7a-b5a7-9ff52570d61e tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1198 microversion: 2.1 time: 0.277733 Nov 27 20:50:15.450132 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 716/1444] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:15 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1198 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:15.463325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c1c6c6f-dcac-4e12-b0a5-430d84e5c751 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:15.464804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c1c6c6f-dcac-4e12-b0a5-430d84e5c751 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:15.471825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1c6c6f-dcac-4e12-b0a5-430d84e5c751 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.472902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1c6c6f-dcac-4e12-b0a5-430d84e5c751 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.473879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1c6c6f-dcac-4e12-b0a5-430d84e5c751 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.474481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1c6c6f-dcac-4e12-b0a5-430d84e5c751 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.482913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.490878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.492906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.494217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7785dae0-1473-446a-ba79-6ee8a0ca7fb0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1335 microversion: 2.57 time: 0.233015 Nov 27 20:50:15.494963 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 729/1445] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:15 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:15.499838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:15.500633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:15.508203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.508762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.509424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.509910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.535036 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c1c6c6f-dcac-4e12-b0a5-430d84e5c751 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.081814 Nov 27 20:50:15.539546 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 717/1446] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:15 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:15.606641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:15.607776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:15.615089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.616123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.617443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:15.618503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:15.802758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:15.814697 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84481e7a-2335-46cc-8031-713ca6e4a198 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.208555 Nov 27 20:50:15.817152 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 718/1447] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:15 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:16.173150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:16.173767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:16.179946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.180659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.181454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.182062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.252431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.271617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39df6ed7-dfb6-4196-93ae-911f8e19d99a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1313 microversion: 2.1 time: 0.775332 Nov 27 20:50:16.272230 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 730/1448] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:15 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1313 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:16.284091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:16.285677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:16.293007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.293695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.296600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.297359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.482869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.497109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f0c2632-885a-4910-b6a7-38e8d0dfb00b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.327860 Nov 27 20:50:16.508498 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 719/1449] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:16 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:16.513766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:16.514691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:16.523045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.524057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.525481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.526294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.704005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.712886 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-748c1045-3fac-452e-9018-1ad77808b09c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1381 microversion: 2.1 time: 0.202946 Nov 27 20:50:16.713595 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 720/1450] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:16 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1381 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:16.721126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:16.722029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:16.730410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.731083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.732067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.732777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.733307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.742601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.744870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.746272 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30c3c2b9-3f2a-4d03-a678-222db994e42d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1477 microversion: 2.25 time: 0.472933 Nov 27 20:50:16.747003 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 731/1451] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:16 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1477 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:16.751996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f9f53f2-4cd4-4c17-8e4b-f83b1db54c41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:16.753960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f9f53f2-4cd4-4c17-8e4b-f83b1db54c41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:16.767281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f9f53f2-4cd4-4c17-8e4b-f83b1db54c41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.768034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f9f53f2-4cd4-4c17-8e4b-f83b1db54c41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.769421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f9f53f2-4cd4-4c17-8e4b-f83b1db54c41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.770016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f9f53f2-4cd4-4c17-8e4b-f83b1db54c41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.808475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.821407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.823580 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f9f53f2-4cd4-4c17-8e4b-f83b1db54c41 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.074295 Nov 27 20:50:16.824034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:16.825099 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 732/1452] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:16 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:16.826874 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1fcbecea-db3d-4f10-a78c-d6c2d4b0a251 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1335 microversion: 2.57 time: 0.111732 Nov 27 20:50:16.827589 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 721/1453] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:16 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:16.833088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-87813abc-4668-45cc-b27b-9d22b5443f4d req-15d4f27e-e6e4-4e35-9f26-4f4a85be7fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99c91ae-1196-4fdf-af86-c9c0c7a47bb2", "name": "network-vif-plugged", "status": "completed", "tag": "69669768-ef11-486a-bf97-be4dc7401b97"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:16.833420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02db67d0-467f-4c1a-8939-5ee615376858 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:16.835224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02db67d0-467f-4c1a-8939-5ee615376858 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:16.835625 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:16.835625 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:16.843956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02db67d0-467f-4c1a-8939-5ee615376858 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.844417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02db67d0-467f-4c1a-8939-5ee615376858 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.845223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02db67d0-467f-4c1a-8939-5ee615376858 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.845663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02db67d0-467f-4c1a-8939-5ee615376858 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.848978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-87813abc-4668-45cc-b27b-9d22b5443f4d req-15d4f27e-e6e4-4e35-9f26-4f4a85be7fdb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.850928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-87813abc-4668-45cc-b27b-9d22b5443f4d req-15d4f27e-e6e4-4e35-9f26-4f4a85be7fdb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.862930 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-87813abc-4668-45cc-b27b-9d22b5443f4d req-15d4f27e-e6e4-4e35-9f26-4f4a85be7fdb service nova] Creating event network-vif-plugged:69669768-ef11-486a-bf97-be4dc7401b97 for instance b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 on nch2-master-1 Nov 27 20:50:16.869372 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-87813abc-4668-45cc-b27b-9d22b5443f4d req-15d4f27e-e6e4-4e35-9f26-4f4a85be7fdb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042012 Nov 27 20:50:16.870015 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 733/1454] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:16.876449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:16.877146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:16.884983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.885427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:16.886552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:16.887339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.324344 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02db67d0-467f-4c1a-8939-5ee615376858 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1532 microversion: 2.1 time: 0.494522 Nov 27 20:50:17.324890 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 722/1455] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:16 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1532 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:17.341504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:17.342625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:17.350265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.350803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.351712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.352246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.379537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid 5ecb697a-9c98-475c-9836-19f15d3c9194 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:50:17.393068 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45219a6d-eb6f-4ec3-a32c-91913f420d8d tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1970 microversion: 2.25 time: 0.521639 Nov 27 20:50:17.393792 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 734/1456] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:16 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1970 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:17.398567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-58d400ba-e6fd-43d9-a29f-0fa135cb280a req-54ea1931-d533-4b77-a880-e9ab694cbed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0f5c56-6c32-4b25-9685-4a04863f57dc", "tag": "ca642020-d459-4da1-b5a7-ee2c44c1c93e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:17.400173 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:17.400173 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:17.408485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-58d400ba-e6fd-43d9-a29f-0fa135cb280a req-54ea1931-d533-4b77-a880-e9ab694cbed7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.408936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-58d400ba-e6fd-43d9-a29f-0fa135cb280a req-54ea1931-d533-4b77-a880-e9ab694cbed7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.419758 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-58d400ba-e6fd-43d9-a29f-0fa135cb280a req-54ea1931-d533-4b77-a880-e9ab694cbed7 service nova] Creating event network-changed:ca642020-d459-4da1-b5a7-ee2c44c1c93e for instance cd0f5c56-6c32-4b25-9685-4a04863f57dc on nch2-master-1 Nov 27 20:50:17.424509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-58d400ba-e6fd-43d9-a29f-0fa135cb280a req-54ea1931-d533-4b77-a880-e9ab694cbed7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029192 Nov 27 20:50:17.425284 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 735/1457] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:17.432639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:17.433518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:17.440363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.440363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.441085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.441811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.549284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:17.557331 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3972a1a6-a175-4dbc-b6de-cd4e34f03574 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1395 microversion: 2.1 time: 0.220320 Nov 27 20:50:17.558348 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 723/1458] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:17 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1395 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:17.564452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-17faade5-7471-4f71-9740-4822d7679d74 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:17.565219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-17faade5-7471-4f71-9740-4822d7679d74 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:17.571648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17faade5-7471-4f71-9740-4822d7679d74 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.572102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17faade5-7471-4f71-9740-4822d7679d74 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.572892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17faade5-7471-4f71-9740-4822d7679d74 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.573398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17faade5-7471-4f71-9740-4822d7679d74 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.577011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:17.584272 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9aeea60-da15-4e94-8fbc-dd2d2a51d0a9 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1462 microversion: 2.1 time: 0.157671 Nov 27 20:50:17.585069 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 736/1459] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:17 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1462 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:17.589143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:17.589998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:17.596723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.597186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.597977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.598416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.732436 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-17faade5-7471-4f71-9740-4822d7679d74 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1532 microversion: 2.1 time: 0.172178 Nov 27 20:50:17.733238 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 724/1460] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:17 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1532 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:17.739108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:17.739824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:17.749815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.750741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.752152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.752820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.901873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid 5ecb697a-9c98-475c-9836-19f15d3c9194 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:50:17.938729 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07c582a1-ab90-4a1c-a9bd-8c3d143aa691 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1970 microversion: 2.25 time: 0.352808 Nov 27 20:50:17.940864 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 737/1461] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:17 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1970 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:17.946387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b06fdae-7c99-4ea7-ab64-6255d16720d0 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:17.947066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b06fdae-7c99-4ea7-ab64-6255d16720d0 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:17.952972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:17.954119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b06fdae-7c99-4ea7-ab64-6255d16720d0 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.954792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b06fdae-7c99-4ea7-ab64-6255d16720d0 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.955583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b06fdae-7c99-4ea7-ab64-6255d16720d0 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.956025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b06fdae-7c99-4ea7-ab64-6255d16720d0 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.962561 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ee14d24-0455-4575-a757-67b601f683b4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.228157 Nov 27 20:50:17.963233 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 725/1462] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:17 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:17.968326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a6770fcf-10de-4aff-9d74-40c4105afeeb tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:17.976038 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:17.976038 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:17.978091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6770fcf-10de-4aff-9d74-40c4105afeeb tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.978851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6770fcf-10de-4aff-9d74-40c4105afeeb tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:17.979771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6770fcf-10de-4aff-9d74-40c4105afeeb tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:17.980217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6770fcf-10de-4aff-9d74-40c4105afeeb tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.008292 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a6770fcf-10de-4aff-9d74-40c4105afeeb tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043923 Nov 27 20:50:18.009084 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 726/1463] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:50:17 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:18.014144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e21377b5-ae33-48c3-a610-c06e19bb28e3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:18.015124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e21377b5-ae33-48c3-a610-c06e19bb28e3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:18.020951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e21377b5-ae33-48c3-a610-c06e19bb28e3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.021399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e21377b5-ae33-48c3-a610-c06e19bb28e3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.022176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e21377b5-ae33-48c3-a610-c06e19bb28e3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.022730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e21377b5-ae33-48c3-a610-c06e19bb28e3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.087304 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e21377b5-ae33-48c3-a610-c06e19bb28e3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.076914 Nov 27 20:50:18.088917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 727/1464] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:18 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:18.095429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:18.096339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:18.103642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.104213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.105119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.106207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.172024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b06fdae-7c99-4ea7-ab64-6255d16720d0 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1613 microversion: 2.1 time: 0.228669 Nov 27 20:50:18.184377 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 738/1465] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:17 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1613 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:18.190322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc9e9186-bb5a-46af-ac5b-b0a6ffae23d1 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:18.192071 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:18.192071 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:18.198346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc9e9186-bb5a-46af-ac5b-b0a6ffae23d1 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.199544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc9e9186-bb5a-46af-ac5b-b0a6ffae23d1 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.201261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc9e9186-bb5a-46af-ac5b-b0a6ffae23d1 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.201400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:18.202115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc9e9186-bb5a-46af-ac5b-b0a6ffae23d1 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.213847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:18.216918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:18.218608 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b6dd5eb-aa4f-4eb5-8468-4cf92ee230f0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1356 microversion: 2.57 time: 0.128840 Nov 27 20:50:18.219872 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 728/1466] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:18 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1356 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:18.225478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:18.226594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:18.236401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.236994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.237789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.238217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.245033 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc9e9186-bb5a-46af-ac5b-b0a6ffae23d1 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.059022 Nov 27 20:50:18.245646 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 739/1467] 10.222.0.21 () {60 vars in 1216 bytes} [Sat Nov 27 20:50:18 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:18.250727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:18.251618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:18.258300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.259177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.260283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.260969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.265440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lazy-loading 'flavor' on Instance uuid f37efb1e-42bf-4d0f-8311-b4254fa2ce71 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:50:18.281594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Going to try to live migrate instance to nch2-master-1 {{(pid=135679) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:50:18.293299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1b2ee0ab190e4d4d9005d8d9f432f414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59ee766273440ad9e1b4b17af7c1c2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:18.294574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] flavor_id is None. Assuming migration. {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 27 20:50:18.295091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 20:50:18.432043 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a37398c-c124-4fdc-afa4-c1da82f0457e tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade/action" status: 202 len: 0 microversion: 2.1 time: 0.184371 Nov 27 20:50:18.432700 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 740/1468] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:18 2021] POST /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:50:18.442891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:18.444650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:18.452758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.453216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.454009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.454448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.550740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:50:18.551243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:50:18.551801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:50:18.552210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:50:18.552645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:50:18.650660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:18.666497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.666951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.667781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.674341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.717722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-898b3885-45f8-4858-847b-10c9e3530dd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "POST /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae/action" status: 202 len: 1137 microversion: 2.57 time: 0.279871 Nov 27 20:50:18.719125 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 741/1469] 10.222.0.21 () {62 vars in 1319 bytes} [Sat Nov 27 20:50:18 2021] POST /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae/action => generated 1137 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 27 20:50:18.723859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:18.725207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:18.733134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.734179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.735379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:18.750664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:18.789276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'flavor' on Instance uuid 5ecb697a-9c98-475c-9836-19f15d3c9194 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:50:18.801834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Going to try to live migrate instance to nch1-master-1 {{(pid=135680) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 20:50:19.735860 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0312fcd-ebf6-4755-a507-337bf0db6233 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71/action" status: 202 len: 0 microversion: 2.1 time: 1.514816 Nov 27 20:50:19.736882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 729/1470] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:18 2021] POST /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71/action => generated 0 bytes in 1516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:50:19.742964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:19.744500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:19.752573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:19.753304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:19.754099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:19.754713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:19.908475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:19.915952 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f27237dd-63b4-4a6c-846f-83b1ab3a6f85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1471 microversion: 2.1 time: 0.177825 Nov 27 20:50:19.916454 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 730/1471] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:19 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:19.921511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:19.922106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:19.927938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:19.928413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:19.929181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:19.929609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.063222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:20.070703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6bca5d7b-ffe1-4244-9897-68326d47d2f1 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1577 microversion: 2.1 time: 0.153108 Nov 27 20:50:20.082124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 731/1472] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:19 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:20.325974 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30203ba3-4003-4df7-9ae1-e4290ea1a823 tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] 10.222.0.21 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.253657 Nov 27 20:50:20.326516 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 732/1473] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:50:20 2021] DELETE /compute/v2.1/images/ => generated 112 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 27 20:50:20.330705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.331389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:20.337697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.338152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.338946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.339419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.380206 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8512c97f-3d4d-47a7-a6ae-df6b8cadabaf tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194/action" status: 202 len: 0 microversion: 2.25 time: 1.659812 Nov 27 20:50:20.384262 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 742/1474] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:50:18 2021] POST /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194/action => generated 0 bytes in 1664 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:50:20.389342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.390247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:20.398694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.399670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.400699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.401435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.414197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:20.440317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:20.441989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:20.443891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98c4a758-ca5a-4335-8059-95c53e5476bb tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.116375 Nov 27 20:50:20.444671 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 733/1475] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:20 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:20.461827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cae97dc6-01e0-486a-9ec7-6206658df658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:20.463497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cae97dc6-01e0-486a-9ec7-6206658df658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:20.471175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cae97dc6-01e0-486a-9ec7-6206658df658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.471704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cae97dc6-01e0-486a-9ec7-6206658df658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.472596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cae97dc6-01e0-486a-9ec7-6206658df658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.473090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cae97dc6-01e0-486a-9ec7-6206658df658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.518036 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cae97dc6-01e0-486a-9ec7-6206658df658 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.071048 Nov 27 20:50:20.519841 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 734/1476] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:20 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:20.524745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.525432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:20.533351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.533805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.534595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.535027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.742108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:20.745778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:20.750837 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-782ecdd9-4cc0-4ec4-8c9e-94fdca802323 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.365317 Nov 27 20:50:20.752967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 743/1477] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:20 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:20.758014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a643ac20-797f-4c69-a3c4-1da2d2e7d405 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.758755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a643ac20-797f-4c69-a3c4-1da2d2e7d405 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:20.759290 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d9b2299-8f7d-4bc2-8760-f2d37621fdc2 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.237121 Nov 27 20:50:20.760045 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 735/1478] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:20 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:20.769513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a643ac20-797f-4c69-a3c4-1da2d2e7d405 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.769513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a643ac20-797f-4c69-a3c4-1da2d2e7d405 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.769513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a643ac20-797f-4c69-a3c4-1da2d2e7d405 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.769513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a643ac20-797f-4c69-a3c4-1da2d2e7d405 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.776977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad3dd867-f9c6-49ab-8cb3-4777fb9ab71c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Calling method '.version_select at 0x7f15c7ddd280>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.834319 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ad3dd867-f9c6-49ab-8cb3-4777fb9ab71c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] HTTP exception thrown: Image not found. Nov 27 20:50:20.834927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad3dd867-f9c6-49ab-8cb3-4777fb9ab71c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:50:20.835791 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad3dd867-f9c6-49ab-8cb3-4777fb9ab71c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] 10.222.0.21 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.063800 Nov 27 20:50:20.840584 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 736/1479] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 20:50:20 2021] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:50:20.848096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.848745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:20.854687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.855347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.856142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.856666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.916394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a643ac20-797f-4c69-a3c4-1da2d2e7d405 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162034 Nov 27 20:50:20.917066 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 744/1480] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:50:20 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:20.922289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-309ef9f1-135b-46ae-a5eb-0204316856a6 tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Calling method '.version_select at 0x7f15c75590d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.949473 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-309ef9f1-135b-46ae-a5eb-0204316856a6 tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] HTTP exception thrown: Image not found. Nov 27 20:50:20.951008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-309ef9f1-135b-46ae-a5eb-0204316856a6 tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:50:20.951945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-309ef9f1-135b-46ae-a5eb-0204316856a6 tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] 10.222.0.21 "DELETE /compute/v2.1/images/d254577d-70e1-418a-a78e-3b13f08d21ej" status: 404 len: 62 microversion: 2.1 time: 0.033687 Nov 27 20:50:20.952611 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 745/1481] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:20 2021] DELETE /compute/v2.1/images/d254577d-70e1-418a-a78e-3b13f08d21ej => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:50:20.957762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:20.958584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:20.966205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.966911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:20.967885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:20.968484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.193408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:21.202983 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c21c59f-758b-43ff-94af-8a991235aa7c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1471 microversion: 2.1 time: 0.249081 Nov 27 20:50:21.204008 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 746/1482] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:20 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:21.219181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b054c8e-5787-45b1-ba7f-e9f096c15ccb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Calling method '.version_select at 0x7f15c7559820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:21.241311 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-6b054c8e-5787-45b1-ba7f-e9f096c15ccb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] HTTP exception thrown: Image not found. Nov 27 20:50:21.242114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b054c8e-5787-45b1-ba7f-e9f096c15ccb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:50:21.242941 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b054c8e-5787-45b1-ba7f-e9f096c15ccb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] 10.222.0.21 "DELETE /compute/v2.1/images/8e313aa5-adb1-423d-aa05-827eed29ece91" status: 404 len: 62 microversion: 2.1 time: 0.037736 Nov 27 20:50:21.243518 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 747/1483] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:50:21 2021] DELETE /compute/v2.1/images/8e313aa5-adb1-423d-aa05-827eed29ece91 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:50:21.254525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d93f183a-a4c1-4526-a8db-a798030028eb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Calling method '.version_select at 0x7f15c74dc700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:21.281538 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d93f183a-a4c1-4526-a8db-a798030028eb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] HTTP exception thrown: Image not found. Nov 27 20:50:21.282116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d93f183a-a4c1-4526-a8db-a798030028eb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:50:21.283433 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d93f183a-a4c1-4526-a8db-a798030028eb tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] 10.222.0.21 "DELETE /compute/v2.1/images/tempest-invalid-971106814" status: 404 len: 62 microversion: 2.1 time: 0.033870 Nov 27 20:50:21.283976 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 748/1484] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 20:50:21 2021] DELETE /compute/v2.1/images/tempest-invalid-971106814 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:50:21.296557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d907ddd7-581e-4643-9b64-c0230127582c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Calling method '.version_select at 0x7f15c7bfe550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:21.323940 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d907ddd7-581e-4643-9b64-c0230127582c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] HTTP exception thrown: Image not found. Nov 27 20:50:21.324785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d907ddd7-581e-4643-9b64-c0230127582c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:50:21.326001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d907ddd7-581e-4643-9b64-c0230127582c tempest-ImagesDeleteNegativeTestJSON-104306543 tempest-ImagesDeleteNegativeTestJSON-104306543-project] 10.222.0.21 "DELETE /compute/v2.1/images/a86199a5-63c4-4cdf-8092-bb93cd3797ce" status: 404 len: 62 microversion: 2.1 time: 0.036677 Nov 27 20:50:21.331780 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 749/1485] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:21 2021] DELETE /compute/v2.1/images/a86199a5-63c4-4cdf-8092-bb93cd3797ce => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 27 20:50:21.431211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:21.439616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:21.441382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:21.442769 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91829085-3776-4797-8591-c7f7b678685d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.605392 Nov 27 20:50:21.443853 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 737/1486] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:20 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:21.465538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:21.466260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:21.475215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.476003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.477041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.478001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.533437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-997afd80-8e2c-47f4-b168-3cf221d290a7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:21.534741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-997afd80-8e2c-47f4-b168-3cf221d290a7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:21.543373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-997afd80-8e2c-47f4-b168-3cf221d290a7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.544790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-997afd80-8e2c-47f4-b168-3cf221d290a7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.546025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-997afd80-8e2c-47f4-b168-3cf221d290a7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.547051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-997afd80-8e2c-47f4-b168-3cf221d290a7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.549165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:21.557808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:21.559475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:21.561127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6d42d6a-d106-4071-bc17-af29b4260f30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.099803 Nov 27 20:50:21.572280 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 750/1487] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:21 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:21.595699 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-997afd80-8e2c-47f4-b168-3cf221d290a7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.068036 Nov 27 20:50:21.603654 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 738/1488] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:21 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:21.781466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:21.784354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:21.785377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:21.788816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:21.803004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.807807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.810723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.811769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.812322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.814900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:21.816166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:21.818281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.090420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.100001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-be0bf7bc-a72e-45df-b6b2-384d51dacb90 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.332606 Nov 27 20:50:22.100885 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 751/1489] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:21 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:22.220851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:22.221796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:22.228476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.229129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.230094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.230741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.271861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.282800 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c59bd706-24a4-47c7-9ab3-73db9d31a3b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.508382 Nov 27 20:50:22.284827 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 739/1490] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:21 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:22.400386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.409943 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-880f01c5-0908-43b9-b7a1-550d73c2342e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.192969 Nov 27 20:50:22.422109 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 752/1491] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:22 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:22.461528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:22.462448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:22.477625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.479519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.483902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.484630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.556647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa75afb9-9d4a-472a-bc51-088ebf0902d3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:22.558431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa75afb9-9d4a-472a-bc51-088ebf0902d3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:22.572015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa75afb9-9d4a-472a-bc51-088ebf0902d3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.576734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa75afb9-9d4a-472a-bc51-088ebf0902d3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.577793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa75afb9-9d4a-472a-bc51-088ebf0902d3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.579048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa75afb9-9d4a-472a-bc51-088ebf0902d3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.663475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa75afb9-9d4a-472a-bc51-088ebf0902d3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 14 microversion: 2.1 time: 0.111719 Nov 27 20:50:22.664793 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 753/1492] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:22 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:50:22.677884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4c5e43ce-5311-4aaf-9d68-438fcf050964 req-5f8507a8-0b12-4d10-8af8-e166d03822fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99c91ae-1196-4fdf-af86-c9c0c7a47bb2", "tag": "69669768-ef11-486a-bf97-be4dc7401b97"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:22.679854 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:22.679854 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:22.696384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4c5e43ce-5311-4aaf-9d68-438fcf050964 req-5f8507a8-0b12-4d10-8af8-e166d03822fb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.698815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4c5e43ce-5311-4aaf-9d68-438fcf050964 req-5f8507a8-0b12-4d10-8af8-e166d03822fb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.722394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4c5e43ce-5311-4aaf-9d68-438fcf050964 req-5f8507a8-0b12-4d10-8af8-e166d03822fb service nova] Creating event network-changed:69669768-ef11-486a-bf97-be4dc7401b97 for instance b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 on nch2-master-1 Nov 27 20:50:22.728004 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4c5e43ce-5311-4aaf-9d68-438fcf050964 req-5f8507a8-0b12-4d10-8af8-e166d03822fb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061695 Nov 27 20:50:22.728890 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 754/1493] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:22.736061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:22.737038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:22.744574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.745379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.748872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.750096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.759043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.772139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.774939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.776449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62251f30-74fb-4496-a2c5-25f955b9a832 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.318926 Nov 27 20:50:22.789499 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 740/1494] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:22 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:22.796249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a5546e2-cded-4515-9aa2-ccb00bb2a458 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:22.797423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a5546e2-cded-4515-9aa2-ccb00bb2a458 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:22.808811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a5546e2-cded-4515-9aa2-ccb00bb2a458 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.810132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a5546e2-cded-4515-9aa2-ccb00bb2a458 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.811396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a5546e2-cded-4515-9aa2-ccb00bb2a458 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:22.812235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a5546e2-cded-4515-9aa2-ccb00bb2a458 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:22.876854 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a5546e2-cded-4515-9aa2-ccb00bb2a458 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.085984 Nov 27 20:50:22.878787 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 741/1495] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:22 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:22.893068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.904872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.906983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:22.908325 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d9173fdc-f3d8-4f42-ac3f-2320c931b1c5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.178086 Nov 27 20:50:22.922784 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 755/1496] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:22 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:23.118103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:23.118815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:23.126938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.127683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.135479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.136202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.303589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:23.304837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:23.317264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:23.318029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.319059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.322377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.323084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.326637 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6c0c5ea5-ccaa-4b09-9dbf-ff574bd1a508 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.212946 Nov 27 20:50:23.341617 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 742/1497] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:23 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:23.427403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:23.428057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:23.434292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.434756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.435640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.436378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.598525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:23.605581 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92dc32c4-395e-4df5-af55-9c5f2bcfafe7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.181786 Nov 27 20:50:23.606690 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 743/1498] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:23 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:23.625298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:23.634411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2102612-6a0f-413c-81db-0ed09cbb3d42 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.336997 Nov 27 20:50:23.634993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 756/1499] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:23 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:23.675851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e174681e-edf0-4145-9ff9-e353976bdae4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:23.677339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e174681e-edf0-4145-9ff9-e353976bdae4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:23.683472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e174681e-edf0-4145-9ff9-e353976bdae4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.684323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e174681e-edf0-4145-9ff9-e353976bdae4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.685952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e174681e-edf0-4145-9ff9-e353976bdae4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.686601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e174681e-edf0-4145-9ff9-e353976bdae4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.732630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e174681e-edf0-4145-9ff9-e353976bdae4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 14 microversion: 2.1 time: 0.061381 Nov 27 20:50:23.733623 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 757/1500] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:23 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:50:23.763735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-980233558", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:23.801107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:23.802349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:23.815954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.816918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.817908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:23.819507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:23.826421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:50:23.989424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:23.997754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:23.999352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.000906 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-69e51952-3378-4035-940f-27939ce47222 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.204514 Nov 27 20:50:24.001674 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 758/1501] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:23 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:50:24.015790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c8f8d164-b29f-45f5-a585-a24393db5058 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:24.016816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c8f8d164-b29f-45f5-a585-a24393db5058 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:24.022887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d164-b29f-45f5-a585-a24393db5058 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.023482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d164-b29f-45f5-a585-a24393db5058 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.031791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d164-b29f-45f5-a585-a24393db5058 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.032353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d164-b29f-45f5-a585-a24393db5058 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.059191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:50:24.059673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:50:24.060148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:50:24.060557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:50:24.060969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:50:24.070521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.070981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.071843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.072350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.084452 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c8f8d164-b29f-45f5-a585-a24393db5058 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.072626 Nov 27 20:50:24.085904 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 759/1502] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:24 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:24.090079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Getting quotas for project 5274d71e0622482a82d08375f9c081b2. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:50:24.093912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:24.094603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:24.094732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Getting quotas for user 8854f64f47034358971c9d2ea40a3074 and project 5274d71e0622482a82d08375f9c081b2. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:50:24.101754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.102599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.103425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.103916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.106022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:50:24.109276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:50:24.157312 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab9113f5-94db-4c51-8871-2a8316b5396d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549254 Nov 27 20:50:24.164455 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 744/1503] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:50:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:50:24.170119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-850f7fd1-b09f-4df9-b69b-be553e4dbe49 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:24.170959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-850f7fd1-b09f-4df9-b69b-be553e4dbe49 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:24.175640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.186779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.188524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.189952 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c17e8d75-4607-4ab7-8fbd-c839006a50fa tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.100467 Nov 27 20:50:24.190404 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 760/1504] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:24 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:24.227036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-850f7fd1-b09f-4df9-b69b-be553e4dbe49 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.234086 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-850f7fd1-b09f-4df9-b69b-be553e4dbe49 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1215 microversion: 2.1 time: 0.068251 Nov 27 20:50:24.234655 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 745/1505] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:24 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:24.346718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:24.348425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:24.355057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.355555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.357038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.357531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.525368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.532805 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e75eb3b8-3090-40e4-ae2d-a541e4c41d98 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.190570 Nov 27 20:50:24.533379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 761/1506] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:24 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:24.626310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:24.626921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:24.633845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.634316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.635086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.635541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.651367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:24.652126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:24.661877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.663362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.667429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.669662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.786803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.795057 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16488f93-66e5-450e-b6d8-fc13cac7bb19 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.175568 Nov 27 20:50:24.795660 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 746/1507] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:24 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:24.800096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc8d0337-5651-48bd-97f8-3002aa1e18ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:24.801051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc8d0337-5651-48bd-97f8-3002aa1e18ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:24.808810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc8d0337-5651-48bd-97f8-3002aa1e18ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.809289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc8d0337-5651-48bd-97f8-3002aa1e18ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.810060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc8d0337-5651-48bd-97f8-3002aa1e18ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:24.810488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc8d0337-5651-48bd-97f8-3002aa1e18ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:24.822994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:24.830679 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aad66ab9-dc12-4258-a327-4940dd28fcd3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.182947 Nov 27 20:50:24.831354 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 762/1508] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:24 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:24.850229 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc8d0337-5651-48bd-97f8-3002aa1e18ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 14 microversion: 2.1 time: 0.053387 Nov 27 20:50:24.850839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 747/1509] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:24 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:50:25.019482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:25.020091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:25.026304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.026835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.027711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.028890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.110970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95812654-4706-4523-b29b-a272899b3ed9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:25.112785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95812654-4706-4523-b29b-a272899b3ed9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:25.121568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95812654-4706-4523-b29b-a272899b3ed9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.136982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95812654-4706-4523-b29b-a272899b3ed9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.139218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95812654-4706-4523-b29b-a272899b3ed9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.139861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95812654-4706-4523-b29b-a272899b3ed9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.226820 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95812654-4706-4523-b29b-a272899b3ed9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.130251 Nov 27 20:50:25.227540 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 748/1510] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:25 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:25.232907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:25.233596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:25.238768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:25.240698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.241329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.242364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.242963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.249616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:25.251396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:25.252557 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27bff148-f1d5-4a31-ac42-480fbbd742ea tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.236849 Nov 27 20:50:25.253338 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 763/1511] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:25 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:25.268714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:25.269317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:25.275356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.276047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.277003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.277607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.329523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:25.340559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:25.342060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:25.343484 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc072af5-ad30-4a08-87df-e6e9c516ced1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.114504 Nov 27 20:50:25.344185 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 749/1512] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:25 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:25.361336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:25.369426 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b74f3a3b-11bc-43e0-8fb1-c7d6b6203ab3 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1267 microversion: 2.1 time: 0.104263 Nov 27 20:50:25.370006 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 764/1513] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:25 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:25.494608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-73239829-a614-4543-a1bf-ac410affbe23 req-2371f04a-f445-479f-9bd8-cef4d5dcac4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37efb1e-42bf-4d0f-8311-b4254fa2ce71", "name": "network-vif-unplugged", "status": "completed", "tag": "24c3bbfe-097d-44dd-b015-ded002b7cd5e"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:25.496281 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:25.496281 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:25.504221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-73239829-a614-4543-a1bf-ac410affbe23 req-2371f04a-f445-479f-9bd8-cef4d5dcac4b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.505605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-73239829-a614-4543-a1bf-ac410affbe23 req-2371f04a-f445-479f-9bd8-cef4d5dcac4b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.521219 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-73239829-a614-4543-a1bf-ac410affbe23 req-2371f04a-f445-479f-9bd8-cef4d5dcac4b service nova] Creating event network-vif-unplugged:24c3bbfe-097d-44dd-b015-ded002b7cd5e for instance f37efb1e-42bf-4d0f-8311-b4254fa2ce71 on nch1-master-1 Nov 27 20:50:25.526563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-73239829-a614-4543-a1bf-ac410affbe23 req-2371f04a-f445-479f-9bd8-cef4d5dcac4b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035899 Nov 27 20:50:25.527343 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 750/1514] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:50:25.549731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:25.550485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:25.557129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.557721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.558843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.559933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.786484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0bb2de64-190e-4f9e-8cca-8628151267c6 req-ba820e66-eeda-4048-8973-d98c4de086bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecb697a-9c98-475c-9836-19f15d3c9194", "name": "network-vif-unplugged", "status": "completed", "tag": "cab30d0b-bd13-4963-a8fd-40f8283c83c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:25.789010 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:25.789010 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:25.797601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0bb2de64-190e-4f9e-8cca-8628151267c6 req-ba820e66-eeda-4048-8973-d98c4de086bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.798056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0bb2de64-190e-4f9e-8cca-8628151267c6 req-ba820e66-eeda-4048-8973-d98c4de086bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.816201 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0bb2de64-190e-4f9e-8cca-8628151267c6 req-ba820e66-eeda-4048-8973-d98c4de086bc service nova] Creating event network-vif-unplugged:cab30d0b-bd13-4963-a8fd-40f8283c83c7 for instance 5ecb697a-9c98-475c-9836-19f15d3c9194 on nch2-master-1 Nov 27 20:50:25.821647 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0bb2de64-190e-4f9e-8cca-8628151267c6 req-ba820e66-eeda-4048-8973-d98c4de086bc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041470 Nov 27 20:50:25.822562 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 751/1515] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:50:25.828726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:25.829748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:25.837159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.837610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:25.839139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:25.839667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.046445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.057304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce2d32e6-e49c-4ada-982d-e067750719a7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.510423 Nov 27 20:50:26.066649 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 765/1516] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:25 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:26.071085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:26.071695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:26.078839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.079303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.079907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.080211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.080700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.095393 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe734560-f899-4fda-8e3f-4c425e1bfde4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.271242 Nov 27 20:50:26.105081 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 752/1517] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:25 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:26.106820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16b07cda-260d-4bd5-957b-a7cd7e1ea2fe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:26.107998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16b07cda-260d-4bd5-957b-a7cd7e1ea2fe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:26.122702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16b07cda-260d-4bd5-957b-a7cd7e1ea2fe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.123268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16b07cda-260d-4bd5-957b-a7cd7e1ea2fe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.132945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16b07cda-260d-4bd5-957b-a7cd7e1ea2fe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.133458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16b07cda-260d-4bd5-957b-a7cd7e1ea2fe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.193138 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16b07cda-260d-4bd5-957b-a7cd7e1ea2fe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 14 microversion: 2.1 time: 0.095610 Nov 27 20:50:26.193708 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 753/1518] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:26 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:50:26.241211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16584607-3919-445b-a924-7eeb610a313e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:26.244119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16584607-3919-445b-a924-7eeb610a313e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:26.260722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16584607-3919-445b-a924-7eeb610a313e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.262242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16584607-3919-445b-a924-7eeb610a313e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.265406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16584607-3919-445b-a924-7eeb610a313e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.266092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16584607-3919-445b-a924-7eeb610a313e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.323533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16584607-3919-445b-a924-7eeb610a313e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.088590 Nov 27 20:50:26.326279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 754/1519] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:26 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:26.331859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:26.332848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:26.344533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.345248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.346359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.346968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.555731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.565353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.572827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.575476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-221d97de-2f85-4807-8836-6a3205e7859e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.247263 Nov 27 20:50:26.576394 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 755/1520] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:26 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:26.582252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:26.584127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:26.586553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.592773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.593596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.594789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.595353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.596680 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58b381f2-6f7d-4acf-adf5-9b5b12725e41 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.529058 Nov 27 20:50:26.607212 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 766/1521] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:26 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:26.614144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:26.615741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:26.623937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.624734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.625780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:26.626434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:26.668767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.677507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.679145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.680451 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3712f409-6f87-4583-894e-e21881cb8c06 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.103232 Nov 27 20:50:26.684402 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 756/1522] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:26 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:26.712855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:26.724956 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f3f4002d-f675-4ad9-89fa-938ca559a173 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1273 microversion: 2.1 time: 0.115383 Nov 27 20:50:26.725886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 767/1523] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:26 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:27.073842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:27.074637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.083886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.083886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.084937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.085468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.113942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:27.115148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.124415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.125287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.126465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.127232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.240169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:27.248398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46a785cf-8a6a-4073-8060-8e8555279b2f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.178282 Nov 27 20:50:27.249218 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 757/1524] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:27 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:27.254421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45a3c11a-5875-4d63-9eed-4853f2b5887f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:27.255575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45a3c11a-5875-4d63-9eed-4853f2b5887f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.263373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a3c11a-5875-4d63-9eed-4853f2b5887f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.264094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a3c11a-5875-4d63-9eed-4853f2b5887f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.264620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a3c11a-5875-4d63-9eed-4853f2b5887f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.265120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a3c11a-5875-4d63-9eed-4853f2b5887f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.317887 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45a3c11a-5875-4d63-9eed-4853f2b5887f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 14 microversion: 2.1 time: 0.067073 Nov 27 20:50:27.320686 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 758/1525] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:27 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:50:27.336526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68ece850-1903-4949-be29-98d7660038c2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:27.337426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68ece850-1903-4949-be29-98d7660038c2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.345700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68ece850-1903-4949-be29-98d7660038c2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.346151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68ece850-1903-4949-be29-98d7660038c2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.346948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68ece850-1903-4949-be29-98d7660038c2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.347414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68ece850-1903-4949-be29-98d7660038c2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.386062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:27.394742 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6036a9a-3193-4402-b4de-bf145e27b92f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.285986 Nov 27 20:50:27.395366 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 768/1526] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:27 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:27.405181 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68ece850-1903-4949-be29-98d7660038c2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.068604 Nov 27 20:50:27.405181 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 759/1527] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:27 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:27.552982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f37507c8-8bd8-4665-a80b-05bae67bf41f req-75b4d94c-8321-4f52-89e6-8ac2811ff79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37efb1e-42bf-4d0f-8311-b4254fa2ce71", "tag": "24c3bbfe-097d-44dd-b015-ded002b7cd5e"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:27.554845 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:27.554845 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:27.563627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f37507c8-8bd8-4665-a80b-05bae67bf41f req-75b4d94c-8321-4f52-89e6-8ac2811ff79f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.564077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f37507c8-8bd8-4665-a80b-05bae67bf41f req-75b4d94c-8321-4f52-89e6-8ac2811ff79f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.580458 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f37507c8-8bd8-4665-a80b-05bae67bf41f req-75b4d94c-8321-4f52-89e6-8ac2811ff79f service nova] Creating event network-changed:24c3bbfe-097d-44dd-b015-ded002b7cd5e for instance f37efb1e-42bf-4d0f-8311-b4254fa2ce71 on nch1-master-1 Nov 27 20:50:27.586839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f37507c8-8bd8-4665-a80b-05bae67bf41f req-75b4d94c-8321-4f52-89e6-8ac2811ff79f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038313 Nov 27 20:50:27.587499 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 760/1528] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:27.598190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:27.598935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.605656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.606148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.607302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.608012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.614936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:27.615661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.633377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.633831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.634715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.635216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.879435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:27.889928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:27.891943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:27.893151 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a0ef170-c8b0-444f-b485-e0e1824623de tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.299503 Nov 27 20:50:27.903001 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 769/1529] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:27 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:27.907882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:27.909186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.915801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.916252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.917066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.917523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.923738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:27.934094 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20053a07-1365-481d-8a20-5e3d263d379b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.323623 Nov 27 20:50:27.943780 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 761/1530] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:27 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:27.948491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:27.949197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:27.955884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.956329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.957106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:27.957534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:27.990941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:28.001952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:28.003491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:28.004666 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04697d5b-352a-423b-ab2b-8463c10b9d2a tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.109679 Nov 27 20:50:28.005233 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 770/1531] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:27 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:28.009714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-25e93023-03a9-43bd-ba2b-0f12a59fbc29 req-0d73cf44-2bf7-4706-bfd9-943c515f32df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecb697a-9c98-475c-9836-19f15d3c9194", "tag": "cab30d0b-bd13-4963-a8fd-40f8283c83c7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:28.011346 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:28.011346 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:28.020702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-25e93023-03a9-43bd-ba2b-0f12a59fbc29 req-0d73cf44-2bf7-4706-bfd9-943c515f32df service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.021413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-25e93023-03a9-43bd-ba2b-0f12a59fbc29 req-0d73cf44-2bf7-4706-bfd9-943c515f32df service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.034132 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-25e93023-03a9-43bd-ba2b-0f12a59fbc29 req-0d73cf44-2bf7-4706-bfd9-943c515f32df service nova] Creating event network-changed:cab30d0b-bd13-4963-a8fd-40f8283c83c7 for instance 5ecb697a-9c98-475c-9836-19f15d3c9194 on nch2-master-1 Nov 27 20:50:28.041679 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-25e93023-03a9-43bd-ba2b-0f12a59fbc29 req-0d73cf44-2bf7-4706-bfd9-943c515f32df service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034961 Nov 27 20:50:28.042303 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 771/1532] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:28.229069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:28.241193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea7c69f8-65f3-414e-8f77-b23f17b62af2 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1315 microversion: 2.1 time: 0.304320 Nov 27 20:50:28.242450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 762/1533] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:27 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:28.267393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:28.268753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:28.275244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.276033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.277180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.277819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.330510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b16c514-d02c-4f15-a620-fe892b117979 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:28.331805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b16c514-d02c-4f15-a620-fe892b117979 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:28.340952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b16c514-d02c-4f15-a620-fe892b117979 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.341698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b16c514-d02c-4f15-a620-fe892b117979 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.343093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b16c514-d02c-4f15-a620-fe892b117979 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.343944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b16c514-d02c-4f15-a620-fe892b117979 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.408079 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b16c514-d02c-4f15-a620-fe892b117979 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 14 microversion: 2.1 time: 0.082434 Nov 27 20:50:28.409910 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 763/1534] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:28 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:50:28.419877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c8dce987-9d51-4447-b53d-3d6f28c7e763 req-8f913401-bfa1-4740-9754-584a37392dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0f5c56-6c32-4b25-9685-4a04863f57dc", "name": "network-vif-plugged", "status": "completed", "tag": "ca642020-d459-4da1-b5a7-ee2c44c1c93e"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:28.421791 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:28.421791 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:28.432045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c8dce987-9d51-4447-b53d-3d6f28c7e763 req-8f913401-bfa1-4740-9754-584a37392dd7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.432782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c8dce987-9d51-4447-b53d-3d6f28c7e763 req-8f913401-bfa1-4740-9754-584a37392dd7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.450168 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c8dce987-9d51-4447-b53d-3d6f28c7e763 req-8f913401-bfa1-4740-9754-584a37392dd7 service nova] Creating event network-vif-plugged:ca642020-d459-4da1-b5a7-ee2c44c1c93e for instance cd0f5c56-6c32-4b25-9685-4a04863f57dc on nch2-master-1 Nov 27 20:50:28.466614 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c8dce987-9d51-4447-b53d-3d6f28c7e763 req-8f913401-bfa1-4740-9754-584a37392dd7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052902 Nov 27 20:50:28.467508 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 764/1535] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:28.476619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:28.477688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:28.486013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.486751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.487627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.488072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.643546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:28.650970 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc9c01d7-d806-49e9-b2cf-b06260198164 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.178726 Nov 27 20:50:28.651578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 765/1536] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:28 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:28.656584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81c46772-c875-4c91-a50a-567bdfff16c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:28.657632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81c46772-c875-4c91-a50a-567bdfff16c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:28.667853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81c46772-c875-4c91-a50a-567bdfff16c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.668316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81c46772-c875-4c91-a50a-567bdfff16c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.669693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81c46772-c875-4c91-a50a-567bdfff16c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.670150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81c46772-c875-4c91-a50a-567bdfff16c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.721494 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81c46772-c875-4c91-a50a-567bdfff16c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 32642 microversion: 2.1 time: 0.068672 Nov 27 20:50:28.725556 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 766/1537] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:28 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 32642 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:28.744137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:28.751713 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-666d070c-ef53-43e4-b66d-74f952c6e5e8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.489325 Nov 27 20:50:28.752257 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 772/1538] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:28 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:28.913608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:28.914321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:28.922277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.922746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.923677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.924208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.952874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:28.953546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:28.975775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.983316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:28.984571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:28.985013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.188337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.197523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.199482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.200856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd76dc98-5e27-491a-95a0-9b29bb018fce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.292611 Nov 27 20:50:29.201656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 767/1539] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:28 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:50:29.207079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:29.207787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:29.213966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.214495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.216163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.216603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.283051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.291377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.292910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.294752 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29774766-867c-4d86-9e77-57e7f5d3c88e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.091899 Nov 27 20:50:29.295330 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 768/1540] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:29 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:29.299504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:29.300109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:29.306699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.306961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.307791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.308230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.440478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.454193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8791f00c-43bd-420b-bf00-76cb4ef177e5 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1315 microversion: 2.1 time: 0.157731 Nov 27 20:50:29.454785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 769/1541] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:29 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:29.467108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.469090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e16ca216-e1ed-4a43-990a-5277b5fc7e51 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:29.470501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e16ca216-e1ed-4a43-990a-5277b5fc7e51 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:29.475705 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-55c76d78-00bc-4b47-bf1a-2a4b122f0776 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.527589 Nov 27 20:50:29.476004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16ca216-e1ed-4a43-990a-5277b5fc7e51 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.476466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16ca216-e1ed-4a43-990a-5277b5fc7e51 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.476594 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 773/1542] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:28 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:29.478229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16ca216-e1ed-4a43-990a-5277b5fc7e51 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.478810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16ca216-e1ed-4a43-990a-5277b5fc7e51 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.668467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:29.669065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:29.675422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.675872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.676654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.677093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.817741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:29.825898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a23e50c-0289-4b37-8b61-e022639de2e4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.161181 Nov 27 20:50:29.826468 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 774/1543] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:29 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:50:29.830791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e3bc493e-7255-441f-ad8e-49a5cd11eca9 req-1b80b341-d4f2-4f69-ae44-8a54aa0d5e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddad5835-7d44-421b-97e3-1919c8520678", "tag": "46aac982-82c0-4b7d-a4ff-8afb5569ecf6"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:29.832386 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:29.832386 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:50:29.839269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e3bc493e-7255-441f-ad8e-49a5cd11eca9 req-1b80b341-d4f2-4f69-ae44-8a54aa0d5e9c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.839711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e3bc493e-7255-441f-ad8e-49a5cd11eca9 req-1b80b341-d4f2-4f69-ae44-8a54aa0d5e9c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.851342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e3bc493e-7255-441f-ad8e-49a5cd11eca9 req-1b80b341-d4f2-4f69-ae44-8a54aa0d5e9c service nova] Creating event network-changed:46aac982-82c0-4b7d-a4ff-8afb5569ecf6 for instance ddad5835-7d44-421b-97e3-1919c8520678 on nch1-master-1 Nov 27 20:50:29.856842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e3bc493e-7255-441f-ad8e-49a5cd11eca9 req-1b80b341-d4f2-4f69-ae44-8a54aa0d5e9c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028656 Nov 27 20:50:29.857452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 775/1544] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:29.862251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30f6658d-b048-48d9-9685-c4fb5227a665 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:29.863287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30f6658d-b048-48d9-9685-c4fb5227a665 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:29.869639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30f6658d-b048-48d9-9685-c4fb5227a665 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.870090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30f6658d-b048-48d9-9685-c4fb5227a665 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:29.870870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30f6658d-b048-48d9-9685-c4fb5227a665 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:29.871328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30f6658d-b048-48d9-9685-c4fb5227a665 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.208924 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e16ca216-e1ed-4a43-990a-5277b5fc7e51 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 15.744180 Nov 27 20:50:45.209626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 770/1545] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:29 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 15754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:45.215834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:45.216575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:45.226064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.226949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.228468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.229195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.367740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.375523 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32352cbb-07a1-4ea3-8677-47452ff58ace tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.164837 Nov 27 20:50:45.376095 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 771/1546] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:45 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:45.380723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:45.381381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:45.392297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.392876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.394080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.394679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.553798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.562859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.564499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.565698 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af96aa15-fdd2-4224-9905-cdfc22de53ab tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.188700 Nov 27 20:50:45.566261 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 772/1547] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:45 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:45.570666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:45.571336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:45.577165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.577677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.578608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.579039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.643220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.651159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.652693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.653857 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a98e4826-3ae2-4221-9698-c363833c9ccc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.086661 Nov 27 20:50:45.654428 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 773/1548] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:45 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:45.658622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:45.659228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:45.666781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.667239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.668259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.669223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.803004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.811409 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3fa86642-ebb4-4630-b53a-ddd0304c7b5a tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1315 microversion: 2.1 time: 0.156002 Nov 27 20:50:45.811973 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 774/1549] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:45 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:45.816176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:45.816764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:45.822290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.822762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.823596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.824038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.952710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:45.960167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-50837908-a2d6-43cc-8dc2-d468336896d1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.147236 Nov 27 20:50:45.960740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 775/1550] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:45 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:45.965032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:45.966250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:45.972133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.972580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:45.973345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:45.973775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:46.101910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:46.110416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f16a242e-d316-4217-8d47-80d9ca6bf87b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1476 microversion: 2.1 time: 0.148753 Nov 27 20:50:46.110983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 776/1551] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:45 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1476 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:46.115301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f6a5058c-a51a-4daa-84a9-c618109c7a48 req-db61fd66-69c5-40c5-a59f-edbddf7fce50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddad5835-7d44-421b-97e3-1919c8520678", "name": "network-vif-plugged", "status": "completed", "tag": "46aac982-82c0-4b7d-a4ff-8afb5569ecf6"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:46.117111 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:46.117111 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:46.123608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f6a5058c-a51a-4daa-84a9-c618109c7a48 req-db61fd66-69c5-40c5-a59f-edbddf7fce50 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:46.124045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f6a5058c-a51a-4daa-84a9-c618109c7a48 req-db61fd66-69c5-40c5-a59f-edbddf7fce50 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:46.134691 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f6a5058c-a51a-4daa-84a9-c618109c7a48 req-db61fd66-69c5-40c5-a59f-edbddf7fce50 service nova] Creating event network-vif-plugged:46aac982-82c0-4b7d-a4ff-8afb5569ecf6 for instance ddad5835-7d44-421b-97e3-1919c8520678 on nch1-master-1 Nov 27 20:50:46.140010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f6a5058c-a51a-4daa-84a9-c618109c7a48 req-db61fd66-69c5-40c5-a59f-edbddf7fce50 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027813 Nov 27 20:50:46.140802 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 777/1552] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:46.220523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d13242f-d946-4956-b607-264c78afa224 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:46.221579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d13242f-d946-4956-b607-264c78afa224 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:46.227945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d13242f-d946-4956-b607-264c78afa224 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:46.228397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d13242f-d946-4956-b607-264c78afa224 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:46.229189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d13242f-d946-4956-b607-264c78afa224 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:46.229627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d13242f-d946-4956-b607-264c78afa224 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.236870 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30f6658d-b048-48d9-9685-c4fb5227a665 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action" status: 200 len: 40793 microversion: 2.1 time: 26.377208 Nov 27 20:50:56.237435 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 776/1553] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:29 2021] POST /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea/action => generated 40793 bytes in 26379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:50:56.246865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.247868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:56.262838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.263941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.265308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.266153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.279615 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d13242f-d946-4956-b607-264c78afa224 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 10.062412 Nov 27 20:50:56.282655 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 778/1554] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:46 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 10067 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:50:56.292630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.295194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:56.333814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.336914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.338018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.342825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.539976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.550441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.551630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.552868 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f406167c-18f5-4723-b3f5-193518858b00 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.268152 Nov 27 20:50:56.554231 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 779/1555] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:56 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:56.563534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.565157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:56.572969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.573566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.574738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.574738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.586743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.594841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa6c1e69-774c-4f0a-817b-b31f02f94d83 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.355977 Nov 27 20:50:56.603581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 777/1556] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:56 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:56.607521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.608204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:56.614640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.615157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.615968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.616458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.655626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.664806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.666422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.667793 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b786b12b-2733-44c5-8aa7-bf56b20aec54 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.112565 Nov 27 20:50:56.668610 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 780/1557] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:56 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:56.680096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.680883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:56.688501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.689076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.690890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.690890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.769973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.778826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7741d880-c377-433a-af48-5ef30684967c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1464 microversion: 2.1 time: 0.182017 Nov 27 20:50:56.779469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 778/1558] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:56 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1464 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:56.788107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.788732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:56.795919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.796428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.797372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.797799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.848846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.857987 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29991da6-31a4-4be3-b35d-4019ad0c0bd6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.181775 Nov 27 20:50:56.858656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 781/1559] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:56 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:56.864265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.864870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:56.872307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.872823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.873807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:56.874280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:56.964061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:56.976299 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d16b94a-f4b5-413d-906b-327347d7648a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1475 microversion: 2.1 time: 0.195430 Nov 27 20:50:56.977066 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 779/1560] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:56 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1475 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:56.993348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:56.993851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:57.003534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.004186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.005410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.006038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.040463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:57.042098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:50:57.050740 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6adddff-9fca-4760-9837-8f4282dc0e51 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 200 len: 1704 microversion: 2.1 time: 0.190978 Nov 27 20:50:57.051671 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 782/1561] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:56 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 1704 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:57.159610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-df2d26ff-8340-4bbf-93c0-05eaaed4c98d req-5290a970-1cb2-4d9c-bb34-5310caff1b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "name": "network-vif-unplugged", "status": "completed", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:57.161413 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:50:57.161413 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:50:57.169994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-df2d26ff-8340-4bbf-93c0-05eaaed4c98d req-5290a970-1cb2-4d9c-bb34-5310caff1b18 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.170533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-df2d26ff-8340-4bbf-93c0-05eaaed4c98d req-5290a970-1cb2-4d9c-bb34-5310caff1b18 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.173088 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-536e5a68-664a-45da-a85c-0a7996f9ed8c tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 204 len: 0 microversion: 2.1 time: 0.183140 Nov 27 20:50:57.174331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 780/1562] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:50:56 2021] DELETE /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:50:57.184121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:57.184902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:57.191034 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-df2d26ff-8340-4bbf-93c0-05eaaed4c98d req-5290a970-1cb2-4d9c-bb34-5310caff1b18 service nova] Creating event network-vif-unplugged:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch2-master-1 Nov 27 20:50:57.193037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.193545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.194755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.195809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.201917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-df2d26ff-8340-4bbf-93c0-05eaaed4c98d req-5290a970-1cb2-4d9c-bb34-5310caff1b18 service nova] Instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:50:57.216567 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-df2d26ff-8340-4bbf-93c0-05eaaed4c98d req-5290a970-1cb2-4d9c-bb34-5310caff1b18 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160053 Nov 27 20:50:57.217346 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 783/1563] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:50:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:50:57.296381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc5412e9-3e2a-4fdf-9895-2df37eeabe9a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:57.297788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc5412e9-3e2a-4fdf-9895-2df37eeabe9a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:57.304467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5412e9-3e2a-4fdf-9895-2df37eeabe9a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.304923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5412e9-3e2a-4fdf-9895-2df37eeabe9a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.305739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5412e9-3e2a-4fdf-9895-2df37eeabe9a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.306160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5412e9-3e2a-4fdf-9895-2df37eeabe9a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.352013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:57.359700 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7eed84f5-e429-4d71-a323-92fe0f92581d tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1470 microversion: 2.1 time: 0.180019 Nov 27 20:50:57.360294 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 781/1564] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:57 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:57.572589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:57.573113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:57.579416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.579756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.580610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.581043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.726723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:57.735898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:57.737952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:57.739123 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cc2e71e-1eb3-4441-9ae6-a913ae086101 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.170455 Nov 27 20:50:57.750276 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 782/1565] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:57 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:50:57.755373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:57.755972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:57.762679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.763128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.764008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.764364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.909197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:57.918677 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c1b19b5-3506-48af-b7c9-4032790a27e6 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.167305 Nov 27 20:50:57.919781 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 783/1566] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:57 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:57.924509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:57.925107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:57.932972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.933426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:57.934517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:57.934959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.010312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:58.019776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:58.021588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:58.023029 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d56683b6-9e45-43a1-a7ce-aae9cace8dca tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.102604 Nov 27 20:50:58.023711 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 784/1567] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:57 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:58.030707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:58.031213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:58.039797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.040300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.041280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.041771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.070764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:50:58.158618 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfe9dd9d-8c79-40c3-ad68-488cd75bc476 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 204 len: 0 microversion: 2.1 time: 0.132785 Nov 27 20:50:58.159457 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 785/1568] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:50:58 2021] DELETE /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:50:58.169711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:58.171051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:58.177685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.178197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.179131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.179626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.333956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:58.342772 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9d39bf50-2418-41b9-a77a-8434dcacdf4f tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1391 microversion: 2.1 time: 0.182079 Nov 27 20:50:58.343538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 786/1569] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:58 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:58.349715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:58.350339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:58.356702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.357391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.358201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.358537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.396187 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc5412e9-3e2a-4fdf-9895-2df37eeabe9a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 1.104256 Nov 27 20:50:58.397522 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 784/1570] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:50:57 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:50:58.404344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2101646264", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "1678249805", "adminPass": "***", "networks": [{"uuid": "7a2f3da6-fc07-4bd8-b994-fc2cede22518"}], "security_groups": [{"name": "tempest-securitygroup--1211467980"}], "key_name": "tempest-keypair-126826238", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:50:58.604031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] validate_networks() for [('7a2f3da6-fc07-4bd8-b994-fc2cede22518', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:50:58.650532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:58.661946 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff7179eb-5eba-4133-81f1-d91ccc02908e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1475 microversion: 2.1 time: 0.317229 Nov 27 20:50:58.672234 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 787/1571] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:58 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1475 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:58.674129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:58.675181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:58.683384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.683965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:58.685830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:58.686462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.118196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:59.129954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0829c82-6793-48e1-bb1d-c6bb468edb3b tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1470 microversion: 2.1 time: 0.460001 Nov 27 20:50:59.131194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 788/1572] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:58 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:59.135760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:59.136360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:59.144828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.145638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.146774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.148129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.561644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:59.598449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:59.607848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:59.609987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-76740dac-816b-40a8-b88c-249b72f29b31 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.477772 Nov 27 20:50:59.616629 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 789/1573] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:59 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:50:59.623543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:59.624836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:59.633369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.633913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.635051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.635635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.724400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:50:59.725009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:50:59.726003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:50:59.726971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:50:59.727929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:50:59.745839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.747157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.752219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.765435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.831704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for project 68857c7effec496aa99ff78b76521109. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:50:59.839742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Getting quotas for user 5af01920574741f381a5dfefd9282bfc and project 68857c7effec496aa99ff78b76521109. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:50:59.879897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:50:59.882855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:50:59.884920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:50:59.908070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6f50c5e-f1fb-4675-b8fc-b3119087afa5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.289598 Nov 27 20:50:59.908612 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 790/1574] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:59 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:50:59.936871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:59.937362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:59.953623 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-835b11d5-946a-4b54-9126-773bedd102c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.554156 Nov 27 20:50:59.955147 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 785/1575] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:50:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:50:59.960891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:50:59.961804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:50:59.963722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.964246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.965065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.970764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.971233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.972190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:50:59.973277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:50:59.973907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.152179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:00.163154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:00.170652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:00.176804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e9ac942-68c9-47b1-be9c-0b95ccb2fbd5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.244084 Nov 27 20:51:00.177641 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 791/1576] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:50:59 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:00.192535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cab1560a-237d-4774-be6e-83d13b7270f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:00.193887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cab1560a-237d-4774-be6e-83d13b7270f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:00.202433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cab1560a-237d-4774-be6e-83d13b7270f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.203143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cab1560a-237d-4774-be6e-83d13b7270f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.204175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cab1560a-237d-4774-be6e-83d13b7270f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.204854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cab1560a-237d-4774-be6e-83d13b7270f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.296761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cab1560a-237d-4774-be6e-83d13b7270f5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.117401 Nov 27 20:51:00.301907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:00.307117 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 792/1577] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:00 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:00.320668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:00.325576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:00.327329 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-393ee0cd-2003-45cf-91d7-60aa8339004d tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1381 microversion: 2.1 time: 0.370739 Nov 27 20:51:00.331577 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 786/1578] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:50:59 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1381 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:00.350859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.351378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.365738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.368684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.526112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-518e5a8a-6845-4b8c-be09-688c6de03fb3 req-566bfacd-1b5e-44b5-b2a7-adae64a1256c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:00.528822 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:00.528822 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:00.539139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-518e5a8a-6845-4b8c-be09-688c6de03fb3 req-566bfacd-1b5e-44b5-b2a7-adae64a1256c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.540135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-518e5a8a-6845-4b8c-be09-688c6de03fb3 req-566bfacd-1b5e-44b5-b2a7-adae64a1256c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.560022 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-518e5a8a-6845-4b8c-be09-688c6de03fb3 req-566bfacd-1b5e-44b5-b2a7-adae64a1256c service nova] Creating event network-changed:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch2-master-1 Nov 27 20:51:00.570624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-518e5a8a-6845-4b8c-be09-688c6de03fb3 req-566bfacd-1b5e-44b5-b2a7-adae64a1256c service nova] Instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:51:00.613742 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-518e5a8a-6845-4b8c-be09-688c6de03fb3 req-566bfacd-1b5e-44b5-b2a7-adae64a1256c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278555 Nov 27 20:51:00.617887 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 787/1579] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:00.649091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f09408ef-e063-47fd-945c-b99d71befe8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:00.649903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f09408ef-e063-47fd-945c-b99d71befe8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:00.801194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f09408ef-e063-47fd-945c-b99d71befe8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:00.822062 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f09408ef-e063-47fd-945c-b99d71befe8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1264 microversion: 2.1 time: 0.188182 Nov 27 20:51:00.823771 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 788/1580] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:00 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:00.828518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:00.829325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:00.843716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.844364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.848247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.848929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.901089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:00.902456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:00.902456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lazy-loading 'fault' on Instance uuid ddad5835-7d44-421b-97e3-1919c8520678 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:00.965842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:00.976894 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7b0d78f4-e46c-456f-abaa-77fb9ca5b2be tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1475 microversion: 2.1 time: 0.668291 Nov 27 20:51:00.987323 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 793/1581] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:00 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1475 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:00.992451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-375b4c2d-9610-4baa-ab16-c3e3478be6d0 req-15f964a7-d00c-42c4-9e5e-9aa786de3fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddad5835-7d44-421b-97e3-1919c8520678", "name": "network-vif-deleted", "tag": "46aac982-82c0-4b7d-a4ff-8afb5569ecf6"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:01.009920 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:01.009920 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:01.018950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-375b4c2d-9610-4baa-ab16-c3e3478be6d0 req-15f964a7-d00c-42c4-9e5e-9aa786de3fd1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.020726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-375b4c2d-9610-4baa-ab16-c3e3478be6d0 req-15f964a7-d00c-42c4-9e5e-9aa786de3fd1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.057586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8854f64f47034358971c9d2ea40a3074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5274d71e0622482a82d08375f9c081b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:01.067302 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a00e4831-c693-4b7f-86f5-b3a49f7f59db tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 200 len: 1305 microversion: 2.1 time: 0.242090 Nov 27 20:51:01.068652 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 789/1582] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:00 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 1305 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:01.078745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-375b4c2d-9610-4baa-ab16-c3e3478be6d0 req-15f964a7-d00c-42c4-9e5e-9aa786de3fd1 service nova] Creating event network-vif-deleted:46aac982-82c0-4b7d-a4ff-8afb5569ecf6 for instance ddad5835-7d44-421b-97e3-1919c8520678 on nch1-master-1 Nov 27 20:51:01.078898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a6f61147-4043-4c0d-93a5-8114652f991c tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '.version_select at 0x7f15c7f9f820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:01.078898 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:01.078898 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:01.079898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6f61147-4043-4c0d-93a5-8114652f991c tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.081849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6f61147-4043-4c0d-93a5-8114652f991c tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.092526 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-375b4c2d-9610-4baa-ab16-c3e3478be6d0 req-15f964a7-d00c-42c4-9e5e-9aa786de3fd1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103757 Nov 27 20:51:01.093274 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 794/1583] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:01.100361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:01.101045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:01.107895 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a6f61147-4043-4c0d-93a5-8114652f991c tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 4663 microversion: 2.1 time: 0.036927 Nov 27 20:51:01.109042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 790/1584] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:51:01 2021] GET /compute/v2.1/os-migrations => generated 4663 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:01.111779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.112536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.113523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.114177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.116120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:01.119216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:01.131119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.131800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.133068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.133756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.411092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:01.422713 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd710a10-e7f0-46b9-b17d-989a84d31b0b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.312117 Nov 27 20:51:01.432790 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 791/1585] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:01 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:01.432790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c5e3b69-c8ef-4037-a4f1-9f5f3a34f879 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:01.432790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c5e3b69-c8ef-4037-a4f1-9f5f3a34f879 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:01.439340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c5e3b69-c8ef-4037-a4f1-9f5f3a34f879 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.440000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c5e3b69-c8ef-4037-a4f1-9f5f3a34f879 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.448945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c5e3b69-c8ef-4037-a4f1-9f5f3a34f879 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.449536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c5e3b69-c8ef-4037-a4f1-9f5f3a34f879 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.692369 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c5e3b69-c8ef-4037-a4f1-9f5f3a34f879 tempest-LiveMigrationTest-1032860350 tempest-LiveMigrationTest-1032860350-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1532 microversion: 2.1 time: 0.267613 Nov 27 20:51:01.693041 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 792/1586] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:01 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1532 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:01.704739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:01.705492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:01.716043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.723890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.725220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.725844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.926490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:01.947460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:01.950316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:01.952231 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62d79ffe-f7ca-4423-badd-8511cb6bbd1d tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.251513 Nov 27 20:51:01.953195 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 793/1587] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:01 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:01.967012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7236b450-f6c3-44af-ac81-3e322c4add50 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:01.971901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7236b450-f6c3-44af-ac81-3e322c4add50 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:01.985172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:01.990477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7236b450-f6c3-44af-ac81-3e322c4add50 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.992236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7236b450-f6c3-44af-ac81-3e322c4add50 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.993617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7236b450-f6c3-44af-ac81-3e322c4add50 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:01.994334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7236b450-f6c3-44af-ac81-3e322c4add50 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:01.996591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:02.007119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:02.008789 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6aee7e81-c4ad-4c3f-9900-ab7849fd336e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.914295 Nov 27 20:51:02.011469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 795/1588] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:01 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:02.023547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.024374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.037476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.040673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.042297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.044821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.088373 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7236b450-f6c3-44af-ac81-3e322c4add50 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.133278 Nov 27 20:51:02.092915 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 794/1589] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:01 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:02.102890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:02.104949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.105896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.145099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.148626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.152497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.153151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.243181 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42d30c28-3b32-4330-8e1f-a7cd9a35285c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 204 len: 0 microversion: 2.1 time: 0.229307 Nov 27 20:51:02.243902 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 796/1590] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:02 2021] DELETE /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:02.252424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.253130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.274223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.274781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.275617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.276058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.352949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:02.362925 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b58856bf-c526-4f76-b9b4-c8e1abbaa169 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1322 microversion: 2.1 time: 0.268055 Nov 27 20:51:02.368171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 795/1591] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:02 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:02.377005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.377676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.384288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.385395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.386167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.386604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.403074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] HTTP exception thrown: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. Nov 27 20:51:02.403768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Returning 404 to user: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:02.404950 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-609a10d5-19c1-4d01-ae93-da103c69cfcc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 404 len: 111 microversion: 2.1 time: 0.034188 Nov 27 20:51:02.408278 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 796/1592] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:02 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:02.412173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.413062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.419977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.420681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.421693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.422290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.650331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:02.660696 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97970a6a-835a-4a77-b97a-ceaf6b59fdd7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.415590 Nov 27 20:51:02.669707 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 797/1593] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:02 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:02.680152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1464992837", "metadata": {"image_type": "test"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:02.683385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.692949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.693399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.709332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.710019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.732281 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] HTTP exception thrown: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. Nov 27 20:51:02.733268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Returning 404 to user: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:02.735063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2c002e73-7cf0-4804-89be-b374058508bc tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "POST /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678/action" status: 404 len: 111 microversion: 2.1 time: 0.063836 Nov 27 20:51:02.738822 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 798/1594] 10.222.0.21 () {60 vars in 1278 bytes} [Sat Nov 27 20:51:02 2021] POST /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:02.750307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.752237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.760346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.761148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.762101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.763603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.793666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:02.804135 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-79a26164-a8e8-4b84-9663-c99f2fd04be4 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.396973 Nov 27 20:51:02.816808 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 797/1595] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:02 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:02.823070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5785f354-3518-43b5-9d86-72d8b2c646e8 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1854605794", "metadata": {"image_type": "test"}}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:02.824518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5785f354-3518-43b5-9d86-72d8b2c646e8 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Failed to fetch instance by id tempest-invalid-1444330709 {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 27 20:51:02.825054 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5785f354-3518-43b5-9d86-72d8b2c646e8 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] HTTP exception thrown: Instance tempest-invalid-1444330709 could not be found. Nov 27 20:51:02.825615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5785f354-3518-43b5-9d86-72d8b2c646e8 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Returning 404 to user: Instance tempest-invalid-1444330709 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:02.826966 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5785f354-3518-43b5-9d86-72d8b2c646e8 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "POST /compute/v2.1/servers/tempest-invalid-1444330709/action" status: 404 len: 101 microversion: 2.1 time: 0.008916 Nov 27 20:51:02.827914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 798/1596] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:51:02 2021] POST /compute/v2.1/servers/tempest-invalid-1444330709/action => generated 101 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:02.841018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71620082-24b2-4cfd-9e35-5472cbe94901 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1228482417"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:02.842129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71620082-24b2-4cfd-9e35-5472cbe94901 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 27 20:51:02.842923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-71620082-24b2-4cfd-9e35-5472cbe94901 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 27 20:51:02.843625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71620082-24b2-4cfd-9e35-5472cbe94901 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:02.846069 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71620082-24b2-4cfd-9e35-5472cbe94901 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009901 Nov 27 20:51:02.847621 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 799/1597] 10.222.0.21 () {60 vars in 1274 bytes} [Sat Nov 27 20:51:02 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:02.860286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bd9a947-7246-4a39-bbbe-e616a45c907e tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1741829636"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:02.862207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4bd9a947-7246-4a39-bbbe-e616a45c907e tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 27 20:51:02.863078 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-4bd9a947-7246-4a39-bbbe-e616a45c907e tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 27 20:51:02.863834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bd9a947-7246-4a39-bbbe-e616a45c907e tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:02.864715 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4bd9a947-7246-4a39-bbbe-e616a45c907e tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011913 Nov 27 20:51:02.865583 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 800/1598] 10.222.0.21 () {60 vars in 1280 bytes} [Sat Nov 27 20:51:02 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:02.874720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.875282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.882451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.883449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.884542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.885192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.904719 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] HTTP exception thrown: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. Nov 27 20:51:02.905427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Returning 404 to user: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:02.906509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f87db3d-d41d-4305-81ee-f379cd94fd5f tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 404 len: 111 microversion: 2.1 time: 0.035412 Nov 27 20:51:02.907303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 801/1599] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:02 2021] DELETE /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:02.916360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.917104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] [instance: ddad5835-7d44-421b-97e3-1919c8520678] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.925559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.926234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.927038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.927635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.948402 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] HTTP exception thrown: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. Nov 27 20:51:02.949006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] Returning 404 to user: Instance ddad5835-7d44-421b-97e3-1919c8520678 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:02.950172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8224f9e-cd32-45fc-bb88-dda8055487d0 tempest-ImagesNegativeTestJSON-1403336021 tempest-ImagesNegativeTestJSON-1403336021-project] 10.222.0.21 "GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678" status: 404 len: 111 microversion: 2.1 time: 0.037924 Nov 27 20:51:02.951170 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 802/1600] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:02 2021] GET /compute/v2.1/servers/ddad5835-7d44-421b-97e3-1919c8520678 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:51:02.975816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:02.976456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:02.987557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.988011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:02.988800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:02.992724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.124836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:03.141534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:03.147360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:03.148945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:03.160873 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28fdbcaf-17e2-4e56-b482-8f41f4235ce1 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.420641 Nov 27 20:51:03.165779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-752b9cb1-6999-4633-85b5-1bcb7ed86c1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.179761 Nov 27 20:51:03.166745 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 803/1601] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:02 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:03.175658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:03.176647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:03.178695 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 799/1602] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:02 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:03.187421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:03.187421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.188282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:03.188740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.196483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8798237d-a436-47a4-aed8-3644fb35e609 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:03.207963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8798237d-a436-47a4-aed8-3644fb35e609 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:03.234177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8798237d-a436-47a4-aed8-3644fb35e609 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:03.234538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8798237d-a436-47a4-aed8-3644fb35e609 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.235458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8798237d-a436-47a4-aed8-3644fb35e609 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:03.238291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8798237d-a436-47a4-aed8-3644fb35e609 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.619780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:03.627816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:03.633670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:03.635960 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be57c6f7-4c86-481b-9b00-56d6f0b0c136 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.466058 Nov 27 20:51:03.639366 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 804/1603] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:03 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:03.653833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f63ae00c-42dd-4e41-8217-effb09a6588f req-b77ba55d-dbee-439c-905e-9a7eeb6543cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f864ad9-b187-4c7e-a890-af76116d06ea", "name": "network-vif-deleted", "tag": "3c6e79a9-ba6d-49b0-b965-1eb45c6fa910"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:03.655399 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:03.655399 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:03.680233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f63ae00c-42dd-4e41-8217-effb09a6588f req-b77ba55d-dbee-439c-905e-9a7eeb6543cb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:03.681959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f63ae00c-42dd-4e41-8217-effb09a6588f req-b77ba55d-dbee-439c-905e-9a7eeb6543cb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.696660 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f63ae00c-42dd-4e41-8217-effb09a6588f req-b77ba55d-dbee-439c-905e-9a7eeb6543cb service nova] Creating event network-vif-deleted:3c6e79a9-ba6d-49b0-b965-1eb45c6fa910 for instance 1f864ad9-b187-4c7e-a890-af76116d06ea on nch2-master-1 Nov 27 20:51:03.702994 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f63ae00c-42dd-4e41-8217-effb09a6588f req-b77ba55d-dbee-439c-905e-9a7eeb6543cb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062404 Nov 27 20:51:03.704180 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 805/1604] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:03.712021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:03.712968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:03.719916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:03.721025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.721782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:03.722134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:03.991774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:04.004772 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7a51c89-ff68-45b5-b482-e250b8b745af tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1390 microversion: 2.1 time: 0.297824 Nov 27 20:51:04.005288 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 806/1605] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:03 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1390 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:04.019454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:04.021071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:04.032446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:04.035154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:04.036733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:04.037597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:04.413147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:04.429109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ac62c0e-267f-4996-a16d-926aa0e6fe6d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.422380 Nov 27 20:51:04.440228 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 807/1606] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:04 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:04.445939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:04.448076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:04.456523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:04.457153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:04.458099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:04.458789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:04.775124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:04.783867 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2871f40a-ba3e-4b69-8c2b-09a37c675425 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.342145 Nov 27 20:51:04.785740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 808/1607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:04 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:04.790634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:04.791602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:04.800943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:04.801843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:04.803192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:04.803896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.008182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:05.016706 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8446b699-b551-4e48-a876-c273c7b83889 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.229002 Nov 27 20:51:05.025838 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 809/1608] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:04 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:05.028976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:05.029714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:05.036553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:05.037002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.038775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:05.038775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.129754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:05.140604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:05.143014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:05.145245 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d5e7ac7-d424-4d92-a66d-72704a2ba52b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.126940 Nov 27 20:51:05.146075 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 810/1609] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:05 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:05.156391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c708acc3-9c41-482a-a02e-acccdf7d7d4d req-e865a72b-efd2-42b2-a56c-c4f222d4b58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b", "tag": "f34dffdf-663f-4b72-92c0-9d9a0fe43a7f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:05.158793 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:05.158793 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:05.168123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c708acc3-9c41-482a-a02e-acccdf7d7d4d req-e865a72b-efd2-42b2-a56c-c4f222d4b58c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:05.168546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c708acc3-9c41-482a-a02e-acccdf7d7d4d req-e865a72b-efd2-42b2-a56c-c4f222d4b58c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.182010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c708acc3-9c41-482a-a02e-acccdf7d7d4d req-e865a72b-efd2-42b2-a56c-c4f222d4b58c service nova] Creating event network-changed:f34dffdf-663f-4b72-92c0-9d9a0fe43a7f for instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b on nch1-master-1 Nov 27 20:51:05.187084 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c708acc3-9c41-482a-a02e-acccdf7d7d4d req-e865a72b-efd2-42b2-a56c-c4f222d4b58c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039186 Nov 27 20:51:05.187912 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 811/1610] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:05.193826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:05.194538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:05.200502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:05.201176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.202001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:05.202462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.372556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:05.384297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:05.386200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:05.387604 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-093b2968-e481-4406-b23b-276dbeeb2041 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.198406 Nov 27 20:51:05.388384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 812/1611] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:05 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:05.530453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-909354501", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:05.587045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:51:05.903994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:51:05.904414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:51:05.904878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:51:05.905282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:51:05.905685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:51:05.915385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:05.916005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.917264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:05.918012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:05.938718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Getting quotas for project eb7f37181c464b6fbd15d9f235d94086. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:51:05.944280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Getting quotas for user 7e10693bd4a2442cb7c75cc61ccccc16 and project eb7f37181c464b6fbd15d9f235d94086. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:51:05.955979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:51:05.958436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:51:06.002712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2901e18d-fe74-4cd9-bb2f-3d080021daa7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613135 Nov 27 20:51:06.003579 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 813/1612] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:51:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:51:06.007798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:06.008570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:06.014353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.014812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.015638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.016079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.149256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:06.157100 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78180f77-ef69-489e-8cce-7a6fd786065d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1390 microversion: 2.1 time: 0.152733 Nov 27 20:51:06.158193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 814/1613] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:06 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:06.162807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:06.163739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:06.169631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.170080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.170864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.171329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.307890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:06.315547 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22ec2002-7b6c-4d2c-ba78-a1e799831af1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.156275 Nov 27 20:51:06.316123 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 815/1614] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:06 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:06.320732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:06.321330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:06.326952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.327427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.328196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.328627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.467885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:06.475940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-435ef39a-2c86-4988-8371-af33aaa638cd tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.158856 Nov 27 20:51:06.476634 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 816/1615] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:06 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:06.484804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:06.485518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:06.493191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.493955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.494754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.495182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.554710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:06.562360 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ba1588f-9bf5-4b66-a3e6-b9bf88c17745 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1212 microversion: 2.1 time: 0.084646 Nov 27 20:51:06.562869 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 817/1616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:06 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:06.568272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:06.569386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:06.574668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.575100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:06.575910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:06.576345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.091877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.100598 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-697e365f-508f-4d98-a484-0f7802d32ed9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.536560 Nov 27 20:51:07.101215 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 818/1617] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:06 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:07.105579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:07.106196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:07.114176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.114759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.115712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.116224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.218740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.227591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.229133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.230298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d0409ff-e14c-42c3-90bf-4121d2e2e802 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.128159 Nov 27 20:51:07.230856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 819/1618] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:07 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:07.235637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:07.235637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:07.241235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.241717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.242754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.243193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.423108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.431451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.432954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.434106 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b276b4f5-b736-4643-a7c2-1f0d08545d89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.202311 Nov 27 20:51:07.434675 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 820/1619] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:07 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:07.439030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:07.439699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:07.445958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.446490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.447341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.447801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.685338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.693849 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92c2182b-4b69-45d1-9e27-9dfc8accc04e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1390 microversion: 2.1 time: 0.258168 Nov 27 20:51:07.701230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 821/1620] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:07 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:07.707347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:07.707964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:07.714376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.714834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.715665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.716107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.916568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:07.924523 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c4ed7ff-7171-4cdb-b3cc-ec6907847db2 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.222121 Nov 27 20:51:07.925157 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 822/1621] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:07 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:07.932375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:07.933055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:07.938939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.940090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:07.940879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:07.941311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.162509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:08.175762 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad03a149-c16a-4067-a4e5-359074979df7 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.249568 Nov 27 20:51:08.176352 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 823/1622] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:07 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:08.180678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:08.181280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:08.186950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.187430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.188207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.188645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.453324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:08.460514 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d8ff3dc-f15a-4abc-a396-5da04d860d8d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1316 microversion: 2.1 time: 0.283203 Nov 27 20:51:08.461074 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 824/1623] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:08 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:08.465238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:08.465830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:08.472372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.472947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.473807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.474287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.722613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8798237d-a436-47a4-aed8-3644fb35e609 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 5.542264 Nov 27 20:51:08.728428 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 800/1624] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:03 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 5549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:08.735311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:08.737345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:08.744041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:08.749148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.750024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.751961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.753139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.755209 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f509c655-b978-4250-82db-2107e8ce2fab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.293079 Nov 27 20:51:08.764915 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 825/1625] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:08 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:08.764915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:08.764915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:08.770273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.770726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.771738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.772331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.861791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:08.871567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:08.874477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:08.875888 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02b3c921-d5be-45f5-82ce-f9f036a58464 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.145956 Nov 27 20:51:08.876521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 801/1626] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:08 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:08.881176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:08.881971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:08.888993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.889443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:08.890414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:08.890849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.051974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:09.067382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:09.069319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:09.070545 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7911d153-3b8b-41eb-b7b6-b44f3059cbd2 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.311234 Nov 27 20:51:09.071445 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 826/1627] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:08 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:09.076408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:09.077017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:09.088274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.088841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.089733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.090236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.104035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:09.112444 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d35000c-cac2-4639-b0f6-f445faa307c5 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1390 microversion: 2.1 time: 0.234468 Nov 27 20:51:09.131462 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 802/1628] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:08 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1390 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:09.174845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2cfcc25d-d763-4491-bbf4-ec739d8c7551 req-98a26be4-0c00-479b-ad3e-82b330115c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cac25f4-3288-4ba2-ac3d-0e53d2203e05", "tag": "970294ba-0041-4f63-b140-b50984e2960d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:09.178002 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:09.178002 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:09.195309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2cfcc25d-d763-4491-bbf4-ec739d8c7551 req-98a26be4-0c00-479b-ad3e-82b330115c97 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.195907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2cfcc25d-d763-4491-bbf4-ec739d8c7551 req-98a26be4-0c00-479b-ad3e-82b330115c97 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.211471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2cfcc25d-d763-4491-bbf4-ec739d8c7551 req-98a26be4-0c00-479b-ad3e-82b330115c97 service nova] Creating event network-changed:970294ba-0041-4f63-b140-b50984e2960d for instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 on nch1-master-1 Nov 27 20:51:09.217230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2cfcc25d-d763-4491-bbf4-ec739d8c7551 req-98a26be4-0c00-479b-ad3e-82b330115c97 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055398 Nov 27 20:51:09.219390 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 803/1629] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:09.226281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:09.227596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:09.234977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.235810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.237271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.237815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.490714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:09.498880 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e035e508-1c6a-4c49-940c-a6f5c1bcbf72 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.278051 Nov 27 20:51:09.503386 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 804/1630] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:09 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:09.510368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:09.512832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:09.524340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.526624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.528171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.529844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.709785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:09.719363 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2234d24a-31bd-44d6-ad17-114eed9dffa4 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.646581 Nov 27 20:51:09.731328 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 827/1631] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:09 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:09.741447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4936a930-d46f-49f9-a352-6eaef537118a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:09.743150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4936a930-d46f-49f9-a352-6eaef537118a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:09.751021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4936a930-d46f-49f9-a352-6eaef537118a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.752322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4936a930-d46f-49f9-a352-6eaef537118a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.753794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4936a930-d46f-49f9-a352-6eaef537118a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.754795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4936a930-d46f-49f9-a352-6eaef537118a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.767086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:09.775221 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-82e9f931-7431-4538-81c1-d2cc4b3a98c4 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1316 microversion: 2.1 time: 0.270694 Nov 27 20:51:09.775837 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 805/1632] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:09 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:09.783591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:09.784673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:09.799810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.800484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.801527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.802328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.811065 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4936a930-d46f-49f9-a352-6eaef537118a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.077858 Nov 27 20:51:09.811745 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 828/1633] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:09 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:09.894438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:09.895882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:09.903369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.904596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:09.905620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:09.906162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.010217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.018965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.020648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.021904 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84a7a232-c86d-4aed-8ea9-63ff8b421837 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1365 microversion: 2.57 time: 0.131781 Nov 27 20:51:10.022548 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 829/1634] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:09 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:51:10.070490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.078113 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f0b3f10-5a16-44b1-8ad3-8c5ceeb857dc tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.301315 Nov 27 20:51:10.078965 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 806/1635] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:09 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:10.092730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:10.093530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:10.101113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.101689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.102584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.103127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.129776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:10.130389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:10.136954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.137401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.138190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.138869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.339577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.355318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.358966 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ac906f3-1cd4-404a-a620-2c0ab53d88df tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1390 microversion: 2.1 time: 0.232766 Nov 27 20:51:10.359766 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 807/1636] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:10 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:10.366633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.368517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.370014 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b93312c2-869b-4951-b91e-f44bad7f3c95 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1487 microversion: 2.25 time: 0.282728 Nov 27 20:51:10.370781 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 830/1637] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:10 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1487 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:51:10.516832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:10.517876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:10.524411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.524895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.525674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.526104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.738747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:10.739407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:10.748647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.749142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.750039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.750522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.766108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.786311 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d9d1d28-4f1b-49c7-9cfc-cbf393c32e2c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.273705 Nov 27 20:51:10.786939 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 808/1638] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:10 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:10.792747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:10.793616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:10.799850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.800641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.801444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.801888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.910753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:10.919934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd90490e-4cfa-4b1b-af51-147ddd12ef01 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.184855 Nov 27 20:51:10.920737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 831/1639] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:10 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:10.926791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a01b8f07-8a07-4637-9537-844e0b23a474 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:10.928242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a01b8f07-8a07-4637-9537-844e0b23a474 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:10.940794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a01b8f07-8a07-4637-9537-844e0b23a474 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.942470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a01b8f07-8a07-4637-9537-844e0b23a474 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:10.943292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a01b8f07-8a07-4637-9537-844e0b23a474 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:10.943823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a01b8f07-8a07-4637-9537-844e0b23a474 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.014974 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a01b8f07-8a07-4637-9537-844e0b23a474 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.092972 Nov 27 20:51:11.015676 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 832/1640] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:10 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:11.030482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.042208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.042905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.044089 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-773032ba-0314-43ea-ba97-019aef5329f2 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1316 microversion: 2.1 time: 0.254871 Nov 27 20:51:11.045057 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 809/1641] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:10 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:11.059959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.060422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.061227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.061717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.096299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.097354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.106860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.107641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.108666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.109188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.130615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.140406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.142852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.144267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0711d469-e401-405b-9a23-13996cd588b6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.106329 Nov 27 20:51:11.145279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 833/1642] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:51:11.210017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-018d08c4-e2ce-4012-9f09-c5e3231d2334 req-2ed1e3a8-ec6d-4ea1-b4a6-013ba63c1b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b", "name": "network-vif-plugged", "status": "completed", "tag": "f34dffdf-663f-4b72-92c0-9d9a0fe43a7f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:11.211877 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:11.211877 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:11.223449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-018d08c4-e2ce-4012-9f09-c5e3231d2334 req-2ed1e3a8-ec6d-4ea1-b4a6-013ba63c1b7f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.227577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-018d08c4-e2ce-4012-9f09-c5e3231d2334 req-2ed1e3a8-ec6d-4ea1-b4a6-013ba63c1b7f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.249973 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-018d08c4-e2ce-4012-9f09-c5e3231d2334 req-2ed1e3a8-ec6d-4ea1-b4a6-013ba63c1b7f service nova] Creating event network-vif-plugged:f34dffdf-663f-4b72-92c0-9d9a0fe43a7f for instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b on nch1-master-1 Nov 27 20:51:11.261451 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-018d08c4-e2ce-4012-9f09-c5e3231d2334 req-2ed1e3a8-ec6d-4ea1-b4a6-013ba63c1b7f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059188 Nov 27 20:51:11.262605 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 834/1643] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:51:11.279645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.288813 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c51dfc7c-41b3-49fd-9984-495ea59ea0e3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.196874 Nov 27 20:51:11.289854 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 810/1644] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:11.376551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.377542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.385942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.386474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.387536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.388199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.392790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.393608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.400495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.401587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.402475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.403554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.565041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.570051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.573739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2e50fed-236b-40ba-b167-7ee2d97f29ec tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1390 microversion: 2.1 time: 0.201709 Nov 27 20:51:11.575638 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 835/1645] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1390 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:11.579306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.581513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.582668 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a44c4e42-8b2b-494c-9cf0-32e9cf2a98ff tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1477 microversion: 2.25 time: 0.196932 Nov 27 20:51:11.583339 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 811/1646] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:11.600483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f290aaf-ed25-4a35-9597-441b74d78fd2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '.version_select at 0x7f15c7378dc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.601854 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:11.601854 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:11.603292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f290aaf-ed25-4a35-9597-441b74d78fd2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.603749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f290aaf-ed25-4a35-9597-441b74d78fd2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.618714 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f290aaf-ed25-4a35-9597-441b74d78fd2 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/os-migrations" status: 200 len: 5319 microversion: 2.25 time: 0.021836 Nov 27 20:51:11.619301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 836/1647] 10.222.0.21 () {60 vars in 1183 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/os-migrations => generated 5319 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:51:11.634572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.635177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.641612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.642087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.643529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.644020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.781498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] Lazy-loading 'services' on Instance uuid 5ecb697a-9c98-475c-9836-19f15d3c9194 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:11.794744 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1066943-05d9-469a-b8d8-e27dae4b7466 tempest-LiveAutoBlockMigrationV225Test-70634603 tempest-LiveAutoBlockMigrationV225Test-70634603-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1970 microversion: 2.25 time: 0.164693 Nov 27 20:51:11.795389 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 812/1648] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1970 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:11.804185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.804864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.813154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.813951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.815225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.815705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.827482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.827986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.834387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.834781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.835610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.836048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.863790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:11.953723 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43294f20-3c66-480c-beb0-4e42ff20afa6 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 204 len: 0 microversion: 2.1 time: 0.129652 Nov 27 20:51:11.955752 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 813/1649] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:11 2021] DELETE /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:11.964443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:11.964652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.965524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.971791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.972128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-174a60ae-533d-4322-bc75-d3c20a074a70 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.171667 Nov 27 20:51:11.972253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.972709 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 837/1650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:11.973556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.973680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.987055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:11.987751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:11.993929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.994375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:11.995233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:11.995688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.130872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.139515 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8323c0e7-2923-481f-b9e6-a979cb5da12b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.179473 Nov 27 20:51:12.140486 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 814/1651] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:12.141124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.145927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1d8dc3e8-9b86-4438-a794-756412b38ce6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:12.147413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1d8dc3e8-9b86-4438-a794-756412b38ce6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:12.151618 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5773271-6242-427b-a126-47c2ae063da4 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1414 microversion: 2.1 time: 0.177849 Nov 27 20:51:12.152898 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 838/1652] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:11 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1414 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:12.157427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8dc3e8-9b86-4438-a794-756412b38ce6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.158590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:12.158784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8dc3e8-9b86-4438-a794-756412b38ce6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.160678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8dc3e8-9b86-4438-a794-756412b38ce6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.160678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d8dc3e8-9b86-4438-a794-756412b38ce6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.161301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:12.169179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.169629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.170432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.170873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.212501 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1d8dc3e8-9b86-4438-a794-756412b38ce6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.070703 Nov 27 20:51:12.215290 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 815/1653] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:12 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:12.218396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:12.219090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:12.226686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.227130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.227941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.228379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.301400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.309881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.311442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.312605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc6b623a-1638-4a07-8bad-7714c2344712 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.098213 Nov 27 20:51:12.313163 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 816/1654] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:12 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:12.324397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.324571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:12.324571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:12.324774 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af570782-3264-498c-a43a-d249f463fe3f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1316 microversion: 2.1 time: 0.166740 Nov 27 20:51:12.324774 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 839/1655] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:12 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:12.326988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.327481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.328269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.328706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.469268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.477252 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f56fc50-d559-4d15-b3c5-6ea7fcc00ffd tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.163053 Nov 27 20:51:12.477826 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 817/1656] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:12 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:12.591593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:12.592193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:12.599502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.600160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.600790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.601180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.747040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:12.755320 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7cf77adb-b7dc-47c6-bf65-73af3a52afda tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1390 microversion: 2.1 time: 0.167568 Nov 27 20:51:12.755994 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 840/1657] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:12 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:12.989437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:12.990176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:12.997932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.998386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:12.999274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:12.999645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.163904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:13.164683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.173874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.174324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.175109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.175569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.212504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.227287 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f63ded30-d443-4c01-bd48-65e4d61ba305 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.241608 Nov 27 20:51:13.228222 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 818/1658] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:12 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:13.241377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:13.243483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.250183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.251228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.252949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.253856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.356336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.365697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.377836 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af8cd1a0-d697-4f63-b202-f0ba049afa3b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.222912 Nov 27 20:51:13.381382 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4142cb0b-cdb8-49b1-a65a-aeff44b59a94 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 200 len: 1372 microversion: 2.1 time: 0.151883 Nov 27 20:51:13.391076 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 841/1659] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:13 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:13.396144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91736753-669f-41b8-a027-6885cbca9ee8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:13.396460 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 819/1660] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:13 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:13.402419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91736753-669f-41b8-a027-6885cbca9ee8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.405282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:13.405746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.415559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91736753-669f-41b8-a027-6885cbca9ee8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.416022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91736753-669f-41b8-a027-6885cbca9ee8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.416838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91736753-669f-41b8-a027-6885cbca9ee8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.417277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91736753-669f-41b8-a027-6885cbca9ee8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.421889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.422344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.423156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.424147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.498511 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91736753-669f-41b8-a027-6885cbca9ee8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.104915 Nov 27 20:51:13.500374 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 842/1661] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:13 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:13.507642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:13.509523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.517643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.518320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.519073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.521354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.521830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.527700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.529187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.530333 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8274a70-8db0-4453-aa48-bd2954a31f73 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.132899 Nov 27 20:51:13.530871 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 820/1662] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:13 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:13.608673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-579f985c-9a20-4f26-bc1f-16619ab0965e req-0f6612a1-2b8e-4c7d-aa9e-4763665a0222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecb697a-9c98-475c-9836-19f15d3c9194", "name": "network-vif-deleted", "tag": "cab30d0b-bd13-4963-a8fd-40f8283c83c7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:13.610635 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:13.610635 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:13.619809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-579f985c-9a20-4f26-bc1f-16619ab0965e req-0f6612a1-2b8e-4c7d-aa9e-4763665a0222 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.620350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-579f985c-9a20-4f26-bc1f-16619ab0965e req-0f6612a1-2b8e-4c7d-aa9e-4763665a0222 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.635391 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-579f985c-9a20-4f26-bc1f-16619ab0965e req-0f6612a1-2b8e-4c7d-aa9e-4763665a0222 service nova] Creating event network-vif-deleted:cab30d0b-bd13-4963-a8fd-40f8283c83c7 for instance 5ecb697a-9c98-475c-9836-19f15d3c9194 on nch1-master-1 Nov 27 20:51:13.641426 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-579f985c-9a20-4f26-bc1f-16619ab0965e req-0f6612a1-2b8e-4c7d-aa9e-4763665a0222 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109021 Nov 27 20:51:13.642958 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 821/1663] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:13.649914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:13.650704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.656883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.657326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.658778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.659213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.745960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.755974 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-857ea32f-e2c0-4b87-b0ad-4084495bada7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1316 microversion: 2.1 time: 0.252695 Nov 27 20:51:13.756930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 843/1664] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:13 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:13.779009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:13.779807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.788742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.789464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.790442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.790887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.882359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.892437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c298f636-71d0-4738-8945-13595e33e71c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.247977 Nov 27 20:51:13.893570 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 822/1665] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:13 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:13.951564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:13.959923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4dd12861-9508-40a9-9d0f-1fa4ca5e0651 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1589 microversion: 2.1 time: 0.190995 Nov 27 20:51:13.960602 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 844/1666] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:13 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1589 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:13.977298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45be9d4e-d71a-4e07-8e2c-3402a67d6040 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:13.977813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45be9d4e-d71a-4e07-8e2c-3402a67d6040 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:13.983620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45be9d4e-d71a-4e07-8e2c-3402a67d6040 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.984066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45be9d4e-d71a-4e07-8e2c-3402a67d6040 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:13.984850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45be9d4e-d71a-4e07-8e2c-3402a67d6040 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:13.985286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45be9d4e-d71a-4e07-8e2c-3402a67d6040 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.076967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45be9d4e-d71a-4e07-8e2c-3402a67d6040 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103616 Nov 27 20:51:14.077572 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 823/1667] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:51:13 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:14.245303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:14.246014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:14.252486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.252937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.253716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.254149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.396960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:14.397546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:14.397828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:14.404373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.404821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.405343 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23a7ff73-4885-4049-a234-8ed0e31f2b97 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.163977 Nov 27 20:51:14.405892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.406042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 845/1668] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:14 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:14.406623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.410419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:14.411016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5ecb697a-9c98-475c-9836-19f15d3c9194] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:14.417617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.418070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.419017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.419482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.433629 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] HTTP exception thrown: Instance 5ecb697a-9c98-475c-9836-19f15d3c9194 could not be found. Nov 27 20:51:14.434224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Returning 404 to user: Instance 5ecb697a-9c98-475c-9836-19f15d3c9194 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:14.435047 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f3dc6145-2254-4894-9fbe-ab93574c6b0e tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194" status: 404 len: 111 microversion: 2.1 time: 0.028233 Nov 27 20:51:14.435623 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 846/1669] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:14 2021] GET /compute/v2.1/servers/5ecb697a-9c98-475c-9836-19f15d3c9194 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:14.509774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a183a97d-b0ac-4b07-9b9f-1e91b08ec3c0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:14.511495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a183a97d-b0ac-4b07-9b9f-1e91b08ec3c0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:14.518144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a183a97d-b0ac-4b07-9b9f-1e91b08ec3c0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.518611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a183a97d-b0ac-4b07-9b9f-1e91b08ec3c0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.519438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a183a97d-b0ac-4b07-9b9f-1e91b08ec3c0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.519880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a183a97d-b0ac-4b07-9b9f-1e91b08ec3c0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.687069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:14.697078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f09624f7-10f1-44c2-8e37-cf66026f7971 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.305454 Nov 27 20:51:14.697988 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 824/1670] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:14 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:14.702540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:14.703238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:14.713178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.713861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:14.715080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:14.715681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.091532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:15.099978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:15.101556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:15.102800 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51e62f44-fcfa-4583-8639-7478dcc883fc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.403666 Nov 27 20:51:15.111473 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 825/1671] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:14 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:15.115194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:15.115873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:15.122858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.123136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.123933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.124366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.369246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:15.377506 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28837415-04ab-4bc0-961d-241cf902eaf7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1316 microversion: 2.1 time: 0.273028 Nov 27 20:51:15.378182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 826/1672] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:15 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:15.382705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:15.383337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:15.389849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.390359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.391130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.391591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.608768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:15.616667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-632fa671-ecdb-4d24-bbe1-ab26736ff24d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.237461 Nov 27 20:51:15.617422 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 827/1673] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:15 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:15.621887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-10866c4a-6ffd-4af6-8450-a0f18abb0313 req-49509e05-4b4c-42f4-90ff-801ea7aed948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cac25f4-3288-4ba2-ac3d-0e53d2203e05", "name": "network-vif-plugged", "status": "completed", "tag": "970294ba-0041-4f63-b140-b50984e2960d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:15.623576 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:15.623576 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:15.630684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-10866c4a-6ffd-4af6-8450-a0f18abb0313 req-49509e05-4b4c-42f4-90ff-801ea7aed948 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.631127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-10866c4a-6ffd-4af6-8450-a0f18abb0313 req-49509e05-4b4c-42f4-90ff-801ea7aed948 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.641882 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-10866c4a-6ffd-4af6-8450-a0f18abb0313 req-49509e05-4b4c-42f4-90ff-801ea7aed948 service nova] Creating event network-vif-plugged:970294ba-0041-4f63-b140-b50984e2960d for instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 on nch1-master-1 Nov 27 20:51:15.646756 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-10866c4a-6ffd-4af6-8450-a0f18abb0313 req-49509e05-4b4c-42f4-90ff-801ea7aed948 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028152 Nov 27 20:51:15.647441 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 828/1674] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:15.652494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:15.653194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:15.659536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.659990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.660785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.661222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.856059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:15.864210 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8921173d-6260-4957-9e9d-f9753b3cf133 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.215604 Nov 27 20:51:15.865055 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 829/1675] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:15 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:15.869754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5cfc5573-0602-44f1-98fa-c02b26a142cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:15.870736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5cfc5573-0602-44f1-98fa-c02b26a142cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:15.876521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cfc5573-0602-44f1-98fa-c02b26a142cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.876973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cfc5573-0602-44f1-98fa-c02b26a142cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:15.877747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cfc5573-0602-44f1-98fa-c02b26a142cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:15.878179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cfc5573-0602-44f1-98fa-c02b26a142cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.051305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5cfc5573-0602-44f1-98fa-c02b26a142cb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.184963 Nov 27 20:51:16.054968 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 830/1676] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:15 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:16.057019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:16.057608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:16.065299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.065754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.066546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.066985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.094416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:16.176519 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aabf2029-5b38-4fdf-a334-2f5ff7383db9 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 204 len: 0 microversion: 2.1 time: 0.122931 Nov 27 20:51:16.177043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 831/1677] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:16 2021] DELETE /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:16.183438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e0eb968d-0f8d-40a7-a810-7382b4bc2e6b req-b284dc9f-70f3-46e8-85fe-0981d28a2ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b", "tag": "f34dffdf-663f-4b72-92c0-9d9a0fe43a7f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:16.185146 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:16.185146 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:16.192557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e0eb968d-0f8d-40a7-a810-7382b4bc2e6b req-b284dc9f-70f3-46e8-85fe-0981d28a2ce3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.192985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e0eb968d-0f8d-40a7-a810-7382b4bc2e6b req-b284dc9f-70f3-46e8-85fe-0981d28a2ce3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.205538 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e0eb968d-0f8d-40a7-a810-7382b4bc2e6b req-b284dc9f-70f3-46e8-85fe-0981d28a2ce3 service nova] Creating event network-changed:f34dffdf-663f-4b72-92c0-9d9a0fe43a7f for instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b on nch1-master-1 Nov 27 20:51:16.210605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e0eb968d-0f8d-40a7-a810-7382b4bc2e6b req-b284dc9f-70f3-46e8-85fe-0981d28a2ce3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031920 Nov 27 20:51:16.211246 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 832/1678] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:16.216178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:16.216874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:16.224222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.224671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.225466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.225906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.436725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:16.445764 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d9d63c84-c103-420c-af46-d76a195518d3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.233324 Nov 27 20:51:16.446857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 833/1679] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:16 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:16.455842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:16.456517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:16.463769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.464233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.465035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.465472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.556286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:16.564717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:16.566681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:16.567355 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f07592ad-69df-4ad1-818f-c6e05933331f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.119137 Nov 27 20:51:16.567912 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 834/1680] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:16 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:16.572318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:16.572917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:16.579020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.580125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.580920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.581366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.761145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:16.770149 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2092a131-9113-477b-bf30-88965d970ffa tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1524 microversion: 2.1 time: 0.201164 Nov 27 20:51:16.779815 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 835/1681] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:16 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1524 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:16.779815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:16.779815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:16.799487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.800172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:16.801111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:16.801632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.033749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.041044 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92f631da-02a4-4d99-8fe4-cfbb35c4224d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1316 microversion: 2.1 time: 0.269153 Nov 27 20:51:17.041769 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 836/1682] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:16 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:17.051024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:17.051024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:17.052814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.053264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.054100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.054538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.196265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.204063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5ac9e4e7-19e8-4b02-8a4e-39a44816b10d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.161217 Nov 27 20:51:17.204853 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 837/1683] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:17 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:17.209402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:17.209996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:17.216746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.217324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.218318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.218864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.365726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.373787 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0108eb0a-65ee-4c44-8122-4b4ab9933a6b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.167828 Nov 27 20:51:17.378618 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 838/1684] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:17 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:17.379074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f4018f47-c128-41ff-8d94-fc586cfdf187 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:17.380129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f4018f47-c128-41ff-8d94-fc586cfdf187 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:17.386834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4018f47-c128-41ff-8d94-fc586cfdf187 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.387432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4018f47-c128-41ff-8d94-fc586cfdf187 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.388233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4018f47-c128-41ff-8d94-fc586cfdf187 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.388663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4018f47-c128-41ff-8d94-fc586cfdf187 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.430752 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f4018f47-c128-41ff-8d94-fc586cfdf187 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.054994 Nov 27 20:51:17.434290 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 839/1685] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:17 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:17.436685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7f1e45cc-b55f-4b22-b213-d0713fecbb66 req-ab223fc8-2905-4a81-b11e-e6ab15876b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be38ef7-cbe4-41c9-8180-148457627022", "name": "network-vif-deleted", "tag": "f6b877dc-2544-4729-b562-12b62148f13d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:17.438195 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:17.438195 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:17.445963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7f1e45cc-b55f-4b22-b213-d0713fecbb66 req-ab223fc8-2905-4a81-b11e-e6ab15876b9c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.446402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7f1e45cc-b55f-4b22-b213-d0713fecbb66 req-ab223fc8-2905-4a81-b11e-e6ab15876b9c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.457393 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7f1e45cc-b55f-4b22-b213-d0713fecbb66 req-ab223fc8-2905-4a81-b11e-e6ab15876b9c service nova] Creating event network-vif-deleted:f6b877dc-2544-4729-b562-12b62148f13d for instance 5be38ef7-cbe4-41c9-8180-148457627022 on nch1-master-1 Nov 27 20:51:17.461972 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7f1e45cc-b55f-4b22-b213-d0713fecbb66 req-ab223fc8-2905-4a81-b11e-e6ab15876b9c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029162 Nov 27 20:51:17.462544 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 840/1686] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:17.467181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:17.467880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:17.474196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.474638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.475459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.475888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.614645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.622251 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c4fe288-a4b0-4fed-b77e-c25b851a760d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.158662 Nov 27 20:51:17.622811 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 841/1687] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:17 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:17.627106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:17.627718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:17.633317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.633759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.634520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.634949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.695393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.703121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.705130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.706262 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-509dab92-999e-4907-b99b-659b186b30e2 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.082523 Nov 27 20:51:17.707384 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 842/1688] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:17 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:17.787627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:17.788230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:17.794494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.794944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.795903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.796257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.827640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:17.828093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:17.828539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lazy-loading 'fault' on Instance uuid 5be38ef7-cbe4-41c9-8180-148457627022 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:17.871623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:17.878641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53258b1a-81dd-4040-a1d9-a7ea613b001d tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 200 len: 1313 microversion: 2.1 time: 0.094769 Nov 27 20:51:17.879208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 843/1689] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:17 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 1313 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:18.057670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:18.058271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:18.065618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.065989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.066767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.067210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.228893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:18.237061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b74d5c2-aa87-4d4f-bc15-d148bdd62337 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1465 microversion: 2.1 time: 0.183122 Nov 27 20:51:18.237630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 844/1690] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:18 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:18.241833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:18.242676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:18.248169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.248611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.249376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.249806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.377101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:18.384641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04241129-f8bb-40d1-8365-f6249d6c405b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.145802 Nov 27 20:51:18.385207 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 845/1691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:18 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:18.389884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-869688668", "metadata": {"image_type": "test"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:18.391043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:18.396906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.397351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.398115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.398542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.436282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Getting quotas for project eb7f37181c464b6fbd15d9f235d94086. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:51:18.440163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Getting quotas for user 7e10693bd4a2442cb7c75cc61ccccc16 and project eb7f37181c464b6fbd15d9f235d94086. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:51:18.730247 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9bebacca-4cc9-41d3-81b0-3509b4c91a7f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "POST /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05/action" status: 202 len: 0 microversion: 2.1 time: 0.343836 Nov 27 20:51:18.730889 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 846/1692] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:18 2021] POST /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:51:18.735690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:18.736386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:18.742708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.743243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.744169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.744635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.879701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:18.887308 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d49f38a-0940-4aee-92e0-728d27e081eb tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.155257 Nov 27 20:51:18.887909 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 847/1693] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:18 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:18.898996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42c1dbb6-9087-40df-94b5-ad8387f488d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:18.900030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42c1dbb6-9087-40df-94b5-ad8387f488d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:18.906065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42c1dbb6-9087-40df-94b5-ad8387f488d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.906518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42c1dbb6-9087-40df-94b5-ad8387f488d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.907325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42c1dbb6-9087-40df-94b5-ad8387f488d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.907796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42c1dbb6-9087-40df-94b5-ad8387f488d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.944504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42c1dbb6-9087-40df-94b5-ad8387f488d8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.055306 Nov 27 20:51:18.945202 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 848/1694] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:18 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:18.951918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f9aad7d0-325f-47f2-874b-a030ef2984b8 req-663cb0ed-9522-4c97-b237-a89f72016bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "name": "network-vif-plugged", "status": "completed", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:18.953382 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:18.953382 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:18.961543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f9aad7d0-325f-47f2-874b-a030ef2984b8 req-663cb0ed-9522-4c97-b237-a89f72016bcb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:18.961983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f9aad7d0-325f-47f2-874b-a030ef2984b8 req-663cb0ed-9522-4c97-b237-a89f72016bcb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:18.973186 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f9aad7d0-325f-47f2-874b-a030ef2984b8 req-663cb0ed-9522-4c97-b237-a89f72016bcb service nova] Creating event network-vif-plugged:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch2-master-1 Nov 27 20:51:18.978545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-f9aad7d0-325f-47f2-874b-a030ef2984b8 req-663cb0ed-9522-4c97-b237-a89f72016bcb service nova] Instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:51:18.989276 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f9aad7d0-325f-47f2-874b-a030ef2984b8 req-663cb0ed-9522-4c97-b237-a89f72016bcb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042139 Nov 27 20:51:18.989882 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 849/1695] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:18.995121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:18.995836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:19.002771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.003218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.004016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.004450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.134872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:19.142842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b3d9ae2-b76d-4f4e-8b83-3328f0450a0c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.151192 Nov 27 20:51:19.143439 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 850/1696] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:18 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:19.148104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:19.148703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:19.154319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.154764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.155577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.156012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.216381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:19.224027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:19.225564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:19.226709 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-36cae3ba-2229-4e03-8ef1-d4c088ab4c30 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.082243 Nov 27 20:51:19.227272 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 851/1697] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:19 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:19.231345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5dd0653d-63be-4036-b474-0f784913b61e tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c73ca1f0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:19.274964 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5dd0653d-63be-4036-b474-0f784913b61e tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.046695 Nov 27 20:51:19.275570 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 852/1698] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:19 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:19.279714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:19.280305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: 5be38ef7-cbe4-41c9-8180-148457627022] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:19.288245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.288687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.289459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.289888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.303282 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] HTTP exception thrown: Instance 5be38ef7-cbe4-41c9-8180-148457627022 could not be found. Nov 27 20:51:19.303857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Returning 404 to user: Instance 5be38ef7-cbe4-41c9-8180-148457627022 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:19.304657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd1640fc-1d5f-4247-9f87-fd3f076c4e46 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022" status: 404 len: 111 microversion: 2.1 time: 0.028220 Nov 27 20:51:19.305178 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 853/1699] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:19 2021] GET /compute/v2.1/servers/5be38ef7-cbe4-41c9-8180-148457627022 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:19.312555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:19.313041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:19.319201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.319682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.320474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.320908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.346557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:19.418436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c0e7455-87f2-404b-b060-7a4b2d1eed89 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 204 len: 0 microversion: 2.1 time: 0.108920 Nov 27 20:51:19.418906 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 854/1700] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:19 2021] DELETE /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:51:19.424429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:19.425123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:19.430790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.431238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.432048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.432483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.566209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:19.573525 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a9493d8-3a7e-43c3-90c3-9eb831f995b3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.153521 Nov 27 20:51:19.574093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 855/1701] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:19 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:19.578472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:19.579058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:19.585063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.585512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.586304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.586741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.714523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:19.722438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19d352db-f5b4-445f-9b8b-b3642cb7b700 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1509 microversion: 2.1 time: 0.147307 Nov 27 20:51:19.722997 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 856/1702] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:19 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:19.903971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:19.904579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:19.910911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.911388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:19.912159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:19.912595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.043017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:20.050651 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-893bc0d7-116c-4336-8758-528f2dee0c4a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.150333 Nov 27 20:51:20.051217 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 857/1703] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:19 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:20.055820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1135a0dc-09e8-48a5-884d-2c63abe14b5b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:20.056831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1135a0dc-09e8-48a5-884d-2c63abe14b5b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:20.062748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1135a0dc-09e8-48a5-884d-2c63abe14b5b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.063193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1135a0dc-09e8-48a5-884d-2c63abe14b5b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.064007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1135a0dc-09e8-48a5-884d-2c63abe14b5b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.064443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1135a0dc-09e8-48a5-884d-2c63abe14b5b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.104602 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1135a0dc-09e8-48a5-884d-2c63abe14b5b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.052087 Nov 27 20:51:20.105479 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 858/1704] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:20 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:20.161273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:20.162304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:20.169936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.170427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.171677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.172100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.392958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:20.401371 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4e382cbb-6795-48e9-8419-2310de37a8bd tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.244804 Nov 27 20:51:20.402206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 859/1705] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:20 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:20.411161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:20.411968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:20.418444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.418888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.419838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.420269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.505650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:20.516255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:20.518486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:20.519774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9066b3bd-9ef1-4733-a27f-99608a60dc0b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.116598 Nov 27 20:51:20.520402 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 860/1706] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:20 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:20.524880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83bf46c7-ed7e-4c2b-9fdb-aec1099d0ee0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c7415940>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:20.570637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83bf46c7-ed7e-4c2b-9fdb-aec1099d0ee0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.048884 Nov 27 20:51:20.571520 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 861/1707] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:20 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:20.576086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-273742d0-8932-4341-a6c6-8fb898ec3f2e req-facfaa9a-2312-4ba4-8864-8ca3d4766172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9efc26-9fde-4032-8074-261f852463fc", "name": "network-vif-deleted", "tag": "3978ebd3-dcc3-49e6-8a90-afe04b6c5d93"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:20.577908 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:20.577908 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:20.585747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-273742d0-8932-4341-a6c6-8fb898ec3f2e req-facfaa9a-2312-4ba4-8864-8ca3d4766172 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.586187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-273742d0-8932-4341-a6c6-8fb898ec3f2e req-facfaa9a-2312-4ba4-8864-8ca3d4766172 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.597197 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-273742d0-8932-4341-a6c6-8fb898ec3f2e req-facfaa9a-2312-4ba4-8864-8ca3d4766172 service nova] Creating event network-vif-deleted:3978ebd3-dcc3-49e6-8a90-afe04b6c5d93 for instance bb9efc26-9fde-4032-8074-261f852463fc on nch1-master-1 Nov 27 20:51:20.601891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-273742d0-8932-4341-a6c6-8fb898ec3f2e req-facfaa9a-2312-4ba4-8864-8ca3d4766172 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029146 Nov 27 20:51:20.602495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 862/1708] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:20.607392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:20.608072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:20.614223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.614668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.615484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.615922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.842817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:20.850752 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6268455-d4c8-4ce8-b0a1-35be2bf47b1b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.246567 Nov 27 20:51:20.851554 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 863/1709] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:20 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:20.855714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:20.856315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:20.862995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.863474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.864252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.864696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.896433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:20.896874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:20.897314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lazy-loading 'fault' on Instance uuid bb9efc26-9fde-4032-8074-261f852463fc {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:20.936591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:20.944424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2fda7d49-c3d4-4866-a73f-e0bcabe8a2be tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 200 len: 1313 microversion: 2.1 time: 0.092035 Nov 27 20:51:20.944998 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 864/1710] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:20 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 1313 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:21.068054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:21.068662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:21.074447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.074895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.075698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.076135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.207222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:21.215397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-91576fb3-8f6f-4ef6-927c-9486d31e54b6 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.151505 Nov 27 20:51:21.216110 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 865/1711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:21 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:21.220595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca43d6bc-3063-4a58-9fce-335aa8070b48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:21.221604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca43d6bc-3063-4a58-9fce-335aa8070b48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:21.229496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca43d6bc-3063-4a58-9fce-335aa8070b48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.230012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca43d6bc-3063-4a58-9fce-335aa8070b48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.230812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca43d6bc-3063-4a58-9fce-335aa8070b48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.231284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca43d6bc-3063-4a58-9fce-335aa8070b48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.271515 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca43d6bc-3063-4a58-9fce-335aa8070b48 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.054157 Nov 27 20:51:21.274616 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 866/1712] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:21 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:21.418476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:21.419146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:21.426863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.427333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.428535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.429048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.570444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:21.578852 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12ceef76-eab0-46c4-a0ae-4abff58847d1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.164572 Nov 27 20:51:21.580075 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 867/1713] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:21 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:21.584592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:21.585351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:21.591996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.592436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.593268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.593776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.657207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:21.668070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:21.670185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:21.672523 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e0a48e1-6423-4479-8ea9-31b4e0f1d413 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.091070 Nov 27 20:51:21.673817 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 868/1714] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:21 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:21.679816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c673239-3009-4c8b-9cc7-35f93088733f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c75599d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:21.725462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c673239-3009-4c8b-9cc7-35f93088733f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.050879 Nov 27 20:51:21.726199 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 869/1715] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:21 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:21.868021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:21.868632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:21.874663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.875109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:21.875916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:21.876863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.026104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:22.034188 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c49e1bc9-380e-4adc-9a3a-1351df45817b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.170076 Nov 27 20:51:22.039407 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 870/1716] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:21 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:22.041529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:22.042142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: bb9efc26-9fde-4032-8074-261f852463fc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:22.050349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.050801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.051623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.052069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.070006 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] HTTP exception thrown: Instance bb9efc26-9fde-4032-8074-261f852463fc could not be found. Nov 27 20:51:22.070600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Returning 404 to user: Instance bb9efc26-9fde-4032-8074-261f852463fc could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:22.071449 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-57da763e-1cfe-49a5-8652-25a874a68dde tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc" status: 404 len: 111 microversion: 2.1 time: 0.034606 Nov 27 20:51:22.075547 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 871/1717] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:22 2021] GET /compute/v2.1/servers/bb9efc26-9fde-4032-8074-261f852463fc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:22.080671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:22.081164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:22.088912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.089599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.090548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.091041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.122272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:22.216421 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b144e3b8-6e15-4ae6-938c-b2ecd9f869a3 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "DELETE /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 204 len: 0 microversion: 2.1 time: 0.139223 Nov 27 20:51:22.219904 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 872/1718] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:22 2021] DELETE /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:22.225888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:22.226663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:22.235456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.236438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.237232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.237674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.394022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:22.402056 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0f988cf-f243-4945-8aee-7d93c2f0be26 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1524 microversion: 2.1 time: 0.180766 Nov 27 20:51:22.402635 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 873/1719] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:22 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1524 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:22.407275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:22.408410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:22.416846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.417308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.418108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.418678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.562331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:22.570574 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-63f1b8a7-58de-4127-81ad-1d3715f7ce2a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.166938 Nov 27 20:51:22.580282 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 874/1720] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:22 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:22.580282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15384b54-3f0c-46e2-b299-7b1503624612 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:22.580282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15384b54-3f0c-46e2-b299-7b1503624612 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:22.585618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15384b54-3f0c-46e2-b299-7b1503624612 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.586162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15384b54-3f0c-46e2-b299-7b1503624612 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.586961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15384b54-3f0c-46e2-b299-7b1503624612 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.587436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15384b54-3f0c-46e2-b299-7b1503624612 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.636005 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15384b54-3f0c-46e2-b299-7b1503624612 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.063575 Nov 27 20:51:22.637141 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 875/1721] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:22 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:22.642621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:22.643613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:22.651296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.652191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.653209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.653860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.866025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:22.876178 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d02e901f-19a6-47e0-a472-6e1cb339c675 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.237539 Nov 27 20:51:22.877340 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 876/1722] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:22 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:22.882423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:22.883044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:22.890239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.890694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.891686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:22.892180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:22.965848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:22.975458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:22.977609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:22.980034 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e60bcb9f-41f7-48dc-828f-4516fa246be9 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.101573 Nov 27 20:51:22.980813 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 877/1723] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:22 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:22.986792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c716f1cb-65aa-4907-a933-74d48955ca26 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c73cf550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:23.050689 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c716f1cb-65aa-4907-a933-74d48955ca26 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.068433 Nov 27 20:51:23.051661 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 878/1724] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:22 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:23.061889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:23.062669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:23.080028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.080649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.081624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.082135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.317285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:23.324852 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1638c897-c8bd-42b5-8018-58b14c0db26f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.272261 Nov 27 20:51:23.335501 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 879/1725] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:23 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:23.341222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-99863dff-260a-4c41-86f1-473a4bdc05c1 req-2f8d21c4-ee82-4465-a916-4126ce2a6e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cac25f4-3288-4ba2-ac3d-0e53d2203e05", "name": "network-vif-plugged", "status": "completed", "tag": "970294ba-0041-4f63-b140-b50984e2960d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:23.341888 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:23.341888 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:23.349369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-99863dff-260a-4c41-86f1-473a4bdc05c1 req-2f8d21c4-ee82-4465-a916-4126ce2a6e6c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.349812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-99863dff-260a-4c41-86f1-473a4bdc05c1 req-2f8d21c4-ee82-4465-a916-4126ce2a6e6c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.365922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-99863dff-260a-4c41-86f1-473a4bdc05c1 req-2f8d21c4-ee82-4465-a916-4126ce2a6e6c service nova] Creating event network-vif-plugged:970294ba-0041-4f63-b140-b50984e2960d for instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 on nch1-master-1 Nov 27 20:51:23.371158 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-99863dff-260a-4c41-86f1-473a4bdc05c1 req-2f8d21c4-ee82-4465-a916-4126ce2a6e6c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034424 Nov 27 20:51:23.372107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 880/1726] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:23.420432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:23.422038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:23.449375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.449865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.450807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.451425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.527535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d326a07ce104727bec8ae98dabea64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eca53282994b4094a056750bb24ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:23.538137 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98f71304-49ab-493b-9d15-9cda996fef16 tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 200 len: 1482 microversion: 2.1 time: 0.122191 Nov 27 20:51:23.538981 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 881/1727] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:23 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 1482 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:23.544065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fa97ae03-902f-4ad5-ab4b-e89955fadc9a req-de865f62-c80a-4764-9080-d5b0b45dc7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0d3056-c6e0-415c-b5a5-28fea06f98b3", "name": "network-vif-deleted", "tag": "e37a2959-a2b3-4d7f-9dd6-d943c2ac302c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:23.545992 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:23.545992 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:23.554503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fa97ae03-902f-4ad5-ab4b-e89955fadc9a req-de865f62-c80a-4764-9080-d5b0b45dc7bf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.555191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fa97ae03-902f-4ad5-ab4b-e89955fadc9a req-de865f62-c80a-4764-9080-d5b0b45dc7bf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.570078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fa97ae03-902f-4ad5-ab4b-e89955fadc9a req-de865f62-c80a-4764-9080-d5b0b45dc7bf service nova] Creating event network-vif-deleted:e37a2959-a2b3-4d7f-9dd6-d943c2ac302c for instance df0d3056-c6e0-415c-b5a5-28fea06f98b3 on nch1-master-1 Nov 27 20:51:23.577358 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fa97ae03-902f-4ad5-ab4b-e89955fadc9a req-de865f62-c80a-4764-9080-d5b0b45dc7bf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036836 Nov 27 20:51:23.578431 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 882/1728] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:23.589885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:23.590884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:23.599588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.600343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.601531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.602141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.749300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:23.758318 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-161aff59-d298-4fd4-ad00-1366a7837f1a tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.174733 Nov 27 20:51:23.758318 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 883/1729] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:23 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:23.762999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0147ef2e-d7d6-4fce-8c73-88cd492cf29c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:23.764334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0147ef2e-d7d6-4fce-8c73-88cd492cf29c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:23.771154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0147ef2e-d7d6-4fce-8c73-88cd492cf29c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.771727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0147ef2e-d7d6-4fce-8c73-88cd492cf29c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.772588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0147ef2e-d7d6-4fce-8c73-88cd492cf29c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.773093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0147ef2e-d7d6-4fce-8c73-88cd492cf29c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.815748 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0147ef2e-d7d6-4fce-8c73-88cd492cf29c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.055974 Nov 27 20:51:23.816406 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 884/1730] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:23 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:23.893795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:23.894647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:23.903576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.904160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:23.905033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:23.905567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.067693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:24.078616 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b617055c-56ba-411b-acc9-8df6dad3e13f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.189534 Nov 27 20:51:24.090264 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 885/1731] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:23 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:24.095726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:24.096628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:24.103302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.103985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.104924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.105529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.186832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:24.197538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:24.200189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:24.201388 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b7bd52ed-9b04-40c0-9508-2c53564af03f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.109782 Nov 27 20:51:24.202124 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 886/1732] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:24 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:24.219301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d889c946-b292-4c20-ae07-670057d3bdc8 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c7393430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:24.271158 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d889c946-b292-4c20-ae07-670057d3bdc8 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.055204 Nov 27 20:51:24.271158 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 887/1733] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:24 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:24.342816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:24.343409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:24.354595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.355184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.356012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.356450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.517776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:24.526205 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72f101ba-7174-4519-8b1d-8a55faf93e71 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.187647 Nov 27 20:51:24.536520 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 888/1734] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:24 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:24.554533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:24.555429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] [instance: df0d3056-c6e0-415c-b5a5-28fea06f98b3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:24.561765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.562342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.563233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.563842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.580661 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] HTTP exception thrown: Instance df0d3056-c6e0-415c-b5a5-28fea06f98b3 could not be found. Nov 27 20:51:24.581255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] Returning 404 to user: Instance df0d3056-c6e0-415c-b5a5-28fea06f98b3 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:24.582089 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf7b7874-914d-4ccc-a851-55f07688bcce tempest-LiveAutoBlockMigrationV225Test-1157895455 tempest-LiveAutoBlockMigrationV225Test-1157895455-project] 10.222.0.21 "GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3" status: 404 len: 111 microversion: 2.1 time: 0.031201 Nov 27 20:51:24.582931 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 889/1735] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:24 2021] GET /compute/v2.1/servers/df0d3056-c6e0-415c-b5a5-28fea06f98b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:24.774239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:24.774969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:24.781828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.782379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:24.783973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:24.784483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.008166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:25.012311 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e631182-710e-4783-a397-61bfae52d456 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.242022 Nov 27 20:51:25.022431 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 890/1736] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:24 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:25.039212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0e15fa6-d104-4ec9-aad0-56e0baabbe30 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:25.040619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0e15fa6-d104-4ec9-aad0-56e0baabbe30 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:25.052926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0e15fa6-d104-4ec9-aad0-56e0baabbe30 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.053380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0e15fa6-d104-4ec9-aad0-56e0baabbe30 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.054343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0e15fa6-d104-4ec9-aad0-56e0baabbe30 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.054646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0e15fa6-d104-4ec9-aad0-56e0baabbe30 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.133999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0e15fa6-d104-4ec9-aad0-56e0baabbe30 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.119329 Nov 27 20:51:25.135122 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 891/1737] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:25 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:25.140922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:25.141259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:25.149037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.150414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.153156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.153156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.411435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:25.421239 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5066541b-63ad-4e63-b23c-684badbd5e40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1473 microversion: 2.1 time: 0.284808 Nov 27 20:51:25.422526 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 892/1738] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:25 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:25.435863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:25.436668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:25.452613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.453627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.454137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.455277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.540671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:25.549206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:25.556987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:25.558392 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a3f260f-7232-4ac7-9657-c7ca8cb2b1dc tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.126613 Nov 27 20:51:25.562412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 893/1739] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:25 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:25.567483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4051c49f-ea45-488a-893a-012f6d69a1a1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c73ca310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:25.634452 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4051c49f-ea45-488a-893a-012f6d69a1a1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.070918 Nov 27 20:51:25.640433 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 894/1740] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:25 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:25.645619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:25.646234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:25.652607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.653064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.653991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:25.654427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:25.835667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:25.849209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88cafaf0-093d-48f2-95bb-6bd07b3e2d49 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.206938 Nov 27 20:51:25.850265 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 895/1741] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:25 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:25.940184 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a183a97d-b0ac-4b07-9b9f-1e91b08ec3c0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 11.433129 Nov 27 20:51:25.941239 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 847/1742] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:14 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 11436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:26.029620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:26.030425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:26.039785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.045306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.045306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.045306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.148089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2ffad79-450e-439e-957d-d3637528dabe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:26.151398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2ffad79-450e-439e-957d-d3637528dabe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:26.178418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2ffad79-450e-439e-957d-d3637528dabe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.181903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2ffad79-450e-439e-957d-d3637528dabe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.182151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2ffad79-450e-439e-957d-d3637528dabe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.182834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2ffad79-450e-439e-957d-d3637528dabe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.264839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2ffad79-450e-439e-957d-d3637528dabe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 14 microversion: 2.1 time: 0.123665 Nov 27 20:51:26.266008 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 848/1743] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:26 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:51:26.439626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:26.451589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:26.471270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.472240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.474685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.475522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.709425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:26.716889 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa9269f7-8b6e-4a59-af07-1919dbb47620 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1387 microversion: 2.1 time: 0.691220 Nov 27 20:51:26.728822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:26.730764 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 896/1744] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:26 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1387 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:26.735454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:26.736288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:26.736734 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8c34f7bc-ef88-4d0f-8355-80941a642ea1 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1470 microversion: 2.1 time: 0.302502 Nov 27 20:51:26.737312 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 849/1745] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:26 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:26.745972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ba899dc-2f35-4464-aaed-291a45f03989 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c729f280>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:26.754007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.754716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.755733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.756325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.821420 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ba899dc-2f35-4464-aaed-291a45f03989 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.083069 Nov 27 20:51:26.822281 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 850/1746] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:26 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:26.831870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33a0640b-24d8-462d-a649-8580f726ec4b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:26.832703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33a0640b-24d8-462d-a649-8580f726ec4b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:26.838905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a0640b-24d8-462d-a649-8580f726ec4b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.839607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a0640b-24d8-462d-a649-8580f726ec4b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.840576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a0640b-24d8-462d-a649-8580f726ec4b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.841161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a0640b-24d8-462d-a649-8580f726ec4b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.877830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:26.906485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:26.908300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:26.909512 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-abf99080-1916-4683-9875-8d2fc1eae2b5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.177695 Nov 27 20:51:26.915711 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 897/1747] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:26 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:26.930577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:26.931288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:26.942807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.943290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:26.944087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:26.944528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.051191 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33a0640b-24d8-462d-a649-8580f726ec4b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "POST /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade/action" status: 202 len: 0 microversion: 2.1 time: 0.227370 Nov 27 20:51:27.052495 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 851/1748] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:26 2021] POST /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:51:27.057947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13e03073-a039-4ea8-b002-d232642f2a4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:27.059515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13e03073-a039-4ea8-b002-d232642f2a4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:27.070514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e03073-a039-4ea8-b002-d232642f2a4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.071211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e03073-a039-4ea8-b002-d232642f2a4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.072232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e03073-a039-4ea8-b002-d232642f2a4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.073484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e03073-a039-4ea8-b002-d232642f2a4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.206311 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13e03073-a039-4ea8-b002-d232642f2a4c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.152143 Nov 27 20:51:27.206967 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 852/1749] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:27 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:27.212633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:27.216107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:27.231122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.235055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.239776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.244565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.414489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:27.422821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17984186-da16-46c4-bc15-0a8077736f8a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.505849 Nov 27 20:51:27.465816 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 898/1750] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:26 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:27.479205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d6ed476-6dd2-4963-bf79-e66c92fcf9f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:27.491375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d6ed476-6dd2-4963-bf79-e66c92fcf9f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:27.506624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d6ed476-6dd2-4963-bf79-e66c92fcf9f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.509410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d6ed476-6dd2-4963-bf79-e66c92fcf9f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.510384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d6ed476-6dd2-4963-bf79-e66c92fcf9f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.512165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d6ed476-6dd2-4963-bf79-e66c92fcf9f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.580949 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d6ed476-6dd2-4963-bf79-e66c92fcf9f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 8204 microversion: 2.1 time: 0.113690 Nov 27 20:51:27.584615 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 899/1751] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:27 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 8204 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:27.587899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9a8e3e2c-bea5-4b30-8665-dd634341603b req-cb6e6891-8b23-4bc2-b75b-abf52ba0cfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37efb1e-42bf-4d0f-8311-b4254fa2ce71", "name": "network-vif-deleted", "tag": "24c3bbfe-097d-44dd-b015-ded002b7cd5e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:27.590354 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:27.590354 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:27.598632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9a8e3e2c-bea5-4b30-8665-dd634341603b req-cb6e6891-8b23-4bc2-b75b-abf52ba0cfac service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.599346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9a8e3e2c-bea5-4b30-8665-dd634341603b req-cb6e6891-8b23-4bc2-b75b-abf52ba0cfac service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.613480 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9a8e3e2c-bea5-4b30-8665-dd634341603b req-cb6e6891-8b23-4bc2-b75b-abf52ba0cfac service nova] Creating event network-vif-deleted:24c3bbfe-097d-44dd-b015-ded002b7cd5e for instance f37efb1e-42bf-4d0f-8311-b4254fa2ce71 on nch2-master-1 Nov 27 20:51:27.619479 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9a8e3e2c-bea5-4b30-8665-dd634341603b req-cb6e6891-8b23-4bc2-b75b-abf52ba0cfac service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035670 Nov 27 20:51:27.620636 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 900/1752] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:27.669883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:27.679846 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42715290-1fa7-43c2-9273-ba251efa6409 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1469 microversion: 2.1 time: 0.471676 Nov 27 20:51:27.684872 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 853/1753] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:27 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1469 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:27.739429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:27.741275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:27.759025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.759693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.760724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.761307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.818371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.819065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.823634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lazy-loading 'fault' on Instance uuid f37efb1e-42bf-4d0f-8311-b4254fa2ce71 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:27.836821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-921602e8-3d3c-49be-836a-7eeb3af4dac1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d9515c10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:27.916929 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-921602e8-3d3c-49be-836a-7eeb3af4dac1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.086122 Nov 27 20:51:27.917515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 854/1754] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:27 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:27.934169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:27.934794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:27.943714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.944490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.945505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:27.946202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:27.956761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:27.971046 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a1395265-0220-475f-a105-abb09f302f6c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 200 len: 1188 microversion: 2.1 time: 0.236842 Nov 27 20:51:27.973994 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 901/1755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:27 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 1188 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:28.050093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:28.065016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:28.067226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:28.068623 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7bdfa921-99de-4089-a322-ed94dee9ff1f tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.138436 Nov 27 20:51:28.081516 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 855/1756] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:27 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:28.218819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e2d47a1-ddf2-4032-b926-8454b3cae0c3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:28.221627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e2d47a1-ddf2-4032-b926-8454b3cae0c3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:28.234275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2d47a1-ddf2-4032-b926-8454b3cae0c3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.236772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2d47a1-ddf2-4032-b926-8454b3cae0c3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.238135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2d47a1-ddf2-4032-b926-8454b3cae0c3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.239703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2d47a1-ddf2-4032-b926-8454b3cae0c3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.312883 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e2d47a1-ddf2-4032-b926-8454b3cae0c3 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.098445 Nov 27 20:51:28.313557 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 902/1757] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:28 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:28.456276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:28.459475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:28.469942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.472988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.474157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.476409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.596493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dea0c91b-efcf-41d2-982d-ba687dc7bd96 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:28.597909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dea0c91b-efcf-41d2-982d-ba687dc7bd96 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:28.632471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dea0c91b-efcf-41d2-982d-ba687dc7bd96 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.634542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dea0c91b-efcf-41d2-982d-ba687dc7bd96 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.636073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dea0c91b-efcf-41d2-982d-ba687dc7bd96 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.636586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dea0c91b-efcf-41d2-982d-ba687dc7bd96 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.698913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:28.707234 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dea0c91b-efcf-41d2-982d-ba687dc7bd96 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 16397 microversion: 2.1 time: 0.117544 Nov 27 20:51:28.708814 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 903/1758] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:28 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 16397 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:28.712309 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48491875-a847-4e87-9b61-b9c488ad1e2c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.260878 Nov 27 20:51:28.712902 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 856/1759] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:28 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:28.728898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:28.729619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:28.737814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.738495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.739533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:28.740591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:28.929829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e467bede-38d0-4b03-b1b3-16022a1879a7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c7355700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:28.937727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:28.948242 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04f9bf21-c2e6-4dcf-bf06-26fffb41f57f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1469 microversion: 2.1 time: 0.237104 Nov 27 20:51:28.949545 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 904/1760] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:28 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:28.990550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:28.991572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: f37efb1e-42bf-4d0f-8311-b4254fa2ce71] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:29.000625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.002074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.003170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.003883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.010646 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e467bede-38d0-4b03-b1b3-16022a1879a7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.084022 Nov 27 20:51:29.011770 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 857/1761] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:28 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:29.020129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] HTTP exception thrown: Instance f37efb1e-42bf-4d0f-8311-b4254fa2ce71 could not be found. Nov 27 20:51:29.021155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Returning 404 to user: Instance f37efb1e-42bf-4d0f-8311-b4254fa2ce71 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:29.022142 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9fb967cf-2596-42e6-9c29-c19023827fa1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71" status: 404 len: 111 microversion: 2.1 time: 0.036978 Nov 27 20:51:29.026350 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 905/1762] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:28 2021] GET /compute/v2.1/servers/f37efb1e-42bf-4d0f-8311-b4254fa2ce71 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:29.098101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:29.100643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:29.116234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.117880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.126052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.127568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.245562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:29.257207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:29.263671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:29.265856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bab4f431-d171-449c-bd2f-da4d81263f76 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.181191 Nov 27 20:51:29.267024 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 858/1763] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:29 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:29.326191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-38fc5882-b477-43c0-806f-ff542ce05508 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:29.328324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-38fc5882-b477-43c0-806f-ff542ce05508 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:29.354944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38fc5882-b477-43c0-806f-ff542ce05508 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.355491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38fc5882-b477-43c0-806f-ff542ce05508 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.356297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38fc5882-b477-43c0-806f-ff542ce05508 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.356739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38fc5882-b477-43c0-806f-ff542ce05508 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.488610 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-38fc5882-b477-43c0-806f-ff542ce05508 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.165799 Nov 27 20:51:29.489803 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 906/1764] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:29 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:29.738902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a444a27-d1e5-4b18-89ba-e92aa632c20e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:29.740200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:29.741126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:29.744377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a444a27-d1e5-4b18-89ba-e92aa632c20e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:29.753492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.754364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.755368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.755955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a444a27-d1e5-4b18-89ba-e92aa632c20e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.756189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.756646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a444a27-d1e5-4b18-89ba-e92aa632c20e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.757567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a444a27-d1e5-4b18-89ba-e92aa632c20e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.758123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a444a27-d1e5-4b18-89ba-e92aa632c20e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.813068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a444a27-d1e5-4b18-89ba-e92aa632c20e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 16397 microversion: 2.1 time: 0.097868 Nov 27 20:51:29.818559 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 859/1765] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:29 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 16397 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:29.964160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:29.966694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:29.967477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:29.976888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.977580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:29.979829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:29.987675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.002723 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a175d93c-032a-4aea-b7e3-c3af9c41ef55 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.274363 Nov 27 20:51:30.005508 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 907/1766] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:29 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:30.025820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f0f8370-0ed8-483f-83bb-9c44b85fe325 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c74cf790>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:30.122280 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f0f8370-0ed8-483f-83bb-9c44b85fe325 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.100633 Nov 27 20:51:30.130293 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 908/1767] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:30 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:30.192749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:30.201156 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02e68ec6-6b6e-431c-bae6-aa1b74f2506f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1469 microversion: 2.1 time: 0.238660 Nov 27 20:51:30.202781 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 860/1768] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:29 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:30.227904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:30.228408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:30.245970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.246427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.247236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.247677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.286141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:30.286989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:30.289334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:30.295234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.296137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.297160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.297934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.370920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:30.382052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:30.384307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:30.385635 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5809b4ec-8d48-40b8-a7aa-30246c060001 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.103796 Nov 27 20:51:30.401696 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 861/1769] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:30 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:51:30.428203 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5293a413-cb82-46a0-8c00-e435fb18ae84 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "DELETE /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 204 len: 0 microversion: 2.1 time: 0.204442 Nov 27 20:51:30.432745 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 909/1770] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:30 2021] DELETE /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:30.437248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:30.437848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:30.452235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.452680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.453660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.454086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.501235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa32e865-642f-4456-950f-4f295ba9dcf4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:30.502801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa32e865-642f-4456-950f-4f295ba9dcf4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:30.522502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa32e865-642f-4456-950f-4f295ba9dcf4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.522961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa32e865-642f-4456-950f-4f295ba9dcf4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.534611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa32e865-642f-4456-950f-4f295ba9dcf4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.535110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa32e865-642f-4456-950f-4f295ba9dcf4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.642858 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa32e865-642f-4456-950f-4f295ba9dcf4 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.145521 Nov 27 20:51:30.644111 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 910/1771] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:30 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:30.678138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:30.695070 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4cce1f02-d9ac-47fb-ba11-182149d50f30 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1500 microversion: 2.1 time: 0.261316 Nov 27 20:51:30.695704 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 862/1772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:30 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1500 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:30.817112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1829626516", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:30.826260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46c53c3e-353a-4a8f-a394-332c611014fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:30.827659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46c53c3e-353a-4a8f-a394-332c611014fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:30.835889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46c53c3e-353a-4a8f-a394-332c611014fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.836728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46c53c3e-353a-4a8f-a394-332c611014fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.838596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46c53c3e-353a-4a8f-a394-332c611014fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:30.839172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46c53c3e-353a-4a8f-a394-332c611014fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:30.889425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:51:30.918263 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46c53c3e-353a-4a8f-a394-332c611014fe tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 16397 microversion: 2.1 time: 0.096548 Nov 27 20:51:30.926350 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 863/1773] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:30 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 16397 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:31.025776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:31.026817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:31.034823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.035764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.036755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.037441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.205469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:51:31.205903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:51:31.206383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:51:31.206794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:51:31.207201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:51:31.227270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.228008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.229066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.229663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.273624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Getting quotas for project 7096bfbf5c8e42f09551e4c84ea8de02. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:51:31.278551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Getting quotas for user e39495438d7c40a780a68e2cf38d6ba2 and project 7096bfbf5c8e42f09551e4c84ea8de02. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:51:31.305848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:51:31.308686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:51:31.407696 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1f1b833-c577-4621-98b8-c7c458a49506 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761969 Nov 27 20:51:31.411049 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 911/1774] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:51:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:51:31.420030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c777f874-137b-4c69-b061-7fdd38e38a42 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c73cab80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:31.440398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:31.461965 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89e95ecf-c574-4435-ac6a-469a3969e9ab tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.439659 Nov 27 20:51:31.464019 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 864/1775] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:31 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:31.478029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:31.478664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:31.503589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.504033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.505062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.507144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.510896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c777f874-137b-4c69-b061-7fdd38e38a42 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.098579 Nov 27 20:51:31.511947 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 912/1776] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:31 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:31.516402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:31.520667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:31.541882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.542465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.543412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.543958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.675966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:31.686371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:31.694225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:31.695585 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c7ace45f-09b2-49e8-b56a-e2c3208b5c2b tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.182481 Nov 27 20:51:31.707928 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 913/1777] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:31 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:31.712639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7868d1b8-d111-47a7-94cf-387bbf9c9958 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:31.713368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7868d1b8-d111-47a7-94cf-387bbf9c9958 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:31.836949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7868d1b8-d111-47a7-94cf-387bbf9c9958 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:31.870703 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7868d1b8-d111-47a7-94cf-387bbf9c9958 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1214 microversion: 2.1 time: 0.161540 Nov 27 20:51:31.872583 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 914/1778] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:31 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:31.879120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f76045eb-0e52-4bf0-aaea-d4b87868173b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:31.880466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f76045eb-0e52-4bf0-aaea-d4b87868173b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:31.886169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:31.890185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f76045eb-0e52-4bf0-aaea-d4b87868173b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.890929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f76045eb-0e52-4bf0-aaea-d4b87868173b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.893115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f76045eb-0e52-4bf0-aaea-d4b87868173b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.894370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f76045eb-0e52-4bf0-aaea-d4b87868173b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.898545 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c3acc7d5-d9fe-4b60-8564-b482d1ec0b7e tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1469 microversion: 2.1 time: 0.433420 Nov 27 20:51:31.912888 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 865/1779] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:31 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1469 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:31.920297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:31.920928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:31.928726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.929676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.930827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:31.931528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:31.977753 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f76045eb-0e52-4bf0-aaea-d4b87868173b tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.103007 Nov 27 20:51:31.978714 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 915/1780] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:31 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:31.994403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-458d1b25-1a7d-47b2-91f4-7d3c7a30f950 req-0578155f-fd99-431b-b1aa-7d43dd88a3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "name": "network-vif-unplugged", "status": "completed", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:31.996484 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:31.996484 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:32.013439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-458d1b25-1a7d-47b2-91f4-7d3c7a30f950 req-0578155f-fd99-431b-b1aa-7d43dd88a3f2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.014241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-458d1b25-1a7d-47b2-91f4-7d3c7a30f950 req-0578155f-fd99-431b-b1aa-7d43dd88a3f2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.041218 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-458d1b25-1a7d-47b2-91f4-7d3c7a30f950 req-0578155f-fd99-431b-b1aa-7d43dd88a3f2 service nova] Creating event network-vif-unplugged:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch1-master-1 Nov 27 20:51:32.055871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-458d1b25-1a7d-47b2-91f4-7d3c7a30f950 req-0578155f-fd99-431b-b1aa-7d43dd88a3f2 service nova] Instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:51:32.071726 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-458d1b25-1a7d-47b2-91f4-7d3c7a30f950 req-0578155f-fd99-431b-b1aa-7d43dd88a3f2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091353 Nov 27 20:51:32.072652 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 916/1781] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:32.083883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f1bb8b7-f764-4e8f-8e50-a9ddecbb47d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:32.085073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f1bb8b7-f764-4e8f-8e50-a9ddecbb47d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:32.098534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f1bb8b7-f764-4e8f-8e50-a9ddecbb47d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.099290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f1bb8b7-f764-4e8f-8e50-a9ddecbb47d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.100378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f1bb8b7-f764-4e8f-8e50-a9ddecbb47d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.101046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f1bb8b7-f764-4e8f-8e50-a9ddecbb47d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.184171 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f1bb8b7-f764-4e8f-8e50-a9ddecbb47d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 16397 microversion: 2.1 time: 0.109761 Nov 27 20:51:32.192379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 917/1782] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:32 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 16397 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:32.252520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:32.266308 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d99800c2-bb5b-45ec-928e-d37e9a3a06d0 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 200 len: 1458 microversion: 2.1 time: 0.351970 Nov 27 20:51:32.267614 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 866/1783] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:31 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 1458 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:32.344040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-08fe9946-44b2-4023-94b5-f1c91d531562 req-e2cc21f1-a2a2-4e5d-95af-d01c1eff7778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96245ad6-b6b6-4017-aff5-81689a46b3a3", "name": "network-vif-deleted", "tag": "91a3e20c-c74b-4366-a10a-a264f88012cb"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:32.346312 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:32.346312 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:32.390624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-08fe9946-44b2-4023-94b5-f1c91d531562 req-e2cc21f1-a2a2-4e5d-95af-d01c1eff7778 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.391076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-08fe9946-44b2-4023-94b5-f1c91d531562 req-e2cc21f1-a2a2-4e5d-95af-d01c1eff7778 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.414276 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-08fe9946-44b2-4023-94b5-f1c91d531562 req-e2cc21f1-a2a2-4e5d-95af-d01c1eff7778 service nova] Creating event network-vif-deleted:91a3e20c-c74b-4366-a10a-a264f88012cb for instance 96245ad6-b6b6-4017-aff5-81689a46b3a3 on nch1-master-1 Nov 27 20:51:32.424379 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-08fe9946-44b2-4023-94b5-f1c91d531562 req-e2cc21f1-a2a2-4e5d-95af-d01c1eff7778 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085010 Nov 27 20:51:32.433114 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 918/1784] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:32.480947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:32.488808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:32.507360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.509445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.510430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.511024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.525924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-073faaae-c87f-431a-bf34-9a0c68d4d1c1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c73cfee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:32.605710 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-073faaae-c87f-431a-bf34-9a0c68d4d1c1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.085088 Nov 27 20:51:32.615953 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 919/1785] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:32 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:32.707092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:32.715680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:32.716707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:32.719857 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-50c0377c-d253-4e50-a6d3-3328dc45e607 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.242016 Nov 27 20:51:32.722160 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 867/1786] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:32 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:32.727591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.727591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.728746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.729305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.811504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:32.822186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:32.823790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:32.825910 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-18cd61b4-6f29-4312-bb0c-54240d5b95c0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.114726 Nov 27 20:51:32.826993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 920/1787] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:32 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:32.889922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:32.890936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:32.897547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.898070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.900474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.901157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.917482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:32.918666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:32.930121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.930591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:32.931436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:32.931881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.013889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:33.021768 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95ca921c-c005-469b-840d-8814670da1ee tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1210 microversion: 2.1 time: 0.136454 Nov 27 20:51:33.033960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 868/1788] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:32 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:33.039198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8dd38cda-bb95-4583-8aa7-3bed712478dd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:33.040840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8dd38cda-bb95-4583-8aa7-3bed712478dd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:33.047543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dd38cda-bb95-4583-8aa7-3bed712478dd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.048984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dd38cda-bb95-4583-8aa7-3bed712478dd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.050017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dd38cda-bb95-4583-8aa7-3bed712478dd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.050771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dd38cda-bb95-4583-8aa7-3bed712478dd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.099514 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8dd38cda-bb95-4583-8aa7-3bed712478dd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.063927 Nov 27 20:51:33.101009 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 869/1789] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:33 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:33.204631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73025ea5-c29d-4422-a724-44801b917668 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:33.206015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-73025ea5-c29d-4422-a724-44801b917668 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:33.215974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73025ea5-c29d-4422-a724-44801b917668 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.216570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73025ea5-c29d-4422-a724-44801b917668 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.217727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73025ea5-c29d-4422-a724-44801b917668 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.218240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73025ea5-c29d-4422-a724-44801b917668 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.222920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:33.236446 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d30dade-083b-49e6-a85d-9dcf50505e85 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1469 microversion: 2.1 time: 0.322636 Nov 27 20:51:33.237300 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 921/1790] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:32 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:33.280852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73025ea5-c29d-4422-a724-44801b917668 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.080687 Nov 27 20:51:33.281726 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 870/1791] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:33 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:33.285298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:33.285911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 96245ad6-b6b6-4017-aff5-81689a46b3a3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:33.295706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.296454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.297453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.298659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.312821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] HTTP exception thrown: Instance 96245ad6-b6b6-4017-aff5-81689a46b3a3 could not be found. Nov 27 20:51:33.313912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Returning 404 to user: Instance 96245ad6-b6b6-4017-aff5-81689a46b3a3 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:33.315035 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4be22171-4198-4298-84c8-8b779bd042b3 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3" status: 404 len: 111 microversion: 2.1 time: 0.034310 Nov 27 20:51:33.316011 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 922/1792] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:33 2021] GET /compute/v2.1/servers/96245ad6-b6b6-4017-aff5-81689a46b3a3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:51:33.326169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:33.327498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:33.335937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.336664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.337666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.338268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.376258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:33.484452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-758c9570-733a-48c7-a79d-8dde695c4e90 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 204 len: 0 microversion: 2.1 time: 0.162955 Nov 27 20:51:33.485123 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 871/1793] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:33 2021] DELETE /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:33.494626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:33.495502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:33.502760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.503291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.504131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.505251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.624946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1da6ee3-add8-47a9-90a9-d4a4325384e6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94bd700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:33.699775 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1da6ee3-add8-47a9-90a9-d4a4325384e6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.079157 Nov 27 20:51:33.718331 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 872/1794] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:33 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:33.737263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:33.749449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:33.756762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.758215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.760198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.760855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.785258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:33.793255 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4d3d082-f790-4c28-ac5d-c6c8b1a47662 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1485 microversion: 2.1 time: 0.303267 Nov 27 20:51:33.803780 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 923/1795] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:33 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1485 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:33.847194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:33.848142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:33.854852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.855441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.856481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:33.857143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:33.969264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:33.977773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:33.979321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:33.980523 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5071adf-91a3-465c-a63e-1afb46c5ffc6 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.139278 Nov 27 20:51:33.981333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 924/1796] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:33 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:51:33.993352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:34.001651 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b56d9b9-6e9e-4929-a143-1f151fdd1fb7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.267637 Nov 27 20:51:34.002944 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 873/1797] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:33 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:34.048588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:34.049361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:34.056169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.056626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.057432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.057870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.091616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fbaaf2e7-8ce2-45c7-bece-6ef793a31f2f req-d8f71da3-64ad-4bc5-9080-82bc386bc8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:34.093244 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:34.093244 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:34.106184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fbaaf2e7-8ce2-45c7-bece-6ef793a31f2f req-d8f71da3-64ad-4bc5-9080-82bc386bc8a4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.106448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fbaaf2e7-8ce2-45c7-bece-6ef793a31f2f req-d8f71da3-64ad-4bc5-9080-82bc386bc8a4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.122935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fbaaf2e7-8ce2-45c7-bece-6ef793a31f2f req-d8f71da3-64ad-4bc5-9080-82bc386bc8a4 service nova] Creating event network-changed:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch1-master-1 Nov 27 20:51:34.130446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-fbaaf2e7-8ce2-45c7-bece-6ef793a31f2f req-d8f71da3-64ad-4bc5-9080-82bc386bc8a4 service nova] Instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 20:51:34.151037 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fbaaf2e7-8ce2-45c7-bece-6ef793a31f2f req-d8f71da3-64ad-4bc5-9080-82bc386bc8a4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064833 Nov 27 20:51:34.153423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 874/1798] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:51:34.162502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-961ff9e6-e172-4c8a-bcc3-e4b54c610b0f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:34.164132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-961ff9e6-e172-4c8a-bcc3-e4b54c610b0f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:34.192642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-961ff9e6-e172-4c8a-bcc3-e4b54c610b0f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.193545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-961ff9e6-e172-4c8a-bcc3-e4b54c610b0f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.194805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-961ff9e6-e172-4c8a-bcc3-e4b54c610b0f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.195501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-961ff9e6-e172-4c8a-bcc3-e4b54c610b0f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.232209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:34.253306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-961ff9e6-e172-4c8a-bcc3-e4b54c610b0f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.098121 Nov 27 20:51:34.254290 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 875/1799] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:34 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:34.255631 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-254bfe19-dff1-4e63-8fd4-51af8a7a1d82 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1272 microversion: 2.1 time: 0.219491 Nov 27 20:51:34.261701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:34.262885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:34.265780 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 925/1800] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:34 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:34.271901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.272964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.274009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.274799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.294278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-084d5196-dbc7-40bd-a47e-87bab57ab563 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:34.295952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-084d5196-dbc7-40bd-a47e-87bab57ab563 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:34.306746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084d5196-dbc7-40bd-a47e-87bab57ab563 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.315493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084d5196-dbc7-40bd-a47e-87bab57ab563 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.316508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084d5196-dbc7-40bd-a47e-87bab57ab563 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.317058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084d5196-dbc7-40bd-a47e-87bab57ab563 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.374166 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-084d5196-dbc7-40bd-a47e-87bab57ab563 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.083961 Nov 27 20:51:34.379086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 926/1801] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:34 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:34.714178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-914ba333-7cd9-4a54-8ec3-95ba8a29dde3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c738d5e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:34.766251 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-914ba333-7cd9-4a54-8ec3-95ba8a29dde3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1423 microversion: 2.1 time: 0.056039 Nov 27 20:51:34.773569 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 927/1802] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:34 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1423 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:34.811522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:34.813066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:34.833917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.835440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:34.838273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:34.839567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.099888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:35.108810 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-add24a48-a9d5-4a11-9db9-d5dbae776941 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1469 microversion: 2.1 time: 0.853127 Nov 27 20:51:35.119763 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 876/1803] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:34 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1469 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:35.124747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:35.125554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:35.140050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.140882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.141882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.142990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.231996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:35.258509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bcf65b1d-4509-49bb-8598-730dbf3564f1 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 200 len: 1485 microversion: 2.1 time: 0.451166 Nov 27 20:51:35.263526 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 928/1804] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:34 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 1485 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:35.283337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:35.283968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:35.315358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.315974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.316884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.318752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.351222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:35.367979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:35.369509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:35.373470 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d674f8e7-8a77-49cd-8147-10a25e6fdd89 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.252347 Nov 27 20:51:35.374281 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 877/1805] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:35 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:35.386377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c950ca35-ea1d-4419-a380-d2204193139f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:35.389077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c950ca35-ea1d-4419-a380-d2204193139f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:35.413002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c950ca35-ea1d-4419-a380-d2204193139f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.414432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c950ca35-ea1d-4419-a380-d2204193139f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.417059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c950ca35-ea1d-4419-a380-d2204193139f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.418553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c950ca35-ea1d-4419-a380-d2204193139f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.498548 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c950ca35-ea1d-4419-a380-d2204193139f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.122027 Nov 27 20:51:35.500081 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 878/1806] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:35 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:35.510621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:35.511494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:35.522913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.523345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.524208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.524720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.789704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:35.797268 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-213cd5e3-e6ba-4c85-bf77-2d35d4dd24c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.532345 Nov 27 20:51:35.797791 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 929/1807] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:35 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:35.804049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06635da8-3bf4-4868-a84d-1988c0238291 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:35.805289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06635da8-3bf4-4868-a84d-1988c0238291 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:35.812342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06635da8-3bf4-4868-a84d-1988c0238291 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.813152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06635da8-3bf4-4868-a84d-1988c0238291 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.814830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06635da8-3bf4-4868-a84d-1988c0238291 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:35.815494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06635da8-3bf4-4868-a84d-1988c0238291 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:35.866786 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06635da8-3bf4-4868-a84d-1988c0238291 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.067204 Nov 27 20:51:35.868595 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 930/1808] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:35 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:35.873536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a62aa9f-7d34-4661-8617-55ce9370fbd1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c738b820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:35.929434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a62aa9f-7d34-4661-8617-55ce9370fbd1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1432 microversion: 2.1 time: 0.059634 Nov 27 20:51:35.937361 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 931/1809] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:35 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1432 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:35.944459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cc07ba7c-b87a-49cd-86d2-90dc58eec21f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c739a310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.001629 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cc07ba7c-b87a-49cd-86d2-90dc58eec21f tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 200 len: 1432 microversion: 2.1 time: 0.062376 Nov 27 20:51:36.002224 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 932/1810] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:35 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 1432 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:36.013968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.014705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.021877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.022585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.024927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.025568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.040581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:36.051299 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92e0c8a2-fb65-4884-8602-e173bc476135 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.549004 Nov 27 20:51:36.051887 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 879/1811] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:35 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:36.128678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.129720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.138408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.141834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.145166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.145841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.406399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:36.417343 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d336d99f-3be0-49cb-8f5b-eaa3d33f6168 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1462 microversion: 2.1 time: 0.292786 Nov 27 20:51:36.417985 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 880/1812] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1462 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:36.429194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:36.434321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-90d7d516-1d1a-40e7-8d5c-2c49bba14d1d req-f5e022f8-1476-4a9a-90b7-b737cb35be7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4389e3d2-cc9e-40e6-8a2f-d59d54421ab9", "name": "network-vif-deleted", "tag": "b51ad6c9-008a-470c-b58c-4307b66fbeca"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:36.435932 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:36.435932 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:36.437840 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a37266ef-94aa-40f3-81af-91ec0f4284f0 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1465 microversion: 2.1 time: 0.427657 Nov 27 20:51:36.439284 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 933/1813] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1465 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:36.444065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.444836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.450076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-90d7d516-1d1a-40e7-8d5c-2c49bba14d1d req-f5e022f8-1476-4a9a-90b7-b737cb35be7f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.450675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-90d7d516-1d1a-40e7-8d5c-2c49bba14d1d req-f5e022f8-1476-4a9a-90b7-b737cb35be7f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.451576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.452183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.453130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.453721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.464062 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-90d7d516-1d1a-40e7-8d5c-2c49bba14d1d req-f5e022f8-1476-4a9a-90b7-b737cb35be7f service nova] Creating event network-vif-deleted:b51ad6c9-008a-470c-b58c-4307b66fbeca for instance 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 on nch2-master-1 Nov 27 20:51:36.469074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-90d7d516-1d1a-40e7-8d5c-2c49bba14d1d req-f5e022f8-1476-4a9a-90b7-b737cb35be7f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038911 Nov 27 20:51:36.469668 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] HTTP exception thrown: Instance 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 could not be found. Nov 27 20:51:36.470049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 881/1814] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:36.470426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Returning 404 to user: Instance 4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:36.471343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08dd8dbf-4c47-475c-9c75-5cbf286124ff tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9" status: 404 len: 111 microversion: 2.1 time: 0.030975 Nov 27 20:51:36.474756 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 934/1815] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/servers/4389e3d2-cc9e-40e6-8a2f-d59d54421ab9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:36.475214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.476511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.492274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.492893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.493694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.494131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.573716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:36.586013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:36.587587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:36.588916 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16e0c57f-240c-4331-9a21-f6a24735b4c4 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.117786 Nov 27 20:51:36.589855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 882/1816] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:36.599344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9eb11ad1-0427-448f-b2a1-6a4a1873e35b tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94de9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.649669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed16f83f-122a-4b49-8bf6-2dfde1d98af3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.651156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed16f83f-122a-4b49-8bf6-2dfde1d98af3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.653833 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9eb11ad1-0427-448f-b2a1-6a4a1873e35b tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8" status: 200 len: 784 microversion: 2.1 time: 0.063017 Nov 27 20:51:36.654669 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 883/1817] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8 => generated 784 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:36.659754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.660253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.660953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16f83f-122a-4b49-8bf6-2dfde1d98af3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.661599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16f83f-122a-4b49-8bf6-2dfde1d98af3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.662871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16f83f-122a-4b49-8bf6-2dfde1d98af3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.663533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16f83f-122a-4b49-8bf6-2dfde1d98af3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.666488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.666938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.668688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.668688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.697535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:36.777915 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f3dde97-85ab-4c0a-9851-c1a92639bb92 tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "DELETE /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 204 len: 0 microversion: 2.1 time: 0.122123 Nov 27 20:51:36.778666 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 884/1818] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:36 2021] DELETE /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:36.785711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99c03104-d8d5-46f7-be5f-1ef6caa0b7e9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:36.786770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99c03104-d8d5-46f7-be5f-1ef6caa0b7e9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.792730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99c03104-d8d5-46f7-be5f-1ef6caa0b7e9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.793208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99c03104-d8d5-46f7-be5f-1ef6caa0b7e9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.794035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99c03104-d8d5-46f7-be5f-1ef6caa0b7e9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.794495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99c03104-d8d5-46f7-be5f-1ef6caa0b7e9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.840989 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99c03104-d8d5-46f7-be5f-1ef6caa0b7e9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.060815 Nov 27 20:51:36.843266 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 885/1819] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:36 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:36.847272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-414cf8fc-b26c-413a-a9af-a8d17c51fac9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.854865 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed16f83f-122a-4b49-8bf6-2dfde1d98af3 tempest-MigrationsAdminTest-1097371384 tempest-MigrationsAdminTest-1097371384-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1613 microversion: 2.1 time: 0.381905 Nov 27 20:51:36.855912 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 935/1820] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1613 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:36.858551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-414cf8fc-b26c-413a-a9af-a8d17c51fac9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015627 Nov 27 20:51:36.859123 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 886/1821] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:36.861832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.862747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.869708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.870442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.870841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:36.871736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.871858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:36.872720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.881989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.882446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:36.883348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:36.883845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.022258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:37.030100 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-019dd30a-6e51-4501-b59e-8b5e96e9df14 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.169950 Nov 27 20:51:37.030692 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 887/1822] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:37.035756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29aef33b-ff3f-49a1-835a-798c7943edad tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d9515c10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:37.382399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:37.391495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1565965-ccba-4c12-9e0a-6dda3f4bfbdc tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1501 microversion: 2.1 time: 0.534374 Nov 27 20:51:37.402492 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 936/1823] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:36 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1501 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:37.410999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:37.411522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:37.418734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.419191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.420019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.420456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.449492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:37.538841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-56375d7a-69d2-4cb3-a432-c04e6fa6fa40 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 204 len: 0 microversion: 2.1 time: 0.134597 Nov 27 20:51:37.539671 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 937/1824] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:37 2021] DELETE /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:37.548966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc9cceb6-33e1-4047-88ad-6be1b4427b6c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:37.550049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc9cceb6-33e1-4047-88ad-6be1b4427b6c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:37.556440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9cceb6-33e1-4047-88ad-6be1b4427b6c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.556929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9cceb6-33e1-4047-88ad-6be1b4427b6c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.557791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9cceb6-33e1-4047-88ad-6be1b4427b6c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.558226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9cceb6-33e1-4047-88ad-6be1b4427b6c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.600037 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29aef33b-ff3f-49a1-835a-798c7943edad tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "DELETE /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 204 len: 0 microversion: 2.1 time: 0.568288 Nov 27 20:51:37.600611 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 888/1825] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:37 2021] DELETE /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:37.605399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:37.605947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:37.608482 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc9cceb6-33e1-4047-88ad-6be1b4427b6c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.066719 Nov 27 20:51:37.609141 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 938/1826] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:37 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:37.614578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.615127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.616020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.616263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:37.616880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.617016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:37.623624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.624089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.624857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.625294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.766378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:37.774495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0adfa4c3-454d-49c9-bb7a-d6803169deb3 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1468 microversion: 2.1 time: 0.164267 Nov 27 20:51:37.775118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 939/1827] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:37 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:37.780274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:37.780874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:37.787340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.787796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.788572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.789102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.839469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:37.849285 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f1a65344-5007-4f07-ae7c-8bb447db27f6 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.247612 Nov 27 20:51:37.851528 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 889/1828] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:37 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:37.859604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28b2b024-1027-42c2-be49-a371868ee481 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94bdc10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:37.864519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:37.878232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:37.881466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:37.882924 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73faae31-f972-4fab-bf7c-d102ac4020e5 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.106803 Nov 27 20:51:37.883672 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 940/1829] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:37 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:37.889029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da3dbcf9-ea72-40f7-b508-00d702cf8f81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:37.890142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da3dbcf9-ea72-40f7-b508-00d702cf8f81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:37.897125 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-28b2b024-1027-42c2-be49-a371868ee481 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] HTTP exception thrown: Image not found. Nov 27 20:51:37.897302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3dbcf9-ea72-40f7-b508-00d702cf8f81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.897574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3dbcf9-ea72-40f7-b508-00d702cf8f81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.898250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28b2b024-1027-42c2-be49-a371868ee481 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:37.898399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3dbcf9-ea72-40f7-b508-00d702cf8f81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.898758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3dbcf9-ea72-40f7-b508-00d702cf8f81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.900369 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28b2b024-1027-42c2-be49-a371868ee481 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 404 len: 62 microversion: 2.1 time: 0.048144 Nov 27 20:51:37.901387 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 890/1830] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:37 2021] GET /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:51:37.916210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98639721-a3c3-4dc9-8c46-d982d2a9ffb3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1007751856"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:37.917581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98639721-a3c3-4dc9-8c46-d982d2a9ffb3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:37.926010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98639721-a3c3-4dc9-8c46-d982d2a9ffb3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.926459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98639721-a3c3-4dc9-8c46-d982d2a9ffb3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:37.927485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98639721-a3c3-4dc9-8c46-d982d2a9ffb3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:37.927927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98639721-a3c3-4dc9-8c46-d982d2a9ffb3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.183658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da3dbcf9-ea72-40f7-b508-00d702cf8f81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.298191 Nov 27 20:51:38.184512 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 941/1831] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:37 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:38.190550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:38.191420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:38.198201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.198647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.199449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.199915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.227940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98639721-a3c3-4dc9-8c46-d982d2a9ffb3 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "POST /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05/action" status: 202 len: 0 microversion: 2.1 time: 0.315577 Nov 27 20:51:38.228566 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 891/1832] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:37 2021] POST /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:51:38.233335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-59a70e9e-5af1-403f-9fc2-729e0257d1c3 req-37dca5c0-3245-46c4-98f5-4ca23af7b359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f4ea83-2296-4bfd-b8ca-fbc2e03738c3", "name": "network-vif-deleted", "tag": "bb36450b-f6f8-40a8-b587-c2c25520c90d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:38.235144 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:38.235144 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:38.243939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-59a70e9e-5af1-403f-9fc2-729e0257d1c3 req-37dca5c0-3245-46c4-98f5-4ca23af7b359 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.244534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-59a70e9e-5af1-403f-9fc2-729e0257d1c3 req-37dca5c0-3245-46c4-98f5-4ca23af7b359 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.259035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-59a70e9e-5af1-403f-9fc2-729e0257d1c3 req-37dca5c0-3245-46c4-98f5-4ca23af7b359 service nova] Creating event network-vif-deleted:bb36450b-f6f8-40a8-b587-c2c25520c90d for instance 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 on nch2-master-1 Nov 27 20:51:38.264429 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-59a70e9e-5af1-403f-9fc2-729e0257d1c3 req-37dca5c0-3245-46c4-98f5-4ca23af7b359 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034207 Nov 27 20:51:38.265453 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 892/1833] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:38.270312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-393dafb4-eb7f-4f3a-b62f-662eb92dc741 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d9522700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:38.319811 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-393dafb4-eb7f-4f3a-b62f-662eb92dc741 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.053185 Nov 27 20:51:38.320368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 893/1834] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:38 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:38.338061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:38.345707 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ab00731-92dc-4b65-b222-e1a6bf1cb145 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.159648 Nov 27 20:51:38.346252 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 942/1835] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:38 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:38.409714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:38.410339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:38.416446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.416894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.417670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.418097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.449755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.450201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.450640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lazy-loading 'fault' on Instance uuid 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:38.488907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-376b769f-4566-4b34-b7c4-409454297b1c req-a0e9cde9-7f75-49ef-a803-8ef0264c2b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273a67c6-4e11-45b2-b200-51b12af5f0b8", "tag": "d81663c4-56ef-44e4-ad69-a01fa20b6b99"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:38.491504 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:38.491504 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:38.493003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d46c71936aa4118aa36a9e95b95c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149906b8a2744176929b4d314a0de57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:38.499948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-376b769f-4566-4b34-b7c4-409454297b1c req-a0e9cde9-7f75-49ef-a803-8ef0264c2b4c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.500511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-376b769f-4566-4b34-b7c4-409454297b1c req-a0e9cde9-7f75-49ef-a803-8ef0264c2b4c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.500733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34eed214-fbed-46f7-9d43-674f49f0550c tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 200 len: 1301 microversion: 2.1 time: 0.095201 Nov 27 20:51:38.501473 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 894/1836] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:38 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:38.526063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-376b769f-4566-4b34-b7c4-409454297b1c req-a0e9cde9-7f75-49ef-a803-8ef0264c2b4c service nova] Creating event network-changed:d81663c4-56ef-44e4-ad69-a01fa20b6b99 for instance 273a67c6-4e11-45b2-b200-51b12af5f0b8 on nch1-master-1 Nov 27 20:51:38.531445 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-376b769f-4566-4b34-b7c4-409454297b1c req-a0e9cde9-7f75-49ef-a803-8ef0264c2b4c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047564 Nov 27 20:51:38.532857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 943/1837] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:51:38.620487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a860ee1c-f3b3-4b40-805d-b2fb4d7c3ed7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:38.621412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a860ee1c-f3b3-4b40-805d-b2fb4d7c3ed7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:38.627367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a860ee1c-f3b3-4b40-805d-b2fb4d7c3ed7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.627827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a860ee1c-f3b3-4b40-805d-b2fb4d7c3ed7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.628611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a860ee1c-f3b3-4b40-805d-b2fb4d7c3ed7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.629053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a860ee1c-f3b3-4b40-805d-b2fb4d7c3ed7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.684179 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a860ee1c-f3b3-4b40-805d-b2fb4d7c3ed7 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.067513 Nov 27 20:51:38.686201 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 895/1838] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:38 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:38.792216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:38.792899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:38.799111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.799665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.800478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.800957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.866635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:38.868166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:38.875974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.876770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:38.877707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:38.878313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.025809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:39.029832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:39.034543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4773ffcb-8ab2-4e8d-84d5-6ad84cc8cb44 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.172062 Nov 27 20:51:39.035120 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 896/1839] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:38 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:39.044163 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b42b491-2d38-4a8c-8155-fc8f666dd120 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1468 microversion: 2.1 time: 0.251514 Nov 27 20:51:39.044163 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 944/1840] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:38 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1468 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:39.044163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:39.044451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:39.050714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.051165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.052141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.052598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.146011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:39.156995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:39.158638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:39.159934 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ae66b3a-40ab-427a-8fe2-20fcde08b7a7 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.119411 Nov 27 20:51:39.160802 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 945/1841] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:39 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:39.194621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91d6f598-1f03-4965-b964-53c25a783543 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:39.195627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91d6f598-1f03-4965-b964-53c25a783543 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:39.203636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91d6f598-1f03-4965-b964-53c25a783543 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.204912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91d6f598-1f03-4965-b964-53c25a783543 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.205904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91d6f598-1f03-4965-b964-53c25a783543 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.206527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91d6f598-1f03-4965-b964-53c25a783543 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.247090 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91d6f598-1f03-4965-b964-53c25a783543 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.055865 Nov 27 20:51:39.250701 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 897/1842] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:39 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:39.300688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1fcb52cf-7aa4-4109-a3c0-8b64f7f7208b req-b9d4bd20-c4ce-4424-b097-d15e075b364b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "name": "network-vif-plugged", "status": "completed", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:39.302564 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:39.302564 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:39.310048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1fcb52cf-7aa4-4109-a3c0-8b64f7f7208b req-b9d4bd20-c4ce-4424-b097-d15e075b364b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.310498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1fcb52cf-7aa4-4109-a3c0-8b64f7f7208b req-b9d4bd20-c4ce-4424-b097-d15e075b364b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.322342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1fcb52cf-7aa4-4109-a3c0-8b64f7f7208b req-b9d4bd20-c4ce-4424-b097-d15e075b364b service nova] Creating event network-vif-plugged:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch1-master-1 Nov 27 20:51:39.327203 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1fcb52cf-7aa4-4109-a3c0-8b64f7f7208b req-b9d4bd20-c4ce-4424-b097-d15e075b364b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 Nov 27 20:51:39.327945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 946/1843] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:39.334570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3049fe63-44a7-47db-ba38-5a7220ffbf16 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94bd5e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:39.363102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:39.369528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:39.377018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.377469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.378433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.379145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.382104 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3049fe63-44a7-47db-ba38-5a7220ffbf16 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.052266 Nov 27 20:51:39.382684 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 898/1844] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:39 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:39.517844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:39.519522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] [instance: 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:39.529978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.531610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.534917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.539410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.568917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] HTTP exception thrown: Instance 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 could not be found. Nov 27 20:51:39.569681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] Returning 404 to user: Instance 76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:39.570710 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-109830de-080e-438f-ac2d-6ca15a733f0b tempest-LiveMigrationTest-292468335 tempest-LiveMigrationTest-292468335-project] 10.222.0.21 "GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3" status: 404 len: 111 microversion: 2.1 time: 0.056415 Nov 27 20:51:39.571111 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 899/1845] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:39 2021] GET /compute/v2.1/servers/76f4ea83-2296-4bfd-b8ca-fbc2e03738c3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:51:39.614237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:39.622216 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6314032c-98aa-4e4a-92e8-de8577f0e12b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.263344 Nov 27 20:51:39.622902 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 947/1846] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:39 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:39.696507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ba1af367-db4a-434e-bfff-a2a1eb5486ad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:39.698784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ba1af367-db4a-434e-bfff-a2a1eb5486ad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:39.705476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba1af367-db4a-434e-bfff-a2a1eb5486ad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.706029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba1af367-db4a-434e-bfff-a2a1eb5486ad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.707114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba1af367-db4a-434e-bfff-a2a1eb5486ad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:39.707742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba1af367-db4a-434e-bfff-a2a1eb5486ad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:39.749141 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ba1af367-db4a-434e-bfff-a2a1eb5486ad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.056059 Nov 27 20:51:39.750995 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 900/1847] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:39 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:40.052100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:40.053056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:40.056876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:40.057593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:40.065592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.066498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.068837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.069516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.075048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.075540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.076983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.077437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.221453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:40.234256 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bae6cf66-4af2-46b6-a8b4-cc0a5af4e045 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 200 len: 1298 microversion: 2.1 time: 0.181981 Nov 27 20:51:40.235033 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 901/1848] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:40 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 1298 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:40.241542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:40.242434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:40.252066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.252659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.254016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.254546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.349379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:40.360169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:40.361963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:40.363376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d645bf5-8ef4-41cc-bcf6-db79171b2193 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.126600 Nov 27 20:51:40.364423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 902/1849] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:40 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:40.369717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-baa0c14c-7d5c-475f-86e7-74a80b8e0a81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:40.370637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-baa0c14c-7d5c-475f-86e7-74a80b8e0a81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:40.376945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa0c14c-7d5c-475f-86e7-74a80b8e0a81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.377404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa0c14c-7d5c-475f-86e7-74a80b8e0a81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.378192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa0c14c-7d5c-475f-86e7-74a80b8e0a81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.378629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa0c14c-7d5c-475f-86e7-74a80b8e0a81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.410269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:40.419441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4bd86ec-09cf-476d-8721-8b8f38e5261a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.372419 Nov 27 20:51:40.431559 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-baa0c14c-7d5c-475f-86e7-74a80b8e0a81 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.065526 Nov 27 20:51:40.433259 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 903/1850] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:40 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:40.437731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 948/1851] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:40 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:40.439073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f0dc85e-234b-4679-ae16-1c9a5dbfdb9a tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c7fb0550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:40.491940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f0dc85e-234b-4679-ae16-1c9a5dbfdb9a tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.057199 Nov 27 20:51:40.492906 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 904/1852] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:40 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:40.546653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0160c1ba-9545-4262-ba56-76af83cdeb97 req-20b3ece4-2536-49b5-b705-29757526fba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157d971-eec0-4ccd-9c16-1ab1abac0ade", "name": "network-vif-deleted", "tag": "f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:40.548346 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:40.548346 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:40.555155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0160c1ba-9545-4262-ba56-76af83cdeb97 req-20b3ece4-2536-49b5-b705-29757526fba0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.555636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0160c1ba-9545-4262-ba56-76af83cdeb97 req-20b3ece4-2536-49b5-b705-29757526fba0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.566907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0160c1ba-9545-4262-ba56-76af83cdeb97 req-20b3ece4-2536-49b5-b705-29757526fba0 service nova] Creating event network-vif-deleted:f9f8d6d6-2378-47fb-b9d8-40b103ffe5b3 for instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade on nch1-master-1 Nov 27 20:51:40.571697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0160c1ba-9545-4262-ba56-76af83cdeb97 req-20b3ece4-2536-49b5-b705-29757526fba0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028643 Nov 27 20:51:40.572428 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 949/1853] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:40.639625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:40.640377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:40.647138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.647620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.648405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.648846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.762025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39f486d7-cbbe-4972-bb14-6f27719d05f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:40.763037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39f486d7-cbbe-4972-bb14-6f27719d05f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:40.770050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39f486d7-cbbe-4972-bb14-6f27719d05f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.770506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39f486d7-cbbe-4972-bb14-6f27719d05f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.771350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39f486d7-cbbe-4972-bb14-6f27719d05f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:40.771785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39f486d7-cbbe-4972-bb14-6f27719d05f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:40.815117 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39f486d7-cbbe-4972-bb14-6f27719d05f3 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.056857 Nov 27 20:51:40.816036 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 950/1854] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:40 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:40.860652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:40.868773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d32452a-aac4-4866-869e-3af5b255e2a9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.233342 Nov 27 20:51:40.869340 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 905/1855] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:40 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:41.253334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:41.254316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 4157d971-eec0-4ccd-9c16-1ab1abac0ade] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.262598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.263372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.264315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.265051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.280529 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] HTTP exception thrown: Instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade could not be found. Nov 27 20:51:41.281668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Returning 404 to user: Instance 4157d971-eec0-4ccd-9c16-1ab1abac0ade could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:41.283096 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb059e3e-91aa-4d6d-b1d8-c7c85b1630a7 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade" status: 404 len: 111 microversion: 2.1 time: 0.034696 Nov 27 20:51:41.283837 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 951/1856] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:41 2021] GET /compute/v2.1/servers/4157d971-eec0-4ccd-9c16-1ab1abac0ade => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:41.292266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:41.293007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.302122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.303216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.304485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.305081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.336814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:41.377749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-33f624c9-fa39-4812-8629-f55e85e59af9 req-e4f296d6-7226-4fec-81e9-0198dd7bd939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cac25f4-3288-4ba2-ac3d-0e53d2203e05", "name": "network-vif-unplugged", "status": "completed", "tag": "970294ba-0041-4f63-b140-b50984e2960d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:41.380169 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:41.380169 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:41.389902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-33f624c9-fa39-4812-8629-f55e85e59af9 req-e4f296d6-7226-4fec-81e9-0198dd7bd939 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.390613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-33f624c9-fa39-4812-8629-f55e85e59af9 req-e4f296d6-7226-4fec-81e9-0198dd7bd939 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.404377 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-33f624c9-fa39-4812-8629-f55e85e59af9 req-e4f296d6-7226-4fec-81e9-0198dd7bd939 service nova] Creating event network-vif-unplugged:970294ba-0041-4f63-b140-b50984e2960d for instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 on nch1-master-1 Nov 27 20:51:41.412500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-33f624c9-fa39-4812-8629-f55e85e59af9 req-e4f296d6-7226-4fec-81e9-0198dd7bd939 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040747 Nov 27 20:51:41.413587 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 952/1857] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:51:41.420707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:41.421820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.432800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.433587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.435337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.436569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.437556 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3051de2c-348b-438b-baee-604aa15734a5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 204 len: 0 microversion: 2.1 time: 0.148826 Nov 27 20:51:41.438720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 906/1858] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:41 2021] DELETE /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:51:41.447944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:41.448747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.458466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.458925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.460029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.460661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.524446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:41.537394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:41.539697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:41.541077 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5d556632-7583-404a-a648-cfb1c197c42c tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.126221 Nov 27 20:51:41.542076 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 953/1859] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:41 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:41.547092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a41be1f9-3b60-49e5-bf2e-0f8ac440f0cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:41.548807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a41be1f9-3b60-49e5-bf2e-0f8ac440f0cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.555544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a41be1f9-3b60-49e5-bf2e-0f8ac440f0cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.556098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a41be1f9-3b60-49e5-bf2e-0f8ac440f0cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.557105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a41be1f9-3b60-49e5-bf2e-0f8ac440f0cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.557666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a41be1f9-3b60-49e5-bf2e-0f8ac440f0cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.614839 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a41be1f9-3b60-49e5-bf2e-0f8ac440f0cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 24572 microversion: 2.1 time: 0.069476 Nov 27 20:51:41.618547 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 954/1860] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:41 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 24572 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:41.625081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:41.627780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.635057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.635801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.637154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.638418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.638718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:41.647850 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88dcc13c-dab2-4a0d-8ba3-e7052a248283 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.204138 Nov 27 20:51:41.658383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 907/1861] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:41 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:41.664177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18c0d247-82a9-4f64-824f-a828d56cdea7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94d89d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:41.724039 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18c0d247-82a9-4f64-824f-a828d56cdea7 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.063955 Nov 27 20:51:41.727731 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 908/1862] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:41 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:41.824484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:41.828510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf8497ed-f2fc-4d44-9653-806d34f9d553 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:41.830629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf8497ed-f2fc-4d44-9653-806d34f9d553 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.835212 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-721f7ce5-bc25-4fe4-bf6d-d023b11563ee tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1535 microversion: 2.1 time: 0.215120 Nov 27 20:51:41.839606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf8497ed-f2fc-4d44-9653-806d34f9d553 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.840274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf8497ed-f2fc-4d44-9653-806d34f9d553 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.841694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf8497ed-f2fc-4d44-9653-806d34f9d553 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.842716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf8497ed-f2fc-4d44-9653-806d34f9d553 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.846703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 955/1863] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:41 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1535 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:41.886734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:41.888113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:41.910335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.911508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:41.912612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:41.913319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:42.114048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:42.132016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b14b2b53-ce3f-4bc8-b396-d1ce4c942dd9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.240628 Nov 27 20:51:42.132016 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 956/1864] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:41 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:42.154936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf8497ed-f2fc-4d44-9653-806d34f9d553 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.329232 Nov 27 20:51:42.159003 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 909/1865] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:41 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:42.560883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:42.561592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:42.569056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:42.569627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:42.570670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:42.571230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:42.632098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9cb34499-d03e-42c8-8ef8-93a42cd3b065 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:42.634986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9cb34499-d03e-42c8-8ef8-93a42cd3b065 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:42.650679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:42.652949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cb34499-d03e-42c8-8ef8-93a42cd3b065 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:42.653427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cb34499-d03e-42c8-8ef8-93a42cd3b065 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:42.654234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cb34499-d03e-42c8-8ef8-93a42cd3b065 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:42.654683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cb34499-d03e-42c8-8ef8-93a42cd3b065 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:42.668575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:42.672709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:42.677105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3be6c740-16c4-4a6a-86a0-4dd491a6f6df tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.120099 Nov 27 20:51:42.679976 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 957/1866] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:42 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:42.693490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:42.694747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:42.704209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:42.705297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:42.706327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:42.706793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:42.898914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:42.909390 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de6088f8-3015-4400-b423-c5c41cb1ce8a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.224103 Nov 27 20:51:42.920576 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 958/1867] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:42 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:42.926292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3fdabcd1-8d25-485f-aaad-f29125066f0d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c73bf820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:42.997228 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3fdabcd1-8d25-485f-aaad-f29125066f0d tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.075246 Nov 27 20:51:42.997795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 959/1868] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:42 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:43.008524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:43.009201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:43.015418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.016119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.017262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.017711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.229618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:43.238289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b7638a85-2a80-47e9-8417-8ef46912878c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1535 microversion: 2.1 time: 0.239336 Nov 27 20:51:43.243331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 960/1869] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:42 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1535 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:43.244626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:43.245329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:43.251431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.251980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.252861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.253606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.508037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:43.519138 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98c0f54d-6c18-4290-8cd9-b156b5d22e9f tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.278577 Nov 27 20:51:43.519749 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 961/1870] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:43 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:43.540265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e41cf91-1a3c-459a-977c-517eb2731f97 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:43.545921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e41cf91-1a3c-459a-977c-517eb2731f97 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:43.561286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e41cf91-1a3c-459a-977c-517eb2731f97 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.561749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e41cf91-1a3c-459a-977c-517eb2731f97 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.565596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e41cf91-1a3c-459a-977c-517eb2731f97 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.566050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e41cf91-1a3c-459a-977c-517eb2731f97 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.653549 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e41cf91-1a3c-459a-977c-517eb2731f97 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.118964 Nov 27 20:51:43.656836 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 962/1871] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:43 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:43.668034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9bf6c906-e44c-42f7-bfaf-bbde3997f258 req-8e81fdc6-9b7b-46c3-9b5f-52be498109c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cac25f4-3288-4ba2-ac3d-0e53d2203e05", "name": "network-vif-plugged", "status": "completed", "tag": "970294ba-0041-4f63-b140-b50984e2960d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:43.670019 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:43.670019 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:43.685707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9bf6c906-e44c-42f7-bfaf-bbde3997f258 req-8e81fdc6-9b7b-46c3-9b5f-52be498109c1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.686691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9bf6c906-e44c-42f7-bfaf-bbde3997f258 req-8e81fdc6-9b7b-46c3-9b5f-52be498109c1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.701690 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9bf6c906-e44c-42f7-bfaf-bbde3997f258 req-8e81fdc6-9b7b-46c3-9b5f-52be498109c1 service nova] Creating event network-vif-plugged:970294ba-0041-4f63-b140-b50984e2960d for instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 on nch1-master-1 Nov 27 20:51:43.707120 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9bf6c906-e44c-42f7-bfaf-bbde3997f258 req-8e81fdc6-9b7b-46c3-9b5f-52be498109c1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045478 Nov 27 20:51:43.711517 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 963/1872] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:43.718999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:43.719793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:43.726732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.726929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.727934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.728369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.851070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:43.867027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:43.868898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:43.870072 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6142a2ef-f8d4-40ca-a2da-d58c86bf1749 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.156947 Nov 27 20:51:43.870620 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 964/1873] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:43 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:43.928306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:43.928982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:43.937201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.937659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:43.939011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:43.942860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.213560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:44.225448 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3382f0b8-e6f1-40f0-8af0-e681c5519832 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.300711 Nov 27 20:51:44.234537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 965/1874] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:43 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:44.429068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-604eed75-d0bf-4a40-bfbe-512f7b97dbd8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Action: 'update', calling method: .version_select at 0x7f15c73e81f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:44.429068 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:44.429068 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:44.506969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-604eed75-d0bf-4a40-bfbe-512f7b97dbd8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.507460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-604eed75-d0bf-4a40-bfbe-512f7b97dbd8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.508273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-604eed75-d0bf-4a40-bfbe-512f7b97dbd8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.508710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-604eed75-d0bf-4a40-bfbe-512f7b97dbd8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.570959 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-604eed75-d0bf-4a40-bfbe-512f7b97dbd8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6" status: 200 len: 148 microversion: 2.57 time: 0.342701 Nov 27 20:51:44.575327 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 966/1875] 10.222.0.21 () {62 vars in 1302 bytes} [Sat Nov 27 20:51:44 2021] PUT /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6 => generated 148 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:44.575939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f85cd2a8-e35b-44ed-a5bc-ecab903b0bb9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c73e8550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:44.647873 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f85cd2a8-e35b-44ed-a5bc-ecab903b0bb9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.075131 Nov 27 20:51:44.648856 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 967/1876] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:44 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:44.658334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-de40ccb8-70b9-48da-bbbd-ff1de4a0925c req-1ebea9c0-978f-4ece-b666-8a5ce3d9c4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3587c6d6-ace9-414f-9f3f-68f3fb957835", "name": "network-vif-deleted", "tag": "55d30e88-9406-4ec6-91aa-9618b04ad283"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:44.659956 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:44.659956 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:44.671583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-de40ccb8-70b9-48da-bbbd-ff1de4a0925c req-1ebea9c0-978f-4ece-b666-8a5ce3d9c4a3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.672098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-de40ccb8-70b9-48da-bbbd-ff1de4a0925c req-1ebea9c0-978f-4ece-b666-8a5ce3d9c4a3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.687460 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-de40ccb8-70b9-48da-bbbd-ff1de4a0925c req-1ebea9c0-978f-4ece-b666-8a5ce3d9c4a3 service nova] Creating event network-vif-deleted:55d30e88-9406-4ec6-91aa-9618b04ad283 for instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 on nch1-master-1 Nov 27 20:51:44.692045 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-de40ccb8-70b9-48da-bbbd-ff1de4a0925c req-1ebea9c0-978f-4ece-b666-8a5ce3d9c4a3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041811 Nov 27 20:51:44.692989 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 968/1877] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:44.698532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:44.699293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:44.712939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.713772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.714578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.715150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.748989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.749619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.750281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lazy-loading 'fault' on Instance uuid 3587c6d6-ace9-414f-9f3f-68f3fb957835 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:44.800388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:44.807990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea904092-af65-4ad5-866d-1f16f12d2a91 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 200 len: 1369 microversion: 2.1 time: 0.113811 Nov 27 20:51:44.808945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 969/1878] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:44 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 1369 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:44.814693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:44.815596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:44.821733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.822467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.823539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:44.824094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:44.983758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:44.991552 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9034373a-06c6-4c38-9c83-c4148c89e0ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.181230 Nov 27 20:51:45.001786 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 970/1879] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:44 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:45.006508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35feef55-eb70-4f27-8671-0ef60d20015e tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Calling method '.version_select at 0x7f15c7393f70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:45.072173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35feef55-eb70-4f27-8671-0ef60d20015e tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.072895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35feef55-eb70-4f27-8671-0ef60d20015e tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.073836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35feef55-eb70-4f27-8671-0ef60d20015e tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.074392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35feef55-eb70-4f27-8671-0ef60d20015e tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.096480 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35feef55-eb70-4f27-8671-0ef60d20015e tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6/detail" status: 200 len: 463 microversion: 2.57 time: 0.092853 Nov 27 20:51:45.098211 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 971/1880] 10.222.0.21 () {60 vars in 1303 bytes} [Sat Nov 27 20:51:45 2021] GET /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6/detail => generated 463 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:45.102892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4edadc1-5df0-45bd-9153-f0fdba1f1ee9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:45.104092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d4edadc1-5df0-45bd-9153-f0fdba1f1ee9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:45.110598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4edadc1-5df0-45bd-9153-f0fdba1f1ee9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.111055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4edadc1-5df0-45bd-9153-f0fdba1f1ee9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.111882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4edadc1-5df0-45bd-9153-f0fdba1f1ee9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.112439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4edadc1-5df0-45bd-9153-f0fdba1f1ee9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.164049 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4edadc1-5df0-45bd-9153-f0fdba1f1ee9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.064346 Nov 27 20:51:45.170428 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 972/1881] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:45 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:45.179711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:45.180435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:45.191649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.192149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.193031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.193747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.281849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:45.295495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:45.297651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:45.300168 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e6620fb-bda2-4edd-af95-bc90c5a0b153 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.130064 Nov 27 20:51:45.301377 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 973/1882] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:45 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:45.305974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:45.306667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:45.318089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.318675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.319606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.320334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.493237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:45.511002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a3d4ab04-7342-4134-814a-b9ac41bd35be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.208338 Nov 27 20:51:45.511690 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 974/1883] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:45 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:45.524856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Action: 'update', calling method: .version_select at 0x7f15c7393940>, body: {"quota_set": {"ram": "2048"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:45.526742 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:45.526742 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:45.589591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.590047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.590863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.591327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.636157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.636157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.636157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.636872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.694364 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81eca443-75b4-4772-b9bd-95cb48fc8440 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6?user_id=3d4e2b752cb642dfba189937748ef8eb" status: 200 len: 148 microversion: 2.57 time: 0.171707 Nov 27 20:51:45.695224 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 975/1884] 10.222.0.21 () {62 vars in 1383 bytes} [Sat Nov 27 20:51:45 2021] PUT /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6?user_id=3d4e2b752cb642dfba189937748ef8eb => generated 148 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:45.710762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a231ceef-7874-498b-a30e-40ead6885133 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c74165e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:45.763202 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a231ceef-7874-498b-a30e-40ead6885133 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.056063 Nov 27 20:51:45.769574 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 976/1885] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:45 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:45.769574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b62792df-f312-4f04-a474-2878c23768dc tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Calling method '.version_select at 0x7f15c741ad30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:45.794970 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9cb34499-d03e-42c8-8ef8-93a42cd3b065 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 3.173679 Nov 27 20:51:45.795929 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 910/1886] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:42 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 3176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:45.802237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b99e8af6-151f-455e-a4b5-03809cc90054 req-0abb7ba3-0f88-4735-9751-90b7c7341cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273a67c6-4e11-45b2-b200-51b12af5f0b8", "name": "network-vif-plugged", "status": "completed", "tag": "d81663c4-56ef-44e4-ad69-a01fa20b6b99"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:45.803834 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:45.803834 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:45.812982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b99e8af6-151f-455e-a4b5-03809cc90054 req-0abb7ba3-0f88-4735-9751-90b7c7341cbc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.813759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b99e8af6-151f-455e-a4b5-03809cc90054 req-0abb7ba3-0f88-4735-9751-90b7c7341cbc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.830751 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b99e8af6-151f-455e-a4b5-03809cc90054 req-0abb7ba3-0f88-4735-9751-90b7c7341cbc service nova] Creating event network-vif-plugged:d81663c4-56ef-44e4-ad69-a01fa20b6b99 for instance 273a67c6-4e11-45b2-b200-51b12af5f0b8 on nch1-master-1 Nov 27 20:51:45.836174 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b99e8af6-151f-455e-a4b5-03809cc90054 req-0abb7ba3-0f88-4735-9751-90b7c7341cbc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038646 Nov 27 20:51:45.836953 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 911/1887] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:45.844237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:45.846249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 3587c6d6-ace9-414f-9f3f-68f3fb957835] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:45.853084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.853741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.854758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.855498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.872028 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] HTTP exception thrown: Instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 could not be found. Nov 27 20:51:45.872312 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b62792df-f312-4f04-a474-2878c23768dc tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6?user_id=3d4e2b752cb642dfba189937748ef8eb" status: 200 len: 190 microversion: 2.57 time: 0.107065 Nov 27 20:51:45.873040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Returning 404 to user: Instance 3587c6d6-ace9-414f-9f3f-68f3fb957835 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:45.873173 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 977/1888] 10.222.0.21 () {60 vars in 1363 bytes} [Sat Nov 27 20:51:45 2021] GET /compute/v2.1/os-quota-sets/ea942997af134af78b6019c8c3b907b6?user_id=3d4e2b752cb642dfba189937748ef8eb => generated 190 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:45.874305 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5726db9f-33f0-450c-a295-7a19a95634c6 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835" status: 404 len: 111 microversion: 2.1 time: 0.035558 Nov 27 20:51:45.875102 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 912/1889] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:45 2021] GET /compute/v2.1/servers/3587c6d6-ace9-414f-9f3f-68f3fb957835 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:45.883857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:45.885189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:45.899289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.899926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.900870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:45.901523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:45.967027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:46.010391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:46.011215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:46.017743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.018206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.019001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.021124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.114281 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1744e4a4-2087-4a58-9a4f-9f4dfbefb0ae tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "DELETE /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 204 len: 0 microversion: 2.1 time: 0.234219 Nov 27 20:51:46.118546 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 978/1890] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:45 2021] DELETE /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:46.123814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:46.124523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:46.130958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.131506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.132324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.132768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.229130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:46.240127 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2dc8318e-5d5a-4279-8adf-f169b06f166d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.233257 Nov 27 20:51:46.241368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 913/1891] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:46 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:46.254339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-949620db-9996-4471-a02c-6780c9f704b4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:46.255762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-949620db-9996-4471-a02c-6780c9f704b4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:46.261967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-949620db-9996-4471-a02c-6780c9f704b4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.262494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-949620db-9996-4471-a02c-6780c9f704b4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.263444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-949620db-9996-4471-a02c-6780c9f704b4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.263951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-949620db-9996-4471-a02c-6780c9f704b4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.338055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:46.339334 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-949620db-9996-4471-a02c-6780c9f704b4 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.096538 Nov 27 20:51:46.342886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 914/1892] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:46 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:46.349173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:46.350137 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-750ff969-8c79-413d-a415-4dd3ac56f70b tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1468 microversion: 2.1 time: 0.230250 Nov 27 20:51:46.350358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:46.350725 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 979/1893] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:46 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1468 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:46.357721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.358413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.361833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.362528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.439692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:46.449249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:46.450735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:46.451933 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a525d905-7e5c-4299-80fd-8001038d8465 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.107628 Nov 27 20:51:46.455017 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 915/1894] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:46 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:46.527847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:46.528422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:46.535032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.535516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.536314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.537070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.690542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:46.698245 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b202ddc0-7fcc-46f9-941c-0085e09b9eba tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1314 microversion: 2.1 time: 0.174854 Nov 27 20:51:46.699933 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 980/1895] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:46 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:46.776635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9869779e-beb1-4172-a70f-835dbc5da70c tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c7275940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:46.808249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af5a813b-c1cd-4d83-920b-07cc2dc57d65 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:46.809361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af5a813b-c1cd-4d83-920b-07cc2dc57d65 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:46.817193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af5a813b-c1cd-4d83-920b-07cc2dc57d65 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.817777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af5a813b-c1cd-4d83-920b-07cc2dc57d65 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.818679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af5a813b-c1cd-4d83-920b-07cc2dc57d65 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:46.824002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af5a813b-c1cd-4d83-920b-07cc2dc57d65 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:46.842252 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9869779e-beb1-4172-a70f-835dbc5da70c tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.069359 Nov 27 20:51:46.842812 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 916/1896] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:46 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:46.880774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af5a813b-c1cd-4d83-920b-07cc2dc57d65 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.076555 Nov 27 20:51:46.881649 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 981/1897] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:46 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:47.259494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:47.260595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:47.267548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.268086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.268975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.269540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.355829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5155488f-86ad-434b-8524-51a9e7aa30ba tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:47.359197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5155488f-86ad-434b-8524-51a9e7aa30ba tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:47.387928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5155488f-86ad-434b-8524-51a9e7aa30ba tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.393050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5155488f-86ad-434b-8524-51a9e7aa30ba tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.398076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5155488f-86ad-434b-8524-51a9e7aa30ba tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.398776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5155488f-86ad-434b-8524-51a9e7aa30ba tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.489761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5155488f-86ad-434b-8524-51a9e7aa30ba tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.139271 Nov 27 20:51:47.492058 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 982/1898] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:47 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:47.501887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:47.502664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:47.512958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.513514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.514395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.515271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.591999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:47.601189 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be45cf2f-6d87-4c6c-9f5d-c0aeef3b87f8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.346936 Nov 27 20:51:47.617753 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 917/1899] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:47 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:47.631190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:47.632132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:47.643711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.644172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.645011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.645456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.761320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:47.772899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:47.774400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:47.775014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:47.775723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dbb0a8e0-80bf-4f2c-b26d-7b8d33c2f945 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.156526 Nov 27 20:51:47.776868 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 918/1900] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:47 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:47.781559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:47.783296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:47.789958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.790649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.791656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.792250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.814134 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-32ac4b81-f643-47d5-8511-f3701905d73d tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1468 microversion: 2.1 time: 0.319146 Nov 27 20:51:47.823348 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 983/1901] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:47 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1468 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:47.855525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08ae6731-5050-4600-9ee0-9d753bc3564b tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c739a9d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:47.916305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08ae6731-5050-4600-9ee0-9d753bc3564b tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.064286 Nov 27 20:51:47.917105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 984/1902] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:47 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:47.923587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6529ef08-822e-4dd9-a739-0dcead6de937 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:47.923587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6529ef08-822e-4dd9-a739-0dcead6de937 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:47.932394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6529ef08-822e-4dd9-a739-0dcead6de937 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.932855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6529ef08-822e-4dd9-a739-0dcead6de937 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.933661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6529ef08-822e-4dd9-a739-0dcead6de937 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:47.934103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6529ef08-822e-4dd9-a739-0dcead6de937 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:47.979562 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6529ef08-822e-4dd9-a739-0dcead6de937 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.061369 Nov 27 20:51:47.980816 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 985/1903] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:47 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:48.052627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:48.063104 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff39a67f-aabb-4406-8e44-b521e4caccae tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1464 microversion: 2.1 time: 0.284944 Nov 27 20:51:48.064657 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 919/1904] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:47 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1464 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:48.499091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-084c2368-aa3f-45e5-a919-213454f56109 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Calling method '.version_select at 0x7f15c7393e50>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:48.507188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe2363c5-c7d8-4a52-be4d-ce76d8b1b670 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:48.509593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe2363c5-c7d8-4a52-be4d-ce76d8b1b670 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:48.517152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2363c5-c7d8-4a52-be4d-ce76d8b1b670 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.517871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2363c5-c7d8-4a52-be4d-ce76d8b1b670 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.519158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2363c5-c7d8-4a52-be4d-ce76d8b1b670 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.519938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2363c5-c7d8-4a52-be4d-ce76d8b1b670 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.524942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084c2368-aa3f-45e5-a919-213454f56109 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.525395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084c2368-aa3f-45e5-a919-213454f56109 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.544350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084c2368-aa3f-45e5-a919-213454f56109 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.545227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-084c2368-aa3f-45e5-a919-213454f56109 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.569345 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-084c2368-aa3f-45e5-a919-213454f56109 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] 10.222.0.21 "GET /compute/v2.1/os-simple-tenant-usage/7096bfbf5c8e42f09551e4c84ea8de02?start=2021-11-26T20%3A51%3A48.073429&end=2021-11-28T20%3A51%3A48.073429" status: 200 len: 700 microversion: 2.1 time: 0.491646 Nov 27 20:51:48.580196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 986/1905] 10.222.0.21 () {58 vars in 1411 bytes} [Sat Nov 27 20:51:48 2021] GET /compute/v2.1/os-simple-tenant-usage/7096bfbf5c8e42f09551e4c84ea8de02?start=2021-11-26T20%3A51%3A48.073429&end=2021-11-28T20%3A51%3A48.073429 => generated 700 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:48.585515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07c8dfbe-f200-49b8-ab86-d0b9c224fc2d tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '.version_select at 0x7f15c7415430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:48.590371 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe2363c5-c7d8-4a52-be4d-ce76d8b1b670 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.090610 Nov 27 20:51:48.594278 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 920/1906] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:48 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:48.599769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c8dfbe-f200-49b8-ab86-d0b9c224fc2d tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.600784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c8dfbe-f200-49b8-ab86-d0b9c224fc2d tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.616505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c8dfbe-f200-49b8-ab86-d0b9c224fc2d tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.618607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07c8dfbe-f200-49b8-ab86-d0b9c224fc2d tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.634390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:48.635217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:48.645598 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07c8dfbe-f200-49b8-ab86-d0b9c224fc2d tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/os-simple-tenant-usage/7096bfbf5c8e42f09551e4c84ea8de02?start=2021-11-26T20%3A51%3A48.073429&end=2021-11-28T20%3A51%3A48.073429" status: 200 len: 638 microversion: 2.1 time: 0.064267 Nov 27 20:51:48.647701 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 987/1907] 10.222.0.21 () {58 vars in 1411 bytes} [Sat Nov 27 20:51:48 2021] GET /compute/v2.1/os-simple-tenant-usage/7096bfbf5c8e42f09551e4c84ea8de02?start=2021-11-26T20%3A51%3A48.073429&end=2021-11-28T20%3A51%3A48.073429 => generated 638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:48.662898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.663389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.664535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.664984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.669424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30363251-8747-429e-986e-423803bf6548 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Calling method '.version_select at 0x7f15c7416ca0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:48.672618 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:48.672618 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:48.694581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30363251-8747-429e-986e-423803bf6548 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.695024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30363251-8747-429e-986e-423803bf6548 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.744648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30363251-8747-429e-986e-423803bf6548 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.745107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30363251-8747-429e-986e-423803bf6548 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.890746 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30363251-8747-429e-986e-423803bf6548 tempest-TenantUsagesTestJSON-545186378 tempest-TenantUsagesTestJSON-545186378-project-admin] 10.222.0.21 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-26T20%3A51%3A48.073429&end=2021-11-28T20%3A51%3A48.073429&detailed=1" status: 200 len: 21628 microversion: 2.1 time: 0.234085 Nov 27 20:51:48.891660 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 988/1908] 10.222.0.21 () {58 vars in 1334 bytes} [Sat Nov 27 20:51:48 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-26T20%3A51%3A48.073429&end=2021-11-28T20%3A51%3A48.073429&detailed=1 => generated 21628 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:48.896723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-995ea7fa-c0c4-4d1e-bc83-11d28db01a93 req-2cb20561-3831-4082-bf8f-ac2ae42c5bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81016c57-65b3-485d-bcfa-990f3b12fd24", "name": "network-vif-deleted", "tag": "75279561-8c7c-4017-8974-2a5bc6d0661c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:48.898085 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:48.898085 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:48.936962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-995ea7fa-c0c4-4d1e-bc83-11d28db01a93 req-2cb20561-3831-4082-bf8f-ac2ae42c5bd2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:48.937390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-995ea7fa-c0c4-4d1e-bc83-11d28db01a93 req-2cb20561-3831-4082-bf8f-ac2ae42c5bd2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:48.960463 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-995ea7fa-c0c4-4d1e-bc83-11d28db01a93 req-2cb20561-3831-4082-bf8f-ac2ae42c5bd2 service nova] Creating event network-vif-deleted:75279561-8c7c-4017-8974-2a5bc6d0661c for instance 81016c57-65b3-485d-bcfa-990f3b12fd24 on nch1-master-1 Nov 27 20:51:48.970739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-995ea7fa-c0c4-4d1e-bc83-11d28db01a93 req-2cb20561-3831-4082-bf8f-ac2ae42c5bd2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077442 Nov 27 20:51:48.982574 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 989/1909] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:48.992800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:48.993987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:49.001293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.002001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.003081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.003701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.019547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:49.027623 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-69849d23-f0d2-411e-8528-0228e656f76e tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.411275 Nov 27 20:51:49.033276 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 921/1910] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:48 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:49.041395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:49.043310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:49.057884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.059136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.060205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.060860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.085451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:49.094220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:49.096335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:49.097761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10d66677-d18f-47ed-a291-78f6ba0c9a2e tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.113470 Nov 27 20:51:49.098634 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 990/1911] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:48 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:49.114363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:49.114498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:49.125505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.126004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.126796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.127231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.128837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.129297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.129751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lazy-loading 'fault' on Instance uuid 81016c57-65b3-485d-bcfa-990f3b12fd24 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:49.175202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:49.211170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:49.219180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-daf31bd7-f612-4eb9-bb49-e44db488dc3f tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 200 len: 1303 microversion: 2.1 time: 0.184640 Nov 27 20:51:49.220352 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 922/1912] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:49 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 1303 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:49.240250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f0420411-4ecc-4b14-bc22-42c272dfcbe9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c729c0d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:49.308703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f0420411-4ecc-4b14-bc22-42c272dfcbe9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.078044 Nov 27 20:51:49.309313 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 923/1913] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:49 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:49.319130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-67ada623-15e2-4b66-90b5-4a08a2788bd8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:49.323361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-67ada623-15e2-4b66-90b5-4a08a2788bd8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:49.334783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67ada623-15e2-4b66-90b5-4a08a2788bd8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.335603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67ada623-15e2-4b66-90b5-4a08a2788bd8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.336785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67ada623-15e2-4b66-90b5-4a08a2788bd8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.337444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67ada623-15e2-4b66-90b5-4a08a2788bd8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.345235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50c58baa-e0ce-4d69-91c8-5321302d377a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "DELETE /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 204 len: 0 microversion: 2.1 time: 0.244282 Nov 27 20:51:49.345814 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 991/1914] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:49 2021] DELETE /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:49.361443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:49.364368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:49.377119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.377965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.379051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.379914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.399953 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-67ada623-15e2-4b66-90b5-4a08a2788bd8 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.088477 Nov 27 20:51:49.401054 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 924/1915] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:49 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:49.547148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:49.555835 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-776dedd1-0101-4d00-bf44-da56abfe979a tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1470 microversion: 2.1 time: 0.205153 Nov 27 20:51:49.556718 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 992/1916] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:49 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:49.606734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95788da4-9984-45c4-b5a7-c982385380bc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:49.608606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95788da4-9984-45c4-b5a7-c982385380bc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:49.616997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95788da4-9984-45c4-b5a7-c982385380bc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.617802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95788da4-9984-45c4-b5a7-c982385380bc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.619034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95788da4-9984-45c4-b5a7-c982385380bc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:49.619729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95788da4-9984-45c4-b5a7-c982385380bc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:49.669821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95788da4-9984-45c4-b5a7-c982385380bc tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.071244 Nov 27 20:51:49.671638 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 925/1917] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:49 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:50.049058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.049838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.056451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.057608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.062888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.063665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.117640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.119205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.127758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.128487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.129465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.130084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.222535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:50.232238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:50.234317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:50.240117 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8747021b-0866-4b81-8f11-6731cff34ccf tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.126784 Nov 27 20:51:50.241346 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 926/1918] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:50.256420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.257290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 81016c57-65b3-485d-bcfa-990f3b12fd24] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.265483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.266187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.267755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.268356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.280387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:50.280746 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47e5636a-b4e5-417f-81c7-ca42a2f580b9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.235458 Nov 27 20:51:50.281405 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 993/1919] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:50.304823 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] HTTP exception thrown: Instance 81016c57-65b3-485d-bcfa-990f3b12fd24 could not be found. Nov 27 20:51:50.305952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Returning 404 to user: Instance 81016c57-65b3-485d-bcfa-990f3b12fd24 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:50.306966 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5de94fd3-ab8c-41ad-94a9-016edfce3c3c tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24" status: 404 len: 111 microversion: 2.1 time: 0.060157 Nov 27 20:51:50.308937 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 927/1920] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/servers/81016c57-65b3-485d-bcfa-990f3b12fd24 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:50.319107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.323144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.331046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.331772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.332759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.333366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.333522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c8d79de-7f7c-4425-926c-e6e34afe0c87 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c733d280>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.370087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:50.400228 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c8d79de-7f7c-4425-926c-e6e34afe0c87 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.079132 Nov 27 20:51:50.401121 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 928/1921] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:50.412960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f50cf487-73aa-423f-aa64-9b2030585993 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:50.414732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f50cf487-73aa-423f-aa64-9b2030585993 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.422910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f50cf487-73aa-423f-aa64-9b2030585993 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.425095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f50cf487-73aa-423f-aa64-9b2030585993 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.428336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f50cf487-73aa-423f-aa64-9b2030585993 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.429261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f50cf487-73aa-423f-aa64-9b2030585993 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.494684 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49129649-61d0-488e-a637-8c5ccc08c3da tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "DELETE /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 204 len: 0 microversion: 2.1 time: 0.181577 Nov 27 20:51:50.498869 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 994/1922] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:50 2021] DELETE /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:50.505012 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f50cf487-73aa-423f-aa64-9b2030585993 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.096693 Nov 27 20:51:50.505854 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 929/1923] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:50 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:50.511649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.512304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.521367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.521825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.522623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.523057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.654380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-985abf85-d256-46e3-846f-5dcdea236589 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.656433 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:50.656433 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:50.658058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985abf85-d256-46e3-846f-5dcdea236589 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.658519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985abf85-d256-46e3-846f-5dcdea236589 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.659372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985abf85-d256-46e3-846f-5dcdea236589 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.659811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985abf85-d256-46e3-846f-5dcdea236589 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.693021 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-985abf85-d256-46e3-846f-5dcdea236589 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.192481 Nov 27 20:51:50.693870 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 995/1924] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/os-services => generated 947 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:50.695541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:50.698840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.700072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.704418 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ccbf044-99cb-415b-9365-667730dec4ad tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1469 microversion: 2.1 time: 0.197075 Nov 27 20:51:50.705378 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 930/1925] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1469 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:50.710203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1ee4632-5b9c-43b4-aeef-24756a869ef0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:50.711299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d1ee4632-5b9c-43b4-aeef-24756a869ef0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:50.715034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.715208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.716098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.716443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.721762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1ee4632-5b9c-43b4-aeef-24756a869ef0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.721762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1ee4632-5b9c-43b4-aeef-24756a869ef0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.722800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1ee4632-5b9c-43b4-aeef-24756a869ef0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.723533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1ee4632-5b9c-43b4-aeef-24756a869ef0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.773501 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1ee4632-5b9c-43b4-aeef-24756a869ef0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.066864 Nov 27 20:51:50.777290 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 931/1926] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:50 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:50.782336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-516f5b4a-5153-4ce5-8661-37eaac6a0472 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.785381 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:50.785381 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:50.785664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-516f5b4a-5153-4ce5-8661-37eaac6a0472 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.786199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-516f5b4a-5153-4ce5-8661-37eaac6a0472 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.787134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-516f5b4a-5153-4ce5-8661-37eaac6a0472 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.787933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-516f5b4a-5153-4ce5-8661-37eaac6a0472 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.824772 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-516f5b4a-5153-4ce5-8661-37eaac6a0472 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.047426 Nov 27 20:51:50.824772 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 932/1927] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:50.836304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1cf97726-81c2-4e7b-96b4-98a3596fcefd tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.837284 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:50.837284 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:50.838994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cf97726-81c2-4e7b-96b4-98a3596fcefd tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.839773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cf97726-81c2-4e7b-96b4-98a3596fcefd tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.840656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cf97726-81c2-4e7b-96b4-98a3596fcefd tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.841147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cf97726-81c2-4e7b-96b4-98a3596fcefd tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.869238 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1cf97726-81c2-4e7b-96b4-98a3596fcefd tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.037004 Nov 27 20:51:50.869852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 933/1928] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/os-services => generated 947 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:51:50.884367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23ca98fb-2986-40dc-909f-fea80434b016 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.885842 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:50.885842 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:50.887457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23ca98fb-2986-40dc-909f-fea80434b016 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.887916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23ca98fb-2986-40dc-909f-fea80434b016 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.888753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23ca98fb-2986-40dc-909f-fea80434b016 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.889202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23ca98fb-2986-40dc-909f-fea80434b016 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.904067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:50.914546 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23ca98fb-2986-40dc-909f-fea80434b016 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.034048 Nov 27 20:51:50.916900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59994c25-2b24-4d29-aade-d849233552f4 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1470 microversion: 2.1 time: 0.221828 Nov 27 20:51:50.926970 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 996/1929] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:50.927175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 934/1930] 10.222.0.21 () {58 vars in 1195 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:51:50.927308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-942412d2-4503-49ce-b48e-d74d43d135d0 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.928232 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:50.928232 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:50.930539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942412d2-4503-49ce-b48e-d74d43d135d0 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.931226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942412d2-4503-49ce-b48e-d74d43d135d0 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.932548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942412d2-4503-49ce-b48e-d74d43d135d0 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.932993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-942412d2-4503-49ce-b48e-d74d43d135d0 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.964313 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-942412d2-4503-49ce-b48e-d74d43d135d0 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.042350 Nov 27 20:51:50.965159 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 997/1931] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/os-services => generated 947 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:50.975071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ce92a8d-78ca-42ae-8791-a7d7d0e07156 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:50.976367 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:50.976367 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:50.977887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce92a8d-78ca-42ae-8791-a7d7d0e07156 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.978323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce92a8d-78ca-42ae-8791-a7d7d0e07156 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:50.979134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce92a8d-78ca-42ae-8791-a7d7d0e07156 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:50.979590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce92a8d-78ca-42ae-8791-a7d7d0e07156 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.005979 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ce92a8d-78ca-42ae-8791-a7d7d0e07156 tempest-ServicesAdminNegativeTestJSON-398089672 tempest-ServicesAdminNegativeTestJSON-398089672-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.034246 Nov 27 20:51:51.006764 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 935/1932] 10.222.0.21 () {58 vars in 1197 bytes} [Sat Nov 27 20:51:50 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:51:51.143862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ea98eb5-34f8-466e-bfaa-6b2b4be28e6c tempest-ServicesAdminNegativeTestJSON-953690551 tempest-ServicesAdminNegativeTestJSON-953690551-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:51.145244 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:51.145244 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:51.147098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ea98eb5-34f8-466e-bfaa-6b2b4be28e6c tempest-ServicesAdminNegativeTestJSON-953690551 tempest-ServicesAdminNegativeTestJSON-953690551-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd9ace11ab09c4185a7a7385a6e111313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4aa31d233c54e67aee9939f89d9b8ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:51.147983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ea98eb5-34f8-466e-bfaa-6b2b4be28e6c tempest-ServicesAdminNegativeTestJSON-953690551 tempest-ServicesAdminNegativeTestJSON-953690551-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:51.149510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ea98eb5-34f8-466e-bfaa-6b2b4be28e6c tempest-ServicesAdminNegativeTestJSON-953690551 tempest-ServicesAdminNegativeTestJSON-953690551-project] 10.222.0.21 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.135959 Nov 27 20:51:51.161863 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 998/1933] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:51:51 2021] GET /compute/v2.1/os-services => generated 112 bytes in 143 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:51.259189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:51.260692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:51.268253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.268957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.269930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.270561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.299691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:51.300361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:51.325579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.326028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.326824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.327284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.352682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:51.362250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:51.364671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:51.365516 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7554f6a9-823a-42e5-8ff0-5c166b898bac tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.110083 Nov 27 20:51:51.366445 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 936/1934] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:51 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:51.414490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e757f73-a4f9-457b-9195-912b8aff7fd9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94a6820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:51.488576 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e757f73-a4f9-457b-9195-912b8aff7fd9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.077875 Nov 27 20:51:51.489593 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 937/1935] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:51 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:51.518147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9dc9c1e-7db7-47d4-8336-06ecdc3c2385 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:51.519218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9dc9c1e-7db7-47d4-8336-06ecdc3c2385 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:51.540161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9dc9c1e-7db7-47d4-8336-06ecdc3c2385 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.540620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9dc9c1e-7db7-47d4-8336-06ecdc3c2385 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.541429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9dc9c1e-7db7-47d4-8336-06ecdc3c2385 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.541872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9dc9c1e-7db7-47d4-8336-06ecdc3c2385 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.600459 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9dc9c1e-7db7-47d4-8336-06ecdc3c2385 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.087087 Nov 27 20:51:51.602177 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 938/1936] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:51 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:51.629632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:51.638029 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0c68f0c8-e801-4dbd-b163-033544a00b4d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1317 microversion: 2.1 time: 0.343730 Nov 27 20:51:51.640751 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 999/1937] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:51 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:51.726407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:51.727458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:51.739714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.740253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.741233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.743186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.786313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0933e0a8-66b7-4e86-ada1-d76e8b92956f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:51.788874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0933e0a8-66b7-4e86-ada1-d76e8b92956f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:51.799939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0933e0a8-66b7-4e86-ada1-d76e8b92956f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.804167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0933e0a8-66b7-4e86-ada1-d76e8b92956f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.805234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0933e0a8-66b7-4e86-ada1-d76e8b92956f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.807809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0933e0a8-66b7-4e86-ada1-d76e8b92956f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.897787 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0933e0a8-66b7-4e86-ada1-d76e8b92956f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 24579 microversion: 2.1 time: 0.115912 Nov 27 20:51:51.898995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1000/1938] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:51 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 24579 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:51.934847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:51.935684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:51.951315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.952055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:51.953462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:51.955717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.085677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39495438d7c40a780a68e2cf38d6ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7096bfbf5c8e42f09551e4c84ea8de02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:52.098263 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e4641f5-17a2-43ab-88cc-8430387252be tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 200 len: 1428 microversion: 2.1 time: 0.167755 Nov 27 20:51:52.101085 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1001/1939] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:51 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 1428 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:52.116161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2559ca8a-afda-4ba8-a2a8-c4723fbc6a93 req-d19bf84d-fdc2-43d3-9eb6-ec25e7a29493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273a67c6-4e11-45b2-b200-51b12af5f0b8", "name": "network-vif-deleted", "tag": "d81663c4-56ef-44e4-ad69-a01fa20b6b99"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:52.120180 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:52.120180 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:52.134390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2559ca8a-afda-4ba8-a2a8-c4723fbc6a93 req-d19bf84d-fdc2-43d3-9eb6-ec25e7a29493 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.134751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2559ca8a-afda-4ba8-a2a8-c4723fbc6a93 req-d19bf84d-fdc2-43d3-9eb6-ec25e7a29493 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.173467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:52.174995 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2559ca8a-afda-4ba8-a2a8-c4723fbc6a93 req-d19bf84d-fdc2-43d3-9eb6-ec25e7a29493 service nova] Creating event network-vif-deleted:d81663c4-56ef-44e4-ad69-a01fa20b6b99 for instance 273a67c6-4e11-45b2-b200-51b12af5f0b8 on nch1-master-1 Nov 27 20:51:52.185261 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2559ca8a-afda-4ba8-a2a8-c4723fbc6a93 req-d19bf84d-fdc2-43d3-9eb6-ec25e7a29493 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083133 Nov 27 20:51:52.190745 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1002/1940] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:52.190887 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10fe5570-1019-4da1-ab11-302cc26395f5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1469 microversion: 2.1 time: 0.469741 Nov 27 20:51:52.192344 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 939/1941] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:51 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1469 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:52.393797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:52.395653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:52.402597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.403515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.404515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.405149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.503293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc1cb646-2f40-4514-8166-ff8e5d5f84fd tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94bd430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:52.505284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:52.523695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:52.526435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:52.528348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e427bf9d-6518-49c5-90c7-ae90a9f1a803 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.146370 Nov 27 20:51:52.529784 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1003/1942] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:52 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:52.587790 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc1cb646-2f40-4514-8166-ff8e5d5f84fd tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.088640 Nov 27 20:51:52.589187 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 940/1943] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:52 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:52.613018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-539f8056-8ef7-44d9-951e-5c8a9e54c8db tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:52.613933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-539f8056-8ef7-44d9-951e-5c8a9e54c8db tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:52.625374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539f8056-8ef7-44d9-951e-5c8a9e54c8db tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.626881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539f8056-8ef7-44d9-951e-5c8a9e54c8db tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.630146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539f8056-8ef7-44d9-951e-5c8a9e54c8db tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.630775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539f8056-8ef7-44d9-951e-5c8a9e54c8db tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.661027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:52.662584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:52.675459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.679290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.682911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.686800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.692112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-539f8056-8ef7-44d9-951e-5c8a9e54c8db tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.083559 Nov 27 20:51:52.693649 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1004/1944] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:52 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:52.910350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a46e0b4-792f-4944-8670-1180b198cc59 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:52.911057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a46e0b4-792f-4944-8670-1180b198cc59 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:52.928863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a46e0b4-792f-4944-8670-1180b198cc59 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.929407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a46e0b4-792f-4944-8670-1180b198cc59 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.930308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a46e0b4-792f-4944-8670-1180b198cc59 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:52.930831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a46e0b4-792f-4944-8670-1180b198cc59 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:52.993566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:53.007587 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12f29970-414a-49c7-b8c6-772c7315caea tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1466 microversion: 2.1 time: 0.353027 Nov 27 20:51:53.008552 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 941/1945] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:52 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1466 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:53.033532 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a46e0b4-792f-4944-8670-1180b198cc59 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.126893 Nov 27 20:51:53.033755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f51fed16-e17e-4a7c-bb7f-27ace9b29aa2 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:53.034325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f51fed16-e17e-4a7c-bb7f-27ace9b29aa2 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:53.041106 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1005/1946] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:52 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:53.046797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51fed16-e17e-4a7c-bb7f-27ace9b29aa2 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.047279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51fed16-e17e-4a7c-bb7f-27ace9b29aa2 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.048634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51fed16-e17e-4a7c-bb7f-27ace9b29aa2 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.049082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51fed16-e17e-4a7c-bb7f-27ace9b29aa2 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.118736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:53.120105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] [instance: 273a67c6-4e11-45b2-b200-51b12af5f0b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:53.135925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.136415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.141616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.142263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.162829 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] HTTP exception thrown: Instance 273a67c6-4e11-45b2-b200-51b12af5f0b8 could not be found. Nov 27 20:51:53.163977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] Returning 404 to user: Instance 273a67c6-4e11-45b2-b200-51b12af5f0b8 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:53.165842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5185d7a8-9136-46c7-9531-777b6875f954 tempest-TenantUsagesTestJSON-2069042190 tempest-TenantUsagesTestJSON-2069042190-project] 10.222.0.21 "GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8" status: 404 len: 111 microversion: 2.1 time: 0.051386 Nov 27 20:51:53.166946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1006/1947] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:53 2021] GET /compute/v2.1/servers/273a67c6-4e11-45b2-b200-51b12af5f0b8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:51:53.211554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:53.212770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:53.222316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.223848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.228440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.229894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.282906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.284145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.285884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lazy-loading 'fault' on Instance uuid 14c83605-57d7-4d81-a8ee-b30279bafd6f {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:51:53.366751 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f51fed16-e17e-4a7c-bb7f-27ace9b29aa2 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1617 microversion: 2.1 time: 0.346101 Nov 27 20:51:53.381499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb6bc63929648388ac9648823d4ca88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a17517c2104eeba56ce3a7cd915fb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:53.382910 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 942/1948] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:53 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1617 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:53.395083 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff216792-8028-4798-9e62-af9574dbc6d5 tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 200 len: 1303 microversion: 2.1 time: 0.188977 Nov 27 20:51:53.395861 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1007/1949] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:53 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:53.555567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:53.556781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:53.582668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.586997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.588787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.591505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.606520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7d52ccc-a076-4584-b7c6-fa82ecc08405 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c7416c10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:53.693423 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7d52ccc-a076-4584-b7c6-fa82ecc08405 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.095662 Nov 27 20:51:53.703414 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1008/1950] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:53 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:53.720435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1997134974", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ca701c1d-30e3-471a-881e-6d51c9bbef61"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:53.759550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:53.771781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:53.773933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:53.775543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e309b946-e832-4495-80ae-814bbca605ce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.231264 Nov 27 20:51:53.778298 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 943/1951] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:53 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:53.800703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78812247-6fef-4d5e-80cb-63d3f1e70fd9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:53.801812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78812247-6fef-4d5e-80cb-63d3f1e70fd9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:53.826902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78812247-6fef-4d5e-80cb-63d3f1e70fd9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.833261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:51:53.843705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78812247-6fef-4d5e-80cb-63d3f1e70fd9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.843705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78812247-6fef-4d5e-80cb-63d3f1e70fd9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:53.843705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78812247-6fef-4d5e-80cb-63d3f1e70fd9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:53.930881 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78812247-6fef-4d5e-80cb-63d3f1e70fd9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.151060 Nov 27 20:51:53.931565 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 944/1952] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:53 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:54.050965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88da7d76-b4a6-40e0-ac72-3943ea6210c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:54.052403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88da7d76-b4a6-40e0-ac72-3943ea6210c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:54.064451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88da7d76-b4a6-40e0-ac72-3943ea6210c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.065772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88da7d76-b4a6-40e0-ac72-3943ea6210c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.066979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88da7d76-b4a6-40e0-ac72-3943ea6210c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.067679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88da7d76-b4a6-40e0-ac72-3943ea6210c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.122551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88da7d76-b4a6-40e0-ac72-3943ea6210c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.076972 Nov 27 20:51:54.124007 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 945/1953] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:54 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:54.217873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:51:54.218481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:51:54.218989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:51:54.219732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:51:54.221276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:51:54.245079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-87f46548-5ce3-45e5-ac5f-724b03fa0c68 req-7a388d11-1bf3-4ec4-964e-3374e37d9ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c83605-57d7-4d81-a8ee-b30279bafd6f", "name": "network-vif-deleted", "tag": "315cf87c-c809-4b39-b8ec-ef3d92d438f0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:54.247164 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:54.247164 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:54.252548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.257947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.259804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.263132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.270473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-87f46548-5ce3-45e5-ac5f-724b03fa0c68 req-7a388d11-1bf3-4ec4-964e-3374e37d9ca0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.281074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-87f46548-5ce3-45e5-ac5f-724b03fa0c68 req-7a388d11-1bf3-4ec4-964e-3374e37d9ca0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.299700 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-87f46548-5ce3-45e5-ac5f-724b03fa0c68 req-7a388d11-1bf3-4ec4-964e-3374e37d9ca0 service nova] Creating event network-vif-deleted:315cf87c-c809-4b39-b8ec-ef3d92d438f0 for instance 14c83605-57d7-4d81-a8ee-b30279bafd6f on nch1-master-1 Nov 27 20:51:54.322179 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-87f46548-5ce3-45e5-ac5f-724b03fa0c68 req-7a388d11-1bf3-4ec4-964e-3374e37d9ca0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082008 Nov 27 20:51:54.323608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 946/1954] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:54.333182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:51:54.345059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Getting quotas for user 4561f04227544d2ca76bce3dc5618c7f and project c03fae8406904a0da2046c097555cf58. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:51:54.364738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:51:54.369203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:51:54.413729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:54.417653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] [instance: 14c83605-57d7-4d81-a8ee-b30279bafd6f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:54.428854 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eecab956-e55e-453f-b83c-811979c29c5d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723152 Nov 27 20:51:54.430550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1009/1955] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:51:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:51:54.438102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.439369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.440418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.443409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.462219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6091f2f-2a22-415d-8a73-0d49aa3344d0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:54.462219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6091f2f-2a22-415d-8a73-0d49aa3344d0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:54.493326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] HTTP exception thrown: Instance 14c83605-57d7-4d81-a8ee-b30279bafd6f could not be found. Nov 27 20:51:54.493941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] Returning 404 to user: Instance 14c83605-57d7-4d81-a8ee-b30279bafd6f could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:54.494786 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e333f14-a7a1-4a17-8fe5-fd007a4d797a tempest-MigrationsAdminTest-1391153204 tempest-MigrationsAdminTest-1391153204-project] 10.222.0.21 "GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f" status: 404 len: 111 microversion: 2.1 time: 0.085933 Nov 27 20:51:54.495380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 947/1956] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:54 2021] GET /compute/v2.1/servers/14c83605-57d7-4d81-a8ee-b30279bafd6f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:54.591208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d6091f2f-2a22-415d-8a73-0d49aa3344d0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:54.600314 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6091f2f-2a22-415d-8a73-0d49aa3344d0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1217 microversion: 2.1 time: 0.144092 Nov 27 20:51:54.604458 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1010/1957] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:54 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:54.709586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af523c0f-5dca-4ced-9396-e1a8ac7a2b3c tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d40bcaf0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:54.775375 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af523c0f-5dca-4ced-9396-e1a8ac7a2b3c tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1429 microversion: 2.1 time: 0.069441 Nov 27 20:51:54.776499 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 948/1958] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:54 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1429 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:54.796595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:54.797675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:54.806717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.808009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.810180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.810662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.937741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:54.942158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-51c23223-ccb7-48e6-8069-a61d06ac90b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:54.943104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-51c23223-ccb7-48e6-8069-a61d06ac90b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:54.946778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:54.948495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:54.950439 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-13635e50-da0b-491b-994a-8fc46a507821 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.157619 Nov 27 20:51:54.954124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c23223-ccb7-48e6-8069-a61d06ac90b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.954578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c23223-ccb7-48e6-8069-a61d06ac90b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.960450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c23223-ccb7-48e6-8069-a61d06ac90b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:54.962660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c23223-ccb7-48e6-8069-a61d06ac90b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:54.963278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1011/1959] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:54 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:55.023400 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-51c23223-ccb7-48e6-8069-a61d06ac90b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.084792 Nov 27 20:51:55.026018 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 949/1960] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:54 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:55.138869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93f98051-17c4-4eb4-b3ee-ccff58702172 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:55.140839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93f98051-17c4-4eb4-b3ee-ccff58702172 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:55.153099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93f98051-17c4-4eb4-b3ee-ccff58702172 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.153918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93f98051-17c4-4eb4-b3ee-ccff58702172 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:55.156277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93f98051-17c4-4eb4-b3ee-ccff58702172 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.157628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93f98051-17c4-4eb4-b3ee-ccff58702172 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:55.256600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-93f98051-17c4-4eb4-b3ee-ccff58702172 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.124050 Nov 27 20:51:55.264263 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1012/1961] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:55 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:55.618627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:55.619367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:55.631222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.631932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:55.632507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.632942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:55.708808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:55.722643 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92ab6ba9-56c1-447f-a46f-60d57cb8ed66 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1269 microversion: 2.1 time: 0.107797 Nov 27 20:51:55.723727 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 950/1962] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:55 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:55.789539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ee9f404a-9bf3-4c74-9d38-16bf51038900 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c7393550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:55.848456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ee9f404a-9bf3-4c74-9d38-16bf51038900 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1438 microversion: 2.1 time: 0.063252 Nov 27 20:51:55.849543 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1013/1963] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:55 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1438 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:55.861118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-895ca8b3-28c2-4e80-af0b-37fce9bfd9a9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c729cca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:55.919537 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-895ca8b3-28c2-4e80-af0b-37fce9bfd9a9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 200 len: 1438 microversion: 2.1 time: 0.062423 Nov 27 20:51:55.920301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 951/1964] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:55 2021] GET /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:55.936124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:55.936877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:55.945668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.946576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:55.948106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.948738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:55.970202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:55.971230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:55.983634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.991598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:55.992707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:55.993591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:56.123696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:56.139511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:56.143932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:56.147283 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d090c2fe-8c07-4af8-9663-28dbbfaeb759 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.180341 Nov 27 20:51:56.149533 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 952/1965] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:55 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:56.165040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-352e4722-c41d-4532-a8e0-47e505e01121 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:56.167516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-352e4722-c41d-4532-a8e0-47e505e01121 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:56.176310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-352e4722-c41d-4532-a8e0-47e505e01121 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:56.177262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-352e4722-c41d-4532-a8e0-47e505e01121 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:56.180028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-352e4722-c41d-4532-a8e0-47e505e01121 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:56.180730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-352e4722-c41d-4532-a8e0-47e505e01121 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:56.239349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-352e4722-c41d-4532-a8e0-47e505e01121 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.086728 Nov 27 20:51:56.240411 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 953/1966] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:56 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:56.271047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7d914b5-4da7-4b70-b6a4-214b79df8b0e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:56.272451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7d914b5-4da7-4b70-b6a4-214b79df8b0e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:56.281665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d914b5-4da7-4b70-b6a4-214b79df8b0e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:56.282745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d914b5-4da7-4b70-b6a4-214b79df8b0e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:56.283048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:56.284411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d914b5-4da7-4b70-b6a4-214b79df8b0e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:56.285057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d914b5-4da7-4b70-b6a4-214b79df8b0e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:56.292434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f06763bb-a484-4b1f-9669-4c1fd1c925a5 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1465 microversion: 2.1 time: 0.363988 Nov 27 20:51:56.295267 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1014/1967] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:55 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1465 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:56.315697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d41647c6-0e18-4c92-abbe-1c3bc27837f9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15c74cf670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:56.340325 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7d914b5-4da7-4b70-b6a4-214b79df8b0e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.074764 Nov 27 20:51:56.342301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 954/1968] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:56 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:56.738851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f26b2273-3c46-4143-bb96-d5a77bf0a498 tempest-TenantUsagesNegativeTestJSON-1625554790 tempest-TenantUsagesNegativeTestJSON-1625554790-project-admin] 10.222.0.21 "GET /compute/v2.1/os-simple-tenant-usage/?start=2021-11-26T20%3A51%3A56.367231&end=2021-11-28T20%3A51%3A56.367231" status: 404 len: 112 microversion: - time: 0.367520 Nov 27 20:51:56.742151 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 955/1969] 10.222.0.21 () {58 vars in 1315 bytes} [Sat Nov 27 20:51:56 2021] GET /compute/v2.1/os-simple-tenant-usage/?start=2021-11-26T20%3A51%3A56.367231&end=2021-11-28T20%3A51%3A56.367231 => generated 112 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 27 20:51:56.748386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:56.748502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:56.754657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:56.755107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:56.755928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:56.756366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:56.826656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:56.834846 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dca85473-6103-4cb4-9710-b093de5cb749 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1275 microversion: 2.1 time: 0.091631 Nov 27 20:51:56.835511 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 956/1970] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:56 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:56.840010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fde8e279-b878-4b44-b0c9-da33d985e4c5 tempest-TenantUsagesNegativeTestJSON-1625554790 tempest-TenantUsagesNegativeTestJSON-1625554790-project-admin] Calling method '.version_select at 0x7f15c7275c10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:56.846554 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-fde8e279-b878-4b44-b0c9-da33d985e4c5 tempest-TenantUsagesNegativeTestJSON-1625554790 tempest-TenantUsagesNegativeTestJSON-1625554790-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 27 20:51:56.847141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fde8e279-b878-4b44-b0c9-da33d985e4c5 tempest-TenantUsagesNegativeTestJSON-1625554790 tempest-TenantUsagesNegativeTestJSON-1625554790-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:56.848676 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fde8e279-b878-4b44-b0c9-da33d985e4c5 tempest-TenantUsagesNegativeTestJSON-1625554790 tempest-TenantUsagesNegativeTestJSON-1625554790-project-admin] 10.222.0.21 "GET /compute/v2.1/os-simple-tenant-usage/84f220a6252a4356997445be8c77c335?start=2021-11-28T20%3A51%3A56.367231&end=2021-11-26T20%3A51%3A56.367231" status: 400 len: 111 microversion: 2.1 time: 0.012162 Nov 27 20:51:56.849221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 957/1971] 10.222.0.21 () {58 vars in 1411 bytes} [Sat Nov 27 20:51:56 2021] GET /compute/v2.1/os-simple-tenant-usage/84f220a6252a4356997445be8c77c335?start=2021-11-28T20%3A51%3A56.367231&end=2021-11-26T20%3A51%3A56.367231 => generated 111 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:51:57.295172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b818e5f-cd67-4dbf-aa51-f42a87f1e17d tempest-TenantUsagesNegativeTestJSON-133254462 tempest-TenantUsagesNegativeTestJSON-133254462-project] Calling method '.version_select at 0x7f15c734fa60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:57.298533 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:57.298533 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:57.299920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1b818e5f-cd67-4dbf-aa51-f42a87f1e17d tempest-TenantUsagesNegativeTestJSON-133254462 tempest-TenantUsagesNegativeTestJSON-133254462-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b3f8e462094c4456b13e2c9da35a8a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f220a6252a4356997445be8c77c335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:57.302914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b818e5f-cd67-4dbf-aa51-f42a87f1e17d tempest-TenantUsagesNegativeTestJSON-133254462 tempest-TenantUsagesNegativeTestJSON-133254462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:57.309872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b818e5f-cd67-4dbf-aa51-f42a87f1e17d tempest-TenantUsagesNegativeTestJSON-133254462 tempest-TenantUsagesNegativeTestJSON-133254462-project] 10.222.0.21 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-26T20%3A51%3A56.367231&end=2021-11-28T20%3A51%3A56.367231&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.451080 Nov 27 20:51:57.311846 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 958/1972] 10.222.0.21 () {58 vars in 1334 bytes} [Sat Nov 27 20:51:56 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-26T20%3A51%3A56.367231&end=2021-11-28T20%3A51%3A56.367231&detailed=1 => generated 123 bytes in 457 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:57.332133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:57.333571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:57.344547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d41647c6-0e18-4c92-abbe-1c3bc27837f9 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "DELETE /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf" status: 204 len: 0 microversion: 2.1 time: 1.032917 Nov 27 20:51:57.345396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.345855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.346655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.348834 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1015/1973] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:56 2021] DELETE /compute/v2.1/images/22d97504-03fd-4e64-899d-f8e3a1d551cf => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:57.355696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d28d77f0-653e-4a01-9f7d-921ed90ce4eb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:57.356749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d28d77f0-653e-4a01-9f7d-921ed90ce4eb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:57.358019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.377377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28d77f0-653e-4a01-9f7d-921ed90ce4eb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.378472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28d77f0-653e-4a01-9f7d-921ed90ce4eb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.380593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28d77f0-653e-4a01-9f7d-921ed90ce4eb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.382966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28d77f0-653e-4a01-9f7d-921ed90ce4eb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.460463 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d28d77f0-653e-4a01-9f7d-921ed90ce4eb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.109128 Nov 27 20:51:57.462440 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1016/1974] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:57 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:57.474015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:57.475022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-95410c8f-7aa4-4553-997b-d68e55dac78b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:57.477629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-95410c8f-7aa4-4553-997b-d68e55dac78b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:57.485850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:57.487902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:57.489348 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1856da5e-d7fe-478c-a32e-0e4c363ddcea tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.176111 Nov 27 20:51:57.494901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95410c8f-7aa4-4553-997b-d68e55dac78b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.496471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95410c8f-7aa4-4553-997b-d68e55dac78b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.497317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95410c8f-7aa4-4553-997b-d68e55dac78b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.500278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95410c8f-7aa4-4553-997b-d68e55dac78b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.503016 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 959/1975] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:57 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:51:57.508849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c01d931-f622-4b96-8101-c9b18663be51 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '.version_select at 0x7f15d94d2040>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:57.541602 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-7c01d931-f622-4b96-8101-c9b18663be51 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] HTTP exception thrown: Image not found. Nov 27 20:51:57.542420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c01d931-f622-4b96-8101-c9b18663be51 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:51:57.543666 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c01d931-f622-4b96-8101-c9b18663be51 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "DELETE /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253" status: 404 len: 62 microversion: 2.1 time: 0.039288 Nov 27 20:51:57.544821 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 960/1976] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:57 2021] DELETE /compute/v2.1/images/9581e307-e685-4bb9-9880-3dc2eb824253 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:51:57.560575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:57.561084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:57.580228 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-95410c8f-7aa4-4553-997b-d68e55dac78b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.115025 Nov 27 20:51:57.581135 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1017/1977] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:57 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:57.588602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.589072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.590023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.590467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.628184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:51:57.754600 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f0bf047-0178-45f6-8c90-8c764849b924 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 204 len: 0 microversion: 2.1 time: 0.203732 Nov 27 20:51:57.757550 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 961/1978] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:51:57 2021] DELETE /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:51:57.765977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:57.767094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:57.777626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.779495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.780948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.781673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.854018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:57.854704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:57.867293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.867746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:57.868792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:57.872033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.105672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:58.115643 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-021ca4b9-2468-49e0-b74a-c350304f41e1 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1471 microversion: 2.1 time: 0.354316 Nov 27 20:51:58.117974 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1018/1979] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:57 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:58.216223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:58.226154 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb8f9a33-06bc-4d80-b8c2-facac76dc5ee tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1317 microversion: 2.1 time: 0.377138 Nov 27 20:51:58.237035 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 962/1980] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:57 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:51:58.473609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-679c5f41-8f83-4dee-a4a0-288a187ac486 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:58.474701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-679c5f41-8f83-4dee-a4a0-288a187ac486 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:58.487857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679c5f41-8f83-4dee-a4a0-288a187ac486 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:58.488308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679c5f41-8f83-4dee-a4a0-288a187ac486 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.489111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679c5f41-8f83-4dee-a4a0-288a187ac486 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:58.489545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679c5f41-8f83-4dee-a4a0-288a187ac486 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.517922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:58.520220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:58.535293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:58.536596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.537680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:58.538237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.572984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-679c5f41-8f83-4dee-a4a0-288a187ac486 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.099036 Nov 27 20:51:58.577166 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1019/1981] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:58 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:51:58.588022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5278a7c3-eb70-4a1b-b136-e0c7377e9aa9 req-525f4561-be05-4759-a0b9-fa37a519f180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78737951-b29d-4d2f-94c4-0538e549f0e5", "tag": "c363241a-abd6-49ee-b5ee-7e9f499d3cf2"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:58.589581 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:58.589581 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:51:58.610864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5278a7c3-eb70-4a1b-b136-e0c7377e9aa9 req-525f4561-be05-4759-a0b9-fa37a519f180 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:58.616093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5278a7c3-eb70-4a1b-b136-e0c7377e9aa9 req-525f4561-be05-4759-a0b9-fa37a519f180 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.634907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5278a7c3-eb70-4a1b-b136-e0c7377e9aa9 req-525f4561-be05-4759-a0b9-fa37a519f180 service nova] Creating event network-changed:c363241a-abd6-49ee-b5ee-7e9f499d3cf2 for instance 78737951-b29d-4d2f-94c4-0538e549f0e5 on nch1-master-1 Nov 27 20:51:58.642133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5278a7c3-eb70-4a1b-b136-e0c7377e9aa9 req-525f4561-be05-4759-a0b9-fa37a519f180 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062219 Nov 27 20:51:58.643104 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1020/1982] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:58.651976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0b4660a-459c-48a7-91c7-936af7b3e123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:58.653295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0b4660a-459c-48a7-91c7-936af7b3e123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:58.666269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0b4660a-459c-48a7-91c7-936af7b3e123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:58.667007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0b4660a-459c-48a7-91c7-936af7b3e123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.668242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0b4660a-459c-48a7-91c7-936af7b3e123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:58.670574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0b4660a-459c-48a7-91c7-936af7b3e123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:58.705573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:58.717675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:58.720256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:58.722142 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-218864ea-de23-40d3-9702-da43df64cf24 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1371 microversion: 2.57 time: 0.216317 Nov 27 20:51:58.724703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 963/1983] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:58 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:51:58.740731 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0b4660a-459c-48a7-91c7-936af7b3e123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.095793 Nov 27 20:51:58.742160 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1021/1984] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:58 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:59.134677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:59.136295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:59.143514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.144389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.145834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.146405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.245048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:59.245765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:59.265324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.265963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.269345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.269817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.390387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:59.399132 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b4fc254-c781-47cc-9b31-e6904c475192 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1471 microversion: 2.1 time: 0.267971 Nov 27 20:51:59.403672 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 964/1985] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:59 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:59.410416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0fedfbe4-9425-49c1-ac49-ef9d3f866b44 req-16015f31-99a5-4ffe-8be7-c55982a97f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cac25f4-3288-4ba2-ac3d-0e53d2203e05", "name": "network-vif-unplugged", "status": "completed", "tag": "970294ba-0041-4f63-b140-b50984e2960d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:59.416187 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:59.416187 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:59.436662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0fedfbe4-9425-49c1-ac49-ef9d3f866b44 req-16015f31-99a5-4ffe-8be7-c55982a97f1b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.437105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0fedfbe4-9425-49c1-ac49-ef9d3f866b44 req-16015f31-99a5-4ffe-8be7-c55982a97f1b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.460813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0fedfbe4-9425-49c1-ac49-ef9d3f866b44 req-16015f31-99a5-4ffe-8be7-c55982a97f1b service nova] Creating event network-vif-unplugged:970294ba-0041-4f63-b140-b50984e2960d for instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 on nch1-master-1 Nov 27 20:51:59.473779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0fedfbe4-9425-49c1-ac49-ef9d3f866b44 req-16015f31-99a5-4ffe-8be7-c55982a97f1b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068609 Nov 27 20:51:59.479268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 965/1986] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:51:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:59.632364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:51:59.640675 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e015c7fc-1d56-4af7-9957-368db4afe6c9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1317 microversion: 2.1 time: 0.400739 Nov 27 20:51:59.652882 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1022/1987] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:51:59 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:51:59.661661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7390e091-68c6-42e3-9e6e-682029626522 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:59.666499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7390e091-68c6-42e3-9e6e-682029626522 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:59.680023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7390e091-68c6-42e3-9e6e-682029626522 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.684557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7390e091-68c6-42e3-9e6e-682029626522 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.685589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7390e091-68c6-42e3-9e6e-682029626522 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.686202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7390e091-68c6-42e3-9e6e-682029626522 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.706551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4c6786ec-6e94-4778-aef5-95e6757f3cf1 tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] Calling method '.version_select at 0x7f15c729c5e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:59.707697 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:59.707697 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:59.723099 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4c6786ec-6e94-4778-aef5-95e6757f3cf1 tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.242193 Nov 27 20:51:59.724381 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 966/1988] 10.222.0.21 () {58 vars in 1184 bytes} [Sat Nov 27 20:51:59 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:51:59.738809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58774f69-2385-449b-a3b6-b20cfb9597ab tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] Action: 'update', calling method: .version_select at 0x7f15c7297670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:51:59.745300 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:51:59.745300 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:51:59.802409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7390e091-68c6-42e3-9e6e-682029626522 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.140243 Nov 27 20:51:59.804899 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1023/1989] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:51:59 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:51:59.818393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:51:59.820487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:51:59.830860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.831910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:51:59.832999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:51:59.833697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.023460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:00.031986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:00.045430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:00.046972 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-57927708-2a52-4618-bc89-58dcc67c6209 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1356 microversion: 2.57 time: 0.240901 Nov 27 20:52:00.047860 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1024/1990] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:51:59 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:52:00.065315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-34064737-55fa-498c-8138-51fbaf969123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:00.066615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-34064737-55fa-498c-8138-51fbaf969123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:00.076804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34064737-55fa-498c-8138-51fbaf969123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.077524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34064737-55fa-498c-8138-51fbaf969123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.078330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34064737-55fa-498c-8138-51fbaf969123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.079540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34064737-55fa-498c-8138-51fbaf969123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.148046 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-34064737-55fa-498c-8138-51fbaf969123 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.098658 Nov 27 20:52:00.149187 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1025/1991] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:00 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:00.162105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:00.162981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:00.176917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.188742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.190644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.191475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.230944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:00.319963 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58774f69-2385-449b-a3b6-b20cfb9597ab tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.589308 Nov 27 20:52:00.323016 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 967/1992] 10.222.0.21 () {60 vars in 1205 bytes} [Sat Nov 27 20:51:59 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:00.339163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-492de327-2b1f-4ac1-97ba-8fc4723dbd66 tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] Calling method '.version_select at 0x7f15c734f1f0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:00.373932 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-492de327-2b1f-4ac1-97ba-8fc4723dbd66 tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.038654 Nov 27 20:52:00.374955 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 968/1993] 10.222.0.21 () {58 vars in 1184 bytes} [Sat Nov 27 20:52:00 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:00.389532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-581a9d20-cd83-4c38-ba78-6f9aab7f90b7 tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] Action: 'update', calling method: .version_select at 0x7f15c735e820>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:00.566306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-581a9d20-cd83-4c38-ba78-6f9aab7f90b7 tempest-QuotaClassesAdminTestJSON-1651543402 tempest-QuotaClassesAdminTestJSON-1651543402-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.181217 Nov 27 20:52:00.571422 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 969/1994] 10.222.0.21 () {60 vars in 1205 bytes} [Sat Nov 27 20:52:00 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:00.582409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:00.583721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:00.617999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a3ccacd-f004-4df1-9854-80e528ef23b0 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 204 len: 0 microversion: 2.1 time: 0.465817 Nov 27 20:52:00.622613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.623439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.624841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.626662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.627521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1026/1995] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:00 2021] DELETE /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:00.661484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:00.664972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:00.694279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.695357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.696810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.697633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.926203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:00.940994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:00.942178 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e65d10b-1dc7-4c74-901f-741f55fc8a51 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1296 microversion: 2.1 time: 0.310506 Nov 27 20:52:00.943384 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1027/1996] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:00 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1296 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:00.955921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:00.960446 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ffa1bb68-3ee4-47b9-9731-d6e3240d0df6 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1429 microversion: 2.1 time: 0.391207 Nov 27 20:52:00.962171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:00.962338 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 970/1997] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:00 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1429 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:00.976382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc87aa77-614f-46e0-91ee-cc8595043706 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:00.977481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc87aa77-614f-46e0-91ee-cc8595043706 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:00.979150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.984017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.988814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.994543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.997598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc87aa77-614f-46e0-91ee-cc8595043706 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.998048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc87aa77-614f-46e0-91ee-cc8595043706 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:00.999026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc87aa77-614f-46e0-91ee-cc8595043706 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:00.999499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc87aa77-614f-46e0-91ee-cc8595043706 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:01.071881 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc87aa77-614f-46e0-91ee-cc8595043706 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.106735 Nov 27 20:52:01.077430 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 971/1998] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:00 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:01.389810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:01.407654 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ddfb42c-d083-42f3-8f9d-909fae997324 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1317 microversion: 2.1 time: 0.460033 Nov 27 20:52:01.411467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1028/1999] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:00 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:01.717359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b448ad78-8fdc-46e1-bf07-d3988817a849 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:01.718553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b448ad78-8fdc-46e1-bf07-d3988817a849 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:01.729749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b448ad78-8fdc-46e1-bf07-d3988817a849 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:01.730634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b448ad78-8fdc-46e1-bf07-d3988817a849 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:01.731741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b448ad78-8fdc-46e1-bf07-d3988817a849 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:01.736982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b448ad78-8fdc-46e1-bf07-d3988817a849 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:01.804621 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b448ad78-8fdc-46e1-bf07-d3988817a849 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.645693 Nov 27 20:52:01.805539 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 972/2000] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:01 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:01.921021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-bcbb1cc0-c94f-492e-b1f7-0437c6420ffc req-a3779ddf-47c7-48f5-8230-9ba075f81438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cac25f4-3288-4ba2-ac3d-0e53d2203e05", "name": "network-vif-deleted", "tag": "970294ba-0041-4f63-b140-b50984e2960d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:01.922390 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:01.922390 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:01.956426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bcbb1cc0-c94f-492e-b1f7-0437c6420ffc req-a3779ddf-47c7-48f5-8230-9ba075f81438 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:01.956949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bcbb1cc0-c94f-492e-b1f7-0437c6420ffc req-a3779ddf-47c7-48f5-8230-9ba075f81438 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.051485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-bcbb1cc0-c94f-492e-b1f7-0437c6420ffc req-a3779ddf-47c7-48f5-8230-9ba075f81438 service nova] Creating event network-vif-deleted:970294ba-0041-4f63-b140-b50984e2960d for instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 on nch1-master-1 Nov 27 20:52:02.080055 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-bcbb1cc0-c94f-492e-b1f7-0437c6420ffc req-a3779ddf-47c7-48f5-8230-9ba075f81438 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158811 Nov 27 20:52:02.081235 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 973/2001] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:02.082679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-63b7d10a-d796-4a6f-8244-480b7deefa16 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Calling method '.version_select at 0x7f15c75ab8b0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:02.098151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:02.099097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:02.112110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.113534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.114365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.114823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.126879 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-63b7d10a-d796-4a6f-8244-480b7deefa16 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] HTTP exception thrown: Image not found. Nov 27 20:52:02.127544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-63b7d10a-d796-4a6f-8244-480b7deefa16 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:02.128520 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-63b7d10a-d796-4a6f-8244-480b7deefa16 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] 10.222.0.21 "DELETE /compute/v2.1/images/add41092-f9fe-44d4-96cf-f236952c985c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.257052 Nov 27 20:52:02.129441 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1029/2002] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:52:01 2021] DELETE /compute/v2.1/images/add41092-f9fe-44d4-96cf-f236952c985c/metadata/os_distro => generated 62 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:02.163501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:02.164616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:02.176963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.177757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.178952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.179721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.230030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.230764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.231724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lazy-loading 'fault' on Instance uuid 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:52:02.237612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:02.258404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-542241c3-9822-4255-af78-a68913fdf986 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1296 microversion: 2.1 time: 0.175897 Nov 27 20:52:02.271922 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 974/2003] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:02 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1296 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:02.277144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88842d60-f893-4592-9673-02c5375ae20f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:02.283777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88842d60-f893-4592-9673-02c5375ae20f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:02.308001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88842d60-f893-4592-9673-02c5375ae20f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.308461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88842d60-f893-4592-9673-02c5375ae20f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.309269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88842d60-f893-4592-9673-02c5375ae20f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.309855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88842d60-f893-4592-9673-02c5375ae20f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.344628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e10693bd4a2442cb7c75cc61ccccc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7f37181c464b6fbd15d9f235d94086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:02.357513 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f95428fb-43da-4de7-9822-b76ab4113e38 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 200 len: 1306 microversion: 2.1 time: 0.210763 Nov 27 20:52:02.360276 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1030/2004] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:02 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 1306 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:02.372308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b7f4dd2-b09d-4009-b419-8408325b72f2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Calling method '.version_select at 0x7f15c74165e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:02.393322 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88842d60-f893-4592-9673-02c5375ae20f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.127407 Nov 27 20:52:02.394856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 975/2005] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:02 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:02.408527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2b7f4dd2-b09d-4009-b419-8408325b72f2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] HTTP exception thrown: Image not found. Nov 27 20:52:02.409310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b7f4dd2-b09d-4009-b419-8408325b72f2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:02.410329 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b7f4dd2-b09d-4009-b419-8408325b72f2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] 10.222.0.21 "GET /compute/v2.1/images/67168303-82d9-482c-b3f2-4d545140c2ad/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.048889 Nov 27 20:52:02.420803 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1031/2006] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:52:02 2021] GET /compute/v2.1/images/67168303-82d9-482c-b3f2-4d545140c2ad/metadata/os_version => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:02.436832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3a2840e-54eb-4c3b-b7de-34beab46b425 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Calling method '.version_select at 0x7f15c7fdc9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:02.445626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:02.453449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:02.471500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.472293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.473283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.474260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.478289 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b3a2840e-54eb-4c3b-b7de-34beab46b425 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] HTTP exception thrown: Image not found. Nov 27 20:52:02.479104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3a2840e-54eb-4c3b-b7de-34beab46b425 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:02.482775 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3a2840e-54eb-4c3b-b7de-34beab46b425 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] 10.222.0.21 "GET /compute/v2.1/images/bae44df8-41d6-4996-93f5-af736e4bf92f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062248 Nov 27 20:52:02.487687 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 976/2007] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:52:02 2021] GET /compute/v2.1/images/bae44df8-41d6-4996-93f5-af736e4bf92f/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 27 20:52:02.495880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-edb8cc61-9415-41e7-8978-96c0cdbd9c89 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Action: 'update_all', calling method: .version_select at 0x7f15d4130160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:02.537983 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-edb8cc61-9415-41e7-8978-96c0cdbd9c89 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] HTTP exception thrown: Image not found. Nov 27 20:52:02.538953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-edb8cc61-9415-41e7-8978-96c0cdbd9c89 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:02.539818 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-edb8cc61-9415-41e7-8978-96c0cdbd9c89 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] 10.222.0.21 "PUT /compute/v2.1/images/371eaae9-8848-4881-9595-eae70abf2068/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050355 Nov 27 20:52:02.540399 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 977/2008] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:52:02 2021] PUT /compute/v2.1/images/371eaae9-8848-4881-9595-eae70abf2068/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:02.550780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53d36ff1-6bfa-49d7-a172-2b9ef87ee379 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Action: 'update', calling method: .version_select at 0x7f15c787e040>, body: {"meta": {"os_distro": "alt"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:02.584243 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-53d36ff1-6bfa-49d7-a172-2b9ef87ee379 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] HTTP exception thrown: Image not found. Nov 27 20:52:02.585126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53d36ff1-6bfa-49d7-a172-2b9ef87ee379 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:02.586404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53d36ff1-6bfa-49d7-a172-2b9ef87ee379 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] 10.222.0.21 "PUT /compute/v2.1/images/4fda1cf3-636a-4bf6-ad6b-8e08a7e772cc/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.040071 Nov 27 20:52:02.587567 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 978/2009] 10.222.0.21 () {60 vars in 1309 bytes} [Sat Nov 27 20:52:02 2021] PUT /compute/v2.1/images/4fda1cf3-636a-4bf6-ad6b-8e08a7e772cc/metadata/os_distro => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:02.598432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b922a55a-3236-4bba-ae02-875ba53664a2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Action: 'create', calling method: .version_select at 0x7f15c7e833a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:02.630590 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b922a55a-3236-4bba-ae02-875ba53664a2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] HTTP exception thrown: Image not found. Nov 27 20:52:02.631215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b922a55a-3236-4bba-ae02-875ba53664a2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:02.632198 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b922a55a-3236-4bba-ae02-875ba53664a2 tempest-ImagesMetadataNegativeTestJSON-1772676646 tempest-ImagesMetadataNegativeTestJSON-1772676646-project] 10.222.0.21 "POST /compute/v2.1/images/b28a36fc-5b02-48e2-a466-97f6addedc2c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.038131 Nov 27 20:52:02.634779 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 979/2010] 10.222.0.21 () {60 vars in 1280 bytes} [Sat Nov 27 20:52:02 2021] POST /compute/v2.1/images/b28a36fc-5b02-48e2-a466-97f6addedc2c/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:02.821279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd191e36-d82f-4b15-81e1-1e43c1dadf8b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:02.822341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd191e36-d82f-4b15-81e1-1e43c1dadf8b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:02.832468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd191e36-d82f-4b15-81e1-1e43c1dadf8b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.832918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd191e36-d82f-4b15-81e1-1e43c1dadf8b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.834117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd191e36-d82f-4b15-81e1-1e43c1dadf8b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:02.835065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd191e36-d82f-4b15-81e1-1e43c1dadf8b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:02.895122 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd191e36-d82f-4b15-81e1-1e43c1dadf8b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.082328 Nov 27 20:52:02.899320 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 980/2011] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:02 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:03.237653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:03.247600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-422a7091-dac8-407c-bf9f-11168728b804 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1317 microversion: 2.1 time: 0.821785 Nov 27 20:52:03.248868 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1032/2012] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:02 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:03.278574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:03.279280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:03.288242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.288927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.289715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.290150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.361667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7415c3ef574fde8b4e378d3f787cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bcc58fc8444ca188eb8b273931ea09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:03.372654 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dbf3de4b-2d2f-4ba5-aa6d-c0968362bfce tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 200 len: 1296 microversion: 2.1 time: 0.098007 Nov 27 20:52:03.373645 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 981/2013] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:03 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:03.374999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:03.376199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] [instance: 6cac25f4-3288-4ba2-ac3d-0e53d2203e05] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:03.384857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.385322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.386125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.386574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.402616 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] HTTP exception thrown: Instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 could not be found. Nov 27 20:52:03.403265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] Returning 404 to user: Instance 6cac25f4-3288-4ba2-ac3d-0e53d2203e05 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:03.404119 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7eafedb7-fda3-4582-a9d3-23f6a4c9a526 tempest-ImagesOneServerTestJSON-1137655117 tempest-ImagesOneServerTestJSON-1137655117-project] 10.222.0.21 "GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05" status: 404 len: 111 microversion: 2.1 time: 0.033000 Nov 27 20:52:03.404744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abe97ba4-31eb-459d-a64a-fe70d796e7b2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:03.405725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abe97ba4-31eb-459d-a64a-fe70d796e7b2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:03.408158 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1033/2014] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:03 2021] GET /compute/v2.1/servers/6cac25f4-3288-4ba2-ac3d-0e53d2203e05 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:52:03.414974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe97ba4-31eb-459d-a64a-fe70d796e7b2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.415457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe97ba4-31eb-459d-a64a-fe70d796e7b2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.416253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe97ba4-31eb-459d-a64a-fe70d796e7b2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.416689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe97ba4-31eb-459d-a64a-fe70d796e7b2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.492273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abe97ba4-31eb-459d-a64a-fe70d796e7b2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.088966 Nov 27 20:52:03.494663 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 982/2015] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:03 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:03.617095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-78d4a331-b068-48d6-af04-37cf424716f4 req-e03bfd23-a9b3-4b1a-abd8-51a47a1ea6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78737951-b29d-4d2f-94c4-0538e549f0e5", "name": "network-vif-plugged", "status": "completed", "tag": "c363241a-abd6-49ee-b5ee-7e9f499d3cf2"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:03.622345 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:03.622345 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:03.645175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-78d4a331-b068-48d6-af04-37cf424716f4 req-e03bfd23-a9b3-4b1a-abd8-51a47a1ea6d8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.646240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-78d4a331-b068-48d6-af04-37cf424716f4 req-e03bfd23-a9b3-4b1a-abd8-51a47a1ea6d8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.667558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-78d4a331-b068-48d6-af04-37cf424716f4 req-e03bfd23-a9b3-4b1a-abd8-51a47a1ea6d8 service nova] Creating event network-vif-plugged:c363241a-abd6-49ee-b5ee-7e9f499d3cf2 for instance 78737951-b29d-4d2f-94c4-0538e549f0e5 on nch1-master-1 Nov 27 20:52:03.677727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-78d4a331-b068-48d6-af04-37cf424716f4 req-e03bfd23-a9b3-4b1a-abd8-51a47a1ea6d8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068242 Nov 27 20:52:03.678730 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1034/2016] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:03.910378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9e5d3e8-0230-4072-b0e7-a888c6b39375 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:03.911118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9e5d3e8-0230-4072-b0e7-a888c6b39375 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:03.921642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9e5d3e8-0230-4072-b0e7-a888c6b39375 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.922085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9e5d3e8-0230-4072-b0e7-a888c6b39375 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:03.940000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9e5d3e8-0230-4072-b0e7-a888c6b39375 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:03.940473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9e5d3e8-0230-4072-b0e7-a888c6b39375 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:04.181059 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9e5d3e8-0230-4072-b0e7-a888c6b39375 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.276358 Nov 27 20:52:04.182393 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 983/2017] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:03 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:04.266048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:04.267669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:04.282072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:04.283696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:04.286266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:04.287691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:04.391031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:04.391948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] [instance: 0d25a55d-44b1-4947-8540-688f87f1edae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:04.406791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:04.407542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:04.408562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:04.412239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:04.469934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] HTTP exception thrown: Instance 0d25a55d-44b1-4947-8540-688f87f1edae could not be found. Nov 27 20:52:04.472819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] Returning 404 to user: Instance 0d25a55d-44b1-4947-8540-688f87f1edae could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:04.473936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d58d2e4-be28-48cb-99c4-4473cba30bc1 tempest-ServerShowV257Test-637799521 tempest-ServerShowV257Test-637799521-project] 10.222.0.21 "GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae" status: 404 len: 111 microversion: 2.1 time: 0.087949 Nov 27 20:52:04.480128 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 984/2018] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:04 2021] GET /compute/v2.1/servers/0d25a55d-44b1-4947-8540-688f87f1edae => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:04.506140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9931f0be-6bf5-484a-a54c-9c6a04a84e02 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:04.507154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9931f0be-6bf5-484a-a54c-9c6a04a84e02 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:04.523280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9931f0be-6bf5-484a-a54c-9c6a04a84e02 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:04.523762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9931f0be-6bf5-484a-a54c-9c6a04a84e02 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:04.524669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9931f0be-6bf5-484a-a54c-9c6a04a84e02 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:04.525104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9931f0be-6bf5-484a-a54c-9c6a04a84e02 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:04.608369 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9931f0be-6bf5-484a-a54c-9c6a04a84e02 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.107630 Nov 27 20:52:04.609029 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 985/2019] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:04 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:04.758656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:04.767535 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4519f54-f861-4812-9f32-601bce6281d8 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1317 microversion: 2.1 time: 0.505368 Nov 27 20:52:04.780575 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1035/2020] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:04 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:05.196901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98dbba68-b01b-47d1-acaf-a0290b0ef956 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:05.199012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98dbba68-b01b-47d1-acaf-a0290b0ef956 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:05.220902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98dbba68-b01b-47d1-acaf-a0290b0ef956 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:05.223643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98dbba68-b01b-47d1-acaf-a0290b0ef956 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:05.224671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98dbba68-b01b-47d1-acaf-a0290b0ef956 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:05.229638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98dbba68-b01b-47d1-acaf-a0290b0ef956 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:05.358233 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98dbba68-b01b-47d1-acaf-a0290b0ef956 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.168552 Nov 27 20:52:05.364051 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 986/2021] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:05 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:05.620963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b8272a2-0b8e-440c-9469-4520e88d3676 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:05.622075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b8272a2-0b8e-440c-9469-4520e88d3676 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:05.629379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8272a2-0b8e-440c-9469-4520e88d3676 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:05.633577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8272a2-0b8e-440c-9469-4520e88d3676 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:05.636615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8272a2-0b8e-440c-9469-4520e88d3676 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:05.637412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8272a2-0b8e-440c-9469-4520e88d3676 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:05.715580 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b8272a2-0b8e-440c-9469-4520e88d3676 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.098286 Nov 27 20:52:05.717076 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1036/2022] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:05 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:05.789742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:05.792085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:05.810244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:05.810696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:05.811582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:05.812032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.119932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:06.128480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f500b33f-cd9a-455b-9656-e466024ec510 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1467 microversion: 2.1 time: 0.342902 Nov 27 20:52:06.146764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1b41911-b4f9-45f4-a099-9ae816681816 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:06.147518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1b41911-b4f9-45f4-a099-9ae816681816 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:06.151335 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 987/2023] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:05 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1467 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:06.155155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1b41911-b4f9-45f4-a099-9ae816681816 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.155913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1b41911-b4f9-45f4-a099-9ae816681816 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.156764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1b41911-b4f9-45f4-a099-9ae816681816 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.157512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1b41911-b4f9-45f4-a099-9ae816681816 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.434440 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 20:52:06.434646 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 20:52:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 (ip 10.222.0.21) !!! Nov 27 20:52:06.531674 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1b41911-b4f9-45f4-a099-9ae816681816 tempest-ServersOnMultiNodesTest-1817299780 tempest-ServersOnMultiNodesTest-1817299780-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1618 microversion: 2.1 time: 0.389148 Nov 27 20:52:06.534720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1037/2024] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:06 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1618 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:06.554515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c17efdc4-b50f-44c9-ad1d-89eed07db451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:06.555503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c17efdc4-b50f-44c9-ad1d-89eed07db451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:06.576325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17efdc4-b50f-44c9-ad1d-89eed07db451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.576790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17efdc4-b50f-44c9-ad1d-89eed07db451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.580364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17efdc4-b50f-44c9-ad1d-89eed07db451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.580975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c17efdc4-b50f-44c9-ad1d-89eed07db451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.642460 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c17efdc4-b50f-44c9-ad1d-89eed07db451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.104219 Nov 27 20:52:06.644496 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1038/2025] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:06 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:06.651992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:06.652954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:06.662575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.663628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.664717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.665331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.711773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:06.817566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c7d90670>, body: {"keypair": {"name": "tempest-keypair-1059852590"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:06.859439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:06.871334 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fcf28e19-ae98-4997-8ee8-a714a0812b1d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 204 len: 0 microversion: 2.1 time: 0.222565 Nov 27 20:52:06.873603 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1039/2026] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:06 2021] DELETE /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:06.874602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:06.888308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a901daf0-48eb-43d9-b748-1725ac32be1e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:06.892526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a901daf0-48eb-43d9-b748-1725ac32be1e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:06.904526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a901daf0-48eb-43d9-b748-1725ac32be1e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.905371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a901daf0-48eb-43d9-b748-1725ac32be1e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.910311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a901daf0-48eb-43d9-b748-1725ac32be1e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:06.912826 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] [14fe4436-aa96-4a19-b938-ee833bc206f9] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 20:52:06.913266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a901daf0-48eb-43d9-b748-1725ac32be1e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:06.985788 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a901daf0-48eb-43d9-b748-1725ac32be1e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.107912 Nov 27 20:52:06.995444 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1040/2027] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:06 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:07.006560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:07.007339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:07.014342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:07.015004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:07.015862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:07.017975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:07.203332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:07.222110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-14cc772a-8c00-4c2a-912d-52c4b9b9395a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1473 microversion: 2.1 time: 0.226665 Nov 27 20:52:07.223181 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1041/2028] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:06 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:07.497070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-280225d0-f4a1-4db1-9cef-668bf46539cc tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Action: 'create', calling method: .version_select at 0x7f15c77ff160>, body: {"pool": null} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:07.941664 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] [14fe4436-aa96-4a19-b938-ee833bc206f9] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 50792. Nov 27 20:52:08.393592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:08.405642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:08.444384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21a55522-5ec5-4406-93f9-8af85c954ff8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 2.136141 Nov 27 20:52:08.450171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 988/2029] 10.222.0.21 () {62 vars in 1197 bytes} [Sat Nov 27 20:52:06 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2143 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:52:08.704616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f44ff725-3802-4dbc-9d2e-479e61497701 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Calling method '.version_select at 0x7f15c7dbbc10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:08.778701 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f44ff725-3802-4dbc-9d2e-479e61497701 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 371 microversion: 2.1 time: 0.327080 Nov 27 20:52:08.788401 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 989/2030] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:52:08 2021] GET /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:08.793618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd03e8cf-ce45-4872-9027-49a7bfc26cb1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:08.795182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd03e8cf-ce45-4872-9027-49a7bfc26cb1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:08.804551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd03e8cf-ce45-4872-9027-49a7bfc26cb1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:08.805383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd03e8cf-ce45-4872-9027-49a7bfc26cb1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:08.806419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd03e8cf-ce45-4872-9027-49a7bfc26cb1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:08.807085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd03e8cf-ce45-4872-9027-49a7bfc26cb1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:08.856040 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd03e8cf-ce45-4872-9027-49a7bfc26cb1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.065836 Nov 27 20:52:08.857867 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 990/2031] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:08 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:08.865041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c64d5432-6abb-493e-9355-5ed1d7cd94a9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:08.866456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c64d5432-6abb-493e-9355-5ed1d7cd94a9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:08.878469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64d5432-6abb-493e-9355-5ed1d7cd94a9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:08.879655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64d5432-6abb-493e-9355-5ed1d7cd94a9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:08.881125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64d5432-6abb-493e-9355-5ed1d7cd94a9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:08.881891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64d5432-6abb-493e-9355-5ed1d7cd94a9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:08.954599 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c64d5432-6abb-493e-9355-5ed1d7cd94a9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.093700 Nov 27 20:52:08.955692 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 991/2032] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:08 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:08.966995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:08.968004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:08.985031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:08.987292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:08.988435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:08.988948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:09.200222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-280225d0-f4a1-4db1-9cef-668bf46539cc tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.975618 Nov 27 20:52:09.201438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1042/2033] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:52:07 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:09.302396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1269556191", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "51800357-640d-4106-97ff-61854e2562e6"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:09.364457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] validate_networks() for [('51800357-640d-4106-97ff-61854e2562e6', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:09.483611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:09.501996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-224dfd14-01e3-49f3-9935-e5c0d6392648 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 200 len: 1473 microversion: 2.1 time: 0.544561 Nov 27 20:52:09.503981 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 992/2034] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:08 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 1473 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:09.520984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3788ea95-838b-4cbe-a887-bd4415d2335f tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15d4074430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:09.543291 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3788ea95-838b-4cbe-a887-bd4415d2335f tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs/tempest-keypair-1059852590" status: 200 len: 706 microversion: 2.2 time: 0.037506 Nov 27 20:52:09.544289 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 993/2035] 10.222.0.21 () {60 vars in 1257 bytes} [Sat Nov 27 20:52:09 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1059852590 => generated 706 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:09.553547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5295f5cf-1925-456d-a5f6-5c84c03a4de1 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Action: 'update', calling method: .version_select at 0x7f15c787e310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:09.555799 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:09.555799 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:09.661178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f5cf-1925-456d-a5f6-5c84c03a4de1 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:09.662049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f5cf-1925-456d-a5f6-5c84c03a4de1 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:09.663173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f5cf-1925-456d-a5f6-5c84c03a4de1 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:09.663706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f5cf-1925-456d-a5f6-5c84c03a4de1 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:09.770865 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5295f5cf-1925-456d-a5f6-5c84c03a4de1 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 328 microversion: 2.1 time: 0.225241 Nov 27 20:52:09.774370 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 994/2036] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:52:09 2021] PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:09.783544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2fc4df91-9b9a-47e4-a4c5-f1b638a5a95e tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Calling method '.version_select at 0x7f15c729c040>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:10.214223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:10.214728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:10.215114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:10.215544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:10.215948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:10.238078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:10.239215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:10.241061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:10.241921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:10.267163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for project 483860ef169447208569ca7510affe41. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:10.273764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for user 4143c311f90d4b6bbae7b8eddcbef26f and project 483860ef169447208569ca7510affe41. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:10.277395 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2fc4df91-9b9a-47e4-a4c5-f1b638a5a95e tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips/3bd5ace4-2e79-4bda-9f9f-4e6b22ab2aae" status: 200 len: 142 microversion: 2.1 time: 0.501912 Nov 27 20:52:10.278564 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 995/2037] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:52:09 2021] GET /compute/v2.1/os-floating-ips/3bd5ace4-2e79-4bda-9f9f-4e6b22ab2aae => generated 142 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:10.283332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b5e32f1e-1975-49bc-94fe-36f98944c6c6 req-f8088993-de4d-4fd3-bbd6-7fce7b77734f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78737951-b29d-4d2f-94c4-0538e549f0e5", "name": "network-vif-deleted", "tag": "c363241a-abd6-49ee-b5ee-7e9f499d3cf2"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:10.284835 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:10.284835 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:10.297032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b5e32f1e-1975-49bc-94fe-36f98944c6c6 req-f8088993-de4d-4fd3-bbd6-7fce7b77734f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:10.298020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b5e32f1e-1975-49bc-94fe-36f98944c6c6 req-f8088993-de4d-4fd3-bbd6-7fce7b77734f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:10.302413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:52:10.308756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:52:10.315104 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b5e32f1e-1975-49bc-94fe-36f98944c6c6 req-f8088993-de4d-4fd3-bbd6-7fce7b77734f service nova] Creating event network-vif-deleted:c363241a-abd6-49ee-b5ee-7e9f499d3cf2 for instance 78737951-b29d-4d2f-94c4-0538e549f0e5 on nch1-master-1 Nov 27 20:52:10.320514 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b5e32f1e-1975-49bc-94fe-36f98944c6c6 req-f8088993-de4d-4fd3-bbd6-7fce7b77734f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040812 Nov 27 20:52:10.323581 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 996/2038] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:10.333787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66b63240-816d-4335-91bc-d77809ea5874 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15d94bd160>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:10.370645 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66b63240-816d-4335-91bc-d77809ea5874 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059852590" status: 204 len: 0 microversion: 2.2 time: 0.045375 Nov 27 20:52:10.391782 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 997/2039] 10.222.0.21 () {60 vars in 1260 bytes} [Sat Nov 27 20:52:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059852590 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:10.392240 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c9a2136-38c3-4f5e-abcf-03c4df35fe6a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187492 Nov 27 20:52:10.398487 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1043/2040] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:52:10.398649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf2c5a6f-6cbf-41d4-acf1-a91b0fa4b61b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:10.399635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf2c5a6f-6cbf-41d4-acf1-a91b0fa4b61b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:10.406015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf2c5a6f-6cbf-41d4-acf1-a91b0fa4b61b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:10.406478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf2c5a6f-6cbf-41d4-acf1-a91b0fa4b61b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:10.407286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:10.407452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf2c5a6f-6cbf-41d4-acf1-a91b0fa4b61b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:10.407796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf2c5a6f-6cbf-41d4-acf1-a91b0fa4b61b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:10.408431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:10.431718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:10.432187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:10.433023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:10.433460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:10.472151 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf2c5a6f-6cbf-41d4-acf1-a91b0fa4b61b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.081899 Nov 27 20:52:10.472822 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 998/2041] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:10 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:10.508405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.111820 Nov 27 20:52:10.515037 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1044/2042] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:10 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:10.516714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:10.517733 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f77a674-1afa-4357-9bcf-9b09d9524819 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001550 Nov 27 20:52:10.518128 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1045/2043] 10.222.0.21 () {56 vars in 885 bytes} [Sat Nov 27 20:52:10 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 27 20:52:10.540629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68ad1dbd-1f93-46f1-89c3-f62c53047cd9 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Calling method '.version_select at 0x7f15c7416670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:10.597730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1969765975", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:10.709649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:10.985904 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68ad1dbd-1f93-46f1-89c3-f62c53047cd9 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.466594 Nov 27 20:52:10.994743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1046/2044] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:52:10 2021] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:11.000030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a1a7f29-7d7f-448b-acbc-c13cb77f4a02 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c77360d0>, body: {"keypair": {"name": "tempest-keypair-621237884"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:11.018201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7a1a7f29-7d7f-448b-acbc-c13cb77f4a02 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:11.025937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7a1a7f29-7d7f-448b-acbc-c13cb77f4a02 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:11.066451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:11.066969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:11.067572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:11.067987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:11.068394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:11.097561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.102240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.107704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.114161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.171428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Getting quotas for project 742998b08aec4df0844e1fbf2ecb4479. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:11.182132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Getting quotas for user 577c5d661d1a43a38e41deeca0c88aa7 and project 742998b08aec4df0844e1fbf2ecb4479. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:11.198531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.utils [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] cores quota exceeded for 742998b08aec4df0844e1fbf2ecb4479, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=135679) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Nov 27 20:52:11.199697 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 27 20:52:11.200551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:11.201616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea55486b-5e1f-4be4-93e6-ec412018aaed tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.727734 Nov 27 20:52:11.203049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 999/2045] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:10 2021] POST /compute/v2.1/servers => generated 111 bytes in 730 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:11.208725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:11.209893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:11.218167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.219150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.222180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.223167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.450062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7a1a7f29-7d7f-448b-acbc-c13cb77f4a02 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:11.462436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7a1a7f29-7d7f-448b-acbc-c13cb77f4a02 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:11.488042 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a1a7f29-7d7f-448b-acbc-c13cb77f4a02 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.491518 Nov 27 20:52:11.492493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1047/2046] 10.222.0.21 () {62 vars in 1197 bytes} [Sat Nov 27 20:52:10 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 497 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:11.498499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:11.499485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 78737951-b29d-4d2f-94c4-0538e549f0e5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:11.508147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.508624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.509421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.509854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.543392 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance 78737951-b29d-4d2f-94c4-0538e549f0e5 could not be found. Nov 27 20:52:11.544005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance 78737951-b29d-4d2f-94c4-0538e549f0e5 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:11.544855 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44c8445f-c1ec-4e48-a235-8c052486802a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5" status: 404 len: 111 microversion: 2.1 time: 0.051291 Nov 27 20:52:11.545651 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1048/2047] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:11 2021] GET /compute/v2.1/servers/78737951-b29d-4d2f-94c4-0538e549f0e5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:11.557446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:11.558065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c5820d0-9c17-432c-a973-99abe48367c4 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Calling method '.version_select at 0x7f15c7736310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:11.579657 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9219ceaa-5101-44ac-9457-28099bb581ff tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1229 microversion: 2.1 time: 0.373816 Nov 27 20:52:11.590581 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1000/2048] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:11 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1229 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:11.596361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-708f2cbb-da50-4621-bf6d-dca221485419 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Action: 'update', calling method: .version_select at 0x7f15d4155ee0>, body: {"quota_set": {"cores": 20}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:11.599014 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:11.599014 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:11.714587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-708f2cbb-da50-4621-bf6d-dca221485419 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.715283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-708f2cbb-da50-4621-bf6d-dca221485419 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.716287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-708f2cbb-da50-4621-bf6d-dca221485419 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.716941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-708f2cbb-da50-4621-bf6d-dca221485419 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.806831 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-708f2cbb-da50-4621-bf6d-dca221485419 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 329 microversion: 2.1 time: 0.214767 Nov 27 20:52:11.808180 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1001/2049] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:52:11 2021] PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 329 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:11.817628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-437ef7da-7c76-4558-95f0-96f11023c282 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:11.818812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-437ef7da-7c76-4558-95f0-96f11023c282 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:11.825252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-437ef7da-7c76-4558-95f0-96f11023c282 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.825954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-437ef7da-7c76-4558-95f0-96f11023c282 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.826960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-437ef7da-7c76-4558-95f0-96f11023c282 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.827605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-437ef7da-7c76-4558-95f0-96f11023c282 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.884543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-437ef7da-7c76-4558-95f0-96f11023c282 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.074842 Nov 27 20:52:11.885658 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1002/2050] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:11 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:11.898145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b76ed8b-a807-4930-ad46-dad9d7ffa239 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c7dbbd30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:11.930438 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b76ed8b-a807-4930-ad46-dad9d7ffa239 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621237884" status: 204 len: 0 microversion: 2.2 time: 0.043496 Nov 27 20:52:11.931406 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1003/2051] 10.222.0.21 () {60 vars in 1257 bytes} [Sat Nov 27 20:52:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621237884 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:11.938967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-528086d5-fb64-41da-8a23-658698b6fc04 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:11.940339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-528086d5-fb64-41da-8a23-658698b6fc04 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:11.958130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-528086d5-fb64-41da-8a23-658698b6fc04 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.961321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-528086d5-fb64-41da-8a23-658698b6fc04 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:11.962159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-528086d5-fb64-41da-8a23-658698b6fc04 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:11.967519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-528086d5-fb64-41da-8a23-658698b6fc04 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:12.033155 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-528086d5-fb64-41da-8a23-658698b6fc04 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.100653 Nov 27 20:52:12.034222 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1004/2052] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:11 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:12.040404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:12.040977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:12.051540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:12.052425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:12.053516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:12.053759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:12.092485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:12.229807 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a139615e-9dc0-4952-900e-8efbc8bb149c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 204 len: 0 microversion: 2.1 time: 0.194101 Nov 27 20:52:12.230703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1005/2053] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:12 2021] DELETE /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:12.237047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48087cfa-7f06-4a04-9cd1-5bb85488b933 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Calling method '.version_select at 0x7f15c78a9790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:12.522412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48087cfa-7f06-4a04-9cd1-5bb85488b933 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 371 microversion: 2.1 time: 0.290094 Nov 27 20:52:12.536046 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1006/2054] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:52:12 2021] GET /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:12.543072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-276a8004-10c7-4f7c-87fe-8a5c6e4ca10e tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c7dbb700>, body: {"keypair": {"name": "tempest-keypair-989476285", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:12.559897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-276a8004-10c7-4f7c-87fe-8a5c6e4ca10e tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:12.565927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-276a8004-10c7-4f7c-87fe-8a5c6e4ca10e tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:12.601035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-276a8004-10c7-4f7c-87fe-8a5c6e4ca10e tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.061936 Nov 27 20:52:12.607609 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1007/2055] 10.222.0.21 () {62 vars in 1198 bytes} [Sat Nov 27 20:52:12 2021] POST /compute/v2.1/os-keypairs => generated 588 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 27 20:52:12.612463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:12.613210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:12.619613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:12.620076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:12.620886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:12.621332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:12.877147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:12.887595 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ca02547-3eda-4ae9-9840-b2868d177e89 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1472 microversion: 2.1 time: 0.278331 Nov 27 20:52:12.889100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1008/2056] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:12 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:12.909606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53cb41dd-04d1-4f76-819b-d08f4b23f28e tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Action: 'update', calling method: .version_select at 0x7f15d40bc8b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:12.919901 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:12.919901 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:13.134980 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c5820d0-9c17-432c-a973-99abe48367c4 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/3bd5ace4-2e79-4bda-9f9f-4e6b22ab2aae" status: 202 len: 0 microversion: 2.1 time: 1.580828 Nov 27 20:52:13.140930 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1049/2057] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:52:11 2021] DELETE /compute/v2.1/os-floating-ips/3bd5ace4-2e79-4bda-9f9f-4e6b22ab2aae => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:52:13.148117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:13.148762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:13.158166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.159857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.161149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.162019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.221712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53cb41dd-04d1-4f76-819b-d08f4b23f28e tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.222207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53cb41dd-04d1-4f76-819b-d08f4b23f28e tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.223002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53cb41dd-04d1-4f76-819b-d08f4b23f28e tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.223501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53cb41dd-04d1-4f76-819b-d08f4b23f28e tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.304931 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53cb41dd-04d1-4f76-819b-d08f4b23f28e tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 328 microversion: 2.1 time: 0.404608 Nov 27 20:52:13.308123 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1009/2058] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:52:12 2021] PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 328 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:13.313590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73d370bd-f2e0-47a2-a9b5-3a3c91fdaca1 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c727ec10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:13.353197 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73d370bd-f2e0-47a2-a9b5-3a3c91fdaca1 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989476285" status: 204 len: 0 microversion: 2.2 time: 0.046518 Nov 27 20:52:13.358028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1010/2059] 10.222.0.21 () {60 vars in 1257 bytes} [Sat Nov 27 20:52:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989476285 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:13.362467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dada0589-19ef-45ae-ab59-5b567e68fff1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:13.363435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dada0589-19ef-45ae-ab59-5b567e68fff1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:13.370300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dada0589-19ef-45ae-ab59-5b567e68fff1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.370751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dada0589-19ef-45ae-ab59-5b567e68fff1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.371582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dada0589-19ef-45ae-ab59-5b567e68fff1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.372084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dada0589-19ef-45ae-ab59-5b567e68fff1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.385232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:13.395902 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa2acc61-f3ac-4c24-b5ec-4408c7fe315c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1325 microversion: 2.1 time: 0.252799 Nov 27 20:52:13.396420 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1050/2060] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:13 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:13.407658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23c18ec9-c5aa-4667-9c93-5edd23b4e834 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:13.408650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23c18ec9-c5aa-4667-9c93-5edd23b4e834 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:13.420061 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dada0589-19ef-45ae-ab59-5b567e68fff1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.064478 Nov 27 20:52:13.422105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1011/2061] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:13 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:13.424528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23c18ec9-c5aa-4667-9c93-5edd23b4e834 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.426248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23c18ec9-c5aa-4667-9c93-5edd23b4e834 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.427243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23c18ec9-c5aa-4667-9c93-5edd23b4e834 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:13.427713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23c18ec9-c5aa-4667-9c93-5edd23b4e834 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:13.433983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1851e61-0d4e-417e-b100-739cb953ea90 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Action: 'create', calling method: .version_select at 0x7f15d94bdd30>, body: {"pool": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:13.482222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23c18ec9-c5aa-4667-9c93-5edd23b4e834 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.083003 Nov 27 20:52:13.483228 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1051/2062] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:13 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:13.489016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b36496e7-687f-4805-ad1e-136986aa47d4 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c77ee670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-879994403"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:13.505276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b36496e7-687f-4805-ad1e-136986aa47d4 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:13.511756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b36496e7-687f-4805-ad1e-136986aa47d4 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:13.730617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b36496e7-687f-4805-ad1e-136986aa47d4 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:13.736496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b36496e7-687f-4805-ad1e-136986aa47d4 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:13.751752 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b36496e7-687f-4805-ad1e-136986aa47d4 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.267155 Nov 27 20:52:13.752364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1052/2063] 10.222.0.21 () {62 vars in 1197 bytes} [Sat Nov 27 20:52:13 2021] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 268 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:13.756938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1190341880", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:13.813786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:14.019641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:14.020576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:14.021177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:14.022212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:14.022632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:14.032740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.033198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:14.034034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.034479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:14.053451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Getting quotas for project 742998b08aec4df0844e1fbf2ecb4479. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:14.058764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Getting quotas for user 577c5d661d1a43a38e41deeca0c88aa7 and project 742998b08aec4df0844e1fbf2ecb4479. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:14.071912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.utils [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] instances quota exceeded for 742998b08aec4df0844e1fbf2ecb4479, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=135680) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Nov 27 20:52:14.073027 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 27 20:52:14.073932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:14.074789 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fb2b9a52-f41f-44c7-ab7d-b143d3ee8134 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.321467 Nov 27 20:52:14.075416 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1053/2064] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:13 2021] POST /compute/v2.1/servers => generated 119 bytes in 322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:14.080297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-952b0d9d-af1b-4aeb-b4c1-15b3d705601d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c77368b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1457103611"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:14.094769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-952b0d9d-af1b-4aeb-b4c1-15b3d705601d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:14.099736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-952b0d9d-af1b-4aeb-b4c1-15b3d705601d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:14.174715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-952b0d9d-af1b-4aeb-b4c1-15b3d705601d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:14.179914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-952b0d9d-af1b-4aeb-b4c1-15b3d705601d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:14.199744 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-952b0d9d-af1b-4aeb-b4c1-15b3d705601d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.123231 Nov 27 20:52:14.200650 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1054/2065] 10.222.0.21 () {62 vars in 1197 bytes} [Sat Nov 27 20:52:14 2021] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:14.206440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:14.207222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:14.214048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.214490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:14.215401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.215850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:14.357948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:14.366672 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e9305d98-3935-458b-b865-758aa305fda5 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1472 microversion: 2.1 time: 0.165050 Nov 27 20:52:14.367278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1055/2066] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:14 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:14.375088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1dbdbb0-da68-4271-b093-0c0fa1096edf tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Action: 'update', calling method: .version_select at 0x7f15c7563e50>, body: {"quota_set": {"instances": 10}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:14.376871 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:14.376871 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:14.638321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1dbdbb0-da68-4271-b093-0c0fa1096edf tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.638802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1dbdbb0-da68-4271-b093-0c0fa1096edf tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:14.640158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1dbdbb0-da68-4271-b093-0c0fa1096edf tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.641024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1dbdbb0-da68-4271-b093-0c0fa1096edf tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:14.699595 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1dbdbb0-da68-4271-b093-0c0fa1096edf tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 329 microversion: 2.1 time: 0.329095 Nov 27 20:52:14.700100 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1056/2067] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:52:14 2021] PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 329 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:14.705459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7b991b96-c042-4c01-8f6c-de8d5379525a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c754f9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-510659184"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:14.721680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7b991b96-c042-4c01-8f6c-de8d5379525a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:14.728394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7b991b96-c042-4c01-8f6c-de8d5379525a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:14.938906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7b991b96-c042-4c01-8f6c-de8d5379525a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:14.943919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7b991b96-c042-4c01-8f6c-de8d5379525a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:14.960255 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7b991b96-c042-4c01-8f6c-de8d5379525a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.258717 Nov 27 20:52:14.960773 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1057/2068] 10.222.0.21 () {62 vars in 1197 bytes} [Sat Nov 27 20:52:14 2021] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 260 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:14.965314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:14.965853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:14.973154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.973607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:14.974403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:14.974842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.112026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:15.119625 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e790e1eb-f130-4654-98b5-c2221592117a tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1325 microversion: 2.1 time: 0.157864 Nov 27 20:52:15.120317 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1058/2069] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:14 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1325 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:15.124736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87f28533-81cc-4ce8-980e-dcff0c645798 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:15.126195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-87f28533-81cc-4ce8-980e-dcff0c645798 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:15.132365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87f28533-81cc-4ce8-980e-dcff0c645798 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:15.132821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87f28533-81cc-4ce8-980e-dcff0c645798 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.133600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87f28533-81cc-4ce8-980e-dcff0c645798 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:15.134032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87f28533-81cc-4ce8-980e-dcff0c645798 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.180630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87f28533-81cc-4ce8-980e-dcff0c645798 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.059054 Nov 27 20:52:15.181313 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1059/2070] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:15 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:15.186552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f1431d71-724f-414e-b57d-c75b92bbf3b9 req-4b5653ad-f57b-433e-bea9-9c20a9c4149d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7b870d-40d5-4c15-9a87-89fdf19b33cb", "tag": "c10c2fd2-5244-453a-826f-f5bb827d9b58"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:15.188557 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:15.188557 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:15.196428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f1431d71-724f-414e-b57d-c75b92bbf3b9 req-4b5653ad-f57b-433e-bea9-9c20a9c4149d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:15.196875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f1431d71-724f-414e-b57d-c75b92bbf3b9 req-4b5653ad-f57b-433e-bea9-9c20a9c4149d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.208526 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f1431d71-724f-414e-b57d-c75b92bbf3b9 req-4b5653ad-f57b-433e-bea9-9c20a9c4149d service nova] Creating event network-changed:c10c2fd2-5244-453a-826f-f5bb827d9b58 for instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb on nch1-master-1 Nov 27 20:52:15.213304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f1431d71-724f-414e-b57d-c75b92bbf3b9 req-4b5653ad-f57b-433e-bea9-9c20a9c4149d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030504 Nov 27 20:52:15.213846 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1060/2071] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:15.218897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b2abebe-4211-400b-9de2-fa90dd030b0c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:15.219960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b2abebe-4211-400b-9de2-fa90dd030b0c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:15.225999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2abebe-4211-400b-9de2-fa90dd030b0c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:15.226452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2abebe-4211-400b-9de2-fa90dd030b0c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.227234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2abebe-4211-400b-9de2-fa90dd030b0c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:15.227702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2abebe-4211-400b-9de2-fa90dd030b0c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.270902 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b2abebe-4211-400b-9de2-fa90dd030b0c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.055546 Nov 27 20:52:15.274836 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1061/2072] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:15 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:15.326357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9654b214-4979-4214-ae38-fe229cd59c53 tempest-ComputeTenantNetworksTest-1400367759 tempest-ComputeTenantNetworksTest-1400367759-project] Calling method '.version_select at 0x7f15c77ee1f0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:15.535442 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9654b214-4979-4214-ae38-fe229cd59c53 tempest-ComputeTenantNetworksTest-1400367759 tempest-ComputeTenantNetworksTest-1400367759-project] 10.222.0.21 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 0.262190 Nov 27 20:52:15.536114 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1062/2073] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:52:15 2021] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:15.540846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0644d4ca-3cfb-4ae7-a6c7-e1ab6456b953 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Calling method '.version_select at 0x7f15c77eea60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:15.615887 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0644d4ca-3cfb-4ae7-a6c7-e1ab6456b953 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 371 microversion: 2.1 time: 0.078163 Nov 27 20:52:15.616655 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1063/2074] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:52:15 2021] GET /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:15.621388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-69288614-4be6-4459-b74d-00964c7a57bb tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c773d160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:15.624546 ncdv-master-1 devstack@n-api.service[135680]: WARNING oslo_db.sqlalchemy.utils [None req-69288614-4be6-4459-b74d-00964c7a57bb tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 27 20:52:15.632189 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-69288614-4be6-4459-b74d-00964c7a57bb tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.014739 Nov 27 20:52:15.632758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1064/2075] 10.222.0.21 () {60 vars in 1176 bytes} [Sat Nov 27 20:52:15 2021] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:15.638421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:15.639351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:15.651512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:15.651968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.652778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:15.653219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:15.722173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:15.732617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-76ac699b-645b-4223-b206-7299915c29eb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 200 len: 1430 microversion: 2.1 time: 0.098766 Nov 27 20:52:15.743226 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1065/2076] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:15 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 1430 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:15.743794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a77a62b-c0c7-4ff3-8f09-7a5c5f399898 tempest-ComputeTenantNetworksTest-1400367759 tempest-ComputeTenantNetworksTest-1400367759-project] Calling method '.version_select at 0x7f15c77eadc0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:15.936615 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a77a62b-c0c7-4ff3-8f09-7a5c5f399898 tempest-ComputeTenantNetworksTest-1400367759 tempest-ComputeTenantNetworksTest-1400367759-project] 10.222.0.21 "GET /compute/v2.1/os-tenant-networks/a2bb8a58-a2c8-4d3a-88ab-02884eb26d08" status: 200 len: 138 microversion: 2.1 time: 0.199790 Nov 27 20:52:15.937472 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1066/2077] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:52:15 2021] GET /compute/v2.1/os-tenant-networks/a2bb8a58-a2c8-4d3a-88ab-02884eb26d08 => generated 138 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:15.943511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5d77f0b8-a983-4a92-88c2-898e681fe5a4 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Action: 'update', calling method: .version_select at 0x7f15c77ff550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:15.944836 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:15.944836 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:16.078316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d77f0b8-a983-4a92-88c2-898e681fe5a4 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.078986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d77f0b8-a983-4a92-88c2-898e681fe5a4 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.083786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d77f0b8-a983-4a92-88c2-898e681fe5a4 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.084575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d77f0b8-a983-4a92-88c2-898e681fe5a4 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.175407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5d77f0b8-a983-4a92-88c2-898e681fe5a4 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 325 microversion: 2.1 time: 0.236278 Nov 27 20:52:16.190430 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1067/2078] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:52:15 2021] PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 325 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:16.195391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e6fec13-80fd-47b1-89bf-4cb6bd659e2b tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c7416280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:16.233717 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e6fec13-80fd-47b1-89bf-4cb6bd659e2b tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-510659184" status: 204 len: 0 microversion: 2.2 time: 0.042205 Nov 27 20:52:16.234597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1068/2079] 10.222.0.21 () {60 vars in 1317 bytes} [Sat Nov 27 20:52:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-510659184 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:16.249506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:16.255492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:16.264363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.267407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.268996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.269631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.558413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:16.560858 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1851e61-0d4e-417e-b100-739cb953ea90 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.136833 Nov 27 20:52:16.562653 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1012/2080] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:52:13 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:16.570255 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ec3b9e0-93ff-4455-bd59-d40f5c37345d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1325 microversion: 2.1 time: 0.334511 Nov 27 20:52:16.570846 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1069/2081] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:16 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:16.576873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff329345-f9c7-4a5d-9443-942d1bd9e141 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:16.580052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff329345-f9c7-4a5d-9443-942d1bd9e141 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:16.581382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-658467406", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:16.591386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff329345-f9c7-4a5d-9443-942d1bd9e141 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.592103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff329345-f9c7-4a5d-9443-942d1bd9e141 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.593094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff329345-f9c7-4a5d-9443-942d1bd9e141 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.593538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff329345-f9c7-4a5d-9443-942d1bd9e141 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.640331 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff329345-f9c7-4a5d-9443-942d1bd9e141 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.075440 Nov 27 20:52:16.647227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:16.665829 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1013/2082] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:16 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:16.671931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1795cea1-14c3-4331-915a-0bbd461f648b tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c7d5ad30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:16.708976 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1795cea1-14c3-4331-915a-0bbd461f648b tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1457103611" status: 204 len: 0 microversion: 2.2 time: 0.041502 Nov 27 20:52:16.709690 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1014/2083] 10.222.0.21 () {60 vars in 1320 bytes} [Sat Nov 27 20:52:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1457103611 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:16.717550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32e69035-d90f-4d9f-93ff-b36052e138b9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:16.718675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32e69035-d90f-4d9f-93ff-b36052e138b9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:16.726679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e69035-d90f-4d9f-93ff-b36052e138b9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.727212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e69035-d90f-4d9f-93ff-b36052e138b9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.728106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e69035-d90f-4d9f-93ff-b36052e138b9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.728610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32e69035-d90f-4d9f-93ff-b36052e138b9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.771940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32e69035-d90f-4d9f-93ff-b36052e138b9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.060460 Nov 27 20:52:16.772700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1015/2084] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:16 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:16.777791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2be471b4-d4cc-4252-bb2c-56f9a8b5a2e7 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Calling method '.version_select at 0x7f15c7dbbee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:16.879760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:16.880396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:16.880873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:16.881384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:16.882392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:16.891805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.892256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.893093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.893527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.911194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Getting quotas for project 742998b08aec4df0844e1fbf2ecb4479. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:16.916122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Getting quotas for user 577c5d661d1a43a38e41deeca0c88aa7 and project 742998b08aec4df0844e1fbf2ecb4479. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:16.928238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.utils [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] ram quota exceeded for 742998b08aec4df0844e1fbf2ecb4479, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=135680) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Nov 27 20:52:16.928776 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 27 20:52:16.929408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:16.930212 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f217cb4-0bd2-4467-a846-eaa987246f63 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.358269 Nov 27 20:52:16.930788 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1070/2085] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:16 2021] POST /compute/v2.1/servers => generated 110 bytes in 359 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:16.935095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07c6450d-0080-4c87-8721-c951bdd41a34 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c74160d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:16.952280 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07c6450d-0080-4c87-8721-c951bdd41a34 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-879994403" status: 204 len: 0 microversion: 2.2 time: 0.020475 Nov 27 20:52:16.957183 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1071/2086] 10.222.0.21 () {60 vars in 1317 bytes} [Sat Nov 27 20:52:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-879994403 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:16.960966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:16.961577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: cd0f5c56-6c32-4b25-9685-4a04863f57dc] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:16.967745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.968188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.968965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:16.969447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:16.983962 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance cd0f5c56-6c32-4b25-9685-4a04863f57dc could not be found. Nov 27 20:52:16.984559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance cd0f5c56-6c32-4b25-9685-4a04863f57dc could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:16.985918 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d003dff8-4ab3-45ad-8e2f-c561fb2a2deb tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc" status: 404 len: 111 microversion: 2.1 time: 0.031857 Nov 27 20:52:16.986779 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1072/2087] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:16 2021] GET /compute/v2.1/servers/cd0f5c56-6c32-4b25-9685-4a04863f57dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:16.992867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5acffeb0-20c1-4e09-af44-5910b5592d0a tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Action: 'update', calling method: .version_select at 0x7f15c77eaee0>, body: {"quota_set": {"ram": 51200}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:16.995387 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:16.995387 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:17.180885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acffeb0-20c1-4e09-af44-5910b5592d0a tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.181633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acffeb0-20c1-4e09-af44-5910b5592d0a tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.183069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acffeb0-20c1-4e09-af44-5910b5592d0a tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.183709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acffeb0-20c1-4e09-af44-5910b5592d0a tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.254687 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5acffeb0-20c1-4e09-af44-5910b5592d0a tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 200 len: 329 microversion: 2.1 time: 0.266826 Nov 27 20:52:17.256216 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1073/2088] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:52:16 2021] PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 329 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:17.261053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9c7eada-021f-4591-b634-4645411bd544 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c7416790>, body: {"keypair": {"name": "tempest-keypair-1187142801"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:17.276712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-c9c7eada-021f-4591-b634-4645411bd544 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:17.282705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-c9c7eada-021f-4591-b634-4645411bd544 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:17.416460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-c9c7eada-021f-4591-b634-4645411bd544 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:17.423876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-c9c7eada-021f-4591-b634-4645411bd544 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:17.440542 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9c7eada-021f-4591-b634-4645411bd544 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.182292 Nov 27 20:52:17.441186 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1074/2089] 10.222.0.21 () {62 vars in 1197 bytes} [Sat Nov 27 20:52:17 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:17.445586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:17.446084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:17.458766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.459222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.461567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.462026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.494192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:17.596218 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8abb9e5-7e63-40e0-a397-536c4261fabf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 204 len: 0 microversion: 2.1 time: 0.153528 Nov 27 20:52:17.597679 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1075/2090] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:17 2021] DELETE /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:17.605385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-31598341-314f-4423-98f2-96cb90f8bd10 req-3aa173cc-8752-43f3-8bab-5cf31bca6686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0f5c56-6c32-4b25-9685-4a04863f57dc", "name": "network-vif-deleted", "tag": "ca642020-d459-4da1-b5a7-ee2c44c1c93e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:17.606239 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:17.606239 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:17.613962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-31598341-314f-4423-98f2-96cb90f8bd10 req-3aa173cc-8752-43f3-8bab-5cf31bca6686 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.614407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-31598341-314f-4423-98f2-96cb90f8bd10 req-3aa173cc-8752-43f3-8bab-5cf31bca6686 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.626709 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-31598341-314f-4423-98f2-96cb90f8bd10 req-3aa173cc-8752-43f3-8bab-5cf31bca6686 service nova] Creating event network-vif-deleted:ca642020-d459-4da1-b5a7-ee2c44c1c93e for instance cd0f5c56-6c32-4b25-9685-4a04863f57dc on nch2-master-1 Nov 27 20:52:17.632061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-31598341-314f-4423-98f2-96cb90f8bd10 req-3aa173cc-8752-43f3-8bab-5cf31bca6686 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Nov 27 20:52:17.633075 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1076/2091] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:17.639010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5b81313-0f64-445b-9031-b44d156bf486 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Action: 'update', calling method: .version_select at 0x7f15c74dc940>, body: {"quota_set": {"ram": 0}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:17.640777 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:17.640777 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:17.641759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b5b81313-0f64-445b-9031-b44d156bf486 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '577c5d661d1a43a38e41deeca0c88aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742998b08aec4df0844e1fbf2ecb4479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:17.642475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5b81313-0f64-445b-9031-b44d156bf486 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:17.643426 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5b81313-0f64-445b-9031-b44d156bf486 tempest-QuotasAdminNegativeTest-411820446 tempest-QuotasAdminNegativeTest-411820446-project] 10.222.0.21 "PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479" status: 403 len: 116 microversion: 2.1 time: 0.009080 Nov 27 20:52:17.643979 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1077/2092] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 20:52:17 2021] PUT /compute/v2.1/os-quota-sets/742998b08aec4df0844e1fbf2ecb4479 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:17.648480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bcbdef7-e9d7-497d-a61a-41609ce51d5d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c77ee9d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:17.657161 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bcbdef7-e9d7-497d-a61a-41609ce51d5d tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs/tempest-keypair-1187142801" status: 200 len: 707 microversion: 2.2 time: 0.011781 Nov 27 20:52:17.658020 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1078/2093] 10.222.0.21 () {60 vars in 1257 bytes} [Sat Nov 27 20:52:17 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1187142801 => generated 707 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:17.666477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:17.669196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:17.680826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.681375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.682358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.682867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.822124 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2be471b4-d4cc-4252-bb2c-56f9a8b5a2e7 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/f60893f0-700b-49c6-a673-9030ed438a13" status: 202 len: 0 microversion: 2.1 time: 1.047958 Nov 27 20:52:17.823525 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1016/2094] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:52:16 2021] DELETE /compute/v2.1/os-floating-ips/f60893f0-700b-49c6-a673-9030ed438a13 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:52:17.829654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:17.830615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:17.840220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.841185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.842658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.843380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.850702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:17.871160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fec99a50-eca7-4ad9-8aa8-53013afd1f51 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1325 microversion: 2.1 time: 0.199944 Nov 27 20:52:17.874431 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1079/2095] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:17 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:17.882709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb70b2d3-c01a-4dd4-921f-da93838fd6bd tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c77ea5e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:17.888461 ncdv-master-1 devstack@n-api.service[135680]: WARNING oslo_db.sqlalchemy.utils [None req-bb70b2d3-c01a-4dd4-921f-da93838fd6bd tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 27 20:52:17.895585 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb70b2d3-c01a-4dd4-921f-da93838fd6bd tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.019774 Nov 27 20:52:17.897193 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1080/2096] 10.222.0.21 () {60 vars in 1176 bytes} [Sat Nov 27 20:52:17 2021] GET /compute/v2.1/os-keypairs => generated 564 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:17.902501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00dd5df1-3b63-4713-9935-020151236f61 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:17.903625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00dd5df1-3b63-4713-9935-020151236f61 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:17.911864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dd5df1-3b63-4713-9935-020151236f61 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.912785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dd5df1-3b63-4713-9935-020151236f61 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.913827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dd5df1-3b63-4713-9935-020151236f61 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.915784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dd5df1-3b63-4713-9935-020151236f61 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.970850 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00dd5df1-3b63-4713-9935-020151236f61 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.071438 Nov 27 20:52:17.972284 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1081/2097] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:17 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:17.981664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-708ca9e1-0305-4276-8f45-b89656d80265 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:17.984407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-708ca9e1-0305-4276-8f45-b89656d80265 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:17.998408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-708ca9e1-0305-4276-8f45-b89656d80265 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:17.998855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-708ca9e1-0305-4276-8f45-b89656d80265 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:17.999687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-708ca9e1-0305-4276-8f45-b89656d80265 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:18.000526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-708ca9e1-0305-4276-8f45-b89656d80265 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:18.062707 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-708ca9e1-0305-4276-8f45-b89656d80265 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.089443 Nov 27 20:52:18.069594 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1082/2098] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:17 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:18.071164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:18.075326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba9a99ea-4a66-4313-960d-d7c9c85efddf tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Calling method '.version_select at 0x7f15c759d5e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:18.080878 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-19181da6-3e6c-4fbc-9c7f-ef609fd69711 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1472 microversion: 2.1 time: 0.256025 Nov 27 20:52:18.084543 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1017/2099] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:17 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:18.089300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8801721-6314-4c3c-8aca-d5982933bb9a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c7dca4c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:18.115191 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8801721-6314-4c3c-8aca-d5982933bb9a tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187142801" status: 204 len: 0 microversion: 2.2 time: 0.029325 Nov 27 20:52:18.115969 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1018/2100] 10.222.0.21 () {60 vars in 1260 bytes} [Sat Nov 27 20:52:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187142801 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:18.126220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Action: 'create', calling method: .version_select at 0x7f15c787eca0>, body: {"keypair": {"name": "tempest-keypair-1384616463", "type": "x509"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:18.131467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-ba9a99ea-4a66-4313-960d-d7c9c85efddf tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f60893f0-700b-49c6-a673-9030ed438a13 could not be found", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:52:18.132399 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-ba9a99ea-4a66-4313-960d-d7c9c85efddf tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] HTTP exception thrown: Floating IP not found for ID f60893f0-700b-49c6-a673-9030ed438a13 Nov 27 20:52:18.133153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba9a99ea-4a66-4313-960d-d7c9c85efddf tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Returning 404 to user: Floating IP not found for ID f60893f0-700b-49c6-a673-9030ed438a13 {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:18.134321 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba9a99ea-4a66-4313-960d-d7c9c85efddf tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips/f60893f0-700b-49c6-a673-9030ed438a13" status: 404 len: 111 microversion: 2.1 time: 0.063379 Nov 27 20:52:18.135435 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1083/2101] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:52:18 2021] GET /compute/v2.1/os-floating-ips/f60893f0-700b-49c6-a673-9030ed438a13 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:18.141802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:18.144900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a46eb24-b00d-45a1-9d7e-eb8292d7f555 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Calling method '.version_select at 0x7f15d41a0820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:18.147962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:18.181577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.processutils [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpji4ugusd/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpji4ugusd/temp.key -subj /CN=641fe530de494a4fb1fefcd7688fb725 -extensions v3_req_client {{(pid=135679) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:52:18.227303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-4a46eb24-b00d-45a1-9d7e-eb8292d7f555 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f60893f0-700b-49c6-a673-9030ed438a13 could not be found", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:52:18.228005 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4a46eb24-b00d-45a1-9d7e-eb8292d7f555 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] HTTP exception thrown: Floating IP not found for ID f60893f0-700b-49c6-a673-9030ed438a13 Nov 27 20:52:18.228580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a46eb24-b00d-45a1-9d7e-eb8292d7f555 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] Returning 404 to user: Floating IP not found for ID f60893f0-700b-49c6-a673-9030ed438a13 {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:18.229404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a46eb24-b00d-45a1-9d7e-eb8292d7f555 tempest-FloatingIPsTestJSON-1654241374 tempest-FloatingIPsTestJSON-1654241374-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/f60893f0-700b-49c6-a673-9030ed438a13" status: 404 len: 111 microversion: 2.1 time: 0.089691 Nov 27 20:52:18.230153 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1084/2102] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:52:18 2021] DELETE /compute/v2.1/os-floating-ips/f60893f0-700b-49c6-a673-9030ed438a13 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:52:18.457819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.processutils [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpji4ugusd/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpji4ugusd/temp.key -subj /CN=641fe530de494a4fb1fefcd7688fb725 -extensions v3_req_client" returned: 0 in 0.275s {{(pid=135679) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:52:18.459927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.processutils [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpji4ugusd/temp.key -password pass: {{(pid=135679) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 27 20:52:18.485684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.processutils [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpji4ugusd/temp.key -password pass:" returned: 0 in 0.025s {{(pid=135679) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 27 20:52:18.545890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:18.552008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Getting quotas for user 641fe530de494a4fb1fefcd7688fb725 and project c20895c1ea684b139e4b6802d7a80ba1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:18.569866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91ba0329-532d-4781-9437-1a241a890441 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.447914 Nov 27 20:52:18.576428 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1019/2103] 10.222.0.21 () {62 vars in 1197 bytes} [Sat Nov 27 20:52:18 2021] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 451 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:18.583424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5b71add-5722-40c7-ab3f-746d946bd794 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c79775e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:18.594198 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5b71add-5722-40c7-ab3f-746d946bd794 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs/tempest-keypair-1384616463" status: 200 len: 1534 microversion: 2.2 time: 0.016066 Nov 27 20:52:18.595036 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1085/2104] 10.222.0.21 () {60 vars in 1257 bytes} [Sat Nov 27 20:52:18 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1384616463 => generated 1534 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:18.606721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-143bc269-49a3-4b2f-a312-de8d908f13c8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c7d65550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:18.611768 ncdv-master-1 devstack@n-api.service[135679]: WARNING oslo_db.sqlalchemy.utils [None req-143bc269-49a3-4b2f-a312-de8d908f13c8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 27 20:52:18.617639 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-143bc269-49a3-4b2f-a312-de8d908f13c8 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.016012 Nov 27 20:52:18.623117 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1020/2105] 10.222.0.21 () {60 vars in 1176 bytes} [Sat Nov 27 20:52:18 2021] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:18.628822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5abc0505-a2ca-40bb-8541-10202f874b69 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] Calling method '.version_select at 0x7f15c73e80d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:18.647453 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5abc0505-a2ca-40bb-8541-10202f874b69 tempest-KeyPairsV22TestJSON-357010357 tempest-KeyPairsV22TestJSON-357010357-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384616463" status: 204 len: 0 microversion: 2.2 time: 0.022931 Nov 27 20:52:18.648096 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1086/2106] 10.222.0.21 () {60 vars in 1260 bytes} [Sat Nov 27 20:52:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384616463 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:52:18.889728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:18.892154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:18.904737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:18.905912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:18.907781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:18.908806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:18.985186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f78540af-f5ae-444e-8815-99c797f18774 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:18.987974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f78540af-f5ae-444e-8815-99c797f18774 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:19.001056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f78540af-f5ae-444e-8815-99c797f18774 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:19.002115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f78540af-f5ae-444e-8815-99c797f18774 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:19.003525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f78540af-f5ae-444e-8815-99c797f18774 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:19.005065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f78540af-f5ae-444e-8815-99c797f18774 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:19.066818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f78540af-f5ae-444e-8815-99c797f18774 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.087297 Nov 27 20:52:19.071812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1087/2107] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:18 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:19.083678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3cf935e4-f931-4b45-a5b4-9cace8ab9225 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:19.084546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3cf935e4-f931-4b45-a5b4-9cace8ab9225 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:19.092671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3cf935e4-f931-4b45-a5b4-9cace8ab9225 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:19.093745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3cf935e4-f931-4b45-a5b4-9cace8ab9225 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:19.095658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3cf935e4-f931-4b45-a5b4-9cace8ab9225 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:19.096168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3cf935e4-f931-4b45-a5b4-9cace8ab9225 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:19.150560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3cf935e4-f931-4b45-a5b4-9cace8ab9225 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.073981 Nov 27 20:52:19.155731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1088/2108] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:19 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:19.165776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:19.166650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:19.175925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:19.176578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:19.177374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:19.177987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:19.268016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:19.297843 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8793921e-84d5-44fd-be45-1790f5f84485 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1325 microversion: 2.1 time: 0.412566 Nov 27 20:52:19.298451 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1021/2109] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:18 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1325 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:19.496084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4526ec50-c5b1-4c6a-87d6-ef4c1badc0d5 req-de558086-1b60-41f3-8ce3-69e6245b82e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7b870d-40d5-4c15-9a87-89fdf19b33cb", "name": "network-vif-plugged", "status": "completed", "tag": "c10c2fd2-5244-453a-826f-f5bb827d9b58"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:19.498097 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:19.498097 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:19.505733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4526ec50-c5b1-4c6a-87d6-ef4c1badc0d5 req-de558086-1b60-41f3-8ce3-69e6245b82e1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:19.506561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4526ec50-c5b1-4c6a-87d6-ef4c1badc0d5 req-de558086-1b60-41f3-8ce3-69e6245b82e1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:19.526813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4526ec50-c5b1-4c6a-87d6-ef4c1badc0d5 req-de558086-1b60-41f3-8ce3-69e6245b82e1 service nova] Creating event network-vif-plugged:c10c2fd2-5244-453a-826f-f5bb827d9b58 for instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb on nch1-master-1 Nov 27 20:52:19.536987 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4526ec50-c5b1-4c6a-87d6-ef4c1badc0d5 req-de558086-1b60-41f3-8ce3-69e6245b82e1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044843 Nov 27 20:52:19.538144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:19.540350 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1022/2110] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:19.556502 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dff4fb1a-ae0d-4eb4-a1ed-25736ab3d97b tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1472 microversion: 2.1 time: 0.396863 Nov 27 20:52:19.566590 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1089/2111] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:19 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:20.082396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa999889-fd04-43d1-849f-0b1d118e347b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:20.086123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa999889-fd04-43d1-849f-0b1d118e347b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:20.095541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa999889-fd04-43d1-849f-0b1d118e347b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.096567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa999889-fd04-43d1-849f-0b1d118e347b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.097742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa999889-fd04-43d1-849f-0b1d118e347b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.098400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa999889-fd04-43d1-849f-0b1d118e347b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.152688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa999889-fd04-43d1-849f-0b1d118e347b tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.073745 Nov 27 20:52:20.155125 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1090/2112] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:20 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:20.170928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bbabf08f-4a66-47ac-908f-f905a3d9505e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:20.174413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bbabf08f-4a66-47ac-908f-f905a3d9505e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:20.193763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbabf08f-4a66-47ac-908f-f905a3d9505e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.195923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbabf08f-4a66-47ac-908f-f905a3d9505e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.196825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbabf08f-4a66-47ac-908f-f905a3d9505e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.197279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbabf08f-4a66-47ac-908f-f905a3d9505e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.254301 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bbabf08f-4a66-47ac-908f-f905a3d9505e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.093218 Nov 27 20:52:20.259285 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1091/2113] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:20 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:20.318841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2101433269", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "4c1c2964-efe7-47f4-bb47-68bb0bb15cce"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:20.319955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:20.321316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:20.338711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.340518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.342356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.343686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.405943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] validate_networks() for [('4c1c2964-efe7-47f4-bb47-68bb0bb15cce', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:20.535114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:20.542431 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-189ec0c6-6554-4b6c-ab9e-fce9362e295d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1325 microversion: 2.1 time: 0.231551 Nov 27 20:52:20.553183 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1092/2114] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:20 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:20.575933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:20.576544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:20.583404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.584127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.585228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:20.585895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:20.818777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:20.826907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebc4a22a-e263-4de3-8789-dd557650f9da tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 200 len: 1472 microversion: 2.1 time: 0.256829 Nov 27 20:52:20.833995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1093/2115] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:20 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:21.166889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f686bd29-45ee-4ee2-92e8-3a544246780e tempest-AZV2TestJSON-1457898471 tempest-AZV2TestJSON-1457898471-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:21.168662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f686bd29-45ee-4ee2-92e8-3a544246780e tempest-AZV2TestJSON-1457898471 tempest-AZV2TestJSON-1457898471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.169323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f686bd29-45ee-4ee2-92e8-3a544246780e tempest-AZV2TestJSON-1457898471 tempest-AZV2TestJSON-1457898471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.170219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f686bd29-45ee-4ee2-92e8-3a544246780e tempest-AZV2TestJSON-1457898471 tempest-AZV2TestJSON-1457898471-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.170868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f686bd29-45ee-4ee2-92e8-3a544246780e tempest-AZV2TestJSON-1457898471 tempest-AZV2TestJSON-1457898471-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.231398 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f686bd29-45ee-4ee2-92e8-3a544246780e tempest-AZV2TestJSON-1457898471 tempest-AZV2TestJSON-1457898471-project] 10.222.0.21 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.278513 Nov 27 20:52:21.232312 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1094/2116] 10.222.0.21 () {58 vars in 1163 bytes} [Sat Nov 27 20:52:20 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:52:21.248688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-14f270d1-7d08-4571-af60-a234497ccdb4 req-20b9405e-6a7f-4cf6-a253-28bc5897725e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f6fefc-0619-4cd0-9361-aa81a9a2f30a", "name": "network-vif-deleted", "tag": "e02b8cc1-0258-4858-9965-ca7f6004dc39"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:21.252554 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:21.252554 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:21.269486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-14f270d1-7d08-4571-af60-a234497ccdb4 req-20b9405e-6a7f-4cf6-a253-28bc5897725e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.270559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-14f270d1-7d08-4571-af60-a234497ccdb4 req-20b9405e-6a7f-4cf6-a253-28bc5897725e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.296921 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-14f270d1-7d08-4571-af60-a234497ccdb4 req-20b9405e-6a7f-4cf6-a253-28bc5897725e service nova] Creating event network-vif-deleted:e02b8cc1-0258-4858-9965-ca7f6004dc39 for instance 63f6fefc-0619-4cd0-9361-aa81a9a2f30a on nch2-master-1 Nov 27 20:52:21.304236 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-14f270d1-7d08-4571-af60-a234497ccdb4 req-20b9405e-6a7f-4cf6-a253-28bc5897725e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064245 Nov 27 20:52:21.306398 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1095/2117] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:21.320029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27844b6c-6301-407d-bee5-3c66a774a21e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:21.321318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27844b6c-6301-407d-bee5-3c66a774a21e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:21.338744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27844b6c-6301-407d-bee5-3c66a774a21e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.339634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27844b6c-6301-407d-bee5-3c66a774a21e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.342266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27844b6c-6301-407d-bee5-3c66a774a21e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.344303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27844b6c-6301-407d-bee5-3c66a774a21e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.425686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27844b6c-6301-407d-bee5-3c66a774a21e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.115254 Nov 27 20:52:21.428344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1096/2118] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:21 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:21.440633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0cb5e2f-e408-4c48-a784-3b9b91eba8d2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:21.442211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0cb5e2f-e408-4c48-a784-3b9b91eba8d2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:21.457291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0cb5e2f-e408-4c48-a784-3b9b91eba8d2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.458875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0cb5e2f-e408-4c48-a784-3b9b91eba8d2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.461213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0cb5e2f-e408-4c48-a784-3b9b91eba8d2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.461859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0cb5e2f-e408-4c48-a784-3b9b91eba8d2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.577078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0cb5e2f-e408-4c48-a784-3b9b91eba8d2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.145640 Nov 27 20:52:21.585062 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1097/2119] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:21 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:21.590845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:21.594190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:21.611941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.614058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.616101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.617481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.796369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:21.797661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:21.798270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:21.798977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:21.799441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:21.820350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.820798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.821617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:21.822055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:21.887367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:21.903936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for user 6f940822793e422c8436036be6a116a0 and project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:21.925604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:52:21.929228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:52:21.978962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:21.994552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5ba1f75-246d-4c77-b9f4-7ed08c8f9140 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.978337 Nov 27 20:52:22.000088 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1023/2120] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:52:22.011971 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83e819df-f395-405f-b149-0d61b529dec9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1325 microversion: 2.1 time: 0.405465 Nov 27 20:52:22.014858 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1098/2121] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:21 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:22.029731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:22.030801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 63f6fefc-0619-4cd0-9361-aa81a9a2f30a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:22.036525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5f18b53-fb4e-41d2-8805-b32c8fc58a5e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:22.039953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.040269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5f18b53-fb4e-41d2-8805-b32c8fc58a5e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:22.040392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.042283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.042805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.059008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance 63f6fefc-0619-4cd0-9361-aa81a9a2f30a could not be found. Nov 27 20:52:22.059847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance 63f6fefc-0619-4cd0-9361-aa81a9a2f30a could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:22.060875 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a4c4a7c6-28a6-48e4-8698-9999f872ba25 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a" status: 404 len: 111 microversion: 2.1 time: 0.064417 Nov 27 20:52:22.062049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1024/2122] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:21 2021] GET /compute/v2.1/servers/63f6fefc-0619-4cd0-9361-aa81a9a2f30a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:22.080013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:22.083846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:22.098081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.098543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.121581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.122221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.180579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:22.260069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5f18b53-fb4e-41d2-8805-b32c8fc58a5e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:22.272510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5f18b53-fb4e-41d2-8805-b32c8fc58a5e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1218 microversion: 2.1 time: 0.246799 Nov 27 20:52:22.273115 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1099/2123] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:22 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:22.304889 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0f22197-075a-4f70-9024-e0b1e9d2464a tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd" status: 204 len: 0 microversion: 2.1 time: 0.238019 Nov 27 20:52:22.308828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1025/2124] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:22 2021] DELETE /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:22.314079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:22.314850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:22.330685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.331139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.331956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.332391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.404232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:22.454308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fddc991e-d2cc-46d1-9e2d-894c1ee238c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:22.456320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fddc991e-d2cc-46d1-9e2d-894c1ee238c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:22.466922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc991e-d2cc-46d1-9e2d-894c1ee238c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.468401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc991e-d2cc-46d1-9e2d-894c1ee238c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.470269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc991e-d2cc-46d1-9e2d-894c1ee238c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.470989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fddc991e-d2cc-46d1-9e2d-894c1ee238c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.537518 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fddc991e-d2cc-46d1-9e2d-894c1ee238c6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.098373 Nov 27 20:52:22.540032 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1026/2125] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:22 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:22.576768 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12fd2f2f-fc19-4b03-97e8-c482b3a87eaf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 204 len: 0 microversion: 2.1 time: 0.266078 Nov 27 20:52:22.577855 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1100/2126] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:22 2021] DELETE /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:22.593169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:22.595859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:22.600880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b2f816cc-16db-45ee-8cde-33ff2ea94196 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:22.603644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b2f816cc-16db-45ee-8cde-33ff2ea94196 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:22.607817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.608711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.610909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.611845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.640634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2f816cc-16db-45ee-8cde-33ff2ea94196 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.641202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2f816cc-16db-45ee-8cde-33ff2ea94196 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.646542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2f816cc-16db-45ee-8cde-33ff2ea94196 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:22.647593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2f816cc-16db-45ee-8cde-33ff2ea94196 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:22.740105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b2f816cc-16db-45ee-8cde-33ff2ea94196 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.151460 Nov 27 20:52:22.741358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1101/2127] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:22 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:23.038969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:23.040128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:23.068082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.068082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.068082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.077215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.126166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:23.140526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f4a7805f-337f-43ec-8203-52774c64d91d tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd" status: 200 len: 1474 microversion: 2.1 time: 0.554181 Nov 27 20:52:23.141221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1027/2128] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:22 2021] GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:23.290201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:23.291240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:23.312419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.314341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.319367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.320566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.434152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:23.455111 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a3bdf958-af4e-4edc-83dd-900f9e0ea790 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.424052 Nov 27 20:52:23.457110 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1102/2129] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:23 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:23.476515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:23.477228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:23.497158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.498091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.499971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.500982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.576364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:23.589573 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e248663b-e39d-4133-866b-825916ef214e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1270 microversion: 2.1 time: 0.303141 Nov 27 20:52:23.604819 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1028/2130] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:23 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1270 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:23.627220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9a0b5ce-4c91-4021-93b5-55a01798868a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:23.629516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9a0b5ce-4c91-4021-93b5-55a01798868a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:23.638862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a0b5ce-4c91-4021-93b5-55a01798868a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.639677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a0b5ce-4c91-4021-93b5-55a01798868a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.642006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a0b5ce-4c91-4021-93b5-55a01798868a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.642653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a0b5ce-4c91-4021-93b5-55a01798868a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.775636 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9a0b5ce-4c91-4021-93b5-55a01798868a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.153031 Nov 27 20:52:23.776324 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1029/2131] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:23 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:23.785597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-faefd0ce-a437-4d63-b830-1e240c0faed2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:23.788099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-faefd0ce-a437-4d63-b830-1e240c0faed2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:23.803869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:23.809406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faefd0ce-a437-4d63-b830-1e240c0faed2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.810167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faefd0ce-a437-4d63-b830-1e240c0faed2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.813869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faefd0ce-a437-4d63-b830-1e240c0faed2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.814578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faefd0ce-a437-4d63-b830-1e240c0faed2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.846752 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3ecdc2d-acca-4f41-8cfe-cf6c530b095f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.374380 Nov 27 20:52:23.847403 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1103/2132] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:23 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:23.865611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efadc9cc-2af9-4981-9139-85dcbb367d92 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-622158072", "metadata": {"": ""}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:23.868193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efadc9cc-2af9-4981-9139-85dcbb367d92 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:23.869846 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-efadc9cc-2af9-4981-9139-85dcbb367d92 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action" status: 400 len: 170 microversion: 2.1 time: 0.010597 Nov 27 20:52:23.871217 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1104/2133] 10.222.0.21 () {60 vars in 1278 bytes} [Sat Nov 27 20:52:23 2021] POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action => generated 170 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:52:23.879657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:23.880469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:23.891370 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-faefd0ce-a437-4d63-b830-1e240c0faed2 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.112119 Nov 27 20:52:23.892214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.892675 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1030/2134] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:23 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:23.892802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:23.894282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:23.894735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.128829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:24.138803 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06bf51db-64eb-4023-9e29-0adb3f90a08b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.263981 Nov 27 20:52:24.141993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1105/2135] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:23 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:24.162215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:24.163629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:24.164147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:24.164907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:24.180525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.180706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.180869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.181454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.188360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.189125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.189262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.189796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.666623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:24.682726 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da917218-4e39-450c-9b95-711fae2480d6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.526193 Nov 27 20:52:24.686148 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1106/2136] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:24 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:24.691157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:24.692032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:24.701121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.701768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.707960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.708855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.840069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:24.849991 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00170f54-0894-4d6c-a6c9-4f6df06cfe76 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1276 microversion: 2.1 time: 0.162196 Nov 27 20:52:24.850301 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1107/2137] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:24 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:24.855367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88e5e880-8e50-484f-b64d-7ec46f5f45c1 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1272009737", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:24.857052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88e5e880-8e50-484f-b64d-7ec46f5f45c1 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:24.858096 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88e5e880-8e50-484f-b64d-7ec46f5f45c1 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action" status: 400 len: 938 microversion: 2.1 time: 0.006630 Nov 27 20:52:24.859942 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1108/2138] 10.222.0.21 () {60 vars in 1278 bytes} [Sat Nov 27 20:52:24 2021] POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action => generated 938 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:52:24.864831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2fd2d13-6db6-4cc3-8c0b-8f8e9a39e451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:24.865909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2fd2d13-6db6-4cc3-8c0b-8f8e9a39e451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:24.874171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2fd2d13-6db6-4cc3-8c0b-8f8e9a39e451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.874871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2fd2d13-6db6-4cc3-8c0b-8f8e9a39e451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.876562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2fd2d13-6db6-4cc3-8c0b-8f8e9a39e451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.877174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2fd2d13-6db6-4cc3-8c0b-8f8e9a39e451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.929462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2fd2d13-6db6-4cc3-8c0b-8f8e9a39e451 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.067982 Nov 27 20:52:24.934346 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1109/2139] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:24 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:24.938832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:24.940126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:24.947357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.947929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:24.948786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:24.949288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:25.113066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:25.125593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dd406a6e-06db-4543-bc46-ed095ec2e2aa tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd" status: 200 len: 1474 microversion: 2.1 time: 0.968105 Nov 27 20:52:25.136311 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1031/2140] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:24 2021] GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd => generated 1474 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:25.143970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca396a4a-c1e3-47ee-b8df-253baba3a464 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:25.145944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca396a4a-c1e3-47ee-b8df-253baba3a464 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:25.155201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca396a4a-c1e3-47ee-b8df-253baba3a464 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:25.155696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca396a4a-c1e3-47ee-b8df-253baba3a464 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:25.156546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca396a4a-c1e3-47ee-b8df-253baba3a464 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:25.156998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca396a4a-c1e3-47ee-b8df-253baba3a464 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:25.213039 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca396a4a-c1e3-47ee-b8df-253baba3a464 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.075937 Nov 27 20:52:25.213759 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1032/2141] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:25 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:25.382459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:25.393011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea040927-2653-49fd-ae01-5d9f60975cdb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.459401 Nov 27 20:52:25.393597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1110/2142] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:24 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:25.412801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:25.413616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:25.431131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:25.431622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:25.432434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:25.432879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:25.539392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3eec7361-146e-456b-9b63-3d2ae4d202cd req-3a78a5b3-0ed4-470f-a873-2151e74b1634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352412c0-8ac8-4c44-810a-ce588efeafcd", "name": "network-vif-deleted", "tag": "03656c06-3cc8-4fda-a16b-4029c1b5ca5e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:25.540977 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:25.540977 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:25.565708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3eec7361-146e-456b-9b63-3d2ae4d202cd req-3a78a5b3-0ed4-470f-a873-2151e74b1634 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:25.566169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3eec7361-146e-456b-9b63-3d2ae4d202cd req-3a78a5b3-0ed4-470f-a873-2151e74b1634 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:25.599129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3eec7361-146e-456b-9b63-3d2ae4d202cd req-3a78a5b3-0ed4-470f-a873-2151e74b1634 service nova] Creating event network-vif-deleted:03656c06-3cc8-4fda-a16b-4029c1b5ca5e for instance 352412c0-8ac8-4c44-810a-ce588efeafcd on nch2-master-1 Nov 27 20:52:25.605339 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3eec7361-146e-456b-9b63-3d2ae4d202cd req-3a78a5b3-0ed4-470f-a873-2151e74b1634 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069679 Nov 27 20:52:25.606547 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1111/2143] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:25.869208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:25.870567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:25.881119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:25.881624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:25.882651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:25.883093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.125820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:26.146043 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4cac5fa0-d72d-4b39-bf01-e7855dd44290 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.734959 Nov 27 20:52:26.146901 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1033/2144] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:25 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:26.160485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0daa0a6a-030e-423a-804f-5a5fdd86372e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:26.161746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0daa0a6a-030e-423a-804f-5a5fdd86372e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:26.178933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0daa0a6a-030e-423a-804f-5a5fdd86372e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.179425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0daa0a6a-030e-423a-804f-5a5fdd86372e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.187918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0daa0a6a-030e-423a-804f-5a5fdd86372e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.188507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0daa0a6a-030e-423a-804f-5a5fdd86372e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.295584 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0daa0a6a-030e-423a-804f-5a5fdd86372e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.146252 Nov 27 20:52:26.296257 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1034/2145] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:26 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:26.307361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:26.310803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:26.324342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.327407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.329956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.332158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.396293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.397041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.397728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lazy-loading 'fault' on Instance uuid 352412c0-8ac8-4c44-810a-ce588efeafcd {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:52:26.480025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:26.489231 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a81f0883-0b29-4dbf-9893-a1c9146eec1c tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd" status: 200 len: 1309 microversion: 2.1 time: 0.191462 Nov 27 20:52:26.492019 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1035/2146] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:26 2021] GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:26.511989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a440330-8a8c-4801-97a9-b6dcdf4f4298 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:26.516933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a440330-8a8c-4801-97a9-b6dcdf4f4298 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:26.518592 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a440330-8a8c-4801-97a9-b6dcdf4f4298 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action" status: 400 len: 619 microversion: 2.1 time: 0.024540 Nov 27 20:52:26.519577 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1036/2147] 10.222.0.21 () {60 vars in 1278 bytes} [Sat Nov 27 20:52:26 2021] POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:52:26.525871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d90fa0e-69c1-4676-9e02-2cb3fb9f3226 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:26.527359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d90fa0e-69c1-4676-9e02-2cb3fb9f3226 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:26.536822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d90fa0e-69c1-4676-9e02-2cb3fb9f3226 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.537713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d90fa0e-69c1-4676-9e02-2cb3fb9f3226 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.539990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d90fa0e-69c1-4676-9e02-2cb3fb9f3226 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.540670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d90fa0e-69c1-4676-9e02-2cb3fb9f3226 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.598237 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d90fa0e-69c1-4676-9e02-2cb3fb9f3226 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.077218 Nov 27 20:52:26.600033 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1037/2148] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:26 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:26.606624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:26.609293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:26.629136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.630615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.631653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:26.632272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:26.861719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:26.874764 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35b7cf80-e6b8-4e28-a64c-4451d8f33eb9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 1.008391 Nov 27 20:52:26.876787 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1112/2149] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:25 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:27.115611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:27.124869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc7b0776-976d-4fff-9d8b-71eed36ba39e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.522233 Nov 27 20:52:27.126118 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1038/2150] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:26 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:27.149124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:27.150039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:27.160559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.163522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.164648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.165736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.295744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a90a0d77-527a-43bc-81b0-60297740c8e9 tempest-FlavorsV2NegativeTest-1658900478 tempest-FlavorsV2NegativeTest-1658900478-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:27.313697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a90a0d77-527a-43bc-81b0-60297740c8e9 tempest-FlavorsV2NegativeTest-1658900478 tempest-FlavorsV2NegativeTest-1658900478-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.296827 Nov 27 20:52:27.327310 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1113/2151] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:52:27 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:27.332921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c02975ab-ea2d-4202-8c76-71150bd78fce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:27.334038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c02975ab-ea2d-4202-8c76-71150bd78fce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:27.346469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c02975ab-ea2d-4202-8c76-71150bd78fce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.347171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c02975ab-ea2d-4202-8c76-71150bd78fce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.348223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c02975ab-ea2d-4202-8c76-71150bd78fce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.348826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c02975ab-ea2d-4202-8c76-71150bd78fce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.424876 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c02975ab-ea2d-4202-8c76-71150bd78fce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.096557 Nov 27 20:52:27.426531 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1114/2152] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:27 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:27.509453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:27.510155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 352412c0-8ac8-4c44-810a-ce588efeafcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:27.527919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.528371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.529164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.529787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.575145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:27.584448 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance 352412c0-8ac8-4c44-810a-ce588efeafcd could not be found. Nov 27 20:52:27.588073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance 352412c0-8ac8-4c44-810a-ce588efeafcd could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:27.588709 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62f03edd-3d8f-48af-9378-7a956f42c2fe tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.442827 Nov 27 20:52:27.589866 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4902f29-eaf0-4cab-8cd7-e9a80b4d6ee0 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd" status: 404 len: 111 microversion: 2.1 time: 0.084906 Nov 27 20:52:27.596077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1115/2153] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:27 2021] GET /compute/v2.1/servers/352412c0-8ac8-4c44-810a-ce588efeafcd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:27.600839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1039/2154] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:27 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:27.611763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:27.612807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ff456cbf-e87f-45d6-bc23-eda1680f7319] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:27.620622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.621464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.622258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.622748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.639510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance ff456cbf-e87f-45d6-bc23-eda1680f7319 could not be found. Nov 27 20:52:27.640399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance ff456cbf-e87f-45d6-bc23-eda1680f7319 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:27.641625 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0055ba34-8fc3-4c22-aa00-228240e38e13 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319" status: 404 len: 111 microversion: 2.1 time: 0.044250 Nov 27 20:52:27.644134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1116/2155] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:27 2021] GET /compute/v2.1/servers/ff456cbf-e87f-45d6-bc23-eda1680f7319 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:27.652040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a90a37a1-e6ad-464d-b3cb-a24256e64d1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1650879579"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:27.656020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a90a37a1-e6ad-464d-b3cb-a24256e64d1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:27.665925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a90a37a1-e6ad-464d-b3cb-a24256e64d1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.666837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a90a37a1-e6ad-464d-b3cb-a24256e64d1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.668275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a90a37a1-e6ad-464d-b3cb-a24256e64d1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:27.669278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a90a37a1-e6ad-464d-b3cb-a24256e64d1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:27.743176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2030038257", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "c6502c39-8b47-4e70-ac49-9906b123e7d6"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:27.837541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] validate_networks() for [('c6502c39-8b47-4e70-ac49-9906b123e7d6', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:28.169103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a90a37a1-e6ad-464d-b3cb-a24256e64d1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action" status: 202 len: 0 microversion: 2.1 time: 0.523130 Nov 27 20:52:28.176048 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1117/2156] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:27 2021] POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:52:28.183535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ff214e0-39e8-4ee5-84ed-602c88a7c97f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:28.185494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ff214e0-39e8-4ee5-84ed-602c88a7c97f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:28.195618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ff214e0-39e8-4ee5-84ed-602c88a7c97f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.196399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ff214e0-39e8-4ee5-84ed-602c88a7c97f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.198004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ff214e0-39e8-4ee5-84ed-602c88a7c97f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.198745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ff214e0-39e8-4ee5-84ed-602c88a7c97f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.293943 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ff214e0-39e8-4ee5-84ed-602c88a7c97f tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.115657 Nov 27 20:52:28.295358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1118/2157] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:28 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:28.304289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f54ba359-b4aa-48bf-a3ea-fda4e79ea851 req-2b2f3a61-914c-4373-beae-0f8ae1949fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff456cbf-e87f-45d6-bc23-eda1680f7319", "name": "network-vif-deleted", "tag": "f7eb3780-8e46-4709-b050-efac2b428838"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:28.311910 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:28.311910 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:28.324760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f54ba359-b4aa-48bf-a3ea-fda4e79ea851 req-2b2f3a61-914c-4373-beae-0f8ae1949fe2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.325581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f54ba359-b4aa-48bf-a3ea-fda4e79ea851 req-2b2f3a61-914c-4373-beae-0f8ae1949fe2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.345288 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f54ba359-b4aa-48bf-a3ea-fda4e79ea851 req-2b2f3a61-914c-4373-beae-0f8ae1949fe2 service nova] Creating event network-vif-deleted:f7eb3780-8e46-4709-b050-efac2b428838 for instance ff456cbf-e87f-45d6-bc23-eda1680f7319 on nch1-master-1 Nov 27 20:52:28.350613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f54ba359-b4aa-48bf-a3ea-fda4e79ea851 req-2b2f3a61-914c-4373-beae-0f8ae1949fe2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052519 Nov 27 20:52:28.352372 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1119/2158] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:28.357625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71eda546-f3d6-4a06-8fad-901d6d4f19c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:28.395074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71eda546-f3d6-4a06-8fad-901d6d4f19c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/2806f1c8-ce1c-4445-9cca-6347ca84de05" status: 204 len: 0 microversion: 2.1 time: 0.041530 Nov 27 20:52:28.396023 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1120/2159] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:52:28 2021] DELETE /compute/v2.1/os-server-groups/2806f1c8-ce1c-4445-9cca-6347ca84de05 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:28.405861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:28.406758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:28.414502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.415092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.416178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.416722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.603702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:28.611761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-418bcf6c-0912-48b0-a9e8-ad246708bceb tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.211226 Nov 27 20:52:28.612338 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1121/2160] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:28 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:28.616777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-dd15ba54-2fb2-418e-95ab-3039067eae86 req-a40030d4-bca2-4ee0-996c-05450f8ce102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821291e6-a643-4172-ba04-15984efe9761", "tag": "1cb73713-eb64-4a52-a006-70b1b4bcabdb"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:28.618328 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:28.618328 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:28.626691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dd15ba54-2fb2-418e-95ab-3039067eae86 req-a40030d4-bca2-4ee0-996c-05450f8ce102 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.627139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dd15ba54-2fb2-418e-95ab-3039067eae86 req-a40030d4-bca2-4ee0-996c-05450f8ce102 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.638064 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-dd15ba54-2fb2-418e-95ab-3039067eae86 req-a40030d4-bca2-4ee0-996c-05450f8ce102 service nova] Creating event network-changed:1cb73713-eb64-4a52-a006-70b1b4bcabdb for instance 821291e6-a643-4172-ba04-15984efe9761 on nch2-master-1 Nov 27 20:52:28.643040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-dd15ba54-2fb2-418e-95ab-3039067eae86 req-a40030d4-bca2-4ee0-996c-05450f8ce102 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029609 Nov 27 20:52:28.643984 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1122/2161] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:28.648574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1571627752"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:28.649607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:28.655712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.656172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.657492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.657930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.688769 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Cannot 'createImage' instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb while it is in task_state image_snapshot Nov 27 20:52:28.689361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 409 to user: Cannot 'createImage' instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb while it is in task_state image_snapshot {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:28.690186 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-11e825fd-a96d-4700-b110-6dbd33e68936 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action" status: 409 len: 159 microversion: 2.1 time: 0.045477 Nov 27 20:52:28.690749 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1123/2162] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:28 2021] POST /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb/action => generated 159 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:28.695987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:28.696477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:28.702344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.702791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.703599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.704032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.725919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:28.726614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:28.726783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:28.727176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:28.727648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:28.734143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:28.741920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.742747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.744110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.744881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.763844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Getting quotas for project 99a5eb3bc93349828958b7879707829a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:28.769302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Getting quotas for user 745d99de8bd24185aacbbcf7b2c404c2 and project 99a5eb3bc93349828958b7879707829a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:28.784207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:52:28.786698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:52:28.841983 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-567db4f3-796e-4061-b559-22ec1ae4aedd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239703 Nov 27 20:52:28.842910 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1040/2163] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:52:28.852396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf52b49c-a9c6-4c5a-a6e2-dc901475acf8 tempest-FlavorsV2NegativeTest-1658900478 tempest-FlavorsV2NegativeTest-1658900478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1630477034", "imageRef": "a41ed966-dc99-49ff-a927-c3448b103ccd", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:28.874676 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a6577f1b-bdc6-4033-a0fd-0554df2752cf tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 204 len: 0 microversion: 2.1 time: 0.182123 Nov 27 20:52:28.875495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1124/2164] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:28 2021] DELETE /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:28.882997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ad999f1e-9f77-4948-9b1a-2102cc3939b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:28.885643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ad999f1e-9f77-4948-9b1a-2102cc3939b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:28.893968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad999f1e-9f77-4948-9b1a-2102cc3939b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.896030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad999f1e-9f77-4948-9b1a-2102cc3939b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.897025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad999f1e-9f77-4948-9b1a-2102cc3939b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:28.897564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad999f1e-9f77-4948-9b1a-2102cc3939b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:28.924272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-cf52b49c-a9c6-4c5a-a6e2-dc901475acf8 tempest-FlavorsV2NegativeTest-1658900478 tempest-FlavorsV2NegativeTest-1658900478-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:28.952589 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ad999f1e-9f77-4948-9b1a-2102cc3939b2 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.075554 Nov 27 20:52:28.955458 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1125/2165] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:28 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:28.963495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-781d357a-cdb5-418b-ac73-6ecb8d7fa45c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '.version_select at 0x7f15c77e9550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:29.147819 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-781d357a-cdb5-418b-ac73-6ecb8d7fa45c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/images/6a01dee4-c158-4553-a845-edf875ba757b" status: 204 len: 0 microversion: 2.1 time: 0.190367 Nov 27 20:52:29.149607 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1126/2166] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:28 2021] DELETE /compute/v2.1/images/6a01dee4-c158-4553-a845-edf875ba757b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:29.157920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c7ad9371-be2e-4406-b871-3ed3a842fb27 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:29.170337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c7ad9371-be2e-4406-b871-3ed3a842fb27 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:29.260269 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-cf52b49c-a9c6-4c5a-a6e2-dc901475acf8 tempest-FlavorsV2NegativeTest-1658900478 tempest-FlavorsV2NegativeTest-1658900478-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 27 20:52:29.261723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf52b49c-a9c6-4c5a-a6e2-dc901475acf8 tempest-FlavorsV2NegativeTest-1658900478 tempest-FlavorsV2NegativeTest-1658900478-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:29.262076 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf52b49c-a9c6-4c5a-a6e2-dc901475acf8 tempest-FlavorsV2NegativeTest-1658900478 tempest-FlavorsV2NegativeTest-1658900478-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.413698 Nov 27 20:52:29.262856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1041/2167] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:28 2021] POST /compute/v2.1/servers => generated 93 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:29.267481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7ad9371-be2e-4406-b871-3ed3a842fb27 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:29.270796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:29.271397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:29.279876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.280336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.281147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.282204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.289988 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c7ad9371-be2e-4406-b871-3ed3a842fb27 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1218 microversion: 2.1 time: 0.135077 Nov 27 20:52:29.291888 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1127/2168] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:29 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:29.313021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:29.316301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:29.327025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:29.333848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.334428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.340776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.342415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.479377 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c4e28450-d45b-46c9-87ff-ab9638b62ed4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 204 len: 0 microversion: 2.1 time: 0.214073 Nov 27 20:52:29.480902 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1042/2169] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:29 2021] DELETE /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:29.494045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6619cac0-6710-4567-9635-322fc393c82a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:29.496476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6619cac0-6710-4567-9635-322fc393c82a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:29.505436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6619cac0-6710-4567-9635-322fc393c82a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.506286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6619cac0-6710-4567-9635-322fc393c82a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.507282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6619cac0-6710-4567-9635-322fc393c82a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.507885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6619cac0-6710-4567-9635-322fc393c82a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.561990 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6619cac0-6710-4567-9635-322fc393c82a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.079316 Nov 27 20:52:29.566954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1043/2170] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:29 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:29.572743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:29.573455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:29.583107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.583944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.585156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.586369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.631493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:29.641519 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f498d35e-d8b2-4db4-9897-01cb186f6b68 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1540 microversion: 2.1 time: 0.347680 Nov 27 20:52:29.642297 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1128/2171] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:29 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1540 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:29.655698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:29.660807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:29.671737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.674205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.676229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.679211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.872363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:29.881880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:29.886270 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fdb4375d-bb45-45d6-8ebb-17d0e7cc9d63 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 200 len: 1473 microversion: 2.1 time: 0.317810 Nov 27 20:52:29.887746 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1044/2172] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:29 2021] GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:29.898483 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8aa0d57b-af99-4723-87c8-2fac12704b68 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.249477 Nov 27 20:52:29.899783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1129/2173] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:29 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:29.965376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1545539-b09c-418e-85c7-26bad633559d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:29.966511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d1545539-b09c-418e-85c7-26bad633559d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:29.973109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1545539-b09c-418e-85c7-26bad633559d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.973653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1545539-b09c-418e-85c7-26bad633559d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:29.974594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1545539-b09c-418e-85c7-26bad633559d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:29.975289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1545539-b09c-418e-85c7-26bad633559d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.024526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1545539-b09c-418e-85c7-26bad633559d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.062842 Nov 27 20:52:30.025313 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1045/2174] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:29 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:30.309691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:30.311278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:30.326513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.330410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.331650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.332259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.477437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:30.486468 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4412113d-8343-4db8-bd5d-724188f7de80 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1276 microversion: 2.1 time: 0.181474 Nov 27 20:52:30.487544 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1130/2175] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:30 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:30.575420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33b91280-36c8-4db8-917a-445ae0182f62 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:30.576597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33b91280-36c8-4db8-917a-445ae0182f62 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:30.587121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b91280-36c8-4db8-917a-445ae0182f62 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.592581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b91280-36c8-4db8-917a-445ae0182f62 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.604482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b91280-36c8-4db8-917a-445ae0182f62 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.604944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b91280-36c8-4db8-917a-445ae0182f62 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.655279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33b91280-36c8-4db8-917a-445ae0182f62 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.083738 Nov 27 20:52:30.658111 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1046/2176] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:30 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:30.659072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:30.659731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:30.670895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.671650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.672490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.672925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.905655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:30.907826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:30.916689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.917526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.918526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.918974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.948463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:30.961655 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50ea3967-8d32-44ed-a6a8-e2be7a9e7e69 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1540 microversion: 2.1 time: 0.305597 Nov 27 20:52:30.963955 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1131/2177] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:30 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1540 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:30.969579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:30.970644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:30.989837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.991135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:30.994197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:30.996435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:31.344722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:31.351821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2fbeed40-0b52-46dc-908e-daae658e5c00 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.386153 Nov 27 20:52:31.363840 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1132/2178] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:30 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:31.371543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3210244-3c64-4214-b284-540c2fab68a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:31.372808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3210244-3c64-4214-b284-540c2fab68a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:31.379670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3210244-3c64-4214-b284-540c2fab68a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:31.380414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3210244-3c64-4214-b284-540c2fab68a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:31.381467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3210244-3c64-4214-b284-540c2fab68a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:31.382126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3210244-3c64-4214-b284-540c2fab68a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:31.434766 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3210244-3c64-4214-b284-540c2fab68a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.069071 Nov 27 20:52:31.436538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1133/2179] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:31 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:31.518864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:31.522387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:31.536541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:31.537535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:31.538502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:31.540464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:31.707818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:31.716959 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-332b3a43-5d31-48fb-9e8f-cd5d11034ad7 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 200 len: 1473 microversion: 2.1 time: 0.815610 Nov 27 20:52:31.719562 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1047/2180] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:30 2021] GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 1473 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:31.726053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0b1fb6c-02b8-4b1d-b84f-00ec6084852c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:31.727406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0b1fb6c-02b8-4b1d-b84f-00ec6084852c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:31.738131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b1fb6c-02b8-4b1d-b84f-00ec6084852c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:31.739213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b1fb6c-02b8-4b1d-b84f-00ec6084852c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:31.742453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b1fb6c-02b8-4b1d-b84f-00ec6084852c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:31.743185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b1fb6c-02b8-4b1d-b84f-00ec6084852c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:31.800588 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0b1fb6c-02b8-4b1d-b84f-00ec6084852c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.077766 Nov 27 20:52:31.803759 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1048/2181] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:31 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:31.980401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:31.981156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:31.998968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:31.999543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.001015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.001467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.209262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:32.216710 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bcddcdc0-702e-48ae-af62-c9988a33b6b3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1318 microversion: 2.1 time: 0.710768 Nov 27 20:52:32.220008 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1134/2182] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:31 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:32.254962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-92c6398c-2233-446a-be37-2f5f2f3dccdf req-9e042370-5384-4696-94c2-635c26cc6998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6c668f-a112-487a-83a3-dd50f8dc252b", "name": "network-vif-deleted", "tag": "062acbc0-509c-4546-aa47-d13c4188e1bf"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:32.257068 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:32.257068 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:32.270464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-92c6398c-2233-446a-be37-2f5f2f3dccdf req-9e042370-5384-4696-94c2-635c26cc6998 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.270962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-92c6398c-2233-446a-be37-2f5f2f3dccdf req-9e042370-5384-4696-94c2-635c26cc6998 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.294923 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-92c6398c-2233-446a-be37-2f5f2f3dccdf req-9e042370-5384-4696-94c2-635c26cc6998 service nova] Creating event network-vif-deleted:062acbc0-509c-4546-aa47-d13c4188e1bf for instance 4d6c668f-a112-487a-83a3-dd50f8dc252b on nch2-master-1 Nov 27 20:52:32.308093 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-92c6398c-2233-446a-be37-2f5f2f3dccdf req-9e042370-5384-4696-94c2-635c26cc6998 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056879 Nov 27 20:52:32.313792 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1135/2183] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:32.377530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:32.379074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:32.395384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.396098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.400038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.400721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.581544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:32.590852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-002860f3-baee-4408-a3e1-39d0a194cb8f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1522 microversion: 2.1 time: 0.614646 Nov 27 20:52:32.595771 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1049/2184] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:31 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:32.617314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e468894-8d17-44c8-a65c-b3453290236d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:32.620561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e468894-8d17-44c8-a65c-b3453290236d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:32.638633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e468894-8d17-44c8-a65c-b3453290236d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.642270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e468894-8d17-44c8-a65c-b3453290236d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.643450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e468894-8d17-44c8-a65c-b3453290236d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.644102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e468894-8d17-44c8-a65c-b3453290236d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.750763 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e468894-8d17-44c8-a65c-b3453290236d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.153517 Nov 27 20:52:32.751857 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1050/2185] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:32 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:32.760348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e6578801-d2bc-4589-b6e9-32cdd4003cd8 req-32fdcdbd-ba15-4101-9b98-b9ec937dd855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21735147-42d2-4c01-a74b-7ac91c6ac723", "name": "network-vif-deleted", "tag": "381881ef-aefe-442f-b7f9-355ca72b0903"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:32.765121 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:32.765121 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:32.787440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e6578801-d2bc-4589-b6e9-32cdd4003cd8 req-32fdcdbd-ba15-4101-9b98-b9ec937dd855 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.788634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e6578801-d2bc-4589-b6e9-32cdd4003cd8 req-32fdcdbd-ba15-4101-9b98-b9ec937dd855 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.820725 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e6578801-d2bc-4589-b6e9-32cdd4003cd8 req-32fdcdbd-ba15-4101-9b98-b9ec937dd855 service nova] Creating event network-vif-deleted:381881ef-aefe-442f-b7f9-355ca72b0903 for instance 21735147-42d2-4c01-a74b-7ac91c6ac723 on nch2-master-1 Nov 27 20:52:32.832869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e6578801-d2bc-4589-b6e9-32cdd4003cd8 req-32fdcdbd-ba15-4101-9b98-b9ec937dd855 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079394 Nov 27 20:52:32.834919 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1051/2186] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:32.858055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:32.860503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:32.875149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.879321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.880507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:32.881172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:32.915497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:32.976796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:32.994070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0cf9ed2-498e-4ce2-bb9d-e3f96b17914d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.619570 Nov 27 20:52:32.996743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1136/2187] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:32 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:33.015167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:33.022932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:33.047562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.048415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.049810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.050569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.133238 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b15d9a33-8a4c-4bb6-bced-06436603ad73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 204 len: 0 microversion: 2.1 time: 0.292402 Nov 27 20:52:33.134557 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1052/2188] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:32 2021] DELETE /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:33.150155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd6f86f6-2fe0-406b-9396-75597094e661 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:33.151418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd6f86f6-2fe0-406b-9396-75597094e661 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:33.167114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd6f86f6-2fe0-406b-9396-75597094e661 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.167893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd6f86f6-2fe0-406b-9396-75597094e661 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.169025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd6f86f6-2fe0-406b-9396-75597094e661 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.169938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd6f86f6-2fe0-406b-9396-75597094e661 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.182981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.184481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.185842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lazy-loading 'fault' on Instance uuid 21735147-42d2-4c01-a74b-7ac91c6ac723 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:52:33.245133 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd6f86f6-2fe0-406b-9396-75597094e661 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.104763 Nov 27 20:52:33.247363 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1053/2189] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:33 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:33.258000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:33.259811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:33.273779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.274666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.278533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.280206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.283358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:33.296115 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-84023bf7-ebab-4f45-8b0f-6ceddef16aa4 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 200 len: 1308 microversion: 2.1 time: 0.294008 Nov 27 20:52:33.299096 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1137/2190] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:32 2021] GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:33.313414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:33.314258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:33.333752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.335536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.339669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.340464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.695607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:33.708857 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-34b36eaa-3b83-4e13-91dd-4889b0e1c74c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1318 microversion: 2.1 time: 0.408560 Nov 27 20:52:33.716052 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1138/2191] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:33 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:33.763186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4189864-efe6-48f2-9952-2a39fb500993 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:33.764412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4189864-efe6-48f2-9952-2a39fb500993 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:33.779149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4189864-efe6-48f2-9952-2a39fb500993 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.781771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4189864-efe6-48f2-9952-2a39fb500993 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.782873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4189864-efe6-48f2-9952-2a39fb500993 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:33.784443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4189864-efe6-48f2-9952-2a39fb500993 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:33.825561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:33.836000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8ccb34d-2ecf-414a-a5a3-b2745903f307 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1528 microversion: 2.1 time: 0.584548 Nov 27 20:52:33.848447 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1054/2192] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:33 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1528 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:33.887937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4189864-efe6-48f2-9952-2a39fb500993 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.129019 Nov 27 20:52:33.900697 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1139/2193] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:33 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:34.015792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:34.016590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:34.040085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.043117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.044325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.045822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.257988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b9cb16cb-59c6-4e5d-9b2a-051d31a277ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:34.259698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b9cb16cb-59c6-4e5d-9b2a-051d31a277ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:34.267813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9cb16cb-59c6-4e5d-9b2a-051d31a277ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.268677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9cb16cb-59c6-4e5d-9b2a-051d31a277ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.269725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9cb16cb-59c6-4e5d-9b2a-051d31a277ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.270406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9cb16cb-59c6-4e5d-9b2a-051d31a277ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.328857 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b9cb16cb-59c6-4e5d-9b2a-051d31a277ff tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.073681 Nov 27 20:52:34.334447 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1140/2194] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:34 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:34.342883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:34.343760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 21735147-42d2-4c01-a74b-7ac91c6ac723] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:34.366755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.369321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.370912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.372316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.396558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance 21735147-42d2-4c01-a74b-7ac91c6ac723 could not be found. Nov 27 20:52:34.399322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance 21735147-42d2-4c01-a74b-7ac91c6ac723 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:34.401176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fafa2a5d-5d64-41c8-ae05-2ba1ec541613 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723" status: 404 len: 111 microversion: 2.1 time: 0.062503 Nov 27 20:52:34.402051 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1141/2195] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:34 2021] GET /compute/v2.1/servers/21735147-42d2-4c01-a74b-7ac91c6ac723 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:34.410092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ffc99da6-b86e-48d1-80a8-0aa8ac89875f req-5c076fa4-0cf8-4813-9269-ed4d2508c36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af66675-b153-4617-ad21-c79c87e4eac2", "tag": "b27a9306-471b-4b83-91e0-219d06b5219f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:34.415450 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:34.415450 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:34.427135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ffc99da6-b86e-48d1-80a8-0aa8ac89875f req-5c076fa4-0cf8-4813-9269-ed4d2508c36e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.428325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ffc99da6-b86e-48d1-80a8-0aa8ac89875f req-5c076fa4-0cf8-4813-9269-ed4d2508c36e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.441226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:34.451671 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a04dd1a-9ee9-46b7-87b7-017418d7defe tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.441900 Nov 27 20:52:34.464145 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1055/2196] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:34 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:34.464412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ffc99da6-b86e-48d1-80a8-0aa8ac89875f req-5c076fa4-0cf8-4813-9269-ed4d2508c36e service nova] Creating event network-changed:b27a9306-471b-4b83-91e0-219d06b5219f for instance 6af66675-b153-4617-ad21-c79c87e4eac2 on nch1-master-1 Nov 27 20:52:34.464529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:34.464529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: 4d6c668f-a112-487a-83a3-dd50f8dc252b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:34.465929 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ffc99da6-b86e-48d1-80a8-0aa8ac89875f req-5c076fa4-0cf8-4813-9269-ed4d2508c36e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061832 Nov 27 20:52:34.467343 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1142/2197] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:34.477576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.478041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.478910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.479441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.510300 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance 4d6c668f-a112-487a-83a3-dd50f8dc252b could not be found. Nov 27 20:52:34.511613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance 4d6c668f-a112-487a-83a3-dd50f8dc252b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:34.512479 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e6f5642-42b3-48ac-a7ac-a6b946c5af74 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b" status: 404 len: 111 microversion: 2.1 time: 0.057380 Nov 27 20:52:34.513701 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1056/2198] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:34 2021] GET /compute/v2.1/servers/4d6c668f-a112-487a-83a3-dd50f8dc252b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:34.530182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45883720-c154-4952-9123-f1385fe5bb56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:34.563776 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45883720-c154-4952-9123-f1385fe5bb56 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/19ef2532-367d-4b30-bcf3-220fa35a38fe" status: 204 len: 0 microversion: 2.1 time: 0.044343 Nov 27 20:52:34.569357 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1143/2199] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:52:34 2021] DELETE /compute/v2.1/os-server-groups/19ef2532-367d-4b30-bcf3-220fa35a38fe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:34.575850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:34.576668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:34.584531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.585259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.586273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.586983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.617597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:52:34.733272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:34.734188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:34.739172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45dbb097-761b-4041-93f6-14efad5d04c3 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 204 len: 0 microversion: 2.1 time: 0.168043 Nov 27 20:52:34.741633 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1057/2200] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:52:34 2021] DELETE /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:52:34.748865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.749509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.751304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.751750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.752079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:34.753361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:34.760852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.761679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:34.762911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:34.763974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.141108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:35.141540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:35.149113 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1e492729-3c18-4a02-8055-acc6c4267f15 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1471 microversion: 2.1 time: 0.402978 Nov 27 20:52:35.149720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1058/2201] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:34 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1471 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:35.162439 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cc8b82f9-5341-4e1b-9987-89a67cd08f63 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1318 microversion: 2.1 time: 0.432894 Nov 27 20:52:35.164109 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1144/2202] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:34 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:35.167169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:35.168138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:35.171636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-895b2b4b-a65d-441f-b33e-32b73da59e0d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:35.175047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-895b2b4b-a65d-441f-b33e-32b73da59e0d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:35.185458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.186296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.187298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.188479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.198635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-895b2b4b-a65d-441f-b33e-32b73da59e0d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.199579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-895b2b4b-a65d-441f-b33e-32b73da59e0d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.200892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-895b2b4b-a65d-441f-b33e-32b73da59e0d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.201656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-895b2b4b-a65d-441f-b33e-32b73da59e0d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.278909 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-895b2b4b-a65d-441f-b33e-32b73da59e0d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.112526 Nov 27 20:52:35.285553 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1145/2203] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:35 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:35.493684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-571591332", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:35.566301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:35.568502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] validate_networks() for [('b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:35.575054 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30824799-68bd-4d07-8361-1b08ea5ac193 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1528 microversion: 2.1 time: 0.424158 Nov 27 20:52:35.585028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1059/2204] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:35 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1528 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:35.590127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb4b21f8-0b1e-4e4e-b14f-f826a1b15022 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:35.591112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb4b21f8-0b1e-4e4e-b14f-f826a1b15022 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:35.598503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4b21f8-0b1e-4e4e-b14f-f826a1b15022 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.598952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4b21f8-0b1e-4e4e-b14f-f826a1b15022 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.599787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4b21f8-0b1e-4e4e-b14f-f826a1b15022 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.600222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4b21f8-0b1e-4e4e-b14f-f826a1b15022 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.644508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb4b21f8-0b1e-4e4e-b14f-f826a1b15022 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.057868 Nov 27 20:52:35.645326 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1060/2205] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:35 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:35.653314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:35.654056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:35.661294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.661745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.662526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:35.662957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:35.954929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:35.983533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f712237-a77a-4296-a8ba-1806ebd7187c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.336766 Nov 27 20:52:35.986109 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1061/2206] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:35 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:36.168808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:36.169718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:36.185169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.187972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.188817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.189270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.308814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:36.309855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:36.310473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:36.311071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:36.311661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:36.326240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.329725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.330755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.331438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.374175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:36.389464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for user b8a8aa467b0a42459f18f6bd4ee623e4 and project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:36.416209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:52:36.423922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:52:36.455510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:36.464474 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-517ddfac-6834-45b9-8e7d-2182ac0bbae9 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1471 microversion: 2.1 time: 0.301787 Nov 27 20:52:36.468141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1062/2207] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:36 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:36.476332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:36.480189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:36.497765 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-913d1c09-e274-47ae-8ea9-7ade059d64df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197741 Nov 27 20:52:36.499195 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1146/2208] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:52:36.509493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.510410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.511423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.511875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.513525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-68b09ee1-cbd3-4690-9e27-eff8c2c4d7c1 req-6c7c83c1-4a7b-4e68-83ed-73f5a32ea053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7b870d-40d5-4c15-9a87-89fdf19b33cb", "name": "network-vif-deleted", "tag": "c10c2fd2-5244-453a-826f-f5bb827d9b58"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:36.523860 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:36.523860 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:36.545225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-68b09ee1-cbd3-4690-9e27-eff8c2c4d7c1 req-6c7c83c1-4a7b-4e68-83ed-73f5a32ea053 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.545225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-68b09ee1-cbd3-4690-9e27-eff8c2c4d7c1 req-6c7c83c1-4a7b-4e68-83ed-73f5a32ea053 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.574836 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-68b09ee1-cbd3-4690-9e27-eff8c2c4d7c1 req-6c7c83c1-4a7b-4e68-83ed-73f5a32ea053 service nova] Creating event network-vif-deleted:c10c2fd2-5244-453a-826f-f5bb827d9b58 for instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb on nch1-master-1 Nov 27 20:52:36.588574 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-68b09ee1-cbd3-4690-9e27-eff8c2c4d7c1 req-6c7c83c1-4a7b-4e68-83ed-73f5a32ea053 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087132 Nov 27 20:52:36.589589 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1147/2209] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:36.596374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3034ac2-3a84-4fd3-8c13-004ce21559e0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:36.597632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3034ac2-3a84-4fd3-8c13-004ce21559e0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:36.605391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3034ac2-3a84-4fd3-8c13-004ce21559e0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.606140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3034ac2-3a84-4fd3-8c13-004ce21559e0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.607540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3034ac2-3a84-4fd3-8c13-004ce21559e0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.608155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3034ac2-3a84-4fd3-8c13-004ce21559e0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.663803 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3034ac2-3a84-4fd3-8c13-004ce21559e0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.071687 Nov 27 20:52:36.666206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1148/2210] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:36 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:36.680850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ecc4330a-bf0b-416c-8794-67b853211918 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:36.681578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ecc4330a-bf0b-416c-8794-67b853211918 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:36.778627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ecc4330a-bf0b-416c-8794-67b853211918 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:36.786305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ecc4330a-bf0b-416c-8794-67b853211918 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1207 microversion: 2.1 time: 0.118738 Nov 27 20:52:36.789947 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1149/2211] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:36 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1207 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:36.800840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:36.801718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:36.815551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.816266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.817062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.817662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.893290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:36.893747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:36.894209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lazy-loading 'fault' on Instance uuid bd7b870d-40d5-4c15-9a87-89fdf19b33cb {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:52:36.969775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:36.981284 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa9cda7d-868a-41c9-8336-2ca41c4851e9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 200 len: 1315 microversion: 2.1 time: 0.189758 Nov 27 20:52:36.982245 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1150/2212] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:36 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:37.003792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41f6cde6-e8c2-4a9f-9721-23e8bb340497 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:37.006306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41f6cde6-e8c2-4a9f-9721-23e8bb340497 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:37.019901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41f6cde6-e8c2-4a9f-9721-23e8bb340497 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.020879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41f6cde6-e8c2-4a9f-9721-23e8bb340497 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.023188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41f6cde6-e8c2-4a9f-9721-23e8bb340497 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.024893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41f6cde6-e8c2-4a9f-9721-23e8bb340497 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.090405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41f6cde6-e8c2-4a9f-9721-23e8bb340497 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.099367 Nov 27 20:52:37.095039 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1151/2213] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:36 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:37.108809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:37.112218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:37.129069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.129793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.135447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.136245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.207801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:37.224923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a4f1e572-47a9-4353-bb8d-9dcd137c3316 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1318 microversion: 2.1 time: 0.752210 Nov 27 20:52:37.228013 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1063/2214] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:36 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1318 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:37.237324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-bb3836e8-471c-46ad-b39b-9704de8869b4 req-b2478ac8-3d9b-4c5c-adf5-5fa910d3daea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821291e6-a643-4172-ba04-15984efe9761", "name": "network-vif-plugged", "status": "completed", "tag": "1cb73713-eb64-4a52-a006-70b1b4bcabdb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:37.238979 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:37.238979 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:37.263936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bb3836e8-471c-46ad-b39b-9704de8869b4 req-b2478ac8-3d9b-4c5c-adf5-5fa910d3daea service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.264426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bb3836e8-471c-46ad-b39b-9704de8869b4 req-b2478ac8-3d9b-4c5c-adf5-5fa910d3daea service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.286956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-bb3836e8-471c-46ad-b39b-9704de8869b4 req-b2478ac8-3d9b-4c5c-adf5-5fa910d3daea service nova] Creating event network-vif-plugged:1cb73713-eb64-4a52-a006-70b1b4bcabdb for instance 821291e6-a643-4172-ba04-15984efe9761 on nch2-master-1 Nov 27 20:52:37.301615 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-bb3836e8-471c-46ad-b39b-9704de8869b4 req-b2478ac8-3d9b-4c5c-adf5-5fa910d3daea service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069797 Nov 27 20:52:37.303326 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1064/2215] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:37.486764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:37.487886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:37.501549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.502297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.503381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.505928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.657266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:37.665722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a3d6fa2-039c-4a5d-ab5f-876c42c353e9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.569190 Nov 27 20:52:37.667927 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1152/2216] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:37 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:37.679850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4561f04227544d2ca76bce3dc5618c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03fae8406904a0da2046c097555cf58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:37.692371 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0116dd2d-e4e7-437c-aa0b-36984dbc0773 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 200 len: 1301 microversion: 2.1 time: 0.209589 Nov 27 20:52:37.692716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f8039d6d-999d-4cdc-ac18-5740d1a99372 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:37.693176 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1065/2217] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:37 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 1301 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:37.694667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f8039d6d-999d-4cdc-ac18-5740d1a99372 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:37.718212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8039d6d-999d-4cdc-ac18-5740d1a99372 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.719321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8039d6d-999d-4cdc-ac18-5740d1a99372 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.722039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8039d6d-999d-4cdc-ac18-5740d1a99372 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.725438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8039d6d-999d-4cdc-ac18-5740d1a99372 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.802744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:37.804879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:37.812940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.813410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.814212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:37.814639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:37.835706 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f8039d6d-999d-4cdc-ac18-5740d1a99372 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.159308 Nov 27 20:52:37.836369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1153/2218] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:37 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:37.909413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:37.920534 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5886a059-0906-41f9-b19e-085daa846111 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1259 microversion: 2.1 time: 0.121710 Nov 27 20:52:37.922768 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1066/2219] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:37 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1259 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:38.002285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:38.006847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:38.013957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.014416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.018393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.018849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.039311 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb could not be found. Nov 27 20:52:38.039915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:38.040787 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b2505b32-e2fa-46b2-84a8-ab22155081de tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 404 len: 111 microversion: 2.1 time: 0.043248 Nov 27 20:52:38.041381 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1154/2220] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:37 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:38.051671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-950d9ef4-e9b0-4063-9ddc-d7f82b9a0fcc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'create', calling method: .version_select at 0x7f15c7d70ee0>, body: {"keypair": {"name": "tempest-keypair-1452547011"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:38.068642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-950d9ef4-e9b0-4063-9ddc-d7f82b9a0fcc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for project 483860ef169447208569ca7510affe41. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:38.084006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-950d9ef4-e9b0-4063-9ddc-d7f82b9a0fcc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for user 4143c311f90d4b6bbae7b8eddcbef26f and project 483860ef169447208569ca7510affe41. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:38.112491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-036ec127-e660-4468-9448-31cc29da5b77 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:38.114810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-036ec127-e660-4468-9448-31cc29da5b77 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:38.127470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-036ec127-e660-4468-9448-31cc29da5b77 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.129156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-036ec127-e660-4468-9448-31cc29da5b77 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.131119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-036ec127-e660-4468-9448-31cc29da5b77 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.131833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-036ec127-e660-4468-9448-31cc29da5b77 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.218609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-036ec127-e660-4468-9448-31cc29da5b77 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.115276 Nov 27 20:52:38.219994 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1155/2221] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:38 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:38.256222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:38.257094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:38.275852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.293429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-950d9ef4-e9b0-4063-9ddc-d7f82b9a0fcc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for project 483860ef169447208569ca7510affe41. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:38.297938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.300510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-950d9ef4-e9b0-4063-9ddc-d7f82b9a0fcc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for user 4143c311f90d4b6bbae7b8eddcbef26f and project 483860ef169447208569ca7510affe41. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:38.300888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.301429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.318910 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-950d9ef4-e9b0-4063-9ddc-d7f82b9a0fcc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.272249 Nov 27 20:52:38.323449 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1067/2222] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:52:38 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:38.651325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-29b833df-e15c-46a3-a88a-325b41eb39ff req-77e1c50f-ce55-4d5b-b492-425f1938e58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca701c1d-30e3-471a-881e-6d51c9bbef61", "name": "network-vif-deleted", "tag": "8ad22e26-c654-4c33-99af-7729f8c1726b"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:38.652943 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:38.652943 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:38.664759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-29b833df-e15c-46a3-a88a-325b41eb39ff req-77e1c50f-ce55-4d5b-b492-425f1938e58f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.670751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-29b833df-e15c-46a3-a88a-325b41eb39ff req-77e1c50f-ce55-4d5b-b492-425f1938e58f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.688759 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-29b833df-e15c-46a3-a88a-325b41eb39ff req-77e1c50f-ce55-4d5b-b492-425f1938e58f service nova] Creating event network-vif-deleted:8ad22e26-c654-4c33-99af-7729f8c1726b for instance ca701c1d-30e3-471a-881e-6d51c9bbef61 on nch1-master-1 Nov 27 20:52:38.694541 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-29b833df-e15c-46a3-a88a-325b41eb39ff req-77e1c50f-ce55-4d5b-b492-425f1938e58f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047917 Nov 27 20:52:38.695748 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1068/2223] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:38.702162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:38.703612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:38.710493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.711175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.712199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.712833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.735649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:38.744241 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e158ca5f-f3a1-4f3c-b106-7a63cf2505ef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1318 microversion: 2.1 time: 0.504236 Nov 27 20:52:38.754257 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1156/2224] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:38 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:38.759472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:38.760575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] [instance: ca701c1d-30e3-471a-881e-6d51c9bbef61] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:38.767650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.768602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.769620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.770275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.790051 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] HTTP exception thrown: Instance ca701c1d-30e3-471a-881e-6d51c9bbef61 could not be found. Nov 27 20:52:38.791004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] Returning 404 to user: Instance ca701c1d-30e3-471a-881e-6d51c9bbef61 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:38.792199 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f85e12e-5860-466e-aa91-653852260243 tempest-ServersOnMultiNodesTest-196078870 tempest-ServersOnMultiNodesTest-196078870-project] 10.222.0.21 "GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61" status: 404 len: 111 microversion: 2.1 time: 0.036473 Nov 27 20:52:38.796281 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1157/2225] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:38 2021] GET /compute/v2.1/servers/ca701c1d-30e3-471a-881e-6d51c9bbef61 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:38.849330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fee968c-3b6f-4209-9aae-6abbfc9a8738 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:38.850576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9fee968c-3b6f-4209-9aae-6abbfc9a8738 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:38.859557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fee968c-3b6f-4209-9aae-6abbfc9a8738 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.860307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fee968c-3b6f-4209-9aae-6abbfc9a8738 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.861193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fee968c-3b6f-4209-9aae-6abbfc9a8738 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.861860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fee968c-3b6f-4209-9aae-6abbfc9a8738 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.917093 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9fee968c-3b6f-4209-9aae-6abbfc9a8738 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.072726 Nov 27 20:52:38.918988 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1158/2226] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:38 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:38.948481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:38.951374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:38.980421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.986980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:38.989969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:38.990611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:39.116492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:39.128188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5018e207-296f-4383-ac07-62e35432f283 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1318 microversion: 2.1 time: 0.427789 Nov 27 20:52:39.131353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1069/2227] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:38 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:39.236414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:39.244662 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10b881a2-3c46-4e48-8a2a-8a41d6016f48 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1265 microversion: 2.1 time: 0.309959 Nov 27 20:52:39.248194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1159/2228] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:38 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:39.253906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08dc6aab-3da8-4434-9741-80b83a03d338 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:39.257425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08dc6aab-3da8-4434-9741-80b83a03d338 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:39.290676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dc6aab-3da8-4434-9741-80b83a03d338 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:39.291208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dc6aab-3da8-4434-9741-80b83a03d338 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:39.293676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dc6aab-3da8-4434-9741-80b83a03d338 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:39.295184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08dc6aab-3da8-4434-9741-80b83a03d338 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:39.409753 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08dc6aab-3da8-4434-9741-80b83a03d338 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.159523 Nov 27 20:52:39.416999 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1160/2229] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:39 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:39.579330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62f09a22-230f-4fec-95a0-8f7405ded030 tempest-FloatingIPDetailsNegativeTestJSON-1043279550 tempest-FloatingIPDetailsNegativeTestJSON-1043279550-project] Calling method '.version_select at 0x7f15c7ccb790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:39.665479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7cedadf9-93cf-40ab-a41d-67c4efe771ee req-2fc1e858-0fb2-42c6-9071-97be0f588697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af66675-b153-4617-ad21-c79c87e4eac2", "name": "network-vif-plugged", "status": "completed", "tag": "b27a9306-471b-4b83-91e0-219d06b5219f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:39.668958 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:39.668958 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:39.684057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7cedadf9-93cf-40ab-a41d-67c4efe771ee req-2fc1e858-0fb2-42c6-9071-97be0f588697 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:39.685440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7cedadf9-93cf-40ab-a41d-67c4efe771ee req-2fc1e858-0fb2-42c6-9071-97be0f588697 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:39.703328 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7cedadf9-93cf-40ab-a41d-67c4efe771ee req-2fc1e858-0fb2-42c6-9071-97be0f588697 service nova] Creating event network-vif-plugged:b27a9306-471b-4b83-91e0-219d06b5219f for instance 6af66675-b153-4617-ad21-c79c87e4eac2 on nch1-master-1 Nov 27 20:52:39.710451 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7cedadf9-93cf-40ab-a41d-67c4efe771ee req-2fc1e858-0fb2-42c6-9071-97be0f588697 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052829 Nov 27 20:52:39.712015 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1161/2230] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:39.764452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:39.765465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:39.781847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:39.785834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:39.788399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:39.789659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:39.795689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-62f09a22-230f-4fec-95a0-8f7405ded030 tempest-FloatingIPDetailsNegativeTestJSON-1043279550 tempest-FloatingIPDetailsNegativeTestJSON-1043279550-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1d54bd6c-63b0-4f54-ae5a-0a16b10f04be could not be found", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:52:39.798735 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-62f09a22-230f-4fec-95a0-8f7405ded030 tempest-FloatingIPDetailsNegativeTestJSON-1043279550 tempest-FloatingIPDetailsNegativeTestJSON-1043279550-project] HTTP exception thrown: Floating IP not found for ID 1d54bd6c-63b0-4f54-ae5a-0a16b10f04be Nov 27 20:52:39.799373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62f09a22-230f-4fec-95a0-8f7405ded030 tempest-FloatingIPDetailsNegativeTestJSON-1043279550 tempest-FloatingIPDetailsNegativeTestJSON-1043279550-project] Returning 404 to user: Floating IP not found for ID 1d54bd6c-63b0-4f54-ae5a-0a16b10f04be {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:39.800571 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62f09a22-230f-4fec-95a0-8f7405ded030 tempest-FloatingIPDetailsNegativeTestJSON-1043279550 tempest-FloatingIPDetailsNegativeTestJSON-1043279550-project] 10.222.0.21 "GET /compute/v2.1/os-floating-ips/1d54bd6c-63b0-4f54-ae5a-0a16b10f04be" status: 404 len: 111 microversion: 2.1 time: 0.636058 Nov 27 20:52:39.801750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1070/2231] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:52:39 2021] GET /compute/v2.1/os-floating-ips/1d54bd6c-63b0-4f54-ae5a-0a16b10f04be => generated 111 bytes in 638 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:39.931639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-03304064-ec50-45e7-bf99-0bb0de30dd71 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:39.932612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-03304064-ec50-45e7-bf99-0bb0de30dd71 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:39.948628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03304064-ec50-45e7-bf99-0bb0de30dd71 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:39.949355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03304064-ec50-45e7-bf99-0bb0de30dd71 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:39.950474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03304064-ec50-45e7-bf99-0bb0de30dd71 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:39.951023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03304064-ec50-45e7-bf99-0bb0de30dd71 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:40.226349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-03304064-ec50-45e7-bf99-0bb0de30dd71 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.298145 Nov 27 20:52:40.227129 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1071/2232] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:39 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:40.271059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:40.274715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:40.278362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:40.289094 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-841b2284-6df8-40c8-9e79-ebd88eeb693d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1318 microversion: 2.1 time: 0.531167 Nov 27 20:52:40.298978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:40.299535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:40.300211 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1162/2233] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:39 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:40.304626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:40.305214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:40.307521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:40.308034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:40.312337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:40.312792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:40.313578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:40.314015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:40.715872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:40.737749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b053a0f5-930b-4215-88d4-8df2dfe62041 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1507 microversion: 2.1 time: 0.507719 Nov 27 20:52:40.741253 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1072/2234] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:40 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1507 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:40.757543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0a75d6db-3618-4713-86b7-9f6e6f85a3b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:40.759764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0a75d6db-3618-4713-86b7-9f6e6f85a3b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:40.799106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a75d6db-3618-4713-86b7-9f6e6f85a3b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:40.799853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a75d6db-3618-4713-86b7-9f6e6f85a3b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:40.800724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a75d6db-3618-4713-86b7-9f6e6f85a3b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:40.801170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a75d6db-3618-4713-86b7-9f6e6f85a3b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:40.870397 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0a75d6db-3618-4713-86b7-9f6e6f85a3b6 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.125763 Nov 27 20:52:40.871094 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1073/2235] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:40 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:41.006505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:41.023872 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c4163cb-823c-4d78-b4b6-0875616578a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.722746 Nov 27 20:52:41.025234 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1163/2236] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:40 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:41.247548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63a3bed0-86f9-48f5-a5a9-4921fc6902c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:41.248739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63a3bed0-86f9-48f5-a5a9-4921fc6902c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:41.299455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a3bed0-86f9-48f5-a5a9-4921fc6902c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:41.299455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a3bed0-86f9-48f5-a5a9-4921fc6902c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:41.299455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a3bed0-86f9-48f5-a5a9-4921fc6902c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:41.305468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a3bed0-86f9-48f5-a5a9-4921fc6902c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:41.316530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:41.317144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:41.326855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:41.327338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:41.328241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:41.328622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:41.457760 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63a3bed0-86f9-48f5-a5a9-4921fc6902c1 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.219141 Nov 27 20:52:41.467100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1074/2237] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:41 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:41.725089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-80f635da-e2aa-4aa2-92e7-b7a69f22019c req-da77c74d-ab9c-457e-a9bb-db438ff23897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5ef299-0115-4cd2-b728-afcd425f78b5", "tag": "91c15e78-d85f-42e5-90f2-bd938828b809"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:41.728101 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:41.728101 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:41.745666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80f635da-e2aa-4aa2-92e7-b7a69f22019c req-da77c74d-ab9c-457e-a9bb-db438ff23897 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:41.746110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80f635da-e2aa-4aa2-92e7-b7a69f22019c req-da77c74d-ab9c-457e-a9bb-db438ff23897 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:41.774412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-80f635da-e2aa-4aa2-92e7-b7a69f22019c req-da77c74d-ab9c-457e-a9bb-db438ff23897 service nova] Creating event network-changed:91c15e78-d85f-42e5-90f2-bd938828b809 for instance cc5ef299-0115-4cd2-b728-afcd425f78b5 on nch2-master-1 Nov 27 20:52:41.795903 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-80f635da-e2aa-4aa2-92e7-b7a69f22019c req-da77c74d-ab9c-457e-a9bb-db438ff23897 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078453 Nov 27 20:52:41.796742 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1075/2238] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:41.888733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:41.901912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33e2ba6b-5670-4440-a357-b15214d97c5d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:41.908706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33e2ba6b-5670-4440-a357-b15214d97c5d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:41.926575 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2795e5ad-5c22-4d2a-b38d-e63861b2821f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1318 microversion: 2.1 time: 0.610249 Nov 27 20:52:41.930421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1164/2239] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:41 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:41.937693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33e2ba6b-5670-4440-a357-b15214d97c5d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:41.940106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33e2ba6b-5670-4440-a357-b15214d97c5d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:41.942868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33e2ba6b-5670-4440-a357-b15214d97c5d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:41.945272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33e2ba6b-5670-4440-a357-b15214d97c5d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.040923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33e2ba6b-5670-4440-a357-b15214d97c5d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.160461 Nov 27 20:52:42.042247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1076/2240] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:41 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:42.047211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:42.048473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:42.071178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.071990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.073349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.083299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.416278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89e965f2-b424-4e58-b544-b4449c101ffc tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cad55e6f-4b88-4111-9cfb-0a54a768ecde"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:42.417734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89e965f2-b424-4e58-b544-b4449c101ffc tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:42.436440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e965f2-b424-4e58-b544-b4449c101ffc tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.439617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e965f2-b424-4e58-b544-b4449c101ffc tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.450178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e965f2-b424-4e58-b544-b4449c101ffc tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.450929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e965f2-b424-4e58-b544-b4449c101ffc tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.494681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:42.522262 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89e1aa48-bd72-4fa5-b6af-42d78924e48a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.475675 Nov 27 20:52:42.523527 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1165/2241] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:42 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:42.539736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a83222bb-05c9-4aad-a8dc-4b8166df2799 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:42.547401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a83222bb-05c9-4aad-a8dc-4b8166df2799 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:42.574083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a83222bb-05c9-4aad-a8dc-4b8166df2799 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.575577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a83222bb-05c9-4aad-a8dc-4b8166df2799 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.594453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a83222bb-05c9-4aad-a8dc-4b8166df2799 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.594950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a83222bb-05c9-4aad-a8dc-4b8166df2799 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.668745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a83222bb-05c9-4aad-a8dc-4b8166df2799 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.143274 Nov 27 20:52:42.674480 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1166/2242] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:42 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:42.805606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-213717960", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51800357-640d-4106-97ff-61854e2562e6"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:42.927159 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89e965f2-b424-4e58-b544-b4449c101ffc tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515917 Nov 27 20:52:42.927886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1077/2243] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:52:42 2021] POST /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:42.930275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] validate_networks() for [('51800357-640d-4106-97ff-61854e2562e6', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:42.960980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:42.961784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:42.975164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.975874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:42.979417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:42.980181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.374521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:43.388522 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-520fd214-68f3-4755-8922-90117577edc9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1508 microversion: 2.1 time: 0.433536 Nov 27 20:52:43.415425 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1078/2244] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:42 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:43.425762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab4aae2f-f394-4675-b08e-222c34e8974d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:43.426849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab4aae2f-f394-4675-b08e-222c34e8974d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:43.454764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4aae2f-f394-4675-b08e-222c34e8974d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.455225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4aae2f-f394-4675-b08e-222c34e8974d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.456184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4aae2f-f394-4675-b08e-222c34e8974d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.456634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4aae2f-f394-4675-b08e-222c34e8974d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.525935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab4aae2f-f394-4675-b08e-222c34e8974d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.108858 Nov 27 20:52:43.529980 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1079/2245] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:43 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:43.537246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:43.537969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:43.550123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.550600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.551437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.551923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.739484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:43.750605 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b408576d-fc7b-4ed1-b087-0ec172ebdf31 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1508 microversion: 2.1 time: 0.221857 Nov 27 20:52:43.751197 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1080/2246] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:43 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:43.767324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:43.767945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:43.774610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.775068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.776023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.776460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.951507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:43.961148 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18ece397-b7cb-4a0d-b738-5a9f1e18abe4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.198021 Nov 27 20:52:43.961736 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1081/2247] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:43 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:43.966907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed6024ad-773f-4cf4-8d38-779f5ae88da6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:43.967885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed6024ad-773f-4cf4-8d38-779f5ae88da6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:43.975363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6024ad-773f-4cf4-8d38-779f5ae88da6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.975817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6024ad-773f-4cf4-8d38-779f5ae88da6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:43.976615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6024ad-773f-4cf4-8d38-779f5ae88da6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:43.977062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed6024ad-773f-4cf4-8d38-779f5ae88da6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.039702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed6024ad-773f-4cf4-8d38-779f5ae88da6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.076689 Nov 27 20:52:44.040788 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1082/2248] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:43 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:44.045969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "OS-DCF:diskConfig": "AUTO"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:44.048089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:44.055636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.056279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.057306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.057982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.165415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:44.165724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:44.166488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:44.167234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:44.167718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:44.242537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:44.252426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.253274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.254474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.256070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.312132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:44.313173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:44.313812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:44.314414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:44.314985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:44.333028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.337604 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dadcf266-8be4-44bd-8804-02a3b40dd77d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "POST /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2/action" status: 202 len: 1110 microversion: 2.1 time: 0.295544 Nov 27 20:52:44.338459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.339706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.340323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.351044 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1083/2249] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:44 2021] POST /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2/action => generated 1110 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 20:52:44.367151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:44.375561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:44.379990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for project 483860ef169447208569ca7510affe41. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:44.387043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.390668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.392125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.393694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for user 4143c311f90d4b6bbae7b8eddcbef26f and project 483860ef169447208569ca7510affe41. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:44.394520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.425920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:52:44.429865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:52:44.537407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92127f23-e90c-4a75-8738-2751dcd3b01e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.738536 Nov 27 20:52:44.538587 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1167/2250] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:42 2021] POST /compute/v2.1/servers => generated 383 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 20:52:44.549834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a58f866-6ce7-49af-b58b-ffedb15f98e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:44.556766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a58f866-6ce7-49af-b58b-ffedb15f98e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:44.574881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a58f866-6ce7-49af-b58b-ffedb15f98e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.575725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a58f866-6ce7-49af-b58b-ffedb15f98e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.593366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a58f866-6ce7-49af-b58b-ffedb15f98e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:44.596066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a58f866-6ce7-49af-b58b-ffedb15f98e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:44.708663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a58f866-6ce7-49af-b58b-ffedb15f98e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.167156 Nov 27 20:52:44.709631 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1168/2251] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:44 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:44.724539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1e1f791-2d44-463a-8098-661436039ffc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:44.725328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b1e1f791-2d44-463a-8098-661436039ffc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:44.734308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:44.748669 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3acc0eb2-eaaa-4c12-b1ca-af27f029b9f4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.384289 Nov 27 20:52:44.750931 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1084/2252] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:44 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:44.843007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b1e1f791-2d44-463a-8098-661436039ffc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:44.851145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1e1f791-2d44-463a-8098-661436039ffc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1224 microversion: 2.1 time: 0.140132 Nov 27 20:52:44.851752 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1169/2253] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:44 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1224 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:44.979854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:44.981784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:45.021241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.027277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.028625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.032694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.052798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dcfe9a40-6394-4107-a502-8b7681082f1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:45.053950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dcfe9a40-6394-4107-a502-8b7681082f1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:45.071394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcfe9a40-6394-4107-a502-8b7681082f1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.076427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcfe9a40-6394-4107-a502-8b7681082f1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.082499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcfe9a40-6394-4107-a502-8b7681082f1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.085463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcfe9a40-6394-4107-a502-8b7681082f1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.179175 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dcfe9a40-6394-4107-a502-8b7681082f1e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.127681 Nov 27 20:52:45.185805 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1170/2254] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:45 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:45.412518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:45.429118 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-351f6609-2288-4195-a548-7807a7f75522 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.453413 Nov 27 20:52:45.433359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1085/2255] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:44 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:45.721152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ff2264e-0b98-4c21-b7e0-c2e6c9ba2239 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:45.722419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9ff2264e-0b98-4c21-b7e0-c2e6c9ba2239 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:45.732887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff2264e-0b98-4c21-b7e0-c2e6c9ba2239 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.733353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff2264e-0b98-4c21-b7e0-c2e6c9ba2239 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.734901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff2264e-0b98-4c21-b7e0-c2e6c9ba2239 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.735649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff2264e-0b98-4c21-b7e0-c2e6c9ba2239 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.775810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:45.776483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:45.783173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.783655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.784493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.784906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.789202 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ff2264e-0b98-4c21-b7e0-c2e6c9ba2239 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.072319 Nov 27 20:52:45.790292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1171/2256] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:45 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:45.870381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:45.871085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:45.879762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.880215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.881022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:45.881834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:45.961670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:45.977317 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-802fa5c5-12a1-4f78-9daf-3627830cea66 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.208025 Nov 27 20:52:45.977973 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1086/2257] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:45 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:46.015031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:46.027311 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6deb5ce5-2104-41af-a5f9-223d457ca2ef tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1276 microversion: 2.1 time: 0.161304 Nov 27 20:52:46.033568 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1172/2258] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:45 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:46.196994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34ac90c1-d772-45c0-8c25-b97de02c0567 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:46.198072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34ac90c1-d772-45c0-8c25-b97de02c0567 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:46.212709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ac90c1-d772-45c0-8c25-b97de02c0567 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:46.213098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ac90c1-d772-45c0-8c25-b97de02c0567 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:46.213907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ac90c1-d772-45c0-8c25-b97de02c0567 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:46.214348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ac90c1-d772-45c0-8c25-b97de02c0567 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:46.286967 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34ac90c1-d772-45c0-8c25-b97de02c0567 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.093710 Nov 27 20:52:46.288230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1087/2259] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:46 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:46.450347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:46.450496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:46.457351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:46.458011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:46.459016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:46.459481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:46.508009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2074353311", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "4c1c2964-efe7-47f4-bb47-68bb0bb15cce"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:46.581134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] validate_networks() for [('4c1c2964-efe7-47f4-bb47-68bb0bb15cce', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:46.935290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:46.947804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8fcf9f57-5141-40e2-afec-dc919871fc3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.501592 Nov 27 20:52:46.949401 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1173/2260] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:46 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:46.959062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3277db19-91c9-448f-9603-8aa49d5f1015 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:46.961393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3277db19-91c9-448f-9603-8aa49d5f1015 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:46.974185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3277db19-91c9-448f-9603-8aa49d5f1015 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:46.975207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3277db19-91c9-448f-9603-8aa49d5f1015 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:46.976104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3277db19-91c9-448f-9603-8aa49d5f1015 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:46.976546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3277db19-91c9-448f-9603-8aa49d5f1015 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.045294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3277db19-91c9-448f-9603-8aa49d5f1015 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.094014 Nov 27 20:52:47.048727 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1174/2261] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:46 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:47.055949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:47.057330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:47.078632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.080106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.080970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.081417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.420263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:47.432945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80b2cddb-dfe3-46ff-938d-b6319fbe0cd4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.379584 Nov 27 20:52:47.436643 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1175/2262] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:47 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:47.452002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:47.459155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:47.472395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:47.473177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:47.474055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:47.474645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.474828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:47.475642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:47.476643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.478996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.479864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.488075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.488883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.490066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.490899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.514345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:47.522035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for user 6f940822793e422c8436036be6a116a0 and project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:47.539458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:52:47.542558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:52:47.616733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f73a25a5-5535-44c2-97d9-2e1861ae873a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113743 Nov 27 20:52:47.623549 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1088/2263] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:52:47.643022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66f14c59-ba9c-4d8e-b1bf-05de4d30a5c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:47.644441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66f14c59-ba9c-4d8e-b1bf-05de4d30a5c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:47.665434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66f14c59-ba9c-4d8e-b1bf-05de4d30a5c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.665905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66f14c59-ba9c-4d8e-b1bf-05de4d30a5c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.666712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66f14c59-ba9c-4d8e-b1bf-05de4d30a5c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.667157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66f14c59-ba9c-4d8e-b1bf-05de4d30a5c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.754908 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66f14c59-ba9c-4d8e-b1bf-05de4d30a5c0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.129717 Nov 27 20:52:47.755602 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1089/2264] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:47 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:47.767803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a44a17b3-fb3f-4313-bdc9-f9f717660015 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:47.768759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a44a17b3-fb3f-4313-bdc9-f9f717660015 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:47.947340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a44a17b3-fb3f-4313-bdc9-f9f717660015 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:47.955984 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a44a17b3-fb3f-4313-bdc9-f9f717660015 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1218 microversion: 2.1 time: 0.198912 Nov 27 20:52:47.958831 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1090/2265] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:47 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:47.971786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:47.976100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:47.985496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:47.995662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.996127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:47.997075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:47.997388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.002060 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ee15f1a-f519-4ca1-921e-314de7fe7c46 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1324 microversion: 2.1 time: 0.562158 Nov 27 20:52:48.003480 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1176/2266] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:47 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1324 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:48.247753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-860759619", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "ea1d2eec-b8f7-4251-aae1-c470a22d9037"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:48.352610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] validate_networks() for [('ea1d2eec-b8f7-4251-aae1-c470a22d9037', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:52:48.358421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:48.378519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3a2cdcc-f673-47ff-bfe9-6311afb767c5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.410988 Nov 27 20:52:48.379669 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1091/2267] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:47 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:48.402981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-19f73c85-12f4-46c4-b245-28118778ca5c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:48.407106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-19f73c85-12f4-46c4-b245-28118778ca5c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:48.419457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19f73c85-12f4-46c4-b245-28118778ca5c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.420923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19f73c85-12f4-46c4-b245-28118778ca5c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.422482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19f73c85-12f4-46c4-b245-28118778ca5c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.423114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19f73c85-12f4-46c4-b245-28118778ca5c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.495577 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-19f73c85-12f4-46c4-b245-28118778ca5c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.113610 Nov 27 20:52:48.497883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1092/2268] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:48 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:48.505019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:48.511892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:48.520836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.521681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.522831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.523470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.810926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:48.819660 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63e19423-3f27-4075-9d33-f584d0d5f78e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.320186 Nov 27 20:52:48.820323 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1093/2269] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:48 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:48.825243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed7e1a07-f15a-417e-93f8-5cb57acd501f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:48.826455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed7e1a07-f15a-417e-93f8-5cb57acd501f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:48.835035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7e1a07-f15a-417e-93f8-5cb57acd501f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.835638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7e1a07-f15a-417e-93f8-5cb57acd501f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.836676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7e1a07-f15a-417e-93f8-5cb57acd501f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.837112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7e1a07-f15a-417e-93f8-5cb57acd501f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.870588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:52:48.871302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:52:48.871967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:52:48.873039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:52:48.873039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:52:48.884660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.885203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.886009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.886445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.887391 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed7e1a07-f15a-417e-93f8-5cb57acd501f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.065580 Nov 27 20:52:48.888801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1094/2270] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:48 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:48.903417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0173c9d7-bf63-4213-909d-bd0b096b147c req-91ed8b8d-01f3-475a-8c5c-38e15f8d25c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89360906-579a-4126-bc8d-e3e4cff060e0", "tag": "cbbbfa16-834b-452b-bcfa-17d86ec350c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:48.906030 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:48.906030 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:48.906263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Getting quotas for project 9f57434a24104e95bcff0d4cabbd1419. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:52:48.911606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Getting quotas for user 9de6e0419e7843089302fa399e9e56aa and project 9f57434a24104e95bcff0d4cabbd1419. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:52:48.914332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0173c9d7-bf63-4213-909d-bd0b096b147c req-91ed8b8d-01f3-475a-8c5c-38e15f8d25c7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:48.914938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0173c9d7-bf63-4213-909d-bd0b096b147c req-91ed8b8d-01f3-475a-8c5c-38e15f8d25c7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:48.927472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:52:48.930113 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0173c9d7-bf63-4213-909d-bd0b096b147c req-91ed8b8d-01f3-475a-8c5c-38e15f8d25c7 service nova] Creating event network-changed:cbbbfa16-834b-452b-bcfa-17d86ec350c7 for instance 89360906-579a-4126-bc8d-e3e4cff060e0 on nch1-master-1 Nov 27 20:52:48.930893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:52:48.949502 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0173c9d7-bf63-4213-909d-bd0b096b147c req-91ed8b8d-01f3-475a-8c5c-38e15f8d25c7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058357 Nov 27 20:52:48.950431 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1095/2271] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:48.978705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:48.979435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:49.001942 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65773c90-49dd-465c-8091-655a020e5162 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996916 Nov 27 20:52:49.002601 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1177/2272] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:52:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:52:49.017197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-feb04fac-fdfd-4bf5-9822-3bdaea13aac0 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:49.020226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.020683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.021273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-feb04fac-fdfd-4bf5-9822-3bdaea13aac0 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:49.021484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.021926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.100809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-feb04fac-fdfd-4bf5-9822-3bdaea13aac0 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:49.122711 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-feb04fac-fdfd-4bf5-9822-3bdaea13aac0 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1217 microversion: 2.1 time: 0.113457 Nov 27 20:52:49.128061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1178/2273] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:49 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:49.134390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:49.135300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:49.148557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.149341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.150564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.151343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.194284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:49.204085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b72a4b7-2363-4e65-be2a-60bf5a1eb176 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1270 microversion: 2.1 time: 0.231288 Nov 27 20:52:49.209994 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1096/2274] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:48 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:49.397116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:49.402196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:49.402859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:49.405796 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3b1e6b5-7782-44d2-b14d-84cb92acadd3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1324 microversion: 2.1 time: 0.276582 Nov 27 20:52:49.407038 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1179/2275] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:49 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:49.411046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.411730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.412698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.413310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.508230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72527cc5-3190-4ca6-b0f3-6ad02577a3cd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:49.509395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72527cc5-3190-4ca6-b0f3-6ad02577a3cd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:49.518347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72527cc5-3190-4ca6-b0f3-6ad02577a3cd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.519086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72527cc5-3190-4ca6-b0f3-6ad02577a3cd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.520132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72527cc5-3190-4ca6-b0f3-6ad02577a3cd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.520685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72527cc5-3190-4ca6-b0f3-6ad02577a3cd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.571384 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72527cc5-3190-4ca6-b0f3-6ad02577a3cd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.066602 Nov 27 20:52:49.572285 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1180/2276] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:49 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:49.772305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:49.784191 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-988de8b4-f725-4cec-9b09-d3550e7b1cf5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.390868 Nov 27 20:52:49.796426 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1097/2277] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:49 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:49.840345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:49.841306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:49.851507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.852285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.853332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.853939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.902058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-130ed0a2-022f-41c1-8ecd-65eeb7d270db tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:49.903782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-130ed0a2-022f-41c1-8ecd-65eeb7d270db tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:49.922842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130ed0a2-022f-41c1-8ecd-65eeb7d270db tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.929175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130ed0a2-022f-41c1-8ecd-65eeb7d270db tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.930570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130ed0a2-022f-41c1-8ecd-65eeb7d270db tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:49.931285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130ed0a2-022f-41c1-8ecd-65eeb7d270db tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:49.990070 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-130ed0a2-022f-41c1-8ecd-65eeb7d270db tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.092121 Nov 27 20:52:49.991042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1098/2278] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:49 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:50.045561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:50.054411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-31284187-e355-4144-a838-bc16096a3cd5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.218531 Nov 27 20:52:50.055151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1181/2279] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:49 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:50.123099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42ba5faa-ba3e-4e89-9065-0aa77f6f2887 tempest-ListImageFiltersNegativeTestJSON-366688997 tempest-ListImageFiltersNegativeTestJSON-366688997-project] Calling method '.version_select at 0x7f15c7d07310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:50.145335 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-42ba5faa-ba3e-4e89-9065-0aa77f6f2887 tempest-ListImageFiltersNegativeTestJSON-366688997 tempest-ListImageFiltersNegativeTestJSON-366688997-project] HTTP exception thrown: Image not found. Nov 27 20:52:50.145945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42ba5faa-ba3e-4e89-9065-0aa77f6f2887 tempest-ListImageFiltersNegativeTestJSON-366688997 tempest-ListImageFiltersNegativeTestJSON-366688997-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:50.146768 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42ba5faa-ba3e-4e89-9065-0aa77f6f2887 tempest-ListImageFiltersNegativeTestJSON-366688997 tempest-ListImageFiltersNegativeTestJSON-366688997-project] 10.222.0.21 "GET /compute/v2.1/images/0cb3f2ed-5da9-4525-b503-951c55dfe6cd" status: 404 len: 62 microversion: 2.1 time: 0.154420 Nov 27 20:52:50.147533 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1099/2280] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:49 2021] GET /compute/v2.1/images/0cb3f2ed-5da9-4525-b503-951c55dfe6cd => generated 62 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:50.149079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:50.151010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:50.170953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.171497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.172438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.172917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.226940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:50.227719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:50.240338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.241249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.244887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.245655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.276400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:50.286407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ee7b526-0934-4005-aa74-8bad09098daf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1269 microversion: 2.1 time: 0.145085 Nov 27 20:52:50.297043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1182/2281] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:50 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:50.355470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:50.364985 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cbfb7a08-7a86-4ef5-ae3a-bb69c4276b99 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1276 microversion: 2.1 time: 0.142008 Nov 27 20:52:50.365579 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1100/2282] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:50 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:50.433851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:50.434917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:50.451299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.454097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.455107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.457481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.585312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2fb49bb0-93e9-40a9-a6b2-7131d1b75a71 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:50.586759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2fb49bb0-93e9-40a9-a6b2-7131d1b75a71 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:50.595548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fb49bb0-93e9-40a9-a6b2-7131d1b75a71 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.596327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fb49bb0-93e9-40a9-a6b2-7131d1b75a71 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.597310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fb49bb0-93e9-40a9-a6b2-7131d1b75a71 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.597909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fb49bb0-93e9-40a9-a6b2-7131d1b75a71 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.654847 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2fb49bb0-93e9-40a9-a6b2-7131d1b75a71 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.074032 Nov 27 20:52:50.656960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1101/2283] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:50 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:50.763917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:50.773103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5c399ed-eafd-419f-bf66-f4e97bff564d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1324 microversion: 2.1 time: 0.353448 Nov 27 20:52:50.773866 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1183/2284] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:50 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:50.804597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:50.806082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:50.820121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.820971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:50.822219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:50.822933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.002215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3610ecb4-217f-47f5-a783-3e568182df05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:51.003279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3610ecb4-217f-47f5-a783-3e568182df05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:51.009733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3610ecb4-217f-47f5-a783-3e568182df05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.010433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3610ecb4-217f-47f5-a783-3e568182df05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.011432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3610ecb4-217f-47f5-a783-3e568182df05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.012035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3610ecb4-217f-47f5-a783-3e568182df05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.063969 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3610ecb4-217f-47f5-a783-3e568182df05 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.065356 Nov 27 20:52:51.065476 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1184/2285] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:50 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:51.075951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:51.077201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:51.087634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.088548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.089589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.090430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.240195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:51.250657 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89e728de-97b0-4a4d-a6d0-aa68edfe8337 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.452219 Nov 27 20:52:51.251805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1102/2286] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:50 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:51.266351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-efd8fd56-8926-4566-add3-5cca13d70b99 req-55118172-0ecc-4d12-b468-628c52a7e746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ef299-0115-4cd2-b728-afcd425f78b5", "name": "network-vif-plugged", "status": "completed", "tag": "91c15e78-d85f-42e5-90f2-bd938828b809"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:51.268370 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:51.268370 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:52:51.288281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-efd8fd56-8926-4566-add3-5cca13d70b99 req-55118172-0ecc-4d12-b468-628c52a7e746 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.288813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-efd8fd56-8926-4566-add3-5cca13d70b99 req-55118172-0ecc-4d12-b468-628c52a7e746 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.303211 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-efd8fd56-8926-4566-add3-5cca13d70b99 req-55118172-0ecc-4d12-b468-628c52a7e746 service nova] Creating event network-vif-plugged:91c15e78-d85f-42e5-90f2-bd938828b809 for instance cc5ef299-0115-4cd2-b728-afcd425f78b5 on nch2-master-1 Nov 27 20:52:51.308741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-efd8fd56-8926-4566-add3-5cca13d70b99 req-55118172-0ecc-4d12-b468-628c52a7e746 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055627 Nov 27 20:52:51.310277 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1103/2287] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:51.330032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:51.332508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:51.342493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.344091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.347670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.348948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.356318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:51.368624 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f3c856d-eb62-44f6-b4b3-be42f09273a0 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.296885 Nov 27 20:52:51.370038 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1185/2288] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:51 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:51.391095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:51.392302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:51.413152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.414159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.415907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.416839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.728531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:51.740900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5d557a2-8eeb-43cf-8680-4b9a9ffa910c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.356906 Nov 27 20:52:51.751302 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1186/2289] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:51 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:51.756838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce816f18-20d8-4976-9ad2-535067efd09a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:51.758153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce816f18-20d8-4976-9ad2-535067efd09a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:51.772450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce816f18-20d8-4976-9ad2-535067efd09a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.773166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce816f18-20d8-4976-9ad2-535067efd09a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.774670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce816f18-20d8-4976-9ad2-535067efd09a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.775536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce816f18-20d8-4976-9ad2-535067efd09a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.839697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:51.851502 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-246f3a7e-6b6d-4936-b4de-5199c7317a8a tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1317 microversion: 2.1 time: 0.534125 Nov 27 20:52:51.852795 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1104/2290] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:51 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:51.858250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:51.859791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:51.868276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.868765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.869832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:51.870280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:51.891350 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce816f18-20d8-4976-9ad2-535067efd09a tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.145072 Nov 27 20:52:51.893722 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1187/2291] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:51 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:52.084808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-859410d6-f256-49fa-a6ff-f8c4c26533d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:52.085989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-859410d6-f256-49fa-a6ff-f8c4c26533d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:52.101179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-859410d6-f256-49fa-a6ff-f8c4c26533d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.106096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-859410d6-f256-49fa-a6ff-f8c4c26533d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.107512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-859410d6-f256-49fa-a6ff-f8c4c26533d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.109834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-859410d6-f256-49fa-a6ff-f8c4c26533d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.142048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:52.154111 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-571c4cb9-4c34-43e8-93dc-e9d5c6c7f360 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1324 microversion: 2.1 time: 0.299775 Nov 27 20:52:52.166804 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1105/2292] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:51 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:52.207479 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-859410d6-f256-49fa-a6ff-f8c4c26533d9 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.133874 Nov 27 20:52:52.208145 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1188/2293] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:52 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:52.272034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:52.273349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:52.283071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.283810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.284994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.285780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.339208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4095d861-1169-4662-95ff-6bf1b96d4dce req-a7a21e12-a107-43a4-b208-5fe9d315db30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7cfd43-2058-4943-b00e-471de21cbe0e", "tag": "0437b053-b2e1-4749-ac48-4e6a8a0dc423"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:52.341204 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:52.341204 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:52.354701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4095d861-1169-4662-95ff-6bf1b96d4dce req-a7a21e12-a107-43a4-b208-5fe9d315db30 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.356684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4095d861-1169-4662-95ff-6bf1b96d4dce req-a7a21e12-a107-43a4-b208-5fe9d315db30 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.385619 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4095d861-1169-4662-95ff-6bf1b96d4dce req-a7a21e12-a107-43a4-b208-5fe9d315db30 service nova] Creating event network-changed:0437b053-b2e1-4749-ac48-4e6a8a0dc423 for instance ad7cfd43-2058-4943-b00e-471de21cbe0e on nch2-master-1 Nov 27 20:52:52.394214 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4095d861-1169-4662-95ff-6bf1b96d4dce req-a7a21e12-a107-43a4-b208-5fe9d315db30 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058236 Nov 27 20:52:52.395689 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1189/2294] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:52.402528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:52.403416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:52.411212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.411759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.412820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.413247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.590379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:52.598249 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a9ee517-322f-4786-8344-98b94e120fc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1307 microversion: 2.1 time: 0.333219 Nov 27 20:52:52.607212 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1106/2295] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:52 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:52.664545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:52.672626 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a3c8c97a-ad6d-4dd7-8a9e-0793934d92ae tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.275551 Nov 27 20:52:52.673359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1190/2296] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:52 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:52.679962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-aa349571-0dc7-4f84-8064-8ac11e3b0f8f req-49754c96-7cc8-414f-b829-6c636523046b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc4635e-f9e3-4806-a40e-3afc332181d9", "tag": "6d0e6730-2f05-484e-bb6e-5092209740ea"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:52.681749 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:52.681749 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:52.689880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-aa349571-0dc7-4f84-8064-8ac11e3b0f8f req-49754c96-7cc8-414f-b829-6c636523046b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.690411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-aa349571-0dc7-4f84-8064-8ac11e3b0f8f req-49754c96-7cc8-414f-b829-6c636523046b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.703369 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-aa349571-0dc7-4f84-8064-8ac11e3b0f8f req-49754c96-7cc8-414f-b829-6c636523046b service nova] Creating event network-changed:6d0e6730-2f05-484e-bb6e-5092209740ea for instance 8cc4635e-f9e3-4806-a40e-3afc332181d9 on nch1-master-1 Nov 27 20:52:52.708487 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-aa349571-0dc7-4f84-8064-8ac11e3b0f8f req-49754c96-7cc8-414f-b829-6c636523046b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033694 Nov 27 20:52:52.709336 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1191/2297] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:52.746463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-024fce34-dd51-479d-a696-7e83f37cfcea tempest-ListImagesTestJSON-300221330 tempest-ListImagesTestJSON-300221330-project] Calling method '.version_select at 0x7f15c73b8790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:52.758881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:52.759604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:52.767286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.767493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.768393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.768833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.802514 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-024fce34-dd51-479d-a696-7e83f37cfcea tempest-ListImagesTestJSON-300221330 tempest-ListImagesTestJSON-300221330-project] 10.222.0.21 "GET /compute/v2.1/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8" status: 200 len: 784 microversion: 2.1 time: 0.193857 Nov 27 20:52:52.803460 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1107/2298] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:52 2021] GET /compute/v2.1/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8 => generated 784 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:52.818291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-329be13a-9da4-4b94-9ad1-69327a9eba7f tempest-ListImagesTestJSON-300221330 tempest-ListImagesTestJSON-300221330-project] Calling method '.version_select at 0x7f15c7c9d040>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:52.902962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-329be13a-9da4-4b94-9ad1-69327a9eba7f tempest-ListImagesTestJSON-300221330 tempest-ListImagesTestJSON-300221330-project] 10.222.0.21 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.089035 Nov 27 20:52:52.903689 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1108/2299] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:52 2021] GET /compute/v2.1/images => generated 445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:52.909731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:52.910672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:52.918675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.919293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:52.920337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:52.921247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.010007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:53.019739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a509a49-fbe9-4628-b4ae-fc8ba878052b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.264901 Nov 27 20:52:53.023534 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1192/2300] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:52 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:53.037426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9dd4f8ad-b979-4475-b96b-1d9c86225942 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:53.040129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9dd4f8ad-b979-4475-b96b-1d9c86225942 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:53.052535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd4f8ad-b979-4475-b96b-1d9c86225942 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.053379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd4f8ad-b979-4475-b96b-1d9c86225942 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.054916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd4f8ad-b979-4475-b96b-1d9c86225942 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.055623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd4f8ad-b979-4475-b96b-1d9c86225942 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.103907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9dd4f8ad-b979-4475-b96b-1d9c86225942 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.078502 Nov 27 20:52:53.104705 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1193/2301] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:53 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:53.121589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50e7362b-39b3-412f-bd64-710a7bf18987 tempest-ListImagesTestJSON-300221330 tempest-ListImagesTestJSON-300221330-project] Calling method '.version_select at 0x7f15c73bf3a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:53.182161 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50e7362b-39b3-412f-bd64-710a7bf18987 tempest-ListImagesTestJSON-300221330 tempest-ListImagesTestJSON-300221330-project] 10.222.0.21 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.075859 Nov 27 20:52:53.183597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1194/2302] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:52:53 2021] GET /compute/v2.1/images/detail => generated 787 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:53.189366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:53.191071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:53.195571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:53.199593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.200278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.201247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.201862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.204315 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30a403b2-6248-4a2b-a879-2bedcee8d4e4 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1317 microversion: 2.1 time: 0.299546 Nov 27 20:52:53.213785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1109/2303] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:52 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:53.220074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d010725c-d071-4c57-8442-1f654ea90a8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:53.224802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d010725c-d071-4c57-8442-1f654ea90a8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:53.239531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d010725c-d071-4c57-8442-1f654ea90a8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.240589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d010725c-d071-4c57-8442-1f654ea90a8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.240875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d010725c-d071-4c57-8442-1f654ea90a8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.241319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d010725c-d071-4c57-8442-1f654ea90a8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.298873 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d010725c-d071-4c57-8442-1f654ea90a8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.082372 Nov 27 20:52:53.303459 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1110/2304] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:53 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:53.437808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:53.447404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cd622cc-0f45-420c-884e-0e06b4420ec4 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1324 microversion: 2.1 time: 0.262158 Nov 27 20:52:53.448629 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1195/2305] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:53 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:53.615766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:53.616903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:53.625032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.625770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.626840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.627537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.668733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-59f7e14c-e584-4a41-b1a7-f762e4d0715a req-85bbf538-bb23-4032-98bf-c303cd46a189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89360906-579a-4126-bc8d-e3e4cff060e0", "name": "network-vif-plugged", "status": "completed", "tag": "cbbbfa16-834b-452b-bcfa-17d86ec350c7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:53.670793 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:53.670793 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:53.681516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-59f7e14c-e584-4a41-b1a7-f762e4d0715a req-85bbf538-bb23-4032-98bf-c303cd46a189 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.682287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-59f7e14c-e584-4a41-b1a7-f762e4d0715a req-85bbf538-bb23-4032-98bf-c303cd46a189 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.695988 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-59f7e14c-e584-4a41-b1a7-f762e4d0715a req-85bbf538-bb23-4032-98bf-c303cd46a189 service nova] Creating event network-vif-plugged:cbbbfa16-834b-452b-bcfa-17d86ec350c7 for instance 89360906-579a-4126-bc8d-e3e4cff060e0 on nch1-master-1 Nov 27 20:52:53.701712 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-59f7e14c-e584-4a41-b1a7-f762e4d0715a req-85bbf538-bb23-4032-98bf-c303cd46a189 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037367 Nov 27 20:52:53.703644 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1196/2306] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:53.710083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:53.721365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:53.737561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.738452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.739608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.741460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.812650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:53.820218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e26045b-3d8d-4bef-9fd3-f89b669e5c14 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1486 microversion: 2.1 time: 0.208426 Nov 27 20:52:53.821141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1111/2307] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:53 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1486 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:53.837382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db6b5918-6bc2-4f3a-8dd6-53a14d8b2bd4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:53.837986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db6b5918-6bc2-4f3a-8dd6-53a14d8b2bd4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:53.844805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6b5918-6bc2-4f3a-8dd6-53a14d8b2bd4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.845260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6b5918-6bc2-4f3a-8dd6-53a14d8b2bd4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.846314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6b5918-6bc2-4f3a-8dd6-53a14d8b2bd4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.846668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6b5918-6bc2-4f3a-8dd6-53a14d8b2bd4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.917142 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db6b5918-6bc2-4f3a-8dd6-53a14d8b2bd4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5/action" status: 202 len: 0 microversion: 2.1 time: 0.083428 Nov 27 20:52:53.921171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1112/2308] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:53 2021] POST /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:52:53.927780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:53.935509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:53.943188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.943870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:53.944663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:53.945244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.002457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:54.010412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b412498d-6a9b-4d93-80c3-fd55c6316e88 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.305389 Nov 27 20:52:54.011078 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1197/2309] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:53 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:54.037320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:54.037929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:54.043731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.044262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.044935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.045362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.138249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:54.147644 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63a13f23-89e7-4214-ac53-cb1e961ea9ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1491 microversion: 2.1 time: 0.224751 Nov 27 20:52:54.160656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1113/2310] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:53 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1491 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:54.168470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c8d814d-73cc-4d53-bbe8-8a7ea4cbcb54 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:54.171023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c8d814d-73cc-4d53-bbe8-8a7ea4cbcb54 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:54.180730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c8d814d-73cc-4d53-bbe8-8a7ea4cbcb54 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.182239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c8d814d-73cc-4d53-bbe8-8a7ea4cbcb54 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.183928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c8d814d-73cc-4d53-bbe8-8a7ea4cbcb54 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.184755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c8d814d-73cc-4d53-bbe8-8a7ea4cbcb54 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.207701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:54.217160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80377a47-ada8-4d4d-bb32-a8d324c99106 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.183460 Nov 27 20:52:54.218700 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1198/2311] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:54 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:54.224398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:54.225003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:54.232515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.232997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.233974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.234571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.245922 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c8d814d-73cc-4d53-bbe8-8a7ea4cbcb54 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.083766 Nov 27 20:52:54.246883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1114/2312] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:54 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:54.310329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8c5a6d30-fd7a-49c2-8de0-c8aad9fd132f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:54.311679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8c5a6d30-fd7a-49c2-8de0-c8aad9fd132f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:54.319689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c5a6d30-fd7a-49c2-8de0-c8aad9fd132f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.320598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c5a6d30-fd7a-49c2-8de0-c8aad9fd132f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.321454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c5a6d30-fd7a-49c2-8de0-c8aad9fd132f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.322068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c5a6d30-fd7a-49c2-8de0-c8aad9fd132f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.368204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8c5a6d30-fd7a-49c2-8de0-c8aad9fd132f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.061809 Nov 27 20:52:54.369405 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1115/2313] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:54 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:54.376256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:54.383629 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddcda057-9439-4869-abe2-657fcf81d659 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1317 microversion: 2.1 time: 0.163078 Nov 27 20:52:54.384203 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1199/2314] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:54 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:54.465564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:54.466341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:54.473561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.473712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.474545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:54.474997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:54.614008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:54.622353 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dd81d691-179c-4926-afbb-2a1213dabceb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1324 microversion: 2.1 time: 0.161268 Nov 27 20:52:54.622942 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1116/2315] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:54 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:55.027317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:55.027939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.036640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.037091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.037937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.038471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.172317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:55.174341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.182954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.183942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.185235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.185971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.190077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:55.198893 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bbfead8-a87f-46e9-8b52-4abfb859d445 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.175248 Nov 27 20:52:55.199597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1200/2316] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:55 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:55.241118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:55.241851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.255155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.256063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.257292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.259453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.353955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:55.363937 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e51a427-e1bc-4cc0-834a-f077f593bd3a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 200 len: 1471 microversion: 2.1 time: 0.197377 Nov 27 20:52:55.365223 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1117/2317] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:55 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:55.371193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ef5ea32-d785-4670-af85-9d941640d26e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:55.372401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ef5ea32-d785-4670-af85-9d941640d26e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.381208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea32-d785-4670-af85-9d941640d26e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.381887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea32-d785-4670-af85-9d941640d26e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.382683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea32-d785-4670-af85-9d941640d26e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.383115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea32-d785-4670-af85-9d941640d26e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.427664 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ef5ea32-d785-4670-af85-9d941640d26e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.060655 Nov 27 20:52:55.432645 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1118/2318] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:55 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:55.435345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42f1d315-6877-4c0b-86e9-1ec8d123a1c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:55.436474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42f1d315-6877-4c0b-86e9-1ec8d123a1c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.444239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42f1d315-6877-4c0b-86e9-1ec8d123a1c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.444883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42f1d315-6877-4c0b-86e9-1ec8d123a1c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.445747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42f1d315-6877-4c0b-86e9-1ec8d123a1c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.446312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42f1d315-6877-4c0b-86e9-1ec8d123a1c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.490455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42f1d315-6877-4c0b-86e9-1ec8d123a1c8 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.060260 Nov 27 20:52:55.495462 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1119/2319] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:55 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:55.496415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5bd6dad-7952-48e6-83fe-ecabcf5c9185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-205029860"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:55.497519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5bd6dad-7952-48e6-83fe-ecabcf5c9185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.504532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bd6dad-7952-48e6-83fe-ecabcf5c9185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.504785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:55.504987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bd6dad-7952-48e6-83fe-ecabcf5c9185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.505787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bd6dad-7952-48e6-83fe-ecabcf5c9185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.506228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bd6dad-7952-48e6-83fe-ecabcf5c9185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.514415 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5ae81e2-1c33-4a70-b2fc-35c24e1225f8 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.282911 Nov 27 20:52:55.516306 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1201/2320] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:55 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:55.520885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:55.521671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.527836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.528294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.529081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.529523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.746623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:55.756185 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26917657-5ba5-4cc5-8fc2-3ada85f69fa6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1317 microversion: 2.1 time: 0.238110 Nov 27 20:52:55.770155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1202/2321] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:55 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:55.777536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:55.778346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:55.785609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.786059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.786843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:55.787293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:55.830865 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5bd6dad-7952-48e6-83fe-ecabcf5c9185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5/action" status: 202 len: 0 microversion: 2.1 time: 0.338230 Nov 27 20:52:55.836833 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1120/2322] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:55 2021] POST /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:52:55.842723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-015a3006-eaa9-45f3-aefc-b76211ec5c76 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7a01e50>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:55.915193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-015a3006-eaa9-45f3-aefc-b76211ec5c76 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.076913 Nov 27 20:52:55.922430 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1121/2323] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:55 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:55.976920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:55.984820 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e8182cda-59f2-4992-8b76-0ed62f875bea tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1521 microversion: 2.1 time: 0.213210 Nov 27 20:52:55.985821 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1203/2324] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:55 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:56.013229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:56.013828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:56.021735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.022180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.022964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.023431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.092425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-581b0e5f-38c5-40ba-85fb-6732c981da35 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c7dcac10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1834570862", "description": "tempest-description-1888158102"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:56.191619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:56.200721 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5aa27ad8-57b1-4f52-84a6-469755b34089 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1521 microversion: 2.1 time: 0.191841 Nov 27 20:52:56.201611 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1204/2325] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:56 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:56.217174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:56.218076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:56.225850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.226370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.227277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.227779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.258972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-581b0e5f-38c5-40ba-85fb-6732c981da35 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.335388 Nov 27 20:52:56.265902 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1122/2326] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:52:55 2021] POST /compute/v2.1/os-security-groups => generated 256 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:56.270464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f18b3143-7027-4066-92f3-33299c34923d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1124453330"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:56.275982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f18b3143-7027-4066-92f3-33299c34923d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:56.282965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18b3143-7027-4066-92f3-33299c34923d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.283455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18b3143-7027-4066-92f3-33299c34923d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.284257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18b3143-7027-4066-92f3-33299c34923d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.284694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18b3143-7027-4066-92f3-33299c34923d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.365524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:56.373259 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1af53a06-3afe-4a76-987d-76cbfb215e92 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.161077 Nov 27 20:52:56.373820 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1205/2327] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:56 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:56.378721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ee076b86-6ad9-4ba7-987a-691a72191a12 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c77ee940>, body: {"security_group_rule": {"parent_group_id": "15a6e815-0f1a-4e97-955f-4de622630c79", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:56.554396 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f18b3143-7027-4066-92f3-33299c34923d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0/action" status: 202 len: 0 microversion: 2.1 time: 0.287370 Nov 27 20:52:56.555044 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1123/2328] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:56 2021] POST /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:52:56.557979 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ee076b86-6ad9-4ba7-987a-691a72191a12 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.183137 Nov 27 20:52:56.558854 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1206/2329] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:56 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:56.563274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02fb04e9-ce4e-4219-9927-d53293934600 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:56.564341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02fb04e9-ce4e-4219-9927-d53293934600 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:56.570754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02fb04e9-ce4e-4219-9927-d53293934600 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.571243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02fb04e9-ce4e-4219-9927-d53293934600 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.572082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02fb04e9-ce4e-4219-9927-d53293934600 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.572321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-028faa7c-63bd-4719-8a72-49a050d4ff59 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:56.572545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02fb04e9-ce4e-4219-9927-d53293934600 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.573909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-028faa7c-63bd-4719-8a72-49a050d4ff59 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:56.579919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-028faa7c-63bd-4719-8a72-49a050d4ff59 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.580654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-028faa7c-63bd-4719-8a72-49a050d4ff59 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.583524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-028faa7c-63bd-4719-8a72-49a050d4ff59 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.584088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-028faa7c-63bd-4719-8a72-49a050d4ff59 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.616086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02fb04e9-ce4e-4219-9927-d53293934600 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.055179 Nov 27 20:52:56.617213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1207/2330] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:56 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:56.623379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:56.624236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:56.627449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-028faa7c-63bd-4719-8a72-49a050d4ff59 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.058920 Nov 27 20:52:56.628353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1124/2331] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:56 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:56.634404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.634854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.635123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-14988424-9106-47f1-908d-46be3e1f501b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c7fb01f0>, body: {"security_group_rule": {"parent_group_id": "15a6e815-0f1a-4e97-955f-4de622630c79", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:56.635678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.636119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.684422 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-14988424-9106-47f1-908d-46be3e1f501b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: This rule already exists in group 15a6e815-0f1a-4e97-955f-4de622630c79 Nov 27 20:52:56.685041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-14988424-9106-47f1-908d-46be3e1f501b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 400 to user: This rule already exists in group 15a6e815-0f1a-4e97-955f-4de622630c79 {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:56.685907 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-14988424-9106-47f1-908d-46be3e1f501b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.056418 Nov 27 20:52:56.686516 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1125/2332] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:56 2021] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:52:56.698504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebdf9dff-0b45-4bd3-8ca4-7ee614153e1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '.version_select at 0x7f15c7297670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:56.781781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:56.789685 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41670847-56fc-44d5-8bf5-72d157b1b30b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.171345 Nov 27 20:52:56.790267 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1208/2333] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:56 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:56.794472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df535caf-2df4-45fb-bf61-4139270d150c tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Calling method '.version_select at 0x7f15c754fb80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:56.823127 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebdf9dff-0b45-4bd3-8ca4-7ee614153e1e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/images/34e6b483-8ef9-45c0-81ff-5801cfc7b538" status: 204 len: 0 microversion: 2.1 time: 0.132327 Nov 27 20:52:56.823806 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1126/2334] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:56 2021] DELETE /compute/v2.1/images/34e6b483-8ef9-45c0-81ff-5801cfc7b538 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:52:56.829088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:56.829949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:56.836344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.836896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.837739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:56.838269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:56.956918 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df535caf-2df4-45fb-bf61-4139270d150c tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-group-rules/c6e9d061-383a-4f06-aed4-b81a5ae48700" status: 202 len: 0 microversion: 2.1 time: 0.165583 Nov 27 20:52:56.958881 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1209/2335] 10.222.0.21 () {58 vars in 1286 bytes} [Sat Nov 27 20:52:56 2021] DELETE /compute/v2.1/os-security-group-rules/c6e9d061-383a-4f06-aed4-b81a5ae48700 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:52:56.964481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a0e47ea-04a3-4afc-9851-d9edc3a4b7e8 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '.version_select at 0x7f15d44d8ee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:56.989565 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4a0e47ea-04a3-4afc-9851-d9edc3a4b7e8 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Image not found. Nov 27 20:52:56.994509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:56.996818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a0e47ea-04a3-4afc-9851-d9edc3a4b7e8 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:56.997724 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a0e47ea-04a3-4afc-9851-d9edc3a4b7e8 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/images/34e6b483-8ef9-45c0-81ff-5801cfc7b538" status: 404 len: 62 microversion: 2.1 time: 0.037577 Nov 27 20:52:56.998333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1210/2336] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:56 2021] GET /compute/v2.1/images/34e6b483-8ef9-45c0-81ff-5801cfc7b538 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:52:57.005328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c380f13f-3934-42aa-8c52-cb3646e09791 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d44efc10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:57.007470 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1db5ec53-01d6-4dde-b12e-f6896ab4aa49 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1317 microversion: 2.1 time: 0.182526 Nov 27 20:52:57.008124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1127/2337] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:56 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:57.012477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4cde2160-fd75-448d-acab-d9dfe6f535cb tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15d459fb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-466563686", "description": "tempest-description-2026076786"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.058462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c380f13f-3934-42aa-8c52-cb3646e09791 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.059078 Nov 27 20:52:57.064630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1211/2338] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:56 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:57.068299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:57.069043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:57.077283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.078415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.079447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.079897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.172821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4cde2160-fd75-448d-acab-d9dfe6f535cb tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.163602 Nov 27 20:52:57.173753 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1128/2339] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:57.184965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49ae1733-32bc-4233-8348-ac03988969d2 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c7ca0a60>, body: {"security_group_rule": {"parent_group_id": "4d2da2ad-d624-4302-a4bb-bb19a9e656a3", "ip_protocol": "tcp", "from_port": 486291322, "to_port": 22}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.219421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:57.226824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-48055065-0736-4f38-9c57-eebfe6d0c5eb tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1533 microversion: 2.1 time: 0.166803 Nov 27 20:52:57.227421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1212/2340] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:57 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1533 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:57.235529 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-49ae1733-32bc-4233-8348-ac03988969d2 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: Invalid port range 486291322:22. Former value cannot be greater than the later Nov 27 20:52:57.236132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49ae1733-32bc-4233-8348-ac03988969d2 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 400 to user: Invalid port range 486291322:22. Former value cannot be greater than the later {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:57.237007 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49ae1733-32bc-4233-8348-ac03988969d2 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.055759 Nov 27 20:52:57.237568 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1129/2341] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:52:57.247199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd3a05ce-41ab-4fcf-9825-ddc16efb7ac1 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c77eaaf0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2122798975", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.250577 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fd3a05ce-41ab-4fcf-9825-ddc16efb7ac1 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: Security group id should be uuid Nov 27 20:52:57.251311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd3a05ce-41ab-4fcf-9825-ddc16efb7ac1 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 400 to user: Security group id should be uuid {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:57.252121 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd3a05ce-41ab-4fcf-9825-ddc16efb7ac1 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009135 Nov 27 20:52:57.252726 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1213/2342] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:57.262004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a02c67d5-5d24-4966-8244-9183250683e6 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c7c9db80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1404769672", "description": "tempest-description-774885776"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.392445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:57.393127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:57.394767 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a02c67d5-5d24-4966-8244-9183250683e6 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.137120 Nov 27 20:52:57.395405 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1130/2343] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:57.400507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.401004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.401986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.402423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.406305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe501ef0-4ea8-4cf9-bd04-949fd5192d2a tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15d43bfa60>, body: {"security_group_rule": {"parent_group_id": "06f588d1-c6e4-43a3-ab36-471b4d23ce1b", "ip_protocol": "tempest-999-1439794011", "from_port": 22, "to_port": 22}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.456433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-fe501ef0-4ea8-4cf9-bd04-949fd5192d2a tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: Invalid IP protocol tempest-999-1439794011. Nov 27 20:52:57.457091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe501ef0-4ea8-4cf9-bd04-949fd5192d2a tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 400 to user: Invalid IP protocol tempest-999-1439794011. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:57.457963 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe501ef0-4ea8-4cf9-bd04-949fd5192d2a tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.055634 Nov 27 20:52:57.458631 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1131/2344] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:57.467208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-951ecf93-1699-4a0a-a367-0b6348625cf4 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c7a25dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-427192680", "description": "tempest-description-1465660495"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.549295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:57.557617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-049a63f6-917f-4cf4-8bf7-0ae14758dc7c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.170196 Nov 27 20:52:57.568247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1214/2345] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:57 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:57.626017 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-951ecf93-1699-4a0a-a367-0b6348625cf4 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.162258 Nov 27 20:52:57.626765 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1132/2346] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:52:57.637336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5755220-8c99-45d1-8ce2-fe8dba61026f tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c7a01940>, body: {"security_group_rule": {"parent_group_id": "f8e8e8bd-baa1-468e-9820-21a789cecdd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.637728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9801cb00-e0ce-4403-8a8f-f6f279cdeae6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.638730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9801cb00-e0ce-4403-8a8f-f6f279cdeae6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:57.649788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9801cb00-e0ce-4403-8a8f-f6f279cdeae6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.650239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9801cb00-e0ce-4403-8a8f-f6f279cdeae6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.651040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9801cb00-e0ce-4403-8a8f-f6f279cdeae6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.651612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9801cb00-e0ce-4403-8a8f-f6f279cdeae6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.689246 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e5755220-8c99-45d1-8ce2-fe8dba61026f tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 27 20:52:57.689946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5755220-8c99-45d1-8ce2-fe8dba61026f tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:57.690956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5755220-8c99-45d1-8ce2-fe8dba61026f tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.057400 Nov 27 20:52:57.691641 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1133/2347] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:52:57.696546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4f8ef6e3-d794-490f-913d-5dbbdb3f77df tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.697749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4f8ef6e3-d794-490f-913d-5dbbdb3f77df tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:57.700670 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9801cb00-e0ce-4403-8a8f-f6f279cdeae6 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.075483 Nov 27 20:52:57.701711 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1215/2348] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:52:57.706207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f8ef6e3-d794-490f-913d-5dbbdb3f77df tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.707100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d35df23c-b48d-49b4-8fb0-1e1d5a2ffb46 req-b0d97ba4-0c83-4981-9e48-9adbd5f4bef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc4635e-f9e3-4806-a40e-3afc332181d9", "name": "network-vif-plugged", "status": "completed", "tag": "6d0e6730-2f05-484e-bb6e-5092209740ea"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.707362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f8ef6e3-d794-490f-913d-5dbbdb3f77df tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.708169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f8ef6e3-d794-490f-913d-5dbbdb3f77df tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.708625 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:52:57.708625 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:52:57.708850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f8ef6e3-d794-490f-913d-5dbbdb3f77df tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.716384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d35df23c-b48d-49b4-8fb0-1e1d5a2ffb46 req-b0d97ba4-0c83-4981-9e48-9adbd5f4bef9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.716989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d35df23c-b48d-49b4-8fb0-1e1d5a2ffb46 req-b0d97ba4-0c83-4981-9e48-9adbd5f4bef9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.728336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d35df23c-b48d-49b4-8fb0-1e1d5a2ffb46 req-b0d97ba4-0c83-4981-9e48-9adbd5f4bef9 service nova] Creating event network-vif-plugged:6d0e6730-2f05-484e-bb6e-5092209740ea for instance 8cc4635e-f9e3-4806-a40e-3afc332181d9 on nch1-master-1 Nov 27 20:52:57.733461 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d35df23c-b48d-49b4-8fb0-1e1d5a2ffb46 req-b0d97ba4-0c83-4981-9e48-9adbd5f4bef9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030205 Nov 27 20:52:57.735208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1216/2349] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:57.741251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-215993d1-f3e6-479d-aad4-4e39756beaa7 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c78b9160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-560640214", "description": "tempest-description-1599670454"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:57.749336 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4f8ef6e3-d794-490f-913d-5dbbdb3f77df tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.056322 Nov 27 20:52:57.753808 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1134/2350] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:57.806361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:57.807063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:57.814418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.815091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.815915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:57.816347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:57.949995 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-215993d1-f3e6-479d-aad4-4e39756beaa7 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.212826 Nov 27 20:52:57.955302 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1217/2351] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:52:57.961245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e2ee4c29-03ed-41d6-89b0-5e4144bd913b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15c790fee0>, body: {"security_group_rule": {"parent_group_id": "58368e67-86a6-47e4-a4cd-df6c0c272038", "ip_protocol": "tcp", "from_port": 22, "to_port": 1200881730}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:58.002922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:58.012743 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e4ec37c-7f94-4b13-9e4f-f3685879bdc2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.210502 Nov 27 20:52:58.013331 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1135/2352] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:57 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:58.031221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.032062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:58.037345 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e2ee4c29-03ed-41d6-89b0-5e4144bd913b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: Invalid port range 22:1200881730. Valid TCP ports should be between 1-65535 Nov 27 20:52:58.038075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e2ee4c29-03ed-41d6-89b0-5e4144bd913b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 400 to user: Invalid port range 22:1200881730. Valid TCP ports should be between 1-65535 {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:58.039083 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e2ee4c29-03ed-41d6-89b0-5e4144bd913b tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.081418 Nov 27 20:52:58.039958 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1218/2353] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:57 2021] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:52:58.044501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.045046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.045905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.046460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.050453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94369277-7f79-4d9f-9ea6-4ee32f1da724 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Action: 'create', calling method: .version_select at 0x7f15d44d8ee0>, body: {"security_group_rule": {"parent_group_id": "1920052b-1ed0-486b-8715-75d467aaee59", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:58.073626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-94369277-7f79-4d9f-9ea6-4ee32f1da724 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1920052b-1ed0-486b-8715-75d467aaee59 does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:52:58.074555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-94369277-7f79-4d9f-9ea6-4ee32f1da724 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Neutron security group 1920052b-1ed0-486b-8715-75d467aaee59 not found {{(pid=135680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:52:58.075178 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-94369277-7f79-4d9f-9ea6-4ee32f1da724 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: Security group 1920052b-1ed0-486b-8715-75d467aaee59 does not exist Nov 27 20:52:58.075178 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-bfb15292-a1db-4a96-b9a5-7bffe35f583c'] Nov 27 20:52:58.075931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94369277-7f79-4d9f-9ea6-4ee32f1da724 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 404 to user: Security group 1920052b-1ed0-486b-8715-75d467aaee59 does not exist Nov 27 20:52:58.075931 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-bfb15292-a1db-4a96-b9a5-7bffe35f583c'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:58.076903 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-94369277-7f79-4d9f-9ea6-4ee32f1da724 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.031438 Nov 27 20:52:58.077539 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1219/2354] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:52:58 2021] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:52:58.082141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2e439973-7f19-4e93-8f84-1c9faa5fcbd3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c790ff70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.127437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2e439973-7f19-4e93-8f84-1c9faa5fcbd3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.048741 Nov 27 20:52:58.128028 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1220/2355] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:58 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:58.134329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-047e37b8-3591-4ce6-906c-2286d76ef2ed tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Calling method '.version_select at 0x7f15c7f77310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.155296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-047e37b8-3591-4ce6-906c-2286d76ef2ed tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2032a564-fbf0-4bcd-a33e-ca0b855c0c78 does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:52:58.156541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-047e37b8-3591-4ce6-906c-2286d76ef2ed tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Neutron security group rule 2032a564-fbf0-4bcd-a33e-ca0b855c0c78 not found {{(pid=135680) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 27 20:52:58.157058 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-047e37b8-3591-4ce6-906c-2286d76ef2ed tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] HTTP exception thrown: Security group rule 2032a564-fbf0-4bcd-a33e-ca0b855c0c78 does not exist Nov 27 20:52:58.157058 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-570d658a-e669-4ef8-94d4-5c09b751f1e4'] Nov 27 20:52:58.157641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-047e37b8-3591-4ce6-906c-2286d76ef2ed tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Returning 404 to user: Security group rule 2032a564-fbf0-4bcd-a33e-ca0b855c0c78 does not exist Nov 27 20:52:58.157641 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-570d658a-e669-4ef8-94d4-5c09b751f1e4'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:52:58.158486 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-047e37b8-3591-4ce6-906c-2286d76ef2ed tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-group-rules/2032a564-fbf0-4bcd-a33e-ca0b855c0c78" status: 404 len: 199 microversion: 2.1 time: 0.027626 Nov 27 20:52:58.159151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1221/2356] 10.222.0.21 () {58 vars in 1286 bytes} [Sat Nov 27 20:52:58 2021] DELETE /compute/v2.1/os-security-group-rules/2032a564-fbf0-4bcd-a33e-ca0b855c0c78 => generated 199 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:52:58.168165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49a947b2-c226-44ff-b5e1-3950a65b43d6 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Calling method '.version_select at 0x7f15d4627dc0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.183816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:58.191072 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8c2adc4-365f-4b3d-b043-795eb01e2290 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1317 microversion: 2.1 time: 0.170169 Nov 27 20:52:58.191677 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1136/2357] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:58 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:58.243816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.244802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:58.251316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.251846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.252719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.253149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.341322 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49a947b2-c226-44ff-b5e1-3950a65b43d6 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/58368e67-86a6-47e4-a4cd-df6c0c272038" status: 202 len: 0 microversion: 2.1 time: 0.176939 Nov 27 20:52:58.342311 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1222/2358] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:52:58 2021] DELETE /compute/v2.1/os-security-groups/58368e67-86a6-47e4-a4cd-df6c0c272038 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:52:58.356754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3ed2f93c-b65f-42ce-bc8a-1517cd55812a tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Calling method '.version_select at 0x7f15c7b7a700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.392918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:58.400805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc1295ca-9c16-4dce-9501-7569a4a0d73b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1539 microversion: 2.1 time: 0.160625 Nov 27 20:52:58.401394 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1137/2359] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:58 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:58.532869 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3ed2f93c-b65f-42ce-bc8a-1517cd55812a tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/f8e8e8bd-baa1-468e-9820-21a789cecdd4" status: 202 len: 0 microversion: 2.1 time: 0.185803 Nov 27 20:52:58.533462 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1223/2360] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:52:58 2021] DELETE /compute/v2.1/os-security-groups/f8e8e8bd-baa1-468e-9820-21a789cecdd4 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:52:58.541240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-218671c8-befb-46dd-a000-4837823784c8 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Calling method '.version_select at 0x7f15c7fb0e50>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.574033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.574850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:58.581866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.582524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.583392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.583895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.714770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:58.720059 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-218671c8-befb-46dd-a000-4837823784c8 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/06f588d1-c6e4-43a3-ab36-471b4d23ce1b" status: 202 len: 0 microversion: 2.1 time: 0.182250 Nov 27 20:52:58.721800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1138/2361] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:52:58 2021] DELETE /compute/v2.1/os-security-groups/06f588d1-c6e4-43a3-ab36-471b4d23ce1b => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:52:58.726412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fc009b3-c364-4915-bc89-cd497d86e820 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:58.726597 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c736a5b3-e933-4ece-b31c-2bd6d0994489 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.156574 Nov 27 20:52:58.727413 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1224/2362] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:58 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:58.727634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fc009b3-c364-4915-bc89-cd497d86e820 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:58.733848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fc009b3-c364-4915-bc89-cd497d86e820 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.734301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fc009b3-c364-4915-bc89-cd497d86e820 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.734745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-194fb4e0-b6b3-4029-a17c-e6935f5a3ccb tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Calling method '.version_select at 0x7f15c7b58550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:58.735472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fc009b3-c364-4915-bc89-cd497d86e820 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.735910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fc009b3-c364-4915-bc89-cd497d86e820 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.787956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8fc009b3-c364-4915-bc89-cd497d86e820 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.064683 Nov 27 20:52:58.789073 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1139/2363] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:58 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:58.794297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aee13424-7e1b-4d93-b40a-0edcbad14dd5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:58.795338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aee13424-7e1b-4d93-b40a-0edcbad14dd5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:58.802280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee13424-7e1b-4d93-b40a-0edcbad14dd5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.802739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee13424-7e1b-4d93-b40a-0edcbad14dd5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.803544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee13424-7e1b-4d93-b40a-0edcbad14dd5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:58.803986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee13424-7e1b-4d93-b40a-0edcbad14dd5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:58.849311 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aee13424-7e1b-4d93-b40a-0edcbad14dd5 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.058621 Nov 27 20:52:58.850176 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1140/2364] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:58 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:58.923761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-194fb4e0-b6b3-4029-a17c-e6935f5a3ccb tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/4d2da2ad-d624-4302-a4bb-bb19a9e656a3" status: 202 len: 0 microversion: 2.1 time: 0.194018 Nov 27 20:52:58.925180 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1225/2365] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:52:58 2021] DELETE /compute/v2.1/os-security-groups/4d2da2ad-d624-4302-a4bb-bb19a9e656a3 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:52:58.935303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1527daaa-a9b1-47f7-8cc4-578968030cb8 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] Calling method '.version_select at 0x7f15d9522820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:59.029722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:59.030338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:59.036518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.036974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.037766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.038204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.129687 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1527daaa-a9b1-47f7-8cc4-578968030cb8 tempest-SecurityGroupRulesNegativeTestJSON-533201508 tempest-SecurityGroupRulesNegativeTestJSON-533201508-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/15a6e815-0f1a-4e97-955f-4de622630c79" status: 202 len: 0 microversion: 2.1 time: 0.199487 Nov 27 20:52:59.132229 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1141/2366] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:52:58 2021] DELETE /compute/v2.1/os-security-groups/15a6e815-0f1a-4e97-955f-4de622630c79 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:52:59.145829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6198037f-0843-400a-b0c1-68275f79537b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d4380700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:59.207958 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6198037f-0843-400a-b0c1-68275f79537b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.070255 Nov 27 20:52:59.214485 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1142/2367] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:59 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:59.223157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:59.224363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:59.231235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.232189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.233217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.234415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.493990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:59.505700 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf01a6d7-3a17-44e3-bbde-8c1207720820 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1317 microversion: 2.1 time: 0.289246 Nov 27 20:52:59.507754 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1143/2368] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:59 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:59.512984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:59.513838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:59.522496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.523498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.525338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.526263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.575843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:59.583734 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0a5889d-8ba8-418c-82e5-d20d3a98afd6 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.557698 Nov 27 20:52:59.585802 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1226/2369] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:59 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:59.743990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:52:59.745213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:59.751947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.752782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.754021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.754690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.790830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:59.804336 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7880db16-1dd3-480c-9fd0-7808ea973ed9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1534 microversion: 2.1 time: 0.293811 Nov 27 20:52:59.806538 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1144/2370] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:59 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1534 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:52:59.816989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ba56185-7173-422b-854a-dde3276437fb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:59.818510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ba56185-7173-422b-854a-dde3276437fb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:59.828874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba56185-7173-422b-854a-dde3276437fb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.829426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba56185-7173-422b-854a-dde3276437fb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.830237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba56185-7173-422b-854a-dde3276437fb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.830864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba56185-7173-422b-854a-dde3276437fb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.896079 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ba56185-7173-422b-854a-dde3276437fb tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.087782 Nov 27 20:52:59.897359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1145/2371] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:59 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:52:59.902697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e95fd74-76cd-4dcd-9d58-16490148ea61 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:52:59.903868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e95fd74-76cd-4dcd-9d58-16490148ea61 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:52:59.925547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e95fd74-76cd-4dcd-9d58-16490148ea61 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.926014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e95fd74-76cd-4dcd-9d58-16490148ea61 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.927381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e95fd74-76cd-4dcd-9d58-16490148ea61 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:52:59.927832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e95fd74-76cd-4dcd-9d58-16490148ea61 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:52:59.955802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:52:59.966024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7acd6453-8cb0-4c44-a1a6-5d24c55641f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.224619 Nov 27 20:52:59.966024 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1227/2372] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:52:59 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:52:59.993056 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e95fd74-76cd-4dcd-9d58-16490148ea61 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.094155 Nov 27 20:52:59.998711 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1146/2373] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:52:59 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:00.221622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7bd14d6e-053b-4804-9874-18fe43644163 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7d6d0d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:00.269679 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7bd14d6e-053b-4804-9874-18fe43644163 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.051721 Nov 27 20:53:00.270543 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1228/2374] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:00 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:00.522334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:00.523140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:00.530980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.531467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:00.532265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.532708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:00.601344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:00.602085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:00.609350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.610136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:00.611274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.611917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:00.681861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:00.690778 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc85c94f-8a6e-44ef-ac23-5c670fc76cd1 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1505 microversion: 2.1 time: 0.171921 Nov 27 20:53:00.690778 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1147/2375] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:00 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:00.758115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:00.766547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a623a1dd-a3da-477a-8679-9bec7a48004a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.169281 Nov 27 20:53:00.767116 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1229/2376] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:00 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:00.821000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:00.821614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:00.828684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.829414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:00.830212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.830655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:00.909781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f6db43a-e517-4692-b722-2d88dae44a9d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:00.910543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f6db43a-e517-4692-b722-2d88dae44a9d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:00.920529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f6db43a-e517-4692-b722-2d88dae44a9d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.920985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f6db43a-e517-4692-b722-2d88dae44a9d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:00.922421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f6db43a-e517-4692-b722-2d88dae44a9d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:00.922855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f6db43a-e517-4692-b722-2d88dae44a9d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.010570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:01.035035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bebe3276-2321-40ce-aa1b-93d8cc80731c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1521 microversion: 2.1 time: 0.205764 Nov 27 20:53:01.035035 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1148/2377] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:00 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:01.035035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:01.035035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:01.036898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f6db43a-e517-4692-b722-2d88dae44a9d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.116278 Nov 27 20:53:01.038966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.039856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.040857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.041449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.041766 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1230/2378] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:00 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:53:01.050188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e3acbef1-1251-460f-98ad-ca3c9f629231 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:01.052512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e3acbef1-1251-460f-98ad-ca3c9f629231 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:01.061615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3acbef1-1251-460f-98ad-ca3c9f629231 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.062372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3acbef1-1251-460f-98ad-ca3c9f629231 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.063412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3acbef1-1251-460f-98ad-ca3c9f629231 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.064067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3acbef1-1251-460f-98ad-ca3c9f629231 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.131178 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e3acbef1-1251-460f-98ad-ca3c9f629231 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.087587 Nov 27 20:53:01.132127 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1231/2379] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:01 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:01.139079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:01.140202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:01.149981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.150529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.151641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.152278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.193332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:53:01.238932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:01.248765 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb35d5f8-af1b-401d-8fe6-73f247bd0ae9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.223284 Nov 27 20:53:01.250012 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1149/2380] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:01 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:01.259375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f6e7e4c8-aca2-43d5-b471-e846928670aa req-a9259148-65b9-4bfb-82fa-9fffdbd5e060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7cfd43-2058-4943-b00e-471de21cbe0e", "name": "network-vif-plugged", "status": "completed", "tag": "0437b053-b2e1-4749-ac48-4e6a8a0dc423"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:01.259375 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:01.259375 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:01.263973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f6e7e4c8-aca2-43d5-b471-e846928670aa req-a9259148-65b9-4bfb-82fa-9fffdbd5e060 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.264944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f6e7e4c8-aca2-43d5-b471-e846928670aa req-a9259148-65b9-4bfb-82fa-9fffdbd5e060 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.279464 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f6e7e4c8-aca2-43d5-b471-e846928670aa req-a9259148-65b9-4bfb-82fa-9fffdbd5e060 service nova] Creating event network-vif-plugged:0437b053-b2e1-4749-ac48-4e6a8a0dc423 for instance ad7cfd43-2058-4943-b00e-471de21cbe0e on nch2-master-1 Nov 27 20:53:01.289153 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f6e7e4c8-aca2-43d5-b471-e846928670aa req-a9259148-65b9-4bfb-82fa-9fffdbd5e060 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037567 Nov 27 20:53:01.289986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1150/2381] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:01.298340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18a656fe-4ccc-43a3-9bc3-6bf22193d325 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c786c670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:01.363476 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88299049-02fe-46e1-b7af-ecbf39a767cc tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 204 len: 0 microversion: 2.1 time: 0.229526 Nov 27 20:53:01.364402 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1232/2382] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:01 2021] DELETE /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:01.382117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:01.391397 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18a656fe-4ccc-43a3-9bc3-6bf22193d325 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.098876 Nov 27 20:53:01.393597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:01.399598 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1151/2383] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:01 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:01.406905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.408181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.409436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.410193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.663629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:01.675294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9627725-7ca7-493b-be76-1deb81027a87 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1527 microversion: 2.1 time: 0.297235 Nov 27 20:53:01.676104 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1233/2384] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:01 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1527 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:01.784422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:01.785270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:01.793601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.794424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:01.795523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:01.796212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.045066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:02.048314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e8795929-dae9-4caf-adc8-09968de35cad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:02.049467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e8795929-dae9-4caf-adc8-09968de35cad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:02.054310 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-987ae266-4a32-4155-b288-bfa8b2f8f6fd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.274262 Nov 27 20:53:02.055472 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1152/2385] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:01 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:02.056828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8795929-dae9-4caf-adc8-09968de35cad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.057647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8795929-dae9-4caf-adc8-09968de35cad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.058821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8795929-dae9-4caf-adc8-09968de35cad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.059358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8795929-dae9-4caf-adc8-09968de35cad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.109621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e8795929-dae9-4caf-adc8-09968de35cad tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 32657 microversion: 2.1 time: 0.064600 Nov 27 20:53:02.111280 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1234/2386] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:02 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 32657 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:53:02.144831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d102b173-3fc4-4eb9-a6f6-181f11c3f6e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:02.145816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d102b173-3fc4-4eb9-a6f6-181f11c3f6e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:02.152507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d102b173-3fc4-4eb9-a6f6-181f11c3f6e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.153010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d102b173-3fc4-4eb9-a6f6-181f11c3f6e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.154035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d102b173-3fc4-4eb9-a6f6-181f11c3f6e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.154472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d102b173-3fc4-4eb9-a6f6-181f11c3f6e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.157380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92e149ad-4031-4891-b011-f9e4e1a23463 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb8e6d39-28b6-481a-996e-22a668b9411c"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:02.158959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92e149ad-4031-4891-b011-f9e4e1a23463 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:02.166726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e149ad-4031-4891-b011-f9e4e1a23463 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.167240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e149ad-4031-4891-b011-f9e4e1a23463 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.168277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e149ad-4031-4891-b011-f9e4e1a23463 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.168818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e149ad-4031-4891-b011-f9e4e1a23463 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.225450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d102b173-3fc4-4eb9-a6f6-181f11c3f6e0 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.084749 Nov 27 20:53:02.226719 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1153/2387] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:02 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:02.354776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2f15ae6b-be72-4257-b3ad-908dd42b11c5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15c7c9d790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1830156601", "description": "tempest-description-1968978122"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:02.438831 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92e149ad-4031-4891-b011-f9e4e1a23463 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "POST /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286051 Nov 27 20:53:02.439581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1235/2388] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:53:02 2021] POST /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:02.445073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:02.446195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:02.454248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.454908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.455883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.456677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.559667 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2f15ae6b-be72-4257-b3ad-908dd42b11c5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.331148 Nov 27 20:53:02.563682 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1154/2389] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:02 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:02.573945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e45e8a51-545c-462a-bd14-47779e05a7c2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7dddaf0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:02.635811 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e45e8a51-545c-462a-bd14-47779e05a7c2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.071014 Nov 27 20:53:02.636396 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1155/2390] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:02 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:02.644117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:02.645453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6bb20fc0-6838-4e4f-99bd-6fa71ae48d7d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15d94d8670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-574700247", "description": "tempest-description-285478824"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:02.654024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f174792-6d30-46d9-b7d1-f47eb3d1e976 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.213151 Nov 27 20:53:02.654616 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1236/2391] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:02 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:02.692624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:02.693290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:02.699624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.700074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.700863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:02.701301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:02.797739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6bb20fc0-6838-4e4f-99bd-6fa71ae48d7d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.159895 Nov 27 20:53:02.799375 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1156/2392] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:02 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:02.852991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1952961058", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "2940339f-24fb-427d-9c33-55a10d708401"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:02.871847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:02.883730 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0591d422-f207-4f86-a2f0-3c2301aa4316 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1527 microversion: 2.1 time: 0.194584 Nov 27 20:53:02.884541 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1237/2393] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:02 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1527 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:02.924723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] validate_networks() for [('2940339f-24fb-427d-9c33-55a10d708401', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:03.071816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:03.072835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:03.092003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.096351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.097545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.099506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.396343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:03.401471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:03.401895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:03.402442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:03.402854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:03.403389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:03.409688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-90299f19-1336-408b-9b3a-e52ab8409243 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1318 microversion: 2.1 time: 0.341404 Nov 27 20:53:03.410278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1238/2394] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:03 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:03.418074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.419746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.420964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.422063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.422296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b11e7893-d4b6-4815-b0f3-29f48e767a1c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:03.423349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b11e7893-d4b6-4815-b0f3-29f48e767a1c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:03.433990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11e7893-d4b6-4815-b0f3-29f48e767a1c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.434923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11e7893-d4b6-4815-b0f3-29f48e767a1c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.436040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11e7893-d4b6-4815-b0f3-29f48e767a1c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.436899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11e7893-d4b6-4815-b0f3-29f48e767a1c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.457372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Getting quotas for project 4ce320b0fdb0466692b28dc520686425. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:03.464050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Getting quotas for user 434669fb63034fa0b91c67050a6b7d28 and project 4ce320b0fdb0466692b28dc520686425. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:03.484776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:03.490241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:03.517647 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b11e7893-d4b6-4815-b0f3-29f48e767a1c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action" status: 200 len: 40788 microversion: 2.1 time: 0.101292 Nov 27 20:53:03.519903 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1239/2395] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:03 2021] POST /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b/action => generated 40788 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:03.539065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a3c7207-100a-472a-b377-53c64518f7cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:03.551333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a3c7207-100a-472a-b377-53c64518f7cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:03.565435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3c7207-100a-472a-b377-53c64518f7cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.565887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3c7207-100a-472a-b377-53c64518f7cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.566548 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e1c00ba-be33-40b7-a7c0-f3add7568529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716908 Nov 27 20:53:03.566688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3c7207-100a-472a-b377-53c64518f7cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.567111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a3c7207-100a-472a-b377-53c64518f7cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.572938 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1157/2396] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 20:53:03.579773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b6e9c60b-ede2-430b-adcd-575fa41ddee0 req-d24d3a2d-cb27-4afc-ac8e-13c6ba2c15aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ef299-0115-4cd2-b728-afcd425f78b5", "name": "network-vif-plugged", "status": "completed", "tag": "91c15e78-d85f-42e5-90f2-bd938828b809"}, {"server_uuid": "89360906-579a-4126-bc8d-e3e4cff060e0", "name": "network-vif-plugged", "status": "completed", "tag": "cbbbfa16-834b-452b-bcfa-17d86ec350c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:03.582282 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:03.582282 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:03.595080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b6e9c60b-ede2-430b-adcd-575fa41ddee0 req-d24d3a2d-cb27-4afc-ac8e-13c6ba2c15aa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.595954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b6e9c60b-ede2-430b-adcd-575fa41ddee0 req-d24d3a2d-cb27-4afc-ac8e-13c6ba2c15aa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.612405 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b6e9c60b-ede2-430b-adcd-575fa41ddee0 req-d24d3a2d-cb27-4afc-ac8e-13c6ba2c15aa service nova] Creating event network-vif-plugged:91c15e78-d85f-42e5-90f2-bd938828b809 for instance cc5ef299-0115-4cd2-b728-afcd425f78b5 on nch2-master-1 Nov 27 20:53:03.613406 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b6e9c60b-ede2-430b-adcd-575fa41ddee0 req-d24d3a2d-cb27-4afc-ac8e-13c6ba2c15aa service nova] Creating event network-vif-plugged:cbbbfa16-834b-452b-bcfa-17d86ec350c7 for instance 89360906-579a-4126-bc8d-e3e4cff060e0 on nch1-master-1 Nov 27 20:53:03.624265 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b6e9c60b-ede2-430b-adcd-575fa41ddee0 req-d24d3a2d-cb27-4afc-ac8e-13c6ba2c15aa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050056 Nov 27 20:53:03.625157 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1158/2397] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:03 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:03.631239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:03.632275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:03.641962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.642422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.643864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.645483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.650491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a3c7207-100a-472a-b377-53c64518f7cb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.128813 Nov 27 20:53:03.651887 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1240/2398] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:03 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:03.668402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-639e21e5-bd84-4843-b2c2-162ebc6b10f6 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:03.671447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-639e21e5-bd84-4843-b2c2-162ebc6b10f6 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:03.784266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-639e21e5-bd84-4843-b2c2-162ebc6b10f6 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:03.794118 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-639e21e5-bd84-4843-b2c2-162ebc6b10f6 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1216 microversion: 2.1 time: 0.139025 Nov 27 20:53:03.794726 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1241/2399] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:03 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1216 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:03.809345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d43bf322-e011-4d74-82b8-401bf8d924ef tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d449eb80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:03.901730 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d43bf322-e011-4d74-82b8-401bf8d924ef tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.085766 Nov 27 20:53:03.903073 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1242/2400] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:03 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:03.904469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:03.913350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:03.914888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:03.919170 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5aff02ce-1293-4553-b341-f18172d1e51e tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1707 microversion: 2.1 time: 0.290619 Nov 27 20:53:03.921175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1159/2401] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:03 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1707 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:03.922954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.923677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.924730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.925702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.933936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:03.935160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:03.944571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.945501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:03.946668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:03.947478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.232581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:04.242892 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb512b12-2d00-4182-8bb1-72c6f135d721 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 200 len: 1527 microversion: 2.1 time: 0.317957 Nov 27 20:53:04.262239 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1160/2402] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:03 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:04.287355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-18d39503-0522-4820-ab1f-4fab748c7aa7 req-d1a396a1-eeec-4123-afb5-1bb3553f1160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89360906-579a-4126-bc8d-e3e4cff060e0", "name": "network-vif-deleted", "tag": "cbbbfa16-834b-452b-bcfa-17d86ec350c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:04.288993 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:04.288993 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:04.297560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:04.307758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-18d39503-0522-4820-ab1f-4fab748c7aa7 req-d1a396a1-eeec-4123-afb5-1bb3553f1160 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.308014 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b2fec19f-c4b3-4336-ab75-993067433bcf tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.403553 Nov 27 20:53:04.308707 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1243/2403] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:03 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:04.309576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-18d39503-0522-4820-ab1f-4fab748c7aa7 req-d1a396a1-eeec-4123-afb5-1bb3553f1160 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.355707 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-18d39503-0522-4820-ab1f-4fab748c7aa7 req-d1a396a1-eeec-4123-afb5-1bb3553f1160 service nova] Creating event network-vif-deleted:cbbbfa16-834b-452b-bcfa-17d86ec350c7 for instance 89360906-579a-4126-bc8d-e3e4cff060e0 on nch1-master-1 Nov 27 20:53:04.363874 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-18d39503-0522-4820-ab1f-4fab748c7aa7 req-d1a396a1-eeec-4123-afb5-1bb3553f1160 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081526 Nov 27 20:53:04.364710 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1161/2404] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:53:04.427191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:04.427685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:04.440209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.441236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.449518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.450632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.615367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:04.624810 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26330bcd-577e-4607-9fdd-cf6038dd1454 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1507 microversion: 2.1 time: 0.200847 Nov 27 20:53:04.625486 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1244/2405] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:04 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:04.646783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cad55e6f-4b88-4111-9cfb-0a54a768ecde"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:04.648112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:04.659158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.659650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.660552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.661912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.663965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93bfad1f-cff5-44f8-bde6-06dcd33ddd2c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:04.665233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93bfad1f-cff5-44f8-bde6-06dcd33ddd2c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:04.674509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93bfad1f-cff5-44f8-bde6-06dcd33ddd2c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.674948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93bfad1f-cff5-44f8-bde6-06dcd33ddd2c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.675775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93bfad1f-cff5-44f8-bde6-06dcd33ddd2c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.676200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93bfad1f-cff5-44f8-bde6-06dcd33ddd2c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.725443 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-93bfad1f-cff5-44f8-bde6-06dcd33ddd2c tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.066534 Nov 27 20:53:04.728317 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1245/2406] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:04 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:53:04.765567 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] HTTP exception thrown: Invalid volume: volume cad55e6f-4b88-4111-9cfb-0a54a768ecde is already attached to instances: 821291e6-a643-4172-ba04-15984efe9761 Nov 27 20:53:04.766439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Returning 400 to user: Invalid volume: volume cad55e6f-4b88-4111-9cfb-0a54a768ecde is already attached to instances: 821291e6-a643-4172-ba04-15984efe9761 {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:04.767777 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ef34d77c-4041-492c-846c-455791d257e0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129793 Nov 27 20:53:04.769730 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1162/2407] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:53:04 2021] POST /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:53:04.812811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:04.813768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:04.822083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.822853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.824200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.825025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.887514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:04.888058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:04.903632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:04.904182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.909301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.910978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.911610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.914488 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40719009-89e8-4779-b1d2-f6df51f09f0e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1268 microversion: 2.1 time: 0.106423 Nov 27 20:53:04.925418 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1246/2408] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:04 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1268 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:04.930637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:04.931461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:04.940068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.940872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.942044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:04.942836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:04.971081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:53:05.073437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lazy-loading 'services' on Instance uuid 821291e6-a643-4172-ba04-15984efe9761 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:53:05.127822 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56227bee-093e-4a1b-a369-37fb28cdc773 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 204 len: 0 microversion: 2.1 time: 0.250610 Nov 27 20:53:05.130060 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1163/2409] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:04 2021] DELETE /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:05.138542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88c87c7f-a581-416a-aedc-0b5c59a424ac tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7c91ca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:05.200247 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88c87c7f-a581-416a-aedc-0b5c59a424ac tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.068171 Nov 27 20:53:05.201232 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1164/2410] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:05 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:05.206099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:05.207382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:05.214721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.215209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b3db021-365d-4045-abb8-a3ec0c38229a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "DELETE /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments/cad55e6f-4b88-4111-9cfb-0a54a768ecde" status: 202 len: 0 microversion: 2.1 time: 0.287768 Nov 27 20:53:05.215626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.216364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1247/2411] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 20:53:04 2021] DELETE /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments/cad55e6f-4b88-4111-9cfb-0a54a768ecde => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:05.216907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.217450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.228589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0340495d-c5f8-48a4-a0fa-7a78090300f5 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:05.231113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0340495d-c5f8-48a4-a0fa-7a78090300f5 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:05.244020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0340495d-c5f8-48a4-a0fa-7a78090300f5 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.247146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0340495d-c5f8-48a4-a0fa-7a78090300f5 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.251840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0340495d-c5f8-48a4-a0fa-7a78090300f5 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.253762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0340495d-c5f8-48a4-a0fa-7a78090300f5 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.326086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0340495d-c5f8-48a4-a0fa-7a78090300f5 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103615 Nov 27 20:53:05.326988 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1248/2412] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:53:05 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:05.341940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:05.344796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:05.361275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.363094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.368288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.368816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.395672 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Instance 89360906-579a-4126-bc8d-e3e4cff060e0 could not be found. Nov 27 20:53:05.398414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Instance 89360906-579a-4126-bc8d-e3e4cff060e0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:05.399395 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2657dc86-e690-49b3-a580-1325c1263114 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 404 len: 111 microversion: 2.1 time: 0.069862 Nov 27 20:53:05.400242 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1249/2413] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:05 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:05.404688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:05.405416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:05.420357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.421194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.422738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.423439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.590305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:05.591205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:05.599564 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c5592e1c-cca4-4527-9ec5-ebc9bfa6673f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1713 microversion: 2.1 time: 0.397302 Nov 27 20:53:05.600557 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5656cb77-449b-4c50-be4a-c36cbc6dd4a2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.199343 Nov 27 20:53:05.611575 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1250/2414] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:05 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:05.612026 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1165/2415] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:05 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1713 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:05.612142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-333119401", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51800357-640d-4106-97ff-61854e2562e6"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:05.669331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] validate_networks() for [('51800357-640d-4106-97ff-61854e2562e6', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:05.684354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ad663696-02c7-4b56-a50a-4b7400db570b req-46d33199-2141-4869-9178-1a37c3a2d5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89360906-579a-4126-bc8d-e3e4cff060e0", "name": "network-vif-unplugged", "status": "completed", "tag": "cbbbfa16-834b-452b-bcfa-17d86ec350c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:05.686059 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:05.686059 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:05.701036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ad663696-02c7-4b56-a50a-4b7400db570b req-46d33199-2141-4869-9178-1a37c3a2d5cc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.701409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ad663696-02c7-4b56-a50a-4b7400db570b req-46d33199-2141-4869-9178-1a37c3a2d5cc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.720551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ad663696-02c7-4b56-a50a-4b7400db570b req-46d33199-2141-4869-9178-1a37c3a2d5cc service nova] Creating event network-vif-unplugged:cbbbfa16-834b-452b-bcfa-17d86ec350c7 for instance 89360906-579a-4126-bc8d-e3e4cff060e0 on nch1-master-1 Nov 27 20:53:05.737509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ad663696-02c7-4b56-a50a-4b7400db570b req-46d33199-2141-4869-9178-1a37c3a2d5cc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056615 Nov 27 20:53:05.738394 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1166/2416] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:05 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:05.759792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be0fb5d7-7c5e-4f4a-b57a-10d5034f76f9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:05.761186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be0fb5d7-7c5e-4f4a-b57a-10d5034f76f9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:05.768921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0fb5d7-7c5e-4f4a-b57a-10d5034f76f9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.769468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0fb5d7-7c5e-4f4a-b57a-10d5034f76f9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.770481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0fb5d7-7c5e-4f4a-b57a-10d5034f76f9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:05.770923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0fb5d7-7c5e-4f4a-b57a-10d5034f76f9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:05.842122 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be0fb5d7-7c5e-4f4a-b57a-10d5034f76f9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.102198 Nov 27 20:53:05.848158 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1167/2417] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:05 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:06.094692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b0d52e50-1604-4a56-b723-75d29faf5775"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:06.098008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:06.114844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.117696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.118989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.119772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.162253 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:06.162253 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:06.193774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:06.194276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:06.194720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:06.195134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:06.195611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:06.215143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.215855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.230629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.234325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.273271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for project 483860ef169447208569ca7510affe41. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:06.286397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Getting quotas for user 4143c311f90d4b6bbae7b8eddcbef26f and project 483860ef169447208569ca7510affe41. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:06.286976 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] HTTP exception thrown: Volume b0d52e50-1604-4a56-b723-75d29faf5775 could not be found. Nov 27 20:53:06.287687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Returning 400 to user: Volume b0d52e50-1604-4a56-b723-75d29faf5775 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:06.288526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-478943c7-8e00-46a7-bc19-4d713640e76b tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] 10.222.0.21 "PUT /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments/bb8e6d39-28b6-481a-996e-22a668b9411c" status: 400 len: 107 microversion: 2.1 time: 0.383889 Nov 27 20:53:06.290159 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1168/2418] 10.222.0.21 () {60 vars in 1432 bytes} [Sat Nov 27 20:53:05 2021] PUT /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments/bb8e6d39-28b6-481a-996e-22a668b9411c => generated 107 bytes in 386 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:53:06.296577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:06.298720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:06.303526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:06.306187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:06.319967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.321686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.323695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.324894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.376319 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7323077e-ba11-45c1-839f-ee80f2e2a885 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.773973 Nov 27 20:53:06.379300 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1251/2419] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:05 2021] POST /compute/v2.1/servers => generated 383 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:06.381301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-183dfa48-37eb-4662-b30e-596067f4d358 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7922b80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:06.467632 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-183dfa48-37eb-4662-b30e-596067f4d358 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.089494 Nov 27 20:53:06.473419 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1252/2420] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:06 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:06.473419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-edfcb412-777a-46d5-95e2-ef59486c7eb2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:06.474265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-edfcb412-777a-46d5-95e2-ef59486c7eb2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:06.495203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfcb412-777a-46d5-95e2-ef59486c7eb2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.495956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfcb412-777a-46d5-95e2-ef59486c7eb2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.496991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfcb412-777a-46d5-95e2-ef59486c7eb2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.497866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfcb412-777a-46d5-95e2-ef59486c7eb2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.532538 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-edfcb412-777a-46d5-95e2-ef59486c7eb2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062630 Nov 27 20:53:06.537461 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1253/2421] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:53:06 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:53:06.544604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:06.545145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:06.564624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.565133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.565966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.566410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.684885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lazy-loading 'services' on Instance uuid 8cc4635e-f9e3-4806-a40e-3afc332181d9 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:53:06.725375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:06.753260 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c36a8f3a-a7ce-4833-a150-5859f6bbaa41 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 0.460486 Nov 27 20:53:06.762943 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1169/2422] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:06 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:06.770694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3469eb52-cdaa-4684-9113-2adca5d8a208 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:06.772452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3469eb52-cdaa-4684-9113-2adca5d8a208 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:06.838584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-789fc9cc-7abb-40e7-903f-373f176a19b6 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments/bb8e6d39-28b6-481a-996e-22a668b9411c" status: 202 len: 0 microversion: 2.1 time: 0.303550 Nov 27 20:53:06.839812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1254/2423] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 20:53:06 2021] DELETE /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments/bb8e6d39-28b6-481a-996e-22a668b9411c => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:06.857534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:06.860511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:06.872352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.872905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:06.873999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:06.874726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:07.194146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:07.206398 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-13020a9b-05b4-49dd-956c-8d4c31f68d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.364625 Nov 27 20:53:07.206992 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1255/2424] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:06 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:07.223354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:07.228751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:07.239508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:07.239957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:07.240770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:07.241193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:07.384088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3469eb52-cdaa-4684-9113-2adca5d8a208 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:07.392861 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3469eb52-cdaa-4684-9113-2adca5d8a208 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1224 microversion: 2.1 time: 0.635438 Nov 27 20:53:07.404664 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1170/2425] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:06 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1224 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:07.411646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1426045059", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "4c1c2964-efe7-47f4-bb47-68bb0bb15cce"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:07.526012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] validate_networks() for [('4c1c2964-efe7-47f4-bb47-68bb0bb15cce', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:07.582274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:07.596336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5611080c-48ab-42cb-aa80-8cfb7076bfbd tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1713 microversion: 2.1 time: 0.388088 Nov 27 20:53:07.596927 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1256/2426] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:07 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1713 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:07.601368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-194ddc47-d48d-4706-844f-4f2194138da3 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:07.606059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-194ddc47-d48d-4706-844f-4f2194138da3 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:07.635192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-194ddc47-d48d-4706-844f-4f2194138da3 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:07.635831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-194ddc47-d48d-4706-844f-4f2194138da3 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:07.636632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-194ddc47-d48d-4706-844f-4f2194138da3 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:07.639144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-194ddc47-d48d-4706-844f-4f2194138da3 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:07.732502 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-194ddc47-d48d-4706-844f-4f2194138da3 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134361 Nov 27 20:53:07.733193 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1257/2427] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:53:07 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:07.738528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d08ff30a-9f6e-4e2e-88ed-8d5db83ba13d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:07.739497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d08ff30a-9f6e-4e2e-88ed-8d5db83ba13d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:07.747658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d08ff30a-9f6e-4e2e-88ed-8d5db83ba13d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:07.748168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d08ff30a-9f6e-4e2e-88ed-8d5db83ba13d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:07.749026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d08ff30a-9f6e-4e2e-88ed-8d5db83ba13d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:07.750047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d08ff30a-9f6e-4e2e-88ed-8d5db83ba13d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:07.833468 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d08ff30a-9f6e-4e2e-88ed-8d5db83ba13d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.098953 Nov 27 20:53:07.834674 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1258/2428] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:07 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:07.849622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9d81295-c284-4edf-8e99-41012a2c57be tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7d6d820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:07.967499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9d81295-c284-4edf-8e99-41012a2c57be tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.129827 Nov 27 20:53:07.968791 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1259/2429] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:07 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:08.000780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:08.001725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:08.009541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.010377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.011368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.012027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.535708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:08.543570 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e9f1b8d6-16a8-42ea-9b5d-a567fc6a9b6b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 0.573364 Nov 27 20:53:08.553537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1260/2430] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:07 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:08.557506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:08.558219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:08.571613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.572107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.572937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.573381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.670910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:08.672118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:08.673022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:08.673373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:08.673783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:08.693553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.703421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.704784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.712665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.761524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:08.782429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for user 6f940822793e422c8436036be6a116a0 and project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:08.828709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:08.833019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:08.922281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:08.930957 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-67c14fd7-97b9-4e80-a31a-1a6ff2fbe772 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.381726 Nov 27 20:53:08.933215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1261/2431] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:08 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:08.952214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:08.955760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:08.967701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.968736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.969584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:08.970026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:08.982204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aee07582-39e3-4b64-be13-2e330f3d6fed tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576276 Nov 27 20:53:08.987683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1171/2432] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:09.003984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:09.004622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:09.033087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.033353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.034194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.034708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.101356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:09.113388 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d7655c30-d9d0-40e7-81fa-5d8833879b04 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1282 microversion: 2.1 time: 0.168490 Nov 27 20:53:09.114208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1262/2433] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:08 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:09.118623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a378a6de-3817-4de8-9c8e-50d2961b9343 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:09.120186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a378a6de-3817-4de8-9c8e-50d2961b9343 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:09.127117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378a6de-3817-4de8-9c8e-50d2961b9343 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.127598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378a6de-3817-4de8-9c8e-50d2961b9343 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.128775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378a6de-3817-4de8-9c8e-50d2961b9343 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.128976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378a6de-3817-4de8-9c8e-50d2961b9343 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.161333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.162722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.163464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lazy-loading 'fault' on Instance uuid 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:53:09.182441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a378a6de-3817-4de8-9c8e-50d2961b9343 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067365 Nov 27 20:53:09.193855 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1263/2434] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:53:09 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:53:09.209327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f4ae38b6-16ae-48b1-8385-e93ef537b251 req-22ac5b09-92a2-46c5-97a1-c56c080c57f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b", "name": "network-vif-deleted", "tag": "f34dffdf-663f-4b72-92c0-9d9a0fe43a7f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:09.217124 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:09.217124 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:09.235858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f4ae38b6-16ae-48b1-8385-e93ef537b251 req-22ac5b09-92a2-46c5-97a1-c56c080c57f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.238301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f4ae38b6-16ae-48b1-8385-e93ef537b251 req-22ac5b09-92a2-46c5-97a1-c56c080c57f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.267381 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f4ae38b6-16ae-48b1-8385-e93ef537b251 req-22ac5b09-92a2-46c5-97a1-c56c080c57f8 service nova] Creating event network-vif-deleted:f34dffdf-663f-4b72-92c0-9d9a0fe43a7f for instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b on nch1-master-1 Nov 27 20:53:09.278896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f4ae38b6-16ae-48b1-8385-e93ef537b251 req-22ac5b09-92a2-46c5-97a1-c56c080c57f8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083422 Nov 27 20:53:09.296098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5af01920574741f381a5dfefd9282bfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68857c7effec496aa99ff78b76521109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:09.296359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1264/2435] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:09.327969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f6bc149-1084-41e4-b438-eee7efda443d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:09.330154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f6bc149-1084-41e4-b438-eee7efda443d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:09.334836 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-510da51e-cc85-41a2-8bd0-3e9e67875bce tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 200 len: 1354 microversion: 2.1 time: 0.344098 Nov 27 20:53:09.341231 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1172/2436] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:08 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 1354 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:09.356201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f6bc149-1084-41e4-b438-eee7efda443d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.357681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f6bc149-1084-41e4-b438-eee7efda443d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.358844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f6bc149-1084-41e4-b438-eee7efda443d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.362091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f6bc149-1084-41e4-b438-eee7efda443d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.365447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8269d7c2-e63a-4aab-98fc-56fe16127844 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7a25b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:09.436468 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f6bc149-1084-41e4-b438-eee7efda443d tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.137517 Nov 27 20:53:09.460938 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1265/2437] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:09 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:09.461802 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8269d7c2-e63a-4aab-98fc-56fe16127844 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.118451 Nov 27 20:53:09.462774 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1173/2438] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:09 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:09.476642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e3946d98-be68-4921-8a4e-1dd679810535 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:09.495687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cba93250-a941-4a5c-b0f1-d39668005e08 req-a05ea8ef-f5e0-4b89-9812-2e492d061ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be1b680-176c-4763-a0b2-3e8c7e18d91e", "tag": "82ae9ef3-d9a1-4c1b-9556-dd503129f6ca"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:09.496157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e3946d98-be68-4921-8a4e-1dd679810535 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:09.498735 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:09.498735 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:09.519697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cba93250-a941-4a5c-b0f1-d39668005e08 req-a05ea8ef-f5e0-4b89-9812-2e492d061ffd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.524919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cba93250-a941-4a5c-b0f1-d39668005e08 req-a05ea8ef-f5e0-4b89-9812-2e492d061ffd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.555233 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cba93250-a941-4a5c-b0f1-d39668005e08 req-a05ea8ef-f5e0-4b89-9812-2e492d061ffd service nova] Creating event network-changed:82ae9ef3-d9a1-4c1b-9556-dd503129f6ca for instance 4be1b680-176c-4763-a0b2-3e8c7e18d91e on nch2-master-1 Nov 27 20:53:09.569588 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cba93250-a941-4a5c-b0f1-d39668005e08 req-a05ea8ef-f5e0-4b89-9812-2e492d061ffd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097206 Nov 27 20:53:09.570943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3946d98-be68-4921-8a4e-1dd679810535 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:09.571934 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1174/2439] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:09.580477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e3946d98-be68-4921-8a4e-1dd679810535 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1218 microversion: 2.1 time: 0.117010 Nov 27 20:53:09.585598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:09.586719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:09.592418 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1266/2440] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:09 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:09.607669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.609414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.613329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.614288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.948869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:09.949838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:09.965346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.967247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:09.972958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:09.982271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.325407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:10.340242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96a73ec1-daf3-421f-951d-cf19517761e0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 0.765945 Nov 27 20:53:10.341220 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1175/2441] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:09 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:10.350065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:10.353641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:10.367830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:10.371007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.371751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.374748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.375203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.378503 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7fa1feca-9077-486b-aff3-fb23af7bef24 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.433462 Nov 27 20:53:10.388960 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1267/2442] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:09 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:10.394444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:10.395240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:10.407241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.408420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.409576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.410716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.427322 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] HTTP exception thrown: Instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b could not be found. Nov 27 20:53:10.428264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Returning 404 to user: Instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:10.429453 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3337aec-8c75-4572-82a0-1f7fb1b9cd8c tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 404 len: 111 microversion: 2.1 time: 0.038505 Nov 27 20:53:10.430225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1268/2443] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:10 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:10.441577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:10.442441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:10.451877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.453276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.454324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.454992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.490591 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] HTTP exception thrown: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. Nov 27 20:53:10.501965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Returning 404 to user: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:10.504020 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1508aeb5-2ad6-40f8-91ae-cefe9f3a00a0 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 404 len: 111 microversion: 2.1 time: 0.069528 Nov 27 20:53:10.505771 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1269/2444] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:10 2021] DELETE /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:53:10.513934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e7c0b4e4-fe8d-48bb-ac20-cd973418eaac tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:10.515378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e7c0b4e4-fe8d-48bb-ac20-cd973418eaac tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:10.528641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7c0b4e4-fe8d-48bb-ac20-cd973418eaac tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.529441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7c0b4e4-fe8d-48bb-ac20-cd973418eaac tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.532277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7c0b4e4-fe8d-48bb-ac20-cd973418eaac tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.532972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7c0b4e4-fe8d-48bb-ac20-cd973418eaac tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.594220 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e7c0b4e4-fe8d-48bb-ac20-cd973418eaac tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.083350 Nov 27 20:53:10.599043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1270/2445] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:10 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:10.607976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-826c0fce-f4c0-4001-9610-ed2575811d12 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7416b80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:10.691085 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-826c0fce-f4c0-4001-9610-ed2575811d12 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.090474 Nov 27 20:53:10.692175 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1271/2446] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:10 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:10.696515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:10.718532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:10.741773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.742305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.743016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.743501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.786613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] HTTP exception thrown: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. Nov 27 20:53:10.799975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Returning 404 to user: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:10.800859 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f63fcc68-2066-4bd4-bc86-d643db24f09a tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 404 len: 111 microversion: 2.1 time: 0.108186 Nov 27 20:53:10.801437 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1272/2447] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:10 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:10.818783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:10.825725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:10.843603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.844057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:10.844854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:10.845290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:11.091602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:11.102272 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d159e428-82f3-4478-81e3-73a754bdde5c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1276 microversion: 2.1 time: 0.299618 Nov 27 20:53:11.117330 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1273/2448] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:10 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:11.122895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d21fa3f6-3728-42d2-9fdb-87ca9f69ed1f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '.version_select at 0x7f15c754fa60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:11.170838 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d21fa3f6-3728-42d2-9fdb-87ca9f69ed1f tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126826238" status: 202 len: 0 microversion: 2.1 time: 0.050606 Nov 27 20:53:11.172729 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1274/2449] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 20:53:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126826238 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:11.183033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7cb494ee-e52f-4464-965d-d331ccc0afdc"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:11.205674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:11.217595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:11.218621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:11.219461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:11.219904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:11.280109 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:11.280109 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:11.284785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:11.292834 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9db50787-ecf2-40c1-82c8-5db397934f73 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.950248 Nov 27 20:53:11.300128 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1176/2450] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:10 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:11.346115 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] HTTP exception thrown: Volume f898888a-7c7c-4db0-b598-9a4347e9ceb3 could not be found. Nov 27 20:53:11.346867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] Returning 404 to user: Volume f898888a-7c7c-4db0-b598-9a4347e9ceb3 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:11.347825 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e48b5e2-599a-4955-949c-4c0aaf0584ce tempest-VolumesAdminNegativeTest-1326878529 tempest-VolumesAdminNegativeTest-1326878529-project-admin] 10.222.0.21 "PUT /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments/f898888a-7c7c-4db0-b598-9a4347e9ceb3" status: 404 len: 109 microversion: 2.1 time: 0.173438 Nov 27 20:53:11.348615 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1275/2451] 10.222.0.21 () {60 vars in 1432 bytes} [Sat Nov 27 20:53:11 2021] PUT /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9/os-volume_attachments/f898888a-7c7c-4db0-b598-9a4347e9ceb3 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:11.370610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:11.372040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:11.397211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:11.398135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:11.411266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:11.416858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:11.417541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:11.418303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:11.419322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:11.420331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:11.422210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:11.437361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:11.983838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:11.997111 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5dadcc3-9f4e-4cec-80fc-60ed398281a6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.602739 Nov 27 20:53:12.007309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1276/2452] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:11 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:12.014589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d4c19b6-be63-4f52-bd86-da4bac4fddfb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:12.016005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d4c19b6-be63-4f52-bd86-da4bac4fddfb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:12.034468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4c19b6-be63-4f52-bd86-da4bac4fddfb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:12.034935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4c19b6-be63-4f52-bd86-da4bac4fddfb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:12.038178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4c19b6-be63-4f52-bd86-da4bac4fddfb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:12.038643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d4c19b6-be63-4f52-bd86-da4bac4fddfb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:12.130678 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d4c19b6-be63-4f52-bd86-da4bac4fddfb tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.128974 Nov 27 20:53:12.131503 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1277/2453] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:11 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:12.136760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59c2821c-9571-4eda-a5dc-d141b524e617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d449eb80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:12.222233 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59c2821c-9571-4eda-a5dc-d141b524e617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.089296 Nov 27 20:53:12.223781 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1278/2454] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:12 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:12.230551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:12.231707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:12.242549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:12.243594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:12.245062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:12.246036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:12.445174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:12.479215 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-287e9505-ca83-437b-8657-93bf7db895da tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 1.119094 Nov 27 20:53:12.495137 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1177/2455] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:11 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:12.501785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:12.502714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:12.509535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:12.510289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:12.511896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:12.512562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:12.779314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:12.792327 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7b6179e3-c11c-4140-86b5-a90a89fca791 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.566666 Nov 27 20:53:12.792941 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1279/2456] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:12 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:13.019220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:13.019883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:13.032898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.033344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.034154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.034591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.050053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:13.064000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efba600d-bbbe-438e-905f-542e22d73c14 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.567281 Nov 27 20:53:13.080025 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1178/2457] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:12 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:13.143507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd38bf28-e6b4-4611-9bc1-9ffe063f19ed tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:13.145129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd38bf28-e6b4-4611-9bc1-9ffe063f19ed tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:13.154985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd38bf28-e6b4-4611-9bc1-9ffe063f19ed tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.157417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd38bf28-e6b4-4611-9bc1-9ffe063f19ed tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.158562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd38bf28-e6b4-4611-9bc1-9ffe063f19ed tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.159230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd38bf28-e6b4-4611-9bc1-9ffe063f19ed tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.262750 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd38bf28-e6b4-4611-9bc1-9ffe063f19ed tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 32644 microversion: 2.1 time: 0.123604 Nov 27 20:53:13.268744 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1179/2458] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:13 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 32644 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:53:13.278746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2fcff8eb-3c4b-4b3c-a960-bc38d4ffa9df req-54253657-588d-4497-8f82-8540fbd4109a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56059f02-0c55-46c4-9744-8b4536f99ff3", "tag": "07fe1e64-102d-4c40-8233-cc2f4399f06f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:13.282435 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:13.282435 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:13.303330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2fcff8eb-3c4b-4b3c-a960-bc38d4ffa9df req-54253657-588d-4497-8f82-8540fbd4109a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.304264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2fcff8eb-3c4b-4b3c-a960-bc38d4ffa9df req-54253657-588d-4497-8f82-8540fbd4109a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.317460 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2fcff8eb-3c4b-4b3c-a960-bc38d4ffa9df req-54253657-588d-4497-8f82-8540fbd4109a service nova] Creating event network-changed:07fe1e64-102d-4c40-8233-cc2f4399f06f for instance 56059f02-0c55-46c4-9744-8b4536f99ff3 on nch1-master-1 Nov 27 20:53:13.322654 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2fcff8eb-3c4b-4b3c-a960-bc38d4ffa9df req-54253657-588d-4497-8f82-8540fbd4109a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050105 Nov 27 20:53:13.324141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1180/2459] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:13.330616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8d25e2fc-5e45-43b2-9c5a-08f55eeb85b5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7c95ca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:13.366011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:13.381089 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-62e768c8-ac65-454d-b413-8bd4738f9fe9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.365817 Nov 27 20:53:13.394743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1280/2460] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:13 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:13.411430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8d25e2fc-5e45-43b2-9c5a-08f55eeb85b5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.085820 Nov 27 20:53:13.418177 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1181/2461] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:13 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:13.500077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:13.501821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:13.510515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.511236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.512435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.513227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.699660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dec22674-4500-421b-aeb1-24c2d4a0f1b5 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:13.700483 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:13.700483 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:13.746955 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dec22674-4500-421b-aeb1-24c2d4a0f1b5 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/872004157" status: 202 len: 0 microversion: 2.1 time: 0.301366 Nov 27 20:53:13.748821 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1281/2462] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:53:13 2021] DELETE /compute/v2.1/flavors/872004157 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:13.757867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b771c410-bf71-428a-b37a-36cb3ae0582b tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:13.781645 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b771c410-bf71-428a-b37a-36cb3ae0582b tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.028049 Nov 27 20:53:13.782481 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1282/2463] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:53:13 2021] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:13.820347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-67622255-0c71-44c7-a321-f53620824e54 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:13.849385 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-67622255-0c71-44c7-a321-f53620824e54 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1678249805" status: 202 len: 0 microversion: 2.1 time: 0.041602 Nov 27 20:53:13.850957 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1283/2464] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:53:13 2021] DELETE /compute/v2.1/flavors/1678249805 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:13.857892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:13.859534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:13.869601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.870417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:13.872188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:13.873736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.127541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:14.141600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a50b6fe0-6eb9-4553-bbde-6ef7d968d4e3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.287529 Nov 27 20:53:14.142441 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1284/2465] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:13 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:14.155000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-56644065-d5f6-4055-90c6-a97c598df0aa req-a65a1799-eeb1-465f-a785-21f523b5febf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbf72fc-e72f-4963-8664-b1b1260f8f89", "tag": "1597305a-cd19-4e32-92a0-39078f81c889"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:14.159989 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:14.159989 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:14.178636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-56644065-d5f6-4055-90c6-a97c598df0aa req-a65a1799-eeb1-465f-a785-21f523b5febf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.179076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-56644065-d5f6-4055-90c6-a97c598df0aa req-a65a1799-eeb1-465f-a785-21f523b5febf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.180556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:14.188780 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90ce96cb-7e03-41da-9148-c8ee202b98fc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 0.695102 Nov 27 20:53:14.192179 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1182/2466] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:13 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:14.203821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-56644065-d5f6-4055-90c6-a97c598df0aa req-a65a1799-eeb1-465f-a785-21f523b5febf service nova] Creating event network-changed:1597305a-cd19-4e32-92a0-39078f81c889 for instance acbf72fc-e72f-4963-8664-b1b1260f8f89 on nch1-master-1 Nov 27 20:53:14.205166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:14.205879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:14.217343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-56644065-d5f6-4055-90c6-a97c598df0aa req-a65a1799-eeb1-465f-a785-21f523b5febf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073249 Nov 27 20:53:14.219558 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1285/2467] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:14.225239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.225805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.226616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.227052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.233812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0edc3c9-5465-42a8-b157-5ba1db7ce616 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:14.255085 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0edc3c9-5465-42a8-b157-5ba1db7ce616 tempest-ServersWithSpecificFlavorTestJSON-1267388492 tempest-ServersWithSpecificFlavorTestJSON-1267388492-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033033 Nov 27 20:53:14.256051 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1286/2468] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:53:14 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:14.260758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:14.261730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:14.286683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:53:14.289235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.291688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.293271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.296107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.471405 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-60649bd3-b3f6-4b6e-b065-5f06107985a2 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 204 len: 0 microversion: 2.1 time: 0.274997 Nov 27 20:53:14.472149 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1183/2469] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:14 2021] DELETE /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:14.477629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9effc767-6b95-44b0-848e-7d6e3ca351ca tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:14.486861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9effc767-6b95-44b0-848e-7d6e3ca351ca tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:14.498970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9effc767-6b95-44b0-848e-7d6e3ca351ca tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.500357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9effc767-6b95-44b0-848e-7d6e3ca351ca tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.502083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9effc767-6b95-44b0-848e-7d6e3ca351ca tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.502745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9effc767-6b95-44b0-848e-7d6e3ca351ca tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.591874 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9effc767-6b95-44b0-848e-7d6e3ca351ca tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action" status: 200 len: 40790 microversion: 2.1 time: 0.117584 Nov 27 20:53:14.596988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1184/2470] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:14 2021] POST /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2/action => generated 40790 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:53:14.609860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:14.612050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:14.626869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.627588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.628662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.629382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.661180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] HTTP exception thrown: Instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b could not be found. Nov 27 20:53:14.662073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Returning 404 to user: Instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:14.662919 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8fdb3b56-6242-4c3d-9bb4-5ba85a188c90 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 404 len: 111 microversion: 2.1 time: 0.064487 Nov 27 20:53:14.663734 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1185/2471] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:14 2021] DELETE /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:14.672244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:14.673774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:14.680781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.681532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.682510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:14.683120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:14.937855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:14.963426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:14.964440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-798a0f23-3115-47f7-908c-1b079a70c389 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.296404 Nov 27 20:53:14.965477 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1186/2472] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:14 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:14.981817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c5be478-45d3-4c9f-86a4-0beb1a70e6c6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.724499 Nov 27 20:53:14.982798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-599c4f96-b9ca-462e-ac85-17cb905f0ff4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7369310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.049336 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-599c4f96-b9ca-462e-ac85-17cb905f0ff4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.082325 Nov 27 20:53:15.055937 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1187/2473] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:14 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:15.062614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.063589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.070846 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1287/2474] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:14 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:15.074543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.075230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.076554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.077166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.085302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.086610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.093991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.093991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.094691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.095130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.354819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:15.367653 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aeedd293-964b-4b2e-a4c2-bb1ef4af24cf tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1511 microversion: 2.1 time: 0.309998 Nov 27 20:53:15.368906 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1188/2475] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:15 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:15.394763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.397305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.411112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.411872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.412842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.415389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.449958 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] HTTP exception thrown: Instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b could not be found. Nov 27 20:53:15.450578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Returning 404 to user: Instance 2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:15.453491 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5618a2f2-8e09-431e-83cd-df64e02f4e70 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b" status: 404 len: 111 microversion: 2.1 time: 0.069115 Nov 27 20:53:15.454092 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1189/2476] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:15 2021] GET /compute/v2.1/servers/2a7a179d-93f0-4ab9-af5e-bafe4f2dbc2b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:15.461987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.462856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.470495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.471210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.472208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.472838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.492288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:15.504183 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b203f46-f767-445b-ad21-54a835afcddf tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1696 microversion: 2.1 time: 0.424962 Nov 27 20:53:15.504965 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1288/2477] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:15 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1696 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:15.510040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.510722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.517934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.518386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.519162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.528039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.772819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:15.786336 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18a85ca6-f14b-403d-b91f-1a3e0ac703db tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.328053 Nov 27 20:53:15.787002 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1190/2478] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:15 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:15.805793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.807339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.826908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.834183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.836114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.836921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.858918 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] HTTP exception thrown: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. Nov 27 20:53:15.860449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Returning 404 to user: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:15.861496 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8c82ae9a-7c05-456b-94b9-d0c75fcc5460 tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 404 len: 111 microversion: 2.1 time: 0.066533 Nov 27 20:53:15.862672 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1191/2479] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:15 2021] DELETE /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:15.869291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:15.871669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.872983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] [instance: 1f864ad9-b187-4c7e-a890-af76116d06ea] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.877539 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5df809d6-6481-44ce-ae3f-90b3d175d77e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 0.370785 Nov 27 20:53:15.878308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1289/2480] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:15 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:15.896884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.897998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.899204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.899383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.927080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] HTTP exception thrown: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. Nov 27 20:53:15.927931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] Returning 404 to user: Instance 1f864ad9-b187-4c7e-a890-af76116d06ea could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:15.929366 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8790044-3755-47fa-b919-06a4bd4f293d tempest-ServersWithSpecificFlavorTestJSON-1317853450 tempest-ServersWithSpecificFlavorTestJSON-1317853450-project] 10.222.0.21 "GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea" status: 404 len: 111 microversion: 2.1 time: 0.062495 Nov 27 20:53:15.933497 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1192/2481] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:15 2021] GET /compute/v2.1/servers/1f864ad9-b187-4c7e-a890-af76116d06ea => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:15.982332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:15.983341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:15.992237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.995486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:15.996459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:15.997010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.067763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d276cb6a-59a5-453d-9307-1092955a8a0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d459f670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:16.132874 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d276cb6a-59a5-453d-9307-1092955a8a0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.074441 Nov 27 20:53:16.134091 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1193/2482] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:16 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:16.139111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:16.141291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:16.148936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.149791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.151350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.152034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.206891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:16.221310 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ae8d056-99bd-49c7-9b3d-62418965a4d6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1515 microversion: 2.1 time: 0.242578 Nov 27 20:53:16.222567 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1290/2483] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:15 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:16.379816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:16.384124 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:16.384124 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:16.385141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:16.385801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Searching by: {'deleted': False, 'project_id': '3452ada55fe043918a4bf028d75b070d'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:53:16.401233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.401691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.402537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.402985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.437997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:53:16.460197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:16.469088 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f200b69d-a92d-43db-8e5e-4418242ba075 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.333312 Nov 27 20:53:16.471471 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1194/2484] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:16 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:16.473550 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1e27b4a1-b6c3-49a2-9c5e-7beaac5196ea tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.097258 Nov 27 20:53:16.480021 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1291/2485] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:53:16 2021] GET /compute/v2.1/servers => generated 334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:53:16.487157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:16.491403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:16.493903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:16.500057 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:16.500057 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:16.501556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:16.502841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Searching by: {'deleted': False, 'project_id': '3452ada55fe043918a4bf028d75b070d'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:53:16.507860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.509029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.509486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.510404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.510896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.511169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.512249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.518663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.540845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:53:16.588932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:16.611100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.611879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.730584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de6e0419e7843089302fa399e9e56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57434a24104e95bcff0d4cabbd1419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:16.746745 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-93a60880-df50-4cc5-a608-2c0c47142c6f tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 200 len: 1511 microversion: 2.1 time: 0.265609 Nov 27 20:53:16.748930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1195/2486] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:16 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:16.804774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:16.805442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:16.811990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.813920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.816132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.816670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.903462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e1781df-0526-49e5-b245-e72b22ad62a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.421960 Nov 27 20:53:16.916675 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1292/2487] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:53:16 2021] GET /compute/v2.1/servers/detail => generated 1699 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:16.926410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:16.927189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:16.937298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.937760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:16.938835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:16.939041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.074608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:17.087176 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46283c2b-4ab7-4ba7-9435-57dc8a4ea8f0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.286798 Nov 27 20:53:17.088601 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1196/2488] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:16 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:17.109450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd8e0298-ef6f-4ab0-b9dc-961c8141a9c9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:17.129032 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd8e0298-ef6f-4ab0-b9dc-961c8141a9c9 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028644 Nov 27 20:53:17.143822 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1197/2489] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:53:17 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:17.168407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f16ef04-925d-42e6-8cd4-bcbf7d0212d0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7378d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:17.258311 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f16ef04-925d-42e6-8cd4-bcbf7d0212d0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.109145 Nov 27 20:53:17.259325 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1198/2490] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:17 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:17.274531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9fb71bdd-d8b0-41b9-a45d-2250c8f978f7 req-297da529-734e-462e-9c70-9cd6dd42774b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc4635e-f9e3-4806-a40e-3afc332181d9", "name": "network-vif-deleted", "tag": "6d0e6730-2f05-484e-bb6e-5092209740ea"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:17.277998 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:17.277998 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:17.296913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9fb71bdd-d8b0-41b9-a45d-2250c8f978f7 req-297da529-734e-462e-9c70-9cd6dd42774b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.299740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9fb71bdd-d8b0-41b9-a45d-2250c8f978f7 req-297da529-734e-462e-9c70-9cd6dd42774b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.316307 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9fb71bdd-d8b0-41b9-a45d-2250c8f978f7 req-297da529-734e-462e-9c70-9cd6dd42774b service nova] Creating event network-vif-deleted:6d0e6730-2f05-484e-bb6e-5092209740ea for instance 8cc4635e-f9e3-4806-a40e-3afc332181d9 on nch1-master-1 Nov 27 20:53:17.323723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9fb71bdd-d8b0-41b9-a45d-2250c8f978f7 req-297da529-734e-462e-9c70-9cd6dd42774b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062675 Nov 27 20:53:17.324849 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1199/2491] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:17.331199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:17.335826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:17.337641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:17.347042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.347583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.348395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.348830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.357477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4752f089-bfaa-42c2-bad3-9c199ed56c39 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 0.439978 Nov 27 20:53:17.369797 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1293/2492] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:16 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:17.375366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f6867d08-9299-447d-8f20-903b5a8f675a req-2c129bd8-78ca-4ae4-8079-86190b8a1c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be1b680-176c-4763-a0b2-3e8c7e18d91e", "name": "network-vif-plugged", "status": "completed", "tag": "82ae9ef3-d9a1-4c1b-9556-dd503129f6ca"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:17.378033 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:17.378033 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:17.387528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f6867d08-9299-447d-8f20-903b5a8f675a req-2c129bd8-78ca-4ae4-8079-86190b8a1c59 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.389773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f6867d08-9299-447d-8f20-903b5a8f675a req-2c129bd8-78ca-4ae4-8079-86190b8a1c59 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.410180 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f6867d08-9299-447d-8f20-903b5a8f675a req-2c129bd8-78ca-4ae4-8079-86190b8a1c59 service nova] Creating event network-vif-plugged:82ae9ef3-d9a1-4c1b-9556-dd503129f6ca for instance 4be1b680-176c-4763-a0b2-3e8c7e18d91e on nch2-master-1 Nov 27 20:53:17.417571 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f6867d08-9299-447d-8f20-903b5a8f675a req-2c129bd8-78ca-4ae4-8079-86190b8a1c59 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045833 Nov 27 20:53:17.418599 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1294/2493] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:17.483661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:17.485139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:17.497394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.500004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.501474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.502113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.539041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:53:17.659536 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d7d1924d-7314-432d-990c-273714fd19a7 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 204 len: 0 microversion: 2.1 time: 0.181209 Nov 27 20:53:17.661941 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1295/2494] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:17 2021] DELETE /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:17.670103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:17.671646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:17.678408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.679171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.680214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.680912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.818911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:17.826501 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5309fa13-337a-4ee8-9b7d-c6f1242e7c10 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1521 microversion: 2.1 time: 0.500243 Nov 27 20:53:17.831386 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1200/2495] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:17 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:17.836228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:17.836872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:17.845378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.846083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.848269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.848832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.941324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:17.950348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81db1fb3-f962-44f3-815e-9fc662e5ac8e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.285710 Nov 27 20:53:17.956255 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1296/2496] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:17 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:17.962203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:17.962985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] [instance: 8cc4635e-f9e3-4806-a40e-3afc332181d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:17.982736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.982736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:17.987292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:17.987906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.024407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] HTTP exception thrown: Instance 8cc4635e-f9e3-4806-a40e-3afc332181d9 could not be found. Nov 27 20:53:18.025001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] Returning 404 to user: Instance 8cc4635e-f9e3-4806-a40e-3afc332181d9 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:18.025837 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-775eec8e-c1d5-4cb7-9c3e-226f70d734a8 tempest-VolumesAdminNegativeTest-1676413609 tempest-VolumesAdminNegativeTest-1676413609-project] 10.222.0.21 "GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9" status: 404 len: 111 microversion: 2.1 time: 0.068247 Nov 27 20:53:18.028734 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1297/2497] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:17 2021] GET /compute/v2.1/servers/8cc4635e-f9e3-4806-a40e-3afc332181d9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:18.115137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:18.116807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:18.128168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.133160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.134106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.137042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.185451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:18.200717 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-292e818a-def9-4d12-8aee-563b905eaadd tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1702 microversion: 2.1 time: 0.367897 Nov 27 20:53:18.201636 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1201/2498] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:17 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1702 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:18.276050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08b001fd-f60b-450e-b51a-9ceb285861c4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d95225e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:18.365362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-08b001fd-f60b-450e-b51a-9ceb285861c4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.096994 Nov 27 20:53:18.365975 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1202/2499] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:18 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:18.375686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:18.376337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:18.393161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.393626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.394430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.394871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.545729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:18.555285 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a99b09a-8e53-4074-a5ed-459a3cdbe449 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.445384 Nov 27 20:53:18.570490 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1298/2500] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:18 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:18.843644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:18.845497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:18.857970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.858859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:18.862953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.866509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de3c69af-f21b-4f8e-b5ca-007da0196486 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1316 microversion: 2.1 time: 0.494847 Nov 27 20:53:18.867067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.867211 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1203/2501] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:18 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:18.868261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.969546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:18.970160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:18.978054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.978503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:18.979310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:18.979750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:19.179545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:19.189315 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd641dc4-4faf-4e3e-b637-1e89d2e17b39 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1521 microversion: 2.1 time: 0.348649 Nov 27 20:53:19.190433 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1299/2502] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:18 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:19.218444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:19.219039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:19.230471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:19.230919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:19.231745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:19.232431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:19.297804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:19.308355 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1051c99a-3762-49b5-889f-b529bde843a2 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.342529 Nov 27 20:53:19.311296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1204/2503] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:18 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:19.378292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cbcba71c-36a4-4b97-b297-92bfb7f6538a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d9494940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:19.431482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:19.449269 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6bcec3f3-4215-4846-8d4c-8766c120b71e tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1702 microversion: 2.1 time: 0.235195 Nov 27 20:53:19.454107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1300/2504] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:19 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1702 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:19.466227 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cbcba71c-36a4-4b97-b297-92bfb7f6538a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1411 microversion: 2.1 time: 0.092131 Nov 27 20:53:19.467065 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1205/2505] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:19 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:19.612526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:19.625740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:19.668510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:19.673605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:19.676095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:19.679987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:19.886723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:19.888950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:19.901381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:19.904026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:19.906918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:19.909885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:20.114747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:20.125842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46bc155c-3ac3-44e6-8d68-c0394e1eb619 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.537131 Nov 27 20:53:20.126973 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1301/2506] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:19 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:20.210166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:20.210758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:20.227480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:20.227935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:20.228733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:20.229170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:20.381816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:20.394468 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-770e4535-ce2b-4f31-a312-f7a176397d79 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1503 microversion: 2.1 time: 0.511499 Nov 27 20:53:20.395051 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1206/2507] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:19 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1503 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:20.404543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:20.412105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:20.420771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:20.450162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:20.451424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:20.452731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:20.642331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:20.654351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6459f417-838e-449b-9300-1e058d279249 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1521 microversion: 2.1 time: 0.447714 Nov 27 20:53:20.654981 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1302/2508] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:20 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:20.667364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1830156601"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:20.678327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:20.704424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:20.706891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:20.708028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:20.710339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:21.211558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.security_group_api [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Adding security group d51088c2-09fd-4bb8-9023-6cf77fd03eec to port 82ae9ef3-d9a1-4c1b-9556-dd503129f6ca Nov 27 20:53:21.322250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:21.330436 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-08000c1f-e7ce-4979-b785-d3386e3363b6 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.930821 Nov 27 20:53:21.342055 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1207/2509] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:20 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:21.360959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:21.364203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:21.396346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:21.397545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:21.401554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:21.402424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:21.858356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd54936ebf874a45800b444b942c6e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3452ada55fe043918a4bf028d75b070d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:21.868326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45deea9b-5079-4f74-8c6c-b31d5eaaeffe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 200 len: 1702 microversion: 2.1 time: 0.524070 Nov 27 20:53:21.876238 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1208/2510] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:21 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 1702 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:21.886748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-82a73e4b-d513-4ee3-90ce-deb4e9f689b1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94d83a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:21.955723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-82a73e4b-d513-4ee3-90ce-deb4e9f689b1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1420 microversion: 2.1 time: 0.077948 Nov 27 20:53:21.956409 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1209/2511] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:21 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:21.968759 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cadd0968-3d81-4895-af0e-8837506a7f1d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e/action" status: 202 len: 0 microversion: 2.1 time: 1.312605 Nov 27 20:53:21.971580 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1303/2512] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:20 2021] POST /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e/action => generated 0 bytes in 1316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:21.976581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:21.977760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:21.981700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7767ed8f-a3da-497d-a937-6ddac4671717 req-163ff804-ec15-474e-970c-d323e05a3157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56059f02-0c55-46c4-9744-8b4536f99ff3", "name": "network-vif-plugged", "status": "completed", "tag": "07fe1e64-102d-4c40-8233-cc2f4399f06f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:21.983496 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:21.983496 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:21.990964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:21.999842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.001694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.005282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.018365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7767ed8f-a3da-497d-a937-6ddac4671717 req-163ff804-ec15-474e-970c-d323e05a3157 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.018828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7767ed8f-a3da-497d-a937-6ddac4671717 req-163ff804-ec15-474e-970c-d323e05a3157 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.047767 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7767ed8f-a3da-497d-a937-6ddac4671717 req-163ff804-ec15-474e-970c-d323e05a3157 service nova] Creating event network-vif-plugged:07fe1e64-102d-4c40-8233-cc2f4399f06f for instance 56059f02-0c55-46c4-9744-8b4536f99ff3 on nch1-master-1 Nov 27 20:53:22.056165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7767ed8f-a3da-497d-a937-6ddac4671717 req-163ff804-ec15-474e-970c-d323e05a3157 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094305 Nov 27 20:53:22.060632 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1210/2513] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:22.074805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:22.075655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:22.089771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.090310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.091370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.092163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.437932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:22.448900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f077c52a-1260-4e3c-bca8-9de9a7dae481 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.475880 Nov 27 20:53:22.451077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1304/2514] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:21 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:22.465290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9133ef87-33db-45b1-9759-b369d8d8f3e6 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7b58a60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:22.553803 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9133ef87-33db-45b1-9759-b369d8d8f3e6 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 200 len: 1420 microversion: 2.1 time: 0.100944 Nov 27 20:53:22.567524 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1305/2515] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:22 2021] GET /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:22.579100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-574700247"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:22.579702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:22.602086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.602471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.603308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.603946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.646385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:22.662363 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c89a8710-9002-4006-b34b-9c44c07a0df4 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1521 microversion: 2.1 time: 0.599562 Nov 27 20:53:22.668767 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1211/2516] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:22 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:22.677463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-536c22eb-33d2-4bb3-93e4-dfa7e6045836 req-a58a0c52-86f2-4256-9be4-de70d9fdecc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be1b680-176c-4763-a0b2-3e8c7e18d91e", "tag": "82ae9ef3-d9a1-4c1b-9556-dd503129f6ca"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:22.680775 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:22.680775 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:22.699933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-536c22eb-33d2-4bb3-93e4-dfa7e6045836 req-a58a0c52-86f2-4256-9be4-de70d9fdecc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.709662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-536c22eb-33d2-4bb3-93e4-dfa7e6045836 req-a58a0c52-86f2-4256-9be4-de70d9fdecc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.749450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-536c22eb-33d2-4bb3-93e4-dfa7e6045836 req-a58a0c52-86f2-4256-9be4-de70d9fdecc7 service nova] Creating event network-changed:82ae9ef3-d9a1-4c1b-9556-dd503129f6ca for instance 4be1b680-176c-4763-a0b2-3e8c7e18d91e on nch2-master-1 Nov 27 20:53:22.764992 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-536c22eb-33d2-4bb3-93e4-dfa7e6045836 req-a58a0c52-86f2-4256-9be4-de70d9fdecc7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094438 Nov 27 20:53:22.768601 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1212/2517] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:22.786711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:22.788052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:22.796653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.797661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:22.798839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:22.799497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:23.005866 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.security_group_api [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Adding security group d3d4501e-ad00-41f7-a9ea-7a077cdc7b84 to port 82ae9ef3-d9a1-4c1b-9556-dd503129f6ca Nov 27 20:53:23.153763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:23.168725 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f18fb34b-8cca-4c27-b577-48f437e3f06c tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1324 microversion: 2.1 time: 0.397003 Nov 27 20:53:23.169009 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1213/2518] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:22 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1324 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:23.178062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-592bff8b-3e3d-438f-83d2-30fad1e2c2df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c7246820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:24.177154 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-592bff8b-3e3d-438f-83d2-30fad1e2c2df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 204 len: 0 microversion: 2.1 time: 1.006942 Nov 27 20:53:24.178140 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1214/2519] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:23 2021] DELETE /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:24.183311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:24.184134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] [instance: b99c91ae-1196-4fdf-af86-c9c0c7a47bb2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:24.195830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.196659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.197701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.198379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.220703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] HTTP exception thrown: Instance b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 could not be found. Nov 27 20:53:24.221647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Returning 404 to user: Instance b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:24.223386 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98305e2c-a685-4a99-bae5-15568a33fafe tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2" status: 404 len: 111 microversion: 2.1 time: 0.043492 Nov 27 20:53:24.224421 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1215/2520] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:24 2021] GET /compute/v2.1/servers/b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:24.231939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-900d1eee-0b0c-4eeb-b01b-d9b1a21f9b84 req-ddcf83a3-6042-4cb3-8311-c1885d3b54d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99c91ae-1196-4fdf-af86-c9c0c7a47bb2", "name": "network-vif-deleted", "tag": "69669768-ef11-486a-bf97-be4dc7401b97"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:24.235309 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:24.235309 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:24.247026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-900d1eee-0b0c-4eeb-b01b-d9b1a21f9b84 req-ddcf83a3-6042-4cb3-8311-c1885d3b54d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.248348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-900d1eee-0b0c-4eeb-b01b-d9b1a21f9b84 req-ddcf83a3-6042-4cb3-8311-c1885d3b54d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.268701 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-900d1eee-0b0c-4eeb-b01b-d9b1a21f9b84 req-ddcf83a3-6042-4cb3-8311-c1885d3b54d2 service nova] Creating event network-vif-deleted:69669768-ef11-486a-bf97-be4dc7401b97 for instance b99c91ae-1196-4fdf-af86-c9c0c7a47bb2 on nch2-master-1 Nov 27 20:53:24.274314 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-900d1eee-0b0c-4eeb-b01b-d9b1a21f9b84 req-ddcf83a3-6042-4cb3-8311-c1885d3b54d2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047997 Nov 27 20:53:24.276030 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1216/2521] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:24.283595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:24.284576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:24.292620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.293697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.294735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.296534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.478636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:24.488309 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c211111-5d36-4866-918b-c6ef08294bb0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.210561 Nov 27 20:53:24.489204 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1217/2522] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:24 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:24.503180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:24.503861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:24.510630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.511121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.511990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.512433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.678363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:24.689298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-239e3771-8653-4f32-b68e-7ee51499195e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1521 microversion: 2.1 time: 0.186385 Nov 27 20:53:24.690122 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1218/2523] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:24 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:24.696238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:24.696621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:24.704330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.705182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.706682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.707547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.755763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:53:24.772361 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7982eada-fa1a-4a3a-8faa-4d03647700a1 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e/action" status: 202 len: 0 microversion: 2.1 time: 2.203649 Nov 27 20:53:24.775835 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1306/2524] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:22 2021] POST /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e/action => generated 0 bytes in 2205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:24.778396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:24.779147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:24.795844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.796307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.797116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.797559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:24.915616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-460571d0-0cd4-4a6c-ab59-9370d52d61ad tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 204 len: 0 microversion: 2.1 time: 0.223366 Nov 27 20:53:24.918877 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1219/2525] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:24 2021] DELETE /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:24.929208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce0083a6-97c9-42fb-a671-306aec085a74 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] Calling method '.version_select at 0x7f15c7cde160>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:24.959109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce0083a6-97c9-42fb-a671-306aec085a74 tempest-ServersTestJSON-1762231565 tempest-ServersTestJSON-1762231565-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545153221" status: 202 len: 0 microversion: 2.1 time: 0.038221 Nov 27 20:53:24.963914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1220/2526] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 20:53:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545153221 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:24.969325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9b2b27f6-3b90-4926-ba20-985f7edbfbad req-5630f229-b6e1-440a-b891-3785bd3e175c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbf72fc-e72f-4963-8664-b1b1260f8f89", "name": "network-vif-plugged", "status": "completed", "tag": "1597305a-cd19-4e32-92a0-39078f81c889"}, {"server_uuid": "cc5ef299-0115-4cd2-b728-afcd425f78b5", "name": "network-vif-unplugged", "status": "completed", "tag": "91c15e78-d85f-42e5-90f2-bd938828b809"}, {"server_uuid": "6af66675-b153-4617-ad21-c79c87e4eac2", "name": "network-vif-plugged", "status": "completed", "tag": "b27a9306-471b-4b83-91e0-219d06b5219f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:24.971832 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:24.971832 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:24.982543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9b2b27f6-3b90-4926-ba20-985f7edbfbad req-5630f229-b6e1-440a-b891-3785bd3e175c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:24.983098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9b2b27f6-3b90-4926-ba20-985f7edbfbad req-5630f229-b6e1-440a-b891-3785bd3e175c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:25.010027 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9b2b27f6-3b90-4926-ba20-985f7edbfbad req-5630f229-b6e1-440a-b891-3785bd3e175c service nova] Creating event network-vif-plugged:1597305a-cd19-4e32-92a0-39078f81c889 for instance acbf72fc-e72f-4963-8664-b1b1260f8f89 on nch1-master-1 Nov 27 20:53:25.011018 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9b2b27f6-3b90-4926-ba20-985f7edbfbad req-5630f229-b6e1-440a-b891-3785bd3e175c service nova] Creating event network-vif-unplugged:91c15e78-d85f-42e5-90f2-bd938828b809 for instance cc5ef299-0115-4cd2-b728-afcd425f78b5 on nch2-master-1 Nov 27 20:53:25.011690 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9b2b27f6-3b90-4926-ba20-985f7edbfbad req-5630f229-b6e1-440a-b891-3785bd3e175c service nova] Creating event network-vif-plugged:b27a9306-471b-4b83-91e0-219d06b5219f for instance 6af66675-b153-4617-ad21-c79c87e4eac2 on nch1-master-1 Nov 27 20:53:25.024515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9b2b27f6-3b90-4926-ba20-985f7edbfbad req-5630f229-b6e1-440a-b891-3785bd3e175c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.058843 Nov 27 20:53:25.025722 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1221/2527] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:24 2021] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:25.032307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-93991b0f-9de0-4bd3-9fd1-eb8c2497d2ec tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:25.033316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-93991b0f-9de0-4bd3-9fd1-eb8c2497d2ec tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:25.046860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93991b0f-9de0-4bd3-9fd1-eb8c2497d2ec tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:25.047875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93991b0f-9de0-4bd3-9fd1-eb8c2497d2ec tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:25.048526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93991b0f-9de0-4bd3-9fd1-eb8c2497d2ec tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:25.049078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93991b0f-9de0-4bd3-9fd1-eb8c2497d2ec tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:25.297741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:25.330734 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ea19ac3-da56-4b1f-985d-6363a4521034 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1522 microversion: 2.1 time: 0.555965 Nov 27 20:53:25.332437 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1307/2528] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:24 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:25.341843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d7c7a794-e5b3-440c-b2fd-05d842b2172c req-b398eb86-ce40-4e0f-bde2-bfc8a8551397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be1b680-176c-4763-a0b2-3e8c7e18d91e", "tag": "82ae9ef3-d9a1-4c1b-9556-dd503129f6ca"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:25.356368 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:25.356368 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:25.374953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d7c7a794-e5b3-440c-b2fd-05d842b2172c req-b398eb86-ce40-4e0f-bde2-bfc8a8551397 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:25.375433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d7c7a794-e5b3-440c-b2fd-05d842b2172c req-b398eb86-ce40-4e0f-bde2-bfc8a8551397 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:25.406842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d7c7a794-e5b3-440c-b2fd-05d842b2172c req-b398eb86-ce40-4e0f-bde2-bfc8a8551397 service nova] Creating event network-changed:82ae9ef3-d9a1-4c1b-9556-dd503129f6ca for instance 4be1b680-176c-4763-a0b2-3e8c7e18d91e on nch2-master-1 Nov 27 20:53:25.426362 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d7c7a794-e5b3-440c-b2fd-05d842b2172c req-b398eb86-ce40-4e0f-bde2-bfc8a8551397 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092520 Nov 27 20:53:25.428217 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1308/2529] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:25.442089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2108289847", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:25.534859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] validate_networks() for [('b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:25.640289 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-93991b0f-9de0-4bd3-9fd1-eb8c2497d2ec tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.612753 Nov 27 20:53:25.650376 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1222/2530] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:53:25 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e/os-security-groups => generated 1157 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:25.656555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:25.657060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:25.664489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:25.664939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:25.665726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:25.666304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:25.695616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:53:25.809901 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf23e37a-442c-46c1-8553-57efb9112df7 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 204 len: 0 microversion: 2.1 time: 0.157574 Nov 27 20:53:25.811367 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1223/2531] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:25 2021] DELETE /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:25.816522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:25.817230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:25.823466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:25.823926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:25.824801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:25.825253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:26.063049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:26.101226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b7d5ff1-3903-4236-8489-c1af6919bf4b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1318 microversion: 2.1 time: 0.282327 Nov 27 20:53:26.118215 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1224/2532] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:25 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:26.130403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6713caba-f6bf-4a97-82e8-841dfadaa5f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15c7df2dc0>, body: {"security_group": {"name": " tempest-securitygroup -1792902192 ", "description": "tempest-description-2074187850"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:26.577197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:26.577759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:26.578231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:26.578711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:26.579576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:26.596289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:26.597112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:26.598187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:26.599496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:26.625617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:26.633609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for user b8a8aa467b0a42459f18f6bd4ee623e4 and project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:26.654814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:26.659832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:26.787999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-36676edd-3ba5-4a8a-9c2a-b4fb293c015d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.354159 Nov 27 20:53:26.798627 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1309/2533] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:26.830378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:26.831012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:26.856694 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6713caba-f6bf-4a97-82e8-841dfadaa5f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.738479 Nov 27 20:53:26.857626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1225/2534] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:26 2021] POST /compute/v2.1/os-security-groups => generated 224 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:26.866754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:26.867538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:26.874356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:26.879845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:26.880826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:26.881048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:26.881467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:26.881613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:26.882307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:26.886973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:27.183566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:27.193386 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02f0dc7e-2413-4758-9cb3-065022daf73d tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1528 microversion: 2.1 time: 0.334579 Nov 27 20:53:27.198235 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1226/2535] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:26 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1528 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:27.212025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c621fd81-2e10-4f5b-b454-a0fcaef1aba7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:27.212786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c621fd81-2e10-4f5b-b454-a0fcaef1aba7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:27.426107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c621fd81-2e10-4f5b-b454-a0fcaef1aba7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:27.454079 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c621fd81-2e10-4f5b-b454-a0fcaef1aba7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1208 microversion: 2.1 time: 0.254494 Nov 27 20:53:27.457410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1227/2536] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:27 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1208 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:27.473158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e4d7052b-39d0-4325-abb3-72245ed712b5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d94945e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:27.651299 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e4d7052b-39d0-4325-abb3-72245ed712b5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1" status: 200 len: 224 microversion: 2.1 time: 0.185761 Nov 27 20:53:27.651917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1228/2537] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:53:27 2021] GET /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1 => generated 224 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:27.664132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:27.665037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:27.673331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:27.674170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:27.675165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:27.676560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:27.768582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:27.779026 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6cc15891-293f-473a-9de8-64dceed38914 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1521 microversion: 2.1 time: 0.977979 Nov 27 20:53:27.779643 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1310/2538] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:26 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1521 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:27.784852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3af38e4a-43f1-4469-a2f2-64fc344897e5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7416b80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:27.853596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3af38e4a-43f1-4469-a2f2-64fc344897e5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/31d59e6d-691b-4a65-bf6f-2861de9545e2" status: 200 len: 662 microversion: 2.1 time: 0.072165 Nov 27 20:53:27.854165 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1311/2539] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:27 2021] GET /compute/v2.1/images/31d59e6d-691b-4a65-bf6f-2861de9545e2 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:27.867815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90537910-4542-4303-9ceb-888f3adbaf92 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c734c700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:28.038613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:28.056214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49c5fbab-17c4-4f32-b886-a69cba0c6d10 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1508 microversion: 2.1 time: 0.395952 Nov 27 20:53:28.056716 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1229/2540] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:27 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1508 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:28.061363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30a9d873-c831-434f-904d-70513cddd29d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7c7e9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:28.112830 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30a9d873-c831-434f-904d-70513cddd29d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/31d59e6d-691b-4a65-bf6f-2861de9545e2" status: 200 len: 662 microversion: 2.1 time: 0.054931 Nov 27 20:53:28.115299 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1230/2541] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:28 2021] GET /compute/v2.1/images/31d59e6d-691b-4a65-bf6f-2861de9545e2 => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:28.216939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:28.217639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:28.238432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:28.239422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:28.250668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:28.252050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:28.874629 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-90537910-4542-4303-9ceb-888f3adbaf92 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1" status: 202 len: 0 microversion: 2.1 time: 1.010451 Nov 27 20:53:28.876758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1312/2542] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:53:27 2021] DELETE /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1 => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:28.886665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:28.887474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:28.905677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:28.907886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:28.909296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:28.911935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:29.097535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4143c311f90d4b6bbae7b8eddcbef26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483860ef169447208569ca7510affe41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:29.106814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:29.122282 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4f3d2e85-cda1-4029-87f3-9306b8c93d5b tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 200 len: 1528 microversion: 2.1 time: 0.910275 Nov 27 20:53:29.133585 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1231/2543] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:28 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 1528 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:29.135335 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b8c6bb2-9b15-42e7-ba28-76f63ffdd374 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1266 microversion: 2.1 time: 0.255314 Nov 27 20:53:29.146365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:29.149081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:29.158538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1313/2544] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:28 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:29.161697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:29.164596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d20f699-66bd-4866-85f4-a684c4eeedf2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c7439670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:29.166654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:29.167875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:29.168829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:29.276999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-0d20f699-66bd-4866-85f4-a684c4eeedf2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ed005e21-fa12-4398-855c-906f54804dc1 does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:53:29.277946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-0d20f699-66bd-4866-85f4-a684c4eeedf2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group ed005e21-fa12-4398-855c-906f54804dc1 not found {{(pid=135680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:53:29.278830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0d20f699-66bd-4866-85f4-a684c4eeedf2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group ed005e21-fa12-4398-855c-906f54804dc1 does not exist Nov 27 20:53:29.278830 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-d0c804a4-ecdc-4287-b5e7-263d2f097c4a'] Nov 27 20:53:29.279915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d20f699-66bd-4866-85f4-a684c4eeedf2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group ed005e21-fa12-4398-855c-906f54804dc1 does not exist Nov 27 20:53:29.279915 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-d0c804a4-ecdc-4287-b5e7-263d2f097c4a'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:29.282123 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d20f699-66bd-4866-85f4-a684c4eeedf2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1" status: 404 len: 194 microversion: 2.1 time: 0.122095 Nov 27 20:53:29.283301 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1314/2545] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:53:29 2021] GET /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:29.301068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5c7966d3-5965-4b0d-82b0-0866e9a0c5c0 req-9196e738-87e9-4816-baa9-6c560ac9d7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56059f02-0c55-46c4-9744-8b4536f99ff3", "name": "network-vif-deleted", "tag": "07fe1e64-102d-4c40-8233-cc2f4399f06f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:29.305367 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:29.305367 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:29.338077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5c7966d3-5965-4b0d-82b0-0866e9a0c5c0 req-9196e738-87e9-4816-baa9-6c560ac9d7e6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:29.338724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5c7966d3-5965-4b0d-82b0-0866e9a0c5c0 req-9196e738-87e9-4816-baa9-6c560ac9d7e6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:29.359411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5c7966d3-5965-4b0d-82b0-0866e9a0c5c0 req-9196e738-87e9-4816-baa9-6c560ac9d7e6 service nova] Creating event network-vif-deleted:07fe1e64-102d-4c40-8233-cc2f4399f06f for instance 56059f02-0c55-46c4-9744-8b4536f99ff3 on nch1-master-1 Nov 27 20:53:29.367630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5c7966d3-5965-4b0d-82b0-0866e9a0c5c0 req-9196e738-87e9-4816-baa9-6c560ac9d7e6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079329 Nov 27 20:53:29.368518 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1315/2546] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:29.379643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-58ee1ec6-8e75-41a4-811e-bd2f8a9cfe40 req-a0bd3c6e-f41c-430a-9c61-74b615f212a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ef299-0115-4cd2-b728-afcd425f78b5", "name": "network-vif-deleted", "tag": "91c15e78-d85f-42e5-90f2-bd938828b809"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:29.392352 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:29.392352 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:29.400356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-58ee1ec6-8e75-41a4-811e-bd2f8a9cfe40 req-a0bd3c6e-f41c-430a-9c61-74b615f212a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:29.400792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-58ee1ec6-8e75-41a4-811e-bd2f8a9cfe40 req-a0bd3c6e-f41c-430a-9c61-74b615f212a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:29.422598 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-58ee1ec6-8e75-41a4-811e-bd2f8a9cfe40 req-a0bd3c6e-f41c-430a-9c61-74b615f212a1 service nova] Creating event network-vif-deleted:91c15e78-d85f-42e5-90f2-bd938828b809 for instance cc5ef299-0115-4cd2-b728-afcd425f78b5 on nch2-master-1 Nov 27 20:53:29.433637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-58ee1ec6-8e75-41a4-811e-bd2f8a9cfe40 req-a0bd3c6e-f41c-430a-9c61-74b615f212a1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062526 Nov 27 20:53:29.435213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1316/2547] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:29.447991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d58c8d8-9ee4-422f-8668-a5b27ee7365f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15c7559670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1448924831", "description": "tempest-description-1886303458"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:30.020984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d58c8d8-9ee4-422f-8668-a5b27ee7365f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.584433 Nov 27 20:53:30.021901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1317/2548] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:29 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:30.026951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07a82113-660f-405b-98f6-66833fce6ee7 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1d8a7fd-96da-4769-831b-93e5469edd45"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:30.027375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:30.029517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07a82113-660f-405b-98f6-66833fce6ee7 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:30.042164 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e96740f-9e2a-40cd-be52-22f3f12dfbe1 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1506 microversion: 2.1 time: 0.906529 Nov 27 20:53:30.042993 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1232/2549] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:29 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1506 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:30.049297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a82113-660f-405b-98f6-66833fce6ee7 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:30.051396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a82113-660f-405b-98f6-66833fce6ee7 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:30.052930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a82113-660f-405b-98f6-66833fce6ee7 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:30.053543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a82113-660f-405b-98f6-66833fce6ee7 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:30.058616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02e54325-a9dd-40ce-843e-0c6deb427424 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9522dc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:30.110996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02e54325-a9dd-40ce-843e-0c6deb427424 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/7b523a8b-ff1f-4f5e-a7a7-43940bfb0d20" status: 200 len: 661 microversion: 2.1 time: 0.066720 Nov 27 20:53:30.117899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1233/2550] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:30 2021] GET /compute/v2.1/images/7b523a8b-ff1f-4f5e-a7a7-43940bfb0d20 => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:30.117899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66b24a93-f481-4b89-a509-6e873a25bdc3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15c72bb430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-652897848", "description": "tempest-description-2028512787"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:30.498709 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07a82113-660f-405b-98f6-66833fce6ee7 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472620 Nov 27 20:53:30.503709 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1318/2551] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:53:30 2021] POST /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:30.515506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:30.520191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:30.536375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:30.537407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:30.540464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:30.542023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:30.818903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:30.826640 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e3c4538e-94f9-4a1e-b0c9-0827108a6e61 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 200 len: 1506 microversion: 2.1 time: 0.321509 Nov 27 20:53:30.828405 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1319/2552] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:30 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:30.834102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-976b739e-35b1-4840-8c2e-39564cf9ef93 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7ba9f70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:30.912747 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-976b739e-35b1-4840-8c2e-39564cf9ef93 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/7b523a8b-ff1f-4f5e-a7a7-43940bfb0d20" status: 200 len: 661 microversion: 2.1 time: 0.082950 Nov 27 20:53:30.913436 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1320/2553] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:30 2021] GET /compute/v2.1/images/7b523a8b-ff1f-4f5e-a7a7-43940bfb0d20 => generated 661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:30.930097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:30.930734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 56059f02-0c55-46c4-9744-8b4536f99ff3] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:30.946826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:30.947210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:30.948057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:30.949268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:30.972353 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Instance 56059f02-0c55-46c4-9744-8b4536f99ff3 could not be found. Nov 27 20:53:30.973305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Instance 56059f02-0c55-46c4-9744-8b4536f99ff3 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:30.975061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb107a3e-3392-4091-a93a-3b1310b18d9e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3" status: 404 len: 111 microversion: 2.1 time: 0.059566 Nov 27 20:53:30.978236 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1321/2554] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:30 2021] GET /compute/v2.1/servers/56059f02-0c55-46c4-9744-8b4536f99ff3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:30.988071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:30.989189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:31.001269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:31.002315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:31.003640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:31.004810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:31.027985 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66b24a93-f481-4b89-a509-6e873a25bdc3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.914481 Nov 27 20:53:31.028956 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1234/2555] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:30 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:31.038044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:31.039234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:31.063734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:31.066406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:31.068801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:31.071906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:31.135377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:53:31.308505 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d6d7edf-9269-4bc5-b6a6-5db2b546426b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 204 len: 0 microversion: 2.1 time: 0.277808 Nov 27 20:53:31.310187 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1235/2556] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:31 2021] DELETE /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:53:31.357235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1e2c95f-9d8c-4a18-9522-1d911ea63df9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '.version_select at 0x7f15c735eaf0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:31.411031 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d1e2c95f-9d8c-4a18-9522-1d911ea63df9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Image not found. Nov 27 20:53:31.411676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1e2c95f-9d8c-4a18-9522-1d911ea63df9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:31.416323 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1e2c95f-9d8c-4a18-9522-1d911ea63df9 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/images/34e6b483-8ef9-45c0-81ff-5801cfc7b538" status: 404 len: 62 microversion: 2.1 time: 0.068043 Nov 27 20:53:31.418006 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1236/2557] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:31 2021] DELETE /compute/v2.1/images/34e6b483-8ef9-45c0-81ff-5801cfc7b538 => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:53:31.424733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c4f6b70-ef20-4f15-abd7-1f9675257752 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15c72bb790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-95312429", "description": "tempest-description-268814757"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:31.446700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:31.457481 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec701c3b-f7a5-4a09-a5ff-5d83acb2645b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 0.476998 Nov 27 20:53:31.471495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1322/2558] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:30 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:31.482242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:31.482751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:31.493733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:31.494332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:31.495921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:31.496367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:31.532947 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Instance 89360906-579a-4126-bc8d-e3e4cff060e0 could not be found. Nov 27 20:53:31.533466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Instance 89360906-579a-4126-bc8d-e3e4cff060e0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:31.534302 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2212d3da-88f4-40e9-82ec-e1ef6b1ed34f tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 404 len: 111 microversion: 2.1 time: 0.061960 Nov 27 20:53:31.534863 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1323/2559] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:31 2021] DELETE /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:31.542816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-433900170", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "c6502c39-8b47-4e70-ac49-9906b123e7d6"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:31.637724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] validate_networks() for [('c6502c39-8b47-4e70-ac49-9906b123e7d6', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:32.345643 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c4f6b70-ef20-4f15-abd7-1f9675257752 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.924810 Nov 27 20:53:32.346949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1237/2560] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:31 2021] POST /compute/v2.1/os-security-groups => generated 241 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:32.354490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:32.355978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: 89360906-579a-4126-bc8d-e3e4cff060e0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:32.390869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:32.391393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:32.395089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:32.395600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:32.439978 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Instance 89360906-579a-4126-bc8d-e3e4cff060e0 could not be found. Nov 27 20:53:32.440608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Instance 89360906-579a-4126-bc8d-e3e4cff060e0 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:32.441458 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3345213e-a749-4fda-ae45-73a54f065cf3 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0" status: 404 len: 111 microversion: 2.1 time: 0.093449 Nov 27 20:53:32.449625 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1238/2561] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:32 2021] GET /compute/v2.1/servers/89360906-579a-4126-bc8d-e3e4cff060e0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:32.455663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-06a77f4b-d60f-4132-b33e-7c9a88afbfa5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c7c9dca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:32.526728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:32.527237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:32.527654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:32.528090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:32.528495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:32.543882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:32.544738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:32.546702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:32.547550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:32.583321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Getting quotas for project 99a5eb3bc93349828958b7879707829a. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:32.592176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Getting quotas for user 745d99de8bd24185aacbbcf7b2c404c2 and project 99a5eb3bc93349828958b7879707829a. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:32.636850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:32.642494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:32.713418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52e49538-bc04-4ce4-b757-3f8804b738f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174263 Nov 27 20:53:32.714990 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1324/2562] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:32.721650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eabc4b73-0eeb-4a39-a761-f9f191b341cf tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '.version_select at 0x7f15c7414b80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:32.768765 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eabc4b73-0eeb-4a39-a761-f9f191b341cf tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452547011" status: 202 len: 0 microversion: 2.1 time: 0.052196 Nov 27 20:53:32.770134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1325/2563] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:53:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452547011 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:32.776935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de36505a-b796-4b50-9c3a-49ca798ff58f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7439670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:32.848570 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de36505a-b796-4b50-9c3a-49ca798ff58f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/20c659a5-a89c-4221-a1ed-bb8ffe0d42b0" status: 200 len: 661 microversion: 2.1 time: 0.076348 Nov 27 20:53:32.850788 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1326/2564] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:32 2021] GET /compute/v2.1/images/20c659a5-a89c-4221-a1ed-bb8ffe0d42b0 => generated 661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:32.870436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:32.871362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:32.882358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:32.883234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:32.884559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:32.885480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:33.223997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:33.239267 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5783943a-c61f-438a-97e6-c29f9b3c0960 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 0.385215 Nov 27 20:53:33.241055 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1327/2565] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:32 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:33.248797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e3ca181-f356-4921-be0d-3c0f3f530fda tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:33.254900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1e3ca181-f356-4921-be0d-3c0f3f530fda tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:33.410941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1e3ca181-f356-4921-be0d-3c0f3f530fda tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:33.418454 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1e3ca181-f356-4921-be0d-3c0f3f530fda tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1217 microversion: 2.1 time: 0.175481 Nov 27 20:53:33.431010 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1328/2566] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:33 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:33.442309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6cf78da0-8efd-4397-b291-c973c7625223 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c739f5e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:33.512529 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6cf78da0-8efd-4397-b291-c973c7625223 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/20c659a5-a89c-4221-a1ed-bb8ffe0d42b0" status: 200 len: 661 microversion: 2.1 time: 0.080304 Nov 27 20:53:33.520119 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1329/2567] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:33 2021] GET /compute/v2.1/images/20c659a5-a89c-4221-a1ed-bb8ffe0d42b0 => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:33.658106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1783147785", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:33.717085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:33.840775 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-06a77f4b-d60f-4132-b33e-7c9a88afbfa5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 1.389831 Nov 27 20:53:33.842291 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1239/2568] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:53:32 2021] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:33.854031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd78f6ee-ffa3-42e2-8a38-44257b7a082b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d94d84c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:34.361154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:34.361969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:34.362451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:34.363196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:34.364484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:34.375473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.376262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.377418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.378218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.402264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Getting quotas for project 65a608f2c265434999aa734f1841b2a3. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:34.413839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Getting quotas for user 5206ef55b9694b4faa3ef71d001d94d4 and project 65a608f2c265434999aa734f1841b2a3. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:34.429429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:34.432476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:34.513286 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-039f2114-bfc7-4298-8f4d-edb70925f04a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859448 Nov 27 20:53:34.523674 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1330/2569] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:34.530841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-868f7cfd-e0d5-4d15-bdfe-3458da843d72 req-a3044ff8-b1c7-4aa0-adad-950fa14431e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f4e797-745d-4e1d-89ff-105b05e550c0", "tag": "dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:34.532665 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:34.532665 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:34.540615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-868f7cfd-e0d5-4d15-bdfe-3458da843d72 req-a3044ff8-b1c7-4aa0-adad-950fa14431e2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.541679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-868f7cfd-e0d5-4d15-bdfe-3458da843d72 req-a3044ff8-b1c7-4aa0-adad-950fa14431e2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.567270 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-868f7cfd-e0d5-4d15-bdfe-3458da843d72 req-a3044ff8-b1c7-4aa0-adad-950fa14431e2 service nova] Creating event network-changed:dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef for instance f7f4e797-745d-4e1d-89ff-105b05e550c0 on nch2-master-1 Nov 27 20:53:34.574498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-868f7cfd-e0d5-4d15-bdfe-3458da843d72 req-a3044ff8-b1c7-4aa0-adad-950fa14431e2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049305 Nov 27 20:53:34.575206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1331/2570] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:34.582573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1d8a7fd-96da-4769-831b-93e5469edd45"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:34.584119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:34.591052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.591738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.593345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.593889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.747350 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] HTTP exception thrown: Invalid volume: volume c1d8a7fd-96da-4769-831b-93e5469edd45 is already attached to instances: acbf72fc-e72f-4963-8664-b1b1260f8f89 Nov 27 20:53:34.747971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Returning 400 to user: Invalid volume: volume c1d8a7fd-96da-4769-831b-93e5469edd45 is already attached to instances: acbf72fc-e72f-4963-8664-b1b1260f8f89 {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:34.748833 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-175eca7a-a8b5-428e-aebe-a8a3fe48dd0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.172399 Nov 27 20:53:34.749412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1332/2571] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:53:34 2021] POST /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments => generated 174 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:53:34.760604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:34.761226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:34.773482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.773482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.774491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.774651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.903984 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd78f6ee-ffa3-42e2-8a38-44257b7a082b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/c0d4bd04-c9dd-4a01-b736-42dedf89aae5" status: 202 len: 0 microversion: 2.1 time: 1.053739 Nov 27 20:53:34.906000 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1240/2572] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:53:33 2021] DELETE /compute/v2.1/os-security-groups/c0d4bd04-c9dd-4a01-b736-42dedf89aae5 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:53:34.913568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:34.914192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:34.933473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.934291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:34.935191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:34.935813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:35.118587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:35.130247 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c9d0754-f523-4c07-9680-5c8aaa123d0f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 0.377745 Nov 27 20:53:35.144878 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1333/2573] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:34 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:35.147115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-389591362", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:35.190152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:35.202696 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5a587c61-cc23-470b-985b-7241bb6ef354 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1275 microversion: 2.1 time: 0.294608 Nov 27 20:53:35.203358 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1241/2574] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:34 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:35.215212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d4f5a4d5-4a23-4b57-98b1-fa21437457e7 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d9494d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:35.229131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:35.338684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-d4f5a4d5-4a23-4b57-98b1-fa21437457e7 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:53:35.339423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-d4f5a4d5-4a23-4b57-98b1-fa21437457e7 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:53:35.340245 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d4f5a4d5-4a23-4b57-98b1-fa21437457e7 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 does not exist Nov 27 20:53:35.340245 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-d28b6c23-1f6b-4d78-ba42-aa4438925900'] Nov 27 20:53:35.341014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d4f5a4d5-4a23-4b57-98b1-fa21437457e7 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 does not exist Nov 27 20:53:35.341014 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-d28b6c23-1f6b-4d78-ba42-aa4438925900'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:35.342116 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d4f5a4d5-4a23-4b57-98b1-fa21437457e7 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/c0d4bd04-c9dd-4a01-b736-42dedf89aae5" status: 404 len: 194 microversion: 2.1 time: 0.137847 Nov 27 20:53:35.343821 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1242/2575] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:53:35 2021] GET /compute/v2.1/os-security-groups/c0d4bd04-c9dd-4a01-b736-42dedf89aae5 => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:35.348704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf5b9a88-5967-4f5c-9689-09dbedef0820 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '.version_select at 0x7f15c727a820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:35.390483 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-cf5b9a88-5967-4f5c-9689-09dbedef0820 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Image not found. Nov 27 20:53:35.393123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf5b9a88-5967-4f5c-9689-09dbedef0820 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:35.394247 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf5b9a88-5967-4f5c-9689-09dbedef0820 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/images/6a01dee4-c158-4553-a845-edf875ba757b" status: 404 len: 62 microversion: 2.1 time: 0.049459 Nov 27 20:53:35.398038 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1243/2576] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:35 2021] DELETE /compute/v2.1/images/6a01dee4-c158-4553-a845-edf875ba757b => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:53:35.411417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:35.414656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:35.426909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:35.428518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:35.433369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:35.434133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:35.564088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lazy-loading 'services' on Instance uuid acbf72fc-e72f-4963-8664-b1b1260f8f89 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:53:35.684758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:35.686008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:35.687690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:35.688503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:35.689425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:35.731455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:35.732307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:35.734382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:35.736115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:35.753407 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2bf710fe-3f0b-44a4-876a-e96924d32e19 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "DELETE /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments/c1d8a7fd-96da-4769-831b-93e5469edd45" status: 202 len: 0 microversion: 2.1 time: 0.350410 Nov 27 20:53:35.764858 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1244/2577] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 20:53:35 2021] DELETE /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments/c1d8a7fd-96da-4769-831b-93e5469edd45 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:35.778992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8ac34fa-e509-4246-bc14-34809266faff tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c72af160>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:35.800855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Getting quotas for project 65a608f2c265434999aa734f1841b2a3. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:35.816195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Getting quotas for user 5206ef55b9694b4faa3ef71d001d94d4 and project 65a608f2c265434999aa734f1841b2a3. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:35.852738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:35.867647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:36.022880 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5a935b1-098b-4a66-8008-0a0671344058 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890807 Nov 27 20:53:36.037113 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1334/2578] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:36.075959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:36.079503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:36.090547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.091924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.095058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.095936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.124838 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb could not be found. Nov 27 20:53:36.125842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:36.127067 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4751d1a0-caba-47b1-a017-ae03be21a91e tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 404 len: 111 microversion: 2.1 time: 0.088499 Nov 27 20:53:36.127956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1335/2579] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:53:36 2021] DELETE /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:36.137375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb43b072-d831-4e01-89f6-cc6521a603d3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:36.163647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb43b072-d831-4e01-89f6-cc6521a603d3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:36.195942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb43b072-d831-4e01-89f6-cc6521a603d3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.196404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb43b072-d831-4e01-89f6-cc6521a603d3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.197208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb43b072-d831-4e01-89f6-cc6521a603d3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.197654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb43b072-d831-4e01-89f6-cc6521a603d3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.262385 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb43b072-d831-4e01-89f6-cc6521a603d3 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132662 Nov 27 20:53:36.272373 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1336/2580] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:53:36 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:36.284138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a02a92a-f6db-418c-acba-9b24c64fc5d1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:36.285656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a02a92a-f6db-418c-acba-9b24c64fc5d1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:36.416452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0a02a92a-f6db-418c-acba-9b24c64fc5d1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:36.437692 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a02a92a-f6db-418c-acba-9b24c64fc5d1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1217 microversion: 2.1 time: 0.158519 Nov 27 20:53:36.449841 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1337/2581] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:36 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:36.478356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:36.479143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] [instance: bd7b870d-40d5-4c15-9a87-89fdf19b33cb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:36.523767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.524249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.525093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.525536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.559211 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] HTTP exception thrown: Instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb could not be found. Nov 27 20:53:36.560246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] Returning 404 to user: Instance bd7b870d-40d5-4c15-9a87-89fdf19b33cb could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:36.561387 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4aa206b9-b678-4618-b039-89bd6cd64930 tempest-ImagesOneServerNegativeTestJSON-1163528440 tempest-ImagesOneServerNegativeTestJSON-1163528440-project] 10.222.0.21 "GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb" status: 404 len: 111 microversion: 2.1 time: 0.109925 Nov 27 20:53:36.570468 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1338/2582] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:36 2021] GET /compute/v2.1/servers/bd7b870d-40d5-4c15-9a87-89fdf19b33cb => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:36.589983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:36.590433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:36.603008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.607011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.608394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.608857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.956241 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8ac34fa-e509-4246-bc14-34809266faff tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/bca48df5-5161-4586-b716-27c26861f49a" status: 202 len: 0 microversion: 2.1 time: 1.187819 Nov 27 20:53:36.957426 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1245/2583] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:53:35 2021] DELETE /compute/v2.1/os-security-groups/bca48df5-5161-4586-b716-27c26861f49a => generated 0 bytes in 1192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:36.962970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:36.963741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:36.985032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.985846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:36.986860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:36.987641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:37.154525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:37.183567 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53663993-fea1-41de-b657-a399694c150e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 0.600589 Nov 27 20:53:37.185125 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1339/2584] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:36 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:37.192676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-521a5261-c5f6-4dee-b8c4-1a1dbe8f9149 req-3d1a1ca9-9d03-4931-bbef-bc5b022ad810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af66675-b153-4617-ad21-c79c87e4eac2", "name": "network-vif-deleted", "tag": "b27a9306-471b-4b83-91e0-219d06b5219f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:37.194494 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:37.194494 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:37.218581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-521a5261-c5f6-4dee-b8c4-1a1dbe8f9149 req-3d1a1ca9-9d03-4931-bbef-bc5b022ad810 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:37.219146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-521a5261-c5f6-4dee-b8c4-1a1dbe8f9149 req-3d1a1ca9-9d03-4931-bbef-bc5b022ad810 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:37.233699 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-521a5261-c5f6-4dee-b8c4-1a1dbe8f9149 req-3d1a1ca9-9d03-4931-bbef-bc5b022ad810 service nova] Creating event network-vif-deleted:b27a9306-471b-4b83-91e0-219d06b5219f for instance 6af66675-b153-4617-ad21-c79c87e4eac2 on nch1-master-1 Nov 27 20:53:37.240245 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-521a5261-c5f6-4dee-b8c4-1a1dbe8f9149 req-3d1a1ca9-9d03-4931-bbef-bc5b022ad810 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053346 Nov 27 20:53:37.241122 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1340/2585] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:37.246916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89906ea0-0ef2-4f6d-a90a-41ac0ba19b71 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c734cca0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:37.398953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-89906ea0-0ef2-4f6d-a90a-41ac0ba19b71 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bca48df5-5161-4586-b716-27c26861f49a does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:53:37.400099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-89906ea0-0ef2-4f6d-a90a-41ac0ba19b71 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group bca48df5-5161-4586-b716-27c26861f49a not found {{(pid=135680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:53:37.400945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-89906ea0-0ef2-4f6d-a90a-41ac0ba19b71 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group bca48df5-5161-4586-b716-27c26861f49a does not exist Nov 27 20:53:37.400945 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-1383c8e0-2e8b-46d3-8cee-7e50f754c8b7'] Nov 27 20:53:37.401863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89906ea0-0ef2-4f6d-a90a-41ac0ba19b71 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group bca48df5-5161-4586-b716-27c26861f49a does not exist Nov 27 20:53:37.401863 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-1383c8e0-2e8b-46d3-8cee-7e50f754c8b7'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:37.404019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89906ea0-0ef2-4f6d-a90a-41ac0ba19b71 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/bca48df5-5161-4586-b716-27c26861f49a" status: 404 len: 194 microversion: 2.1 time: 0.160646 Nov 27 20:53:37.407192 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1341/2586] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:53:37 2021] GET /compute/v2.1/os-security-groups/bca48df5-5161-4586-b716-27c26861f49a => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:37.571583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1797e763-40c3-4fa6-ba58-d007c9a80ae8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-373807416", "id": 1745416639, "os-flavor-access:is_public": "False"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:37.573906 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:37.573906 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:37.591437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1797e763-40c3-4fa6-ba58-d007c9a80ae8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.182415 Nov 27 20:53:37.592399 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1342/2587] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:37 2021] POST /compute/v2.1/flavors => generated 430 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:37.597818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9298c1c5-b986-493a-8a12-310627e6e7fa tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:37.599192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9298c1c5-b986-493a-8a12-310627e6e7fa tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:37.605624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9298c1c5-b986-493a-8a12-310627e6e7fa tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:37.606148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9298c1c5-b986-493a-8a12-310627e6e7fa tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:37.607008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9298c1c5-b986-493a-8a12-310627e6e7fa tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:37.607481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9298c1c5-b986-493a-8a12-310627e6e7fa tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:37.637861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9298c1c5-b986-493a-8a12-310627e6e7fa tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044253 Nov 27 20:53:37.638452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1343/2588] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:53:37 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:53:37.643523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f6ef007-1fff-4b5d-a4a8-9c3561b028a3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c75bb430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:37.758022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:37.767426 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15c54c9b-e611-43fe-b349-1aa76b554d41 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1317 microversion: 2.1 time: 0.808692 Nov 27 20:53:37.768329 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1246/2589] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:36 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:37.782146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:37.783023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:37.792748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:37.801707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:37.802724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:37.803477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:37.912284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:37.923087 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd426647-35c8-42c4-a9c0-face47f7bb6f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1269 microversion: 2.1 time: 0.152957 Nov 27 20:53:37.924828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1247/2590] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:37 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:37.951143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68f89c37-ba9a-4890-8c01-ff169589135b tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dccff361431c4b6ba5e99c6dfdb83842"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:37.957451 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:37.957451 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:38.235130 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68f89c37-ba9a-4890-8c01-ff169589135b tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1745416639/action" status: 200 len: 97 microversion: 2.1 time: 0.305883 Nov 27 20:53:38.237870 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1248/2591] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:53:37 2021] POST /compute/v2.1/flavors/1745416639/action => generated 97 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:53:38.249595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-156402902", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "4c1c2964-efe7-47f4-bb47-68bb0bb15cce"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:38.331213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] validate_networks() for [('4c1c2964-efe7-47f4-bb47-68bb0bb15cce', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:38.349318 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f6ef007-1fff-4b5d-a4a8-9c3561b028a3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/432dc27c-42ce-4c46-bb75-098a5c24ef26" status: 202 len: 0 microversion: 2.1 time: 0.709797 Nov 27 20:53:38.359360 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1344/2592] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:53:37 2021] DELETE /compute/v2.1/os-security-groups/432dc27c-42ce-4c46-bb75-098a5c24ef26 => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:38.365729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fd46db38-1275-42c2-a926-b36e88a38a62 req-7965c131-2028-4a4d-8323-a98a5426aeca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a542bf73-64b0-4fac-9738-f06b723b6d21", "tag": "a7424a47-99c1-4af8-bc12-2878fbff5f36"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:38.368578 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:38.368578 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:38.382708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fd46db38-1275-42c2-a926-b36e88a38a62 req-7965c131-2028-4a4d-8323-a98a5426aeca service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:38.383621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fd46db38-1275-42c2-a926-b36e88a38a62 req-7965c131-2028-4a4d-8323-a98a5426aeca service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:38.404609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fd46db38-1275-42c2-a926-b36e88a38a62 req-7965c131-2028-4a4d-8323-a98a5426aeca service nova] Creating event network-changed:a7424a47-99c1-4af8-bc12-2878fbff5f36 for instance a542bf73-64b0-4fac-9738-f06b723b6d21 on nch1-master-1 Nov 27 20:53:38.412041 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fd46db38-1275-42c2-a926-b36e88a38a62 req-7965c131-2028-4a4d-8323-a98a5426aeca service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049684 Nov 27 20:53:38.413177 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1345/2593] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:38.419172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:38.420107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:38.432424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:38.432919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:38.433991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:38.434435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:38.734857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:38.745613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-232e7f3b-8902-42d5-9f83-f8b7028fd3d7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 0.330273 Nov 27 20:53:38.756343 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1346/2594] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:38 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:39.088666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-029a44f3-8355-4ccc-8a47-6e6a4d14b7f4 tempest-FlavorsAccessTestJSON-536726596 tempest-FlavorsAccessTestJSON-536726596-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:39.121585 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-029a44f3-8355-4ccc-8a47-6e6a4d14b7f4 tempest-FlavorsAccessTestJSON-536726596 tempest-FlavorsAccessTestJSON-536726596-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.363928 Nov 27 20:53:39.123333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1347/2595] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:53:38 2021] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:39.128633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5ea0358-7f26-41d1-80b4-ba1fdc439190 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c7559670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:39.179745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-c5ea0358-7f26-41d1-80b4-ba1fdc439190 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:53:39.181453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-c5ea0358-7f26-41d1-80b4-ba1fdc439190 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 not found {{(pid=135680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:53:39.182010 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-c5ea0358-7f26-41d1-80b4-ba1fdc439190 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 does not exist Nov 27 20:53:39.182010 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-e6255574-4773-433b-a72e-ab133a070d1e'] Nov 27 20:53:39.182714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5ea0358-7f26-41d1-80b4-ba1fdc439190 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 does not exist Nov 27 20:53:39.182714 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-e6255574-4773-433b-a72e-ab133a070d1e'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:53:39.185484 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c5ea0358-7f26-41d1-80b4-ba1fdc439190 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/432dc27c-42ce-4c46-bb75-098a5c24ef26" status: 404 len: 194 microversion: 2.1 time: 0.060239 Nov 27 20:53:39.186285 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1348/2596] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:53:39 2021] GET /compute/v2.1/os-security-groups/432dc27c-42ce-4c46-bb75-098a5c24ef26 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:39.192470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:39.193448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:39.209863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:39.210317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:39.211295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:39.211741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:39.472584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:39.473538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:39.474211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:39.475376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:39.476128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:39.516032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:39.521139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:39.526285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:39.527975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:39.601730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:39.622123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Getting quotas for user 6f940822793e422c8436036be6a116a0 and project 79226c480677428e924a69a8e4c01ae9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:39.663880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:39.671503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:39.786340 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d16a2e50-9332-4b00-8ad7-46e49b0dff8b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545656 Nov 27 20:53:39.790840 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1249/2597] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:39.804403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:39.814295 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1d43e468-54b0-4128-8452-7754fad2e205 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1317 microversion: 2.1 time: 0.626857 Nov 27 20:53:39.817978 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1349/2598] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:39 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:39.824329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:39.825181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:39.834689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4b92ad8-9a53-40a7-baca-b383f89c5588 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dccff361431c4b6ba5e99c6dfdb83842"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:39.839914 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:39.839914 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:39.883845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:39.885410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:39.887359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:39.888338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:40.093601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:40.104012 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ec66461d-a27b-4af7-a477-101fc166fc73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1275 microversion: 2.1 time: 0.311703 Nov 27 20:53:40.104743 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1250/2599] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:39 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:40.124721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12e4971a-5fb3-4bbe-9246-ea304be94fce tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c7c95ca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:40.395268 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4b92ad8-9a53-40a7-baca-b383f89c5588 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors/1745416639/action" status: 200 len: 21 microversion: 2.1 time: 0.575867 Nov 27 20:53:40.398188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1350/2600] 10.222.0.21 () {60 vars in 1199 bytes} [Sat Nov 27 20:53:39 2021] POST /compute/v2.1/flavors/1745416639/action => generated 21 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:53:40.409335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:40.410335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:40.422349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:40.422802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:40.427150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:40.428470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:40.644421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:40.655678 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-82a6adf7-3f17-41be-b6c4-186cb8ac55a1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 0.253953 Nov 27 20:53:40.656748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1351/2601] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:40 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:40.671293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:40.672273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:40.680291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:40.680813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:40.681687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:40.682193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:40.754807 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12e4971a-5fb3-4bbe-9246-ea304be94fce tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.639726 Nov 27 20:53:40.756423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1251/2602] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:53:40 2021] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:40.763843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d8b4063-c393-4855-a8c7-1d6ed022c22e tempest-FlavorsAccessTestJSON-536726596 tempest-FlavorsAccessTestJSON-536726596-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:40.773848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:40.798027 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98c86e22-4d67-4c90-9b3c-42c245a0c725 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1213 microversion: 2.1 time: 0.139652 Nov 27 20:53:40.801379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1352/2603] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:40 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:40.810363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50e8aa14-6db2-4b22-a260-382bcc90bf27 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15c7fb95e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-610229230", "description": "tempest-description-2104779913"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:40.831600 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1d8b4063-c393-4855-a8c7-1d6ed022c22e tempest-FlavorsAccessTestJSON-536726596 tempest-FlavorsAccessTestJSON-536726596-project] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065771 Nov 27 20:53:40.832769 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1252/2604] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:53:40 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:40.853647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:40.854261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:40.877071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:40.877688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:40.879909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:40.880357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:41.159906 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50e8aa14-6db2-4b22-a260-382bcc90bf27 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.357445 Nov 27 20:53:41.160514 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1353/2605] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:40 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:41.176731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28658dc6-d43a-49e8-9945-c3a64b0306b8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:41.178571 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:41.178571 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:41.211576 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28658dc6-d43a-49e8-9945-c3a64b0306b8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/1745416639" status: 202 len: 0 microversion: 2.1 time: 0.049861 Nov 27 20:53:41.212713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1354/2606] 10.222.0.21 () {58 vars in 1160 bytes} [Sat Nov 27 20:53:41 2021] DELETE /compute/v2.1/flavors/1745416639 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:41.218383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:41.220247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:41.228370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:41.229379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:41.230350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:41.231001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:41.354631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:41.363358 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e214a334-8562-4a31-a322-aea1ff98e232 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1317 microversion: 2.1 time: 0.529497 Nov 27 20:53:41.367945 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1253/2607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:40 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:41.372955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b5bf00c-d87a-41dd-934f-b217ed9be788 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15c727a550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1303566878", "description": "tempest-description-1468722228"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:41.736721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:41.752796 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de152278-8847-460b-8e86-ae3e3d6c7755 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.538846 Nov 27 20:53:41.753389 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1355/2608] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:41 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:41.757842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0f6d3bdd-d9d9-472d-86bc-8169dc384263 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:41.795091 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0f6d3bdd-d9d9-472d-86bc-8169dc384263 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039799 Nov 27 20:53:41.797964 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1356/2609] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:53:41 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:41.803524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-226fdcb4-5224-4f52-a54d-15661bbe61e2 req-35e498ea-2c63-4e66-8ee6-9577200e5a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f4e797-745d-4e1d-89ff-105b05e550c0", "name": "network-vif-plugged", "status": "completed", "tag": "dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:41.805581 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:41.805581 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:41.821444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-226fdcb4-5224-4f52-a54d-15661bbe61e2 req-35e498ea-2c63-4e66-8ee6-9577200e5a6a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:41.823063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-226fdcb4-5224-4f52-a54d-15661bbe61e2 req-35e498ea-2c63-4e66-8ee6-9577200e5a6a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:41.837459 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-226fdcb4-5224-4f52-a54d-15661bbe61e2 req-35e498ea-2c63-4e66-8ee6-9577200e5a6a service nova] Creating event network-vif-plugged:dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef for instance f7f4e797-745d-4e1d-89ff-105b05e550c0 on nch2-master-1 Nov 27 20:53:41.843721 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-226fdcb4-5224-4f52-a54d-15661bbe61e2 req-35e498ea-2c63-4e66-8ee6-9577200e5a6a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043847 Nov 27 20:53:41.845070 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1357/2610] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:41.850903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:41.852336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:41.874360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:41.875326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:41.876421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:41.877742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:42.196983 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b5bf00c-d87a-41dd-934f-b217ed9be788 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.827663 Nov 27 20:53:42.209529 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1254/2611] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:53:41 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:42.216707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-df0869ff-16ef-4d76-a177-b738166d7c0b tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1929441099", "id": 777703992, "os-flavor-access:is_public": "False"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:42.221173 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:42.221173 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:42.264953 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-df0869ff-16ef-4d76-a177-b738166d7c0b tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.051401 Nov 27 20:53:42.266059 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1255/2612] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:42 2021] POST /compute/v2.1/flavors => generated 428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:42.280485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:42.283319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:42.294199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:42.294914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:42.296611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:42.297284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:42.415394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:42.428379 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88219a47-d2ae-4755-8f42-e132a8b3e71c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1275 microversion: 2.1 time: 0.158749 Nov 27 20:53:42.429247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1256/2613] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:42 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:42.435156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20692655-94d7-4d67-a56a-db617a13e4c9 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:42.436727 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:42.436727 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:42.457196 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20692655-94d7-4d67-a56a-db617a13e4c9 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/777703992/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.025790 Nov 27 20:53:42.457605 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1257/2614] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 20:53:42 2021] GET /compute/v2.1/flavors/777703992/os-flavor-access => generated 21 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:53:42.483000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8da1c6e7-a980-438c-bb10-03dac4bda795 req-2f82c13a-6ea7-4f86-9296-6e0f58c1a523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322cb011-f54a-4dd9-92b9-6c9478c4333c", "tag": "f582af39-1252-42ce-a0f7-29c2ea84cba2"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:42.486824 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:42.486824 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:42.516154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8da1c6e7-a980-438c-bb10-03dac4bda795 req-2f82c13a-6ea7-4f86-9296-6e0f58c1a523 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:42.516840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8da1c6e7-a980-438c-bb10-03dac4bda795 req-2f82c13a-6ea7-4f86-9296-6e0f58c1a523 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:42.544305 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8da1c6e7-a980-438c-bb10-03dac4bda795 req-2f82c13a-6ea7-4f86-9296-6e0f58c1a523 service nova] Creating event network-changed:f582af39-1252-42ce-a0f7-29c2ea84cba2 for instance 322cb011-f54a-4dd9-92b9-6c9478c4333c on nch1-master-1 Nov 27 20:53:42.555080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8da1c6e7-a980-438c-bb10-03dac4bda795 req-2f82c13a-6ea7-4f86-9296-6e0f58c1a523 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095978 Nov 27 20:53:42.556855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1258/2615] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:42.573530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:42.576435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:42.587524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:42.588049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:42.588938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:42.589440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:42.732711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:42.740297 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-321845d7-b26d-4dc5-8024-d3b3743d01a2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 0.893537 Nov 27 20:53:42.750452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1358/2616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:41 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:42.755499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-165993025", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "2940339f-24fb-427d-9c33-55a10d708401"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:42.846034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] validate_networks() for [('2940339f-24fb-427d-9c33-55a10d708401', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:43.130010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:43.138660 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0bc7dbb5-38ac-49e4-b26c-541e17d578fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1317 microversion: 2.1 time: 0.580271 Nov 27 20:53:43.140126 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1259/2617] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:42 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:43.145725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ce10c12-b011-4a0e-8395-3feb957944d6 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:43.147173 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:43.147173 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:43.167640 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ce10c12-b011-4a0e-8395-3feb957944d6 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/777703992" status: 202 len: 0 microversion: 2.1 time: 0.025568 Nov 27 20:53:43.169142 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1260/2618] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:53:43 2021] DELETE /compute/v2.1/flavors/777703992 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:43.175763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:43.176722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:43.184182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:43.184650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:43.185542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:43.186904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:43.564837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:43.565467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:43.566015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:43.566649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:43.567130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:43.584598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:43.585838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:43.587410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:43.590768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:43.637482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Getting quotas for project 4ce320b0fdb0466692b28dc520686425. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:43.653733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Getting quotas for user 434669fb63034fa0b91c67050a6b7d28 and project 4ce320b0fdb0466692b28dc520686425. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:43.679673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:43.683045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:43.755638 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9dd91a05-ebe7-4ebb-b70b-d51ae0378c3c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003403 Nov 27 20:53:43.757316 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1359/2619] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:43.763334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4bc63f1d-6b71-4e18-9828-b193f9edf751 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:43.818512 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4bc63f1d-6b71-4e18-9828-b193f9edf751 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059693 Nov 27 20:53:43.819971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1360/2620] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:53:43 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:43.826079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:43.827317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:43.839633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:43.840387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:43.841428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:43.843377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:44.092810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:44.107744 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d7c7f5c-813e-43b7-a97c-a2f09293b4f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.935641 Nov 27 20:53:44.109760 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1261/2621] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:43 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:44.123002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:44.125170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:44.140829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:44.143540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:44.145052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:44.178446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:44.333377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:44.344235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5127a364-5884-42d4-a06d-55459ab3d6ef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.522173 Nov 27 20:53:44.346363 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1361/2622] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:43 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:44.355854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92aee74c-c922-406f-b9a6-88277348b771 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:44.356499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92aee74c-c922-406f-b9a6-88277348b771 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:44.464566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92aee74c-c922-406f-b9a6-88277348b771 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:44.474385 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92aee74c-c922-406f-b9a6-88277348b771 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1215 microversion: 2.1 time: 0.126178 Nov 27 20:53:44.475358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1362/2623] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:44 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:44.500336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:44.501640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:44.512665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:44.513692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:44.515650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:44.516358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:44.888845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:44.899097 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b599c591-63c4-4c69-b721-91227f1cc4a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1317 microversion: 2.1 time: 0.421880 Nov 27 20:53:44.899727 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1363/2624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:44 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:44.904359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-95f9853c-72ed-422e-aafe-ca73e8db329e req-99109b89-9a0a-4de4-a946-1c30c7700164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a542bf73-64b0-4fac-9738-f06b723b6d21", "name": "network-vif-plugged", "status": "completed", "tag": "a7424a47-99c1-4af8-bc12-2878fbff5f36"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:44.905999 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:44.905999 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:44.923942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-95f9853c-72ed-422e-aafe-ca73e8db329e req-99109b89-9a0a-4de4-a946-1c30c7700164 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:44.924388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-95f9853c-72ed-422e-aafe-ca73e8db329e req-99109b89-9a0a-4de4-a946-1c30c7700164 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:44.954884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-95f9853c-72ed-422e-aafe-ca73e8db329e req-99109b89-9a0a-4de4-a946-1c30c7700164 service nova] Creating event network-vif-plugged:a7424a47-99c1-4af8-bc12-2878fbff5f36 for instance a542bf73-64b0-4fac-9738-f06b723b6d21 on nch1-master-1 Nov 27 20:53:44.963999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-95f9853c-72ed-422e-aafe-ca73e8db329e req-99109b89-9a0a-4de4-a946-1c30c7700164 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062772 Nov 27 20:53:44.968345 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1364/2625] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:44.981032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-76230624-d25a-4278-b0c3-64447aff0c06 req-28691b37-de56-4236-a7e6-1f493541bb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931317b4-226f-4f75-8a5e-f93c7ce5c3ad", "tag": "2dfaad6b-b499-4a67-ad7b-ec4eea1d3813"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:44.983558 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:44.983558 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:45.002378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-76230624-d25a-4278-b0c3-64447aff0c06 req-28691b37-de56-4236-a7e6-1f493541bb91 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.011363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-76230624-d25a-4278-b0c3-64447aff0c06 req-28691b37-de56-4236-a7e6-1f493541bb91 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:45.039358 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-76230624-d25a-4278-b0c3-64447aff0c06 req-28691b37-de56-4236-a7e6-1f493541bb91 service nova] Creating event network-changed:2dfaad6b-b499-4a67-ad7b-ec4eea1d3813 for instance 931317b4-226f-4f75-8a5e-f93c7ce5c3ad on nch2-master-1 Nov 27 20:53:45.044908 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-76230624-d25a-4278-b0c3-64447aff0c06 req-28691b37-de56-4236-a7e6-1f493541bb91 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074417 Nov 27 20:53:45.047225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1365/2626] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:45.078269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6eea6ac7-a3d5-456d-a70a-b2fef48b98d3 req-3c3c5a4c-e41b-42a2-b8db-d9affc070d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83157fd-522c-4778-bc69-51b6ec64f565", "tag": "bcaf48e3-c17f-47ae-a393-90c2200e0412"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:45.080115 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:45.080115 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:45.096722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6eea6ac7-a3d5-456d-a70a-b2fef48b98d3 req-3c3c5a4c-e41b-42a2-b8db-d9affc070d29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.097968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6eea6ac7-a3d5-456d-a70a-b2fef48b98d3 req-3c3c5a4c-e41b-42a2-b8db-d9affc070d29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:45.126090 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6eea6ac7-a3d5-456d-a70a-b2fef48b98d3 req-3c3c5a4c-e41b-42a2-b8db-d9affc070d29 service nova] Creating event network-changed:bcaf48e3-c17f-47ae-a393-90c2200e0412 for instance f83157fd-522c-4778-bc69-51b6ec64f565 on nch1-master-1 Nov 27 20:53:45.140320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:45.146043 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6eea6ac7-a3d5-456d-a70a-b2fef48b98d3 req-3c3c5a4c-e41b-42a2-b8db-d9affc070d29 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071673 Nov 27 20:53:45.149576 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1366/2627] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:53:45.150264 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7fc2858-b151-460e-8c59-4520d1627c1b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1308 microversion: 2.1 time: 1.038040 Nov 27 20:53:45.153801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1262/2628] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:44 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1308 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:45.175771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:45.182396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:45.200632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.202313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:45.203053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.206536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:45.365184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:45.366246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:45.381355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.386748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:45.389766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.392069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:45.829187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:45.840826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-66d05942-0fc8-49d8-aaa6-c29a75d1d3c5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.689984 Nov 27 20:53:45.842259 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1367/2629] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:45 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:45.851310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:45.851310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:45.857930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.858851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:45.860058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:45.860743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:46.008746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:46.023519 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff54c48d-c358-403f-9fc9-385f511053f3 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1273 microversion: 2.1 time: 0.178767 Nov 27 20:53:46.024747 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1368/2630] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:45 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:46.031158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:46.032218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:46.038467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:46.039230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:46.040281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:46.040957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:46.064063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:46.087648 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46076a5e-c52b-4f49-b3b1-208957cc0414 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.724173 Nov 27 20:53:46.090645 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1263/2631] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:45 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:46.180743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:46.188275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:46.201000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:46.201874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:46.203035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:46.203889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:46.358338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:46.367585 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-326f49f3-6be0-4e81-934c-572abb99bf0b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1317 microversion: 2.1 time: 0.341517 Nov 27 20:53:46.368176 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1369/2632] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:46 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:46.858680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:46.859408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:46.871900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:46.872493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:46.873301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:46.874282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:47.496354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:47.505716 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89de2e51-a78e-4b56-a144-1d0f381d0196 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1487 microversion: 2.1 time: 1.335299 Nov 27 20:53:47.518504 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1264/2633] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:46 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1487 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:47.524565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:47.525428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:47.533151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:47.533860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:47.535051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:47.535695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:47.696597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:47.711520 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-171d00ed-ff4f-44c6-b35f-81d731274752 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.857277 Nov 27 20:53:47.713005 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1370/2634] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:46 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:53:47.726433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:47.727433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:47.735273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:47.736072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:47.737169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:47.737827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:48.101840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:48.111124 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-452b839c-ed93-4b78-8e21-4ee82721839d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.591172 Nov 27 20:53:48.111885 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1265/2635] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:47 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:48.116714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:48.121622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:48.144206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:48.144675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:48.147413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:48.153024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:48.386605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:48.401644 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f92b824-45d4-479f-9fc2-ae0ddc0312ab tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.687148 Nov 27 20:53:48.402942 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1371/2636] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:47 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:48.407978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b859ce2-8f42-4f03-be86-8f73ecedd79b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:48.415911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b859ce2-8f42-4f03-be86-8f73ecedd79b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:48.416870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b859ce2-8f42-4f03-be86-8f73ecedd79b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:48.458989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5b859ce2-8f42-4f03-be86-8f73ecedd79b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Going to try to stop instance {{(pid=135680) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 20:53:48.519059 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b859ce2-8f42-4f03-be86-8f73ecedd79b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0/action" status: 202 len: 0 microversion: 2.1 time: 0.114457 Nov 27 20:53:48.521097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1372/2637] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:48 2021] POST /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:53:48.552248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:48.552887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:48.569761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:48.571056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:48.571056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:48.571480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:48.677351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:48.713130 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f9ee719-3cdf-421d-9243-fd19a464e6bb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1506 microversion: 2.1 time: 0.599127 Nov 27 20:53:48.714414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1266/2638] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:48 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:48.735050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:48.736569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:48.747610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:48.749059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:48.750274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:48.750950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.340158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:49.350217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-daac88d2-b002-442e-9f01-fc1443ba4e42 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.813340 Nov 27 20:53:49.353463 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1373/2639] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:48 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:49.375733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:49.377085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:49.379577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:49.393456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.394109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ff81052-6712-42f5-b1e6-f2ff0cc305bc tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.659688 Nov 27 20:53:49.395286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.396459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.397161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.397485 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1267/2640] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:48 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:49.427870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5af75ae3-660b-4946-8060-9b4d971efc1d req-9b22a47b-ec2d-4c63-b54c-1f06f5115a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322cb011-f54a-4dd9-92b9-6c9478c4333c", "name": "network-vif-plugged", "status": "completed", "tag": "f582af39-1252-42ce-a0f7-29c2ea84cba2"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:49.429913 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:49.429913 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:49.460804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5af75ae3-660b-4946-8060-9b4d971efc1d req-9b22a47b-ec2d-4c63-b54c-1f06f5115a88 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.461265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5af75ae3-660b-4946-8060-9b4d971efc1d req-9b22a47b-ec2d-4c63-b54c-1f06f5115a88 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.503035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5af75ae3-660b-4946-8060-9b4d971efc1d req-9b22a47b-ec2d-4c63-b54c-1f06f5115a88 service nova] Creating event network-vif-plugged:f582af39-1252-42ce-a0f7-29c2ea84cba2 for instance 322cb011-f54a-4dd9-92b9-6c9478c4333c on nch1-master-1 Nov 27 20:53:49.517652 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5af75ae3-660b-4946-8060-9b4d971efc1d req-9b22a47b-ec2d-4c63-b54c-1f06f5115a88 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118851 Nov 27 20:53:49.518428 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1268/2641] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:49.528256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:49.528966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:49.550288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.554410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.555624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.559125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.866359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:49.877892 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-91bb7f9f-dfb4-436a-b564-cd15843a6333 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1506 microversion: 2.1 time: 0.523227 Nov 27 20:53:49.880149 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1374/2642] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:49 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:49.888112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:49.889554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:49.900389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.901612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.903517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.904218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.915677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:49.940194 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fea99179-ce11-4988-a515-235e5c24b115 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.415567 Nov 27 20:53:49.941213 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1269/2643] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:49 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:49.952064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22ed7e8e-9bf8-4b87-b351-c650e9f065f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:49.955184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22ed7e8e-9bf8-4b87-b351-c650e9f065f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:49.975305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ed7e8e-9bf8-4b87-b351-c650e9f065f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.976269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ed7e8e-9bf8-4b87-b351-c650e9f065f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:49.977333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ed7e8e-9bf8-4b87-b351-c650e9f065f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:49.981320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22ed7e8e-9bf8-4b87-b351-c650e9f065f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.087418 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22ed7e8e-9bf8-4b87-b351-c650e9f065f7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "PUT /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1078 microversion: 2.1 time: 0.144430 Nov 27 20:53:50.089658 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1270/2644] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 20:53:49 2021] PUT /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1078 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:50.094795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-97b6f14e-c6d1-4429-b7b1-25f562fee230 req-b70ead4f-e706-45d3-adc8-b083539e77b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f26b6b0-7e2f-457c-97b1-c88bde1e9df8", "tag": "fb48d058-a5af-4ca6-ae15-d032b95d3013"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:50.096818 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:50.096818 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:50.104762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-97b6f14e-c6d1-4429-b7b1-25f562fee230 req-b70ead4f-e706-45d3-adc8-b083539e77b4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.105376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-97b6f14e-c6d1-4429-b7b1-25f562fee230 req-b70ead4f-e706-45d3-adc8-b083539e77b4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.122172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-97b6f14e-c6d1-4429-b7b1-25f562fee230 req-b70ead4f-e706-45d3-adc8-b083539e77b4 service nova] Creating event network-changed:fb48d058-a5af-4ca6-ae15-d032b95d3013 for instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 on nch2-master-1 Nov 27 20:53:50.130338 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-97b6f14e-c6d1-4429-b7b1-25f562fee230 req-b70ead4f-e706-45d3-adc8-b083539e77b4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039316 Nov 27 20:53:50.131584 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1271/2645] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:50.138236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:50.139135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:50.146129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.146639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.147685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.148441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.414051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:50.421588 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-596e3f09-b329-46a7-a2c4-fb32840ac659 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.539526 Nov 27 20:53:50.434437 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1375/2646] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:49 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:50.455063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:50.457063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:50.464198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.464886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.465874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.466492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.758388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:50.766502 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eecf26ac-0ec0-4861-9c17-c8a394c679b6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1504 microversion: 2.1 time: 0.633360 Nov 27 20:53:50.769400 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1272/2647] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:50 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1504 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:50.777729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:50.778610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:50.791563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.792324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.793333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.793842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.823545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:50.839349 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52bddab6-94cf-432f-9ed4-9e67790af59d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.403466 Nov 27 20:53:50.840260 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1376/2648] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:50 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:50.847786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:50.848626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:50.862421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.862928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:50.863973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:50.866090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:51.318170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:51.327626 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7530966d-dd15-46b6-ae29-970ae3373e2e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.556307 Nov 27 20:53:51.330597 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1273/2649] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:50 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:51.341734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:51.352133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46f65db9-f5c4-4672-9085-286dbb990f46 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1504 microversion: 2.1 time: 0.509245 Nov 27 20:53:51.368487 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1377/2650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:50 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1504 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:51.377175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:51.382216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:51.393705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:51.394166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:51.394976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:51.395451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:51.541443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-997140328", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:51.598843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:53:51.938650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:51.939077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:51.939711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:51.940147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:51.940578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:51.957292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:51.958124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:51.962372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:51.963097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.012998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Getting quotas for project 812b97d174d84cdbb78bd4064909234f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:52.025185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Getting quotas for user 8d611499f56e463ab23fc7c1ee2b382e and project 812b97d174d84cdbb78bd4064909234f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:52.056866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:53:52.061513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:53:52.155412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5569839e-d1a7-4d93-9f7e-ab550cd3adab tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822791 Nov 27 20:53:52.161807 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1274/2651] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:53:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:53:52.191547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:52.196387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:52.210223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.212458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.214949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.216951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.335034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:52.350977 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ddfa948-c3b8-4c4f-bd58-58d7ce7c34e5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.981275 Nov 27 20:53:52.357410 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1378/2652] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:51 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:52.370401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:52.371022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:52.382420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:53:52.383006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:53:52.383332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:53:52.391927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.393823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.396029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:53:52.396358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:53:52.397341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.398024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.561624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:52.571083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.571988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.573069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.574275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.622560 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5dfe54fb-74f7-4e29-bf5a-ffdad0703bef tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "POST /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21/action" status: 202 len: 1110 microversion: 2.1 time: 0.456918 Nov 27 20:53:52.624849 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1275/2653] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:52 2021] POST /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21/action => generated 1110 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 20:53:52.634662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:52.637471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:52.652840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.653410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.655045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:52.657886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:52.959507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:52.970904 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bddc1f03-05d9-4a7a-8e2b-bd96e55e51cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.344601 Nov 27 20:53:52.972637 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1276/2654] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:52 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:52.980619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-501678d7-41f8-464a-8824-b26e0f316fcb tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:52.983301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-501678d7-41f8-464a-8824-b26e0f316fcb tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:53.019752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:53.031563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1364fad0-8e47-439e-8fd0-22bef3685240 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.672960 Nov 27 20:53:53.032995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1379/2655] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:52 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:53.038824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:53.049242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:53.070349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:53.075733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:53.077010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:53.077683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:53.239964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-501678d7-41f8-464a-8824-b26e0f316fcb tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:53.258932 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-501678d7-41f8-464a-8824-b26e0f316fcb tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1221 microversion: 2.1 time: 0.284904 Nov 27 20:53:53.266724 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1277/2656] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:52 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1221 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:53.285775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:53.299103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:53.312833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:53.314911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:53.319399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:53.320214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:53.602356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:53.617140 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da1ae74c-15bb-47f5-aeda-6b507d27585f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.581642 Nov 27 20:53:53.628464 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1380/2657] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:53 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:53.633190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:53.633797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:53.649785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:53.650610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:53.651648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:53.652330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:53.670967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:53.683434 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-804fc5ce-5ab3-4b47-b864-d2c0f99efbdc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.410836 Nov 27 20:53:53.684975 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1278/2658] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:53 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:53.842882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a6afcbb8-c78b-4261-8999-9546a6b78972 req-f77603d0-3ae1-4543-8c48-64f760ec55c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931317b4-226f-4f75-8a5e-f93c7ce5c3ad", "name": "network-vif-plugged", "status": "completed", "tag": "2dfaad6b-b499-4a67-ad7b-ec4eea1d3813"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:53.844592 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:53.844592 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:53:53.853999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a6afcbb8-c78b-4261-8999-9546a6b78972 req-f77603d0-3ae1-4543-8c48-64f760ec55c8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:53.854470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a6afcbb8-c78b-4261-8999-9546a6b78972 req-f77603d0-3ae1-4543-8c48-64f760ec55c8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:53.886625 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a6afcbb8-c78b-4261-8999-9546a6b78972 req-f77603d0-3ae1-4543-8c48-64f760ec55c8 service nova] Creating event network-vif-plugged:2dfaad6b-b499-4a67-ad7b-ec4eea1d3813 for instance 931317b4-226f-4f75-8a5e-f93c7ce5c3ad on nch2-master-1 Nov 27 20:53:53.894014 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a6afcbb8-c78b-4261-8999-9546a6b78972 req-f77603d0-3ae1-4543-8c48-64f760ec55c8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058453 Nov 27 20:53:53.901009 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1279/2659] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:53:54.001443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:54.003132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:54.024374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:54.029486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:54.039312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:54.040177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:54.345227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:54.368346 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8439ee72-c686-4fb6-94d1-efdb28f465bb tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.726639 Nov 27 20:53:54.382661 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1381/2660] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:53 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:54.399455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:54.402715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:54.414983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:54.415883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:54.417071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:54.418520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:54.892449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:54.902174 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12bda8b2-c5a4-4cd7-97b9-a860dc5f9bcf tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.517312 Nov 27 20:53:54.914358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1382/2661] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:54 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:54.921810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:54.922693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:54.929933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:54.930674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:54.934850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:54.935519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:55.009889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:55.020855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a9c9c95-c0b8-4958-917f-74793e7eba7c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 1.035290 Nov 27 20:53:55.023605 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1280/2662] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:53 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:55.042897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:55.043687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:55.063189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:55.067377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:55.071170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:55.071521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:55.121924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:55.136343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92b2b086-5433-4faf-bf74-44c51bfe2961 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1279 microversion: 2.1 time: 0.220328 Nov 27 20:53:55.143374 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1383/2663] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:54 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:55.151616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:55.154297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:55.168080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:55.168846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:55.173222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:55.176020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:55.510489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:55.533541 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dbc0c072-74c2-48df-a93f-8775607784cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.382927 Nov 27 20:53:55.534411 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1384/2664] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:55 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:55.543774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:55.544796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:55.578151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:55.578943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:55.582380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:55.583013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:55.584251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:55.590927 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d5b500a-22b6-4200-9750-4324be2afe99 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1317 microversion: 2.1 time: 0.563239 Nov 27 20:53:55.591558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1281/2665] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:55 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:55.854039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da1b82b2-251f-4533-a808-81ac5db090e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'create', calling method: .version_select at 0x7f15d94ba8b0>, body: {"keypair": {"name": "tempest-keypair-371219246"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:55.898741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-da1b82b2-251f-4533-a808-81ac5db090e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Getting quotas for project 659003b54d7c4726bc5197bfd351d3c1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:55.909960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-da1b82b2-251f-4533-a808-81ac5db090e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Getting quotas for user 7c837598a18f439d93cfce37b86aa235 and project 659003b54d7c4726bc5197bfd351d3c1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:55.958606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:55.966679 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a708ce4-52e2-43df-b68b-2acb79ce87d9 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.430560 Nov 27 20:53:55.970372 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1385/2666] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:55 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:55.986669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:55.987676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:56.006127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.007598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.011441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.012665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.256142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:56.267534 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f3efc0b-5f0c-4319-8050-5e88f4be9b1a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.295821 Nov 27 20:53:56.285274 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1386/2667] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:55 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:56.290746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-acb4ac14-b492-4643-9af6-a995cc715839 req-ed08ea21-b35b-4590-8f44-b4dfc745263f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83157fd-522c-4778-bc69-51b6ec64f565", "name": "network-vif-plugged", "status": "completed", "tag": "bcaf48e3-c17f-47ae-a393-90c2200e0412"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:56.300668 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:53:56.300668 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:53:56.309900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-acb4ac14-b492-4643-9af6-a995cc715839 req-ed08ea21-b35b-4590-8f44-b4dfc745263f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.311471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-acb4ac14-b492-4643-9af6-a995cc715839 req-ed08ea21-b35b-4590-8f44-b4dfc745263f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.313773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-da1b82b2-251f-4533-a808-81ac5db090e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Getting quotas for project 659003b54d7c4726bc5197bfd351d3c1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:56.319712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-da1b82b2-251f-4533-a808-81ac5db090e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Getting quotas for user 7c837598a18f439d93cfce37b86aa235 and project 659003b54d7c4726bc5197bfd351d3c1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:56.325617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-acb4ac14-b492-4643-9af6-a995cc715839 req-ed08ea21-b35b-4590-8f44-b4dfc745263f service nova] Creating event network-vif-plugged:bcaf48e3-c17f-47ae-a393-90c2200e0412 for instance f83157fd-522c-4778-bc69-51b6ec64f565 on nch1-master-1 Nov 27 20:53:56.335336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-acb4ac14-b492-4643-9af6-a995cc715839 req-ed08ea21-b35b-4590-8f44-b4dfc745263f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048314 Nov 27 20:53:56.335957 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1387/2668] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:53:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:53:56.337013 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da1b82b2-251f-4533-a808-81ac5db090e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.556968 Nov 27 20:53:56.338100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1282/2669] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:53:55 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:56.341427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:56.342176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:56.343669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:56.344493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:56.351556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.352742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.353751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.354370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.375541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.375997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.382020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.382408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.547680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:56.556762 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b9a3481-5d74-4859-b6d1-a951f4f7de43 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1279 microversion: 2.1 time: 0.217356 Nov 27 20:53:56.570030 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1283/2670] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:56 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1279 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:56.661306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-449153eb-2d56-4af9-a8fe-00c4eb7e6db7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'create', calling method: .version_select at 0x7f15d94e4c10>, body: {"keypair": {"name": "tempest-keypair-1709801205"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:56.699312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-449153eb-2d56-4af9-a8fe-00c4eb7e6db7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for project 949d330b01384fb091f743a127f26402. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:56.712685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-449153eb-2d56-4af9-a8fe-00c4eb7e6db7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for user 3cc24888898d4d20bcfdc3d7c8cde8bf and project 949d330b01384fb091f743a127f26402. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:56.763425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:56.775723 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65c3b443-3765-4b4e-9b38-7c1befd385e7 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.435834 Nov 27 20:53:56.777011 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1388/2671] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:56 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:56.796643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:56.797513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:56.815665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.816123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:56.820790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:56.821584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.075973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-449153eb-2d56-4af9-a8fe-00c4eb7e6db7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for project 949d330b01384fb091f743a127f26402. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:53:57.091687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-449153eb-2d56-4af9-a8fe-00c4eb7e6db7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for user 3cc24888898d4d20bcfdc3d7c8cde8bf and project 949d330b01384fb091f743a127f26402. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:53:57.158956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-449153eb-2d56-4af9-a8fe-00c4eb7e6db7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.586884 Nov 27 20:53:57.160199 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1284/2672] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:53:56 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:57.164915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:57.165755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:57.176627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.177314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.178537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.179796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.224549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:57.239458 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-550dbc34-8b53-4862-b022-65ffa05c1f36 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.454663 Nov 27 20:53:57.253317 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1389/2673] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:56 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:57.261016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:57.262042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:57.270857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.271538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.272806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.273502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.562546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:57.578877 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abc7f8f4-c5c6-4161-a05c-3fd96a35025a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1467 microversion: 2.1 time: 0.412964 Nov 27 20:53:57.582751 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1285/2674] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:57 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1467 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:57.594097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:57.597140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:57.606776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.610914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.611779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.612102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:57.612278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.628183 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f4193717-cf8f-40a5-aef7-331df81c6cc2 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.369397 Nov 27 20:53:57.628833 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1390/2675] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:57 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:57.635743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:57.637465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:57.647533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.649301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.650660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:57.651422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:57.923656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:57.941361 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41c9ee11-e4fe-4e80-a0b8-92ddc37fd2ee tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.306744 Nov 27 20:53:57.942403 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1391/2676] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:57 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:57.972519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:57.973190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:57.995504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.001047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:58.002718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.006223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:58.280139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:58.293561 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e61f0b7b-0f64-48cf-8529-26adcfcfbdef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1317 microversion: 2.1 time: 0.708730 Nov 27 20:53:58.296305 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1286/2677] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:57 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:58.309389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:58.310264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:58.336931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.337896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:58.340492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.341131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:58.417922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:58.443538 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f96cf1f2-cd42-4a38-af1e-bae4bf6db1ac tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 200 len: 1466 microversion: 2.1 time: 0.487489 Nov 27 20:53:58.460875 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1392/2678] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:57 2021] GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 1466 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:58.496658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:58.497224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:58.522650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.523216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:58.524097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.526811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:58.756654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:58.769122 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df30aa63-8a83-4b7f-b925-da5cf66c6eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.307001 Nov 27 20:53:58.780532 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1393/2679] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:58 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:58.786017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60f8d354-c62c-4054-b02c-004a38544a73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1041116440"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:53:58.787678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60f8d354-c62c-4054-b02c-004a38544a73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:58.796337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60f8d354-c62c-4054-b02c-004a38544a73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.797174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60f8d354-c62c-4054-b02c-004a38544a73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:58.798265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60f8d354-c62c-4054-b02c-004a38544a73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:58.798955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60f8d354-c62c-4054-b02c-004a38544a73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.281443 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60f8d354-c62c-4054-b02c-004a38544a73 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "POST /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c/action" status: 202 len: 0 microversion: 2.1 time: 0.499024 Nov 27 20:53:59.283561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:59.287167 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1394/2680] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:53:58 2021] POST /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:53:59.293906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:59.294847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:59.300245 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20cfa5bc-e3cc-4732-b872-fd820ced5033 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 1.002172 Nov 27 20:53:59.300825 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1287/2681] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:58 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:59.303826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.305543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.307063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.307880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.321766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:59.328349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:59.337640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.338567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.339744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.342446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.524824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:59.539678 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-29c482cc-04e2-4737-85a4-e35f6c4b967e tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.250680 Nov 27 20:53:59.550955 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1395/2682] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:59 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:59.557057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d21c0105-5db0-40f8-8e00-9ee32e6654a1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94f93a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:59.613080 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d21c0105-5db0-40f8-8e00-9ee32e6654a1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.060799 Nov 27 20:53:59.613967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1396/2683] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:59 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:59.619094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:59.620234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:59.628035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.628485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.629266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.629698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.800956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:53:59.811636 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-410baa83-2520-4100-87fb-5eeaa30a1894 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1506 microversion: 2.1 time: 0.195599 Nov 27 20:53:59.812770 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1397/2684] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:59 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:53:59.816961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:53:59.817562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:53:59.828916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.829039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:53:59.833061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:53:59.833787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:00.113739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:00.125287 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41712c11-9cf7-475f-af45-e8a752963f06 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.311585 Nov 27 20:54:00.134965 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1398/2685] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:59 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:00.134965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e43117d2-ffd2-4d21-8242-7c087e0ef4ee req-f33e06b1-aa00-4d00-844f-678fbb92d25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf0c6c5-5410-4d97-bebc-94825b8ec5ae", "tag": "fb6fe1ae-aae8-4dcf-863c-9e42e9603264"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:00.134965 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:00.134965 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:00.143328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e43117d2-ffd2-4d21-8242-7c087e0ef4ee req-f33e06b1-aa00-4d00-844f-678fbb92d25f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:00.144223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e43117d2-ffd2-4d21-8242-7c087e0ef4ee req-f33e06b1-aa00-4d00-844f-678fbb92d25f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:00.171456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e43117d2-ffd2-4d21-8242-7c087e0ef4ee req-f33e06b1-aa00-4d00-844f-678fbb92d25f service nova] Creating event network-changed:fb6fe1ae-aae8-4dcf-863c-9e42e9603264 for instance edf0c6c5-5410-4d97-bebc-94825b8ec5ae on nch1-master-1 Nov 27 20:54:00.179478 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e43117d2-ffd2-4d21-8242-7c087e0ef4ee req-f33e06b1-aa00-4d00-844f-678fbb92d25f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051337 Nov 27 20:54:00.180860 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1399/2686] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:00.329199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:00.342934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:00.377671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:00.381431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:00.382260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:00.382700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:00.505448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:00.515781 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-726e0db4-5cda-4783-b0cd-165a24dcba0b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 1.206399 Nov 27 20:54:00.517291 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1288/2687] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:53:59 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:00.522162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-131349ec-6981-4b3c-ab00-03ff1e9e240d req-9923a096-22fb-4274-9406-84a19e13e3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f26b6b0-7e2f-457c-97b1-c88bde1e9df8", "name": "network-vif-plugged", "status": "completed", "tag": "fb48d058-a5af-4ca6-ae15-d032b95d3013"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:00.526096 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:00.526096 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:00.539892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-131349ec-6981-4b3c-ab00-03ff1e9e240d req-9923a096-22fb-4274-9406-84a19e13e3da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:00.540397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-131349ec-6981-4b3c-ab00-03ff1e9e240d req-9923a096-22fb-4274-9406-84a19e13e3da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:00.572508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-131349ec-6981-4b3c-ab00-03ff1e9e240d req-9923a096-22fb-4274-9406-84a19e13e3da service nova] Creating event network-vif-plugged:fb48d058-a5af-4ca6-ae15-d032b95d3013 for instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 on nch2-master-1 Nov 27 20:54:00.589431 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-131349ec-6981-4b3c-ab00-03ff1e9e240d req-9923a096-22fb-4274-9406-84a19e13e3da service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070885 Nov 27 20:54:00.590629 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1289/2688] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:00.639188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:00.640434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:00.689898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:00.690365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:00.691672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:00.692247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:00.777617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:00.788113 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc49d3ea-b6f1-4201-aa32-cbcf6edbdee4 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.470871 Nov 27 20:54:00.792303 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1400/2689] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:00 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:00.798683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8bdd0834-0ba0-4647-967e-ff23f5ef48fb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7559670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:00.880875 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8bdd0834-0ba0-4647-967e-ff23f5ef48fb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.087323 Nov 27 20:54:00.895840 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1401/2690] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:00 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:01.142230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:01.142848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:01.149966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.150845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:01.152412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.153117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:01.241347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:01.257497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0961b31c-33e1-459a-8068-9f1eecb23865 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.665301 Nov 27 20:54:01.269238 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1290/2691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:00 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:01.274664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "ecb2b22d-df71-40c8-af9b-e8abd512f0db"}], "security_groups": [{"name": "tempest-securitygroup--79563315"}], "key_name": "tempest-keypair-371219246", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:01.331480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:01.340741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28ad89e7-7dca-4faf-99ed-05c5f3f3a2c5 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.202712 Nov 27 20:54:01.342907 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1402/2692] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:01 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:01.352516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bbe1315e-ae0d-4780-8794-fa8af5743d7b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60217ada-e1c1-41d9-8800-666d6b70b099"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:01.353848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bbe1315e-ae0d-4780-8794-fa8af5743d7b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:01.367615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbe1315e-ae0d-4780-8794-fa8af5743d7b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.368577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbe1315e-ae0d-4780-8794-fa8af5743d7b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:01.369910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbe1315e-ae0d-4780-8794-fa8af5743d7b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.371368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbe1315e-ae0d-4780-8794-fa8af5743d7b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:01.556624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] validate_networks() for [('ecb2b22d-df71-40c8-af9b-e8abd512f0db', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:54:01.659874 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bbe1315e-ae0d-4780-8794-fa8af5743d7b tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "POST /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315570 Nov 27 20:54:01.665192 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1403/2693] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:54:01 2021] POST /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:01.665530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:01.666236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:01.673300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.673990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:01.674553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.674998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:01.893098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:01.907581 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72db17d5-5c01-4e6e-996b-33611538b04a tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.245202 Nov 27 20:54:01.909380 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1404/2694] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:01 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:01.915744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:01.916981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:01.926330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.927723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:01.928574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:01.929360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.184757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:02.198536 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-64d4b31a-94d1-4948-ae05-454865faed5c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.287594 Nov 27 20:54:02.199787 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1405/2695] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:01 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:02.213542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25f33faf-e57c-46c8-9bec-e1fe9d6cc5be tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94f9160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:02.308390 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25f33faf-e57c-46c8-9bec-e1fe9d6cc5be tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.107026 Nov 27 20:54:02.314261 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1406/2696] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:02 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:02.322191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:02.323066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:02.330886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.331375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.332505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.333120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.573047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:02.587379 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2960f544-880d-4f0c-aebc-0322cdae0170 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1315 microversion: 2.1 time: 0.274945 Nov 27 20:54:02.597079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1407/2697] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:02 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:02.598771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:54:02.599225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:54:02.600008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:54:02.600518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:54:02.600918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:02.601313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:54:02.601534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:02.612711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.613336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.614133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.614608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.618142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.625724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.627095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.627799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.673431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Getting quotas for project 659003b54d7c4726bc5197bfd351d3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:54:02.679189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Getting quotas for user 7c837598a18f439d93cfce37b86aa235 and project 659003b54d7c4726bc5197bfd351d3c1. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:54:02.705691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:54:02.711030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:54:02.806486 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29db5336-7306-454b-9fcc-b74bb1ab5ba3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.536075 Nov 27 20:54:02.810715 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1291/2698] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:01 2021] POST /compute/v2.1/servers => generated 407 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:54:02.819631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bee7096a-7f59-449e-b110-b3878cbb1525 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:02.823223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bee7096a-7f59-449e-b110-b3878cbb1525 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:02.848574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:02.883763 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f473851-e29c-4da4-8b8e-dfc7ca8f300f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.282854 Nov 27 20:54:02.885080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1408/2699] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:02 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:02.926209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:02.926829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:02.938853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.943162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:02.946042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:02.947762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:03.170483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:03.186119 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2fa63d64-60ca-4092-887b-7e691d82c141 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.263053 Nov 27 20:54:03.192417 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1409/2700] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:02 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:03.197562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-442415923", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9468b055-276c-45cc-aca4-5401a80bf2fe"}], "security_groups": [{"name": "tempest-securitygroup--1079207788"}], "key_name": "tempest-keypair-1709801205", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:03.387561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] validate_networks() for [('9468b055-276c-45cc-aca4-5401a80bf2fe', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:54:03.424661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bee7096a-7f59-449e-b110-b3878cbb1525 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:03.432529 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bee7096a-7f59-449e-b110-b3878cbb1525 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1225 microversion: 2.1 time: 0.616601 Nov 27 20:54:03.433811 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1292/2701] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:02 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1225 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:03.441679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:03.443036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:03.464056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:03.465383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:03.466445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:03.467125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:03.735096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:03.744915 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4db5eb4c-adad-4fe8-b22d-63bedbec7122 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.309423 Nov 27 20:54:03.746364 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1293/2702] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:03 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:03.751679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0cf978f4-ca80-43af-94df-45f0ca291524 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7246820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:03.823869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0cf978f4-ca80-43af-94df-45f0ca291524 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.075965 Nov 27 20:54:03.824831 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1294/2703] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:03 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:03.832593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:03.833361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:03.852886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:03.853740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:03.854819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:03.855562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.012879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for project 949d330b01384fb091f743a127f26402. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:54:04.024721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for user 3cc24888898d4d20bcfdc3d7c8cde8bf and project 949d330b01384fb091f743a127f26402. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:54:04.053267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:54:04.058419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:54:04.059182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:54:04.059874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:54:04.060918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:54:04.077709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.079188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.081864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.082401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.135000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for project 949d330b01384fb091f743a127f26402. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:54:04.137087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:04.143558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Getting quotas for user 3cc24888898d4d20bcfdc3d7c8cde8bf and project 949d330b01384fb091f743a127f26402. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:54:04.145146 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-051b0baf-6653-4c6b-8616-b24e3668d529 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1502 microversion: 2.1 time: 0.319157 Nov 27 20:54:04.156848 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1295/2704] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:03 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:04.161996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:04.163555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:04.165104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:54:04.167932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:54:04.177216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.177764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.178681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.179199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.242824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3251207a-7943-4347-9a0e-2fb83066e007 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.049242 Nov 27 20:54:04.247379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1410/2705] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:03 2021] POST /compute/v2.1/servers => generated 409 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:54:04.254113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-610229230"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:04.255471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:04.264327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.265083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.266065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.267394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.447471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:04.463286 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c65030e1-5dc4-4736-bdf1-226a927aff99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.304975 Nov 27 20:54:04.464787 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1296/2706] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:04 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:04.473560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:04.474648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:04.482947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.484062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.485196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.485977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.597172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.security_group_api [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Adding security group d1cf470f-d002-4517-acfa-7dfc330e54d7 to port fb48d058-a5af-4ca6-ae15-d032b95d3013 Nov 27 20:54:04.804140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:04.818951 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd62c3cb-2608-42bf-80ad-77704fd12927 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.351948 Nov 27 20:54:04.822265 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1297/2707] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:04 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:04.829586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b73b25c7-feac-44fc-8952-800902d4074c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:04.831612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b73b25c7-feac-44fc-8952-800902d4074c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:04.929859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b73b25c7-feac-44fc-8952-800902d4074c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:04.941493 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b73b25c7-feac-44fc-8952-800902d4074c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1277 microversion: 2.1 time: 0.116432 Nov 27 20:54:04.943046 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1298/2708] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:04 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:04.947695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:04.948553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:04.955138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.956486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:04.957983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:04.958611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.091530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:05.099188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d09488f-344e-435b-8292-9da679eb34c4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1283 microversion: 2.1 time: 0.154841 Nov 27 20:54:05.110567 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1299/2709] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:04 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:05.116788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-97508e57-f83a-4de2-8aac-90be19e5d10a req-921b7efd-b0eb-4397-b40a-f8382ecef0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322cb011-f54a-4dd9-92b9-6c9478c4333c", "name": "network-vif-plugged", "status": "completed", "tag": "f582af39-1252-42ce-a0f7-29c2ea84cba2"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:05.118563 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:05.118563 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:05.142884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-97508e57-f83a-4de2-8aac-90be19e5d10a req-921b7efd-b0eb-4397-b40a-f8382ecef0a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.144580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-97508e57-f83a-4de2-8aac-90be19e5d10a req-921b7efd-b0eb-4397-b40a-f8382ecef0a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.172967 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-97508e57-f83a-4de2-8aac-90be19e5d10a req-921b7efd-b0eb-4397-b40a-f8382ecef0a1 service nova] Creating event network-vif-plugged:f582af39-1252-42ce-a0f7-29c2ea84cba2 for instance 322cb011-f54a-4dd9-92b9-6c9478c4333c on nch1-master-1 Nov 27 20:54:05.188774 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-97508e57-f83a-4de2-8aac-90be19e5d10a req-921b7efd-b0eb-4397-b40a-f8382ecef0a1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073956 Nov 27 20:54:05.189733 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1300/2710] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:05.205633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:05.207038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:05.223066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.224231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.238535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.239764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.514629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:05.525086 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea86b3e9-3266-44cb-b32c-959779d858f1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.331759 Nov 27 20:54:05.535170 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1301/2711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:05 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:05.539849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5485e56c-956e-44a6-83cd-a26a03362bd1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94ba790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:05.591169 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5485e56c-956e-44a6-83cd-a26a03362bd1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.054668 Nov 27 20:54:05.592226 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1302/2712] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:05 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:05.597085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:05.598059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:05.605667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.606544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.607767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.608880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.752054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lazy-loading 'services' on Instance uuid f83157fd-522c-4778-bc69-51b6ec64f565 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:54:05.880953 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca6ad229-cb3d-4a92-857c-ccbdca6eabef tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments/60217ada-e1c1-41d9-8800-666d6b70b099" status: 202 len: 0 microversion: 2.1 time: 0.283500 Nov 27 20:54:05.882297 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1303/2713] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 20:54:05 2021] DELETE /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments/60217ada-e1c1-41d9-8800-666d6b70b099 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:05.909800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:05.910508 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1d42238f-675d-4b60-92b8-17752e0fe84c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8/action" status: 202 len: 0 microversion: 2.1 time: 1.661080 Nov 27 20:54:05.912335 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1411/2714] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:04 2021] POST /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8/action => generated 0 bytes in 1664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:05.918027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:05.926021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:05.942592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:05.944261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.944950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.946028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.946702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.958312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.959112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:05.961583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:05.963919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.258888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:06.267693 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-131439fd-843d-4065-bfc8-ae8c0da58f99 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.382388 Nov 27 20:54:06.278279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1304/2715] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:05 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:06.283931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-06088214-0ffd-4d86-9b18-25106635e666 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:06.285249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-06088214-0ffd-4d86-9b18-25106635e666 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:06.294464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06088214-0ffd-4d86-9b18-25106635e666 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.295891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06088214-0ffd-4d86-9b18-25106635e666 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.296988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06088214-0ffd-4d86-9b18-25106635e666 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.297683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06088214-0ffd-4d86-9b18-25106635e666 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.366319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:06.376143 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-94214ae4-1ac3-4c95-8476-73c12ed6f641 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.461687 Nov 27 20:54:06.379080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1412/2716] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:05 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:06.392368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99f7d36f-6149-46d7-9adf-851db2418987 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c7416b80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:06.393298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-06088214-0ffd-4d86-9b18-25106635e666 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112991 Nov 27 20:54:06.394316 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1305/2717] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:54:06 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:06.401727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f1df4124-7693-4b0b-93e9-47132442300f req-10910171-e4ee-4995-a06a-7cfd292fd0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f26b6b0-7e2f-457c-97b1-c88bde1e9df8", "tag": "fb48d058-a5af-4ca6-ae15-d032b95d3013"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:06.403738 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:06.403738 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:06.412503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f1df4124-7693-4b0b-93e9-47132442300f req-10910171-e4ee-4995-a06a-7cfd292fd0ec service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.413396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f1df4124-7693-4b0b-93e9-47132442300f req-10910171-e4ee-4995-a06a-7cfd292fd0ec service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.428383 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f1df4124-7693-4b0b-93e9-47132442300f req-10910171-e4ee-4995-a06a-7cfd292fd0ec service nova] Creating event network-changed:fb48d058-a5af-4ca6-ae15-d032b95d3013 for instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 on nch2-master-1 Nov 27 20:54:06.437064 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f1df4124-7693-4b0b-93e9-47132442300f req-10910171-e4ee-4995-a06a-7cfd292fd0ec service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041060 Nov 27 20:54:06.437678 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1306/2718] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:06.455654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:06.458081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:06.469615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.473487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.474671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.483583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.648610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:06.663355 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24ea9542-65a2-4ee8-bee9-7c4733e5549b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1335 microversion: 2.1 time: 0.221132 Nov 27 20:54:06.673853 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1307/2719] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:06 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1335 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:06.691364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:06.692010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:06.703667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.704127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.704939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.705383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.774354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-99f7d36f-6149-46d7-9adf-851db2418987 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d1cf470f-d002-4517-acfa-7dfc330e54d7 in use.", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:06.775054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-99f7d36f-6149-46d7-9adf-851db2418987 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security Group d1cf470f-d002-4517-acfa-7dfc330e54d7 in use. Nov 27 20:54:06.775054 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-01e1374c-36a4-4dfb-9723-fc88ddf59852'] Nov 27 20:54:06.775715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99f7d36f-6149-46d7-9adf-851db2418987 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 400 to user: Security Group d1cf470f-d002-4517-acfa-7dfc330e54d7 in use. Nov 27 20:54:06.775715 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-01e1374c-36a4-4dfb-9723-fc88ddf59852'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:06.776563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99f7d36f-6149-46d7-9adf-851db2418987 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/d1cf470f-d002-4517-acfa-7dfc330e54d7" status: 400 len: 185 microversion: 2.1 time: 0.396089 Nov 27 20:54:06.777452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1413/2720] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:06 2021] DELETE /compute/v2.1/os-security-groups/d1cf470f-d002-4517-acfa-7dfc330e54d7 => generated 185 bytes in 397 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:54:06.784257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:06.786248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:06.810544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.811008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:06.814448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:06.814911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.229231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:07.239116 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3536acdb-b0e0-4927-b78e-5ba75efc7c4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.460619 Nov 27 20:54:07.240512 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1414/2721] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:06 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:07.245431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-636034d6-b368-4137-8a6b-c4931fa6ddce tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7364940>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:07.312491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-636034d6-b368-4137-8a6b-c4931fa6ddce tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.070618 Nov 27 20:54:07.320393 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1415/2722] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:07 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:07.332607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e9aa38b-12a1-474c-b504-2a251910706c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:07.333652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1e9aa38b-12a1-474c-b504-2a251910706c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:07.337954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:07.342995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e9aa38b-12a1-474c-b504-2a251910706c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.343492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e9aa38b-12a1-474c-b504-2a251910706c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.344300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e9aa38b-12a1-474c-b504-2a251910706c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.345284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e9aa38b-12a1-474c-b504-2a251910706c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.352025 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a464a2e7-de13-4e64-b29d-87ebeffb0a32 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.677240 Nov 27 20:54:07.361234 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1308/2723] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:06 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:07.361972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:07.364303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:07.383222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.383693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.384504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.384950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.477274 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1e9aa38b-12a1-474c-b504-2a251910706c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8/action" status: 202 len: 0 microversion: 2.1 time: 0.154551 Nov 27 20:54:07.484620 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1416/2724] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:07 2021] POST /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:07.494608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:07.500043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:07.511747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.512569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.514023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.514656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.847369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:07.856842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28cec127-7491-4080-98ae-d5a2ecaf5bfc tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.370019 Nov 27 20:54:07.859655 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1417/2725] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:07 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:07.868922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27e6117e-ca27-4813-8c09-b8e75984508a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:07.871563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:07.877921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27e6117e-ca27-4813-8c09-b8e75984508a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:07.884630 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c3ca790-ef15-44c6-b772-d3be7cfce15b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.529692 Nov 27 20:54:07.885604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27e6117e-ca27-4813-8c09-b8e75984508a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.886052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27e6117e-ca27-4813-8c09-b8e75984508a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.886859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27e6117e-ca27-4813-8c09-b8e75984508a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.887339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27e6117e-ca27-4813-8c09-b8e75984508a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.889986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1309/2726] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:07 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:07.901703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:07.902714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:07.909654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.914545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.918185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.918901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.953429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27e6117e-ca27-4813-8c09-b8e75984508a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092668 Nov 27 20:54:07.959352 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1418/2727] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:54:07 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:07.970778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:07.972918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:07.985066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.992230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:07.993385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:07.998495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.182575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:08.196302 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b050884d-84ea-490c-97a6-e7fda3121cbc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1335 microversion: 2.1 time: 0.234558 Nov 27 20:54:08.197188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1419/2728] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:07 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1335 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:08.257563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:08.258976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:08.289035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.290202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.293047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.295779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.631200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:08.639778 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f93f516-3da0-4435-83e1-8a5242ec3c13 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1572 microversion: 2.1 time: 0.747864 Nov 27 20:54:08.647121 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1310/2729] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:07 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1572 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:08.651836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d5100bc3-b65e-42ae-a186-83361bb85ea4 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9522550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:08.750120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:08.752144 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d5100bc3-b65e-42ae-a186-83361bb85ea4 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.097688 Nov 27 20:54:08.754653 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1311/2730] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:08 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:08.760016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bd041d7c-8db2-48d7-aa0e-413e2a24580f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.507561 Nov 27 20:54:08.763355 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1420/2731] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:08 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:08.767158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:08.773780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-823c2d61-12dd-44a1-acdf-4a91c675ba84 req-7bc9d724-f577-457e-ae68-31f69e3aa14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf0c6c5-5410-4d97-bebc-94825b8ec5ae", "name": "network-vif-plugged", "status": "completed", "tag": "fb6fe1ae-aae8-4dcf-863c-9e42e9603264"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:08.774925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:08.781665 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:08.781665 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:08.795736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.796923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.798435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.799006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-823c2d61-12dd-44a1-acdf-4a91c675ba84 req-7bc9d724-f577-457e-ae68-31f69e3aa14f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.799815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.799990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-823c2d61-12dd-44a1-acdf-4a91c675ba84 req-7bc9d724-f577-457e-ae68-31f69e3aa14f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.829269 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-823c2d61-12dd-44a1-acdf-4a91c675ba84 req-7bc9d724-f577-457e-ae68-31f69e3aa14f service nova] Creating event network-vif-plugged:fb6fe1ae-aae8-4dcf-863c-9e42e9603264 for instance edf0c6c5-5410-4d97-bebc-94825b8ec5ae on nch1-master-1 Nov 27 20:54:08.844080 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-823c2d61-12dd-44a1-acdf-4a91c675ba84 req-7bc9d724-f577-457e-ae68-31f69e3aa14f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078611 Nov 27 20:54:08.844926 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1421/2732] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:08.851166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f69e9ddf-ff81-4fe4-bf08-7643383268b1 req-1ba49a5f-06bd-45a0-983b-e6466eb631c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3742d74c-1fbd-42f7-8dd3-1af6053e9f28", "tag": "5f40e7d5-e01b-48c4-a853-15b07fbabc1f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:08.864210 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:08.864210 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:08.886985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f69e9ddf-ff81-4fe4-bf08-7643383268b1 req-1ba49a5f-06bd-45a0-983b-e6466eb631c6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.890054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f69e9ddf-ff81-4fe4-bf08-7643383268b1 req-1ba49a5f-06bd-45a0-983b-e6466eb631c6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.923775 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f69e9ddf-ff81-4fe4-bf08-7643383268b1 req-1ba49a5f-06bd-45a0-983b-e6466eb631c6 service nova] Creating event network-changed:5f40e7d5-e01b-48c4-a853-15b07fbabc1f for instance 3742d74c-1fbd-42f7-8dd3-1af6053e9f28 on nch2-master-1 Nov 27 20:54:08.934228 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f69e9ddf-ff81-4fe4-bf08-7643383268b1 req-1ba49a5f-06bd-45a0-983b-e6466eb631c6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086359 Nov 27 20:54:08.937365 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1422/2733] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:08.944209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:08.945313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:08.954805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.955721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:08.959670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:08.960395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.253057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:09.264779 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27ebc2bc-5af1-45df-b6ef-6ba004611959 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.325275 Nov 27 20:54:09.274685 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1423/2734] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:08 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:09.275578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:09.276477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:09.285933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.286574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.287602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.288542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.525181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:09.544580 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b325c945-611a-4fcf-be33-635667683d6d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.784756 Nov 27 20:54:09.545240 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1312/2735] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:08 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:09.558021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:09.558877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:09.565632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.566085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.566876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.567405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.600048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:09.608618 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c18d581c-fe72-4843-815c-465148e5fef6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.341527 Nov 27 20:54:09.618026 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1424/2736] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:09 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:09.619416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:09.619914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:09.628669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.629121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.629914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.630349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.670045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:09.829601 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52802d0c-33e9-4f1c-9dac-ed5677959a1d tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 204 len: 0 microversion: 2.1 time: 0.214628 Nov 27 20:54:09.833660 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1425/2737] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:09 2021] DELETE /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:09.844180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:09.845874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:09.867755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.868218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:09.869036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:09.869497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.027812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:10.036656 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-283d78b9-68e3-475d-a2c8-b37f33d5d956 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1403 microversion: 2.1 time: 0.490372 Nov 27 20:54:10.046298 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1313/2738] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:09 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1403 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:10.051790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb37bff5-cbc5-45f9-a139-457401429caf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9449160>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:10.106409 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb37bff5-cbc5-45f9-a139-457401429caf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.058700 Nov 27 20:54:10.112222 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1314/2739] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:10 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:10.126206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:10.127998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:10.137716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.138493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.140529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.141156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.228347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:10.242846 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dfa1d556-34b9-4749-96d6-038d595efc46 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1572 microversion: 2.1 time: 0.407783 Nov 27 20:54:10.245597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1426/2740] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:09 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1572 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:10.260369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:10.261844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:10.274923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.275582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.276490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.277005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.495585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:10.507705 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e211fe4-4b5c-450e-8687-66e6bf919798 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1512 microversion: 2.1 time: 0.260904 Nov 27 20:54:10.508897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1427/2741] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:10 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:10.513977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:10.514812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:10.522061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.522780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.523845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.524453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.703461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:10.712246 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7fcd4af7-a795-4186-9356-e902c5fc150b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1321 microversion: 2.1 time: 0.202030 Nov 27 20:54:10.713023 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1428/2742] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:10 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:10.731797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:10.731797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:10.737699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.738181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.739043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.739693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.804637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:10.814090 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a604dbb-1ca7-4aff-bb70-379d2c3928b9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.692964 Nov 27 20:54:10.817331 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1315/2743] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:10 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:10.823140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:10.824028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:10.830723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.831527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.833096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:10.834869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:10.923693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:10.940284 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-be3ffa71-afd2-44e2-b732-64c8d719e276 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.221421 Nov 27 20:54:10.940890 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1429/2744] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:10 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:11.054533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:11.056585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:11.072556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.074115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.078980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.081934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.146177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:11.158934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a353d8b-2d44-4dc1-9b85-cefa73d78526 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.339819 Nov 27 20:54:11.160697 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1316/2745] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:10 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:11.175710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-306403a9-35d4-45ca-a8ac-4fe90f2531f2 req-126bd302-98e3-44a9-ad43-a3b253a74a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4915d7-d7e8-4026-b053-0daf8f1da2d9", "tag": "dd8f41df-2dbf-4de0-bf5b-e9b90b539e23"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:11.178723 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:11.178723 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:11.194969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-306403a9-35d4-45ca-a8ac-4fe90f2531f2 req-126bd302-98e3-44a9-ad43-a3b253a74a4f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.196114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-306403a9-35d4-45ca-a8ac-4fe90f2531f2 req-126bd302-98e3-44a9-ad43-a3b253a74a4f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.230041 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-306403a9-35d4-45ca-a8ac-4fe90f2531f2 req-126bd302-98e3-44a9-ad43-a3b253a74a4f service nova] Creating event network-changed:dd8f41df-2dbf-4de0-bf5b-e9b90b539e23 for instance 4c4915d7-d7e8-4026-b053-0daf8f1da2d9 on nch1-master-1 Nov 27 20:54:11.241893 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-306403a9-35d4-45ca-a8ac-4fe90f2531f2 req-126bd302-98e3-44a9-ad43-a3b253a74a4f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079419 Nov 27 20:54:11.243874 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1317/2746] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:11.252502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0aadbf9d-7f50-4387-aa24-453aa40a889f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94944c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:11.321420 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0aadbf9d-7f50-4387-aa24-453aa40a889f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.073929 Nov 27 20:54:11.327693 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1318/2747] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:11 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:11.335619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:11.336527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:11.362726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.366936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.368199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.368846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.417713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:11.428348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eabd7bde-33f9-4bf7-8866-6b123ea425c5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1403 microversion: 2.1 time: 0.378136 Nov 27 20:54:11.441161 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1430/2748] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:11 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1403 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:11.527836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:11.528446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:11.535395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.536453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.538724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.549932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.660458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:11.669283 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-540c1bff-73a4-4d57-aca1-39939ac867c0 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1570 microversion: 2.1 time: 0.345314 Nov 27 20:54:11.671928 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1319/2749] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:11 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1570 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:11.690346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1303566878"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:11.691236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:11.698099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.698804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.699818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.700426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.755109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:11.763204 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-193f1eab-d531-40b5-9f6b-02ad03643b0a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1512 microversion: 2.1 time: 0.239467 Nov 27 20:54:11.774132 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1431/2750] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:11 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:11.774132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:11.774132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:11.781356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.787380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.788329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:11.788868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:11.967336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:11.978903 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5d402bfc-9c47-4cc6-82ba-7e0a4e918838 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1471 microversion: 2.1 time: 0.211114 Nov 27 20:54:11.980680 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1432/2751] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:11 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:12.001207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:12.003968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:12.014483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.015204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.016395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.016999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.041892 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.network.security_group_api [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Adding security group ab7e8c7d-1033-438d-9cdf-65069ed8573d to port fb48d058-a5af-4ca6-ae15-d032b95d3013 Nov 27 20:54:12.208421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:12.217901 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac2e6de4-3566-4fb8-883c-bf78acae59e0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.223624 Nov 27 20:54:12.224047 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1433/2752] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:11 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:12.229356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:12.230372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:12.242107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.242872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.243723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.244159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.423957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:12.433060 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f54d2118-6566-4fd4-9818-ba6688b712b3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.207643 Nov 27 20:54:12.433956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1434/2753] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:12 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:12.513003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f14f55d-345e-4441-9b8c-25eaf8dae681 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:12.513624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f14f55d-345e-4441-9b8c-25eaf8dae681 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] [instance: 5b745741-9958-4d30-9b2c-7a113b143a5b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:12.519763 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9f14f55d-345e-4441-9b8c-25eaf8dae681 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] HTTP exception thrown: Instance 5b745741-9958-4d30-9b2c-7a113b143a5b could not be found. Nov 27 20:54:12.520358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f14f55d-345e-4441-9b8c-25eaf8dae681 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Returning 404 to user: Instance 5b745741-9958-4d30-9b2c-7a113b143a5b could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:12.521182 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f14f55d-345e-4441-9b8c-25eaf8dae681 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/5b745741-9958-4d30-9b2c-7a113b143a5b/action" status: 404 len: 111 microversion: 2.1 time: 0.085713 Nov 27 20:54:12.521742 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1435/2754] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:12 2021] POST /compute/v2.1/servers/5b745741-9958-4d30-9b2c-7a113b143a5b/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:12.526540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:12.527461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:12.545454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.546278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.547331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.548000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.712612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:12.725680 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-62dce1b1-21c0-49c4-a428-a89da058977f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.202615 Nov 27 20:54:12.726443 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1436/2755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:12 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:12.731463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0126db9d-df4b-4f41-a752-9c25c1a06160 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c737df70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:12.789010 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0126db9d-df4b-4f41-a752-9c25c1a06160 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.061654 Nov 27 20:54:12.790398 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1437/2756] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:12 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:12.795759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:12.796577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:12.805686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.806659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.808319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:12.808933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:12.964263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:12.973008 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e191abb-610f-449b-b93d-e6cd1ffb4e69 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1403 microversion: 2.1 time: 0.181307 Nov 27 20:54:12.983478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1438/2757] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:12 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:12.988401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1830736854", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:13.050424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:54:13.235773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-885fd5d6-d113-4f48-bc14-b256da604705 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8/action" status: 202 len: 0 microversion: 2.1 time: 1.551190 Nov 27 20:54:13.242193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1320/2758] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:11 2021] POST /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8/action => generated 0 bytes in 1559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:13.248155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:13.250761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:13.257992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.265610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.266770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.267524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.408999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:13.430858 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca6d8f82-d643-4257-bd6e-b6f2e661c645 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 200 len: 1470 microversion: 2.1 time: 0.178155 Nov 27 20:54:13.431857 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1321/2759] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:13 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:13.440675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:13.441586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:13.461133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.462149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.463816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.464445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.521314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:54:13.522010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:54:13.522711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:54:13.523267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:54:13.523769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:54:13.537755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.538222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.539044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.540163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.572564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Getting quotas for project 812b97d174d84cdbb78bd4064909234f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:54:13.581131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Getting quotas for user 8d611499f56e463ab23fc7c1ee2b382e and project 812b97d174d84cdbb78bd4064909234f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:54:13.596284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:54:13.599584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:54:13.672426 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e2970d3-c86f-4c9c-8a96-eba322229ce7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687470 Nov 27 20:54:13.677941 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1439/2760] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:54:13.683296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fb49a13-5bda-4352-9c94-ce80a63d4b5f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c7345160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:13.710418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:13.723766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2ebd4cc-71a7-4f72-a4bd-fdc6b602936f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.287446 Nov 27 20:54:13.725181 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1322/2761] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:13 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:13.730604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-66d9e1b5-645c-408b-af1f-1c24cd4c746a req-ee5761d0-3a61-4776-b99a-64f7391cf421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f26b6b0-7e2f-457c-97b1-c88bde1e9df8", "tag": "fb48d058-a5af-4ca6-ae15-d032b95d3013"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:13.733019 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:13.733019 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:13.744978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-66d9e1b5-645c-408b-af1f-1c24cd4c746a req-ee5761d0-3a61-4776-b99a-64f7391cf421 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.746188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-66d9e1b5-645c-408b-af1f-1c24cd4c746a req-ee5761d0-3a61-4776-b99a-64f7391cf421 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.766626 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-66d9e1b5-645c-408b-af1f-1c24cd4c746a req-ee5761d0-3a61-4776-b99a-64f7391cf421 service nova] Creating event network-changed:fb48d058-a5af-4ca6-ae15-d032b95d3013 for instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 on nch2-master-1 Nov 27 20:54:13.773806 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-66d9e1b5-645c-408b-af1f-1c24cd4c746a req-ee5761d0-3a61-4776-b99a-64f7391cf421 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046785 Nov 27 20:54:13.775291 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1323/2762] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:13.796721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:13.797737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:13.807943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.809499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.811025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:13.811675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:13.907793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-9fb49a13-5bda-4352-9c94-ce80a63d4b5f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ab7e8c7d-1033-438d-9cdf-65069ed8573d in use.", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:13.909775 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9fb49a13-5bda-4352-9c94-ce80a63d4b5f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security Group ab7e8c7d-1033-438d-9cdf-65069ed8573d in use. Nov 27 20:54:13.909775 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-0db230d4-0839-44b3-89d9-770d30f0e001'] Nov 27 20:54:13.909775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fb49a13-5bda-4352-9c94-ce80a63d4b5f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 400 to user: Security Group ab7e8c7d-1033-438d-9cdf-65069ed8573d in use. Nov 27 20:54:13.909775 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-0db230d4-0839-44b3-89d9-770d30f0e001'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:13.910354 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9fb49a13-5bda-4352-9c94-ce80a63d4b5f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/ab7e8c7d-1033-438d-9cdf-65069ed8573d" status: 400 len: 185 microversion: 2.1 time: 0.233385 Nov 27 20:54:13.914645 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1440/2763] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:13 2021] DELETE /compute/v2.1/os-security-groups/ab7e8c7d-1033-438d-9cdf-65069ed8573d => generated 185 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:54:13.916621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a57c4eb-9883-492b-8413-58f0c13663e7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:13.917235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a57c4eb-9883-492b-8413-58f0c13663e7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:14.041797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1a57c4eb-9883-492b-8413-58f0c13663e7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:14.050527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a57c4eb-9883-492b-8413-58f0c13663e7 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1222 microversion: 2.1 time: 0.137509 Nov 27 20:54:14.060115 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1441/2764] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:13 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:14.065831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:14.065831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:14.086142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.086545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.096193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.096671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.149983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:14.167872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf383e91-2684-44a1-9fe5-8e92d1258213 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.388899 Nov 27 20:54:14.171410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1324/2765] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:13 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:14.193253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e57b22c2-05e8-4abc-a9c4-b802a0c8ff54 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d944a3a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:14.318815 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e57b22c2-05e8-4abc-a9c4-b802a0c8ff54 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.146063 Nov 27 20:54:14.324588 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1325/2766] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:14 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:14.329241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:14.329742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:14.365093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.366865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.373154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.378257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.454812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:14.628698 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-80f203eb-306b-47e3-a31a-a46766ecc591 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 204 len: 0 microversion: 2.1 time: 0.302721 Nov 27 20:54:14.639545 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1326/2767] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:14 2021] DELETE /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:14.645732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:14.648733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:14.664569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.665899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.667874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.671048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.805685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:14.815895 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ccb909e-4909-42c1-a32a-54e69f49644c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.758700 Nov 27 20:54:14.818404 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1442/2768] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:14 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:14.822899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:14.832849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: f83157fd-522c-4778-bc69-51b6ec64f565] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:14.851753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.852623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.853681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.854376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.906637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] HTTP exception thrown: Instance f83157fd-522c-4778-bc69-51b6ec64f565 could not be found. Nov 27 20:54:14.907404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Returning 404 to user: Instance f83157fd-522c-4778-bc69-51b6ec64f565 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:14.908349 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc3923fc-3e47-43e8-b835-8efe4caf8686 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565" status: 404 len: 111 microversion: 2.1 time: 0.088916 Nov 27 20:54:14.912299 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1443/2769] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:14 2021] GET /compute/v2.1/servers/f83157fd-522c-4778-bc69-51b6ec64f565 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:14.925513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:14.938387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:14.950063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:14.954204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.963797 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e45600f6-69c8-4af5-8772-31f258770224 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1403 microversion: 2.1 time: 0.321934 Nov 27 20:54:14.965225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.967160 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1327/2770] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:14 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1403 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:14.969681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.973251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.980574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:14.981124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:14.995814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.996401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:14.997303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:14.998472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.351202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:15.367264 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a8b2a69-2ac9-4cf7-beb5-bb48a2425185 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.398943 Nov 27 20:54:15.372221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1328/2771] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:14 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:15.378847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:15.381853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:15.399663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:15.404158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.405501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:15.406115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.407740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:15.418394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81f0d76b-652f-48dc-a838-314acafcb149 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1645 microversion: 2.1 time: 0.498877 Nov 27 20:54:15.423039 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1444/2772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:14 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1645 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:15.428666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:15.429460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:15.437764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:15.438924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.440213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:15.440848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.536397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:15.546981 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a156445a-4ae4-4019-8ebc-4f42cefd421f tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1274 microversion: 2.1 time: 0.172993 Nov 27 20:54:15.548443 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1329/2773] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:15 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:15.553992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-feacbbaa-cb6d-4125-8cb6-48fa6cddca9f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94de5e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:15.636610 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-feacbbaa-cb6d-4125-8cb6-48fa6cddca9f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.086866 Nov 27 20:54:15.637651 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1330/2774] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:15 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:15.663672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:15.673312 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca5b1b09-4508-4a89-a8f2-7ebb1273e859 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.248833 Nov 27 20:54:15.674247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1445/2775] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:15 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:15.827143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-87bad69e-3dcb-4b50-a45d-909d9eb13941 req-0112fcc8-f526-4154-9512-a0d6ecfc0196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83157fd-522c-4778-bc69-51b6ec64f565", "name": "network-vif-deleted", "tag": "bcaf48e3-c17f-47ae-a393-90c2200e0412"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:15.828769 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:15.828769 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:15.836738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:15.837963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:15.853439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:15.859083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.859934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:15.860374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.865462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-87bad69e-3dcb-4b50-a45d-909d9eb13941 req-0112fcc8-f526-4154-9512-a0d6ecfc0196 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:15.865638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-87bad69e-3dcb-4b50-a45d-909d9eb13941 req-0112fcc8-f526-4154-9512-a0d6ecfc0196 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:15.908072 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-87bad69e-3dcb-4b50-a45d-909d9eb13941 req-0112fcc8-f526-4154-9512-a0d6ecfc0196 service nova] Creating event network-vif-deleted:bcaf48e3-c17f-47ae-a393-90c2200e0412 for instance f83157fd-522c-4778-bc69-51b6ec64f565 on nch1-master-1 Nov 27 20:54:15.918040 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-87bad69e-3dcb-4b50-a45d-909d9eb13941 req-0112fcc8-f526-4154-9512-a0d6ecfc0196 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096920 Nov 27 20:54:15.921020 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1331/2776] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:15.986902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:15.987910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:16.003892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.004651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.008061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.009992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.111027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:16.122984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37962fb3-0a72-4000-b363-73a42910d6af tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.290456 Nov 27 20:54:16.133980 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1446/2777] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:15 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:16.215493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:16.215994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:16.223612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.224412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.225685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.226126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.249865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:16.257594 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d45cac22-e69f-4b83-82f3-1a3b19dfeba9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1403 microversion: 2.1 time: 0.276875 Nov 27 20:54:16.261879 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1332/2778] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:15 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1403 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:16.286326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:16.298019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-943035d9-984f-4325-a435-38124b03f65f req-a9e615d1-99cb-4d91-967d-7e3c363fbba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4915d7-d7e8-4026-b053-0daf8f1da2d9", "name": "network-vif-plugged", "status": "completed", "tag": "dd8f41df-2dbf-4de0-bf5b-e9b90b539e23"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:16.299622 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:16.299622 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:16.317721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-943035d9-984f-4325-a435-38124b03f65f req-a9e615d1-99cb-4d91-967d-7e3c363fbba8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.318159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-943035d9-984f-4325-a435-38124b03f65f req-a9e615d1-99cb-4d91-967d-7e3c363fbba8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.338450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-943035d9-984f-4325-a435-38124b03f65f req-a9e615d1-99cb-4d91-967d-7e3c363fbba8 service nova] Creating event network-vif-plugged:dd8f41df-2dbf-4de0-bf5b-e9b90b539e23 for instance 4c4915d7-d7e8-4026-b053-0daf8f1da2d9 on nch1-master-1 Nov 27 20:54:16.356612 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-943035d9-984f-4325-a435-38124b03f65f req-a9e615d1-99cb-4d91-967d-7e3c363fbba8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062217 Nov 27 20:54:16.358909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1333/2779] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:54:16.386563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:16.387287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:16.398983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.399464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.400263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.400718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.422404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-535980eb-456b-4a17-8258-f43414e39512 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "DELETE /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 204 len: 0 microversion: 2.1 time: 0.209376 Nov 27 20:54:16.424913 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1447/2780] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:16 2021] DELETE /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:16.446620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:16.452257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:16.463591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.466970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.470402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.470887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.654512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:16.669278 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-69d03dc4-146b-492f-87e8-6b4b0457f9a9 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1514 microversion: 2.1 time: 0.239189 Nov 27 20:54:16.686475 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1448/2781] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:16 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:16.694458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:16.695089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:16.710226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.712211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.713297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.714150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.748643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:16.763934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e912224-a984-4297-8d6f-603841f89ad1 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.381244 Nov 27 20:54:16.774743 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1334/2782] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:16 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:16.788246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:16.789164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:16.798406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.799704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.800646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:16.801196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:16.898658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:16.909721 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a4b50df6-f379-443d-b7ca-d08203998f07 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1280 microversion: 2.1 time: 0.133736 Nov 27 20:54:16.916319 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1335/2783] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:16 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:16.922771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d219c79c-1bb2-4126-96e6-e4edcf1e9b42 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9445f70>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:17.004425 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d219c79c-1bb2-4126-96e6-e4edcf1e9b42 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.084965 Nov 27 20:54:17.006026 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1336/2784] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:16 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:17.018934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:17.022710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:17.037494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:17.039394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.041086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.046245 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65768fce-2967-4075-b00f-d9f846f00e15 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1645 microversion: 2.1 time: 0.358632 Nov 27 20:54:17.047244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.047585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.050415 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1449/2785] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:16 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1645 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:17.142314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:17.142922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:17.156224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.159059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.161900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.162567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.420447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:17.430385 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af2ab3f3-4742-45b0-afa0-07ca58cc501f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.423045 Nov 27 20:54:17.443110 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1337/2786] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:17 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:17.455138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:17.456754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:17.475839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.476289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.477108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.477556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.550976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:17.565452 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9954a16-7af8-4eae-afd6-5dbd92d15748 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.427066 Nov 27 20:54:17.586151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1450/2787] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:17 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:17.688277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:17.690630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:17.709360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.711210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.715169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.717700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.839271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:17.854855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96fb09dc-2f78-4191-bcde-e567e876a483 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1403 microversion: 2.1 time: 0.410508 Nov 27 20:54:17.870112 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1338/2788] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:17 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1403 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:17.887026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:17.887840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:17.900996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.901446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:17.902280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:17.902724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.098898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:18.108083 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42daa91c-35ec-480c-a942-9789d5c79f1e tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1514 microversion: 2.1 time: 0.424860 Nov 27 20:54:18.110559 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1451/2789] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:17 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1514 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:18.115589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:18.116430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:18.128313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.129467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.130778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.131530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.308106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:18.317626 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-26dc50bf-4cbf-4812-84c9-071a40a7ec17 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1497 microversion: 2.1 time: 0.443663 Nov 27 20:54:18.319880 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1339/2790] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:17 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1497 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:18.329016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22506f5e-08bd-4e3e-b797-248bba0892e8 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d943f790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:18.358600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:18.370180 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3b5f24c-eab2-4b08-b87a-e4fa1537f878 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1322 microversion: 2.1 time: 0.258126 Nov 27 20:54:18.372234 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1452/2791] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:18 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:18.382563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0c430ff7-910d-40be-b7cf-ca582370d37d req-0ac6d1a3-2751-4f6b-ae47-2767c2e78420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f26b6b0-7e2f-457c-97b1-c88bde1e9df8", "name": "network-vif-deleted", "tag": "fb48d058-a5af-4ca6-ae15-d032b95d3013"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:18.386437 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:18.386437 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:18.398351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0c430ff7-910d-40be-b7cf-ca582370d37d req-0ac6d1a3-2751-4f6b-ae47-2767c2e78420 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.399030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0c430ff7-910d-40be-b7cf-ca582370d37d req-0ac6d1a3-2751-4f6b-ae47-2767c2e78420 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.413684 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0c430ff7-910d-40be-b7cf-ca582370d37d req-0ac6d1a3-2751-4f6b-ae47-2767c2e78420 service nova] Creating event network-vif-deleted:fb48d058-a5af-4ca6-ae15-d032b95d3013 for instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 on nch2-master-1 Nov 27 20:54:18.423910 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0c430ff7-910d-40be-b7cf-ca582370d37d req-0ac6d1a3-2751-4f6b-ae47-2767c2e78420 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049089 Nov 27 20:54:18.425147 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1453/2792] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:18.431726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:18.432888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:18.441164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.443281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.445421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.449739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.464483 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22506f5e-08bd-4e3e-b797-248bba0892e8 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.140073 Nov 27 20:54:18.465383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1340/2793] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:18 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:18.470338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c1da82f5-44f2-4e54-890b-797492375f0f req-1aa580ed-a800-4098-b648-259a5ea9841a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3742d74c-1fbd-42f7-8dd3-1af6053e9f28", "name": "network-vif-plugged", "status": "completed", "tag": "5f40e7d5-e01b-48c4-a853-15b07fbabc1f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:18.480050 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:18.480050 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:18.500944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c1da82f5-44f2-4e54-890b-797492375f0f req-1aa580ed-a800-4098-b648-259a5ea9841a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.501294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c1da82f5-44f2-4e54-890b-797492375f0f req-1aa580ed-a800-4098-b648-259a5ea9841a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.531605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.533729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.534339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lazy-loading 'fault' on Instance uuid 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:54:18.536330 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c1da82f5-44f2-4e54-890b-797492375f0f req-1aa580ed-a800-4098-b648-259a5ea9841a service nova] Creating event network-vif-plugged:5f40e7d5-e01b-48c4-a853-15b07fbabc1f for instance 3742d74c-1fbd-42f7-8dd3-1af6053e9f28 on nch2-master-1 Nov 27 20:54:18.545274 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c1da82f5-44f2-4e54-890b-797492375f0f req-1aa580ed-a800-4098-b648-259a5ea9841a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077929 Nov 27 20:54:18.546441 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1341/2794] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:18.553190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:18.554171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:18.581774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.582629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.583791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.584663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.631477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:18.647403 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-941fd798-2310-4951-97fb-35541a669b87 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 200 len: 1305 microversion: 2.1 time: 0.213034 Nov 27 20:54:18.649458 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1454/2795] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:18 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:18.660398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:18.661894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:18.672301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.673029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.674657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.675313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.945966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:18.962360 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0469658-42d7-4ded-bfa1-71170ecb6800 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.309367 Nov 27 20:54:18.963828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1455/2796] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:18 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:18.969850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:18.970642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:18.977800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.978930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:18.979930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:18.980636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.158063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:19.170220 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bdde337b-942e-4df7-9306-22c6d6b80f0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1591 microversion: 2.1 time: 0.203710 Nov 27 20:54:19.171353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1456/2797] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:18 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1591 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:19.176232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:19.177016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:19.184772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.186522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.190040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.191088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.339297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:19.359096 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb8530d6-10cd-48a8-ad5d-b5d8e3781e00 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1349 microversion: 2.1 time: 0.810977 Nov 27 20:54:19.364875 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1342/2798] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:18 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1349 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:19.379085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c93b4bf-1d83-4759-9e4f-ad3731bb6352 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:19.379918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c93b4bf-1d83-4759-9e4f-ad3731bb6352 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:19.416177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c93b4bf-1d83-4759-9e4f-ad3731bb6352 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.416768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c93b4bf-1d83-4759-9e4f-ad3731bb6352 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.417722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c93b4bf-1d83-4759-9e4f-ad3731bb6352 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.418272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c93b4bf-1d83-4759-9e4f-ad3731bb6352 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.513904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:19.532136 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-601b35f3-68dd-4c71-ba11-acc9b7b7cfdd tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 200 len: 1514 microversion: 2.1 time: 0.351161 Nov 27 20:54:19.545082 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1457/2799] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:19 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:19.545082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:19.545082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:19.560985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.562526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.563479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.563989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.741889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:19.750558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c32e1812-1695-4a59-8ad2-907bcc3d924c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 200 len: 1474 microversion: 2.1 time: 0.216461 Nov 27 20:54:19.751166 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1458/2800] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:19 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 1474 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:19.769747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-92978136-df9b-4d43-9437-a76c86649e1e req-c65810bf-5c86-48b2-9e78-a4a6432bb7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1248fe45-c107-4977-b69b-eba5a348ec41", "tag": "36e23715-b371-4509-b3a1-1a6ee03ca0a6"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:19.771475 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:19.771475 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:19.780032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-92978136-df9b-4d43-9437-a76c86649e1e req-c65810bf-5c86-48b2-9e78-a4a6432bb7c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.780482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-92978136-df9b-4d43-9437-a76c86649e1e req-c65810bf-5c86-48b2-9e78-a4a6432bb7c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.793349 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-92978136-df9b-4d43-9437-a76c86649e1e req-c65810bf-5c86-48b2-9e78-a4a6432bb7c3 service nova] Creating event network-changed:36e23715-b371-4509-b3a1-1a6ee03ca0a6 for instance 1248fe45-c107-4977-b69b-eba5a348ec41 on nch1-master-1 Nov 27 20:54:19.799040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-92978136-df9b-4d43-9437-a76c86649e1e req-c65810bf-5c86-48b2-9e78-a4a6432bb7c3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034359 Nov 27 20:54:19.800196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1459/2801] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:19.805644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:19.806344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:19.813585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.814044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.814838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.815302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.840038 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c93b4bf-1d83-4759-9e4f-ad3731bb6352 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.473727 Nov 27 20:54:19.841979 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1343/2802] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:54:19 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/os-interface => generated 285 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:19.853706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10bae74e-7f6b-41dd-aeb4-28ec545a2c69 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9449a60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:19.929779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10bae74e-7f6b-41dd-aeb4-28ec545a2c69 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1453 microversion: 2.1 time: 0.079664 Nov 27 20:54:19.931292 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1344/2803] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:19 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:19.937458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:19.938208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:19.945110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.946228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.947373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.948030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.969805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 could not be found. Nov 27 20:54:19.970686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:19.972024 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b9d2422-9d9c-494e-841b-0c936d488b94 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 404 len: 111 microversion: 2.1 time: 0.038605 Nov 27 20:54:19.973397 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1345/2804] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:19 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:19.978679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb09c9a7-39b6-4e2b-b207-799b4a9e8d6c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-304817086"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:19.980122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb09c9a7-39b6-4e2b-b207-799b4a9e8d6c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:19.987027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb09c9a7-39b6-4e2b-b207-799b4a9e8d6c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.987963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb09c9a7-39b6-4e2b-b207-799b4a9e8d6c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:19.989027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb09c9a7-39b6-4e2b-b207-799b4a9e8d6c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:19.989729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb09c9a7-39b6-4e2b-b207-799b4a9e8d6c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:20.372217 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb09c9a7-39b6-4e2b-b207-799b4a9e8d6c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0/action" status: 202 len: 0 microversion: 2.1 time: 0.397030 Nov 27 20:54:20.374361 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1346/2805] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:19 2021] POST /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:54:20.401572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:20.402356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:20.420985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:20.421444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:20.424057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:20.424515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:20.744813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:20.757993 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-207486c6-016f-43ff-a909-24758388bc3e tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1322 microversion: 2.1 time: 0.956575 Nov 27 20:54:20.764029 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1460/2806] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:19 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:20.769522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-63401f0d-e27c-49ab-a6a7-5834bb76af8b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d94f9d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:20.851183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:20.867467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4f6c9bca-2c2c-4a35-b8d9-ff98f3a1d454 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.485698 Nov 27 20:54:20.868635 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1347/2807] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:20 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:20.875365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:20.880707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:20.896164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:20.897112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:20.898103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:20.898697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.173349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:21.186836 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2dbc53d4-cdf2-41f9-a15e-2a825dc04ec7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1538 microversion: 2.1 time: 0.313101 Nov 27 20:54:21.201882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1348/2808] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:20 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1538 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:21.208612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c017e5d5-3ea4-4099-a54e-8f54d7b025d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94badc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.271614 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-63401f0d-e27c-49ab-a6a7-5834bb76af8b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/d1cf470f-d002-4517-acfa-7dfc330e54d7" status: 202 len: 0 microversion: 2.1 time: 0.506096 Nov 27 20:54:21.272306 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1461/2809] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:20 2021] DELETE /compute/v2.1/os-security-groups/d1cf470f-d002-4517-acfa-7dfc330e54d7 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:21.277416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.278026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: acbf72fc-e72f-4963-8664-b1b1260f8f89] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:21.295411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.295854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.296838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.297457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.312014 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c017e5d5-3ea4-4099-a54e-8f54d7b025d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.109098 Nov 27 20:54:21.312914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1349/2810] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:21 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:21.319906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ea18d34-c56a-437e-86cd-8a48c7517c4b tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94ba3a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.326183 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] HTTP exception thrown: Instance acbf72fc-e72f-4963-8664-b1b1260f8f89 could not be found. Nov 27 20:54:21.333586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Returning 404 to user: Instance acbf72fc-e72f-4963-8664-b1b1260f8f89 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:21.336194 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58de1381-0a0a-469f-8cae-5b83bee7b0a0 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89" status: 404 len: 111 microversion: 2.1 time: 0.062523 Nov 27 20:54:21.337338 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1462/2811] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:21 2021] GET /compute/v2.1/servers/acbf72fc-e72f-4963-8664-b1b1260f8f89 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:21.351712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e95bb7dc-9b91-46da-91ab-a0893056400c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.353960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e95bb7dc-9b91-46da-91ab-a0893056400c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:21.369462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95bb7dc-9b91-46da-91ab-a0893056400c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.369990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95bb7dc-9b91-46da-91ab-a0893056400c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.373045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95bb7dc-9b91-46da-91ab-a0893056400c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.375184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e95bb7dc-9b91-46da-91ab-a0893056400c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.406068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ea18d34-c56a-437e-86cd-8a48c7517c4b tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1462 microversion: 2.1 time: 0.091630 Nov 27 20:54:21.407985 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1350/2812] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:21 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:21.418020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ff2c0e5-c670-41fa-b583-9d4aebd86011 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c727a1f0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.516022 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e95bb7dc-9b91-46da-91ab-a0893056400c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177541 Nov 27 20:54:21.516646 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1463/2813] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:54:21 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:21.521826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.522869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:21.529568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.530014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.530985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.531445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.560919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:21.646946 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e551f18-6493-4b7c-8635-da00752795f2 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 204 len: 0 microversion: 2.1 time: 0.128732 Nov 27 20:54:21.648095 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1464/2814] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:21 2021] DELETE /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:21.655690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c11a3ca4-85f0-405e-a156-4c95a5233117 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d95293a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.704986 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c11a3ca4-85f0-405e-a156-4c95a5233117 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 200 len: 1462 microversion: 2.1 time: 0.055341 Nov 27 20:54:21.706062 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1465/2815] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:21 2021] GET /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 1462 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:21.710624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.712222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:21.722707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.723968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.725079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:21.725719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:21.977622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:21.986846 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-379c0925-555d-4527-8c91-3ad64d845d0c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1513 microversion: 2.1 time: 0.279559 Nov 27 20:54:21.987560 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1466/2816] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:21 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:21.992064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:21.992901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:22.009667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.010175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.011209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.012410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.027966 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ff2c0e5-c670-41fa-b583-9d4aebd86011 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/ab7e8c7d-1033-438d-9cdf-65069ed8573d" status: 202 len: 0 microversion: 2.1 time: 0.618150 Nov 27 20:54:22.029238 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1351/2817] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:21 2021] DELETE /compute/v2.1/os-security-groups/ab7e8c7d-1033-438d-9cdf-65069ed8573d => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:22.042176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:22.043083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:22.060451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.061081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.061943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.063466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.224972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:22.234587 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fded1e0f-019b-4e9e-a242-9d74562b1cc5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 200 len: 1466 microversion: 2.1 time: 0.245734 Nov 27 20:54:22.235359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1467/2818] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:21 2021] GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:22.243764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fb9cc0b7-607a-4f24-84e4-6b97c1337bce req-e9386d9d-b92e-459b-bc3e-1ebdb29b6bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbf72fc-e72f-4963-8664-b1b1260f8f89", "name": "network-vif-deleted", "tag": "1597305a-cd19-4e32-92a0-39078f81c889"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:22.246092 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:22.246092 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:22.256294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fb9cc0b7-607a-4f24-84e4-6b97c1337bce req-e9386d9d-b92e-459b-bc3e-1ebdb29b6bb5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.256836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fb9cc0b7-607a-4f24-84e4-6b97c1337bce req-e9386d9d-b92e-459b-bc3e-1ebdb29b6bb5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.268641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fb9cc0b7-607a-4f24-84e4-6b97c1337bce req-e9386d9d-b92e-459b-bc3e-1ebdb29b6bb5 service nova] Creating event network-vif-deleted:1597305a-cd19-4e32-92a0-39078f81c889 for instance acbf72fc-e72f-4963-8664-b1b1260f8f89 on nch1-master-1 Nov 27 20:54:22.275282 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fb9cc0b7-607a-4f24-84e4-6b97c1337bce req-e9386d9d-b92e-459b-bc3e-1ebdb29b6bb5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037890 Nov 27 20:54:22.275971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1468/2819] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:22.282081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:22.282769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:22.288783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.289228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.290197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.290799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.439000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:22.448976 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2441042-5733-4943-acfa-9e97aa1cea45 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.170813 Nov 27 20:54:22.450007 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1469/2820] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:22 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:22.454074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-824fae0c-8e79-4df3-85c1-9fe4bd6613da tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:22.455046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-824fae0c-8e79-4df3-85c1-9fe4bd6613da tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:22.469658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-824fae0c-8e79-4df3-85c1-9fe4bd6613da tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.470255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-824fae0c-8e79-4df3-85c1-9fe4bd6613da tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.472202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-824fae0c-8e79-4df3-85c1-9fe4bd6613da tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.472757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-824fae0c-8e79-4df3-85c1-9fe4bd6613da tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.514087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-824fae0c-8e79-4df3-85c1-9fe4bd6613da tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.063280 Nov 27 20:54:22.514994 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1470/2821] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:22 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:22.520042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b1f65d3d-1d06-4772-832e-f76cb2820dcc req-4b3ce536-6bd0-4683-b4ae-4677a9add4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4915d7-d7e8-4026-b053-0daf8f1da2d9", "tag": "dd8f41df-2dbf-4de0-bf5b-e9b90b539e23"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:22.521777 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:22.521777 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:22.530178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b1f65d3d-1d06-4772-832e-f76cb2820dcc req-4b3ce536-6bd0-4683-b4ae-4677a9add4a8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.530625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b1f65d3d-1d06-4772-832e-f76cb2820dcc req-4b3ce536-6bd0-4683-b4ae-4677a9add4a8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.543066 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b1f65d3d-1d06-4772-832e-f76cb2820dcc req-4b3ce536-6bd0-4683-b4ae-4677a9add4a8 service nova] Creating event network-changed:dd8f41df-2dbf-4de0-bf5b-e9b90b539e23 for instance 4c4915d7-d7e8-4026-b053-0daf8f1da2d9 on nch1-master-1 Nov 27 20:54:22.549003 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b1f65d3d-1d06-4772-832e-f76cb2820dcc req-4b3ce536-6bd0-4683-b4ae-4677a9add4a8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032475 Nov 27 20:54:22.550013 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1471/2822] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:22.555766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-64af8998-26e5-4e2a-8408-afa0b4d1c072 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'create', calling method: .version_select at 0x7f15d94bb430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-907564468", "description": "tempest-description-1307861968"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:22.733473 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-64af8998-26e5-4e2a-8408-afa0b4d1c072 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.181768 Nov 27 20:54:22.734269 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1472/2823] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:54:22 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:22.739110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0339f573-18c3-4808-9e07-860949d9514a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-244877053"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:22.740848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0339f573-18c3-4808-9e07-860949d9514a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:22.749123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0339f573-18c3-4808-9e07-860949d9514a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.749685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0339f573-18c3-4808-9e07-860949d9514a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.750783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0339f573-18c3-4808-9e07-860949d9514a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:22.751541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0339f573-18c3-4808-9e07-860949d9514a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:22.918521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:22.933756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1804e32-75fe-48a4-89cf-c69dbef7aed2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1322 microversion: 2.1 time: 0.903152 Nov 27 20:54:22.936237 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1352/2824] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:22 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1322 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:22.946294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-555920dc-f082-4e1f-bdf5-4eb7cb2d9912 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94badc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:23.007672 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-555920dc-f082-4e1f-bdf5-4eb7cb2d9912 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.068870 Nov 27 20:54:23.008248 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1353/2825] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:22 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:23.013180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed64e86b-5a91-4aaa-89f8-037ae2f9c572 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Action: 'update', calling method: .version_select at 0x7f15d9459790>, body: {"security_group": {"name": "tempest-sg-hth-1578975193", "description": "tempest-description-hth-1638382519"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:23.043628 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0339f573-18c3-4808-9e07-860949d9514a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "POST /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad/action" status: 202 len: 0 microversion: 2.1 time: 0.307869 Nov 27 20:54:23.045199 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1473/2826] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:22 2021] POST /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:54:23.056686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:23.057410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:23.067411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.067966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.068868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.069383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.245247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:23.258325 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a617f75f-d241-4ed2-9100-5ae5220b8235 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1513 microversion: 2.1 time: 0.210483 Nov 27 20:54:23.268569 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1474/2827] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:23 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:23.268569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23c06c24-00b3-4e7a-8f12-73a56b8be174 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c739f5e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:23.316501 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23c06c24-00b3-4e7a-8f12-73a56b8be174 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.055017 Nov 27 20:54:23.322864 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1475/2828] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:23 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:23.467111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:23.467772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:23.474108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.474693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.475619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.476165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.635925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:23.656994 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68192b03-99e8-40e9-9184-4c80c5a569cc tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.185331 Nov 27 20:54:23.667414 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1476/2829] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:23 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:23.678509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8364eb1b-25d0-497a-abff-4b03b1dbb55f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:23.679593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8364eb1b-25d0-497a-abff-4b03b1dbb55f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:23.689285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8364eb1b-25d0-497a-abff-4b03b1dbb55f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.690059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8364eb1b-25d0-497a-abff-4b03b1dbb55f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.691312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8364eb1b-25d0-497a-abff-4b03b1dbb55f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.691934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8364eb1b-25d0-497a-abff-4b03b1dbb55f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.742757 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8364eb1b-25d0-497a-abff-4b03b1dbb55f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.077521 Nov 27 20:54:23.743722 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1477/2830] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:23 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:23.820947 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed64e86b-5a91-4aaa-89f8-037ae2f9c572 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "PUT /compute/v2.1/os-security-groups/6715f08b-00a7-4c97-b437-d0d0603d9efa" status: 200 len: 218 microversion: 2.1 time: 0.811465 Nov 27 20:54:23.829256 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1354/2831] 10.222.0.21 () {60 vars in 1289 bytes} [Sat Nov 27 20:54:23 2021] PUT /compute/v2.1/os-security-groups/6715f08b-00a7-4c97-b437-d0d0603d9efa => generated 218 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:23.833688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0f0c320-6dbd-44c5-bc09-ddb55496e774 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d95035e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:23.952518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:23.953249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:23.958059 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0f0c320-6dbd-44c5-bc09-ddb55496e774 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/6715f08b-00a7-4c97-b437-d0d0603d9efa" status: 200 len: 218 microversion: 2.1 time: 0.128557 Nov 27 20:54:23.959044 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1478/2832] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:54:23 2021] GET /compute/v2.1/os-security-groups/6715f08b-00a7-4c97-b437-d0d0603d9efa => generated 218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:23.969718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.970522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.971762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:23.972391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:23.978910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9abe5733-5ca2-49ca-a85c-53e9939cd73b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d94ee3a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.304341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9abe5733-5ca2-49ca-a85c-53e9939cd73b tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/6715f08b-00a7-4c97-b437-d0d0603d9efa" status: 202 len: 0 microversion: 2.1 time: 0.337085 Nov 27 20:54:24.307903 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1479/2833] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:23 2021] DELETE /compute/v2.1/os-security-groups/6715f08b-00a7-4c97-b437-d0d0603d9efa => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:24.316650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0db5e12-0cab-495e-abc0-e1b0c7393845 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94e4430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.377385 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0db5e12-0cab-495e-abc0-e1b0c7393845 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.067652 Nov 27 20:54:24.387643 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1480/2834] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:24 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:24.394762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-076193a2-f567-4922-9d07-50bcd4e847fb req-62074872-98cf-4ba0-9360-44f4d2df8476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322cb011-f54a-4dd9-92b9-6c9478c4333c", "name": "network-vif-unplugged", "status": "completed", "tag": "f582af39-1252-42ce-a0f7-29c2ea84cba2"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:24.396739 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:24.396739 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:24.406102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-076193a2-f567-4922-9d07-50bcd4e847fb req-62074872-98cf-4ba0-9360-44f4d2df8476 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.406846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-076193a2-f567-4922-9d07-50bcd4e847fb req-62074872-98cf-4ba0-9360-44f4d2df8476 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.425404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-076193a2-f567-4922-9d07-50bcd4e847fb req-62074872-98cf-4ba0-9360-44f4d2df8476 service nova] Creating event network-vif-unplugged:f582af39-1252-42ce-a0f7-29c2ea84cba2 for instance 322cb011-f54a-4dd9-92b9-6c9478c4333c on nch1-master-1 Nov 27 20:54:24.432429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-076193a2-f567-4922-9d07-50bcd4e847fb req-62074872-98cf-4ba0-9360-44f4d2df8476 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042659 Nov 27 20:54:24.433782 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1481/2835] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:24.443164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.449380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:24.459675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.460651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.461667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.462339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.537151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:24.549613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b0b1cd6-3a31-490a-b4a3-f9eb2aa2e94a tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 200 len: 1471 microversion: 2.1 time: 0.114152 Nov 27 20:54:24.550745 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1482/2836] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:24 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 1471 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:24.565887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.566532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:24.573307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.574355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.576265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.576958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.594685 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 could not be found. Nov 27 20:54:24.595779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:24.597044 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92bc7451-763f-474a-ae4a-0b872b735793 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 404 len: 111 microversion: 2.1 time: 0.045048 Nov 27 20:54:24.598127 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1483/2837] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:24 2021] DELETE /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:24.605278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e259d709-2f3a-4eb1-bef0-63e9f552ea39 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c73acd30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.657593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:24.670884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e259d709-2f3a-4eb1-bef0-63e9f552ea39 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.071487 Nov 27 20:54:24.671702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0b3335aa-3bd8-4db2-9eed-cbf1036c67ca tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1322 microversion: 2.1 time: 0.722928 Nov 27 20:54:24.672478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1484/2838] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:24 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:24.680959 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1355/2839] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:23 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:24.685208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-dcd8220f-23f7-4f9d-b4b3-70bcd33f35bb req-b6dd0c0c-7ee6-4826-9805-02288ba09118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7cfd43-2058-4943-b00e-471de21cbe0e", "name": "network-vif-deleted", "tag": "0437b053-b2e1-4749-ac48-4e6a8a0dc423"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:24.687071 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:24.687071 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:24.688574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.689729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:24.695973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dcd8220f-23f7-4f9d-b4b3-70bcd33f35bb req-b6dd0c0c-7ee6-4826-9805-02288ba09118 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.696538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dcd8220f-23f7-4f9d-b4b3-70bcd33f35bb req-b6dd0c0c-7ee6-4826-9805-02288ba09118 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.697725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.699076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.700165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.701458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.709804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-dcd8220f-23f7-4f9d-b4b3-70bcd33f35bb req-b6dd0c0c-7ee6-4826-9805-02288ba09118 service nova] Creating event network-vif-deleted:0437b053-b2e1-4749-ac48-4e6a8a0dc423 for instance ad7cfd43-2058-4943-b00e-471de21cbe0e on nch2-master-1 Nov 27 20:54:24.715112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-dcd8220f-23f7-4f9d-b4b3-70bcd33f35bb req-b6dd0c0c-7ee6-4826-9805-02288ba09118 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041273 Nov 27 20:54:24.720731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1485/2840] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:24.726365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.727436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:24.734928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.735896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.737010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.737740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.739453 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 could not be found. Nov 27 20:54:24.740173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Instance 6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:24.741129 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1adedef8-6296-4244-b8ee-9976ca9aa5fd tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8" status: 404 len: 111 microversion: 2.1 time: 0.058918 Nov 27 20:54:24.742017 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1356/2841] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:24 2021] GET /compute/v2.1/servers/6f26b6b0-7e2f-457c-97b1-c88bde1e9df8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:24.750325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d91f57c-6bbe-4e1d-9ccf-748bac17348f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d9464dc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.785816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-7d91f57c-6bbe-4e1d-9ccf-748bac17348f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab7e8c7d-1033-438d-9cdf-65069ed8573d does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:24.786719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-7d91f57c-6bbe-4e1d-9ccf-748bac17348f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group ab7e8c7d-1033-438d-9cdf-65069ed8573d not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:54:24.787458 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-7d91f57c-6bbe-4e1d-9ccf-748bac17348f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group ab7e8c7d-1033-438d-9cdf-65069ed8573d does not exist Nov 27 20:54:24.787458 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-d78730a4-28b3-4c3f-8d9b-452cfff6e770'] Nov 27 20:54:24.788220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d91f57c-6bbe-4e1d-9ccf-748bac17348f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group ab7e8c7d-1033-438d-9cdf-65069ed8573d does not exist Nov 27 20:54:24.788220 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-d78730a4-28b3-4c3f-8d9b-452cfff6e770'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:24.789678 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d91f57c-6bbe-4e1d-9ccf-748bac17348f tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/ab7e8c7d-1033-438d-9cdf-65069ed8573d" status: 404 len: 194 microversion: 2.1 time: 0.043556 Nov 27 20:54:24.793896 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1357/2842] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:24 2021] DELETE /compute/v2.1/os-security-groups/ab7e8c7d-1033-438d-9cdf-65069ed8573d => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:54:24.799128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18505bd1-c439-45fd-91d4-3aa04b988faa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:24.800461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18505bd1-c439-45fd-91d4-3aa04b988faa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:24.817314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18505bd1-c439-45fd-91d4-3aa04b988faa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.817981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18505bd1-c439-45fd-91d4-3aa04b988faa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.818859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18505bd1-c439-45fd-91d4-3aa04b988faa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.819403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18505bd1-c439-45fd-91d4-3aa04b988faa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.868990 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18505bd1-c439-45fd-91d4-3aa04b988faa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.073411 Nov 27 20:54:24.872937 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1358/2843] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:24 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:24.877722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-789bebf1-69f3-47b1-a497-8ebc8ecd57a5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15c727a280>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.897397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:24.906407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c63dc34f-f683-45c6-ab10-e0fcad4cf733 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1515 microversion: 2.1 time: 0.184108 Nov 27 20:54:24.907121 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1486/2844] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:24 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:24.912131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6780f5b4-97fd-4d9d-b530-faf58e44fa5f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:24.913103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6780f5b4-97fd-4d9d-b530-faf58e44fa5f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:24.916505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-789bebf1-69f3-47b1-a497-8ebc8ecd57a5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1cf470f-d002-4517-acfa-7dfc330e54d7 does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:24.917538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-789bebf1-69f3-47b1-a497-8ebc8ecd57a5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group d1cf470f-d002-4517-acfa-7dfc330e54d7 not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:54:24.918437 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-789bebf1-69f3-47b1-a497-8ebc8ecd57a5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group d1cf470f-d002-4517-acfa-7dfc330e54d7 does not exist Nov 27 20:54:24.918437 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-5292e7f1-7558-4bab-8058-c4e67f5aa709'] Nov 27 20:54:24.919860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-789bebf1-69f3-47b1-a497-8ebc8ecd57a5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group d1cf470f-d002-4517-acfa-7dfc330e54d7 does not exist Nov 27 20:54:24.919860 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-5292e7f1-7558-4bab-8058-c4e67f5aa709'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:24.920774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6780f5b4-97fd-4d9d-b530-faf58e44fa5f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.921393 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-789bebf1-69f3-47b1-a497-8ebc8ecd57a5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/d1cf470f-d002-4517-acfa-7dfc330e54d7" status: 404 len: 194 microversion: 2.1 time: 0.049845 Nov 27 20:54:24.921807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6780f5b4-97fd-4d9d-b530-faf58e44fa5f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.922772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6780f5b4-97fd-4d9d-b530-faf58e44fa5f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.923465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6780f5b4-97fd-4d9d-b530-faf58e44fa5f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.926359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1359/2845] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:24 2021] DELETE /compute/v2.1/os-security-groups/d1cf470f-d002-4517-acfa-7dfc330e54d7 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:24.933298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d0f324b6-87cf-4c96-93b0-7b24f17d5ee2 req-52214f3c-a206-4217-9631-692c54952d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3742d74c-1fbd-42f7-8dd3-1af6053e9f28", "tag": "5f40e7d5-e01b-48c4-a853-15b07fbabc1f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:24.936806 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:24.936806 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:24.946984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d0f324b6-87cf-4c96-93b0-7b24f17d5ee2 req-52214f3c-a206-4217-9631-692c54952d72 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:24.948318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d0f324b6-87cf-4c96-93b0-7b24f17d5ee2 req-52214f3c-a206-4217-9631-692c54952d72 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:24.966035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d0f324b6-87cf-4c96-93b0-7b24f17d5ee2 req-52214f3c-a206-4217-9631-692c54952d72 service nova] Creating event network-changed:5f40e7d5-e01b-48c4-a853-15b07fbabc1f for instance 3742d74c-1fbd-42f7-8dd3-1af6053e9f28 on nch2-master-1 Nov 27 20:54:24.974179 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d0f324b6-87cf-4c96-93b0-7b24f17d5ee2 req-52214f3c-a206-4217-9631-692c54952d72 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046587 Nov 27 20:54:24.974393 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6780f5b4-97fd-4d9d-b530-faf58e44fa5f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.065785 Nov 27 20:54:24.975139 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1487/2846] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:24 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:24.980446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e412187d-872f-4b19-990f-f89ed5877b5c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d94e4160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:24.980890 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1360/2847] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:25.011291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-e412187d-872f-4b19-990f-f89ed5877b5c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:25.011901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-e412187d-872f-4b19-990f-f89ed5877b5c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 not found {{(pid=135680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:54:25.013057 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e412187d-872f-4b19-990f-f89ed5877b5c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 does not exist Nov 27 20:54:25.013057 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-533796c9-a7da-4f0d-a622-3dda82433987'] Nov 27 20:54:25.013987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e412187d-872f-4b19-990f-f89ed5877b5c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group 432dc27c-42ce-4c46-bb75-098a5c24ef26 does not exist Nov 27 20:54:25.013987 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-533796c9-a7da-4f0d-a622-3dda82433987'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:25.016058 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e412187d-872f-4b19-990f-f89ed5877b5c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/432dc27c-42ce-4c46-bb75-098a5c24ef26" status: 404 len: 194 microversion: 2.1 time: 0.038745 Nov 27 20:54:25.016225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1488/2848] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:24 2021] DELETE /compute/v2.1/os-security-groups/432dc27c-42ce-4c46-bb75-098a5c24ef26 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:25.025538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5c8ce902-5cef-49bd-b413-053929061b44 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d943f550>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.060732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-5c8ce902-5cef-49bd-b413-053929061b44 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bca48df5-5161-4586-b716-27c26861f49a does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:25.061606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-5c8ce902-5cef-49bd-b413-053929061b44 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group bca48df5-5161-4586-b716-27c26861f49a not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:54:25.063539 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5c8ce902-5cef-49bd-b413-053929061b44 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group bca48df5-5161-4586-b716-27c26861f49a does not exist Nov 27 20:54:25.063539 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-009639bb-3919-4759-809f-06f23bbdf1cb'] Nov 27 20:54:25.064715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5c8ce902-5cef-49bd-b413-053929061b44 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group bca48df5-5161-4586-b716-27c26861f49a does not exist Nov 27 20:54:25.064715 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-009639bb-3919-4759-809f-06f23bbdf1cb'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:25.065597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5c8ce902-5cef-49bd-b413-053929061b44 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/bca48df5-5161-4586-b716-27c26861f49a" status: 404 len: 194 microversion: 2.1 time: 0.045301 Nov 27 20:54:25.066267 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1361/2849] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:25 2021] DELETE /compute/v2.1/os-security-groups/bca48df5-5161-4586-b716-27c26861f49a => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:54:25.077147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e16e944-7936-47d5-b1af-714d4c76eea4 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d951a790>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.140441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-5e16e944-7936-47d5-b1af-714d4c76eea4 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:25.141048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-5e16e944-7936-47d5-b1af-714d4c76eea4 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 not found {{(pid=135680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:54:25.141569 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-5e16e944-7936-47d5-b1af-714d4c76eea4 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 does not exist Nov 27 20:54:25.141569 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-4cd42a25-a48c-4341-b718-d146fe5e4b7c'] Nov 27 20:54:25.142346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e16e944-7936-47d5-b1af-714d4c76eea4 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group c0d4bd04-c9dd-4a01-b736-42dedf89aae5 does not exist Nov 27 20:54:25.142346 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-4cd42a25-a48c-4341-b718-d146fe5e4b7c'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:25.143232 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e16e944-7936-47d5-b1af-714d4c76eea4 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/c0d4bd04-c9dd-4a01-b736-42dedf89aae5" status: 404 len: 194 microversion: 2.1 time: 0.072877 Nov 27 20:54:25.144014 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1489/2850] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:25 2021] DELETE /compute/v2.1/os-security-groups/c0d4bd04-c9dd-4a01-b736-42dedf89aae5 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:54:25.153577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc5236bb-4c4d-482c-a89b-957c06141c65 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d94944c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.177129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG neutronclient.v2_0.client [None req-fc5236bb-4c4d-482c-a89b-957c06141c65 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ed005e21-fa12-4398-855c-906f54804dc1 does not exist", "detail": ""}} {{(pid=135679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:54:25.177799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-fc5236bb-4c4d-482c-a89b-957c06141c65 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Neutron security group ed005e21-fa12-4398-855c-906f54804dc1 not found {{(pid=135679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:54:25.178401 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-fc5236bb-4c4d-482c-a89b-957c06141c65 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Security group ed005e21-fa12-4398-855c-906f54804dc1 does not exist Nov 27 20:54:25.178401 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-53530869-2bec-4e22-aec8-104b5db98b28'] Nov 27 20:54:25.179002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc5236bb-4c4d-482c-a89b-957c06141c65 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Security group ed005e21-fa12-4398-855c-906f54804dc1 does not exist Nov 27 20:54:25.179002 ncdv-master-1 devstack@n-api.service[135679]: Neutron server returns request_ids: ['req-53530869-2bec-4e22-aec8-104b5db98b28'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:25.180035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc5236bb-4c4d-482c-a89b-957c06141c65 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1" status: 404 len: 194 microversion: 2.1 time: 0.031890 Nov 27 20:54:25.184023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1362/2851] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:25 2021] DELETE /compute/v2.1/os-security-groups/ed005e21-fa12-4398-855c-906f54804dc1 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:25.191108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.192074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:25.212113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.212554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.213385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.214158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.243856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:25.391630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f1849a4-3d79-403e-9f09-59b9a445ec1d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d944ac10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.436945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b1db224-8230-42a1-af69-511cfac47ad5 tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 204 len: 0 microversion: 2.1 time: 0.251534 Nov 27 20:54:25.438377 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1490/2852] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:25 2021] DELETE /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:54:25.456254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.457287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:25.469874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.470330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.471125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.471585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.483956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f1849a4-3d79-403e-9f09-59b9a445ec1d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.096364 Nov 27 20:54:25.484813 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1363/2853] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:25 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:25.569784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.570747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: ad7cfd43-2058-4943-b00e-471de21cbe0e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:25.581534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.581986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.582775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.583208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.598523 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] HTTP exception thrown: Instance ad7cfd43-2058-4943-b00e-471de21cbe0e could not be found. Nov 27 20:54:25.599107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Returning 404 to user: Instance ad7cfd43-2058-4943-b00e-471de21cbe0e could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:25.599967 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f3a83b85-5ddb-436c-8f26-d0e3a336bd26 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e" status: 404 len: 111 microversion: 2.1 time: 0.036096 Nov 27 20:54:25.600723 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1364/2854] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:25 2021] GET /compute/v2.1/servers/ad7cfd43-2058-4943-b00e-471de21cbe0e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:25.685561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3062dbe0-572f-446d-97fe-f1a41a95530f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9502160>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.780862 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3062dbe0-572f-446d-97fe-f1a41a95530f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.100497 Nov 27 20:54:25.789028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1365/2855] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:25 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:25.795002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.795925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:25.803182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.804050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.805100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.805781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.836004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:25.846051 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ab863eb-f3a5-4c43-9277-49eb65fff27c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1646 microversion: 2.1 time: 0.400841 Nov 27 20:54:25.846410 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1491/2856] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:25 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1646 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:25.890566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddf8675c-7f85-4be7-91dd-9f9d260a9329 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:25.891664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddf8675c-7f85-4be7-91dd-9f9d260a9329 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:25.911059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddf8675c-7f85-4be7-91dd-9f9d260a9329 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.911833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddf8675c-7f85-4be7-91dd-9f9d260a9329 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.913000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddf8675c-7f85-4be7-91dd-9f9d260a9329 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.913718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddf8675c-7f85-4be7-91dd-9f9d260a9329 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.969920 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddf8675c-7f85-4be7-91dd-9f9d260a9329 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.091367 Nov 27 20:54:25.970896 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1492/2857] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:25 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:25.978412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:25.979454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:25.986779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.987274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:25.988182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:25.988736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.006291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:26.022049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c3a142d-ad20-4739-b1d7-c9175c81da3d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1322 microversion: 2.1 time: 0.231011 Nov 27 20:54:26.023561 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1366/2858] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:25 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:26.029788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c24dec16-7850-484c-9290-318b8c21e073 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:26.031648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c24dec16-7850-484c-9290-318b8c21e073 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:26.039239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c24dec16-7850-484c-9290-318b8c21e073 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.040453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c24dec16-7850-484c-9290-318b8c21e073 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.042262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c24dec16-7850-484c-9290-318b8c21e073 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.043082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c24dec16-7850-484c-9290-318b8c21e073 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.097713 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c24dec16-7850-484c-9290-318b8c21e073 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.072475 Nov 27 20:54:26.099380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1367/2859] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:26 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:26.186870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:26.196714 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-76206c04-0e4c-4688-afbe-b0041edeb575 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.222750 Nov 27 20:54:26.197179 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1493/2860] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:25 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:26.497254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-467caf41-5b4e-4ff0-8f73-925b6eab48f0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94ced30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:26.498350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-aa34b134-da46-4376-a765-64a1c3701a2e req-495e1c82-6f4e-4023-bf43-57e9ea2f9fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f4e797-745d-4e1d-89ff-105b05e550c0", "name": "network-vif-plugged", "status": "completed", "tag": "dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef"}, {"server_uuid": "1248fe45-c107-4977-b69b-eba5a348ec41", "name": "network-vif-plugged", "status": "completed", "tag": "36e23715-b371-4509-b3a1-1a6ee03ca0a6"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:26.499894 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:26.499894 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:26.509997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa34b134-da46-4376-a765-64a1c3701a2e req-495e1c82-6f4e-4023-bf43-57e9ea2f9fad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.510529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa34b134-da46-4376-a765-64a1c3701a2e req-495e1c82-6f4e-4023-bf43-57e9ea2f9fad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.523568 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-aa34b134-da46-4376-a765-64a1c3701a2e req-495e1c82-6f4e-4023-bf43-57e9ea2f9fad service nova] Creating event network-vif-plugged:dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef for instance f7f4e797-745d-4e1d-89ff-105b05e550c0 on nch2-master-1 Nov 27 20:54:26.524212 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-aa34b134-da46-4376-a765-64a1c3701a2e req-495e1c82-6f4e-4023-bf43-57e9ea2f9fad service nova] Creating event network-vif-plugged:36e23715-b371-4509-b3a1-1a6ee03ca0a6 for instance 1248fe45-c107-4977-b69b-eba5a348ec41 on nch1-master-1 Nov 27 20:54:26.533582 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-aa34b134-da46-4376-a765-64a1c3701a2e req-495e1c82-6f4e-4023-bf43-57e9ea2f9fad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040018 Nov 27 20:54:26.534178 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1368/2861] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:26 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:26.542663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-467caf41-5b4e-4ff0-8f73-925b6eab48f0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.049191 Nov 27 20:54:26.543228 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1494/2862] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:26 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:26.797013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54b6a35c-8c41-4ff0-b955-7d24e7a0dad9 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d410d670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:26.813011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:26.813508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:26.819505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.819963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.820745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.821185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.841093 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54b6a35c-8c41-4ff0-b955-7d24e7a0dad9 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.049173 Nov 27 20:54:26.841963 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1369/2863] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:26 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:26.848916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:26.862350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:26.863170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:26.869264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.869713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.870742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.871176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.927168 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc5adec2-3276-4e51-b255-6667083fad2f tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "DELETE /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 204 len: 0 microversion: 2.1 time: 0.118573 Nov 27 20:54:26.927897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1495/2864] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:26 2021] DELETE /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:54:26.936981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:26.937721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:26.945555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.946193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:26.946972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:26.947430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.029559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:27.037295 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d1373df-808c-488b-a7f3-59a2b0779f9d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1646 microversion: 2.1 time: 0.178505 Nov 27 20:54:27.037953 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1370/2865] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:26 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1646 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:27.042579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ba8f7dab-6b2b-4868-ab1c-ec432ce38a93 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:27.043819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ba8f7dab-6b2b-4868-ab1c-ec432ce38a93 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:27.050405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba8f7dab-6b2b-4868-ab1c-ec432ce38a93 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.050929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba8f7dab-6b2b-4868-ab1c-ec432ce38a93 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.051753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba8f7dab-6b2b-4868-ab1c-ec432ce38a93 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.052187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba8f7dab-6b2b-4868-ab1c-ec432ce38a93 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.079057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:27.086621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-62105109-ef40-44c4-bff8-0d16a9b43e35 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1513 microversion: 2.1 time: 0.154723 Nov 27 20:54:27.087170 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1496/2866] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:26 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:27.092006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:27.092616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:27.098245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.098695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.099501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.099945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.119145 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ba8f7dab-6b2b-4868-ab1c-ec432ce38a93 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.079956 Nov 27 20:54:27.119900 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1371/2867] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:27 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:27.125372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77a23d48-81e4-47b9-baac-d2c1e5aa25a3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:27.126403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77a23d48-81e4-47b9-baac-d2c1e5aa25a3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:27.133309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77a23d48-81e4-47b9-baac-d2c1e5aa25a3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.133767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77a23d48-81e4-47b9-baac-d2c1e5aa25a3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.134561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77a23d48-81e4-47b9-baac-d2c1e5aa25a3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.135006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77a23d48-81e4-47b9-baac-d2c1e5aa25a3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.172550 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77a23d48-81e4-47b9-baac-d2c1e5aa25a3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.050792 Nov 27 20:54:27.177399 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1372/2868] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:27 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:27.214392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:27.215099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:27.222618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.223077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.223890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:27.224339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:27.231143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:27.239211 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddd09da6-974d-4d8c-8f39-41c25d402d50 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1322 microversion: 2.1 time: 0.151042 Nov 27 20:54:27.240077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1497/2869] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:27 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:27.363613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:27.371354 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0e14ec6-f6c9-42a6-9989-7d4f647369b2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.161014 Nov 27 20:54:27.371925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1373/2870] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:27 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:27.555727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d76e412f-b7d6-4dd7-b2d4-ba426e789a2f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94b89d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:27.599321 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d76e412f-b7d6-4dd7-b2d4-ba426e789a2f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.047179 Nov 27 20:54:27.599885 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1498/2871] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:27 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:27.853743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-beac755e-a204-4f26-9831-9a2a0048b204 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9461700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:27.900388 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-beac755e-a204-4f26-9831-9a2a0048b204 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.050333 Nov 27 20:54:27.901062 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1374/2872] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:27 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:28.055848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:28.056639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.064786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.065442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.066354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.066884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.082363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-59e67941-46c8-4df7-a62e-23b21d0d0e2e req-a3ec9545-05ef-4c7a-9dd9-3929b8c66886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be1b680-176c-4763-a0b2-3e8c7e18d91e", "name": "network-vif-deleted", "tag": "82ae9ef3-d9a1-4c1b-9556-dd503129f6ca"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:28.084745 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:28.084745 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:28.102465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-59e67941-46c8-4df7-a62e-23b21d0d0e2e req-a3ec9545-05ef-4c7a-9dd9-3929b8c66886 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.105197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-59e67941-46c8-4df7-a62e-23b21d0d0e2e req-a3ec9545-05ef-4c7a-9dd9-3929b8c66886 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.124440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-59e67941-46c8-4df7-a62e-23b21d0d0e2e req-a3ec9545-05ef-4c7a-9dd9-3929b8c66886 service nova] Creating event network-vif-deleted:82ae9ef3-d9a1-4c1b-9556-dd503129f6ca for instance 4be1b680-176c-4763-a0b2-3e8c7e18d91e on nch2-master-1 Nov 27 20:54:28.129573 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-59e67941-46c8-4df7-a62e-23b21d0d0e2e req-a3ec9545-05ef-4c7a-9dd9-3929b8c66886 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052467 Nov 27 20:54:28.130396 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1375/2873] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:28.135676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:28.136624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.143145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.144212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.145212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.145890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.153277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434669fb63034fa0b91c67050a6b7d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce320b0fdb0466692b28dc520686425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:28.179279 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b9ce445-8916-4d33-87b2-72e7e88c479c tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 200 len: 1467 microversion: 2.1 time: 0.127916 Nov 27 20:54:28.191927 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1499/2874] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:28 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 1467 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:28.197487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51f9c3d5-3d1b-42b5-aa84-5a440402b043 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:28.198628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51f9c3d5-3d1b-42b5-aa84-5a440402b043 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.209720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51f9c3d5-3d1b-42b5-aa84-5a440402b043 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.210556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51f9c3d5-3d1b-42b5-aa84-5a440402b043 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.211753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51f9c3d5-3d1b-42b5-aa84-5a440402b043 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.212475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51f9c3d5-3d1b-42b5-aa84-5a440402b043 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.259853 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51f9c3d5-3d1b-42b5-aa84-5a440402b043 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.065997 Nov 27 20:54:28.264630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1500/2875] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:28 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:28.269134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d60d41b9-02ce-47e1-aa2f-65c473e7dccd tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:28.270139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d60d41b9-02ce-47e1-aa2f-65c473e7dccd tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.277828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d60d41b9-02ce-47e1-aa2f-65c473e7dccd tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.279678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d60d41b9-02ce-47e1-aa2f-65c473e7dccd tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.280251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d60d41b9-02ce-47e1-aa2f-65c473e7dccd tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.280394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d60d41b9-02ce-47e1-aa2f-65c473e7dccd tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.329563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:28.329826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d60d41b9-02ce-47e1-aa2f-65c473e7dccd tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.067243 Nov 27 20:54:28.330740 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1501/2876] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:28 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:28.335668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:28.336635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.337224 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f03c3b5d-5d2f-4283-959a-17036a3b834c tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1513 microversion: 2.1 time: 0.205417 Nov 27 20:54:28.337807 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1376/2877] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:28 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:28.344559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.345031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.345841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.346270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.389724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:28.390457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.399989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.400708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.401613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.402162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.487802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:28.497170 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-010bf334-b965-461d-b7c4-bb4984902fb3 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1472 microversion: 2.1 time: 0.165200 Nov 27 20:54:28.497795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1502/2878] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:28 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:28.514066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:28.514618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.520852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.521240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.522032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.522493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.541015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:28.547225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lazy-loading 'flavor' on Instance uuid 1248fe45-c107-4977-b69b-eba5a348ec41 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:54:28.548882 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8fb0589c-ddb8-4478-b81c-030dde40a912 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.164237 Nov 27 20:54:28.549500 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1377/2879] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:28 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:28.553915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d80fd6c3-e4f4-4941-b504-a37b473aef28 req-0b17485b-9c51-4741-98db-417be2e09ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a542bf73-64b0-4fac-9738-f06b723b6d21", "name": "network-vif-unplugged", "status": "completed", "tag": "a7424a47-99c1-4af8-bc12-2878fbff5f36"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:28.555536 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:28.555536 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:28.563642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d80fd6c3-e4f4-4941-b504-a37b473aef28 req-0b17485b-9c51-4741-98db-417be2e09ae1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.564170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d80fd6c3-e4f4-4941-b504-a37b473aef28 req-0b17485b-9c51-4741-98db-417be2e09ae1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.576286 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d80fd6c3-e4f4-4941-b504-a37b473aef28 req-0b17485b-9c51-4741-98db-417be2e09ae1 service nova] Creating event network-vif-unplugged:a7424a47-99c1-4af8-bc12-2878fbff5f36 for instance a542bf73-64b0-4fac-9738-f06b723b6d21 on nch1-master-1 Nov 27 20:54:28.581343 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d80fd6c3-e4f4-4941-b504-a37b473aef28 req-0b17485b-9c51-4741-98db-417be2e09ae1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030714 Nov 27 20:54:28.582023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1378/2880] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:28.613602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12947edb-58e6-47ca-82e3-35b1fe732c7e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94610d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:28.626147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e2de2db-0e2f-4b0c-9001-52a5ab4b9230 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41/action" status: 202 len: 0 microversion: 2.1 time: 0.115460 Nov 27 20:54:28.627534 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1503/2881] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:28 2021] POST /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:54:28.642754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1434b9c-42d1-4271-8787-acf37ce756db tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:28.647661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1434b9c-42d1-4271-8787-acf37ce756db tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:28.657010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1434b9c-42d1-4271-8787-acf37ce756db tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.657584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1434b9c-42d1-4271-8787-acf37ce756db tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.658271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1434b9c-42d1-4271-8787-acf37ce756db tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:28.658707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1434b9c-42d1-4271-8787-acf37ce756db tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:28.669242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12947edb-58e6-47ca-82e3-35b1fe732c7e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.059860 Nov 27 20:54:28.675087 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1379/2882] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:28 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:28.889852 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1434b9c-42d1-4271-8787-acf37ce756db tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1631 microversion: 2.1 time: 0.253237 Nov 27 20:54:28.890905 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1504/2883] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:28 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1631 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:28.913404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9225970e-ac8a-4054-ae3c-8e8885fac048 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d946e8b0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:28.969944 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9225970e-ac8a-4054-ae3c-8e8885fac048 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.060585 Nov 27 20:54:28.970699 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1380/2884] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:28 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:29.199459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:29.201041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] [instance: 4be1b680-176c-4763-a0b2-3e8c7e18d91e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:29.208757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.209339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.210372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.210817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.225588 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] HTTP exception thrown: Instance 4be1b680-176c-4763-a0b2-3e8c7e18d91e could not be found. Nov 27 20:54:29.226590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Returning 404 to user: Instance 4be1b680-176c-4763-a0b2-3e8c7e18d91e could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:29.227464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e5301bc-4cbb-4d8c-aa08-035f89a8c47d tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e" status: 404 len: 111 microversion: 2.1 time: 0.033372 Nov 27 20:54:29.228445 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1505/2885] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:29 2021] GET /compute/v2.1/servers/4be1b680-176c-4763-a0b2-3e8c7e18d91e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:29.236184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b759a0e5-2f70-42ce-8dcb-bc71b3688afc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d94d55e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:29.273371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c682bfb5-daf1-425e-951f-01768b048514 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:29.274850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c682bfb5-daf1-425e-951f-01768b048514 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:29.287864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c682bfb5-daf1-425e-951f-01768b048514 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.288309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c682bfb5-daf1-425e-951f-01768b048514 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.289128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c682bfb5-daf1-425e-951f-01768b048514 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.289531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c682bfb5-daf1-425e-951f-01768b048514 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.332192 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c682bfb5-daf1-425e-951f-01768b048514 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.062534 Nov 27 20:54:29.333077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1506/2886] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:29 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:54:29.349893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e50f4670-5056-4bff-9a01-c7edd739654d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:29.351483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e50f4670-5056-4bff-9a01-c7edd739654d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:29.360295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e50f4670-5056-4bff-9a01-c7edd739654d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.361101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e50f4670-5056-4bff-9a01-c7edd739654d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.362133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e50f4670-5056-4bff-9a01-c7edd739654d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.362947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e50f4670-5056-4bff-9a01-c7edd739654d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.420198 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e50f4670-5056-4bff-9a01-c7edd739654d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.079466 Nov 27 20:54:29.429597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1507/2887] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:29 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:29.444336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:29.445673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:29.463003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.464296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.465818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.466692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.566721 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b759a0e5-2f70-42ce-8dcb-bc71b3688afc tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/d3d4501e-ad00-41f7-a9ea-7a077cdc7b84" status: 202 len: 0 microversion: 2.1 time: 0.334046 Nov 27 20:54:29.571424 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1381/2888] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:29 2021] DELETE /compute/v2.1/os-security-groups/d3d4501e-ad00-41f7-a9ea-7a077cdc7b84 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:29.578283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:29.580811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:29.614442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.616777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.617880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.620658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.822597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:29.848547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba6c0126-9906-489c-8cbe-3baa39a76ede tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1513 microversion: 2.1 time: 0.417318 Nov 27 20:54:29.849532 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1508/2889] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:29 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1513 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:29.850214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:29.857855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46b6fbdd-b4bf-4f50-b76e-4333df5d8fac tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] Calling method '.version_select at 0x7f15d95034c0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:29.869712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-153babb4-bcda-476b-bf21-a576a90e5703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.296510 Nov 27 20:54:29.879395 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1382/2890] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:29 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:29.893945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-000f695c-b0aa-4c04-aec5-16ef8a7b1c89 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d944a040>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:29.963027 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-000f695c-b0aa-4c04-aec5-16ef8a7b1c89 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.082056 Nov 27 20:54:29.969613 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1383/2891] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:29 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:29.975353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-765b0188-241f-4745-94f3-cd0719cda32b tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:29.976517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-765b0188-241f-4745-94f3-cd0719cda32b tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:29.985300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-765b0188-241f-4745-94f3-cd0719cda32b tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.985912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-765b0188-241f-4745-94f3-cd0719cda32b tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:29.986971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-765b0188-241f-4745-94f3-cd0719cda32b tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:29.987575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-765b0188-241f-4745-94f3-cd0719cda32b tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.197593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-765b0188-241f-4745-94f3-cd0719cda32b tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1614 microversion: 2.1 time: 0.232157 Nov 27 20:54:30.198188 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1384/2892] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:29 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1614 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:30.210036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb330537-c16a-4d60-9e7c-b846c53af8bd tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d944ac10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:30.257954 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb330537-c16a-4d60-9e7c-b846c53af8bd tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.058632 Nov 27 20:54:30.269296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1385/2893] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:30 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:30.274601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:30.275208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:30.286183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.286934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.287939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.288546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.306275 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46b6fbdd-b4bf-4f50-b76e-4333df5d8fac tempest-SecurityGroupsTestJSON-72623525 tempest-SecurityGroupsTestJSON-72623525-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/d51088c2-09fd-4bb8-9023-6cf77fd03eec" status: 202 len: 0 microversion: 2.1 time: 0.455339 Nov 27 20:54:30.307807 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1509/2894] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:54:29 2021] DELETE /compute/v2.1/os-security-groups/d51088c2-09fd-4bb8-9023-6cf77fd03eec => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:54:30.345988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72925e9e-21bd-45b6-a650-d9530e83d39c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:30.347915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72925e9e-21bd-45b6-a650-d9530e83d39c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:30.361799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72925e9e-21bd-45b6-a650-d9530e83d39c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.365981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72925e9e-21bd-45b6-a650-d9530e83d39c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.369645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72925e9e-21bd-45b6-a650-d9530e83d39c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.371029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72925e9e-21bd-45b6-a650-d9530e83d39c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.476742 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] HTTP exception thrown: Cannot 'migrate' instance 1248fe45-c107-4977-b69b-eba5a348ec41 while it is in vm_state suspended Nov 27 20:54:30.477392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Returning 409 to user: Cannot 'migrate' instance 1248fe45-c107-4977-b69b-eba5a348ec41 while it is in vm_state suspended {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:30.478247 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-932c388d-6a41-4086-9092-035b97a3f02d tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41/action" status: 409 len: 148 microversion: 2.1 time: 0.207774 Nov 27 20:54:30.483019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72925e9e-21bd-45b6-a650-d9530e83d39c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.141487 Nov 27 20:54:30.483934 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1510/2895] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:30 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:54:30.491353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78e9b6f1-2bff-467b-b71e-7cd3ddddb11b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:30.492375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78e9b6f1-2bff-467b-b71e-7cd3ddddb11b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:30.496021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1386/2896] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:30 2021] POST /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41/action => generated 148 bytes in 226 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:54:30.507065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-738e6eed-fbfd-4e3d-ae7e-415214ed14c4 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:30.508556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-738e6eed-fbfd-4e3d-ae7e-415214ed14c4 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:30.510461 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-738e6eed-fbfd-4e3d-ae7e-415214ed14c4 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae/action" status: 400 len: 144 microversion: 2.1 time: 0.007936 Nov 27 20:54:30.515303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1387/2897] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:30 2021] POST /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae/action => generated 144 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:54:30.515494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78e9b6f1-2bff-467b-b71e-7cd3ddddb11b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.515494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78e9b6f1-2bff-467b-b71e-7cd3ddddb11b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.515494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78e9b6f1-2bff-467b-b71e-7cd3ddddb11b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.515494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78e9b6f1-2bff-467b-b71e-7cd3ddddb11b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.525225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89c84135-175f-49c3-af3b-4a7917fa6a88 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:30.526653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89c84135-175f-49c3-af3b-4a7917fa6a88 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:30.527672 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89c84135-175f-49c3-af3b-4a7917fa6a88 tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae/action" status: 400 len: 120 microversion: 2.1 time: 0.011257 Nov 27 20:54:30.528400 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1388/2898] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:30 2021] POST /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:54:30.539111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3847353-5d4f-4833-90bc-203cba0475fe tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:30.544684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3847353-5d4f-4833-90bc-203cba0475fe tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Failed to fetch instance by id 999 {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 27 20:54:30.545404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a3847353-5d4f-4833-90bc-203cba0475fe tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 27 20:54:30.546143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3847353-5d4f-4833-90bc-203cba0475fe tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:30.548452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3847353-5d4f-4833-90bc-203cba0475fe tempest-ServersAdminNegativeTestJSON-662660658 tempest-ServersAdminNegativeTestJSON-662660658-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.013932 Nov 27 20:54:30.553612 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1389/2899] 10.222.0.21 () {60 vars in 1178 bytes} [Sat Nov 27 20:54:30 2021] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 27 20:54:30.562296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:30.564245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:30.578148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.578806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.584079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.584523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.595273 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78e9b6f1-2bff-467b-b71e-7cd3ddddb11b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.107780 Nov 27 20:54:30.596709 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1511/2900] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:30 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:30.625474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:30.665616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cc6ac82e-21bc-44a3-b140-f93774a46ad7 req-a8d0cfc2-7807-485d-9658-4b0e9250ad86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821291e6-a643-4172-ba04-15984efe9761", "name": "network-vif-deleted", "tag": "1cb73713-eb64-4a52-a006-70b1b4bcabdb"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:30.667080 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:30.667080 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:30.697840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cc6ac82e-21bc-44a3-b140-f93774a46ad7 req-a8d0cfc2-7807-485d-9658-4b0e9250ad86 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.698791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cc6ac82e-21bc-44a3-b140-f93774a46ad7 req-a8d0cfc2-7807-485d-9658-4b0e9250ad86 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.740417 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cc6ac82e-21bc-44a3-b140-f93774a46ad7 req-a8d0cfc2-7807-485d-9658-4b0e9250ad86 service nova] Creating event network-vif-deleted:1cb73713-eb64-4a52-a006-70b1b4bcabdb for instance 821291e6-a643-4172-ba04-15984efe9761 on nch2-master-1 Nov 27 20:54:30.757296 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cc6ac82e-21bc-44a3-b140-f93774a46ad7 req-a8d0cfc2-7807-485d-9658-4b0e9250ad86 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095700 Nov 27 20:54:30.763533 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1512/2901] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:54:30.846704 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28d83b7b-cc8a-40dc-b989-babc7ce06817 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 204 len: 0 microversion: 2.1 time: 0.291641 Nov 27 20:54:30.848390 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1390/2902] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:30 2021] DELETE /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:30.857425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:30.858878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:30.872991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:30.873710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:30.875047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.875634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.876469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.876963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.889845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.890300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.891102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.891584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.959165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:30.959681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:30.960147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lazy-loading 'fault' on Instance uuid 821291e6-a643-4172-ba04-15984efe9761 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:54:31.043709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f940822793e422c8436036be6a116a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79226c480677428e924a69a8e4c01ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:31.060240 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e3dde36-b154-49c4-a07e-740a26e0aa59 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 200 len: 1308 microversion: 2.1 time: 0.191547 Nov 27 20:54:31.066946 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1391/2903] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:30 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:31.074299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:31.075068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:31.084839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:31.085315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:31.086319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:31.086775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:31.208001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:31.220409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46e99584-2656-49fd-8761-030ecd70b52d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1469 microversion: 2.1 time: 0.367857 Nov 27 20:54:31.221707 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1513/2904] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:30 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:31.234947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8a620703-5d9c-4fe9-94d0-076876e9fa66 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94d7a60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:31.317388 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8a620703-5d9c-4fe9-94d0-076876e9fa66 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.091801 Nov 27 20:54:31.318765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1514/2905] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:31 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:31.331107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61e6abc8-6b84-4e18-8f9c-5d8cfb3bc2d3 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94ce040>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:31.420982 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61e6abc8-6b84-4e18-8f9c-5d8cfb3bc2d3 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.100059 Nov 27 20:54:31.423218 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1515/2906] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:31 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:31.475809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:31.485204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e73a2c7a-d9ad-4708-8da8-e0c0bc916f84 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.416701 Nov 27 20:54:31.486401 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1392/2907] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:31 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:31.504052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f77a8c88-b5ce-4aca-95f5-4ba5cb65d0a0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:31.505939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f77a8c88-b5ce-4aca-95f5-4ba5cb65d0a0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:31.522983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77a8c88-b5ce-4aca-95f5-4ba5cb65d0a0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:31.524961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77a8c88-b5ce-4aca-95f5-4ba5cb65d0a0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:31.526336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77a8c88-b5ce-4aca-95f5-4ba5cb65d0a0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:31.527021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77a8c88-b5ce-4aca-95f5-4ba5cb65d0a0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:31.605989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55a92fad-5e18-4953-987f-82f705c806e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:31.607088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55a92fad-5e18-4953-987f-82f705c806e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:31.615107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f77a8c88-b5ce-4aca-95f5-4ba5cb65d0a0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.123388 Nov 27 20:54:31.616632 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1516/2908] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:31 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:31.631327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55a92fad-5e18-4953-987f-82f705c806e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:31.634591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55a92fad-5e18-4953-987f-82f705c806e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:31.635778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55a92fad-5e18-4953-987f-82f705c806e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:31.636438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55a92fad-5e18-4953-987f-82f705c806e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:31.672875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7549fd56-262d-44fa-9b29-1516e88b8759 req-6a60d291-3378-4b38-be1a-ee885b91d0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931317b4-226f-4f75-8a5e-f93c7ce5c3ad", "name": "network-vif-plugged", "status": "completed", "tag": "2dfaad6b-b499-4a67-ad7b-ec4eea1d3813"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:31.680505 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55a92fad-5e18-4953-987f-82f705c806e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.078073 Nov 27 20:54:31.681147 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1393/2909] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:31 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:31.685420 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:31.685420 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:31.708741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7549fd56-262d-44fa-9b29-1516e88b8759 req-6a60d291-3378-4b38-be1a-ee885b91d0b7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:31.709313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7549fd56-262d-44fa-9b29-1516e88b8759 req-6a60d291-3378-4b38-be1a-ee885b91d0b7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:31.733538 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7549fd56-262d-44fa-9b29-1516e88b8759 req-6a60d291-3378-4b38-be1a-ee885b91d0b7 service nova] Creating event network-vif-plugged:2dfaad6b-b499-4a67-ad7b-ec4eea1d3813 for instance 931317b4-226f-4f75-8a5e-f93c7ce5c3ad on nch2-master-1 Nov 27 20:54:31.743731 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7549fd56-262d-44fa-9b29-1516e88b8759 req-6a60d291-3378-4b38-be1a-ee885b91d0b7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075636 Nov 27 20:54:31.749150 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1517/2910] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:54:32.083813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:32.084519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] [instance: 821291e6-a643-4172-ba04-15984efe9761] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:32.094383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.094842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.100235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.100707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.124735 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] HTTP exception thrown: Instance 821291e6-a643-4172-ba04-15984efe9761 could not be found. Nov 27 20:54:32.125968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] Returning 404 to user: Instance 821291e6-a643-4172-ba04-15984efe9761 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:32.127343 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9bed4f0e-e731-458c-80fe-4865df069131 tempest-AttachVolumeNegativeTest-36724854 tempest-AttachVolumeNegativeTest-36724854-project] 10.222.0.21 "GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761" status: 404 len: 111 microversion: 2.1 time: 0.047260 Nov 27 20:54:32.128109 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1394/2911] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:32 2021] GET /compute/v2.1/servers/821291e6-a643-4172-ba04-15984efe9761 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:32.250306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:32.250939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:32.271881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.271881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.271881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.271881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.329664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0d6014b-85df-4a44-814a-7b2bdf80ecb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94e4940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:32.418658 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0d6014b-85df-4a44-814a-7b2bdf80ecb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.092562 Nov 27 20:54:32.421294 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1395/2912] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:32 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:32.433637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e6e53d5-7a0b-4bc8-9c10-a497e5472823 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94c9310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:32.506004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e6e53d5-7a0b-4bc8-9c10-a497e5472823 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.075696 Nov 27 20:54:32.507854 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1396/2913] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:32 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:32.512623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:32.513493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:32.522837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.523547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.524512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.525509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.612150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:32.620907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a305ed47-7348-4a8c-80e6-33edc0228b61 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1469 microversion: 2.1 time: 0.385136 Nov 27 20:54:32.634984 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1518/2914] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:32 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:32.645138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23d32f76-0bb2-4e82-9652-ceca91bc58ae tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:32.649694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23d32f76-0bb2-4e82-9652-ceca91bc58ae tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:32.666016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d32f76-0bb2-4e82-9652-ceca91bc58ae tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.666839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d32f76-0bb2-4e82-9652-ceca91bc58ae tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.670664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d32f76-0bb2-4e82-9652-ceca91bc58ae tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.671554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d32f76-0bb2-4e82-9652-ceca91bc58ae tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.756410 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23d32f76-0bb2-4e82-9652-ceca91bc58ae tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 14 microversion: 2.1 time: 0.119601 Nov 27 20:54:32.757313 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1519/2915] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:32 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:32.768818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac8a89d0-f5c9-4110-ada6-0806bc0b6d2d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:32.775101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac8a89d0-f5c9-4110-ada6-0806bc0b6d2d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:32.790373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac8a89d0-f5c9-4110-ada6-0806bc0b6d2d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.791235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac8a89d0-f5c9-4110-ada6-0806bc0b6d2d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.792286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac8a89d0-f5c9-4110-ada6-0806bc0b6d2d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:32.793669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac8a89d0-f5c9-4110-ada6-0806bc0b6d2d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:32.852129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac8a89d0-f5c9-4110-ada6-0806bc0b6d2d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.090051 Nov 27 20:54:32.858779 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1520/2916] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:32 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:32.970116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:32.977796 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b5dda261-669d-4eba-a4f8-bfa73a090a5b tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.468640 Nov 27 20:54:32.978431 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1397/2917] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:32 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:33.435535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28d36c84-e829-4188-8e2b-eafc132b0d76 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94d7430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:33.520980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-feaf8273-cb79-47d2-abcb-c3eac97c7629 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d946e3a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:33.544783 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28d36c84-e829-4188-8e2b-eafc132b0d76 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.114123 Nov 27 20:54:33.545401 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1521/2918] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:33 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:33.624398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-feaf8273-cb79-47d2-abcb-c3eac97c7629 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.107637 Nov 27 20:54:33.632910 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1398/2919] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:33 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:33.662928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:33.663713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:33.673016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:33.674888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:33.676178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:33.677805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:33.749194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ad149ab5-7f29-4ca2-b4d1-ae131f0a07b5 req-2b8ef296-f638-40fb-bbb3-a2740a0c9e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1248fe45-c107-4977-b69b-eba5a348ec41", "name": "network-vif-deleted", "tag": "36e23715-b371-4509-b3a1-1a6ee03ca0a6"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:33.751504 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:33.751504 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:33.786477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ad149ab5-7f29-4ca2-b4d1-ae131f0a07b5 req-2b8ef296-f638-40fb-bbb3-a2740a0c9e39 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:33.788340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ad149ab5-7f29-4ca2-b4d1-ae131f0a07b5 req-2b8ef296-f638-40fb-bbb3-a2740a0c9e39 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:33.828411 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ad149ab5-7f29-4ca2-b4d1-ae131f0a07b5 req-2b8ef296-f638-40fb-bbb3-a2740a0c9e39 service nova] Creating event network-vif-deleted:36e23715-b371-4509-b3a1-1a6ee03ca0a6 for instance 1248fe45-c107-4977-b69b-eba5a348ec41 on nch1-master-1 Nov 27 20:54:33.834538 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ad149ab5-7f29-4ca2-b4d1-ae131f0a07b5 req-2b8ef296-f638-40fb-bbb3-a2740a0c9e39 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091295 Nov 27 20:54:33.839107 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1399/2920] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:33.855056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8fb6713-3943-4058-9756-cb2ae9bf16a3 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:33.856460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8fb6713-3943-4058-9756-cb2ae9bf16a3 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:33.905203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8fb6713-3943-4058-9756-cb2ae9bf16a3 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:33.905653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8fb6713-3943-4058-9756-cb2ae9bf16a3 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:33.906524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8fb6713-3943-4058-9756-cb2ae9bf16a3 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:33.906965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8fb6713-3943-4058-9756-cb2ae9bf16a3 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:33.978349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8fb6713-3943-4058-9756-cb2ae9bf16a3 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 8205 microversion: 2.1 time: 0.137284 Nov 27 20:54:33.979605 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1400/2921] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:33 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 8205 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:33.986497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ef89af1-a827-4d70-adbe-c63d44e01bad tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:33.988031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ef89af1-a827-4d70-adbe-c63d44e01bad tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:34.003152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ef89af1-a827-4d70-adbe-c63d44e01bad tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:34.004303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ef89af1-a827-4d70-adbe-c63d44e01bad tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:34.005268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ef89af1-a827-4d70-adbe-c63d44e01bad tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:34.005843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ef89af1-a827-4d70-adbe-c63d44e01bad tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:34.055232 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ef89af1-a827-4d70-adbe-c63d44e01bad tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.073568 Nov 27 20:54:34.060893 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1401/2922] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:33 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:34.067604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-80af2b87-0fdf-4911-a758-01057c10b56c req-c8f0f123-b70e-45ec-81e5-c1323abac141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a542bf73-64b0-4fac-9738-f06b723b6d21", "name": "network-vif-plugged", "status": "completed", "tag": "a7424a47-99c1-4af8-bc12-2878fbff5f36"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:34.070215 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:34.070215 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:34.085118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80af2b87-0fdf-4911-a758-01057c10b56c req-c8f0f123-b70e-45ec-81e5-c1323abac141 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:34.085925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80af2b87-0fdf-4911-a758-01057c10b56c req-c8f0f123-b70e-45ec-81e5-c1323abac141 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:34.104956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-80af2b87-0fdf-4911-a758-01057c10b56c req-c8f0f123-b70e-45ec-81e5-c1323abac141 service nova] Creating event network-vif-plugged:a7424a47-99c1-4af8-bc12-2878fbff5f36 for instance a542bf73-64b0-4fac-9738-f06b723b6d21 on nch1-master-1 Nov 27 20:54:34.111541 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-80af2b87-0fdf-4911-a758-01057c10b56c req-c8f0f123-b70e-45ec-81e5-c1323abac141 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048664 Nov 27 20:54:34.114785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1402/2923] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:34.123214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:34.124275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:34.142170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:34.142922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:34.144003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:34.144633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:34.354562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:34.375776 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a1a7b0dd-f439-4aaa-ae30-975915d7772d tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 200 len: 1427 microversion: 2.1 time: 0.722909 Nov 27 20:54:34.383157 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1522/2924] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:33 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 1427 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:34.488563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:34.496914 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ec265fc6-0c40-4b5a-b7f6-76986113d7fb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.380553 Nov 27 20:54:34.502336 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1403/2925] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:34 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:34.570330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9685ffe5-2409-4eff-a91c-c2630bca80df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94764c0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:34.645136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e6b5cfc-d7b6-432b-9748-85fbaf50fc74 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9459dc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:34.674811 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9685ffe5-2409-4eff-a91c-c2630bca80df tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.116616 Nov 27 20:54:34.676743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1523/2926] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:34 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:34.740684 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e6b5cfc-d7b6-432b-9748-85fbaf50fc74 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.099240 Nov 27 20:54:34.741269 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1404/2927] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:34 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:34.990874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-56e05fd3-61f2-4e07-9ba9-6f8f70c247d8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:34.992209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56e05fd3-61f2-4e07-9ba9-6f8f70c247d8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:35.024106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56e05fd3-61f2-4e07-9ba9-6f8f70c247d8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.024641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56e05fd3-61f2-4e07-9ba9-6f8f70c247d8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.026175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56e05fd3-61f2-4e07-9ba9-6f8f70c247d8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.026821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56e05fd3-61f2-4e07-9ba9-6f8f70c247d8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.065767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3485a705-9b94-4938-90d1-bfe27dda3b1a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:35.066762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3485a705-9b94-4938-90d1-bfe27dda3b1a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:35.091815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3485a705-9b94-4938-90d1-bfe27dda3b1a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.098333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3485a705-9b94-4938-90d1-bfe27dda3b1a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.099850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3485a705-9b94-4938-90d1-bfe27dda3b1a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.100904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3485a705-9b94-4938-90d1-bfe27dda3b1a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.149838 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-56e05fd3-61f2-4e07-9ba9-6f8f70c247d8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 16396 microversion: 2.1 time: 0.163120 Nov 27 20:54:35.153364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1524/2928] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:34 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 16396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:35.170936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3485a705-9b94-4938-90d1-bfe27dda3b1a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.104781 Nov 27 20:54:35.173394 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1405/2929] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:35 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:54:35.399449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:35.400059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: 1248fe45-c107-4977-b69b-eba5a348ec41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:35.410186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.415313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.418596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.420085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.461036 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] HTTP exception thrown: Instance 1248fe45-c107-4977-b69b-eba5a348ec41 could not be found. Nov 27 20:54:35.462310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Returning 404 to user: Instance 1248fe45-c107-4977-b69b-eba5a348ec41 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:35.466884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5bafff5-0bcd-4d2d-ad2e-84f3390c61f2 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41" status: 404 len: 111 microversion: 2.1 time: 0.071448 Nov 27 20:54:35.470878 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1525/2930] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:35 2021] GET /compute/v2.1/servers/1248fe45-c107-4977-b69b-eba5a348ec41 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:35.477075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:35.477932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:35.503871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.504649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.508207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.509464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.522893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:35.523980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:35.544224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.545022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.546992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:35.549268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:35.609043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:35.827563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49a97f7a-8534-4c32-9fde-846aabfcd2f8 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "DELETE /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 204 len: 0 microversion: 2.1 time: 0.354340 Nov 27 20:54:35.829004 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1406/2931] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:35 2021] DELETE /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:35.841393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b5a21c3-3c0d-4ce2-800c-37f287c87513 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94bac10>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:35.924063 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b5a21c3-3c0d-4ce2-800c-37f287c87513 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.093392 Nov 27 20:54:35.931142 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1407/2932] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:35 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:35.940446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13ebb3bc-50b6-4690-a2f3-efd6eb867228 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94ba940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:36.031932 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13ebb3bc-50b6-4690-a2f3-efd6eb867228 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.103216 Nov 27 20:54:36.038023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1408/2933] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:35 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:36.044464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:36.045996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:36.055435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:36.055939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:36.056840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:36.057284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:36.171828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:36.181563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f25ac91-f812-4601-910b-86fd64503277 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1521 microversion: 2.1 time: 0.665783 Nov 27 20:54:36.186061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1526/2934] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:35 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:36.199211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-788b6cc5-4775-4bbc-abd5-19046f6941db tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:36.207040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-788b6cc5-4775-4bbc-abd5-19046f6941db tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:36.225562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-788b6cc5-4775-4bbc-abd5-19046f6941db tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:36.231993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-788b6cc5-4775-4bbc-abd5-19046f6941db tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:36.235959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-788b6cc5-4775-4bbc-abd5-19046f6941db tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:36.237508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-788b6cc5-4775-4bbc-abd5-19046f6941db tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:36.363108 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-788b6cc5-4775-4bbc-abd5-19046f6941db tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 16396 microversion: 2.1 time: 0.175356 Nov 27 20:54:36.363986 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1527/2935] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:36 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 16396 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:36.369534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f034f99f-3c09-4dcc-b0d2-f26c55359392 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:36.371040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f034f99f-3c09-4dcc-b0d2-f26c55359392 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:36.399217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f034f99f-3c09-4dcc-b0d2-f26c55359392 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:36.402410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f034f99f-3c09-4dcc-b0d2-f26c55359392 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:36.404200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f034f99f-3c09-4dcc-b0d2-f26c55359392 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:36.416948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f034f99f-3c09-4dcc-b0d2-f26c55359392 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:36.473880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:36.485709 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47ae4f30-7b20-4842-b80b-c87a969eeb87 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1477 microversion: 2.1 time: 0.446213 Nov 27 20:54:36.487831 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1409/2936] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:36 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1477 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:36.516071 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f034f99f-3c09-4dcc-b0d2-f26c55359392 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 14 microversion: 2.1 time: 0.150147 Nov 27 20:54:36.517135 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1528/2937] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:36 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:54:36.938723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72df978c-7545-45bf-bc48-ecbc1c7bb10e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d946e9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:37.003730 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72df978c-7545-45bf-bc48-ecbc1c7bb10e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.069198 Nov 27 20:54:37.004560 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1410/2938] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:36 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:37.046375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71fc0424-6f6c-4a22-b063-4fa8e0029904 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94d78b0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:37.101889 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71fc0424-6f6c-4a22-b063-4fa8e0029904 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.060522 Nov 27 20:54:37.103996 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1529/2939] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:37 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:37.206637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:37.207581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:37.224413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.224866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.225784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.226091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.378168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-652f8d15-cec4-43d0-9704-a6ea52146c0e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:37.379381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-652f8d15-cec4-43d0-9704-a6ea52146c0e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:37.397484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-652f8d15-cec4-43d0-9704-a6ea52146c0e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.398214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-652f8d15-cec4-43d0-9704-a6ea52146c0e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.399927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-652f8d15-cec4-43d0-9704-a6ea52146c0e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.405019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-652f8d15-cec4-43d0-9704-a6ea52146c0e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.482613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-652f8d15-cec4-43d0-9704-a6ea52146c0e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 16396 microversion: 2.1 time: 0.111637 Nov 27 20:54:37.485299 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1530/2940] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:37 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 16396 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:37.506398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:37.507440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:37.531040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.542700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.548229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.551684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.664764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:37.692119 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20c6922c-4996-4c68-8e85-0677350fe8ec tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1506 microversion: 2.1 time: 0.490448 Nov 27 20:54:37.696197 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1411/2941] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:37 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:37.701869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ffbf919-6f4d-417d-9a9c-bd9f60e69bda tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:37.704768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ffbf919-6f4d-417d-9a9c-bd9f60e69bda tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:37.737270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffbf919-6f4d-417d-9a9c-bd9f60e69bda tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.739871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffbf919-6f4d-417d-9a9c-bd9f60e69bda tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.743233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffbf919-6f4d-417d-9a9c-bd9f60e69bda tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.744039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffbf919-6f4d-417d-9a9c-bd9f60e69bda tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.826629 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ffbf919-6f4d-417d-9a9c-bd9f60e69bda tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 8208 microversion: 2.1 time: 0.126175 Nov 27 20:54:37.828936 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1412/2942] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:37 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 8208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:37.843345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:37.846626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:37.875365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.891055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:37.895785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:37.896755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.015928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:38.026922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19679a76-bea7-48f2-ad81-ffa6f44a289b tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1477 microversion: 2.1 time: 0.526818 Nov 27 20:54:38.027550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1531/2943] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:37 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1477 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:38.040786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2de07b1-70b2-4bb7-b55d-931fe1ca4737 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d949cf70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:38.143434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2de07b1-70b2-4bb7-b55d-931fe1ca4737 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1411 microversion: 2.1 time: 0.114775 Nov 27 20:54:38.144018 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1532/2944] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:38 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:38.154870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd03565e-d520-4412-a7b4-b7a1cabcf10b tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94a3040>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:38.411149 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd03565e-d520-4412-a7b4-b7a1cabcf10b tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.266076 Nov 27 20:54:38.412166 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1533/2945] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:38 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:38.497662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e717df6d-714a-45fa-b5fc-1b732b6d9c18 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:38.498666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e717df6d-714a-45fa-b5fc-1b732b6d9c18 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:38.509884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e717df6d-714a-45fa-b5fc-1b732b6d9c18 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:38.510340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e717df6d-714a-45fa-b5fc-1b732b6d9c18 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.511135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e717df6d-714a-45fa-b5fc-1b732b6d9c18 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:38.533291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e717df6d-714a-45fa-b5fc-1b732b6d9c18 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.655013 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e717df6d-714a-45fa-b5fc-1b732b6d9c18 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 16396 microversion: 2.1 time: 0.162165 Nov 27 20:54:38.658614 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1534/2946] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:38 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 16396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:54:38.676624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-da043ce0-7d62-47d0-ab0c-d6f9e16ef918 req-c9f4e467-0cba-40c9-9630-783c738f02a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf0c6c5-5410-4d97-bebc-94825b8ec5ae", "name": "network-vif-deleted", "tag": "fb6fe1ae-aae8-4dcf-863c-9e42e9603264"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:38.678475 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:38.678475 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:38.711422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-da043ce0-7d62-47d0-ab0c-d6f9e16ef918 req-c9f4e467-0cba-40c9-9630-783c738f02a6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:38.711871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-da043ce0-7d62-47d0-ab0c-d6f9e16ef918 req-c9f4e467-0cba-40c9-9630-783c738f02a6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.768926 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-da043ce0-7d62-47d0-ab0c-d6f9e16ef918 req-c9f4e467-0cba-40c9-9630-783c738f02a6 service nova] Creating event network-vif-deleted:fb6fe1ae-aae8-4dcf-863c-9e42e9603264 for instance edf0c6c5-5410-4d97-bebc-94825b8ec5ae on nch1-master-1 Nov 27 20:54:38.789529 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-da043ce0-7d62-47d0-ab0c-d6f9e16ef918 req-c9f4e467-0cba-40c9-9630-783c738f02a6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113764 Nov 27 20:54:38.792550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1535/2947] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:38.839359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f74c582a-e468-4036-8ecb-7e48d2231573 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:38.840658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f74c582a-e468-4036-8ecb-7e48d2231573 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:38.856899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f74c582a-e468-4036-8ecb-7e48d2231573 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:38.861303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f74c582a-e468-4036-8ecb-7e48d2231573 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.865696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f74c582a-e468-4036-8ecb-7e48d2231573 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:38.867421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f74c582a-e468-4036-8ecb-7e48d2231573 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.914660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:38.923167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a547c593-6efb-4617-b42b-93bad1e8ad78 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 200 len: 1506 microversion: 2.1 time: 1.092334 Nov 27 20:54:38.923788 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1413/2948] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:37 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 1506 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:38.952847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:38.953950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:38.967379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:38.968566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.969818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:38.970752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:38.987082 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f74c582a-e468-4036-8ecb-7e48d2231573 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 16402 microversion: 2.1 time: 0.152308 Nov 27 20:54:38.990625 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1536/2949] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:38 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 16402 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:54:39.045395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:39.046150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:39.047406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:39.063691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:39.074330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:39.075449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:39.075912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:39.196738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:39.197175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:39.197823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lazy-loading 'fault' on Instance uuid edf0c6c5-5410-4d97-bebc-94825b8ec5ae {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:54:39.259856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05b32778-4f1f-40b3-9bda-73f638cb15f9 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 204 len: 0 microversion: 2.1 time: 0.313061 Nov 27 20:54:39.262079 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1414/2950] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:38 2021] DELETE /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:39.314681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad6eb2a5-63fb-46f0-8b13-13aca6468a64 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d946e430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:39.457638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d611499f56e463ab23fc7c1ee2b382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812b97d174d84cdbb78bd4064909234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:39.466066 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4e26bf4-f4ca-4428-b0b8-110a4764bc14 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 200 len: 1311 microversion: 2.1 time: 0.425271 Nov 27 20:54:39.480351 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1537/2951] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:39 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:39.496364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f525a5f5-7171-4eaf-bc8f-6080b4598a07 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9476700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:47.324202 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad6eb2a5-63fb-46f0-8b13-13aca6468a64 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1420 microversion: 2.1 time: 8.057236 Nov 27 20:54:47.325950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1415/2952] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:39 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1420 bytes in 8063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:47.326545 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f525a5f5-7171-4eaf-bc8f-6080b4598a07 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 7.844570 Nov 27 20:54:47.327938 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1538/2953] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:39 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 7847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:47.337530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d484a8d-a551-45f1-afdd-fbdb158de90d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:47.340349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d484a8d-a551-45f1-afdd-fbdb158de90d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:47.355354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1483909821", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "c6502c39-8b47-4e70-ac49-9906b123e7d6"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:47.356236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d484a8d-a551-45f1-afdd-fbdb158de90d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:47.357420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d484a8d-a551-45f1-afdd-fbdb158de90d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:47.358471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d484a8d-a551-45f1-afdd-fbdb158de90d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:47.360542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d484a8d-a551-45f1-afdd-fbdb158de90d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:47.451921 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d484a8d-a551-45f1-afdd-fbdb158de90d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 24572 microversion: 2.1 time: 0.122300 Nov 27 20:54:47.452844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1539/2954] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:47 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 24572 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:47.459723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f04dbf61-9289-4ea1-9607-840e31b1e0de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:47.463947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f04dbf61-9289-4ea1-9607-840e31b1e0de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:47.475524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] validate_networks() for [('c6502c39-8b47-4e70-ac49-9906b123e7d6', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:54:47.482483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f04dbf61-9289-4ea1-9607-840e31b1e0de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:47.483245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f04dbf61-9289-4ea1-9607-840e31b1e0de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:47.484291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f04dbf61-9289-4ea1-9607-840e31b1e0de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:47.484906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f04dbf61-9289-4ea1-9607-840e31b1e0de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:47.597567 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f04dbf61-9289-4ea1-9607-840e31b1e0de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.142574 Nov 27 20:54:47.598699 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1540/2955] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:47 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:47.605717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:47.619463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] [instance: edf0c6c5-5410-4d97-bebc-94825b8ec5ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:47.635224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:47.656788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:47.660310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:47.662057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:47.696607 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] HTTP exception thrown: Instance edf0c6c5-5410-4d97-bebc-94825b8ec5ae could not be found. Nov 27 20:54:47.701722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] Returning 404 to user: Instance edf0c6c5-5410-4d97-bebc-94825b8ec5ae could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:54:47.703078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c3db1e3-e140-4880-9f04-b0f9417d5284 tempest-ServersAdminNegativeTestJSON-1978550227 tempest-ServersAdminNegativeTestJSON-1978550227-project] 10.222.0.21 "GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae" status: 404 len: 111 microversion: 2.1 time: 0.101810 Nov 27 20:54:47.707943 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1541/2956] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:47 2021] GET /compute/v2.1/servers/edf0c6c5-5410-4d97-bebc-94825b8ec5ae => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:47.728235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-68c3ea41-67ef-4752-ac25-0aa3b56e365a req-d6a384a3-1737-4ffc-8c13-3c05906aee04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a542bf73-64b0-4fac-9738-f06b723b6d21", "name": "network-vif-deleted", "tag": "a7424a47-99c1-4af8-bc12-2878fbff5f36"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:47.733294 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:47.733294 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:47.753485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-68c3ea41-67ef-4752-ac25-0aa3b56e365a req-d6a384a3-1737-4ffc-8c13-3c05906aee04 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:47.754656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-68c3ea41-67ef-4752-ac25-0aa3b56e365a req-d6a384a3-1737-4ffc-8c13-3c05906aee04 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:47.783370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-68c3ea41-67ef-4752-ac25-0aa3b56e365a req-d6a384a3-1737-4ffc-8c13-3c05906aee04 service nova] Creating event network-vif-deleted:a7424a47-99c1-4af8-bc12-2878fbff5f36 for instance a542bf73-64b0-4fac-9738-f06b723b6d21 on nch1-master-1 Nov 27 20:54:47.792679 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-68c3ea41-67ef-4752-ac25-0aa3b56e365a req-d6a384a3-1737-4ffc-8c13-3c05906aee04 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082580 Nov 27 20:54:47.797775 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1542/2957] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:47.816360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96139e20-1a90-4783-8257-d07c344f1f65 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15c744faf0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:47.935943 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-96139e20-1a90-4783-8257-d07c344f1f65 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 200 len: 1420 microversion: 2.1 time: 0.130878 Nov 27 20:54:47.937139 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1543/2958] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:47 2021] GET /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:47.952886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca0f7d23-d967-4419-bbaf-d2dec8271d3c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d949aa60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:48.352421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:54:48.353484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:54:48.354175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:54:48.354760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:54:48.355424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:54:48.393004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:48.393004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:48.393851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:48.395012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:48.482357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Getting quotas for project 99a5eb3bc93349828958b7879707829a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:54:48.491465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Getting quotas for user 745d99de8bd24185aacbbcf7b2c404c2 and project 99a5eb3bc93349828958b7879707829a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:54:48.523711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:54:48.526519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:54:48.650713 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2ae2216-1f51-46fc-9617-e79507b8084d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306090 Nov 27 20:54:48.651729 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1416/2959] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:54:48.660158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7928ac5f-c6b1-43f6-a1ef-76eed418bf10 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93c49d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:49.415833 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca0f7d23-d967-4419-bbaf-d2dec8271d3c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 204 len: 0 microversion: 2.1 time: 1.470383 Nov 27 20:54:49.417575 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1544/2960] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:47 2021] DELETE /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 0 bytes in 1473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:49.423314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a30a3eb5-7bf0-48d2-aefa-8078ac3c71fc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:49.424718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a30a3eb5-7bf0-48d2-aefa-8078ac3c71fc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:49.454134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a30a3eb5-7bf0-48d2-aefa-8078ac3c71fc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.454673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a30a3eb5-7bf0-48d2-aefa-8078ac3c71fc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.455543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a30a3eb5-7bf0-48d2-aefa-8078ac3c71fc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.455997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a30a3eb5-7bf0-48d2-aefa-8078ac3c71fc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.529794 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7928ac5f-c6b1-43f6-a1ef-76eed418bf10 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.876656 Nov 27 20:54:49.530404 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1417/2961] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:48 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:49.548756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2267e435-0931-4a8e-b0de-1b283d1e6512 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:49.549695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2267e435-0931-4a8e-b0de-1b283d1e6512 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:49.580690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2267e435-0931-4a8e-b0de-1b283d1e6512 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.591541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2267e435-0931-4a8e-b0de-1b283d1e6512 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.592629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2267e435-0931-4a8e-b0de-1b283d1e6512 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.595069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2267e435-0931-4a8e-b0de-1b283d1e6512 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.616139 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a30a3eb5-7bf0-48d2-aefa-8078ac3c71fc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 24572 microversion: 2.1 time: 0.193569 Nov 27 20:54:49.618681 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1545/2962] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:49 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 24572 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:49.643587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:49.649777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:49.664986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.666333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.667664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.668445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.719024 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2267e435-0931-4a8e-b0de-1b283d1e6512 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.184098 Nov 27 20:54:49.729248 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1418/2963] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:49 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:49.750239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:49.751804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:49.781085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.781839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.782913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:49.783580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:49.824482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:49.832885 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-924f5d87-a03e-48b6-87af-3cfcf3ec8f13 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1222 microversion: 2.1 time: 0.212707 Nov 27 20:54:49.833478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1546/2964] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:49 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:49.865477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:54:50.070563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-309a2143-c6f0-4cbf-a893-19b28921e043 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 204 len: 0 microversion: 2.1 time: 0.337669 Nov 27 20:54:50.071104 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1419/2965] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:54:49 2021] DELETE /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:54:50.288651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-399187355", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:50.468633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] validate_networks() for [('b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:54:50.543670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c01470e-0eed-4ccf-b577-f98f1a8f9ac9 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9377280>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:50.737218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c01470e-0eed-4ccf-b577-f98f1a8f9ac9 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.197587 Nov 27 20:54:50.740527 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1420/2966] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:50 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:50.751843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46031071-97ce-4c1f-b31c-e08f812e6957 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:50.752835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46031071-97ce-4c1f-b31c-e08f812e6957 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:50.776723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46031071-97ce-4c1f-b31c-e08f812e6957 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:50.777182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46031071-97ce-4c1f-b31c-e08f812e6957 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:50.778079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46031071-97ce-4c1f-b31c-e08f812e6957 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:50.778499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46031071-97ce-4c1f-b31c-e08f812e6957 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:50.935653 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46031071-97ce-4c1f-b31c-e08f812e6957 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 24572 microversion: 2.1 time: 0.193552 Nov 27 20:54:50.941591 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1421/2967] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:50 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 24572 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:50.960301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72cd62ad-7adc-4790-9b45-bb74a8e1dc2b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:50.961584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-72cd62ad-7adc-4790-9b45-bb74a8e1dc2b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:50.985376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72cd62ad-7adc-4790-9b45-bb74a8e1dc2b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:50.988011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72cd62ad-7adc-4790-9b45-bb74a8e1dc2b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:51.000440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72cd62ad-7adc-4790-9b45-bb74a8e1dc2b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:51.001141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72cd62ad-7adc-4790-9b45-bb74a8e1dc2b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:51.126393 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72cd62ad-7adc-4790-9b45-bb74a8e1dc2b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.182710 Nov 27 20:54:51.128508 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1422/2968] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:50 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:51.133734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:51.143233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:51.171056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:51.177780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:51.178925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:51.179579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:51.416669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:51.425064 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5de29274-0c14-46fc-afb5-93884fb0c9b8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1276 microversion: 2.1 time: 0.295127 Nov 27 20:54:51.426933 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1423/2969] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:51 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1276 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:51.752551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-17113c97-3024-48ce-951c-768115d0ceeb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93c0940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:51.838695 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-17113c97-3024-48ce-951c-768115d0ceeb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.089884 Nov 27 20:54:51.839750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1424/2970] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:51 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:51.950787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be2be25d-6dc3-4a5c-9c29-ccda2150b8e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:51.951970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be2be25d-6dc3-4a5c-9c29-ccda2150b8e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:51.972648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2be25d-6dc3-4a5c-9c29-ccda2150b8e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:51.982875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2be25d-6dc3-4a5c-9c29-ccda2150b8e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:51.988862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2be25d-6dc3-4a5c-9c29-ccda2150b8e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:51.992164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2be25d-6dc3-4a5c-9c29-ccda2150b8e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:52.109308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:54:52.111859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:54:52.112601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:54:52.116496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:54:52.118022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:54:52.122211 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be2be25d-6dc3-4a5c-9c29-ccda2150b8e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 24572 microversion: 2.1 time: 0.170336 Nov 27 20:54:52.131658 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1425/2971] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:51 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 24572 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:52.147234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:52.147735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:52.151976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:52.152441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:52.161316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc0c9021-e27d-40dc-90e2-1cc09093e8f1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:52.165058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc0c9021-e27d-40dc-90e2-1cc09093e8f1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:52.190809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc0c9021-e27d-40dc-90e2-1cc09093e8f1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:52.199510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc0c9021-e27d-40dc-90e2-1cc09093e8f1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:52.204237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc0c9021-e27d-40dc-90e2-1cc09093e8f1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:52.209089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc0c9021-e27d-40dc-90e2-1cc09093e8f1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:52.255442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:54:52.272870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for user b8a8aa467b0a42459f18f6bd4ee623e4 and project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:54:52.311540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:54:52.320677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:54:52.346267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc0c9021-e27d-40dc-90e2-1cc09093e8f1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.210639 Nov 27 20:54:52.366857 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1426/2972] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:52 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:52.444971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:52.445782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:52.465995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:52.480632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:52.484624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:52.486481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:52.511442 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-612a5446-3d80-4ea1-815e-488c676db219 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.226411 Nov 27 20:54:52.516055 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1547/2973] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:54:52.580456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf526fdf-e6df-4aff-b293-3efc553be70b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:52.584622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf526fdf-e6df-4aff-b293-3efc553be70b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:52.900250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf526fdf-e6df-4aff-b293-3efc553be70b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:52.920070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf526fdf-e6df-4aff-b293-3efc553be70b tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1207 microversion: 2.1 time: 0.393352 Nov 27 20:54:52.924825 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1548/2974] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:52 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1207 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:52.941541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:52.951431 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f2aee8b-6400-4c5e-8f89-4c881e0dd5d2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1276 microversion: 2.1 time: 0.511154 Nov 27 20:54:52.957438 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1427/2975] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:52 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1276 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:52.971280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da377bd1-2319-407b-a531-c5a70380f346 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94e4b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:52.973680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0175dfe1-75ef-46c0-8094-871f0d27053e req-514eed7e-2479-4958-a96d-f0f62f17bd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f4e797-745d-4e1d-89ff-105b05e550c0", "name": "network-vif-unplugged", "status": "completed", "tag": "dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:53.019154 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:53.019154 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:53.068737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0175dfe1-75ef-46c0-8094-871f0d27053e req-514eed7e-2479-4958-a96d-f0f62f17bd74 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.069397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0175dfe1-75ef-46c0-8094-871f0d27053e req-514eed7e-2479-4958-a96d-f0f62f17bd74 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.090034 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da377bd1-2319-407b-a531-c5a70380f346 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.131054 Nov 27 20:54:53.095784 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1428/2976] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:52 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:53.136955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6266501-3155-4c17-b128-16dd8544a84a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:53.138036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6266501-3155-4c17-b128-16dd8544a84a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:53.140817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0175dfe1-75ef-46c0-8094-871f0d27053e req-514eed7e-2479-4958-a96d-f0f62f17bd74 service nova] Creating event network-vif-unplugged:dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef for instance f7f4e797-745d-4e1d-89ff-105b05e550c0 on nch2-master-1 Nov 27 20:54:53.157973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6266501-3155-4c17-b128-16dd8544a84a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.157973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6266501-3155-4c17-b128-16dd8544a84a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.158586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6266501-3155-4c17-b128-16dd8544a84a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.170941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6266501-3155-4c17-b128-16dd8544a84a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.173396 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0175dfe1-75ef-46c0-8094-871f0d27053e req-514eed7e-2479-4958-a96d-f0f62f17bd74 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.246387 Nov 27 20:54:53.190406 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1549/2977] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:53.294433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6266501-3155-4c17-b128-16dd8544a84a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 24572 microversion: 2.1 time: 0.154825 Nov 27 20:54:53.295488 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1429/2978] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:53 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 24572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:54:53.376154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-357b53db-e5cc-4b04-845b-671dd8de49db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:53.377505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-357b53db-e5cc-4b04-845b-671dd8de49db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:53.428283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-357b53db-e5cc-4b04-845b-671dd8de49db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.429001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-357b53db-e5cc-4b04-845b-671dd8de49db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.439503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-357b53db-e5cc-4b04-845b-671dd8de49db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.441023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-357b53db-e5cc-4b04-845b-671dd8de49db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.588475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-357b53db-e5cc-4b04-845b-671dd8de49db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.212153 Nov 27 20:54:53.595174 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1550/2979] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:53 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:53.847631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-debd9667-8fab-4823-aef3-252c042a992d req-9432dd85-a98f-4243-ac1e-902b925e9200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f4e797-745d-4e1d-89ff-105b05e550c0", "name": "network-vif-deleted", "tag": "dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:53.849137 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:53.849137 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:53.875610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-debd9667-8fab-4823-aef3-252c042a992d req-9432dd85-a98f-4243-ac1e-902b925e9200 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.876063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-debd9667-8fab-4823-aef3-252c042a992d req-9432dd85-a98f-4243-ac1e-902b925e9200 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.942273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-debd9667-8fab-4823-aef3-252c042a992d req-9432dd85-a98f-4243-ac1e-902b925e9200 service nova] Creating event network-vif-deleted:dcbb4f29-51dd-4bf5-9f92-4d1e24d149ef for instance f7f4e797-745d-4e1d-89ff-105b05e550c0 on nch2-master-1 Nov 27 20:54:53.942907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:53.944061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:53.957307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.963426 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-debd9667-8fab-4823-aef3-252c042a992d req-9432dd85-a98f-4243-ac1e-902b925e9200 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114950 Nov 27 20:54:53.965108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.967988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1430/2980] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:53.974488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:53.977739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:53.988384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:53.994718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:54.018897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:54.028516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:54.034081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:54.037100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:54.163143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:54.188092 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f253ce3-88ac-4ea9-8ae8-68a9ded162af tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1211 microversion: 2.1 time: 0.250262 Nov 27 20:54:54.188689 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1551/2981] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:53 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1211 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:54.216704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4e34b1f3-4e9a-4b57-9eee-a9358476ed56 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d949a700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:54.335040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4e34b1f3-4e9a-4b57-9eee-a9358476ed56 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.141458 Nov 27 20:54:54.336155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1552/2982] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:54 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:54.349876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e39a21e-2c2d-4878-9bbc-1425c7928a01 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:54.369219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e39a21e-2c2d-4878-9bbc-1425c7928a01 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:54.416025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e39a21e-2c2d-4878-9bbc-1425c7928a01 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:54.416491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e39a21e-2c2d-4878-9bbc-1425c7928a01 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:54.417304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e39a21e-2c2d-4878-9bbc-1425c7928a01 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:54.417748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e39a21e-2c2d-4878-9bbc-1425c7928a01 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:54.578047 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e39a21e-2c2d-4878-9bbc-1425c7928a01 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.238126 Nov 27 20:54:54.578727 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1553/2983] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:54 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:54.609799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-162c49a9-3e89-443f-9848-a795457c3307 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:54.611502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-162c49a9-3e89-443f-9848-a795457c3307 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:54.624367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-162c49a9-3e89-443f-9848-a795457c3307 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:54.625507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-162c49a9-3e89-443f-9848-a795457c3307 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:54.626499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-162c49a9-3e89-443f-9848-a795457c3307 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:54.626945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-162c49a9-3e89-443f-9848-a795457c3307 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:54.763022 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-162c49a9-3e89-443f-9848-a795457c3307 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.161693 Nov 27 20:54:54.770130 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1554/2984] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:54 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:54:55.210141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:55.212388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:55.228066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:55.228826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:55.235319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:55.235953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:55.337158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:55.350133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3b8f4c3-6cb0-44c0-8da8-92564bc97cc8 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1277 microversion: 2.1 time: 0.147215 Nov 27 20:54:55.351466 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1555/2985] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:55 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:55.356722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5ca7f2e2-f703-4a6b-9f0f-9a2815a1f70c tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9486d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:55.439278 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5ca7f2e2-f703-4a6b-9f0f-9a2815a1f70c tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.086463 Nov 27 20:54:55.447476 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1556/2986] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:55 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:55.591332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3351bc11-7e55-42c8-9aa0-87b947b31b32 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:55.594007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3351bc11-7e55-42c8-9aa0-87b947b31b32 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:55.619128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3351bc11-7e55-42c8-9aa0-87b947b31b32 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:55.619922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3351bc11-7e55-42c8-9aa0-87b947b31b32 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:55.622276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3351bc11-7e55-42c8-9aa0-87b947b31b32 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:55.623483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3351bc11-7e55-42c8-9aa0-87b947b31b32 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:55.737920 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3351bc11-7e55-42c8-9aa0-87b947b31b32 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.151570 Nov 27 20:54:55.739209 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1557/2987] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:55 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:55.777994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0708bca-562e-452c-a0b5-8c7f73a18e84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:55.779011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0708bca-562e-452c-a0b5-8c7f73a18e84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:55.794877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0708bca-562e-452c-a0b5-8c7f73a18e84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:55.795376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0708bca-562e-452c-a0b5-8c7f73a18e84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:55.796195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0708bca-562e-452c-a0b5-8c7f73a18e84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:55.796640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0708bca-562e-452c-a0b5-8c7f73a18e84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:55.909400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0708bca-562e-452c-a0b5-8c7f73a18e84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.127864 Nov 27 20:54:55.910154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1558/2988] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:55 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:56.261618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:56.274314 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a4ae1a6-98bb-4e00-a19d-a007c82070f8 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 2.302279 Nov 27 20:54:56.295936 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1431/2989] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:53 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:56.367959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:56.368669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:56.380859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.381311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:56.382116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.382560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:56.452952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b61f397-e59c-43ad-a165-a722ebd03cb1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94ba430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:56.558464 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b61f397-e59c-43ad-a165-a722ebd03cb1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.109104 Nov 27 20:54:56.559839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1432/2990] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:56 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:56.598372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:56.609070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00789b36-77f4-4cd2-8e5b-7d60946f735e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1265 microversion: 2.1 time: 0.245058 Nov 27 20:54:56.613753 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1559/2991] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:56 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:56.750250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07cf11d2-a0a8-48b9-98ff-0eec70fd041b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:56.751352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07cf11d2-a0a8-48b9-98ff-0eec70fd041b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:56.767491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07cf11d2-a0a8-48b9-98ff-0eec70fd041b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.770285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07cf11d2-a0a8-48b9-98ff-0eec70fd041b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:56.773681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07cf11d2-a0a8-48b9-98ff-0eec70fd041b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.777527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07cf11d2-a0a8-48b9-98ff-0eec70fd041b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:56.874018 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07cf11d2-a0a8-48b9-98ff-0eec70fd041b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.126619 Nov 27 20:54:56.880398 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1560/2992] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:56 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:56.927196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1904caf1-d109-4bcf-ae70-fa51fce38273 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:56.932614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1904caf1-d109-4bcf-ae70-fa51fce38273 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:56.937710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-14c15a04-21af-412a-ab45-3520e3d90b64 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:56.946633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1904caf1-d109-4bcf-ae70-fa51fce38273 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.947102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1904caf1-d109-4bcf-ae70-fa51fce38273 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:56.949474 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:56.949474 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:56.950866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1904caf1-d109-4bcf-ae70-fa51fce38273 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.951356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1904caf1-d109-4bcf-ae70-fa51fce38273 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:56.953102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14c15a04-21af-412a-ab45-3520e3d90b64 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.955111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14c15a04-21af-412a-ab45-3520e3d90b64 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:56.956585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14c15a04-21af-412a-ab45-3520e3d90b64 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:56.958428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14c15a04-21af-412a-ab45-3520e3d90b64 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.003907 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-14c15a04-21af-412a-ab45-3520e3d90b64 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.286663 Nov 27 20:54:57.005178 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1433/2993] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:54:56 2021] GET /compute/v2.1/os-services => generated 947 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:57.028997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d579a96-d223-4128-9196-9fe7948216b1 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:57.030859 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1904caf1-d109-4bcf-ae70-fa51fce38273 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.112574 Nov 27 20:54:57.032778 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:57.032778 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:57.035916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1561/2994] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:56 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:57.038197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d579a96-d223-4128-9196-9fe7948216b1 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.041196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d579a96-d223-4128-9196-9fe7948216b1 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.047872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d579a96-d223-4128-9196-9fe7948216b1 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.048872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d579a96-d223-4128-9196-9fe7948216b1 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.132582 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d579a96-d223-4128-9196-9fe7948216b1 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.114399 Nov 27 20:54:57.135023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1434/2995] 10.222.0.21 () {58 vars in 1173 bytes} [Sat Nov 27 20:54:57 2021] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:57.149213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e83b9ef2-4ecc-4704-aa0e-a35c82ff576f tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:57.150609 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:57.150609 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:54:57.152219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83b9ef2-4ecc-4704-aa0e-a35c82ff576f tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.152676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83b9ef2-4ecc-4704-aa0e-a35c82ff576f tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.153548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83b9ef2-4ecc-4704-aa0e-a35c82ff576f tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.153986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e83b9ef2-4ecc-4704-aa0e-a35c82ff576f tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.216568 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e83b9ef2-4ecc-4704-aa0e-a35c82ff576f tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073634 Nov 27 20:54:57.217828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1562/2996] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 20:54:57 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:57.229581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58864815-5a84-4e8c-a152-b41a10bf97f5 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:57.231047 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:57.231047 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:57.232829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58864815-5a84-4e8c-a152-b41a10bf97f5 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.233446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58864815-5a84-4e8c-a152-b41a10bf97f5 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.234826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58864815-5a84-4e8c-a152-b41a10bf97f5 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.235406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58864815-5a84-4e8c-a152-b41a10bf97f5 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.301744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:57.302965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:57.304304 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58864815-5a84-4e8c-a152-b41a10bf97f5 tempest-ServicesAdminTestJSON-398366913 tempest-ServicesAdminTestJSON-398366913-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.078924 Nov 27 20:54:57.322042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1435/2997] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:54:57 2021] GET /compute/v2.1/os-services => generated 947 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:57.323269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.325524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.326312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.327892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.574065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23af82e3-416b-41ed-ac1b-7d8d55509ef9 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9379430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:57.635951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:57.647739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5fc995eb-27a4-42d5-804d-abbb455efbb3 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.349602 Nov 27 20:54:57.657454 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1563/2998] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:57 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:57.663515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:57.664387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:57.669165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23af82e3-416b-41ed-ac1b-7d8d55509ef9 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.099193 Nov 27 20:54:57.669766 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1436/2999] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:57 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:54:57.678103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.680149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.688402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.688859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.832506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:57.844870 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d911f0c-a32a-41b7-a255-eed6b308d632 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1265 microversion: 2.1 time: 0.185430 Nov 27 20:54:57.845462 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1564/3000] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:57 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:57.890664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3dfabc2e-7f32-4e35-9824-8959835b521e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:57.891834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3dfabc2e-7f32-4e35-9824-8959835b521e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:57.904017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dfabc2e-7f32-4e35-9824-8959835b521e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.905194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dfabc2e-7f32-4e35-9824-8959835b521e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:57.905990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dfabc2e-7f32-4e35-9824-8959835b521e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:57.907582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dfabc2e-7f32-4e35-9824-8959835b521e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:58.017755 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3dfabc2e-7f32-4e35-9824-8959835b521e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.132139 Nov 27 20:54:58.020419 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1437/3001] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:57 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:58.051279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e1969806-3979-436f-a265-80064fcc1393 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:58.054713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e1969806-3979-436f-a265-80064fcc1393 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:58.074015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1969806-3979-436f-a265-80064fcc1393 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:58.074621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1969806-3979-436f-a265-80064fcc1393 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:58.078218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1969806-3979-436f-a265-80064fcc1393 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:58.079375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1969806-3979-436f-a265-80064fcc1393 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:58.159830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e1969806-3979-436f-a265-80064fcc1393 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.114250 Nov 27 20:54:58.164147 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1565/3002] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:58 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:58.210980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d2df04f1-eae4-4341-942b-4e7ce3415dc2 req-2ba9a8ce-2ab4-4b5b-af9c-f8e176b5ecf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8762dee5-37b1-4d12-8e0d-4190e353bd9e", "tag": "1d0f60a0-826b-4e4d-8af8-93d9fec8ab00"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:58.218831 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:58.218831 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:54:58.246108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d2df04f1-eae4-4341-942b-4e7ce3415dc2 req-2ba9a8ce-2ab4-4b5b-af9c-f8e176b5ecf1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:58.247477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d2df04f1-eae4-4341-942b-4e7ce3415dc2 req-2ba9a8ce-2ab4-4b5b-af9c-f8e176b5ecf1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:58.273922 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d2df04f1-eae4-4341-942b-4e7ce3415dc2 req-2ba9a8ce-2ab4-4b5b-af9c-f8e176b5ecf1 service nova] Creating event network-changed:1d0f60a0-826b-4e4d-8af8-93d9fec8ab00 for instance 8762dee5-37b1-4d12-8e0d-4190e353bd9e on nch1-master-1 Nov 27 20:54:58.282016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d2df04f1-eae4-4341-942b-4e7ce3415dc2 req-2ba9a8ce-2ab4-4b5b-af9c-f8e176b5ecf1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093004 Nov 27 20:54:58.284954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1438/3003] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:54:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:54:58.666882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:58.667655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:58.687313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7128f9f8-2eec-41d3-bcbe-c70a164c185a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9379700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:58.696179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:58.698008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:58.699214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:58.701899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:58.797759 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7128f9f8-2eec-41d3-bcbe-c70a164c185a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.118602 Nov 27 20:54:58.803493 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1439/3004] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:58 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:58.864268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:58.865089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:58.882695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:58.889492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:58.891110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:58.893360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:59.203078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:59.218547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da56fcf0-6dbb-4094-becc-687a96efa6a7 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.557286 Nov 27 20:54:59.228197 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1566/3005] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:58 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:59.235345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b480f92-0359-4b8e-be54-fd7301b51b64 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:59.240961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b480f92-0359-4b8e-be54-fd7301b51b64 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:59.254766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b480f92-0359-4b8e-be54-fd7301b51b64 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:59.256166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b480f92-0359-4b8e-be54-fd7301b51b64 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:59.257450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b480f92-0359-4b8e-be54-fd7301b51b64 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:59.259927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b480f92-0359-4b8e-be54-fd7301b51b64 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:59.374730 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b480f92-0359-4b8e-be54-fd7301b51b64 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.143519 Nov 27 20:54:59.375942 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1567/3006] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:59 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:59.389282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1430a091-0084-4487-94d4-a29def83b22e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:54:59.393501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1430a091-0084-4487-94d4-a29def83b22e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:54:59.414274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1430a091-0084-4487-94d4-a29def83b22e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:59.415779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1430a091-0084-4487-94d4-a29def83b22e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:59.418096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1430a091-0084-4487-94d4-a29def83b22e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:54:59.423650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1430a091-0084-4487-94d4-a29def83b22e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:54:59.499072 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1430a091-0084-4487-94d4-a29def83b22e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.120770 Nov 27 20:54:59.500180 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1568/3007] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:54:59 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:54:59.813602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80a22d10-5d71-4971-a2bc-ea7f093292fa tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9483160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:54:59.816672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:54:59.830930 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8327f700-4e33-4f87-817e-a00342a1e739 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.972768 Nov 27 20:54:59.832108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1440/3008] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:54:58 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:54:59.881457 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80a22d10-5d71-4971-a2bc-ea7f093292fa tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.074069 Nov 27 20:54:59.882231 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1569/3009] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:59 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:00.237278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:00.238237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:00.260557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.265889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:00.267824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.268205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:00.388560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28ca6f7b-3da2-42ce-8c4b-8f2798d2d33c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:00.390173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28ca6f7b-3da2-42ce-8c4b-8f2798d2d33c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:00.400370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ca6f7b-3da2-42ce-8c4b-8f2798d2d33c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.401843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ca6f7b-3da2-42ce-8c4b-8f2798d2d33c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:00.404274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ca6f7b-3da2-42ce-8c4b-8f2798d2d33c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.406661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ca6f7b-3da2-42ce-8c4b-8f2798d2d33c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:00.503787 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28ca6f7b-3da2-42ce-8c4b-8f2798d2d33c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.121212 Nov 27 20:55:00.515695 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1570/3010] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:00 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:55:00.539922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8830fdb0-e29f-4762-9eb5-03f002bd56b2 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:00.541053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8830fdb0-e29f-4762-9eb5-03f002bd56b2 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:00.553394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8830fdb0-e29f-4762-9eb5-03f002bd56b2 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.553844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8830fdb0-e29f-4762-9eb5-03f002bd56b2 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:00.554654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8830fdb0-e29f-4762-9eb5-03f002bd56b2 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.555095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8830fdb0-e29f-4762-9eb5-03f002bd56b2 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:00.703586 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8830fdb0-e29f-4762-9eb5-03f002bd56b2 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.186287 Nov 27 20:55:00.704253 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1571/3011] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:00 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:00.848846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:00.849544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:00.860229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.860678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:00.861480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:00.861922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:01.022894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:01.044629 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e4672a8-376d-42b8-bf5f-b4a6827065fa tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.809736 Nov 27 20:55:01.045276 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1441/3012] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:00 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:01.067151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d3996eb-acde-45d9-980b-8ab78460daed tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93c0b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:01.180508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d3996eb-acde-45d9-980b-8ab78460daed tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.132369 Nov 27 20:55:01.185950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1442/3013] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:01 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:01.455363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:01.463235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ed836a6-f2e5-4ee0-878b-9aeddf2f8e2c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.618319 Nov 27 20:55:01.465055 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1572/3014] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:00 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:01.519242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-130c8920-2b7f-4b7b-921d-b657bce4257e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:01.520719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-130c8920-2b7f-4b7b-921d-b657bce4257e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:01.521755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-126983b2-c6c0-4fb9-827a-a7996c4a172e req-90fb08d1-d98f-45d2-ac05-3b39d53958ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8911dc7c-bdfd-4fcb-a7a9-65e9c946c806", "tag": "a2426259-c237-480c-afc3-6c9804dc6ce1"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:01.523707 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:01.523707 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:01.535514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130c8920-2b7f-4b7b-921d-b657bce4257e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:01.537416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130c8920-2b7f-4b7b-921d-b657bce4257e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:01.540348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130c8920-2b7f-4b7b-921d-b657bce4257e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:01.541138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-126983b2-c6c0-4fb9-827a-a7996c4a172e req-90fb08d1-d98f-45d2-ac05-3b39d53958ef service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:01.541585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-126983b2-c6c0-4fb9-827a-a7996c4a172e req-90fb08d1-d98f-45d2-ac05-3b39d53958ef service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:01.541839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-130c8920-2b7f-4b7b-921d-b657bce4257e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:01.565148 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-126983b2-c6c0-4fb9-827a-a7996c4a172e req-90fb08d1-d98f-45d2-ac05-3b39d53958ef service nova] Creating event network-changed:a2426259-c237-480c-afc3-6c9804dc6ce1 for instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 on nch1-master-1 Nov 27 20:55:01.580434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-126983b2-c6c0-4fb9-827a-a7996c4a172e req-90fb08d1-d98f-45d2-ac05-3b39d53958ef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062115 Nov 27 20:55:01.581918 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1573/3015] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:55:01.615827 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-130c8920-2b7f-4b7b-921d-b657bce4257e tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.103939 Nov 27 20:55:01.616914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1443/3016] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:01 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:01.731854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2688b713-e1e5-4431-b85a-7af1c249c833 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:01.737392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2688b713-e1e5-4431-b85a-7af1c249c833 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:01.756895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2688b713-e1e5-4431-b85a-7af1c249c833 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:01.757420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2688b713-e1e5-4431-b85a-7af1c249c833 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:01.758335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2688b713-e1e5-4431-b85a-7af1c249c833 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:01.758847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2688b713-e1e5-4431-b85a-7af1c249c833 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:01.939584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2688b713-e1e5-4431-b85a-7af1c249c833 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.227067 Nov 27 20:55:01.942185 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1574/3017] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:01 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:02.111715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:02.112552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:02.137697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:02.138190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:02.140434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:02.142957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:02.193903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17989139-c087-4379-913d-1e71e2a78cca tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94aa040>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:02.312469 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17989139-c087-4379-913d-1e71e2a78cca tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.117601 Nov 27 20:55:02.313905 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1575/3018] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:02 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:02.483510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:02.484542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:02.499582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:02.505421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:02.507684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:02.509099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:02.965607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:02.986006 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83c0222f-1f1c-42a7-9e3c-b6db34d7748c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.501437 Nov 27 20:55:02.995468 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1576/3019] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:02 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:03.001120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88b3c801-bd7b-4c9d-ac52-b91df6679462 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:03.002160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88b3c801-bd7b-4c9d-ac52-b91df6679462 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:03.004591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:03.016437 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-319ba792-4601-4672-a20a-271e4315d897 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.934508 Nov 27 20:55:03.016860 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1444/3020] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:02 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:03.024226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88b3c801-bd7b-4c9d-ac52-b91df6679462 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.026618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88b3c801-bd7b-4c9d-ac52-b91df6679462 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.031445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88b3c801-bd7b-4c9d-ac52-b91df6679462 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.032548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88b3c801-bd7b-4c9d-ac52-b91df6679462 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.037538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11da2e12-db60-4727-973d-1fa53440573f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:03.044393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11da2e12-db60-4727-973d-1fa53440573f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:03.082614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11da2e12-db60-4727-973d-1fa53440573f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.088802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11da2e12-db60-4727-973d-1fa53440573f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.089958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11da2e12-db60-4727-973d-1fa53440573f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.090723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11da2e12-db60-4727-973d-1fa53440573f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.186700 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11da2e12-db60-4727-973d-1fa53440573f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.168270 Nov 27 20:55:03.187548 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1445/3021] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:03 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:03.194661 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88b3c801-bd7b-4c9d-ac52-b91df6679462 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.204553 Nov 27 20:55:03.203752 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1577/3022] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:02 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:03.332193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77c9164b-27a5-4d57-972b-81daea722a7f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9396040>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:03.415510 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77c9164b-27a5-4d57-972b-81daea722a7f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1452 microversion: 2.1 time: 0.092011 Nov 27 20:55:03.416805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1446/3023] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:03 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:03.715922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Action: 'update', calling method: .version_select at 0x7f15d944f820>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:03.718263 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:03.718263 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:03.721767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.722253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.735218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.736570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.748108 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] HTTP exception thrown: Service 607265b8-cec4-42a2-a784-53d878ce2f97 could not be found. Nov 27 20:55:03.749818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Returning 404 to user: Service 607265b8-cec4-42a2-a784-53d878ce2f97 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:03.751742 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b920526-2543-4e68-a27f-f34417ac9b54 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-services/607265b8-cec4-42a2-a784-53d878ce2f97" status: 404 len: 110 microversion: 2.53 time: 0.245230 Nov 27 20:55:03.753834 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1578/3024] 10.222.0.21 () {62 vars in 1308 bytes} [Sat Nov 27 20:55:03 2021] PUT /compute/v2.1/os-services/607265b8-cec4-42a2-a784-53d878ce2f97 => generated 110 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:55:03.771067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Action: 'update', calling method: .version_select at 0x7f15d9396310>, body: {"status": "disabled"} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:03.772569 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:03.772569 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:03.774376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.774837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.788803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.789614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.797509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] HTTP exception thrown: Service 607265b8-cec4-42a2-a784-53d878ce2f97 could not be found. Nov 27 20:55:03.798413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Returning 404 to user: Service 607265b8-cec4-42a2-a784-53d878ce2f97 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:03.799541 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0151d02f-2edc-49c7-aaaa-3ac6f50dbe20 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-services/607265b8-cec4-42a2-a784-53d878ce2f97" status: 404 len: 110 microversion: 2.53 time: 0.034820 Nov 27 20:55:03.800793 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1447/3025] 10.222.0.21 () {62 vars in 1308 bytes} [Sat Nov 27 20:55:03 2021] PUT /compute/v2.1/os-services/607265b8-cec4-42a2-a784-53d878ce2f97 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:55:03.811023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Action: 'update', calling method: .version_select at 0x7f15d949c8b0>, body: {"status": "enabled"} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:03.813998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.814813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.821829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.822280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.827918 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] HTTP exception thrown: Service 607265b8-cec4-42a2-a784-53d878ce2f97 could not be found. Nov 27 20:55:03.828730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Returning 404 to user: Service 607265b8-cec4-42a2-a784-53d878ce2f97 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:03.829558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eac46631-f94c-493d-a871-e7085699e0f5 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-services/607265b8-cec4-42a2-a784-53d878ce2f97" status: 404 len: 110 microversion: 2.53 time: 0.022859 Nov 27 20:55:03.831121 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1579/3026] 10.222.0.21 () {62 vars in 1308 bytes} [Sat Nov 27 20:55:03 2021] PUT /compute/v2.1/os-services/607265b8-cec4-42a2-a784-53d878ce2f97 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:55:03.842438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b01b92fe-2de6-451a-817b-4a17c1220cef tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:03.844515 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:03.844515 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:03.847202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01b92fe-2de6-451a-817b-4a17c1220cef tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.848045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01b92fe-2de6-451a-817b-4a17c1220cef tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.849109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01b92fe-2de6-451a-817b-4a17c1220cef tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.849724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01b92fe-2de6-451a-817b-4a17c1220cef tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.879448 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b01b92fe-2de6-451a-817b-4a17c1220cef tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.043188 Nov 27 20:55:03.880321 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1448/3027] 10.222.0.21 () {60 vars in 1177 bytes} [Sat Nov 27 20:55:03 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:03.893845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e3af2e8-4275-447e-82af-375eea62530e tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:03.899541 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:03.899541 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:03.901423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e3af2e8-4275-447e-82af-375eea62530e tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.902251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e3af2e8-4275-447e-82af-375eea62530e tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.903666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e3af2e8-4275-447e-82af-375eea62530e tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.904274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e3af2e8-4275-447e-82af-375eea62530e tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.932868 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e3af2e8-4275-447e-82af-375eea62530e tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.044201 Nov 27 20:55:03.933869 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1580/3028] 10.222.0.21 () {60 vars in 1210 bytes} [Sat Nov 27 20:55:03 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:03.947016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a16b4543-e56d-4387-ba89-26d64574c3eb tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:03.948774 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:03.948774 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:03.951391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a16b4543-e56d-4387-ba89-26d64574c3eb tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.952138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a16b4543-e56d-4387-ba89-26d64574c3eb tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.953205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a16b4543-e56d-4387-ba89-26d64574c3eb tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:03.953896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a16b4543-e56d-4387-ba89-26d64574c3eb tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:03.994172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a16b4543-e56d-4387-ba89-26d64574c3eb tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.052006 Nov 27 20:55:03.995408 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1449/3029] 10.222.0.21 () {60 vars in 1177 bytes} [Sat Nov 27 20:55:03 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:04.002939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.004355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:04.012719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.012902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-716582cd-fca5-4367-8886-a182611c9123 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.013176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.013967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.014117 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:04.014117 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:04.015194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.015542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-716582cd-fca5-4367-8886-a182611c9123 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.016228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-716582cd-fca5-4367-8886-a182611c9123 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.017042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-716582cd-fca5-4367-8886-a182611c9123 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.017661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-716582cd-fca5-4367-8886-a182611c9123 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.044416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-716582cd-fca5-4367-8886-a182611c9123 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.034323 Nov 27 20:55:04.045045 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1450/3030] 10.222.0.21 () {60 vars in 1236 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:04.055369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.056955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:04.064863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.065638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.066765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.067706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.225366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:04.233680 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d400ab03-4d13-4daa-b602-a1addf288521 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.234497 Nov 27 20:55:04.234265 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1581/3031] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:03 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:04.235105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:04.249244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f56d6f5d-7058-45ba-a706-4cedcec14f67 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.249244 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:04.249244 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:04.253948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56d6f5d-7058-45ba-a706-4cedcec14f67 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.254843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56d6f5d-7058-45ba-a706-4cedcec14f67 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.256595 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f9ed267-1ffe-405f-a7db-bed8a0dcb556 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.210047 Nov 27 20:55:04.257425 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1451/3032] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:04.261821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56d6f5d-7058-45ba-a706-4cedcec14f67 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.263214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56d6f5d-7058-45ba-a706-4cedcec14f67 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.269591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-916b47a5-cb36-4edd-9413-0fac0bf96737 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:04.272317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-916b47a5-cb36-4edd-9413-0fac0bf96737 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:04.335397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-916b47a5-cb36-4edd-9413-0fac0bf96737 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.336311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-916b47a5-cb36-4edd-9413-0fac0bf96737 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.338844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-916b47a5-cb36-4edd-9413-0fac0bf96737 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.339348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-916b47a5-cb36-4edd-9413-0fac0bf96737 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.397223 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f56d6f5d-7058-45ba-a706-4cedcec14f67 tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.160517 Nov 27 20:55:04.412341 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1582/3033] 10.222.0.21 () {60 vars in 1177 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:04.426693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11356a00-e7f4-404e-98a9-516807aaf54c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:04.427687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-11356a00-e7f4-404e-98a9-516807aaf54c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:04.448983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11356a00-e7f4-404e-98a9-516807aaf54c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.449287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11356a00-e7f4-404e-98a9-516807aaf54c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.458749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11356a00-e7f4-404e-98a9-516807aaf54c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.459470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11356a00-e7f4-404e-98a9-516807aaf54c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.466110 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-916b47a5-cb36-4edd-9413-0fac0bf96737 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.203463 Nov 27 20:55:04.470599 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1452/3034] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:04 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:04.486160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-173a94c6-9817-48e8-b4e0-8580481bb0bd tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.496408 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:04.496408 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:04.506906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-173a94c6-9817-48e8-b4e0-8580481bb0bd tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.511405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-173a94c6-9817-48e8-b4e0-8580481bb0bd tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.516230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-173a94c6-9817-48e8-b4e0-8580481bb0bd tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.519180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-173a94c6-9817-48e8-b4e0-8580481bb0bd tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.589749 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-11356a00-e7f4-404e-98a9-516807aaf54c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.175786 Nov 27 20:55:04.590455 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1583/3035] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:04 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:04.613253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-812fbff4-44b7-439e-9af5-c1b4fbf61d97 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94ce550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.628355 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-173a94c6-9817-48e8-b4e0-8580481bb0bd tempest-ServicesAdminNegativeV253TestJSON-816518824 tempest-ServicesAdminNegativeV253TestJSON-816518824-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.152134 Nov 27 20:55:04.644774 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1453/3036] 10.222.0.21 () {60 vars in 1238 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:04.742954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-812fbff4-44b7-439e-9af5-c1b4fbf61d97 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1461 microversion: 2.1 time: 0.151308 Nov 27 20:55:04.747145 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1584/3037] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1461 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:04.772853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec079323-ff24-49fd-881b-00d705e61902 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9495ee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.855626 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec079323-ff24-49fd-881b-00d705e61902 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 200 len: 1461 microversion: 2.1 time: 0.098430 Nov 27 20:55:04.866880 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1585/3038] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:04.880097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:04.881406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:04.899043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.901557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:04.901557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:04.902006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.207207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:05.220488 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa70dde4-e9a6-48c6-8cf4-7bb74252e1eb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1467 microversion: 2.1 time: 0.351922 Nov 27 20:55:05.222576 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1586/3039] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1467 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:05.243987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c234f7ea-6fbd-4821-bd32-4ad8d51c249d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-753627028"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:05.248632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c234f7ea-6fbd-4821-bd32-4ad8d51c249d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:05.265634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c234f7ea-6fbd-4821-bd32-4ad8d51c249d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.267205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c234f7ea-6fbd-4821-bd32-4ad8d51c249d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.273462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c234f7ea-6fbd-4821-bd32-4ad8d51c249d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.274529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c234f7ea-6fbd-4821-bd32-4ad8d51c249d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.342553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1bd7666d-52e8-4c62-ba29-855e7d3f205e tempest-ServicesAdminNegativeV253TestJSON-1636064639 tempest-ServicesAdminNegativeV253TestJSON-1636064639-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:05.344551 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:05.344551 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:05.346240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1bd7666d-52e8-4c62-ba29-855e7d3f205e tempest-ServicesAdminNegativeV253TestJSON-1636064639 tempest-ServicesAdminNegativeV253TestJSON-1636064639-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4610eaaf223f4389bb8c63ed8669e5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ba31f5d83b4626b1c8b2c665e09383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:05.346480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1bd7666d-52e8-4c62-ba29-855e7d3f205e tempest-ServicesAdminNegativeV253TestJSON-1636064639 tempest-ServicesAdminNegativeV253TestJSON-1636064639-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:05.347697 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1bd7666d-52e8-4c62-ba29-855e7d3f205e tempest-ServicesAdminNegativeV253TestJSON-1636064639 tempest-ServicesAdminNegativeV253TestJSON-1636064639-project] 10.222.0.21 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.700785 Nov 27 20:55:05.348209 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1454/3040] 10.222.0.21 () {60 vars in 1177 bytes} [Sat Nov 27 20:55:04 2021] GET /compute/v2.1/os-services => generated 112 bytes in 702 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:55:05.355487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:05.357541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:05.366170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.366981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.375981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.379954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.695968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:05.705404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c234f7ea-6fbd-4821-bd32-4ad8d51c249d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "POST /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c/action" status: 202 len: 0 microversion: 2.1 time: 0.469557 Nov 27 20:55:05.707135 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1587/3041] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:05 2021] POST /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:55:05.714139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:05.714852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:05.716305 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72b8056b-617e-4111-bbe0-1010693f1197 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.366132 Nov 27 20:55:05.717404 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1455/3042] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:05 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:05.723274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7715e60a-ba3f-4b2e-bfc7-0fa6c27190e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:05.724459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7715e60a-ba3f-4b2e-bfc7-0fa6c27190e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:05.731551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7715e60a-ba3f-4b2e-bfc7-0fa6c27190e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.733675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7715e60a-ba3f-4b2e-bfc7-0fa6c27190e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.734345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.734804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.735336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7715e60a-ba3f-4b2e-bfc7-0fa6c27190e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.735656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.736226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.736800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7715e60a-ba3f-4b2e-bfc7-0fa6c27190e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.830300 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7715e60a-ba3f-4b2e-bfc7-0fa6c27190e9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.111428 Nov 27 20:55:05.831220 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1456/3043] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:05 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:05.838565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53bc2f54-5371-4acb-9248-2af3fbfe0dc7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:05.842102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53bc2f54-5371-4acb-9248-2af3fbfe0dc7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:05.850682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bc2f54-5371-4acb-9248-2af3fbfe0dc7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.851485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bc2f54-5371-4acb-9248-2af3fbfe0dc7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.852453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bc2f54-5371-4acb-9248-2af3fbfe0dc7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:05.853231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bc2f54-5371-4acb-9248-2af3fbfe0dc7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:05.921004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53bc2f54-5371-4acb-9248-2af3fbfe0dc7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.088108 Nov 27 20:55:05.930925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1457/3044] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:05 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:05.948054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7896c9e1-7887-42c5-b140-1909ffaedf8e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93c0040>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:05.960094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:05.982995 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9fd977c0-e5a9-4398-91c0-8a240d924273 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.262507 Nov 27 20:55:05.984328 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1588/3045] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:05 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:06.021011 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7896c9e1-7887-42c5-b140-1909ffaedf8e tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.088772 Nov 27 20:55:06.021676 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1458/3046] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:05 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:06.707863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6b15e14e-7ead-49f5-a49e-05b36713cd39 req-8455f998-7023-481a-9f8e-f15299f0d612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762dee5-37b1-4d12-8e0d-4190e353bd9e", "name": "network-vif-plugged", "status": "completed", "tag": "1d0f60a0-826b-4e4d-8af8-93d9fec8ab00"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:06.709640 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:06.709640 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:06.720442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6b15e14e-7ead-49f5-a49e-05b36713cd39 req-8455f998-7023-481a-9f8e-f15299f0d612 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:06.721025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6b15e14e-7ead-49f5-a49e-05b36713cd39 req-8455f998-7023-481a-9f8e-f15299f0d612 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:06.739139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:06.740983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:06.750274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:06.757632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:06.758667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:06.762024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:06.766132 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6b15e14e-7ead-49f5-a49e-05b36713cd39 req-8455f998-7023-481a-9f8e-f15299f0d612 service nova] Creating event network-vif-plugged:1d0f60a0-826b-4e4d-8af8-93d9fec8ab00 for instance 8762dee5-37b1-4d12-8e0d-4190e353bd9e on nch1-master-1 Nov 27 20:55:06.774600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6b15e14e-7ead-49f5-a49e-05b36713cd39 req-8455f998-7023-481a-9f8e-f15299f0d612 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070407 Nov 27 20:55:06.775886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1589/3047] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:06.845872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ffe681c1-342c-4628-952a-f2645e387610 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:06.847388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ffe681c1-342c-4628-952a-f2645e387610 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:06.857825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffe681c1-342c-4628-952a-f2645e387610 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:06.858284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffe681c1-342c-4628-952a-f2645e387610 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:06.860583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffe681c1-342c-4628-952a-f2645e387610 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:06.862441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffe681c1-342c-4628-952a-f2645e387610 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:06.914235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ffe681c1-342c-4628-952a-f2645e387610 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.073921 Nov 27 20:55:06.914817 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1590/3048] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:06 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:06.943774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-349da426-cbb8-450c-b4c6-5edab1809345 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:06.944799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-349da426-cbb8-450c-b4c6-5edab1809345 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:06.962595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-349da426-cbb8-450c-b4c6-5edab1809345 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:06.968425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-349da426-cbb8-450c-b4c6-5edab1809345 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:06.969345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-349da426-cbb8-450c-b4c6-5edab1809345 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:06.970761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-349da426-cbb8-450c-b4c6-5edab1809345 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:07.016440 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-349da426-cbb8-450c-b4c6-5edab1809345 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.077602 Nov 27 20:55:07.017095 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1591/3049] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:06 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:55:07.026518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:07.027280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:07.038206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:07.041417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:07.041857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:07.046138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:07.047136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:07.050561 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-897e1a19-091c-4590-8755-6805a02893a5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.320363 Nov 27 20:55:07.055403 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1459/3050] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:06 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:07.061901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b4acfa03-09ca-457d-85b9-c4991b543216 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94baaf0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:07.120401 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b4acfa03-09ca-457d-85b9-c4991b543216 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.063665 Nov 27 20:55:07.121665 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1460/3051] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:07 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:07.211517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:07.219498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92bb0791-60c6-42b5-978a-5d77b5566d9e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.201232 Nov 27 20:55:07.228945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1592/3052] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:07 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:07.926199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-955aeb73-28e6-4cfe-b307-078f1d2f93cf tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:07.927202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-955aeb73-28e6-4cfe-b307-078f1d2f93cf tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:07.934583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955aeb73-28e6-4cfe-b307-078f1d2f93cf tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:07.934992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955aeb73-28e6-4cfe-b307-078f1d2f93cf tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:07.935830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955aeb73-28e6-4cfe-b307-078f1d2f93cf tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:07.936279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955aeb73-28e6-4cfe-b307-078f1d2f93cf tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:07.988181 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-955aeb73-28e6-4cfe-b307-078f1d2f93cf tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.064083 Nov 27 20:55:07.988675 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1461/3053] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:07 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:08.028738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5bdd8b2e-daeb-4586-81eb-15365e44418b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:08.030366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5bdd8b2e-daeb-4586-81eb-15365e44418b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:08.039207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdd8b2e-daeb-4586-81eb-15365e44418b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:08.039911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdd8b2e-daeb-4586-81eb-15365e44418b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:08.041340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdd8b2e-daeb-4586-81eb-15365e44418b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:08.042398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdd8b2e-daeb-4586-81eb-15365e44418b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:08.071185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:08.072190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:08.083485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:08.084889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:08.085933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:08.086991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:08.094967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5bdd8b2e-daeb-4586-81eb-15365e44418b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.069089 Nov 27 20:55:08.094967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1593/3054] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:08 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:55:08.135766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72e768fb-1c5c-4b41-8504-de49a7618e5c tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94f9d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:08.218392 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72e768fb-1c5c-4b41-8504-de49a7618e5c tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.087178 Nov 27 20:55:08.225135 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1594/3055] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:08 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:08.237503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:08.238525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:08.252260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:08.254508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:08.256554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:08.257705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:08.274546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:08.284466 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe12730c-3b1a-4099-ad3a-62a4a6d94e9f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.217993 Nov 27 20:55:08.285679 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1462/3056] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:08 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:08.576693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:08.585465 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15d9e68c-9f22-450e-91ec-fca84d693a97 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1318 microversion: 2.1 time: 0.352475 Nov 27 20:55:08.586406 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1595/3057] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:08 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:08.795475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a27a3e1d-fb8b-4bcb-ad24-1468c7b2a71f req-db255dac-541b-4c4b-9b46-626df0f611d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8911dc7c-bdfd-4fcb-a7a9-65e9c946c806", "name": "network-vif-plugged", "status": "completed", "tag": "a2426259-c237-480c-afc3-6c9804dc6ce1"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:08.797132 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:08.797132 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:08.805133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a27a3e1d-fb8b-4bcb-ad24-1468c7b2a71f req-db255dac-541b-4c4b-9b46-626df0f611d7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:08.805894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a27a3e1d-fb8b-4bcb-ad24-1468c7b2a71f req-db255dac-541b-4c4b-9b46-626df0f611d7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:08.819203 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a27a3e1d-fb8b-4bcb-ad24-1468c7b2a71f req-db255dac-541b-4c4b-9b46-626df0f611d7 service nova] Creating event network-vif-plugged:a2426259-c237-480c-afc3-6c9804dc6ce1 for instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 on nch1-master-1 Nov 27 20:55:08.826493 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a27a3e1d-fb8b-4bcb-ad24-1468c7b2a71f req-db255dac-541b-4c4b-9b46-626df0f611d7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Nov 27 20:55:08.827761 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1463/3058] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:09.009662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f86e712-b55e-4616-8ce0-9f1be3d2c10a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:09.012402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f86e712-b55e-4616-8ce0-9f1be3d2c10a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:09.020916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f86e712-b55e-4616-8ce0-9f1be3d2c10a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.022561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f86e712-b55e-4616-8ce0-9f1be3d2c10a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.023372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f86e712-b55e-4616-8ce0-9f1be3d2c10a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.024085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f86e712-b55e-4616-8ce0-9f1be3d2c10a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.074554 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f86e712-b55e-4616-8ce0-9f1be3d2c10a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.078032 Nov 27 20:55:09.075686 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1596/3059] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:08 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:09.106782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0823cf6-5d16-4cbd-9082-d7432d856e56 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:09.108750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0823cf6-5d16-4cbd-9082-d7432d856e56 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:09.116958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0823cf6-5d16-4cbd-9082-d7432d856e56 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.117618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0823cf6-5d16-4cbd-9082-d7432d856e56 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.118644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0823cf6-5d16-4cbd-9082-d7432d856e56 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.119312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0823cf6-5d16-4cbd-9082-d7432d856e56 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.171888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a660b413-9b24-459e-9681-3dd6fb8c1c7a tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15d945d700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:09.229279 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a660b413-9b24-459e-9681-3dd6fb8c1c7a tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c" status: 200 len: 637 microversion: 2.1 time: 0.062845 Nov 27 20:55:09.244189 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1597/3060] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:09 2021] GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c => generated 637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:09.249843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c26d8b5-0aeb-4309-90c9-a01c39c71bd1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d945daf0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:09.285892 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0823cf6-5d16-4cbd-9082-d7432d856e56 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.183490 Nov 27 20:55:09.289759 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1464/3061] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:09 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:09.298500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3bfe4bb5-d909-48b5-aa6e-5ddd3c239809 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update_all', calling method: .version_select at 0x7f15d94baaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:09.316646 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c26d8b5-0aeb-4309-90c9-a01c39c71bd1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.068549 Nov 27 20:55:09.319591 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1598/3062] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:09 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:09.333906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:09.335295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:09.348611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.349058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.350142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.350814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.390521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-3bfe4bb5-d909-48b5-aa6e-5ddd3c239809 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:09.421274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-3bfe4bb5-d909-48b5-aa6e-5ddd3c239809 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:09.599307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:09.609559 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6fb5f7e-ab97-42ef-8430-ac512ee3c27d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1307 microversion: 2.1 time: 0.288213 Nov 27 20:55:09.610145 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1599/3063] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:09 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:09.623938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:09.624813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:09.638317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.639936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.640777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.641228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.876420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:09.887516 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c39cdcdd-3a7e-4451-9a72-d2a8951d8253 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1507 microversion: 2.1 time: 0.271174 Nov 27 20:55:09.899744 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1600/3064] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:09 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:09.912436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:09.913043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:09.925816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.926780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.927989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:09.928654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:09.943807 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3bfe4bb5-d909-48b5-aa6e-5ddd3c239809 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.652356 Nov 27 20:55:09.945442 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1465/3065] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:55:09 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 61 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:09.955584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40a5cccd-ac59-4bb5-ab6c-7d9f888c48f6 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15d93965e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:10.160526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:10.172334 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a7e6028-aa2e-4f08-8ab2-dd3eaa88d57c tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1507 microversion: 2.1 time: 0.266315 Nov 27 20:55:10.173963 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1601/3066] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:09 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:10.191639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d817827-8077-4dbd-b3b2-85a73b17e693 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:10.193018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d817827-8077-4dbd-b3b2-85a73b17e693 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:10.206165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d817827-8077-4dbd-b3b2-85a73b17e693 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.207234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d817827-8077-4dbd-b3b2-85a73b17e693 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.209769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d817827-8077-4dbd-b3b2-85a73b17e693 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.210553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d817827-8077-4dbd-b3b2-85a73b17e693 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.284492 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d817827-8077-4dbd-b3b2-85a73b17e693 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.099098 Nov 27 20:55:10.288235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1602/3067] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:10 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:10.294895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-096a3df6-ec6e-4aa0-9bf9-b0b78c36e619 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:10.303572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-096a3df6-ec6e-4aa0-9bf9-b0b78c36e619 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:10.321925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096a3df6-ec6e-4aa0-9bf9-b0b78c36e619 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.322408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096a3df6-ec6e-4aa0-9bf9-b0b78c36e619 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.326815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096a3df6-ec6e-4aa0-9bf9-b0b78c36e619 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.328287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096a3df6-ec6e-4aa0-9bf9-b0b78c36e619 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.481607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40a5cccd-ac59-4bb5-ab6c-7d9f888c48f6 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "DELETE /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.530961 Nov 27 20:55:10.482353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1466/3068] 10.222.0.21 () {58 vars in 1295 bytes} [Sat Nov 27 20:55:09 2021] DELETE /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata/os_version => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:55:10.488284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b856088-5fb3-48d9-8e7e-4fc0d4079ff6 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:10.489327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b856088-5fb3-48d9-8e7e-4fc0d4079ff6 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:10.505834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b856088-5fb3-48d9-8e7e-4fc0d4079ff6 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.506297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b856088-5fb3-48d9-8e7e-4fc0d4079ff6 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.508468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b856088-5fb3-48d9-8e7e-4fc0d4079ff6 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.508908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b856088-5fb3-48d9-8e7e-4fc0d4079ff6 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.536993 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-096a3df6-ec6e-4aa0-9bf9-b0b78c36e619 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "PUT /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1079 microversion: 2.1 time: 0.249848 Nov 27 20:55:10.538230 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1603/3069] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 20:55:10 2021] PUT /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1079 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:10.545975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2e717804-e473-4ade-a278-f3942359af4f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d945d550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:10.568805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b856088-5fb3-48d9-8e7e-4fc0d4079ff6 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.085128 Nov 27 20:55:10.576142 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1467/3070] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:10 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:10.589236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a11f98e1-9c96-4b65-81be-02d5bb023723 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15c7c9dee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:10.629379 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2e717804-e473-4ade-a278-f3942359af4f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.089883 Nov 27 20:55:10.635405 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1604/3071] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:10 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:10.651553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:10.653127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:10.665430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.670194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.671600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.672230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.692194 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a11f98e1-9c96-4b65-81be-02d5bb023723 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.114573 Nov 27 20:55:10.693049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1468/3072] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:55:10 2021] GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 37 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:10.699166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:10.702544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:10.713585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.714059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.715391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:10.715906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:10.945388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:10.956837 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5daa30d-9319-47ad-aac5-6064935c30eb tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1505 microversion: 2.1 time: 0.320321 Nov 27 20:55:10.958022 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1605/3073] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:10 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:10.962939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0f3ff978-ffbb-4035-8b6c-449ea15b07cb tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update_all', calling method: .version_select at 0x7f15d94ce8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:11.064281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0f3ff978-ffbb-4035-8b6c-449ea15b07cb tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:11.078249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0f3ff978-ffbb-4035-8b6c-449ea15b07cb tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:11.517804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:11.530347 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-100c7c64-140a-46c9-a99f-3794a479feb0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1486 microversion: 2.1 time: 0.836096 Nov 27 20:55:11.544446 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1469/3074] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:10 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1486 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:11.554021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-aa3057ca-6d4b-496f-b5ed-677be99b7727 req-28dceefe-c494-4e86-87f0-dbc0a6c1319f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931317b4-226f-4f75-8a5e-f93c7ce5c3ad", "name": "network-vif-unplugged", "status": "completed", "tag": "2dfaad6b-b499-4a67-ad7b-ec4eea1d3813"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:11.556854 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:11.556854 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:11.570835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa3057ca-6d4b-496f-b5ed-677be99b7727 req-28dceefe-c494-4e86-87f0-dbc0a6c1319f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.571512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa3057ca-6d4b-496f-b5ed-677be99b7727 req-28dceefe-c494-4e86-87f0-dbc0a6c1319f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.587552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-aa3057ca-6d4b-496f-b5ed-677be99b7727 req-28dceefe-c494-4e86-87f0-dbc0a6c1319f service nova] Creating event network-vif-unplugged:2dfaad6b-b499-4a67-ad7b-ec4eea1d3813 for instance 931317b4-226f-4f75-8a5e-f93c7ce5c3ad on nch2-master-1 Nov 27 20:55:11.593728 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-aa3057ca-6d4b-496f-b5ed-677be99b7727 req-28dceefe-c494-4e86-87f0-dbc0a6c1319f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047732 Nov 27 20:55:11.595045 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1470/3075] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:11.601238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:11.601931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:11.608473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.608967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.609918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.610359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.665096 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0f3ff978-ffbb-4035-8b6c-449ea15b07cb tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.705297 Nov 27 20:55:11.665692 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1606/3076] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:55:10 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 61 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:11.671325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20414450-8b49-41c5-966b-6e6a656d2ceb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:11.672491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20414450-8b49-41c5-966b-6e6a656d2ceb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:11.690615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20414450-8b49-41c5-966b-6e6a656d2ceb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.694124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20414450-8b49-41c5-966b-6e6a656d2ceb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.696485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20414450-8b49-41c5-966b-6e6a656d2ceb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.697124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20414450-8b49-41c5-966b-6e6a656d2ceb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.802346 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20414450-8b49-41c5-966b-6e6a656d2ceb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.131418 Nov 27 20:55:11.807892 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1607/3077] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:11 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:11.819942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:11.825298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:11.826269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:11.828158 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-afad8603-6c7f-48d6-a5d9-61cbb8b89eac tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1505 microversion: 2.1 time: 0.231581 Nov 27 20:55:11.838768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.839709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.839903 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1471/3078] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:11 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:11.841767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.842489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.845331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1bc6b603-2f8c-4a8e-b472-7fcddc01c592 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:11.846293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1bc6b603-2f8c-4a8e-b472-7fcddc01c592 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:11.852360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bc6b603-2f8c-4a8e-b472-7fcddc01c592 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.852811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bc6b603-2f8c-4a8e-b472-7fcddc01c592 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.853600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bc6b603-2f8c-4a8e-b472-7fcddc01c592 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:11.854121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bc6b603-2f8c-4a8e-b472-7fcddc01c592 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:11.878837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lazy-loading 'flavor' on Instance uuid 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:55:11.919872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1bc6b603-2f8c-4a8e-b472-7fcddc01c592 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.078296 Nov 27 20:55:11.921045 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1472/3079] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:11 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:11.927335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29a5ccb1-4066-4268-9e6c-32c68f4aaf41 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93af430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:12.029928 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29a5ccb1-4066-4268-9e6c-32c68f4aaf41 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.102807 Nov 27 20:55:12.040848 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1473/3080] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:11 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:12.051301 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e1cc41d7-2810-443e-b195-9c845a586a73 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806/action" status: 202 len: 0 microversion: 2.1 time: 0.238078 Nov 27 20:55:12.052401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d92064f4-5ed2-4a34-81c9-e108823ad6c2 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15d93afdc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:12.052790 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1608/3081] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:11 2021] POST /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:55:12.093490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a3d6fa1f-2a6e-4e74-b0b4-e08f9fcaa745 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:12.098469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a3d6fa1f-2a6e-4e74-b0b4-e08f9fcaa745 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:12.122475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d6fa1f-2a6e-4e74-b0b4-e08f9fcaa745 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.125484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d6fa1f-2a6e-4e74-b0b4-e08f9fcaa745 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.126198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d6fa1f-2a6e-4e74-b0b4-e08f9fcaa745 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.127413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3d6fa1f-2a6e-4e74-b0b4-e08f9fcaa745 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.139354 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d92064f4-5ed2-4a34-81c9-e108823ad6c2 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.096897 Nov 27 20:55:12.140061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1474/3082] 10.222.0.21 () {58 vars in 1289 bytes} [Sat Nov 27 20:55:12 2021] GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata/os_distro => generated 33 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:12.147131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:12.148973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:12.157555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.158478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.159889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.162055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.257222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a3d6fa1f-2a6e-4e74-b0b4-e08f9fcaa745 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "PUT /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1081 microversion: 2.1 time: 0.190502 Nov 27 20:55:12.263091 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1609/3083] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 20:55:12 2021] PUT /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1081 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:12.275400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43bfba94-78a1-4bd4-b572-974d069cc07c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update_all', calling method: .version_select at 0x7f15d93f95e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:12.362299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-43bfba94-78a1-4bd4-b572-974d069cc07c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:12.376346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-43bfba94-78a1-4bd4-b572-974d069cc07c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:12.383490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:12.392895 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-654f972c-2799-43de-856d-8f953221749e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1494 microversion: 2.1 time: 0.251169 Nov 27 20:55:12.393593 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1475/3084] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:12 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1494 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:12.398030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:12.398655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:12.416572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.430091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.430985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.431472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.817234 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43bfba94-78a1-4bd4-b572-974d069cc07c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.552424 Nov 27 20:55:12.817787 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1610/3085] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:55:12 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 61 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:12.823011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-750098f5-4b3e-45b2-b14e-f2c0975e0d96 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:12.824161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-750098f5-4b3e-45b2-b14e-f2c0975e0d96 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:12.837624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:12.843954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750098f5-4b3e-45b2-b14e-f2c0975e0d96 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.844415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750098f5-4b3e-45b2-b14e-f2c0975e0d96 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.845217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750098f5-4b3e-45b2-b14e-f2c0975e0d96 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.845644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-750098f5-4b3e-45b2-b14e-f2c0975e0d96 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.851937 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2e38262-5411-4f4a-b9e4-667b0e088e5d tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1507 microversion: 2.1 time: 0.456141 Nov 27 20:55:12.852886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1476/3086] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:12 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1507 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:12.858136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e447f71-4e9d-4cd8-b027-23dfecb64a8f tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15d93c4f70>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:12.924591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e447f71-4e9d-4cd8-b027-23dfecb64a8f tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.070001 Nov 27 20:55:12.926116 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1477/3087] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:55:12 2021] GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:12.937975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:12.939143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:12.946999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-750098f5-4b3e-45b2-b14e-f2c0975e0d96 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.127664 Nov 27 20:55:12.952944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1611/3088] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:12 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:12.954797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.955534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.956617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.957299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.963482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e76dde1f-732c-4b78-8124-b4e624609b20 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:12.964971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e76dde1f-732c-4b78-8124-b4e624609b20 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:12.984190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e76dde1f-732c-4b78-8124-b4e624609b20 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.984657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e76dde1f-732c-4b78-8124-b4e624609b20 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:12.988186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e76dde1f-732c-4b78-8124-b4e624609b20 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:12.991029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e76dde1f-732c-4b78-8124-b4e624609b20 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:13.095139 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e76dde1f-732c-4b78-8124-b4e624609b20 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.140651 Nov 27 20:55:13.096075 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1612/3089] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:12 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:13.138464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de721732-4e95-4574-88d6-c06d5ab3ce4b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update_all', calling method: .version_select at 0x7f15d94150d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:13.226062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:13.240766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34ccdd80-0d84-4842-8976-0b745a37cfb6 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1507 microversion: 2.1 time: 0.312625 Nov 27 20:55:13.244609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-de721732-4e95-4574-88d6-c06d5ab3ce4b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:13.250597 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1478/3090] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:12 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:13.257471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-de721732-4e95-4574-88d6-c06d5ab3ce4b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:13.261042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d67250a-86d4-46ee-b7d2-73bfc75ab724 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93ea3a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:13.348929 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d67250a-86d4-46ee-b7d2-73bfc75ab724 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.097009 Nov 27 20:55:13.349501 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1479/3091] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:13 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:13.355155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:13.356236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:13.362562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:13.363016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:13.365040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:13.365484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:13.410024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:13.643063 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7cf2ea62-6c17-4f79-9974-dcf82687083a tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 204 len: 0 microversion: 2.1 time: 0.292296 Nov 27 20:55:13.643816 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1480/3092] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:13 2021] DELETE /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:13.661194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:13.662511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:13.679943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:13.682253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:13.684611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:13.685383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:13.899915 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de721732-4e95-4574-88d6-c06d5ab3ce4b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.788932 Nov 27 20:55:13.901687 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1613/3093] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:55:13 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 61 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:13.906906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:13.908210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:13.915396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:13.921260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:13.922195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:13.922721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:14.006104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:14.008603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:14.024568 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8117291e-d900-4e79-8af3-5d15a3089330 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 200 len: 1477 microversion: 2.1 time: 0.379358 Nov 27 20:55:14.026723 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1481/3094] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:13 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:14.036048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-442e2a63-5b23-4c76-a86f-2c7827110ca7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update_all', calling method: .version_select at 0x7f15d93c4b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:14.114950 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.compute.api [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Instance is already in deleting state, ignoring this request Nov 27 20:55:14.119001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99696e89-b774-4200-a0a0-9e5d418ca703 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 204 len: 0 microversion: 2.1 time: 0.215677 Nov 27 20:55:14.119916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1614/3095] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:13 2021] DELETE /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:14.130061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f7108943-7fe0-4a93-876c-1ec1fd83f51b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:14.134441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7108943-7fe0-4a93-876c-1ec1fd83f51b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:14.145891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7108943-7fe0-4a93-876c-1ec1fd83f51b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:14.149509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7108943-7fe0-4a93-876c-1ec1fd83f51b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:14.152205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7108943-7fe0-4a93-876c-1ec1fd83f51b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:14.152904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7108943-7fe0-4a93-876c-1ec1fd83f51b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:14.191899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-442e2a63-5b23-4c76-a86f-2c7827110ca7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:14.236289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-442e2a63-5b23-4c76-a86f-2c7827110ca7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:14.285820 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f7108943-7fe0-4a93-876c-1ec1fd83f51b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.164522 Nov 27 20:55:14.287854 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1615/3096] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:14 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:14.300873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-acfbb1eb-364f-4cbf-ae8a-244e52945707 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1547120679"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:14.302015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-acfbb1eb-364f-4cbf-ae8a-244e52945707 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:14.331040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acfbb1eb-364f-4cbf-ae8a-244e52945707 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:14.340773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acfbb1eb-364f-4cbf-ae8a-244e52945707 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:14.341542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acfbb1eb-364f-4cbf-ae8a-244e52945707 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:14.342014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acfbb1eb-364f-4cbf-ae8a-244e52945707 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:15.151893 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-442e2a63-5b23-4c76-a86f-2c7827110ca7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 64 microversion: 2.1 time: 1.121259 Nov 27 20:55:15.153456 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1482/3097] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:55:14 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 64 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:15.159908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45d6f68f-aa00-4c58-906b-3a9f271d14c0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:15.162984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45d6f68f-aa00-4c58-906b-3a9f271d14c0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:15.178095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d6f68f-aa00-4c58-906b-3a9f271d14c0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:15.178568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d6f68f-aa00-4c58-906b-3a9f271d14c0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:15.179791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d6f68f-aa00-4c58-906b-3a9f271d14c0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:15.180475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45d6f68f-aa00-4c58-906b-3a9f271d14c0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:15.228192 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-acfbb1eb-364f-4cbf-ae8a-244e52945707 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806/action" status: 202 len: 0 microversion: 2.1 time: 0.929268 Nov 27 20:55:15.232257 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1616/3098] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:14 2021] POST /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806/action => generated 0 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:55:15.247008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:15.252010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:15.279352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:15.279816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:15.287465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:15.287846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:15.314663 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45d6f68f-aa00-4c58-906b-3a9f271d14c0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.159497 Nov 27 20:55:15.322521 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1483/3099] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:15 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:15.353125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5cf1c860-9aa4-4367-8146-573d5f7735dd tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93961f0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:15.487074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5cf1c860-9aa4-4367-8146-573d5f7735dd tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.166196 Nov 27 20:55:15.491341 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1484/3100] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:15 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:15.522838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2b6db2a0-fe7d-4c06-94eb-777d30b0d98a req-bb600584-89de-4509-8a55-af425db7d5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322cb011-f54a-4dd9-92b9-6c9478c4333c", "name": "network-vif-plugged", "status": "completed", "tag": "f582af39-1252-42ce-a0f7-29c2ea84cba2"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:15.533089 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:15.533089 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:15.568916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2b6db2a0-fe7d-4c06-94eb-777d30b0d98a req-bb600584-89de-4509-8a55-af425db7d5d5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:15.572396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2b6db2a0-fe7d-4c06-94eb-777d30b0d98a req-bb600584-89de-4509-8a55-af425db7d5d5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:15.627884 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2b6db2a0-fe7d-4c06-94eb-777d30b0d98a req-bb600584-89de-4509-8a55-af425db7d5d5 service nova] Creating event network-vif-plugged:f582af39-1252-42ce-a0f7-29c2ea84cba2 for instance 322cb011-f54a-4dd9-92b9-6c9478c4333c on nch1-master-1 Nov 27 20:55:15.640898 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2b6db2a0-fe7d-4c06-94eb-777d30b0d98a req-bb600584-89de-4509-8a55-af425db7d5d5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145407 Nov 27 20:55:15.642334 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1485/3101] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:15.655486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee74337e-0138-4087-9052-4cd7a8b56b72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'create', calling method: .version_select at 0x7f15d944a310>, body: {"keypair": {"name": "tempest-keypair-39484124"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:15.691771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ee74337e-0138-4087-9052-4cd7a8b56b72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Getting quotas for project 76f19e09c6b04ac1a559d52d9cad1c77. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:15.704043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ee74337e-0138-4087-9052-4cd7a8b56b72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Getting quotas for user 05f09b6a534240fc82a45ce979040e3e and project 76f19e09c6b04ac1a559d52d9cad1c77. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:15.789701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:15.804441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89a95b0d-f57a-4405-b107-2aeb22301aee tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1513 microversion: 2.1 time: 0.570125 Nov 27 20:55:15.810755 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1617/3102] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:15 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1513 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:15.829229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-074b0b7f-297b-4cb2-a4a1-2f5cb6faca80 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15d944fd30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:15.914633 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-074b0b7f-297b-4cb2-a4a1-2f5cb6faca80 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.102060 Nov 27 20:55:15.915218 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1618/3103] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:55:15 2021] GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 64 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:15.927374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-afc76585-309e-4bff-9ca2-8247c77e0619 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94b1a60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:16.038704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-afc76585-309e-4bff-9ca2-8247c77e0619 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 200 len: 1438 microversion: 2.1 time: 0.122326 Nov 27 20:55:16.039447 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1619/3104] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:15 2021] GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:16.063849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9f8badf-1b9c-4cdb-a67f-d744a4166238 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:16.064952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9f8badf-1b9c-4cdb-a67f-d744a4166238 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:16.099798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9f8badf-1b9c-4cdb-a67f-d744a4166238 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:16.101178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9f8badf-1b9c-4cdb-a67f-d744a4166238 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:16.105124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9f8badf-1b9c-4cdb-a67f-d744a4166238 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:16.106199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9f8badf-1b9c-4cdb-a67f-d744a4166238 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:16.224896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9f8badf-1b9c-4cdb-a67f-d744a4166238 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.180416 Nov 27 20:55:16.229968 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1620/3105] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:16 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:16.267874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e11998cb-d9c3-4b30-86d9-214a6fe0cd5c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update_all', calling method: .version_select at 0x7f15d94b1dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:16.354510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e11998cb-d9c3-4b30-86d9-214a6fe0cd5c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:16.372258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e11998cb-d9c3-4b30-86d9-214a6fe0cd5c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:16.620016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ee74337e-0138-4087-9052-4cd7a8b56b72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Getting quotas for project 76f19e09c6b04ac1a559d52d9cad1c77. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:16.642484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ee74337e-0138-4087-9052-4cd7a8b56b72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Getting quotas for user 05f09b6a534240fc82a45ce979040e3e and project 76f19e09c6b04ac1a559d52d9cad1c77. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:16.689185 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee74337e-0138-4087-9052-4cd7a8b56b72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.42 time: 1.043525 Nov 27 20:55:16.689807 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1486/3106] 10.222.0.21 () {62 vars in 1198 bytes} [Sat Nov 27 20:55:15 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1046 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:55:16.705956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-03a2c943-ea59-411c-baa6-3499d4791296 req-6a3dabbc-41cf-4ed8-845f-5b37398b3505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8762dee5-37b1-4d12-8e0d-4190e353bd9e", "name": "network-vif-deleted", "tag": "1d0f60a0-826b-4e4d-8af8-93d9fec8ab00"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:16.707990 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:16.707990 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:16.717393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-03a2c943-ea59-411c-baa6-3499d4791296 req-6a3dabbc-41cf-4ed8-845f-5b37398b3505 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:16.718144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-03a2c943-ea59-411c-baa6-3499d4791296 req-6a3dabbc-41cf-4ed8-845f-5b37398b3505 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:16.736169 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-03a2c943-ea59-411c-baa6-3499d4791296 req-6a3dabbc-41cf-4ed8-845f-5b37398b3505 service nova] Creating event network-vif-deleted:1d0f60a0-826b-4e4d-8af8-93d9fec8ab00 for instance 8762dee5-37b1-4d12-8e0d-4190e353bd9e on nch1-master-1 Nov 27 20:55:16.748575 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-03a2c943-ea59-411c-baa6-3499d4791296 req-6a3dabbc-41cf-4ed8-845f-5b37398b3505 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046414 Nov 27 20:55:16.749190 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1487/3107] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:16.770984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4722ca3c-340b-4b7c-9d20-2f6928953707 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:16.774894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4722ca3c-340b-4b7c-9d20-2f6928953707 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:16.795320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4722ca3c-340b-4b7c-9d20-2f6928953707 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:16.812105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4722ca3c-340b-4b7c-9d20-2f6928953707 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:16.819118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4722ca3c-340b-4b7c-9d20-2f6928953707 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:16.821014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4722ca3c-340b-4b7c-9d20-2f6928953707 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:16.901370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e11998cb-d9c3-4b30-86d9-214a6fe0cd5c tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.669152 Nov 27 20:55:16.902774 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1621/3108] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:55:16 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 61 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:16.908347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10a410e7-b4db-4d01-a093-b0c845728f01 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94b1670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:16.913074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4722ca3c-340b-4b7c-9d20-2f6928953707 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.162300 Nov 27 20:55:16.917151 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1488/3109] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:16 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:16.922594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:16.923817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:16.955471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:16.957430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:16.959850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:16.960383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:17.004336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10a410e7-b4db-4d01-a093-b0c845728f01 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.100429 Nov 27 20:55:17.004915 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1622/3110] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:16 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:17.009570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0fae798-2e98-4847-8391-b1eec3baa04b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update', calling method: .version_select at 0x7f15d9415dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:17.078542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:17.079979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:17.080737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lazy-loading 'fault' on Instance uuid 8762dee5-37b1-4d12-8e0d-4190e353bd9e {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:55:17.104809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d0fae798-2e98-4847-8391-b1eec3baa04b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:17.119144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d0fae798-2e98-4847-8391-b1eec3baa04b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:17.161403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745d99de8bd24185aacbbcf7b2c404c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a5eb3bc93349828958b7879707829a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:17.176909 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78ac57a8-9ac5-4e6a-888d-1b26db70d5f2 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 200 len: 1308 microversion: 2.1 time: 0.261559 Nov 27 20:55:17.182426 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1489/3111] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:16 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:17.204878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21082acb-e4f2-4ff7-b3f4-4df969258360 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d944aa60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:17.335525 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21082acb-e4f2-4ff7-b3f4-4df969258360 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 200 len: 1438 microversion: 2.1 time: 0.141940 Nov 27 20:55:17.336119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1490/3112] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:17 2021] GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:17.343233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e7d4abf-4179-4b3f-ac1b-e566f22fa700 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:17.354059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e7d4abf-4179-4b3f-ac1b-e566f22fa700 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:17.381866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e7d4abf-4179-4b3f-ac1b-e566f22fa700 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:17.382376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e7d4abf-4179-4b3f-ac1b-e566f22fa700 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:17.383628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e7d4abf-4179-4b3f-ac1b-e566f22fa700 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:17.384352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e7d4abf-4179-4b3f-ac1b-e566f22fa700 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:17.490867 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e7d4abf-4179-4b3f-ac1b-e566f22fa700 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.153490 Nov 27 20:55:17.499627 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1491/3113] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:17 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:17.910130 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0fae798-2e98-4847-8391-b1eec3baa04b tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.903958 Nov 27 20:55:17.911373 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1623/3114] 10.222.0.21 () {60 vars in 1312 bytes} [Sat Nov 27 20:55:17 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata/os_version => generated 31 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:17.922132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-945c37da-eddb-4318-9f79-7bb5a4cc0aec tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15d933ddc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:17.925907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ad6de0b5-0fec-46a0-9178-bd8cc9d03a74 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:17.927687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ad6de0b5-0fec-46a0-9178-bd8cc9d03a74 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:17.940644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad6de0b5-0fec-46a0-9178-bd8cc9d03a74 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:17.947634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad6de0b5-0fec-46a0-9178-bd8cc9d03a74 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:17.949825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad6de0b5-0fec-46a0-9178-bd8cc9d03a74 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:17.950298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad6de0b5-0fec-46a0-9178-bd8cc9d03a74 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:18.059303 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-945c37da-eddb-4318-9f79-7bb5a4cc0aec tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.141713 Nov 27 20:55:18.059947 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1492/3115] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:55:17 2021] GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 58 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:18.065274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5937afba-4314-4626-b2fb-f7a153dd18b3 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d937e820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:18.091596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ad6de0b5-0fec-46a0-9178-bd8cc9d03a74 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.169563 Nov 27 20:55:18.096378 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1624/3116] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:17 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:18.104440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86b02711-5cbc-4811-8b50-6dea7d150ce7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'update_all', calling method: .version_select at 0x7f15d945dc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:18.388053 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5937afba-4314-4626-b2fb-f7a153dd18b3 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1452 microversion: 2.1 time: 0.325981 Nov 27 20:55:18.388644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1493/3117] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:18 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1452 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:18.410341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:18.417169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 8762dee5-37b1-4d12-8e0d-4190e353bd9e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:18.438494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:18.439648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:18.442891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:18.443635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:18.452298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-86b02711-5cbc-4811-8b50-6dea7d150ce7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:18.465381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-86b02711-5cbc-4811-8b50-6dea7d150ce7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:18.478991 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] HTTP exception thrown: Instance 8762dee5-37b1-4d12-8e0d-4190e353bd9e could not be found. Nov 27 20:55:18.485233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Returning 404 to user: Instance 8762dee5-37b1-4d12-8e0d-4190e353bd9e could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:18.486759 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aba81735-b51b-4130-bc38-4f2a4f98b883 tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e" status: 404 len: 111 microversion: 2.1 time: 0.090352 Nov 27 20:55:18.487584 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1494/3118] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:18 2021] GET /compute/v2.1/servers/8762dee5-37b1-4d12-8e0d-4190e353bd9e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:18.495238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3306982e-a372-4eeb-a47a-810496ff8fff tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d933dd30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:28.271827 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3306982e-a372-4eeb-a47a-810496ff8fff tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 200 len: 1438 microversion: 2.1 time: 9.782940 Nov 27 20:55:28.273544 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1495/3119] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:18 2021] GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 1438 bytes in 9785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:28.278630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:28.279121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:28.285468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.286456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.287661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.288272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.302267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] HTTP exception thrown: Instance a542bf73-64b0-4fac-9738-f06b723b6d21 could not be found. Nov 27 20:55:28.302847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Returning 404 to user: Instance a542bf73-64b0-4fac-9738-f06b723b6d21 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:28.303911 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38a9a403-ee7f-4845-8745-ee8a12c3358e tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 404 len: 111 microversion: 2.1 time: 0.029240 Nov 27 20:55:28.304462 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1496/3120] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:28 2021] DELETE /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:28.311593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9805b35-c0c2-4f07-a220-d5fec1166925 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:28.312853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9805b35-c0c2-4f07-a220-d5fec1166925 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:28.326677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9805b35-c0c2-4f07-a220-d5fec1166925 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.327342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9805b35-c0c2-4f07-a220-d5fec1166925 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.328214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9805b35-c0c2-4f07-a220-d5fec1166925 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.328773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9805b35-c0c2-4f07-a220-d5fec1166925 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.391430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9805b35-c0c2-4f07-a220-d5fec1166925 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.085714 Nov 27 20:55:28.392591 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1497/3121] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:28 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:28.398513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4379d8bf-5d98-4ab4-99a2-684b7764121f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:28.399714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4379d8bf-5d98-4ab4-99a2-684b7764121f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:28.407620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4379d8bf-5d98-4ab4-99a2-684b7764121f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.408464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4379d8bf-5d98-4ab4-99a2-684b7764121f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.409514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4379d8bf-5d98-4ab4-99a2-684b7764121f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.410214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4379d8bf-5d98-4ab4-99a2-684b7764121f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.458839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4379d8bf-5d98-4ab4-99a2-684b7764121f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.064623 Nov 27 20:55:28.460100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1498/3122] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:28 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:28.466463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-367959719", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "69bbc6e1-7ac2-4c39-8b81-cbf37c04434d"}, {"port": "7892b730-0a95-4587-9c92-b7522e255107", "tag": "port-1"}, {"port": "2141f889-e6e6-4c2b-ba22-12f0441b2f07", "tag": "port-2"}, {"uuid": "c8bb9313-f783-49f5-91b8-12c308f05da8", "tag": "net-1"}, {"uuid": "c8bb9313-f783-49f5-91b8-12c308f05da8"}, {"uuid": "b81d828c-3c59-4f0f-a608-265030413533", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b81d828c-3c59-4f0f-a608-265030413533", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "021a76d9-22a2-4682-b594-1eb66d6d2882", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7b8f6b91-0f5d-43af-b670-f5ec500355d4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9acdff48-832d-43c1-a2c9-2c6d43a6f9da", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--544438983"}], "key_name": "tempest-keypair-39484124", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:28.628816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] validate_networks() for [('69bbc6e1-7ac2-4c39-8b81-cbf37c04434d', None, None, None, None, None), (None, None, '7892b730-0a95-4587-9c92-b7522e255107', None, None, None), (None, None, '2141f889-e6e6-4c2b-ba22-12f0441b2f07', None, None, None), ('c8bb9313-f783-49f5-91b8-12c308f05da8', None, None, None, None, None), ('c8bb9313-f783-49f5-91b8-12c308f05da8', None, None, None, None, None), ('b81d828c-3c59-4f0f-a608-265030413533', '10.2.2.100', None, None, None, None), ('b81d828c-3c59-4f0f-a608-265030413533', '10.2.2.200', None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:55:28.799919 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86b02711-5cbc-4811-8b50-6dea7d150ce7 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 61 microversion: 2.1 time: 10.701449 Nov 27 20:55:28.805654 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1625/3123] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 20:55:18 2021] PUT /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 61 bytes in 10709 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:28.812264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a8dafab-117b-42ad-9cee-5bbd04e3b584 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93d7040>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:28.895615 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a8dafab-117b-42ad-9cee-5bbd04e3b584 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1461 microversion: 2.1 time: 0.088585 Nov 27 20:55:28.896186 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1626/3124] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:28 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:28.904944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e9a070ff-8e2a-4256-ac1e-688b97ffec38 req-90539c99-8d53-434e-89f5-d9b3e52d04a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8911dc7c-bdfd-4fcb-a7a9-65e9c946c806", "name": "network-vif-plugged", "status": "completed", "tag": "a2426259-c237-480c-afc3-6c9804dc6ce1"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:28.906883 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:28.906883 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:28.915552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e9a070ff-8e2a-4256-ac1e-688b97ffec38 req-90539c99-8d53-434e-89f5-d9b3e52d04a2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.916218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e9a070ff-8e2a-4256-ac1e-688b97ffec38 req-90539c99-8d53-434e-89f5-d9b3e52d04a2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.929745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e9a070ff-8e2a-4256-ac1e-688b97ffec38 req-90539c99-8d53-434e-89f5-d9b3e52d04a2 service nova] Creating event network-vif-plugged:a2426259-c237-480c-afc3-6c9804dc6ce1 for instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 on nch1-master-1 Nov 27 20:55:28.936369 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e9a070ff-8e2a-4256-ac1e-688b97ffec38 req-90539c99-8d53-434e-89f5-d9b3e52d04a2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036035 Nov 27 20:55:28.937324 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1627/3125] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:28.943708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:28.944400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: a542bf73-64b0-4fac-9738-f06b723b6d21] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:28.954312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.957780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.957780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:28.964035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:28.989737 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] HTTP exception thrown: Instance a542bf73-64b0-4fac-9738-f06b723b6d21 could not be found. Nov 27 20:55:28.991173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Returning 404 to user: Instance a542bf73-64b0-4fac-9738-f06b723b6d21 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:28.999052 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f165b7f-e6c0-4a14-869f-15ea0807dfdd tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21" status: 404 len: 111 microversion: 2.1 time: 0.059968 Nov 27 20:55:29.000929 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1628/3126] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:28 2021] GET /compute/v2.1/servers/a542bf73-64b0-4fac-9738-f06b723b6d21 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:29.010334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-481c178a-25c5-4e65-b252-e9cca55d2712 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Action: 'create', calling method: .version_select at 0x7f15d93d7d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:29.109854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-481c178a-25c5-4e65-b252-e9cca55d2712 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:29.116243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-481c178a-25c5-4e65-b252-e9cca55d2712 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Getting quotas for user c5205eebafe64393923d02220666e7b8 and project 50b227cd822e4eaea7803ae94baee3fe. Resources: dict_keys(['metadata_items']) {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:29.819612 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-481c178a-25c5-4e65-b252-e9cca55d2712 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "POST /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.815691 Nov 27 20:55:29.823607 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1629/3127] 10.222.0.21 () {60 vars in 1280 bytes} [Sat Nov 27 20:55:29 2021] POST /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 85 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:29.830162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4efb92a8-47cc-4d72-966d-9f06612e0bdb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93d7670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:29.888371 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4efb92a8-47cc-4d72-966d-9f06612e0bdb tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 200 len: 1461 microversion: 2.1 time: 0.062863 Nov 27 20:55:29.895359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1630/3128] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:29 2021] GET /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 1461 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:29.895359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:29.895359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:29.901059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:29.901512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:29.903138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:29.903880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:29.923898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] HTTP exception thrown: Instance 6af66675-b153-4617-ad21-c79c87e4eac2 could not be found. Nov 27 20:55:29.924521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Returning 404 to user: Instance 6af66675-b153-4617-ad21-c79c87e4eac2 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:29.925521 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a13ebdf4-acc6-4cd0-9aad-e4f1daf3b15f tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 404 len: 111 microversion: 2.1 time: 0.035474 Nov 27 20:55:29.926371 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1631/3129] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:29 2021] DELETE /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:29.932541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d047fbe-298c-48d3-959f-4739147feb16 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d9425d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:29.987285 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d047fbe-298c-48d3-959f-4739147feb16 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 200 len: 1438 microversion: 2.1 time: 0.059856 Nov 27 20:55:29.988282 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1632/3130] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:29 2021] GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 1438 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:29.996393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bafbc4c1-c836-4703-b1a7-0086ee2872a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:29.998621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bafbc4c1-c836-4703-b1a7-0086ee2872a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:30.015549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bafbc4c1-c836-4703-b1a7-0086ee2872a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.016240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bafbc4c1-c836-4703-b1a7-0086ee2872a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.017236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bafbc4c1-c836-4703-b1a7-0086ee2872a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.017843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bafbc4c1-c836-4703-b1a7-0086ee2872a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.059327 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bafbc4c1-c836-4703-b1a7-0086ee2872a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.069255 Nov 27 20:55:30.064105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1633/3131] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:29 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:30.071871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-196ccf21-587f-45b8-a484-409851a4bb1f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:30.076719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-196ccf21-587f-45b8-a484-409851a4bb1f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:30.095303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-196ccf21-587f-45b8-a484-409851a4bb1f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.097781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-196ccf21-587f-45b8-a484-409851a4bb1f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.098574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-196ccf21-587f-45b8-a484-409851a4bb1f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.099129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-196ccf21-587f-45b8-a484-409851a4bb1f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.184613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-196ccf21-587f-45b8-a484-409851a4bb1f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.118695 Nov 27 20:55:30.185560 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1634/3132] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:30 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:30.191036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-363d1490-581a-4487-8f9d-a164ce85d9a9 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] Calling method '.version_select at 0x7f15d93d7dc0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:30.265168 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-363d1490-581a-4487-8f9d-a164ce85d9a9 tempest-ImagesMetadataTestJSON-1643003932 tempest-ImagesMetadataTestJSON-1643003932-project] 10.222.0.21 "GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.078313 Nov 27 20:55:30.266243 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1635/3133] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:55:30 2021] GET /compute/v2.1/images/112b238e-e39e-4502-bfb8-b81fed3ecc7c/metadata => generated 85 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:55:30.283757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:30.286731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:30.303098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.305115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.306534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.307422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.580108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:30.589621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddb465ea-88b0-49c6-ad40-eb92b6440ecf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 200 len: 1466 microversion: 2.1 time: 0.322084 Nov 27 20:55:30.591057 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1636/3134] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:30 2021] GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 1466 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:30.596390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:30.597829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] [instance: 6af66675-b153-4617-ad21-c79c87e4eac2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:30.604756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.606021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.607055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:30.608433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:30.627116 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] HTTP exception thrown: Instance 6af66675-b153-4617-ad21-c79c87e4eac2 could not be found. Nov 27 20:55:30.628299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] Returning 404 to user: Instance 6af66675-b153-4617-ad21-c79c87e4eac2 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:30.629352 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-93535cb7-a16e-4527-a669-7f459b1361ce tempest-ServerDiskConfigTestJSON-1218404937 tempest-ServerDiskConfigTestJSON-1218404937-project] 10.222.0.21 "GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2" status: 404 len: 111 microversion: 2.1 time: 0.036952 Nov 27 20:55:30.630335 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1637/3135] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:30 2021] GET /compute/v2.1/servers/6af66675-b153-4617-ad21-c79c87e4eac2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:30.639050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5ed82cb2-f0b1-44d9-93c9-e405464f8d3a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9415d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:30.880049 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5ed82cb2-f0b1-44d9-93c9-e405464f8d3a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?changes-since=2021-11-27T20%3A53%3A31Z" status: 200 len: 1901 microversion: 2.1 time: 0.244987 Nov 27 20:55:30.880779 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1638/3136] 10.222.0.21 () {58 vars in 1198 bytes} [Sat Nov 27 20:55:30 2021] GET /compute/v2.1/images?changes-since=2021-11-27T20%3A53%3A31Z => generated 1901 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:30.902924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7358695e-e5e9-4231-b2e9-ac7eb88818c8 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94b0160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:31.016654 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7358695e-e5e9-4231-b2e9-ac7eb88818c8 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1087922025" status: 200 len: 485 microversion: 2.1 time: 0.125474 Nov 27 20:55:31.017538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1639/3137] 10.222.0.21 () {58 vars in 1230 bytes} [Sat Nov 27 20:55:30 2021] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1087922025 => generated 485 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:31.024397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b8ab524-96d9-4f4a-87bb-a0c31a45c463 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d9415af0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:31.099818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b8ab524-96d9-4f4a-87bb-a0c31a45c463 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 200 len: 1447 microversion: 2.1 time: 0.080711 Nov 27 20:55:31.101376 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1640/3138] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:31 2021] GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 1447 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:31.107658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f00be31-ce37-4945-91e7-3db1c5172932 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9415940>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:31.221786 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f00be31-ce37-4945-91e7-3db1c5172932 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?server=322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 200 len: 957 microversion: 2.1 time: 0.118703 Nov 27 20:55:31.228086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1641/3139] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 20:55:31 2021] GET /compute/v2.1/images?server=322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 957 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:31.241962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab6a3af9-1e9f-4e10-a25a-798a304a8b90 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:31.242950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab6a3af9-1e9f-4e10-a25a-798a304a8b90 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:31.256828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6a3af9-1e9f-4e10-a25a-798a304a8b90 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:31.257513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6a3af9-1e9f-4e10-a25a-798a304a8b90 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:31.259222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6a3af9-1e9f-4e10-a25a-798a304a8b90 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:31.260812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6a3af9-1e9f-4e10-a25a-798a304a8b90 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:31.325969 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab6a3af9-1e9f-4e10-a25a-798a304a8b90 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.087756 Nov 27 20:55:31.331527 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1642/3140] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:31 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:31.342506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-236de880-3a62-4fda-8a9b-3caaa5c57332 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d94f9430>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:31.364139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:55:31.364765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:55:31.365006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:55:31.365611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:55:31.366191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:55:31.385119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:31.385704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:31.389265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:31.389849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:31.399462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-236de880-3a62-4fda-8a9b-3caaa5c57332 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 200 len: 1447 microversion: 2.1 time: 0.062904 Nov 27 20:55:31.402835 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1643/3141] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:31 2021] GET /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 1447 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:31.411114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46bbedf4-5314-42c1-9603-4d6a4db28b1d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:31.417000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46bbedf4-5314-42c1-9603-4d6a4db28b1d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:31.436302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Getting quotas for project 76f19e09c6b04ac1a559d52d9cad1c77. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:31.439812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bbedf4-5314-42c1-9603-4d6a4db28b1d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:31.440974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bbedf4-5314-42c1-9603-4d6a4db28b1d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:31.442234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bbedf4-5314-42c1-9603-4d6a4db28b1d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:31.442903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bbedf4-5314-42c1-9603-4d6a4db28b1d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:31.452108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Getting quotas for user 05f09b6a534240fc82a45ce979040e3e and project 76f19e09c6b04ac1a559d52d9cad1c77. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:31.514341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46bbedf4-5314-42c1-9603-4d6a4db28b1d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.106441 Nov 27 20:55:31.515641 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1644/3142] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:31 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:31.522348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47bea8af-479b-4541-b27a-7ae8d92dd864 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93c34c0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:31.592623 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47bea8af-479b-4541-b27a-7ae8d92dd864 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fv2.1%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 484 microversion: 2.1 time: 0.074800 Nov 27 20:55:31.594093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1645/3143] 10.222.0.21 () {58 vars in 1316 bytes} [Sat Nov 27 20:55:31 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fv2.1%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 484 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:31.599862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc3403fe-b95c-4bcd-98a9-828ee68fe95e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d9425a60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:32.217581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:55:32.222396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='021a76d9-22a2-4682-b594-1eb66d6d2882',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7b8f6b91-0f5d-43af-b670-f5ec500355d4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9acdff48-832d-43c1-a2c9-2c6d43a6f9da',volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:55:32.705766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-35825a72-095e-41a6-bfdc-f28a36363933 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.243825 Nov 27 20:55:32.708178 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1499/3144] 10.222.0.21 () {62 vars in 1188 bytes} [Sat Nov 27 20:55:28 2021] POST /compute/v2.1/servers => generated 405 bytes in 4247 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 20:55:32.713279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ecf9b021-26e7-4c4f-8784-d775ea58e26d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9342670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:32.784758 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc3403fe-b95c-4bcd-98a9-828ee68fe95e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 204 len: 0 microversion: 2.1 time: 1.189255 Nov 27 20:55:32.785340 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1646/3145] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:31 2021] DELETE /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 0 bytes in 1190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:32.790131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3103e083-541b-4db2-8230-7a0c22658aaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:32.791167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3103e083-541b-4db2-8230-7a0c22658aaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:32.804837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3103e083-541b-4db2-8230-7a0c22658aaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:32.805740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3103e083-541b-4db2-8230-7a0c22658aaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:32.807489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3103e083-541b-4db2-8230-7a0c22658aaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:32.808127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3103e083-541b-4db2-8230-7a0c22658aaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:32.822299 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ecf9b021-26e7-4c4f-8784-d775ea58e26d tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 484 microversion: 2.1 time: 0.112766 Nov 27 20:55:32.822895 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1500/3146] 10.222.0.21 () {58 vars in 1302 bytes} [Sat Nov 27 20:55:32 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 484 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:32.841987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b76c83cf-c1b3-4130-8dc0-564f45712afb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:32.846739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b76c83cf-c1b3-4130-8dc0-564f45712afb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:32.857710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b76c83cf-c1b3-4130-8dc0-564f45712afb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:32.858134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b76c83cf-c1b3-4130-8dc0-564f45712afb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:32.859029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b76c83cf-c1b3-4130-8dc0-564f45712afb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:32.859557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b76c83cf-c1b3-4130-8dc0-564f45712afb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:32.874870 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3103e083-541b-4db2-8230-7a0c22658aaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 24573 microversion: 2.1 time: 0.088109 Nov 27 20:55:32.888843 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1647/3147] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:32 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 24573 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:32.913040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cbf8f15-c51c-4a93-8f36-1bf7bd565f86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:32.920840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7cbf8f15-c51c-4a93-8f36-1bf7bd565f86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:32.955992 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b76c83cf-c1b3-4130-8dc0-564f45712afb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.122901 Nov 27 20:55:32.958016 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1501/3148] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:32 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:32.963335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:32.974024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:32.992034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:32.994724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:32.996404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:32.996858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:33.011799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cbf8f15-c51c-4a93-8f36-1bf7bd565f86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:33.019950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cbf8f15-c51c-4a93-8f36-1bf7bd565f86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:33.021475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cbf8f15-c51c-4a93-8f36-1bf7bd565f86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:33.022599 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cbf8f15-c51c-4a93-8f36-1bf7bd565f86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1283 microversion: 2.42 time: 0.130792 Nov 27 20:55:33.023156 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1648/3149] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:32 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:33.029976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:33.033474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99a3606e-8a28-42a0-a6c7-801c5a74c02f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9425c10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.159843 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a4f3571c-cd22-472d-bbf3-a207c5886f4e tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 204 len: 0 microversion: 2.1 time: 0.200208 Nov 27 20:55:33.160694 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1502/3150] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:32 2021] DELETE /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:33.190377 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99a3606e-8a28-42a0-a6c7-801c5a74c02f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.164972 Nov 27 20:55:33.191075 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1649/3151] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:33.206377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9929c1c5-4c15-4705-a95c-3d6c98cf800f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d946eee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.290464 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9929c1c5-4c15-4705-a95c-3d6c98cf800f tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.089706 Nov 27 20:55:33.291694 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1503/3152] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:33.304702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-368195af-0b59-4390-8a73-41b79a3fb646 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c78d93a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.366828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-586319808", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:33.389480 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-368195af-0b59-4390-8a73-41b79a3fb646 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.088902 Nov 27 20:55:33.390335 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1650/3153] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:33.403474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4e08b306-bd04-477c-ba76-5360978a15f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93d7160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.519501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] validate_networks() for [('b7b4fc9e-a356-4a92-af6a-42e5bad9a5c3', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:55:33.525017 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4e08b306-bd04-477c-ba76-5360978a15f5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/detail?changes-since=2021-11-27T20%3A53%3A26Z" status: 200 len: 6326 microversion: 2.1 time: 0.125969 Nov 27 20:55:33.526249 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1651/3154] 10.222.0.21 () {58 vars in 1219 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images/detail?changes-since=2021-11-27T20%3A53%3A26Z => generated 6326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:33.550839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a6b2155-10a0-4073-bef6-df353185b3ee tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9425160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.665677 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a6b2155-10a0-4073-bef6-df353185b3ee tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1087922025" status: 200 len: 665 microversion: 2.1 time: 0.118373 Nov 27 20:55:33.666496 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1652/3155] 10.222.0.21 () {58 vars in 1251 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1087922025 => generated 665 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:55:33.680962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0322c33-d7c4-4377-ab0d-9620c5296d02 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94b11f0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.745344 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0322c33-d7c4-4377-ab0d-9620c5296d02 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fv2.1%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1464 microversion: 2.1 time: 0.069339 Nov 27 20:55:33.746911 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1653/3156] 10.222.0.21 () {58 vars in 1337 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fv2.1%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1464 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:33.759578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b64ae29-275b-488e-bdae-d5c710b7a647 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9425790>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.850657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b64ae29-275b-488e-bdae-d5c710b7a647 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1464 microversion: 2.1 time: 0.094841 Nov 27 20:55:33.852599 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1654/3157] 10.222.0.21 () {58 vars in 1323 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.21%2Fcompute%2Fservers%2F931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1464 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:33.882683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5127da01-78cd-4820-9215-e995f5c9f45a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94259d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:33.992618 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5127da01-78cd-4820-9215-e995f5c9f45a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.117728 Nov 27 20:55:33.993503 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1655/3158] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:55:33 2021] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:34.000061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b52804df-cbac-453b-a890-c152dac5d6a7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:34.001283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b52804df-cbac-453b-a890-c152dac5d6a7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:34.008786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b52804df-cbac-453b-a890-c152dac5d6a7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.010316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b52804df-cbac-453b-a890-c152dac5d6a7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.012110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b52804df-cbac-453b-a890-c152dac5d6a7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.012748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b52804df-cbac-453b-a890-c152dac5d6a7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.088341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b52804df-cbac-453b-a890-c152dac5d6a7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.092297 Nov 27 20:55:34.092416 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1656/3159] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:33 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:34.097053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39343357-a996-4133-916d-d1781a222f2b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:34.098312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39343357-a996-4133-916d-d1781a222f2b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:34.105607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39343357-a996-4133-916d-d1781a222f2b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.106142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39343357-a996-4133-916d-d1781a222f2b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.107016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39343357-a996-4133-916d-d1781a222f2b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.107571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39343357-a996-4133-916d-d1781a222f2b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.154150 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39343357-a996-4133-916d-d1781a222f2b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.063396 Nov 27 20:55:34.158230 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1657/3160] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:34 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:34.162347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bc729d8-5d76-4bd9-b340-4754ac8885fe tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d94b11f0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:34.276056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:55:34.276886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:55:34.279006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:55:34.280162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:55:34.281444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:55:34.290949 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bc729d8-5d76-4bd9-b340-4754ac8885fe tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.120590 Nov 27 20:55:34.294129 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1658/3161] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:55:34 2021] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:34.303617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.303617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.303617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.303617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.320672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:34.321425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:34.353422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.353959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.355397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:34.366529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:34.385362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:34.400256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Getting quotas for user b8a8aa467b0a42459f18f6bd4ee623e4 and project fe84ac649b6b4faea051ddfd2d4b6185. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:34.434325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:55:34.442912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:55:34.525782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be55adc3-0716-4274-83d9-db91769342d5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166682 Nov 27 20:55:34.527302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1504/3162] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:55:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:55:34.535289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8701666a-6bf9-4efa-beed-2a3a65df1366 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7c9dee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:34.564166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:34.576929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:34.599108 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8701666a-6bf9-4efa-beed-2a3a65df1366 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8" status: 200 len: 784 microversion: 2.1 time: 0.070507 Nov 27 20:55:34.609166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:34.610374 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-740c0521-3fcf-45f2-9ecd-ac8aa03132b6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1581 microversion: 2.42 time: 0.303220 Nov 27 20:55:34.611087 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1659/3163] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:34 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1581 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:34.612636 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1505/3164] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:34 2021] GET /compute/v2.1/images/dad06d36-e5fe-4577-8da6-2101ffe62bc8 => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:34.617611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42b0583d-3405-4f6e-9f2c-8d2a5358a9a9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:34.623971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42b0583d-3405-4f6e-9f2c-8d2a5358a9a9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:34.797867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42b0583d-3405-4f6e-9f2c-8d2a5358a9a9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:34.813497 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42b0583d-3405-4f6e-9f2c-8d2a5358a9a9 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1207 microversion: 2.1 time: 0.201141 Nov 27 20:55:34.815476 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1660/3165] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:34 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1207 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:34.825683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-34bcf83d-01c0-4750-9925-a165c186589a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93c3550>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:34.954409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-34bcf83d-01c0-4750-9925-a165c186589a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.136374 Nov 27 20:55:34.981194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1661/3166] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:55:34 2021] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:35.002557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-575f198b-57b8-4603-b145-1b0485b96781 req-38a1552c-4ef7-4023-a9be-0462d0ee1b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322cb011-f54a-4dd9-92b9-6c9478c4333c", "name": "network-vif-unplugged", "status": "completed", "tag": "f582af39-1252-42ce-a0f7-29c2ea84cba2"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:35.007568 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:35.007568 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:35.023512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-575f198b-57b8-4603-b145-1b0485b96781 req-38a1552c-4ef7-4023-a9be-0462d0ee1b25 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:35.028564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-575f198b-57b8-4603-b145-1b0485b96781 req-38a1552c-4ef7-4023-a9be-0462d0ee1b25 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:35.053524 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-575f198b-57b8-4603-b145-1b0485b96781 req-38a1552c-4ef7-4023-a9be-0462d0ee1b25 service nova] Creating event network-vif-unplugged:f582af39-1252-42ce-a0f7-29c2ea84cba2 for instance 322cb011-f54a-4dd9-92b9-6c9478c4333c on nch1-master-1 Nov 27 20:55:35.061390 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-575f198b-57b8-4603-b145-1b0485b96781 req-38a1552c-4ef7-4023-a9be-0462d0ee1b25 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078759 Nov 27 20:55:35.062188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1662/3167] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:35.064702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8817c09e-66ff-4671-b25d-f3c518f7a8d3 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Calling method '.version_select at 0x7f15d933f670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:35.068440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bdfa9c5e-cfe2-4330-b581-bdf1be7d82e3 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d944f820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:35.088158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8817c09e-66ff-4671-b25d-f3c518f7a8d3 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:35.088632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8817c09e-66ff-4671-b25d-f3c518f7a8d3 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:35.090880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8817c09e-66ff-4671-b25d-f3c518f7a8d3 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:35.093437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8817c09e-66ff-4671-b25d-f3c518f7a8d3 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:35.145042 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8817c09e-66ff-4671-b25d-f3c518f7a8d3 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] 10.222.0.21 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.531154 Nov 27 20:55:35.147146 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1506/3168] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:34 2021] GET /compute/v2.1/limits => generated 511 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:35.163524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a21dbf37-9ec2-4a10-8900-263c1e37ff61 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:35.165089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a21dbf37-9ec2-4a10-8900-263c1e37ff61 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:35.174635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a21dbf37-9ec2-4a10-8900-263c1e37ff61 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:35.178616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a21dbf37-9ec2-4a10-8900-263c1e37ff61 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:35.179463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a21dbf37-9ec2-4a10-8900-263c1e37ff61 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:35.179913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a21dbf37-9ec2-4a10-8900-263c1e37ff61 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:35.255333 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a21dbf37-9ec2-4a10-8900-263c1e37ff61 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.105438 Nov 27 20:55:35.263387 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1507/3169] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:35 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:35.269937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-65226c15-9dff-4624-af80-7394e4e70290 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:35.271970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-65226c15-9dff-4624-af80-7394e4e70290 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:35.281783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65226c15-9dff-4624-af80-7394e4e70290 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:35.283094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65226c15-9dff-4624-af80-7394e4e70290 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:35.284073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65226c15-9dff-4624-af80-7394e4e70290 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:35.284859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65226c15-9dff-4624-af80-7394e4e70290 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:35.363684 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-65226c15-9dff-4624-af80-7394e4e70290 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.098029 Nov 27 20:55:35.364952 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1508/3170] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:35 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:35.372874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5712d82-2eb6-4828-816e-8a6d45dd6952 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-486143979", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:35.466105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-a5712d82-2eb6-4828-816e-8a6d45dd6952 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:55:35.911103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a5712d82-2eb6-4828-816e-8a6d45dd6952 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Getting quotas for project f60857db820e4d7eb13ec7edea9c8cf3. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:35.919784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a5712d82-2eb6-4828-816e-8a6d45dd6952 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Getting quotas for user 18f6851647fb4b7a851f5f94499a087c and project f60857db820e4d7eb13ec7edea9c8cf3. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:35.952537 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a5712d82-2eb6-4828-816e-8a6d45dd6952 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 27 20:55:35.959743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5712d82-2eb6-4828-816e-8a6d45dd6952 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:35.960828 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a5712d82-2eb6-4828-816e-8a6d45dd6952 tempest-AbsoluteLimitsNegativeTestJSON-1510020660 tempest-AbsoluteLimitsNegativeTestJSON-1510020660-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.594136 Nov 27 20:55:35.965201 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1509/3171] 10.222.0.21 () {60 vars in 1147 bytes} [Sat Nov 27 20:55:35 2021] POST /compute/v2.1/servers => generated 87 bytes in 599 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:55:35.985413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:36.009162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:36.025404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:36.026327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:36.036284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:36.037055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:36.116307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bdfa9c5e-cfe2-4330-b581-bdf1be7d82e3 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690" status: 204 len: 0 microversion: 2.1 time: 1.052733 Nov 27 20:55:36.118166 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1663/3172] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:35 2021] DELETE /compute/v2.1/images/d6e73fb1-cbee-4294-8098-48131fa06690 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:36.126309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:36.127042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:36.157535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:36.158849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:36.160653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:36.162297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:36.273302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:36.288192 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-32063a24-156a-4db1-8fae-ebfdb7712e11 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1267 microversion: 2.1 time: 0.168650 Nov 27 20:55:36.289070 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1664/3173] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:36 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:36.295068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b30a2ef5-99e1-43d2-a863-43b943cf1f69 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9425700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:37.110822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:37.122520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:37.124302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:37.126352 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c934e4d3-e140-4a07-a12a-955c9fa4d24b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1658 microversion: 2.42 time: 1.159233 Nov 27 20:55:37.127134 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1510/3174] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:35 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1658 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:37.131907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02964249-948a-4bb6-b877-3db2fd0a1bb3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:37.133161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02964249-948a-4bb6-b877-3db2fd0a1bb3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:37.149138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02964249-948a-4bb6-b877-3db2fd0a1bb3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:37.155549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02964249-948a-4bb6-b877-3db2fd0a1bb3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:37.156593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02964249-948a-4bb6-b877-3db2fd0a1bb3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:37.158751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02964249-948a-4bb6-b877-3db2fd0a1bb3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:37.259376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02964249-948a-4bb6-b877-3db2fd0a1bb3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.130637 Nov 27 20:55:37.260086 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1511/3175] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:37 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:37.279344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7dfd18d-3b03-42c8-83f6-db3650b0bd6a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:37.280943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7dfd18d-3b03-42c8-83f6-db3650b0bd6a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:37.291494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7dfd18d-3b03-42c8-83f6-db3650b0bd6a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:37.292104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7dfd18d-3b03-42c8-83f6-db3650b0bd6a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:37.293137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7dfd18d-3b03-42c8-83f6-db3650b0bd6a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:37.294891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7dfd18d-3b03-42c8-83f6-db3650b0bd6a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:37.382225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7dfd18d-3b03-42c8-83f6-db3650b0bd6a tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.119307 Nov 27 20:55:37.387798 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1512/3176] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:37 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:37.430385 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b30a2ef5-99e1-43d2-a863-43b943cf1f69 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0" status: 204 len: 0 microversion: 2.1 time: 1.140102 Nov 27 20:55:37.431777 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1665/3177] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:36 2021] DELETE /compute/v2.1/images/ec518f13-721b-4ed6-a2f3-5cb5edf89fd0 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:37.438312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d01cd934-b49e-4fdf-8b0f-12f31c644ad5 req-5bb30abd-fb76-4695-a66a-36c1f8102a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8911dc7c-bdfd-4fcb-a7a9-65e9c946c806", "name": "network-vif-unplugged", "status": "completed", "tag": "a2426259-c237-480c-afc3-6c9804dc6ce1"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:37.445901 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:37.445901 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:37.470917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d01cd934-b49e-4fdf-8b0f-12f31c644ad5 req-5bb30abd-fb76-4695-a66a-36c1f8102a9d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:37.472105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d01cd934-b49e-4fdf-8b0f-12f31c644ad5 req-5bb30abd-fb76-4695-a66a-36c1f8102a9d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:37.500197 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d01cd934-b49e-4fdf-8b0f-12f31c644ad5 req-5bb30abd-fb76-4695-a66a-36c1f8102a9d service nova] Creating event network-vif-unplugged:a2426259-c237-480c-afc3-6c9804dc6ce1 for instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 on nch1-master-1 Nov 27 20:55:37.513497 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d01cd934-b49e-4fdf-8b0f-12f31c644ad5 req-5bb30abd-fb76-4695-a66a-36c1f8102a9d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077231 Nov 27 20:55:37.516188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1666/3178] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:37.531862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:37.533985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:37.547462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:37.549973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:37.550775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:37.552776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:37.725301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:37.771179 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-815c0dbf-4888-4596-83c0-9da40d2f9d97 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1265 microversion: 2.1 time: 0.249718 Nov 27 20:55:37.774580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1519307593", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "9c0aa522-1fc2-477c-82ba-de73a057bc9c"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:37.776363 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1667/3179] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:37 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:37.811859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b874664-ea9f-4cfe-97dd-5b548c409705 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d9425790>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:37.873615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] validate_networks() for [('9c0aa522-1fc2-477c-82ba-de73a057bc9c', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:55:38.830937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:55:38.831568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:55:38.831850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:55:38.832231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:55:38.832641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:55:38.849648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:38.851238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:38.853917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:38.857062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:38.910161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Getting quotas for project 7895e84a65ed41808aae6e8f05780bca. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:38.921140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Getting quotas for user a5e06f88a7a941909e40b105d2f30310 and project 7895e84a65ed41808aae6e8f05780bca. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:38.950061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:55:38.963539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:55:39.053517 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10d65ee9-968a-412d-bd3e-3bf19b900c52 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.664413 Nov 27 20:55:39.054729 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1513/3180] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:55:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:55:39.059994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-49a81f07-208e-4238-9403-56ad7d27be07 req-028c23e5-d326-4b79-a0ae-a656ea27569f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8911dc7c-bdfd-4fcb-a7a9-65e9c946c806", "name": "network-vif-deleted", "tag": "a2426259-c237-480c-afc3-6c9804dc6ce1"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:39.061980 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:39.061980 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:39.070158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-49a81f07-208e-4238-9403-56ad7d27be07 req-028c23e5-d326-4b79-a0ae-a656ea27569f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.070871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-49a81f07-208e-4238-9403-56ad7d27be07 req-028c23e5-d326-4b79-a0ae-a656ea27569f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.080242 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b874664-ea9f-4cfe-97dd-5b548c409705 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681" status: 204 len: 0 microversion: 2.1 time: 1.291606 Nov 27 20:55:39.081684 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1668/3181] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:37 2021] DELETE /compute/v2.1/images/cda658a8-6543-482a-9e78-3ebb93835681 => generated 0 bytes in 1304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:39.087294 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-49a81f07-208e-4238-9403-56ad7d27be07 req-028c23e5-d326-4b79-a0ae-a656ea27569f service nova] Creating event network-vif-deleted:a2426259-c237-480c-afc3-6c9804dc6ce1 for instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 on nch1-master-1 Nov 27 20:55:39.087550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:39.088164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:39.094710 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-49a81f07-208e-4238-9403-56ad7d27be07 req-028c23e5-d326-4b79-a0ae-a656ea27569f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037587 Nov 27 20:55:39.095828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1514/3182] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:39.101511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66b9b662-c44e-4255-b9e6-3bb45ea101aa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:39.104272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66b9b662-c44e-4255-b9e6-3bb45ea101aa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:39.107355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.107815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.111604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b9b662-c44e-4255-b9e6-3bb45ea101aa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.112340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b9b662-c44e-4255-b9e6-3bb45ea101aa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.113340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b9b662-c44e-4255-b9e6-3bb45ea101aa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.114053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66b9b662-c44e-4255-b9e6-3bb45ea101aa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.115424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.115885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.168135 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66b9b662-c44e-4255-b9e6-3bb45ea101aa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.069732 Nov 27 20:55:39.169145 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1515/3183] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:39 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:39.180917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1217efd8-250f-4d2e-be5f-661a5b7843f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:39.184424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1217efd8-250f-4d2e-be5f-661a5b7843f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:39.199522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1217efd8-250f-4d2e-be5f-661a5b7843f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.205814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1217efd8-250f-4d2e-be5f-661a5b7843f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.207036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1217efd8-250f-4d2e-be5f-661a5b7843f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.207800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1217efd8-250f-4d2e-be5f-661a5b7843f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.284977 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1217efd8-250f-4d2e-be5f-661a5b7843f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.112959 Nov 27 20:55:39.286109 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1516/3184] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:39 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:39.299442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:39.302403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:39.316759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.318731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.320516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.323332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.523606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:39.545771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:39.550997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:39.554942 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d983d597-4af1-4cc4-9a6e-8b7ff67e6bc7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1704 microversion: 2.42 time: 0.469733 Nov 27 20:55:39.556849 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1669/3185] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:39 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1704 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:39.571341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ffb8ea68-fd92-43cb-a7c2-404273abb1a0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:39.572034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ffb8ea68-fd92-43cb-a7c2-404273abb1a0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:39.727169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ffb8ea68-fd92-43cb-a7c2-404273abb1a0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:39.739688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ffb8ea68-fd92-43cb-a7c2-404273abb1a0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1225 microversion: 2.1 time: 0.181421 Nov 27 20:55:39.743375 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1670/3186] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:39 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1225 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:39.775013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:39.779811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:39.801867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.802836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.807216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:39.815772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:39.899547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:39.907592 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-160669a1-de51-4ee3-9815-e23f653fb028 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1307 microversion: 2.1 time: 0.620070 Nov 27 20:55:39.908179 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1517/3187] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:39 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1307 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:39.911444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:40.107078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26cbb76e-04fa-4928-9fd2-db2c5fcd68de tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 204 len: 0 microversion: 2.1 time: 0.347921 Nov 27 20:55:40.109409 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1671/3188] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:39 2021] DELETE /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:40.117558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:40.118365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:40.138048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.144200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.146921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.148288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.181394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b498ce26-38b2-453b-82c6-51377c12f61e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:40.183883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b498ce26-38b2-453b-82c6-51377c12f61e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:40.192025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b498ce26-38b2-453b-82c6-51377c12f61e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.193662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b498ce26-38b2-453b-82c6-51377c12f61e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.194793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b498ce26-38b2-453b-82c6-51377c12f61e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.197212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b498ce26-38b2-453b-82c6-51377c12f61e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.298373 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b498ce26-38b2-453b-82c6-51377c12f61e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.119110 Nov 27 20:55:40.299639 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1672/3189] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:40 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:55:40.315880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bcc501f1-1ded-4e28-b1be-2eaafb75896d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:40.317102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bcc501f1-1ded-4e28-b1be-2eaafb75896d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:40.324757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcc501f1-1ded-4e28-b1be-2eaafb75896d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.325457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcc501f1-1ded-4e28-b1be-2eaafb75896d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.326490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcc501f1-1ded-4e28-b1be-2eaafb75896d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.327611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcc501f1-1ded-4e28-b1be-2eaafb75896d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.421422 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bcc501f1-1ded-4e28-b1be-2eaafb75896d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.117772 Nov 27 20:55:40.425530 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1673/3190] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:40 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:40.538323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:40.548540 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ecdf260-10ea-4d90-bd57-1419041a70a7 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1473 microversion: 2.1 time: 0.434289 Nov 27 20:55:40.554187 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1518/3191] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:40 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1473 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:40.578531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:40.579728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:40.595847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.596720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.599349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.602008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.762017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:40.762956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:40.777001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.778515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.780979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.783018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.895203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:40.915308 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d81e54d-dafc-4397-aaff-4f9d71b0e285 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1285 microversion: 2.1 time: 0.154080 Nov 27 20:55:40.918537 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1519/3192] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:40 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:40.926363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:40.929254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:40.939184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.939961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:40.941205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:40.941798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.100880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:41.111482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:41.113469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:41.115575 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b7cf975a-c451-4318-b97d-6409c66890bd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1750 microversion: 2.42 time: 0.541640 Nov 27 20:55:41.116362 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1674/3193] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:40 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1750 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:41.294360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-40877f4b-fc67-44b6-b26a-719ea1af9569 req-6794deed-f942-48eb-9c2b-0d71b3b4f254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a37077f-714e-4168-a49e-d6cb8b750ca9", "tag": "539b6d03-82a1-46d1-8b03-a0295fadf9c4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:41.296228 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:41.296228 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:41.309670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-40877f4b-fc67-44b6-b26a-719ea1af9569 req-6794deed-f942-48eb-9c2b-0d71b3b4f254 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.311055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-40877f4b-fc67-44b6-b26a-719ea1af9569 req-6794deed-f942-48eb-9c2b-0d71b3b4f254 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.327116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:41.336666 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3d843c6-e2ae-4461-b8b8-f8b437f65617 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1307 microversion: 2.1 time: 0.415963 Nov 27 20:55:41.337608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1520/3194] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:40 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:41.353937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-40877f4b-fc67-44b6-b26a-719ea1af9569 req-6794deed-f942-48eb-9c2b-0d71b3b4f254 service nova] Creating event network-changed:539b6d03-82a1-46d1-8b03-a0295fadf9c4 for instance 0a37077f-714e-4168-a49e-d6cb8b750ca9 on nch1-master-1 Nov 27 20:55:41.354346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6b2e23f-a2f6-4d11-bb8d-b15ddd4167fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:41.356403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6b2e23f-a2f6-4d11-bb8d-b15ddd4167fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:41.361953 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-40877f4b-fc67-44b6-b26a-719ea1af9569 req-6794deed-f942-48eb-9c2b-0d71b3b4f254 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100780 Nov 27 20:55:41.362908 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1675/3195] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:55:41.365247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6b2e23f-a2f6-4d11-bb8d-b15ddd4167fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.366525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6b2e23f-a2f6-4d11-bb8d-b15ddd4167fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.367396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6b2e23f-a2f6-4d11-bb8d-b15ddd4167fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.367835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6b2e23f-a2f6-4d11-bb8d-b15ddd4167fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.435726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88ea95ab-c012-4d19-95a1-3b894a03cd63 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:41.440328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88ea95ab-c012-4d19-95a1-3b894a03cd63 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:41.459074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6b2e23f-a2f6-4d11-bb8d-b15ddd4167fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.119845 Nov 27 20:55:41.461611 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1521/3196] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:41 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:41.464805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88ea95ab-c012-4d19-95a1-3b894a03cd63 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.465399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88ea95ab-c012-4d19-95a1-3b894a03cd63 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.466687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88ea95ab-c012-4d19-95a1-3b894a03cd63 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.468304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88ea95ab-c012-4d19-95a1-3b894a03cd63 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.517715 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88ea95ab-c012-4d19-95a1-3b894a03cd63 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.086897 Nov 27 20:55:41.519420 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1676/3197] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:41 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:41.567496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:41.568510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:41.578122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.578558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.579535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.580117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.934110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:41.935101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:41.942805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.943647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:41.944764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:41.945433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.080499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:42.089698 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e38a274-8c6d-49c2-a14a-5a44d80beff9 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1283 microversion: 2.1 time: 0.159442 Nov 27 20:55:42.090646 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1677/3198] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:41 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:42.138623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:42.141433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:42.148953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.149623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.150605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.151187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.407522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:42.423967 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b83968bd-574a-459d-909e-c872eb76e790 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1473 microversion: 2.1 time: 0.861144 Nov 27 20:55:42.424880 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1522/3199] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:41 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1473 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:42.437873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:42.440159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:42.449436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.449979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.451131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.451278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.685028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:42.704503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:42.706433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:42.707970 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e322c167-a2f1-44f2-b51a-a6ac65c030ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1784 microversion: 2.42 time: 0.575439 Nov 27 20:55:42.708690 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1678/3200] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:42 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1784 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:42.718950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02f2575e-fdc9-420f-b466-fa3c460fc6bc tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:42.720164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02f2575e-fdc9-420f-b466-fa3c460fc6bc tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:42.737469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f2575e-fdc9-420f-b466-fa3c460fc6bc tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.738151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f2575e-fdc9-420f-b466-fa3c460fc6bc tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.739272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f2575e-fdc9-420f-b466-fa3c460fc6bc tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.739706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f2575e-fdc9-420f-b466-fa3c460fc6bc tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.768522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:42.784103 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-179d8d87-238d-42ef-bf0c-350a1dfaf793 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1307 microversion: 2.1 time: 0.354616 Nov 27 20:55:42.784985 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1523/3201] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:42 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:42.802037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b4a1e583-b2af-4d25-a8c8-c335d97102af tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:42.803133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b4a1e583-b2af-4d25-a8c8-c335d97102af tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:42.809770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a1e583-b2af-4d25-a8c8-c335d97102af tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.810230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02f2575e-fdc9-420f-b466-fa3c460fc6bc tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.099250 Nov 27 20:55:42.810342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a1e583-b2af-4d25-a8c8-c335d97102af tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.811466 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1679/3202] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:42 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:42.812434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a1e583-b2af-4d25-a8c8-c335d97102af tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:42.812567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a1e583-b2af-4d25-a8c8-c335d97102af tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:42.870779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b4a1e583-b2af-4d25-a8c8-c335d97102af tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.072258 Nov 27 20:55:42.872058 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1524/3203] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:42 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:43.006577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-507685753", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "c9d0e7a7-8167-40cd-8b50-75d50aa584f8"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:43.091937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] validate_networks() for [('c9d0e7a7-8167-40cd-8b50-75d50aa584f8', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:55:43.108699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:43.109929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:43.119707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:43.120566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:43.122293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:43.123104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:43.582119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:43.591491 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d953ff98-0038-49de-8dc9-4511c42cfcf2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1325 microversion: 2.1 time: 0.488632 Nov 27 20:55:43.595873 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1525/3204] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:43 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:43.605445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:43.606065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:43.612144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:43.612792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:43.613767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:43.614365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:43.695295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:43.704277 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02230787-7a65-4188-aeb0-3a0a260b72d5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 200 len: 1431 microversion: 2.1 time: 0.107443 Nov 27 20:55:43.705037 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1526/3205] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:43 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 1431 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:43.741249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:43.741868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:43.749098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:43.749545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:43.750325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:43.750759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.236335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:44.245747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:44.247846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:44.249179 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c3bcd2d-0920-4cff-b2d4-d9d7f429f158 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1830 microversion: 2.42 time: 0.523048 Nov 27 20:55:44.250278 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1527/3206] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:43 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1830 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:44.269921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:44.270749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:44.277086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.277526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.278708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.279184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.316995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:55:44.317635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:55:44.318447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:55:44.319016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:55:44.319619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:55:44.337041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.337597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.338493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.339741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.369714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Getting quotas for project e284ee0d43044b11b711ede03335cfa1. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:55:44.377561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Getting quotas for user 5da0c98eadc94788b5636567ccdd9927 and project e284ee0d43044b11b711ede03335cfa1. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:55:44.392683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:55:44.396648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:55:44.451934 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ada49f0-c7ea-48d0-9e35-02c29ee81ecd tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634633 Nov 27 20:55:44.459211 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1680/3207] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:55:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:55:44.465555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-849cf3fd-5497-4bbd-b620-8c498735cd9a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:44.467625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-849cf3fd-5497-4bbd-b620-8c498735cd9a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:44.489002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-849cf3fd-5497-4bbd-b620-8c498735cd9a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.490264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-849cf3fd-5497-4bbd-b620-8c498735cd9a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.492753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-849cf3fd-5497-4bbd-b620-8c498735cd9a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.493528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-849cf3fd-5497-4bbd-b620-8c498735cd9a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.567657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-849cf3fd-5497-4bbd-b620-8c498735cd9a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.106417 Nov 27 20:55:44.574032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1681/3208] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:44 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:44.579903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cc58ce89-a425-4526-b499-e1ba83cea89f req-51e67e90-ae8c-401c-bd21-5142e9791b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931317b4-226f-4f75-8a5e-f93c7ce5c3ad", "name": "network-vif-deleted", "tag": "2dfaad6b-b499-4a67-ad7b-ec4eea1d3813"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:44.590648 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:44.590648 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:44.605883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cc58ce89-a425-4526-b499-e1ba83cea89f req-51e67e90-ae8c-401c-bd21-5142e9791b29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.606721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cc58ce89-a425-4526-b499-e1ba83cea89f req-51e67e90-ae8c-401c-bd21-5142e9791b29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.629378 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cc58ce89-a425-4526-b499-e1ba83cea89f req-51e67e90-ae8c-401c-bd21-5142e9791b29 service nova] Creating event network-vif-deleted:2dfaad6b-b499-4a67-ad7b-ec4eea1d3813 for instance 931317b4-226f-4f75-8a5e-f93c7ce5c3ad on nch2-master-1 Nov 27 20:55:44.645302 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cc58ce89-a425-4526-b499-e1ba83cea89f req-51e67e90-ae8c-401c-bd21-5142e9791b29 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069699 Nov 27 20:55:44.645913 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1682/3209] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:44.656670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7249473b-d5b4-4757-a4c5-72de2e0d467d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:44.665427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7249473b-d5b4-4757-a4c5-72de2e0d467d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:44.679830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7249473b-d5b4-4757-a4c5-72de2e0d467d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.684752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7249473b-d5b4-4757-a4c5-72de2e0d467d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.687348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7249473b-d5b4-4757-a4c5-72de2e0d467d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.687740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7249473b-d5b4-4757-a4c5-72de2e0d467d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.714474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:44.722140 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0b65ec61-44d6-4b23-8ab2-024496f15e29 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1307 microversion: 2.1 time: 0.470607 Nov 27 20:55:44.728662 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1528/3210] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:44 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1307 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:44.734816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9eb69e1a-5eb8-421e-8769-4b18bd67f5db tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:44.735477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9eb69e1a-5eb8-421e-8769-4b18bd67f5db tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:44.765059 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7249473b-d5b4-4757-a4c5-72de2e0d467d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.112119 Nov 27 20:55:44.765729 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1683/3211] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:44 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:44.777652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:44.778367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:44.801797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.803238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.806767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.809297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.897645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9eb69e1a-5eb8-421e-8769-4b18bd67f5db tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:44.905291 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9eb69e1a-5eb8-421e-8769-4b18bd67f5db tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1224 microversion: 2.1 time: 0.175565 Nov 27 20:55:44.905897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1529/3212] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:44 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1224 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:44.915383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:44.915878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 931317b4-226f-4f75-8a5e-f93c7ce5c3ad] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:44.925987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.927203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:44.928315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:44.928948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.006466 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] HTTP exception thrown: Instance 931317b4-226f-4f75-8a5e-f93c7ce5c3ad could not be found. Nov 27 20:55:45.007996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Returning 404 to user: Instance 931317b4-226f-4f75-8a5e-f93c7ce5c3ad could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:45.011941 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5cdfc35-1228-4369-b427-26bb6ed721ae tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad" status: 404 len: 111 microversion: 2.1 time: 0.102048 Nov 27 20:55:45.022198 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1530/3213] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:44 2021] GET /compute/v2.1/servers/931317b4-226f-4f75-8a5e-f93c7ce5c3ad => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:45.039447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-205b4727-d183-4b4c-b245-596ef6fa41f0 req-31a2e2ee-3668-4991-b807-08249ac393b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7389137a-6f45-4998-8ce7-20aa8f6cb2cf", "tag": "2eb52b34-d84f-4b6a-9cef-edda1f2ba852"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:45.042751 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:45.042751 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:45.064792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-205b4727-d183-4b4c-b245-596ef6fa41f0 req-31a2e2ee-3668-4991-b807-08249ac393b5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.066067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-205b4727-d183-4b4c-b245-596ef6fa41f0 req-31a2e2ee-3668-4991-b807-08249ac393b5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.102134 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-205b4727-d183-4b4c-b245-596ef6fa41f0 req-31a2e2ee-3668-4991-b807-08249ac393b5 service nova] Creating event network-changed:2eb52b34-d84f-4b6a-9cef-edda1f2ba852 for instance 7389137a-6f45-4998-8ce7-20aa8f6cb2cf on nch2-master-1 Nov 27 20:55:45.115305 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-205b4727-d183-4b4c-b245-596ef6fa41f0 req-31a2e2ee-3668-4991-b807-08249ac393b5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091401 Nov 27 20:55:45.116327 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1531/3214] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:45.132179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:45.135867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:45.152985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.153938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.156863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.157978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.231416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:45.433324 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e90fd08-632e-4375-8e6e-a89390276471 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 204 len: 0 microversion: 2.1 time: 0.314259 Nov 27 20:55:45.438214 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1532/3215] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:45 2021] DELETE /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:45.445641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:45.446626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:45.454885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.455735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.456783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.457422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.583921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:45.591924 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5601da18-b7b3-4891-8e51-8b62d61984ef tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1325 microversion: 2.1 time: 0.823892 Nov 27 20:55:45.592502 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1684/3216] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:44 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1325 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:45.602255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:45.612633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:45.621018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.621775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.623228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.623809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.742082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:45.751585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:45.753228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:45.754676 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0017408c-a138-4595-91c9-8452f53edf32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1830 microversion: 2.42 time: 0.314405 Nov 27 20:55:45.755539 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1533/3217] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:45 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1830 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:45.760443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d5a6cabc-5676-4652-8e94-dce8d73bae3c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:45.762205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d5a6cabc-5676-4652-8e94-dce8d73bae3c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:45.768472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5a6cabc-5676-4652-8e94-dce8d73bae3c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.769210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5a6cabc-5676-4652-8e94-dce8d73bae3c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.774072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5a6cabc-5676-4652-8e94-dce8d73bae3c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.774936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5a6cabc-5676-4652-8e94-dce8d73bae3c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.819002 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d5a6cabc-5676-4652-8e94-dce8d73bae3c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.061860 Nov 27 20:55:45.819907 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1534/3218] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:45 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:45.834868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:45.835626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:45.856939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.857470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.858435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.859011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.934008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:45.952907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fbee9940-8734-4d19-bfd4-4a2199e5ba0a tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 200 len: 1472 microversion: 2.1 time: 0.345805 Nov 27 20:55:45.954182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1685/3219] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:45 2021] GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:45.973118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3699866a-53b2-44c1-9ece-46be4befa2a8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:45.974290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3699866a-53b2-44c1-9ece-46be4befa2a8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:45.993205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3699866a-53b2-44c1-9ece-46be4befa2a8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.997512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3699866a-53b2-44c1-9ece-46be4befa2a8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:45.998203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3699866a-53b2-44c1-9ece-46be4befa2a8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:45.998712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3699866a-53b2-44c1-9ece-46be4befa2a8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.063177 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3699866a-53b2-44c1-9ece-46be4befa2a8 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.095815 Nov 27 20:55:46.068069 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1686/3220] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:45 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:46.076393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:46.077581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:46.090514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:46.091224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.092274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:46.092899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.222396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:46.234704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f7bfcee7-d98f-43ad-a8b2-ad5d749963bf tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1284 microversion: 2.1 time: 0.165364 Nov 27 20:55:46.235906 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1687/3221] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:46 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:46.610046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:46.611425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:46.618605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:46.619609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.620684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:46.621596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.739197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:46.749483 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96c34f85-aa18-4c91-a438-6b049b9ff368 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1307 microversion: 2.1 time: 0.927930 Nov 27 20:55:46.760622 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1535/3222] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:45 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1307 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:46.766388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5ba32e43-35b7-46c7-b966-af0f65e967d5 req-e9f0de00-24c3-4ac8-8382-d29f0191fa6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "03e5badb-8172-486f-9775-23060da4f0c7"}, {"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "7892b730-0a95-4587-9c92-b7522e255107"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:46.768032 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:46.768032 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:46.776104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5ba32e43-35b7-46c7-b966-af0f65e967d5 req-e9f0de00-24c3-4ac8-8382-d29f0191fa6b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:46.776585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5ba32e43-35b7-46c7-b966-af0f65e967d5 req-e9f0de00-24c3-4ac8-8382-d29f0191fa6b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.789085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5ba32e43-35b7-46c7-b966-af0f65e967d5 req-e9f0de00-24c3-4ac8-8382-d29f0191fa6b service nova] Creating event network-changed:03e5badb-8172-486f-9775-23060da4f0c7 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:55:46.789777 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5ba32e43-35b7-46c7-b966-af0f65e967d5 req-e9f0de00-24c3-4ac8-8382-d29f0191fa6b service nova] Creating event network-changed:7892b730-0a95-4587-9c92-b7522e255107 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:55:46.796024 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5ba32e43-35b7-46c7-b966-af0f65e967d5 req-e9f0de00-24c3-4ac8-8382-d29f0191fa6b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032931 Nov 27 20:55:46.796850 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1536/3223] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:46 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:46.804337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:46.805603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:46.813483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:46.814116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.816359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:46.816992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:46.940966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:46.953941 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca2ea6c1-5f32-49da-99c1-27efa9c6fba7 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1325 microversion: 2.1 time: 0.346434 Nov 27 20:55:46.954890 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1688/3224] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:46 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:46.963794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47d8f37a-dd67-4f36-8220-5682c347a06b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:46.963794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-47d8f37a-dd67-4f36-8220-5682c347a06b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:46.993898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47d8f37a-dd67-4f36-8220-5682c347a06b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.009731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47d8f37a-dd67-4f36-8220-5682c347a06b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.013708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47d8f37a-dd67-4f36-8220-5682c347a06b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.014062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47d8f37a-dd67-4f36-8220-5682c347a06b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.085120 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47d8f37a-dd67-4f36-8220-5682c347a06b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.128772 Nov 27 20:55:47.086041 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1689/3225] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:46 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:47.103467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:47.104225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:47.112999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.113465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.114250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.114826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.444576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:47.457155 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca30da7a-5915-4167-b396-dedf6080c2c1 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 200 len: 1472 microversion: 2.1 time: 0.363908 Nov 27 20:55:47.457937 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1690/3226] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:47 2021] GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:47.466425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-393f01f6-fd06-4491-a2dd-005793ea63e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:47.468131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-393f01f6-fd06-4491-a2dd-005793ea63e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:47.479525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-393f01f6-fd06-4491-a2dd-005793ea63e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.479987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-393f01f6-fd06-4491-a2dd-005793ea63e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.481462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-393f01f6-fd06-4491-a2dd-005793ea63e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.481973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-393f01f6-fd06-4491-a2dd-005793ea63e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.529596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-393f01f6-fd06-4491-a2dd-005793ea63e5 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.070565 Nov 27 20:55:47.530521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1691/3227] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:47 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:47.537046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:47.537628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:47.545510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.545964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.546769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.547421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.583979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:47.598677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:47.601102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:47.602446 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ca85c56-4a2a-4002-9f73-a2107ec00669 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.804153 Nov 27 20:55:47.603835 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1537/3228] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:46 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:47.715005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:47.724105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9d070d1-f464-4c32-b842-3b5aecba916a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1282 microversion: 2.1 time: 0.192409 Nov 27 20:55:47.724783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1692/3229] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:47 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:47.766486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:47.767105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:47.776799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.778256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.780896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.782120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.971124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:47.972029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:47.978978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.979844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:47.980865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:47.981554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.149581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:48.156982 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-851b5819-1a25-4483-a63a-1ff73c1c291c tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1307 microversion: 2.1 time: 0.394079 Nov 27 20:55:48.166972 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1538/3230] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:47 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:48.172132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f81dc61-d2a7-4de0-b20c-2e2c5e56d3de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:48.173237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f81dc61-d2a7-4de0-b20c-2e2c5e56d3de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:48.179539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81dc61-d2a7-4de0-b20c-2e2c5e56d3de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.180183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81dc61-d2a7-4de0-b20c-2e2c5e56d3de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.181142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81dc61-d2a7-4de0-b20c-2e2c5e56d3de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.181720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81dc61-d2a7-4de0-b20c-2e2c5e56d3de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.234257 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f81dc61-d2a7-4de0-b20c-2e2c5e56d3de tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.061493 Nov 27 20:55:48.238421 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1539/3231] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:48 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:48.325478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:48.336555 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e19fa3a0-2f43-48ef-bbba-3b08c633ac3f tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1325 microversion: 2.1 time: 0.368640 Nov 27 20:55:48.337645 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1693/3232] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:47 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1325 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:48.477349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:48.478055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:48.487746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.489754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.491663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.492225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.541830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a339f31-7a17-4d46-a377-aa58bcfd6506 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:48.543113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a339f31-7a17-4d46-a377-aa58bcfd6506 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:48.549587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a339f31-7a17-4d46-a377-aa58bcfd6506 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.550251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a339f31-7a17-4d46-a377-aa58bcfd6506 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.551699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a339f31-7a17-4d46-a377-aa58bcfd6506 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.552347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a339f31-7a17-4d46-a377-aa58bcfd6506 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.644572 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a339f31-7a17-4d46-a377-aa58bcfd6506 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.095559 Nov 27 20:55:48.653059 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1694/3233] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:48 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:48.661941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:48.663530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:48.678967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.679460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.680443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.680891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:48.932750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5206ef55b9694b4faa3ef71d001d94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a608f2c265434999aa734f1841b2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:48.948665 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8056cdfd-cc9d-4077-889e-2239463e7cf2 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 200 len: 1472 microversion: 2.1 time: 0.475098 Nov 27 20:55:48.960735 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1540/3234] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:48 2021] GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:48.973605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b3dab3f1-cb9c-407c-9b63-48053f31ecbc req-65d29b94-86f3-42d1-844a-e5c982ee96c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a37077f-714e-4168-a49e-d6cb8b750ca9", "name": "network-vif-plugged", "status": "completed", "tag": "539b6d03-82a1-46d1-8b03-a0295fadf9c4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:48.977636 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:48.977636 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:48.994174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b3dab3f1-cb9c-407c-9b63-48053f31ecbc req-65d29b94-86f3-42d1-844a-e5c982ee96c5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:48.994855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b3dab3f1-cb9c-407c-9b63-48053f31ecbc req-65d29b94-86f3-42d1-844a-e5c982ee96c5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.010607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b3dab3f1-cb9c-407c-9b63-48053f31ecbc req-65d29b94-86f3-42d1-844a-e5c982ee96c5 service nova] Creating event network-vif-plugged:539b6d03-82a1-46d1-8b03-a0295fadf9c4 for instance 0a37077f-714e-4168-a49e-d6cb8b750ca9 on nch1-master-1 Nov 27 20:55:49.016184 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b3dab3f1-cb9c-407c-9b63-48053f31ecbc req-65d29b94-86f3-42d1-844a-e5c982ee96c5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049402 Nov 27 20:55:49.017107 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1541/3235] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:49.025627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:49.027435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:49.034493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.035216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.036757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.037399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.411907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:49.413277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:49.421814 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-830388e1-fd1e-4280-ad58-d7abaec8f0c1 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1324 microversion: 2.1 time: 0.403256 Nov 27 20:55:49.425462 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1542/3236] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:49 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:49.432019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cf67b8ea-17a0-42e7-98ae-7b89f9f1e8e2 req-d20154aa-27a8-4feb-8838-e5d773706654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "2141f889-e6e6-4c2b-ba22-12f0441b2f07"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:49.437657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:49.439512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:49.439899 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:49.439899 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:49.455932 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5d8bd6d4-824e-48c5-8e15-ee0408ff51c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.786422 Nov 27 20:55:49.456862 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1695/3237] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:48 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:49.458403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cf67b8ea-17a0-42e7-98ae-7b89f9f1e8e2 req-d20154aa-27a8-4feb-8838-e5d773706654 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.458850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cf67b8ea-17a0-42e7-98ae-7b89f9f1e8e2 req-d20154aa-27a8-4feb-8838-e5d773706654 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.461572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a0c0f10d-1516-4f6c-ab4c-10c686746b50 req-b3ceb754-559c-4aa9-bfca-ebca13239ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322cb011-f54a-4dd9-92b9-6c9478c4333c", "name": "network-vif-deleted", "tag": "f582af39-1252-42ce-a0f7-29c2ea84cba2"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:49.472913 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:49.472913 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:49.482242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a0c0f10d-1516-4f6c-ab4c-10c686746b50 req-b3ceb754-559c-4aa9-bfca-ebca13239ee2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.485134 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cf67b8ea-17a0-42e7-98ae-7b89f9f1e8e2 req-d20154aa-27a8-4feb-8838-e5d773706654 service nova] Creating event network-changed:2141f889-e6e6-4c2b-ba22-12f0441b2f07 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:55:49.485794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a0c0f10d-1516-4f6c-ab4c-10c686746b50 req-b3ceb754-559c-4aa9-bfca-ebca13239ee2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.500112 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cf67b8ea-17a0-42e7-98ae-7b89f9f1e8e2 req-d20154aa-27a8-4feb-8838-e5d773706654 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072582 Nov 27 20:55:49.501339 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1543/3238] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:49.504984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a0c0f10d-1516-4f6c-ab4c-10c686746b50 req-b3ceb754-559c-4aa9-bfca-ebca13239ee2 service nova] Creating event network-vif-deleted:f582af39-1252-42ce-a0f7-29c2ea84cba2 for instance 322cb011-f54a-4dd9-92b9-6c9478c4333c on nch1-master-1 Nov 27 20:55:49.506530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:49.507644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:49.515713 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a0c0f10d-1516-4f6c-ab4c-10c686746b50 req-b3ceb754-559c-4aa9-bfca-ebca13239ee2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057424 Nov 27 20:55:49.516841 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1696/3239] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:49.519681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.520134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.520929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.521370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.523010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb0b756a-39d8-45da-806a-0eb2442db7fa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:49.524212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fb0b756a-39d8-45da-806a-0eb2442db7fa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:49.531233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb0b756a-39d8-45da-806a-0eb2442db7fa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.531928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb0b756a-39d8-45da-806a-0eb2442db7fa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.532905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb0b756a-39d8-45da-806a-0eb2442db7fa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.533496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb0b756a-39d8-45da-806a-0eb2442db7fa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.583886 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fb0b756a-39d8-45da-806a-0eb2442db7fa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.065451 Nov 27 20:55:49.584538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1697/3240] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:49 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:49.593938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:49.594613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:49.609087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.609548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.610353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.610797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.880462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:49.897383 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf1249f5-905a-4092-a612-22103dc810cf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1307 microversion: 2.1 time: 0.394647 Nov 27 20:55:49.899088 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1544/3241] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:49 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1307 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:49.905519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-35ad0c1c-5569-4d83-8bfa-943e559f0a59 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:49.906669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-35ad0c1c-5569-4d83-8bfa-943e559f0a59 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:49.914099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35ad0c1c-5569-4d83-8bfa-943e559f0a59 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.914545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35ad0c1c-5569-4d83-8bfa-943e559f0a59 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.915459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35ad0c1c-5569-4d83-8bfa-943e559f0a59 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:49.915892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35ad0c1c-5569-4d83-8bfa-943e559f0a59 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:49.980218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-35ad0c1c-5569-4d83-8bfa-943e559f0a59 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.079018 Nov 27 20:55:49.981060 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1545/3242] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:49 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:49.987632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:49.988689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] [instance: 322cb011-f54a-4dd9-92b9-6c9478c4333c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:49.999594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.000285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:50.001143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.001773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:50.019884 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] HTTP exception thrown: Instance 322cb011-f54a-4dd9-92b9-6c9478c4333c could not be found. Nov 27 20:55:50.020924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Returning 404 to user: Instance 322cb011-f54a-4dd9-92b9-6c9478c4333c could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:50.022221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40b6331f-d744-4976-a90f-47416aea5cb5 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c" status: 404 len: 111 microversion: 2.1 time: 0.039553 Nov 27 20:55:50.026086 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1546/3243] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:49 2021] GET /compute/v2.1/servers/322cb011-f54a-4dd9-92b9-6c9478c4333c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:50.032550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a192acfc-9300-4855-aff0-6c4a64f3897c tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15c7a25b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:50.045548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:50.054373 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-261ef3a0-c1ff-4be3-9a8f-09a784f18c55 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1325 microversion: 2.1 time: 0.468026 Nov 27 20:55:50.055222 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1698/3244] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:49 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1325 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:50.426622 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a192acfc-9300-4855-aff0-6c4a64f3897c tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/images/20c659a5-a89c-4221-a1ed-bb8ffe0d42b0" status: 204 len: 0 microversion: 2.1 time: 0.398274 Nov 27 20:55:50.427065 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1547/3245] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:50 2021] DELETE /compute/v2.1/images/20c659a5-a89c-4221-a1ed-bb8ffe0d42b0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:50.436691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e91143b2-7f17-429e-a801-07a143d0d8cf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93f28b0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:50.441496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:50.442905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:50.458915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.459651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:50.461641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.462250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:50.774507 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e91143b2-7f17-429e-a801-07a143d0d8cf tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/images/7b523a8b-ff1f-4f5e-a7a7-43940bfb0d20" status: 204 len: 0 microversion: 2.1 time: 0.342827 Nov 27 20:55:50.775509 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1699/3246] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:50 2021] DELETE /compute/v2.1/images/7b523a8b-ff1f-4f5e-a7a7-43940bfb0d20 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 20:55:50.782076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:50.782896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:50.800409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.801412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:50.802459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.802989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:50.960576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:50.969223 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e63051fc-6a72-4021-bc3d-f97885ca2896 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1324 microversion: 2.1 time: 0.532746 Nov 27 20:55:50.969722 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1548/3247] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:50 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1324 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:50.982429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11b3481d-7ceb-4552-aa2a-7ec85e752a93 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:50.983873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11b3481d-7ceb-4552-aa2a-7ec85e752a93 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:50.992729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b3481d-7ceb-4552-aa2a-7ec85e752a93 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.993409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b3481d-7ceb-4552-aa2a-7ec85e752a93 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:50.994553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b3481d-7ceb-4552-aa2a-7ec85e752a93 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:50.995413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b3481d-7ceb-4552-aa2a-7ec85e752a93 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.043388 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11b3481d-7ceb-4552-aa2a-7ec85e752a93 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.071660 Nov 27 20:55:51.044307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1549/3248] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:50 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:51.049768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6afd16e2-50ec-4a24-af42-21651a504f08 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] Calling method '.version_select at 0x7f15d93f3af0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:51.164236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:51.174365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:51.176578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:51.178101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae942201-b8f0-4832-8455-8a85b4f81532 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.400752 Nov 27 20:55:51.190664 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1700/3249] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:50 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:51.200651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:51.201996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:51.225586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.227020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.228838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.229598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.327149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6afd16e2-50ec-4a24-af42-21651a504f08 tempest-ListImageFiltersTestJSON-812191923 tempest-ListImageFiltersTestJSON-812191923-project] 10.222.0.21 "DELETE /compute/v2.1/images/31d59e6d-691b-4a65-bf6f-2861de9545e2" status: 204 len: 0 microversion: 2.1 time: 0.281131 Nov 27 20:55:51.327823 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1550/3250] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:51 2021] DELETE /compute/v2.1/images/31d59e6d-691b-4a65-bf6f-2861de9545e2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:51.333555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c02c592e-9fec-4bc7-aa0c-741b8287875d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:51.335431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c02c592e-9fec-4bc7-aa0c-741b8287875d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:51.342845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02c592e-9fec-4bc7-aa0c-741b8287875d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.343349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02c592e-9fec-4bc7-aa0c-741b8287875d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.344878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02c592e-9fec-4bc7-aa0c-741b8287875d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.345108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02c592e-9fec-4bc7-aa0c-741b8287875d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.401752 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c02c592e-9fec-4bc7-aa0c-741b8287875d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.072246 Nov 27 20:55:51.404549 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1551/3251] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:51 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:51.413202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:51.415494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:51.429531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.430216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.431053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.431538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.575895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:51.583491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bd5927b8-5e93-4cfd-b748-711ce6443af2 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1485 microversion: 2.1 time: 0.391421 Nov 27 20:55:51.584602 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1701/3252] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:51 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1485 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:51.595062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4d0335b9-1f11-483e-9948-68673411c042 req-937852be-966b-48cb-9784-05156967590a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40684d33-20dc-4dc9-b3c3-6c4019dedbd8", "tag": "0beb2599-3d1f-4410-abcb-ee75ba24eb98"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:51.596880 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:51.596880 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:51.604943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4d0335b9-1f11-483e-9948-68673411c042 req-937852be-966b-48cb-9784-05156967590a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.605574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4d0335b9-1f11-483e-9948-68673411c042 req-937852be-966b-48cb-9784-05156967590a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.617663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4d0335b9-1f11-483e-9948-68673411c042 req-937852be-966b-48cb-9784-05156967590a service nova] Creating event network-changed:0beb2599-3d1f-4410-abcb-ee75ba24eb98 for instance 40684d33-20dc-4dc9-b3c3-6c4019dedbd8 on nch1-master-1 Nov 27 20:55:51.623831 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4d0335b9-1f11-483e-9948-68673411c042 req-937852be-966b-48cb-9784-05156967590a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037846 Nov 27 20:55:51.624676 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1702/3253] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:51.631130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-442467a3-559d-40b9-975f-34398d22dc0f req-0f0dc6dd-5772-42b3-aeb9-987cbca83950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "14f3487c-a918-45af-a334-40c24460e19d"}, {"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:51.633394 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:51.633394 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:51.642167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-442467a3-559d-40b9-975f-34398d22dc0f req-0f0dc6dd-5772-42b3-aeb9-987cbca83950 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.642959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-442467a3-559d-40b9-975f-34398d22dc0f req-0f0dc6dd-5772-42b3-aeb9-987cbca83950 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.657508 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-442467a3-559d-40b9-975f-34398d22dc0f req-0f0dc6dd-5772-42b3-aeb9-987cbca83950 service nova] Creating event network-changed:14f3487c-a918-45af-a334-40c24460e19d for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:55:51.658435 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-442467a3-559d-40b9-975f-34398d22dc0f req-0f0dc6dd-5772-42b3-aeb9-987cbca83950 service nova] Creating event network-changed:4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:55:51.663851 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-442467a3-559d-40b9-975f-34398d22dc0f req-0f0dc6dd-5772-42b3-aeb9-987cbca83950 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037534 Nov 27 20:55:51.665059 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1703/3254] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:51 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:51.672096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ffea2c3b-df07-477b-9411-f99bd80d0cbd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1846815286"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:51.673827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ffea2c3b-df07-477b-9411-f99bd80d0cbd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:51.680690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffea2c3b-df07-477b-9411-f99bd80d0cbd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.681618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffea2c3b-df07-477b-9411-f99bd80d0cbd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.682573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffea2c3b-df07-477b-9411-f99bd80d0cbd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.683610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffea2c3b-df07-477b-9411-f99bd80d0cbd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.716440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:51.735808 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9a87bdb-1c41-4cef-927a-2f17304de237 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1325 microversion: 2.1 time: 0.318436 Nov 27 20:55:51.745704 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1552/3255] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:51 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:51.986686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:51.987484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:51.997340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.997953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:51.999069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:51.999550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.055326 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ffea2c3b-df07-477b-9411-f99bd80d0cbd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "POST /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.388491 Nov 27 20:55:52.056504 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1704/3256] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:51 2021] POST /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 20:55:52.062632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ae45e29e-bae7-428b-8b2c-5db849cc93b4 req-0696654f-cc93-4c5e-aedb-5d49653e064d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7389137a-6f45-4998-8ce7-20aa8f6cb2cf", "name": "network-vif-plugged", "status": "completed", "tag": "2eb52b34-d84f-4b6a-9cef-edda1f2ba852"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:52.064606 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:52.064606 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:52.073576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ae45e29e-bae7-428b-8b2c-5db849cc93b4 req-0696654f-cc93-4c5e-aedb-5d49653e064d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.075080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ae45e29e-bae7-428b-8b2c-5db849cc93b4 req-0696654f-cc93-4c5e-aedb-5d49653e064d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.105438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ae45e29e-bae7-428b-8b2c-5db849cc93b4 req-0696654f-cc93-4c5e-aedb-5d49653e064d service nova] Creating event network-vif-plugged:2eb52b34-d84f-4b6a-9cef-edda1f2ba852 for instance 7389137a-6f45-4998-8ce7-20aa8f6cb2cf on nch2-master-1 Nov 27 20:55:52.116186 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ae45e29e-bae7-428b-8b2c-5db849cc93b4 req-0696654f-cc93-4c5e-aedb-5d49653e064d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056082 Nov 27 20:55:52.117218 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1705/3257] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:52.134181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6d88c74-e5d2-4e22-95f1-e0e33d97f2cb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:52.135458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6d88c74-e5d2-4e22-95f1-e0e33d97f2cb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:52.150762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d88c74-e5d2-4e22-95f1-e0e33d97f2cb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.151986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d88c74-e5d2-4e22-95f1-e0e33d97f2cb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.153142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d88c74-e5d2-4e22-95f1-e0e33d97f2cb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.153889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d88c74-e5d2-4e22-95f1-e0e33d97f2cb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.213261 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6d88c74-e5d2-4e22-95f1-e0e33d97f2cb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.093197 Nov 27 20:55:52.214990 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1706/3258] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:52 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:52.220586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5994eee-2d07-43f6-89ab-3ab3eaed1726 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d93a10d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:52.295866 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5994eee-2d07-43f6-89ab-3ab3eaed1726 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f" status: 200 len: 1412 microversion: 2.1 time: 0.079448 Nov 27 20:55:52.296449 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1707/3259] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:52 2021] GET /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:52.308188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:52.308971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:52.316558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.317222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.318101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.318545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.647572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:52.656842 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f50b9a5-486f-4761-8be2-0c2c80fe79f4 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1324 microversion: 2.1 time: 0.674108 Nov 27 20:55:52.667920 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1553/3260] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:51 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:52.673997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f7aa0525-0e2c-4fa0-b577-491c60d9a373 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d92fa280>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:52.737085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f7aa0525-0e2c-4fa0-b577-491c60d9a373 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f" status: 200 len: 1412 microversion: 2.1 time: 0.067671 Nov 27 20:55:52.737930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1554/3261] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:52 2021] GET /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:52.743440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e2f4ba1-ed71-4849-809f-ca8a4771a0f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:52.745398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e2f4ba1-ed71-4849-809f-ca8a4771a0f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:52.762344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e2f4ba1-ed71-4849-809f-ca8a4771a0f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.762819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e2f4ba1-ed71-4849-809f-ca8a4771a0f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.763704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e2f4ba1-ed71-4849-809f-ca8a4771a0f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.764619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e2f4ba1-ed71-4849-809f-ca8a4771a0f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.808253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:52.821318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:52.825867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:52.826856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e2f4ba1-ed71-4849-809f-ca8a4771a0f1 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.087030 Nov 27 20:55:52.827659 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b2f8749-2a52-447e-8ee3-8174d700ecb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.528054 Nov 27 20:55:52.828958 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1555/3262] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:52 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:52.840679 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1708/3263] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:52 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:52.846255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:52.847048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:52.849422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05648d55-56f2-4dfb-ae17-400eda8aee91 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d93a85e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:52.856343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.857003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:52.858079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:52.859352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.106780 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05648d55-56f2-4dfb-ae17-400eda8aee91 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f" status: 204 len: 0 microversion: 2.1 time: 0.276149 Nov 27 20:55:53.107878 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1556/3264] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:52 2021] DELETE /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:53.115246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-df41ef76-2e34-47ce-922a-fb60d77133fb tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d933f3a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:53.204908 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-df41ef76-2e34-47ce-922a-fb60d77133fb tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Image not found. Nov 27 20:55:53.206065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-df41ef76-2e34-47ce-922a-fb60d77133fb tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:53.207167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-df41ef76-2e34-47ce-922a-fb60d77133fb tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f" status: 404 len: 62 microversion: 2.1 time: 0.095546 Nov 27 20:55:53.208304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1557/3265] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:53 2021] GET /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 27 20:55:53.217126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:53.225139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:53.251026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.251858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.252898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.253904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.374231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:53.389006 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4bec9b37-63b8-4520-ae2a-7b3e930d311b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1325 microversion: 2.1 time: 0.546884 Nov 27 20:55:53.393206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1709/3266] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:52 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:53.406164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a5d17c3-62cf-48ba-b2a8-a658d215dcaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:53.407173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a5d17c3-62cf-48ba-b2a8-a658d215dcaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:53.424395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5d17c3-62cf-48ba-b2a8-a658d215dcaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.425232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5d17c3-62cf-48ba-b2a8-a658d215dcaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.426055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5d17c3-62cf-48ba-b2a8-a658d215dcaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.426501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5d17c3-62cf-48ba-b2a8-a658d215dcaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.487964 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a5d17c3-62cf-48ba-b2a8-a658d215dcaa tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.091632 Nov 27 20:55:53.488626 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1710/3267] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:53 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:53.674769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:53.675788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:53.687975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.691474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.692613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.693777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.745689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:53.769996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7516f76c-5fe4-49e4-9410-2d9d443c892f tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1503 microversion: 2.1 time: 0.556542 Nov 27 20:55:53.771805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1558/3268] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:53 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:53.779782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-da143284-abfc-40e5-89ce-96a411d50b64 req-ca4e89b4-ded6-414c-a8cd-f503e84445c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "41f728b6-b85b-4f6c-b3a2-991cfa305959"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:53.781548 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:53.781548 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:53.789946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-da143284-abfc-40e5-89ce-96a411d50b64 req-ca4e89b4-ded6-414c-a8cd-f503e84445c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.790640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-da143284-abfc-40e5-89ce-96a411d50b64 req-ca4e89b4-ded6-414c-a8cd-f503e84445c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.803016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-da143284-abfc-40e5-89ce-96a411d50b64 req-ca4e89b4-ded6-414c-a8cd-f503e84445c3 service nova] Creating event network-changed:41f728b6-b85b-4f6c-b3a2-991cfa305959 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:55:53.810355 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-da143284-abfc-40e5-89ce-96a411d50b64 req-ca4e89b4-ded6-414c-a8cd-f503e84445c3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036854 Nov 27 20:55:53.811695 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1559/3269] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:53.841979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da1b03be-0517-445a-9bb0-69b450784918 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:53.843363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da1b03be-0517-445a-9bb0-69b450784918 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:53.850391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1b03be-0517-445a-9bb0-69b450784918 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.851112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1b03be-0517-445a-9bb0-69b450784918 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.852195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1b03be-0517-445a-9bb0-69b450784918 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.852760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1b03be-0517-445a-9bb0-69b450784918 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.898934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da1b03be-0517-445a-9bb0-69b450784918 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.061586 Nov 27 20:55:53.900444 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1560/3270] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:53 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:53.907867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:53.909027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:53.918907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.919773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:53.921991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:53.922650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:54.191022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:54.203954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:54.205847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:54.207082 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3da00236-e907-4f38-bbe0-3f1354aeafdc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.304402 Nov 27 20:55:54.207818 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1561/3271] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:53 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:54.229830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:54.237768 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65b3fb9a-2632-4964-a1ed-183efeef5576 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1324 microversion: 2.1 time: 0.567403 Nov 27 20:55:54.238712 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1711/3272] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:53 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:54.409922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:54.410733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:54.441108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:54.441838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:54.443034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:54.443642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:54.500540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3ee4c768-15c3-45c2-88d7-c2cd161078db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:54.502210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3ee4c768-15c3-45c2-88d7-c2cd161078db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:54.510196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ee4c768-15c3-45c2-88d7-c2cd161078db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:54.514130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ee4c768-15c3-45c2-88d7-c2cd161078db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:54.515204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ee4c768-15c3-45c2-88d7-c2cd161078db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:54.515980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ee4c768-15c3-45c2-88d7-c2cd161078db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:54.565230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3ee4c768-15c3-45c2-88d7-c2cd161078db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.068170 Nov 27 20:55:54.566319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1712/3273] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:54 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:54.789339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:54.790287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:54.798255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:54.798712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:54.799548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:54.799988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.137741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:55.147812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2864e4d6-437a-482b-8751-9daca1f2e8be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1522 microversion: 2.1 time: 0.741571 Nov 27 20:55:55.150645 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1562/3274] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:54 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1522 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:55.156297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a56a1675-f7b6-4a9a-b419-0d5ee657004f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:55.163201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a56a1675-f7b6-4a9a-b419-0d5ee657004f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:55.181054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a56a1675-f7b6-4a9a-b419-0d5ee657004f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.181906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a56a1675-f7b6-4a9a-b419-0d5ee657004f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.183775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a56a1675-f7b6-4a9a-b419-0d5ee657004f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.184497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a56a1675-f7b6-4a9a-b419-0d5ee657004f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.236866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a56a1675-f7b6-4a9a-b419-0d5ee657004f tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.084267 Nov 27 20:55:55.241831 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1563/3275] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:55 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:55.244492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:55.245642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:55.248450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:55.259076 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15a2382a-d096-4f2f-933a-fc86613bd193 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1503 microversion: 2.1 time: 0.473687 Nov 27 20:55:55.261448 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1713/3276] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:54 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1503 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:55.267894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:55.268858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:55.269184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.269647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.270459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.270886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.277743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.278718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.279855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.280740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.319740 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] HTTP exception thrown: Instance is not a member of specified network Nov 27 20:55:55.320589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Returning 404 to user: Instance is not a member of specified network {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:55.321879 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bbe33512-27e4-4608-bc63-1c22f0e316be tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.082864 Nov 27 20:55:55.322639 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1564/3277] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:55:55 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf/ips/invalid => generated 91 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:55:55.326889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:55.327618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:55.334177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.334839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.335944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.336535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.606956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:55.617860 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e210d15-d8fc-4a7a-9ade-dd66d5a89bcb tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1324 microversion: 2.1 time: 0.294251 Nov 27 20:55:55.627863 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1565/3278] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:55 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:55.627863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40705f6d-ca51-416d-bad0-464c3218edf0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:55.627863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40705f6d-ca51-416d-bad0-464c3218edf0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Failed to fetch instance by id 999 {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 27 20:55:55.627863 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-40705f6d-ca51-416d-bad0-464c3218edf0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] HTTP exception thrown: Instance 999 could not be found. Nov 27 20:55:55.627863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40705f6d-ca51-416d-bad0-464c3218edf0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Returning 404 to user: Instance 999 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:55.629646 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40705f6d-ca51-416d-bad0-464c3218edf0 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009666 Nov 27 20:55:55.634087 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1566/3279] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:55:55 2021] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:55:55.640002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-65d23579-f93c-419e-ba68-06dd882129a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:55.640687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-65d23579-f93c-419e-ba68-06dd882129a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:55.649863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65d23579-f93c-419e-ba68-06dd882129a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.650316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65d23579-f93c-419e-ba68-06dd882129a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.651649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65d23579-f93c-419e-ba68-06dd882129a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.652102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65d23579-f93c-419e-ba68-06dd882129a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.663244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:55.683221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:55.684760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:55.685937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19a51dd2-e3c5-4618-bc28-fdd8b7d5669d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.423303 Nov 27 20:55:55.686509 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1714/3280] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:55 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:55.691728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:55.692249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:55.702114 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-65d23579-f93c-419e-ba68-06dd882129a0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.065955 Nov 27 20:55:55.706627 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1567/3281] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:55 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:55.710720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.711145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.712127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.712837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.752708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:55.829871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-10074e92-8929-4cd3-b217-dca028ae55b1 req-6c8d0a97-a91a-4889-9ed6-5b2d17d2140b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "80f6d4bb-15fa-48bb-b344-9306a5390104"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:55.831663 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:55.831663 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:55:55.843535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-10074e92-8929-4cd3-b217-dca028ae55b1 req-6c8d0a97-a91a-4889-9ed6-5b2d17d2140b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.844002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-10074e92-8929-4cd3-b217-dca028ae55b1 req-6c8d0a97-a91a-4889-9ed6-5b2d17d2140b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.860339 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-10074e92-8929-4cd3-b217-dca028ae55b1 req-6c8d0a97-a91a-4889-9ed6-5b2d17d2140b service nova] Creating event network-changed:80f6d4bb-15fa-48bb-b344-9306a5390104 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:55:55.867080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-10074e92-8929-4cd3-b217-dca028ae55b1 req-6c8d0a97-a91a-4889-9ed6-5b2d17d2140b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043182 Nov 27 20:55:55.868286 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1568/3282] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:55.884735 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98f105e3-f742-4c50-87d4-cfe99fc929f2 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 204 len: 0 microversion: 2.1 time: 0.196545 Nov 27 20:55:55.886252 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1715/3283] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:55 2021] DELETE /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:55.895059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:55.899702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:55.911634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.912203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:55.912999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:55.913440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.143613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:56.152180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9bfb6e9d-0981-439e-acb1-58a4e0fa4b6b tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1528 microversion: 2.1 time: 0.261748 Nov 27 20:55:56.152767 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1569/3284] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:55 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1528 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:56.249445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-792781a5-4bc7-4cfd-921e-0ad53fa76e0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:56.250735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-792781a5-4bc7-4cfd-921e-0ad53fa76e0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:56.256655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-792781a5-4bc7-4cfd-921e-0ad53fa76e0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.257331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-792781a5-4bc7-4cfd-921e-0ad53fa76e0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.258274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-792781a5-4bc7-4cfd-921e-0ad53fa76e0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.259227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-792781a5-4bc7-4cfd-921e-0ad53fa76e0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.278835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:56.280060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:56.291297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.292349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.293155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.293596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.335425 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-792781a5-4bc7-4cfd-921e-0ad53fa76e0d tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.088815 Nov 27 20:55:56.340954 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1716/3285] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:56 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:56.519764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf1d1328-a252-47ba-ab82-73eea4d4f308 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d93f2e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-577575807", "description": "tempest-description-213603016"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:56.661943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:56.674877 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d9a659f-1575-46e5-960e-dde3be194c84 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1485 microversion: 2.1 time: 0.400590 Nov 27 20:55:56.676839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1570/3286] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:56 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1485 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:56.686747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:56.688934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:56.724497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.726565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.727963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.731198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.919510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf1d1328-a252-47ba-ab82-73eea4d4f308 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.575635 Nov 27 20:55:56.920331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1717/3287] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:55:56 2021] POST /compute/v2.1/os-security-groups => generated 246 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:56.925162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:56.926133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:56.942641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.943610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:56.944610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:56.945236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.001625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:57.144631 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6888faae-91e0-4071-9690-2f0e94820292 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 204 len: 0 microversion: 2.1 time: 0.222639 Nov 27 20:55:57.150291 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1718/3288] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:56 2021] DELETE /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:57.156214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:57.158384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:57.172221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.172814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.173537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.173979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.233149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:57.246721 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7a32bda5-51b5-48a5-9711-525d605512d5 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1324 microversion: 2.1 time: 0.565561 Nov 27 20:55:57.258244 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1571/3289] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:56 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:57.281164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b4019067-b62b-4026-b7c8-90a6fa286e48 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:57.285711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b4019067-b62b-4026-b7c8-90a6fa286e48 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:57.314074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4019067-b62b-4026-b7c8-90a6fa286e48 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.322711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4019067-b62b-4026-b7c8-90a6fa286e48 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.326148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4019067-b62b-4026-b7c8-90a6fa286e48 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.332736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4019067-b62b-4026-b7c8-90a6fa286e48 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.409432 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b4019067-b62b-4026-b7c8-90a6fa286e48 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.145739 Nov 27 20:55:57.411435 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1572/3290] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:57 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:57.418022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47140664-5ae9-4296-b86f-9658758c1b26 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d9353790>, body: {"security_group_rule": {"parent_group_id": "b7ea6e21-4e12-48bf-9bd5-8e08d3687b86", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:57.520580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:57.530861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:57.533280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:57.534455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3891c327-7da9-4291-99a7-e10dc632a704 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.387201 Nov 27 20:55:57.535015 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1719/3291] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:57 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:57.614519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4a82982d-bd96-4ee3-8e2c-fdb047dbab55 req-70aa4285-0482-4e69-a49d-c0206acc02c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40684d33-20dc-4dc9-b3c3-6c4019dedbd8", "name": "network-vif-plugged", "status": "completed", "tag": "0beb2599-3d1f-4410-abcb-ee75ba24eb98"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:57.616124 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:57.616124 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:57.624127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4a82982d-bd96-4ee3-8e2c-fdb047dbab55 req-70aa4285-0482-4e69-a49d-c0206acc02c9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.624568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4a82982d-bd96-4ee3-8e2c-fdb047dbab55 req-70aa4285-0482-4e69-a49d-c0206acc02c9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.636205 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4a82982d-bd96-4ee3-8e2c-fdb047dbab55 req-70aa4285-0482-4e69-a49d-c0206acc02c9 service nova] Creating event network-vif-plugged:0beb2599-3d1f-4410-abcb-ee75ba24eb98 for instance 40684d33-20dc-4dc9-b3c3-6c4019dedbd8 on nch1-master-1 Nov 27 20:55:57.641101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4a82982d-bd96-4ee3-8e2c-fdb047dbab55 req-70aa4285-0482-4e69-a49d-c0206acc02c9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104735 Nov 27 20:55:57.642300 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1720/3292] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:57.648364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a12fb46f-5c93-48b2-b213-dee7044bbca5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d9476700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:57.688129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a12fb46f-5c93-48b2-b213-dee7044bbca5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Image not found. Nov 27 20:55:57.689059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a12fb46f-5c93-48b2-b213-dee7044bbca5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Image not found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:57.690010 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a12fb46f-5c93-48b2-b213-dee7044bbca5 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f" status: 404 len: 62 microversion: 2.1 time: 0.046377 Nov 27 20:55:57.695947 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1721/3293] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:57 2021] DELETE /compute/v2.1/images/ed8cbe57-3b7d-4eb7-a7dc-00b286d2c21f => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:55:57.703519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:57.707040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:57.714992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.715473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.716284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.716721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.895568 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47140664-5ae9-4296-b86f-9658758c1b26 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.482510 Nov 27 20:55:57.896175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1573/3294] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:55:57 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:57.906917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e61f20a6-f8da-4b5d-8cd2-51ec608de1e9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:57.907993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e61f20a6-f8da-4b5d-8cd2-51ec608de1e9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:57.916220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f20a6-f8da-4b5d-8cd2-51ec608de1e9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.917685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f20a6-f8da-4b5d-8cd2-51ec608de1e9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.919402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f20a6-f8da-4b5d-8cd2-51ec608de1e9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:57.920176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e61f20a6-f8da-4b5d-8cd2-51ec608de1e9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:57.978456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e61f20a6-f8da-4b5d-8cd2-51ec608de1e9 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.080105 Nov 27 20:55:57.980058 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1574/3295] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:57 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:57.987065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:57.987944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:57.999718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.000227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.001156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.001898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.030313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:55:58.089682 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Instance is already in deleting state, ignoring this request Nov 27 20:55:58.090827 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8fb8b12b-b12d-4827-b34c-6f1efe9e0bfa tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 204 len: 0 microversion: 2.1 time: 0.109757 Nov 27 20:55:58.091801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1575/3296] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:55:57 2021] DELETE /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:58.092518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e06f88a7a941909e40b105d2f30310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7895e84a65ed41808aae6e8f05780bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:58.095885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0aecbc99-986a-4916-81e3-44c85b6a8dec tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d930d280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1383400821", "description": "tempest-description-535013133"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:58.109367 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3b16b62-38e6-449c-9446-e6daf5c7c2e1 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 200 len: 1528 microversion: 2.1 time: 0.412041 Nov 27 20:55:58.110623 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1722/3297] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:57 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 1528 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:58.122382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:58.123104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:58.130153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.131001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.131960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.132474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.444754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:58.468015 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0aecbc99-986a-4916-81e3-44c85b6a8dec tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.375233 Nov 27 20:55:58.468790 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1576/3298] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:55:58 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:58.491197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:58.495880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:58.499438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0618a3bf-b7e7-46a1-ac0a-452067e9bb08 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1491 microversion: 2.1 time: 0.386630 Nov 27 20:55:58.504867 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1723/3299] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:58 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1491 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:58.529930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a8c208c-adf0-49e6-9ebb-f0082d5518c6 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:58.561659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.562013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.563096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a8c208c-adf0-49e6-9ebb-f0082d5518c6 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:58.566192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.567654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.584114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a8c208c-adf0-49e6-9ebb-f0082d5518c6 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.584559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a8c208c-adf0-49e6-9ebb-f0082d5518c6 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.587588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a8c208c-adf0-49e6-9ebb-f0082d5518c6 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.587588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a8c208c-adf0-49e6-9ebb-f0082d5518c6 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.663836 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a8c208c-adf0-49e6-9ebb-f0082d5518c6 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.153546 Nov 27 20:55:58.667896 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1724/3300] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:58 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:58.677568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-782ee20a-1211-42d5-b54c-51c4f657d087 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d94765e0>, body: {"security_group_rule": {"parent_group_id": "13d78fa9-427d-4b6e-aac3-f4e1637d9e34", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:58.835312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:58.844340 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8834e91a-85d4-4f55-9d1e-a8fb1966ca2f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1324 microversion: 2.1 time: 0.374116 Nov 27 20:55:58.845548 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1577/3301] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:58 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:55:58.851962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:58.853100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:58.884226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.886316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:58.887558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:58.888338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.146556 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-782ee20a-1211-42d5-b54c-51c4f657d087 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.480797 Nov 27 20:55:59.147166 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1725/3302] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:55:58 2021] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:59.151737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-36bb3998-fb96-43e6-ad33-dfb32c74b01d req-e7424220-066a-4dac-a130-7230fad31f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7389137a-6f45-4998-8ce7-20aa8f6cb2cf", "name": "network-vif-deleted", "tag": "2eb52b34-d84f-4b6a-9cef-edda1f2ba852"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:59.153421 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:59.153421 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:59.169767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-36bb3998-fb96-43e6-ad33-dfb32c74b01d req-e7424220-066a-4dac-a130-7230fad31f7d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.170234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-36bb3998-fb96-43e6-ad33-dfb32c74b01d req-e7424220-066a-4dac-a130-7230fad31f7d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.180493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:59.190275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:59.191805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:59.192927 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-275fc41c-3282-46e7-97f9-cda725ba1f38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.346169 Nov 27 20:55:59.206356 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1578/3303] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:55:58 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:55:59.211388 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-36bb3998-fb96-43e6-ad33-dfb32c74b01d req-e7424220-066a-4dac-a130-7230fad31f7d service nova] Creating event network-vif-deleted:2eb52b34-d84f-4b6a-9cef-edda1f2ba852 for instance 7389137a-6f45-4998-8ce7-20aa8f6cb2cf on nch2-master-1 Nov 27 20:55:59.218770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b903d2f8-4060-4bfb-8d00-5167daef0abf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:59.227987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b903d2f8-4060-4bfb-8d00-5167daef0abf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:59.229018 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-36bb3998-fb96-43e6-ad33-dfb32c74b01d req-e7424220-066a-4dac-a130-7230fad31f7d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078388 Nov 27 20:55:59.231514 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1726/3304] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:59.242057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:59.243235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b903d2f8-4060-4bfb-8d00-5167daef0abf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.243899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b903d2f8-4060-4bfb-8d00-5167daef0abf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.245317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] [instance: 7389137a-6f45-4998-8ce7-20aa8f6cb2cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:59.246612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b903d2f8-4060-4bfb-8d00-5167daef0abf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.249001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b903d2f8-4060-4bfb-8d00-5167daef0abf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.268921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.269386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.270207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.270676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.286189 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] HTTP exception thrown: Instance 7389137a-6f45-4998-8ce7-20aa8f6cb2cf could not be found. Nov 27 20:55:59.286845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] Returning 404 to user: Instance 7389137a-6f45-4998-8ce7-20aa8f6cb2cf could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:55:59.287770 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17517fd0-1149-4d6d-8d04-ff865621cd69 tempest-ServerAddressesNegativeTestJSON-1354357772 tempest-ServerAddressesNegativeTestJSON-1354357772-project] 10.222.0.21 "GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf" status: 404 len: 111 microversion: 2.1 time: 0.054757 Nov 27 20:55:59.291333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1727/3305] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:59 2021] GET /compute/v2.1/servers/7389137a-6f45-4998-8ce7-20aa8f6cb2cf => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:59.293590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7db73139-e807-448c-b597-46e5254f9570 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d945d790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-42659008", "description": "tempest-description-961090641"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:59.309140 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b903d2f8-4060-4bfb-8d00-5167daef0abf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.099432 Nov 27 20:55:59.314255 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1579/3306] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:59 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:59.523363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:59.524078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:59.534425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.534882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.535741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.536410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.701451 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7db73139-e807-448c-b597-46e5254f9570 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.411676 Nov 27 20:55:59.703102 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1728/3307] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:55:59 2021] POST /compute/v2.1/os-security-groups => generated 245 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:59.713105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-861dfcb7-918d-418c-89d3-d9057b911f5b req-611ce317-2f7c-4646-8a06-99e5adc81e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a37077f-714e-4168-a49e-d6cb8b750ca9", "name": "network-vif-plugged", "status": "completed", "tag": "539b6d03-82a1-46d1-8b03-a0295fadf9c4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:59.718645 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:59.718645 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:55:59.743034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-861dfcb7-918d-418c-89d3-d9057b911f5b req-611ce317-2f7c-4646-8a06-99e5adc81e99 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.744488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-861dfcb7-918d-418c-89d3-d9057b911f5b req-611ce317-2f7c-4646-8a06-99e5adc81e99 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.761348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-861dfcb7-918d-418c-89d3-d9057b911f5b req-611ce317-2f7c-4646-8a06-99e5adc81e99 service nova] Creating event network-vif-plugged:539b6d03-82a1-46d1-8b03-a0295fadf9c4 for instance 0a37077f-714e-4168-a49e-d6cb8b750ca9 on nch1-master-1 Nov 27 20:55:59.768002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-861dfcb7-918d-418c-89d3-d9057b911f5b req-611ce317-2f7c-4646-8a06-99e5adc81e99 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063213 Nov 27 20:55:59.769122 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1729/3308] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:55:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:55:59.780888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5dfce0f8-9a5e-4a8d-b182-d5e51b668020 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:59.782491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5dfce0f8-9a5e-4a8d-b182-d5e51b668020 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:59.789540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dfce0f8-9a5e-4a8d-b182-d5e51b668020 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.790200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dfce0f8-9a5e-4a8d-b182-d5e51b668020 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.791315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dfce0f8-9a5e-4a8d-b182-d5e51b668020 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.791964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dfce0f8-9a5e-4a8d-b182-d5e51b668020 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.838294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a8aa467b0a42459f18f6bd4ee623e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe84ac649b6b4faea051ddfd2d4b6185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:55:59.852533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a45efb76-3813-400d-921e-a7cb6fbed782 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 200 len: 1491 microversion: 2.1 time: 0.334213 Nov 27 20:55:59.853706 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1580/3309] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:59 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 1491 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:59.857347 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5dfce0f8-9a5e-4a8d-b182-d5e51b668020 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.085347 Nov 27 20:55:59.861278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8934e55f-268b-4e9c-b8c5-8dbb33a5ffc4 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d931be50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1758191609", "description": "tempest-description-605867789"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:55:59.864581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1730/3310] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:55:59 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:55:59.877457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:55:59.878194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:55:59.903297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.903779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:55:59.904624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:55:59.905038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:00.184674 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8934e55f-268b-4e9c-b8c5-8dbb33a5ffc4 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.329450 Nov 27 20:56:00.185277 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1581/3311] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:55:59 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:00.191973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-26450491-b7a0-42f9-8fa3-6e6fe392824b req-9c00cd28-032e-4114-badd-b32105e43f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a37077f-714e-4168-a49e-d6cb8b750ca9", "name": "network-vif-deleted", "tag": "539b6d03-82a1-46d1-8b03-a0295fadf9c4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:00.193852 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:00.193852 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:00.212597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-26450491-b7a0-42f9-8fa3-6e6fe392824b req-9c00cd28-032e-4114-badd-b32105e43f66 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:00.213688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-26450491-b7a0-42f9-8fa3-6e6fe392824b req-9c00cd28-032e-4114-badd-b32105e43f66 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:00.228361 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-26450491-b7a0-42f9-8fa3-6e6fe392824b req-9c00cd28-032e-4114-badd-b32105e43f66 service nova] Creating event network-vif-deleted:539b6d03-82a1-46d1-8b03-a0295fadf9c4 for instance 0a37077f-714e-4168-a49e-d6cb8b750ca9 on nch1-master-1 Nov 27 20:56:00.234089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-26450491-b7a0-42f9-8fa3-6e6fe392824b req-9c00cd28-032e-4114-badd-b32105e43f66 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047480 Nov 27 20:56:00.237858 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1582/3312] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:00.242865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e54aa4c8-06c1-487d-a20f-eb1f0bf88de4 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d946fa60>, body: {"security_group_rule": {"parent_group_id": "093ddf4d-f1ee-4e4c-800f-fed84f755fd3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b1c7a662-7eeb-402f-83a5-b8a68f7d3049"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:00.627073 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e54aa4c8-06c1-487d-a20f-eb1f0bf88de4 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.387946 Nov 27 20:56:00.627734 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1583/3313] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:56:00 2021] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:00.648744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:00.649904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:00.651333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:00.667882 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae3f0874-190e-4453-adb7-d5509755641a tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1521 microversion: 2.1 time: 0.798805 Nov 27 20:56:00.668496 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1731/3314] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:55:59 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1521 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:00.685076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:00.686017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:00.686857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:00.687716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:00.690893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c245992-bd21-48cf-b7c0-f2c8999fbda0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:00.692689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c245992-bd21-48cf-b7c0-f2c8999fbda0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:00.699156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c245992-bd21-48cf-b7c0-f2c8999fbda0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:00.699649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c245992-bd21-48cf-b7c0-f2c8999fbda0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:00.700445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c245992-bd21-48cf-b7c0-f2c8999fbda0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:00.700885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c245992-bd21-48cf-b7c0-f2c8999fbda0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:00.759239 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c245992-bd21-48cf-b7c0-f2c8999fbda0 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.089489 Nov 27 20:56:00.760388 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1732/3315] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:00 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:00.769966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fe17a229-a30a-47e8-a993-177b73d855ed tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d94d7280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1010112754", "description": "tempest-description-815808227"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:00.981427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:00.994516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:00.996544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:00.997868 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e275c18-73ba-416b-aaa5-66e6b9e89dc8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.369034 Nov 27 20:56:01.010145 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1584/3316] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:00 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:01.015869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.016785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.023957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.024636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.025733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.026955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.064083 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] HTTP exception thrown: Action 999 not found Nov 27 20:56:01.065028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Returning 404 to user: Action 999 not found {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.066036 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db6f706a-a93a-4f13-a2b8-f49576240b4c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.054539 Nov 27 20:56:01.067118 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1585/3317] 10.222.0.21 () {58 vars in 1307 bytes} [Sat Nov 27 20:56:01 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8/os-instance-actions/999 => generated 66 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:56:01.072900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d08edfa-719e-4573-8918-304e8a2436c1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:01.074281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d08edfa-719e-4573-8918-304e8a2436c1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.081964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d08edfa-719e-4573-8918-304e8a2436c1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.082598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d08edfa-719e-4573-8918-304e8a2436c1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.083621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d08edfa-719e-4573-8918-304e8a2436c1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.084238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d08edfa-719e-4573-8918-304e8a2436c1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.093387 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fe17a229-a30a-47e8-a993-177b73d855ed tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.331765 Nov 27 20:56:01.093989 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1733/3318] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:56:00 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:01.099022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.100280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 0a37077f-714e-4168-a49e-d6cb8b750ca9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.114489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.114772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.116459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.116972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.138216 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d08edfa-719e-4573-8918-304e8a2436c1 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.069200 Nov 27 20:56:01.142867 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1586/3319] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:01 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:01.146339 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Instance 0a37077f-714e-4168-a49e-d6cb8b750ca9 could not be found. Nov 27 20:56:01.147078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Instance 0a37077f-714e-4168-a49e-d6cb8b750ca9 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.148069 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b3d7057-52d3-4a16-97f9-91bf22e1eddf tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9" status: 404 len: 111 microversion: 2.1 time: 0.053013 Nov 27 20:56:01.149016 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1734/3320] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] GET /compute/v2.1/servers/0a37077f-714e-4168-a49e-d6cb8b750ca9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:01.150258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0b1022e-5765-49cb-858d-6acfebf8e0e3 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '.version_select at 0x7f15d93afb80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.151569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0b1022e-5765-49cb-858d-6acfebf8e0e3 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 5df9a737-afce-486c-9c26-d7442b018577] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.158060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-daa5ddae-c908-4619-b4af-fdf49965385c tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d9415f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1555950705", "description": "tempest-description-1571855077"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:01.158587 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e0b1022e-5765-49cb-858d-6acfebf8e0e3 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] HTTP exception thrown: Instance 5df9a737-afce-486c-9c26-d7442b018577 could not be found. Nov 27 20:56:01.159181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0b1022e-5765-49cb-858d-6acfebf8e0e3 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Returning 404 to user: Instance 5df9a737-afce-486c-9c26-d7442b018577 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.160061 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0b1022e-5765-49cb-858d-6acfebf8e0e3 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/5df9a737-afce-486c-9c26-d7442b018577/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015912 Nov 27 20:56:01.166333 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1587/3321] 10.222.0.21 () {58 vars in 1295 bytes} [Sat Nov 27 20:56:01 2021] GET /compute/v2.1/servers/5df9a737-afce-486c-9c26-d7442b018577/os-instance-actions => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:01.171470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ea4a883-ca00-4168-9f70-7c287c8b1d4d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d930d9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.202401 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-9ea4a883-ca00-4168-9f70-7c287c8b1d4d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Image not found. Nov 27 20:56:01.203802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ea4a883-ca00-4168-9f70-7c287c8b1d4d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.205228 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ea4a883-ca00-4168-9f70-7c287c8b1d4d tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462" status: 404 len: 62 microversion: 2.1 time: 0.037801 Nov 27 20:56:01.209224 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1588/3322] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/images/83f3be30-1e5c-402b-995b-44d2a5243462 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:56:01.212678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.213298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.221701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.222251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.223264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.223815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.256217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:56:01.382368 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f439c514-257e-4705-9e31-6d79c87e5bab tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "DELETE /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 204 len: 0 microversion: 2.1 time: 0.172583 Nov 27 20:56:01.384298 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1589/3323] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:01.393367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.394178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.409257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.409925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.412059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.413023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.435004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 could not be found. Nov 27 20:56:01.435954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.436975 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a96ef7b9-aa6b-45a8-8d8c-bd69f94a4765 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 404 len: 111 microversion: 2.1 time: 0.050267 Nov 27 20:56:01.438013 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1590/3324] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:01.443631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.444466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.453265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.453975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.455537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.456230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.500280 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-daa5ddae-c908-4619-b4af-fdf49965385c tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.349958 Nov 27 20:56:01.501142 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1735/3325] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:56:01 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:01.513498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.514647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.545850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.546326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.548219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.548677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.575547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 could not be found. Nov 27 20:56:01.576302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Instance 8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.577147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec0c8a39-cd3e-4aea-bcae-ffcfc564c5cd tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806" status: 404 len: 111 microversion: 2.1 time: 0.068599 Nov 27 20:56:01.578024 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1736/3326] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] GET /compute/v2.1/servers/8911dc7c-bdfd-4fcb-a7a9-65e9c946c806 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:01.582490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1273ff50-9df5-4b04-9bdd-e237c1779fea tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d94830d0>, body: {"security_group_rule": {"parent_group_id": "c6616b2e-bfc4-483a-a479-701c624af572", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bd9b500e-9edc-434d-a8ef-17131f12719c"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:01.653048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:01.661555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64a107b9-c618-45f8-a05d-faace4570e65 tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1527 microversion: 2.1 time: 0.222186 Nov 27 20:56:01.672252 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1591/3327] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1527 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:01.677048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c160d283-0b7b-48f2-be47-9902a8ef715a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d9325430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.702532 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-c160d283-0b7b-48f2-be47-9902a8ef715a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Image not found. Nov 27 20:56:01.703151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c160d283-0b7b-48f2-be47-9902a8ef715a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.704048 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c160d283-0b7b-48f2-be47-9902a8ef715a tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60" status: 404 len: 62 microversion: 2.1 time: 0.030631 Nov 27 20:56:01.707675 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1592/3328] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/images/9cc80872-504d-4930-8f70-7e93e5be6c60 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:56:01.712919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.713462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.730250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.730715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.731549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.731995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.751032 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Instance f7f4e797-745d-4e1d-89ff-105b05e550c0 could not be found. Nov 27 20:56:01.752363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Instance f7f4e797-745d-4e1d-89ff-105b05e550c0 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.753326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23392274-233c-41b8-8397-9ab61a4920a0 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 404 len: 111 microversion: 2.1 time: 0.044505 Nov 27 20:56:01.754212 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1593/3329] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:56:01.771131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.771885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: f7f4e797-745d-4e1d-89ff-105b05e550c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.778322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.778999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.780033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.780703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.799446 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Instance f7f4e797-745d-4e1d-89ff-105b05e550c0 could not be found. Nov 27 20:56:01.800520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Instance f7f4e797-745d-4e1d-89ff-105b05e550c0 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.801992 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5696ed56-c3e3-409c-8e8f-422a827ed1bc tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0" status: 404 len: 111 microversion: 2.1 time: 0.041375 Nov 27 20:56:01.802765 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1594/3330] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] GET /compute/v2.1/servers/f7f4e797-745d-4e1d-89ff-105b05e550c0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:56:01.812253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ccd07f31-da1f-4052-8397-01277a78bb1c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:01.813548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ccd07f31-da1f-4052-8397-01277a78bb1c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.820323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccd07f31-da1f-4052-8397-01277a78bb1c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.821060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccd07f31-da1f-4052-8397-01277a78bb1c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.822266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccd07f31-da1f-4052-8397-01277a78bb1c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.823585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccd07f31-da1f-4052-8397-01277a78bb1c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.874218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ccd07f31-da1f-4052-8397-01277a78bb1c tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.065513 Nov 27 20:56:01.875077 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1595/3331] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:01 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:01.883286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ccf82050-c743-4db9-86ab-e47c4e9a6425 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '.version_select at 0x7f15d9325a60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.908173 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ccf82050-c743-4db9-86ab-e47c4e9a6425 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Image not found. Nov 27 20:56:01.908783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ccf82050-c743-4db9-86ab-e47c4e9a6425 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Image not found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.909654 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ccf82050-c743-4db9-86ab-e47c4e9a6425 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09" status: 404 len: 62 microversion: 2.1 time: 0.033281 Nov 27 20:56:01.910327 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1596/3332] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/images/1da5d64f-173f-4025-98f0-1bde6a70cd09 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:56:01.921755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.922585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.929815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.930626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.931842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.933116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.941376 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1273ff50-9df5-4b04-9bdd-e237c1779fea tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.362236 Nov 27 20:56:01.942155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1737/3333] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:56:01 2021] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:01.951769 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Instance cc5ef299-0115-4cd2-b728-afcd425f78b5 could not be found. Nov 27 20:56:01.952423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Instance cc5ef299-0115-4cd2-b728-afcd425f78b5 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.952569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3ec9140f-00a7-4f34-b189-1aa71ddae478 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d9415ca0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.953165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9f4cac3-3278-47c6-bb93-3b21da822f44 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 404 len: 111 microversion: 2.1 time: 0.037991 Nov 27 20:56:01.953701 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1597/3334] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:56:01.961206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:01.961984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] [instance: cc5ef299-0115-4cd2-b728-afcd425f78b5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:01.968065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.968753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.969681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:01.970262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:01.986223 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] HTTP exception thrown: Instance cc5ef299-0115-4cd2-b728-afcd425f78b5 could not be found. Nov 27 20:56:01.987035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] Returning 404 to user: Instance cc5ef299-0115-4cd2-b728-afcd425f78b5 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:01.987926 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4767483a-648f-468a-a34b-859d2c052cb3 tempest-ImagesTestJSON-126946779 tempest-ImagesTestJSON-126946779-project] 10.222.0.21 "GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5" status: 404 len: 111 microversion: 2.1 time: 0.030226 Nov 27 20:56:01.988649 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1598/3335] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:01 2021] GET /compute/v2.1/servers/cc5ef299-0115-4cd2-b728-afcd425f78b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:56:02.017638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:02.018572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:02.033420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.033917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.035906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.036265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.232144 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3ec9140f-00a7-4f34-b189-1aa71ddae478 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/bd9b500e-9edc-434d-a8ef-17131f12719c" status: 202 len: 0 microversion: 2.1 time: 0.283453 Nov 27 20:56:02.233223 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1738/3336] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:01 2021] DELETE /compute/v2.1/os-security-groups/bd9b500e-9edc-434d-a8ef-17131f12719c => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:02.240469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93064a8a-6df5-498d-82d1-44b96362ef25 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:02.242558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93064a8a-6df5-498d-82d1-44b96362ef25 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:02.252711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93064a8a-6df5-498d-82d1-44b96362ef25 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.253359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93064a8a-6df5-498d-82d1-44b96362ef25 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.254375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93064a8a-6df5-498d-82d1-44b96362ef25 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.268664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93064a8a-6df5-498d-82d1-44b96362ef25 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.328824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-93064a8a-6df5-498d-82d1-44b96362ef25 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.093430 Nov 27 20:56:02.330901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1739/3337] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:02 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:02.344344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0995b240-f898-4231-9db1-3ce5d18cc5da tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d94b0670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:02.414496 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0995b240-f898-4231-9db1-3ce5d18cc5da tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/c6616b2e-bfc4-483a-a479-701c624af572" status: 200 len: 247 microversion: 2.1 time: 0.077334 Nov 27 20:56:02.415371 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1740/3338] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:56:02 2021] GET /compute/v2.1/os-security-groups/c6616b2e-bfc4-483a-a479-701c624af572 => generated 247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:02.436984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2feb6684-4f5c-4ddb-a022-a5d58ae094b7 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d9529e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-440149660", "description": "tempest-description-1213991375"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:02.444252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:02.453614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:02.458322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:02.460160 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33fd1e31-e1aa-481c-b6db-6658309ef112 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.447360 Nov 27 20:56:02.460940 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1599/3339] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:02 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:02.626560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2feb6684-4f5c-4ddb-a022-a5d58ae094b7 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.194126 Nov 27 20:56:02.627161 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1741/3340] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:56:02 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:56:02.641659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97b23d02-3142-4d83-ab27-1c9e2dc90093 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d930da60>, body: {"security_group_rule": {"parent_group_id": "b16f862b-205c-473e-97d8-998cc85b0f64", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:02.678301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:02.679451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:02.688490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.689168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.690299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.690786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.839467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:02.848953 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4566918-2dec-4f1d-83eb-a608596b7ffa tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1527 microversion: 2.1 time: 0.174899 Nov 27 20:56:02.850171 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1742/3341] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:02 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1527 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:02.886413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b1a62ec-27a2-4a81-bf6c-59688480bfef tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:02.887588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5b1a62ec-27a2-4a81-bf6c-59688480bfef tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:02.894338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1a62ec-27a2-4a81-bf6c-59688480bfef tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.894713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1a62ec-27a2-4a81-bf6c-59688480bfef tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.895658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1a62ec-27a2-4a81-bf6c-59688480bfef tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:02.896274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1a62ec-27a2-4a81-bf6c-59688480bfef tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:02.951294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b1a62ec-27a2-4a81-bf6c-59688480bfef tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 32642 microversion: 2.1 time: 0.068778 Nov 27 20:56:02.952546 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1743/3342] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:02 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 32642 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:03.344572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6f715db-67c3-4345-8893-417be56e5d7f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:03.359636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6f715db-67c3-4345-8893-417be56e5d7f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:03.375889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f715db-67c3-4345-8893-417be56e5d7f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:03.376593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f715db-67c3-4345-8893-417be56e5d7f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:03.377551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f715db-67c3-4345-8893-417be56e5d7f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:03.378143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f715db-67c3-4345-8893-417be56e5d7f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:03.465567 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6f715db-67c3-4345-8893-417be56e5d7f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.125216 Nov 27 20:56:03.473187 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1744/3343] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:03 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:03.480394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:03.481201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:03.492870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:03.493978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:03.496033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:03.497249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:03.638459 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97b23d02-3142-4d83-ab27-1c9e2dc90093 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.003897 Nov 27 20:56:03.644300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1600/3344] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:56:02 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:03.648839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e994ab2-fc79-44ed-a469-48828f7bd616 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Action: 'create', calling method: .version_select at 0x7f15d946f3a0>, body: {"security_group_rule": {"parent_group_id": "b16f862b-205c-473e-97d8-998cc85b0f64", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:03.800536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:03.811815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:03.814019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:03.815529 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4dc467dc-1fcf-4c84-ac49-ac96b2c0350d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.339993 Nov 27 20:56:03.827886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1745/3345] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:03 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:03.867049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:03.867713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:03.878418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:03.879262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:03.880476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:03.881267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.193897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da0c98eadc94788b5636567ccdd9927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e284ee0d43044b11b711ede03335cfa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:04.205783 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49fe42f8-34ca-440e-a53a-a4b83124726f tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 200 len: 1527 microversion: 2.1 time: 0.342335 Nov 27 20:56:04.209495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1746/3346] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:03 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 1527 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:04.222467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4e7e94fd-6986-4eef-beda-9724075e6fca tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:04.223771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4e7e94fd-6986-4eef-beda-9724075e6fca tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:04.235130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e7e94fd-6986-4eef-beda-9724075e6fca tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.236490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e7e94fd-6986-4eef-beda-9724075e6fca tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.239409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e7e94fd-6986-4eef-beda-9724075e6fca tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.240202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e7e94fd-6986-4eef-beda-9724075e6fca tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.292507 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e994ab2-fc79-44ed-a469-48828f7bd616 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.645968 Nov 27 20:56:04.296113 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1601/3347] 10.222.0.21 () {60 vars in 1194 bytes} [Sat Nov 27 20:56:03 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:04.306257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87e90cc3-5adb-47d7-a169-6a656178ad82 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d931b8b0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:04.326596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4e7e94fd-6986-4eef-beda-9724075e6fca tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action" status: 200 len: 40794 microversion: 2.1 time: 0.114987 Nov 27 20:56:04.338038 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1747/3348] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:04 2021] POST /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9/action => generated 40794 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:04.429202 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87e90cc3-5adb-47d7-a169-6a656178ad82 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "GET /compute/v2.1/os-security-groups/b16f862b-205c-473e-97d8-998cc85b0f64" status: 200 len: 664 microversion: 2.1 time: 0.126647 Nov 27 20:56:04.429817 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1602/3349] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 20:56:04 2021] GET /compute/v2.1/os-security-groups/b16f862b-205c-473e-97d8-998cc85b0f64 => generated 664 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:04.434569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:04.435188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:04.452066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.452713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.453639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.454457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.611215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:04.620847 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28d6a6a9-339a-4c3b-86ab-e857a638a9ee tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1710 microversion: 2.1 time: 0.190011 Nov 27 20:56:04.621936 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1603/3350] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:04 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1710 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:04.651814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9580d4b8-f5d0-4cf4-ba8d-beb95a3e56c5 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d92caca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:04.680785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a946312e-17f7-47c2-9473-1b16eec4097d req-301cd44f-9dc5-4fcd-9dc3-5432d487ac6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40684d33-20dc-4dc9-b3c3-6c4019dedbd8", "name": "network-vif-deleted", "tag": "0beb2599-3d1f-4410-abcb-ee75ba24eb98"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:04.682866 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:04.682866 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:04.692936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a946312e-17f7-47c2-9473-1b16eec4097d req-301cd44f-9dc5-4fcd-9dc3-5432d487ac6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.694206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a946312e-17f7-47c2-9473-1b16eec4097d req-301cd44f-9dc5-4fcd-9dc3-5432d487ac6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.706825 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a946312e-17f7-47c2-9473-1b16eec4097d req-301cd44f-9dc5-4fcd-9dc3-5432d487ac6f service nova] Creating event network-vif-deleted:0beb2599-3d1f-4410-abcb-ee75ba24eb98 for instance 40684d33-20dc-4dc9-b3c3-6c4019dedbd8 on nch1-master-1 Nov 27 20:56:04.712337 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a946312e-17f7-47c2-9473-1b16eec4097d req-301cd44f-9dc5-4fcd-9dc3-5432d487ac6f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369485 Nov 27 20:56:04.713474 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1748/3351] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:04.719982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28ac9084-4d33-4197-873c-37a80258c004 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:04.720990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28ac9084-4d33-4197-873c-37a80258c004 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:04.729042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ac9084-4d33-4197-873c-37a80258c004 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.730240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ac9084-4d33-4197-873c-37a80258c004 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.731204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ac9084-4d33-4197-873c-37a80258c004 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.731829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ac9084-4d33-4197-873c-37a80258c004 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.785581 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28ac9084-4d33-4197-873c-37a80258c004 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.069744 Nov 27 20:56:04.791074 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1749/3352] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:04 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:04.841155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:04.844145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:04.855031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.855989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.857026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:04.857677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:04.931975 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9580d4b8-f5d0-4cf4-ba8d-beb95a3e56c5 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-group-rules/111a5030-c97e-4c34-8fd6-cfc92cae3102" status: 202 len: 0 microversion: 2.1 time: 0.294781 Nov 27 20:56:04.933278 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1604/3353] 10.222.0.21 () {58 vars in 1286 bytes} [Sat Nov 27 20:56:04 2021] DELETE /compute/v2.1/os-security-group-rules/111a5030-c97e-4c34-8fd6-cfc92cae3102 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:04.949435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92f586a9-0665-4fc2-bb37-72899bf09830 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d9312b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:05.243380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:05.254720 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92f586a9-0665-4fc2-bb37-72899bf09830 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/b16f862b-205c-473e-97d8-998cc85b0f64" status: 202 len: 0 microversion: 2.1 time: 0.315523 Nov 27 20:56:05.255318 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1605/3354] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:04 2021] DELETE /compute/v2.1/os-security-groups/b16f862b-205c-473e-97d8-998cc85b0f64 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:05.259833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:05.262929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:05.263964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:05.264116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] [instance: 40684d33-20dc-4dc9-b3c3-6c4019dedbd8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:05.267954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e1cccd9b-8094-4b67-b9a3-9db6d6c99a68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.432694 Nov 27 20:56:05.268703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1750/3355] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:04 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:05.288161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9c5dd22-af6a-4476-a3a5-da9af21023c2 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d94e6790>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:05.298494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:05.299246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:05.305255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:05.305949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:05.330992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG neutronclient.v2_0.client [None req-a9c5dd22-af6a-4476-a3a5-da9af21023c2 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bd9b500e-9edc-434d-a8ef-17131f12719c does not exist", "detail": ""}} {{(pid=135680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 27 20:56:05.332659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.security_group_api [None req-a9c5dd22-af6a-4476-a3a5-da9af21023c2 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Neutron security group bd9b500e-9edc-434d-a8ef-17131f12719c not found {{(pid=135680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 27 20:56:05.333188 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a9c5dd22-af6a-4476-a3a5-da9af21023c2 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] HTTP exception thrown: Security group bd9b500e-9edc-434d-a8ef-17131f12719c does not exist Nov 27 20:56:05.333188 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-c199028f-50fe-45db-b9b7-95126d3060a5'] Nov 27 20:56:05.334093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9c5dd22-af6a-4476-a3a5-da9af21023c2 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Returning 404 to user: Security group bd9b500e-9edc-434d-a8ef-17131f12719c does not exist Nov 27 20:56:05.334093 ncdv-master-1 devstack@n-api.service[135680]: Neutron server returns request_ids: ['req-c199028f-50fe-45db-b9b7-95126d3060a5'] {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:05.334596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9c5dd22-af6a-4476-a3a5-da9af21023c2 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/bd9b500e-9edc-434d-a8ef-17131f12719c" status: 404 len: 194 microversion: 2.1 time: 0.052904 Nov 27 20:56:05.335154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1751/3356] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:05 2021] DELETE /compute/v2.1/os-security-groups/bd9b500e-9edc-434d-a8ef-17131f12719c => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:05.345584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-340f00c1-69b0-4387-9a75-4b5c7ccc7bd6 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d45c0c10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:05.349456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] HTTP exception thrown: Instance 40684d33-20dc-4dc9-b3c3-6c4019dedbd8 could not be found. Nov 27 20:56:05.350429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] Returning 404 to user: Instance 40684d33-20dc-4dc9-b3c3-6c4019dedbd8 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:05.351467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11b5ef8a-f624-47bf-91cb-e711a97ea45c tempest-InstanceActionsNegativeTestJSON-1239276102 tempest-InstanceActionsNegativeTestJSON-1239276102-project] 10.222.0.21 "GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8" status: 404 len: 111 microversion: 2.1 time: 0.095018 Nov 27 20:56:05.353532 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1606/3357] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:05 2021] GET /compute/v2.1/servers/40684d33-20dc-4dc9-b3c3-6c4019dedbd8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:05.358936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:05.364072 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:05.364072 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:05.365953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:05.367097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Searching by: {'deleted': False, 'project_id': '949d330b01384fb091f743a127f26402'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:56:05.376104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:05.377155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:05.378487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:05.379180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:05.442482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:56:05.477934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-94f6ebd2-5721-418f-873c-1ba0bb987254 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.122871 Nov 27 20:56:05.478759 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1607/3358] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:56:05 2021] GET /compute/v2.1/servers => generated 339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:05.740166 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-340f00c1-69b0-4387-9a75-4b5c7ccc7bd6 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/c6616b2e-bfc4-483a-a479-701c624af572" status: 202 len: 0 microversion: 2.1 time: 0.400754 Nov 27 20:56:05.740943 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1752/3359] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:05 2021] DELETE /compute/v2.1/os-security-groups/c6616b2e-bfc4-483a-a479-701c624af572 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:56:05.746531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:05.750003 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:05.750003 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:05.756970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:05.758201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Searching by: {'deleted': False, 'project_id': '949d330b01384fb091f743a127f26402'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:56:05.772383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:05.774254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:05.779833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:05.783734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:05.801225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-224277081", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "d0542c82-181e-451d-b345-bd41dad9fde2"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:05.822827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:56:05.895902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] validate_networks() for [('d0542c82-181e-451d-b345-bd41dad9fde2', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:56:05.914570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:05.923867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:05.924320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:06.143945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-530d31f3-e419-48c8-af47-bcba3e65e828 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.401787 Nov 27 20:56:06.144535 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1753/3360] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:56:05 2021] GET /compute/v2.1/servers/detail => generated 1713 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:06.256863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b03c8c4-b67a-4dce-ad3c-69bd249574f8 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Action: 'create', calling method: .version_select at 0x7f15d94765e0>, body: {"keypair": {"name": "tempest-keypair-946983331"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:06.287038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3b03c8c4-b67a-4dce-ad3c-69bd249574f8 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:06.302800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3b03c8c4-b67a-4dce-ad3c-69bd249574f8 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:06.513024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:56:06.513328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:56:06.513991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:56:06.514747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:56:06.515393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:56:06.527155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:06.527651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:06.528474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:06.528916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:06.547418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Getting quotas for project 79be4e7871e9465b82698fe64c318285. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:06.553411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Getting quotas for user 1ed72c3ee9064f34aa08e7b328100a9a and project 79be4e7871e9465b82698fe64c318285. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:06.566891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:56:06.569546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:56:06.634679 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6dee63ec-4a18-4149-bd44-9c96a994ffca tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154594 Nov 27 20:56:06.641616 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1608/3361] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:56:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:56:06.648071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c8f3116-99a1-47e0-9b00-83c3cd0a086d tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d9353b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:06.677071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3b03c8c4-b67a-4dce-ad3c-69bd249574f8 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:06.683526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3b03c8c4-b67a-4dce-ad3c-69bd249574f8 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:06.702453 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b03c8c4-b67a-4dce-ad3c-69bd249574f8 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.556629 Nov 27 20:56:06.703761 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1754/3362] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:06 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:06.711183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ddb2ab7-fa27-4c51-85df-20e603a21403 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:06.712730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2ddb2ab7-fa27-4c51-85df-20e603a21403 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:06.722889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ddb2ab7-fa27-4c51-85df-20e603a21403 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:06.723815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ddb2ab7-fa27-4c51-85df-20e603a21403 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:06.725049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ddb2ab7-fa27-4c51-85df-20e603a21403 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:06.726788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ddb2ab7-fa27-4c51-85df-20e603a21403 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:06.784044 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ddb2ab7-fa27-4c51-85df-20e603a21403 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.078515 Nov 27 20:56:06.785079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1755/3363] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:06 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:06.792225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86862ebf-4386-4fcc-b17a-3381d9b32069 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:06.802326 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86862ebf-4386-4fcc-b17a-3381d9b32069 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015462 Nov 27 20:56:06.803155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1756/3364] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:56:06 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:06.808886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:06.809799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:06.818492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:06.819204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:06.820293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:06.820912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:07.106980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:07.120126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:07.138909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:07.144761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc86fa8d-744e-4fb7-b8ff-e9e78c9cfe60 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.338377 Nov 27 20:56:07.145915 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1757/3365] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:06 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:07.170415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bec0098c-22f4-4b17-8eff-616b3a679d0a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:07.171652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bec0098c-22f4-4b17-8eff-616b3a679d0a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:07.265652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bec0098c-22f4-4b17-8eff-616b3a679d0a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:07.274468 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bec0098c-22f4-4b17-8eff-616b3a679d0a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1215 microversion: 2.1 time: 0.114358 Nov 27 20:56:07.276097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1758/3366] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:07 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:07.291186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-84c547f8-b1eb-4931-b1f3-aebb9d1175b0 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d94150d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:07.300276 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-84c547f8-b1eb-4931-b1f3-aebb9d1175b0 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs/tempest-keypair-946983331" status: 200 len: 691 microversion: 2.1 time: 0.013327 Nov 27 20:56:07.306478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1759/3367] 10.222.0.21 () {58 vars in 1214 bytes} [Sat Nov 27 20:56:07 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-946983331 => generated 691 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:07.312090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:07.312853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:07.320817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:07.321602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:07.322713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:07.323480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:07.356003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:56:07.432787 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c8f3116-99a1-47e0-9b00-83c3cd0a086d tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/b1c7a662-7eeb-402f-83a5-b8a68f7d3049" status: 202 len: 0 microversion: 2.1 time: 0.788271 Nov 27 20:56:07.436786 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1609/3368] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:06 2021] DELETE /compute/v2.1/os-security-groups/b1c7a662-7eeb-402f-83a5-b8a68f7d3049 => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:07.438883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-772fff75-6242-46a5-b7d9-e44d2c6efef9 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d930d820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:07.478148 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-772fff75-6242-46a5-b7d9-e44d2c6efef9 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946983331" status: 202 len: 0 microversion: 2.1 time: 0.042697 Nov 27 20:56:07.479731 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1610/3369] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 20:56:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946983331 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:07.489491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8416ba76-2ebf-4040-a210-70585b912b1f tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d93795e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:07.490171 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f7a2f122-6840-44fd-a523-64226b3e1129 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 204 len: 0 microversion: 2.1 time: 0.179729 Nov 27 20:56:07.491886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1760/3370] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:07 2021] DELETE /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:07.505568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87c8a7c6-1f19-4c3c-9b3c-d7c375319083 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Action: 'create', calling method: .version_select at 0x7f15d93f28b0>, body: {"keypair": {"name": "tempest-keypair-1009619643"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:07.529333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-87c8a7c6-1f19-4c3c-9b3c-d7c375319083 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:07.535998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-87c8a7c6-1f19-4c3c-9b3c-d7c375319083 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:07.844403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-87c8a7c6-1f19-4c3c-9b3c-d7c375319083 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:07.855626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-87c8a7c6-1f19-4c3c-9b3c-d7c375319083 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:07.874168 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87c8a7c6-1f19-4c3c-9b3c-d7c375319083 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.380981 Nov 27 20:56:07.882816 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1761/3371] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:07 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:07.894458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:07.895332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:07.913344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:07.913661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:07.914563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:07.915035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:07.926071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8416ba76-2ebf-4040-a210-70585b912b1f tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/093ddf4d-f1ee-4e4c-800f-fed84f755fd3" status: 202 len: 0 microversion: 2.1 time: 0.440703 Nov 27 20:56:07.927022 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1611/3372] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:07 2021] DELETE /compute/v2.1/os-security-groups/093ddf4d-f1ee-4e4c-800f-fed84f755fd3 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:07.934289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1035978-c3b9-40d4-ae7a-b5cfbdb38fce tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:07.935574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d1035978-c3b9-40d4-ae7a-b5cfbdb38fce tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:07.949070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1035978-c3b9-40d4-ae7a-b5cfbdb38fce tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:07.949980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1035978-c3b9-40d4-ae7a-b5cfbdb38fce tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:07.951924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1035978-c3b9-40d4-ae7a-b5cfbdb38fce tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:07.952366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1035978-c3b9-40d4-ae7a-b5cfbdb38fce tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:08.040197 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1035978-c3b9-40d4-ae7a-b5cfbdb38fce tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.111497 Nov 27 20:56:08.045242 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1612/3373] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:07 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:08.057955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f266036-d76c-49d3-9ab2-6bc41d926ece tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d93afaf0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:08.107480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f266036-d76c-49d3-9ab2-6bc41d926ece tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009619643" status: 202 len: 0 microversion: 2.1 time: 0.060278 Nov 27 20:56:08.116703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1613/3374] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:56:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009619643 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:08.130239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1a758c3-4baf-43a1-8155-5e2d2bfcb3c3 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d93549d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:08.201270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:08.212458 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5a9f62b-132a-4e52-8a97-9048cfaef5bb tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1716 microversion: 2.1 time: 0.328286 Nov 27 20:56:08.213971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1762/3375] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:07 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1716 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:08.225999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8bd78991-c4c0-4af0-ad5f-9090988e21ea tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Action: 'create', calling method: .version_select at 0x7f15d45c0c10>, body: {"keypair": {"name": "tempest-keypair-1717095159", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:08.254256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8bd78991-c4c0-4af0-ad5f-9090988e21ea tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:08.272271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8bd78991-c4c0-4af0-ad5f-9090988e21ea tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:08.321425 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8bd78991-c4c0-4af0-ad5f-9090988e21ea tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.104947 Nov 27 20:56:08.323639 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1763/3376] 10.222.0.21 () {60 vars in 1158 bytes} [Sat Nov 27 20:56:08 2021] POST /compute/v2.1/os-keypairs => generated 574 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:08.330713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:08.334270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:08.343564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:08.344279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:08.345468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:08.346085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:08.625840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:08.636492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:08.638097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:08.639443 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-197c2978-141e-440a-8623-8b36ac6362f2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.314322 Nov 27 20:56:08.650188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1764/3377] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:08 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:08.650188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:08.650188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:08.652092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:08.652948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:08.653749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:08.654432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:08.747014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:08.757358 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78484309-7725-4e07-8f0e-b53a06500ca6 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1285 microversion: 2.1 time: 0.115857 Nov 27 20:56:08.758113 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1765/3378] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:08 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:08.763154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-712ce781-58a0-4083-b663-ed2cb727518d tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d9415670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:08.782982 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-712ce781-58a0-4083-b663-ed2cb727518d tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717095159" status: 202 len: 0 microversion: 2.1 time: 0.023052 Nov 27 20:56:08.784036 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1766/3379] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:56:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717095159 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:08.795893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97da4140-5670-4763-a0a1-d8d201de8fa6 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Action: 'create', calling method: .version_select at 0x7f15d45c0c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-344789255"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:08.810885 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1a758c3-4baf-43a1-8155-5e2d2bfcb3c3 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/13d78fa9-427d-4b6e-aac3-f4e1637d9e34" status: 202 len: 0 microversion: 2.1 time: 0.693017 Nov 27 20:56:08.811550 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1614/3380] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:08 2021] DELETE /compute/v2.1/os-security-groups/13d78fa9-427d-4b6e-aac3-f4e1637d9e34 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:08.818888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-97da4140-5670-4763-a0a1-d8d201de8fa6 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:08.823397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d6183e7-2623-4138-a4bf-3b26085373e1 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] Calling method '.version_select at 0x7f15d93c0d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:08.829964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-97da4140-5670-4763-a0a1-d8d201de8fa6 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:09.238942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-97da4140-5670-4763-a0a1-d8d201de8fa6 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:09.244808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-97da4140-5670-4763-a0a1-d8d201de8fa6 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:09.268330 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97da4140-5670-4763-a0a1-d8d201de8fa6 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.478034 Nov 27 20:56:09.273733 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1767/3381] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:08 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:09.274925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-57312cf9-ebdb-431d-97b5-09a1b63946c0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:09.278208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-57312cf9-ebdb-431d-97b5-09a1b63946c0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:09.299488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57312cf9-ebdb-431d-97b5-09a1b63946c0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:09.299845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57312cf9-ebdb-431d-97b5-09a1b63946c0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:09.301933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57312cf9-ebdb-431d-97b5-09a1b63946c0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:09.302544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57312cf9-ebdb-431d-97b5-09a1b63946c0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:09.363180 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-57312cf9-ebdb-431d-97b5-09a1b63946c0 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.092419 Nov 27 20:56:09.368093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1768/3382] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:09 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:09.378853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:09.379601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:09.391051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:09.391700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:09.392721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:09.393559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:09.616417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:09.625474 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-caa8a6c1-a067-44c7-9f4e-61635b83f9a7 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1716 microversion: 2.1 time: 0.258187 Nov 27 20:56:09.626194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1769/3383] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:09 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1716 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:09.631387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-893dcb31-54ce-4fc6-a5ed-8dfe5ecbeed1 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Action: 'create', calling method: .version_select at 0x7f15d949c940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-204963143"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:09.647534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-893dcb31-54ce-4fc6-a5ed-8dfe5ecbeed1 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:09.654711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-893dcb31-54ce-4fc6-a5ed-8dfe5ecbeed1 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:09.760810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-893dcb31-54ce-4fc6-a5ed-8dfe5ecbeed1 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:09.766968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-893dcb31-54ce-4fc6-a5ed-8dfe5ecbeed1 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:09.784052 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-893dcb31-54ce-4fc6-a5ed-8dfe5ecbeed1 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.156489 Nov 27 20:56:09.785829 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1770/3384] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:09 2021] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:09.793003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:09.793956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:09.801763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:09.802214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:09.803134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:09.803962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:10.027971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:10.037392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:10.039169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:10.040360 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd39bab7-37fb-4e4b-bd67-44611f2b4979 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.253381 Nov 27 20:56:10.041161 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1771/3385] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:09 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:10.056434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:10.057581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:10.064082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:10.064493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:10.065342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:10.065778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:10.137742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:10.145816 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0c7b980a-b403-46c9-ad90-3816cec91b12 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1273 microversion: 2.1 time: 0.092980 Nov 27 20:56:10.147442 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1772/3386] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:10 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:10.152827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-670a26ee-1991-492e-bd5f-c4313be16a27 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Action: 'create', calling method: .version_select at 0x7f15d94765e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-607007556"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:10.168010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-670a26ee-1991-492e-bd5f-c4313be16a27 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:10.173757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-670a26ee-1991-492e-bd5f-c4313be16a27 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:10.324458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-670a26ee-1991-492e-bd5f-c4313be16a27 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:10.330474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-670a26ee-1991-492e-bd5f-c4313be16a27 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Getting quotas for user d79734c0300042b3b0f7326fc80e13ea and project 6bc9d999317e427fa446cec7242dbab1. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:10.347559 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-670a26ee-1991-492e-bd5f-c4313be16a27 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.198699 Nov 27 20:56:10.349111 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1773/3387] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:10 2021] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:10.359042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-541b8c91-4685-43d3-8ae7-9ba8f6f1229f tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d94e6c10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:10.362961 ncdv-master-1 devstack@n-api.service[135680]: WARNING oslo_db.sqlalchemy.utils [None req-541b8c91-4685-43d3-8ae7-9ba8f6f1229f tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 27 20:56:10.371740 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-541b8c91-4685-43d3-8ae7-9ba8f6f1229f tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs" status: 200 len: 1673 microversion: 2.1 time: 0.016091 Nov 27 20:56:10.372812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1774/3388] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:56:10 2021] GET /compute/v2.1/os-keypairs => generated 1673 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:10.379229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-771de11e-68c8-4cd5-b764-9871aaa9fb14 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:10.380174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-771de11e-68c8-4cd5-b764-9871aaa9fb14 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:10.405512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-771de11e-68c8-4cd5-b764-9871aaa9fb14 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:10.405977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-771de11e-68c8-4cd5-b764-9871aaa9fb14 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:10.406781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-771de11e-68c8-4cd5-b764-9871aaa9fb14 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:10.407223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-771de11e-68c8-4cd5-b764-9871aaa9fb14 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:10.472103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-771de11e-68c8-4cd5-b764-9871aaa9fb14 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.096702 Nov 27 20:56:10.477433 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1775/3389] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:10 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:10.483366 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d6183e7-2623-4138-a4bf-3b26085373e1 tempest-SecurityGroupRulesTestJSON-889325223 tempest-SecurityGroupRulesTestJSON-889325223-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/b7ea6e21-4e12-48bf-9bd5-8e08d3687b86" status: 202 len: 0 microversion: 2.1 time: 1.667186 Nov 27 20:56:10.484061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1615/3390] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:56:08 2021] DELETE /compute/v2.1/os-security-groups/b7ea6e21-4e12-48bf-9bd5-8e08d3687b86 => generated 0 bytes in 1669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:56:10.488319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd5f3639-ec21-4aca-8ebf-917f6a64e8c3 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d9476280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:10.516331 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bd5f3639-ec21-4aca-8ebf-917f6a64e8c3 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-607007556" status: 202 len: 0 microversion: 2.1 time: 0.037356 Nov 27 20:56:10.517309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1776/3391] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:56:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-607007556 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:10.526538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e411216a-e529-48cd-8a5e-b8a2bbd3f24f tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d930da60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:10.546607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e411216a-e529-48cd-8a5e-b8a2bbd3f24f tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-204963143" status: 202 len: 0 microversion: 2.1 time: 0.024622 Nov 27 20:56:10.548041 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1616/3392] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:56:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-204963143 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:10.568929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-24cada3c-7642-41f3-852d-2edfde2b4ce4 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] Calling method '.version_select at 0x7f15d951a0d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:10.601150 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-24cada3c-7642-41f3-852d-2edfde2b4ce4 tempest-KeyPairsV2TestJSON-432050549 tempest-KeyPairsV2TestJSON-432050549-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-344789255" status: 202 len: 0 microversion: 2.1 time: 0.048758 Nov 27 20:56:10.602249 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1777/3393] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:56:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-344789255 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:10.644081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:10.645924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:10.658115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:10.658871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:10.660606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:10.662050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:11.062498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:11.063239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:11.073335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:11.073797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:11.074605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:11.075049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:11.210143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:11.238146 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8b08a804-946b-4832-9c1b-d2dc173321dc tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1716 microversion: 2.1 time: 0.598093 Nov 27 20:56:11.239846 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1617/3394] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:10 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1716 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:11.481324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc6577c3-75e4-4c01-950f-a40067f3f277 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Action: 'create', calling method: .version_select at 0x7f15d93c0b80>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-534076886", "policies": ["affinity"]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:11.519581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-cc6577c3-75e4-4c01-950f-a40067f3f277 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:11.531885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-cc6577c3-75e4-4c01-950f-a40067f3f277 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:11.543763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:11.555619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:11.557214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:11.561978 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da475911-8c1d-4b9e-92c5-c4c3ae1d0cc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.502872 Nov 27 20:56:11.565832 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1778/3395] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:11 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:11.570959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:11.571808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:11.578199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:11.584297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:11.585453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:11.586046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:11.623903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-cc6577c3-75e4-4c01-950f-a40067f3f277 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:11.643955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-cc6577c3-75e4-4c01-950f-a40067f3f277 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:11.665567 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc6577c3-75e4-4c01-950f-a40067f3f277 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.423757 Nov 27 20:56:11.671462 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1618/3396] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 20:56:11 2021] POST /compute/v2.1/os-server-groups => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:11.673083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1f7b906-2431-478e-965c-9592d074847e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:11.674020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d1f7b906-2431-478e-965c-9592d074847e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:11.682354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1f7b906-2431-478e-965c-9592d074847e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:11.682815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1f7b906-2431-478e-965c-9592d074847e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:11.683641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1f7b906-2431-478e-965c-9592d074847e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:11.684137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1f7b906-2431-478e-965c-9592d074847e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:11.731772 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1f7b906-2431-478e-965c-9592d074847e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.062609 Nov 27 20:56:11.733646 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1619/3397] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:11 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:11.745197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c60bfeaa-7540-4d9e-9eca-8275e59c63dd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Action: 'create', calling method: .version_select at 0x7f15d944a040>, body: {"server_group": {"name": "tempest-server-group-984239686", "policies": ["affinity"]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:11.792301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c60bfeaa-7540-4d9e-9eca-8275e59c63dd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:11.799684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c60bfeaa-7540-4d9e-9eca-8275e59c63dd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:11.883775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c60bfeaa-7540-4d9e-9eca-8275e59c63dd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:11.892636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c60bfeaa-7540-4d9e-9eca-8275e59c63dd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:11.913745 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c60bfeaa-7540-4d9e-9eca-8275e59c63dd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.173951 Nov 27 20:56:11.915674 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1620/3398] 10.222.0.21 () {60 vars in 1172 bytes} [Sat Nov 27 20:56:11 2021] POST /compute/v2.1/os-server-groups => generated 163 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:11.932494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aea57de5-6b7b-4645-8ef8-87b66a3c6207 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Action: 'create', calling method: .version_select at 0x7f15d93c0b80>, body: {"server_group": {"name": "tempest-server-group-984239686", "policies": ["affinity"]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:11.955288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:11.965529 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0e9eae5b-4cf6-4e16-ad27-24f79eb0d266 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1315 microversion: 2.1 time: 0.398328 Nov 27 20:56:11.971580 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1779/3399] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:11 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:11.975692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-aea57de5-6b7b-4645-8ef8-87b66a3c6207 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:11.983377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-aea57de5-6b7b-4645-8ef8-87b66a3c6207 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:12.068571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-aea57de5-6b7b-4645-8ef8-87b66a3c6207 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:12.086478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-aea57de5-6b7b-4645-8ef8-87b66a3c6207 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:12.113404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aea57de5-6b7b-4645-8ef8-87b66a3c6207 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.191849 Nov 27 20:56:12.114986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1621/3400] 10.222.0.21 () {60 vars in 1172 bytes} [Sat Nov 27 20:56:11 2021] POST /compute/v2.1/os-server-groups => generated 163 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:12.129373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39e70fa4-70fb-4300-97d8-177852e289b4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.180940 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39e70fa4-70fb-4300-97d8-177852e289b4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/df180887-c748-4220-a265-88bd661fc493" status: 204 len: 0 microversion: 2.1 time: 0.059656 Nov 27 20:56:12.184106 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1780/3401] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:12 2021] DELETE /compute/v2.1/os-server-groups/df180887-c748-4220-a265-88bd661fc493 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:12.191941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-39dab687-3aeb-46c4-9b03-da156d31eceb tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.223733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-39dab687-3aeb-46c4-9b03-da156d31eceb tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.035331 Nov 27 20:56:12.224523 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1622/3402] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:56:12 2021] GET /compute/v2.1/os-server-groups => generated 333 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:56:12.234261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-38c20e13-a2b1-4400-be0d-683d7b4876bf tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.259490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.261664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:12.274651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:12.275918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:12.277012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:12.279275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:12.320991 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-38c20e13-a2b1-4400-be0d-683d7b4876bf tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/66b17366-9c0c-41f0-998f-f7d3b7138bfe" status: 204 len: 0 microversion: 2.1 time: 0.088292 Nov 27 20:56:12.326501 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1781/3403] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:12 2021] DELETE /compute/v2.1/os-server-groups/66b17366-9c0c-41f0-998f-f7d3b7138bfe => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:12.352000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5165204c-fbfc-4e76-a1d0-2cd48a941e4e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.391635 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5165204c-fbfc-4e76-a1d0-2cd48a941e4e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.060560 Nov 27 20:56:12.397834 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1782/3404] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:56:12 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:12.407932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bc29dd2-95a6-438c-b82e-cf90119b5c1a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Action: 'create', calling method: .version_select at 0x7f15d94b0790>, body: {"server_group": {"name": "tempest-server-group-1947967668", "policies": ["affinity"]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:12.480359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0bc29dd2-95a6-438c-b82e-cf90119b5c1a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:12.489031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0bc29dd2-95a6-438c-b82e-cf90119b5c1a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:12.497382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:12.510748 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed376803-2b22-4bb0-bc62-0a9faf2126fa tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1648 microversion: 2.1 time: 0.257847 Nov 27 20:56:12.511458 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1623/3405] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:12 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1648 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:12.525970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f0ab6144-ac8d-49b0-8c1e-a6196f6f31d9 req-f810c51d-c08e-430f-8607-a114052183ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-plugged", "status": "completed", "tag": "2141f889-e6e6-4c2b-ba22-12f0441b2f07"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:12.528145 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:12.528145 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:12.537389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f0ab6144-ac8d-49b0-8c1e-a6196f6f31d9 req-f810c51d-c08e-430f-8607-a114052183ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:12.540525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f0ab6144-ac8d-49b0-8c1e-a6196f6f31d9 req-f810c51d-c08e-430f-8607-a114052183ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:12.572042 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f0ab6144-ac8d-49b0-8c1e-a6196f6f31d9 req-f810c51d-c08e-430f-8607-a114052183ab service nova] Creating event network-vif-plugged:2141f889-e6e6-4c2b-ba22-12f0441b2f07 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:12.584481 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f0ab6144-ac8d-49b0-8c1e-a6196f6f31d9 req-f810c51d-c08e-430f-8607-a114052183ab service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071560 Nov 27 20:56:12.589076 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1624/3406] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:12.600576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.601584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:12.608716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0bc29dd2-95a6-438c-b82e-cf90119b5c1a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:12.622094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:12.622553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:12.623596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:12.624178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:12.624808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0bc29dd2-95a6-438c-b82e-cf90119b5c1a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:12.668087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bc29dd2-95a6-438c-b82e-cf90119b5c1a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.262687 Nov 27 20:56:12.676650 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1783/3407] 10.222.0.21 () {60 vars in 1172 bytes} [Sat Nov 27 20:56:12 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:12.681277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-404effb4-1dec-4cf6-8452-786305814759 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.747306 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-404effb4-1dec-4cf6-8452-786305814759 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/d0587c82-77fd-4dd7-b24c-6941be361159" status: 204 len: 0 microversion: 2.1 time: 0.069497 Nov 27 20:56:12.751413 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1784/3408] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:12 2021] DELETE /compute/v2.1/os-server-groups/d0587c82-77fd-4dd7-b24c-6941be361159 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:12.757459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0fc5f772-22bc-49c8-89cb-4db70406532b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:12.758743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0fc5f772-22bc-49c8-89cb-4db70406532b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:12.769792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fc5f772-22bc-49c8-89cb-4db70406532b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:12.770277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fc5f772-22bc-49c8-89cb-4db70406532b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:12.771069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fc5f772-22bc-49c8-89cb-4db70406532b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:12.771541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fc5f772-22bc-49c8-89cb-4db70406532b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:12.847843 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0fc5f772-22bc-49c8-89cb-4db70406532b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.094660 Nov 27 20:56:12.848893 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1785/3409] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:12 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:12.859908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-883c51f5-c436-4d85-a604-2cc20a2a1a64 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:12.886267 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-883c51f5-c436-4d85-a604-2cc20a2a1a64 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.036019 Nov 27 20:56:12.887906 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1786/3410] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:56:12 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:12.899073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26eb7733-2add-40b4-a768-28c86a24405e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Action: 'create', calling method: .version_select at 0x7f15c7371310>, body: {"server_group": {"name": "tempest-server-group-998222156", "policies": ["anti-affinity"]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:12.942116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-26eb7733-2add-40b4-a768-28c86a24405e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:12.948696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-26eb7733-2add-40b4-a768-28c86a24405e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:13.026480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-26eb7733-2add-40b4-a768-28c86a24405e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:13.036078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-26eb7733-2add-40b4-a768-28c86a24405e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_groups'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:13.077495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26eb7733-2add-40b4-a768-28c86a24405e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.183051 Nov 27 20:56:13.084010 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1787/3411] 10.222.0.21 () {60 vars in 1172 bytes} [Sat Nov 27 20:56:12 2021] POST /compute/v2.1/os-server-groups => generated 168 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:56:13.090012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:13.091994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:13.106310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:13.106750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:13.107570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:13.109440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:13.484245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:13.496670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:13.499541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:13.503733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-098b18f7-05b6-46a8-bdb4-9394f7a9cbea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.913206 Nov 27 20:56:13.505900 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1625/3412] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:12 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:13.516184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf2c275f-31bf-4a1b-bc6c-b805a3668d93 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:13.563206 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf2c275f-31bf-4a1b-bc6c-b805a3668d93 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/a736c857-ab57-4deb-b57a-5c672953de5b" status: 204 len: 0 microversion: 2.1 time: 0.054378 Nov 27 20:56:13.564489 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1626/3413] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:13 2021] DELETE /compute/v2.1/os-server-groups/a736c857-ab57-4deb-b57a-5c672953de5b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:13.574030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9b9fdb74-ba63-4dfb-a245-0c4e1057f923 req-fa6a2b56-3a91-4008-942a-4ef132337fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4915d7-d7e8-4026-b053-0daf8f1da2d9", "name": "network-vif-deleted", "tag": "dd8f41df-2dbf-4de0-bf5b-e9b90b539e23"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:13.576693 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:13.576693 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:13.585097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9b9fdb74-ba63-4dfb-a245-0c4e1057f923 req-fa6a2b56-3a91-4008-942a-4ef132337fdf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:13.585902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9b9fdb74-ba63-4dfb-a245-0c4e1057f923 req-fa6a2b56-3a91-4008-942a-4ef132337fdf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:13.601771 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9b9fdb74-ba63-4dfb-a245-0c4e1057f923 req-fa6a2b56-3a91-4008-942a-4ef132337fdf service nova] Creating event network-vif-deleted:dd8f41df-2dbf-4de0-bf5b-e9b90b539e23 for instance 4c4915d7-d7e8-4026-b053-0daf8f1da2d9 on nch1-master-1 Nov 27 20:56:13.608171 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9b9fdb74-ba63-4dfb-a245-0c4e1057f923 req-fa6a2b56-3a91-4008-942a-4ef132337fdf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039248 Nov 27 20:56:13.609410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1627/3414] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:13.689143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:13.702500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80f21895-bd72-4839-8c7e-178b9dfe54bf tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1315 microversion: 2.1 time: 0.621248 Nov 27 20:56:13.703642 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1788/3415] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:13 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:13.713333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:13.726240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:13.742799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:13.744769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:13.745923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:13.746772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:13.801948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebefc04b-9d56-484e-b56d-2fcf15ca1a51 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15d92fa820>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:13.816328 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ebefc04b-9d56-484e-b56d-2fcf15ca1a51 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Nov 27 20:56:13.817178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebefc04b-9d56-484e-b56d-2fcf15ca1a51 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:13.818476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebefc04b-9d56-484e-b56d-2fcf15ca1a51 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.207679 Nov 27 20:56:13.819317 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1628/3416] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:13 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:56:13.828779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e39409c0-ef67-4b6c-8a8b-99766fc0d591 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:13.833317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:13.836993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:13.837743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lazy-loading 'fault' on Instance uuid 4c4915d7-d7e8-4026-b053-0daf8f1da2d9 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:56:13.856708 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e39409c0-ef67-4b6c-8a8b-99766fc0d591 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032403 Nov 27 20:56:13.893581 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1629/3417] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:56:13 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:13.910386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-701923ee-ea4e-469b-a9cc-cf812c43bc38 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15d92c01f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-701157780", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:13.971805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-701923ee-ea4e-469b-a9cc-cf812c43bc38 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:13.982426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-701923ee-ea4e-469b-a9cc-cf812c43bc38 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for user 8fff05064e37409c8f7a700b54dab65b and project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:14.050032 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-701923ee-ea4e-469b-a9cc-cf812c43bc38 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 27 20:56:14.051866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-701923ee-ea4e-469b-a9cc-cf812c43bc38 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:14.054775 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-701923ee-ea4e-469b-a9cc-cf812c43bc38 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.158457 Nov 27 20:56:14.057886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1630/3418] 10.222.0.21 () {60 vars in 1159 bytes} [Sat Nov 27 20:56:13 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:14.078787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f1de178-2ef6-46bd-8790-420360786885 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:14.082155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f1de178-2ef6-46bd-8790-420360786885 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:14.104936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1de178-2ef6-46bd-8790-420360786885 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:14.105809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1de178-2ef6-46bd-8790-420360786885 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:14.106908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1de178-2ef6-46bd-8790-420360786885 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:14.107658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1de178-2ef6-46bd-8790-420360786885 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:14.173436 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f1de178-2ef6-46bd-8790-420360786885 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.106386 Nov 27 20:56:14.174955 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1631/3419] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:14 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:14.180523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-915e8cf2-a11e-46d7-b435-ea5ae280866e tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15d92c0040>, body: {"keypair": {"name": "tempest-keypair-1530460105"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:14.199219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-915e8cf2-a11e-46d7-b435-ea5ae280866e tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:14.208616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-915e8cf2-a11e-46d7-b435-ea5ae280866e tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for user 8fff05064e37409c8f7a700b54dab65b and project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:14.329425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc24888898d4d20bcfdc3d7c8cde8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '949d330b01384fb091f743a127f26402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:14.344391 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef3e2f00-b781-44a4-bcbc-158d28624271 tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 200 len: 1367 microversion: 2.1 time: 0.639133 Nov 27 20:56:14.346111 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1789/3420] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:13 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 1367 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:14.357518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-170687112", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "2a9252b5-f85f-44aa-beb1-1ab80a2d9a7d"}]}, "os:scheduler_hints": {"group": "c92b9628-904b-4b67-b0c3-33097a4d4bd6"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:14.359563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-915e8cf2-a11e-46d7-b435-ea5ae280866e tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:14.375065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-915e8cf2-a11e-46d7-b435-ea5ae280866e tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for user 8fff05064e37409c8f7a700b54dab65b and project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:14.453852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-915e8cf2-a11e-46d7-b435-ea5ae280866e tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.277058 Nov 27 20:56:14.454614 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1632/3421] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:14 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:14.469603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce5e256a-9dcd-4e84-86ec-bafd07126d5f tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15d92c0dc0>, body: {"keypair": {"name": "tempest-keypair-1530460105"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:14.496930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ce5e256a-9dcd-4e84-86ec-bafd07126d5f tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:14.516440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ce5e256a-9dcd-4e84-86ec-bafd07126d5f tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for user 8fff05064e37409c8f7a700b54dab65b and project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:14.523811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] validate_networks() for [('2a9252b5-f85f-44aa-beb1-1ab80a2d9a7d', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:56:14.796204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ce5e256a-9dcd-4e84-86ec-bafd07126d5f tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] HTTP exception thrown: Key pair 'tempest-keypair-1530460105' already exists. Nov 27 20:56:14.796800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce5e256a-9dcd-4e84-86ec-bafd07126d5f tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 409 to user: Key pair 'tempest-keypair-1530460105' already exists. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:14.798547 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce5e256a-9dcd-4e84-86ec-bafd07126d5f tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.335658 Nov 27 20:56:14.799809 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1633/3422] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:14 2021] POST /compute/v2.1/os-keypairs => generated 105 bytes in 337 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 20:56:14.809679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:14.811826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:14.820014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:14.821067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:14.824888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:14.824888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.113608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:15.126751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:15.128649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:15.129737 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7fb1d539-19ed-4952-9efa-8ef638120576 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.328438 Nov 27 20:56:15.130302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1634/3423] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:14 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:15.136496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2a1675e2-dc11-4842-a879-00ce8bc893d6 req-19bcabb8-7f9a-48d7-a80d-323ffe15d573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-plugged", "status": "completed", "tag": "7892b730-0a95-4587-9c92-b7522e255107"}, {"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-plugged", "status": "completed", "tag": "03e5badb-8172-486f-9775-23060da4f0c7"}, {"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-plugged", "status": "completed", "tag": "41f728b6-b85b-4f6c-b3a2-991cfa305959"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:15.138282 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:15.138282 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:15.145621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2a1675e2-dc11-4842-a879-00ce8bc893d6 req-19bcabb8-7f9a-48d7-a80d-323ffe15d573 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.146081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2a1675e2-dc11-4842-a879-00ce8bc893d6 req-19bcabb8-7f9a-48d7-a80d-323ffe15d573 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.173120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2a1675e2-dc11-4842-a879-00ce8bc893d6 req-19bcabb8-7f9a-48d7-a80d-323ffe15d573 service nova] Creating event network-vif-plugged:7892b730-0a95-4587-9c92-b7522e255107 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:15.173636 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2a1675e2-dc11-4842-a879-00ce8bc893d6 req-19bcabb8-7f9a-48d7-a80d-323ffe15d573 service nova] Creating event network-vif-plugged:03e5badb-8172-486f-9775-23060da4f0c7 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:15.176583 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2a1675e2-dc11-4842-a879-00ce8bc893d6 req-19bcabb8-7f9a-48d7-a80d-323ffe15d573 service nova] Creating event network-vif-plugged:41f728b6-b85b-4f6c-b3a2-991cfa305959 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:15.193024 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2a1675e2-dc11-4842-a879-00ce8bc893d6 req-19bcabb8-7f9a-48d7-a80d-323ffe15d573 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056698 Nov 27 20:56:15.193709 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1635/3424] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:15 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:15.209425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:15.210513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:15.222189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.222698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.224905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.225604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.367946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:56:15.368381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:56:15.368789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:56:15.369706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:56:15.370371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:56:15.384718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.386151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.387110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.387714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.393211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:15.403226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa62d015-aa1b-465b-8597-e36659f77b93 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1315 microversion: 2.1 time: 0.208306 Nov 27 20:56:15.404868 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1636/3425] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:15 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:15.406594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:15.409962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c07636c3-ed7a-43db-ab37-a7d6b4526e33 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Calling method '.version_select at 0x7f15d93afca0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:15.412927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:15.429918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:56:15.433649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:56:15.437838 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c07636c3-ed7a-43db-ab37-a7d6b4526e33 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530460105" status: 202 len: 0 microversion: 2.1 time: 0.032220 Nov 27 20:56:15.438740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1637/3426] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:56:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530460105 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:15.454314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e57f97c-0d77-4bc3-ba1d-70fc176922fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:15.455297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e57f97c-0d77-4bc3-ba1d-70fc176922fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:15.462624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e57f97c-0d77-4bc3-ba1d-70fc176922fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.463394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e57f97c-0d77-4bc3-ba1d-70fc176922fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.464453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e57f97c-0d77-4bc3-ba1d-70fc176922fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.464882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e57f97c-0d77-4bc3-ba1d-70fc176922fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.490982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:15.497105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:15.523171 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e57f97c-0d77-4bc3-ba1d-70fc176922fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.082932 Nov 27 20:56:15.525344 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1638/3427] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:15 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:15.531309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:15.532130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] [instance: 4c4915d7-d7e8-4026-b053-0daf8f1da2d9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:15.540100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.540976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.542539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.543208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.543471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for project 4e0000db558e40a5a68130b07178b447. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:15.550043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Getting quotas for user 18b2bfa328264fb39c380fe21eae79cc and project 4e0000db558e40a5a68130b07178b447. Resources: {'server_group_members'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:15.562161 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] HTTP exception thrown: Instance 4c4915d7-d7e8-4026-b053-0daf8f1da2d9 could not be found. Nov 27 20:56:15.563137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Returning 404 to user: Instance 4c4915d7-d7e8-4026-b053-0daf8f1da2d9 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:15.564564 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0db7156b-25a8-48c1-8ef9-1a0c876fbbdf tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9" status: 404 len: 111 microversion: 2.1 time: 0.037500 Nov 27 20:56:15.565325 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1639/3428] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:15 2021] GET /compute/v2.1/servers/4c4915d7-d7e8-4026-b053-0daf8f1da2d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:15.570772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45b56162-3f78-48c1-b5fd-dae5d4b77f32 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15d92ccca0>, body: {"keypair": {"name": ""}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:15.572476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45b56162-3f78-48c1-b5fd-dae5d4b77f32 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:15.573591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45b56162-3f78-48c1-b5fd-dae5d4b77f32 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.007030 Nov 27 20:56:15.579096 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1640/3429] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:15 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:56:15.583806 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ab5ecbb-4b61-44ea-8139-afc3bd5d315a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235147 Nov 27 20:56:15.584907 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1790/3430] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:56:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:56:15.586074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-51965bdd-7edd-429b-a280-37355d57776b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] Calling method '.version_select at 0x7f15d9312a60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:15.597038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-138be2f0-1670-43f4-a544-f3654de0f464 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15c73641f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-474795968", "public_key": " "}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:15.614970 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-51965bdd-7edd-429b-a280-37355d57776b tempest-ServersTestManualDisk-3222739 tempest-ServersTestManualDisk-3222739-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1709801205" status: 202 len: 0 microversion: 2.1 time: 0.034334 Nov 27 20:56:15.616256 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1641/3431] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:56:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1709801205 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:15.624524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d04a606-1c8d-4b00-bb4e-0023b73d69fd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:15.625367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d04a606-1c8d-4b00-bb4e-0023b73d69fd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:15.635300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-138be2f0-1670-43f4-a544-f3654de0f464 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:15.641852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-138be2f0-1670-43f4-a544-f3654de0f464 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for user 8fff05064e37409c8f7a700b54dab65b and project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:15.679511 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-138be2f0-1670-43f4-a544-f3654de0f464 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 27 20:56:15.680359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-138be2f0-1670-43f4-a544-f3654de0f464 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:15.681413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-138be2f0-1670-43f4-a544-f3654de0f464 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.095270 Nov 27 20:56:15.682647 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1791/3432] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:15 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:15.691078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-37f92955-6a36-4a3b-afa5-5faf929091a4 req-2edb6bb7-3066-4b84-8522-d783fd343715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae0497d-307e-4b5d-bf33-4aa2bc4ff484", "tag": "6fb19fc5-4537-4ccf-9fc1-97b530aaff0b"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:15.696090 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:15.696090 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:15.709559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-37f92955-6a36-4a3b-afa5-5faf929091a4 req-2edb6bb7-3066-4b84-8522-d783fd343715 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:15.710282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-37f92955-6a36-4a3b-afa5-5faf929091a4 req-2edb6bb7-3066-4b84-8522-d783fd343715 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:15.726707 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-37f92955-6a36-4a3b-afa5-5faf929091a4 req-2edb6bb7-3066-4b84-8522-d783fd343715 service nova] Creating event network-changed:6fb19fc5-4537-4ccf-9fc1-97b530aaff0b for instance 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 on nch1-master-1 Nov 27 20:56:15.732500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-37f92955-6a36-4a3b-afa5-5faf929091a4 req-2edb6bb7-3066-4b84-8522-d783fd343715 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048385 Nov 27 20:56:15.733421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1792/3433] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:15.738733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a4ef7a1-02df-422e-b142-5157d6dd80b7 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15d94b09d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:15.740014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a4ef7a1-02df-422e-b142-5157d6dd80b7 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:15.741923 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a4ef7a1-02df-422e-b142-5157d6dd80b7 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.006759 Nov 27 20:56:15.742737 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1793/3434] 10.222.0.21 () {60 vars in 1158 bytes} [Sat Nov 27 20:56:15 2021] POST /compute/v2.1/os-keypairs => generated 627 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 20:56:15.766426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79e57a9e-1d43-4757-8a6c-9cd3742f86d4 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Action: 'create', calling method: .version_select at 0x7f15d45c0c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1197613773", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:15.788872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-79e57a9e-1d43-4757-8a6c-9cd3742f86d4 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:15.809230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-79e57a9e-1d43-4757-8a6c-9cd3742f86d4 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Getting quotas for user 8fff05064e37409c8f7a700b54dab65b and project e5b09831584c4f48b5948b481d2913cb. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:15.845964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0d04a606-1c8d-4b00-bb4e-0023b73d69fd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:15.848975 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-79e57a9e-1d43-4757-8a6c-9cd3742f86d4 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 27 20:56:15.849599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79e57a9e-1d43-4757-8a6c-9cd3742f86d4 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:15.850438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79e57a9e-1d43-4757-8a6c-9cd3742f86d4 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.100594 Nov 27 20:56:15.855581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1794/3435] 10.222.0.21 () {60 vars in 1158 bytes} [Sat Nov 27 20:56:15 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:15.861443 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d04a606-1c8d-4b00-bb4e-0023b73d69fd tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1212 microversion: 2.1 time: 0.243393 Nov 27 20:56:15.866587 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1642/3436] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:15 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1212 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:15.866730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23bc0b58-ee09-4c26-aee8-14002dd5e704 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Calling method '.version_select at 0x7f15d45c0f70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:15.888120 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-23bc0b58-ee09-4c26-aee8-14002dd5e704 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1329265042 not found for user 8fff05064e37409c8f7a700b54dab65b Nov 27 20:56:15.891808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23bc0b58-ee09-4c26-aee8-14002dd5e704 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1329265042 not found for user 8fff05064e37409c8f7a700b54dab65b {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:15.892862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23bc0b58-ee09-4c26-aee8-14002dd5e704 tempest-KeyPairsNegativeTestJSON-1483429508 tempest-KeyPairsNegativeTestJSON-1483429508-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1329265042" status: 404 len: 145 microversion: 2.1 time: 0.035976 Nov 27 20:56:15.900412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1795/3437] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 20:56:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1329265042 => generated 145 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:16.151200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:16.151893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:16.167076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.181086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.184454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.186684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.426762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:16.428505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:16.444019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.445254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.446253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.446849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.747979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:16.767550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:16.769594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:16.777226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9e59c3c-614b-4ef1-8514-541e2f76be19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.631410 Nov 27 20:56:16.777905 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1643/3438] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:16 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:16.782481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49744c11-c535-4165-ae69-3889c1ac08ff tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:16.784889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49744c11-c535-4165-ae69-3889c1ac08ff tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:16.796927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49744c11-c535-4165-ae69-3889c1ac08ff tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.797383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49744c11-c535-4165-ae69-3889c1ac08ff tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.798417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49744c11-c535-4165-ae69-3889c1ac08ff tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.800277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49744c11-c535-4165-ae69-3889c1ac08ff tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.846935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49744c11-c535-4165-ae69-3889c1ac08ff tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.067098 Nov 27 20:56:16.848516 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1644/3439] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:16 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:16.885598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:16.886414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:16.894785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.895327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.896252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:16.896898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:16.953564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:16.962385 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3868f945-512c-41be-a0c2-b68e37f5540c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1315 microversion: 2.1 time: 0.543480 Nov 27 20:56:16.963000 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1796/3440] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:16 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:17.025694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:17.038716 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9234a697-309b-42f8-a902-6590a99a52e1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1264 microversion: 2.1 time: 0.158898 Nov 27 20:56:17.039620 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1645/3441] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:16 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:17.222186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0453e34c-c8c6-4dec-a7cc-cf063376fbe9 req-a465bb58-547a-4dbf-8048-a2ac74ff45f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-plugged", "status": "completed", "tag": "14f3487c-a918-45af-a334-40c24460e19d"}, {"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-plugged", "status": "completed", "tag": "4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5"}, {"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-plugged", "status": "completed", "tag": "80f6d4bb-15fa-48bb-b344-9306a5390104"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:17.225626 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:17.225626 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:17.233472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0453e34c-c8c6-4dec-a7cc-cf063376fbe9 req-a465bb58-547a-4dbf-8048-a2ac74ff45f5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:17.235619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0453e34c-c8c6-4dec-a7cc-cf063376fbe9 req-a465bb58-547a-4dbf-8048-a2ac74ff45f5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:17.259498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0453e34c-c8c6-4dec-a7cc-cf063376fbe9 req-a465bb58-547a-4dbf-8048-a2ac74ff45f5 service nova] Creating event network-vif-plugged:14f3487c-a918-45af-a334-40c24460e19d for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:17.261141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0453e34c-c8c6-4dec-a7cc-cf063376fbe9 req-a465bb58-547a-4dbf-8048-a2ac74ff45f5 service nova] Creating event network-vif-plugged:4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:17.261870 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0453e34c-c8c6-4dec-a7cc-cf063376fbe9 req-a465bb58-547a-4dbf-8048-a2ac74ff45f5 service nova] Creating event network-vif-plugged:80f6d4bb-15fa-48bb-b344-9306a5390104 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:17.268808 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0453e34c-c8c6-4dec-a7cc-cf063376fbe9 req-a465bb58-547a-4dbf-8048-a2ac74ff45f5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055019 Nov 27 20:56:17.269901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1797/3442] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:17 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:17.797378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:17.798648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:17.813966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:17.814430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:17.815244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:17.815709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:17.862247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97a63950-3a5b-4911-ac97-479b24187ac9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:17.864083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97a63950-3a5b-4911-ac97-479b24187ac9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:17.875564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a63950-3a5b-4911-ac97-479b24187ac9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:17.878782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a63950-3a5b-4911-ac97-479b24187ac9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:17.879923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a63950-3a5b-4911-ac97-479b24187ac9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:17.882825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97a63950-3a5b-4911-ac97-479b24187ac9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:17.957040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97a63950-3a5b-4911-ac97-479b24187ac9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.100116 Nov 27 20:56:17.958561 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1798/3443] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:17 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:17.981491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:17.982253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:17.992520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:17.994638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:17.995814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:17.998852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:18.390540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:18.399788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:18.404562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:18.417796 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2cc6069-808c-433c-9be2-ab5fc669a066 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.624865 Nov 27 20:56:18.418373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1646/3444] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:17 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:18.422949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:18.424278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:18.442013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:18.442937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:18.444200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:18.444860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:18.528537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:18.538639 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1aff42f5-9592-4a20-936c-83583724df7d tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1315 microversion: 2.1 time: 0.562878 Nov 27 20:56:18.549319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1799/3445] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:17 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:18.605791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:18.624406 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62dfa1b2-7443-410d-8c33-1bca6a35a38e tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1270 microversion: 2.1 time: 0.204756 Nov 27 20:56:18.637293 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1647/3446] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:18 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:18.969771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85540171-f0c5-476c-95bb-1552ca82b045 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:18.970587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85540171-f0c5-476c-95bb-1552ca82b045 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:18.981671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85540171-f0c5-476c-95bb-1552ca82b045 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:18.983656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85540171-f0c5-476c-95bb-1552ca82b045 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:18.985891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85540171-f0c5-476c-95bb-1552ca82b045 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:18.987114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85540171-f0c5-476c-95bb-1552ca82b045 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:19.081366 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85540171-f0c5-476c-95bb-1552ca82b045 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.112791 Nov 27 20:56:19.084447 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1800/3447] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:18 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:19.445566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:19.446727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:19.465554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:19.466215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:19.467215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:19.468322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:19.563496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:19.565693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:19.578051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:19.578710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:19.579799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:19.581980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:19.930557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:19.941092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:19.951305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:19.952739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f1446e3-d851-44d2-848f-dbda9b6f1c25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 1872 microversion: 2.42 time: 0.515019 Nov 27 20:56:19.956649 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1648/3448] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:19 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 1872 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:19.961534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:19.962269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:19.975129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:19.975767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:19.976613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:19.977451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:20.170633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:20.187380 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60afcf22-4ab6-4550-b112-f0632839db06 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1315 microversion: 2.1 time: 0.634235 Nov 27 20:56:20.197035 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1801/3449] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:19 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:20.206647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-339aa9f0-4c84-488d-94c3-55e95e6076db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:20.207973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-339aa9f0-4c84-488d-94c3-55e95e6076db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:20.219341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-339aa9f0-4c84-488d-94c3-55e95e6076db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:20.220221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-339aa9f0-4c84-488d-94c3-55e95e6076db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:20.223043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-339aa9f0-4c84-488d-94c3-55e95e6076db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:20.224235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-339aa9f0-4c84-488d-94c3-55e95e6076db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:20.322621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-339aa9f0-4c84-488d-94c3-55e95e6076db tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.118568 Nov 27 20:56:20.334235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1802/3450] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:20 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:20.399034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:20.409705 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bedf3852-ff0b-4322-a806-cc8f9eedd6e0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1312 microversion: 2.1 time: 0.451724 Nov 27 20:56:20.410293 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1649/3451] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:19 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1312 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:20.942917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-87bb6e45-b4eb-437a-b415-2d743a47069d req-56cd329a-6980-492e-a607-b9f29f37e3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae0497d-307e-4b5d-bf33-4aa2bc4ff484", "name": "network-vif-plugged", "status": "completed", "tag": "6fb19fc5-4537-4ccf-9fc1-97b530aaff0b"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:20.946877 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:20.946877 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:20.973934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:20.975302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:20.977370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-87bb6e45-b4eb-437a-b415-2d743a47069d req-56cd329a-6980-492e-a607-b9f29f37e3d9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:20.978008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-87bb6e45-b4eb-437a-b415-2d743a47069d req-56cd329a-6980-492e-a607-b9f29f37e3d9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:20.989076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:20.990403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:20.991759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:20.992472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:21.011395 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-87bb6e45-b4eb-437a-b415-2d743a47069d req-56cd329a-6980-492e-a607-b9f29f37e3d9 service nova] Creating event network-vif-plugged:6fb19fc5-4537-4ccf-9fc1-97b530aaff0b for instance 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 on nch1-master-1 Nov 27 20:56:21.033611 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-87bb6e45-b4eb-437a-b415-2d743a47069d req-56cd329a-6980-492e-a607-b9f29f37e3d9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102575 Nov 27 20:56:21.043924 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1803/3452] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:21.217668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:21.219241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:21.238454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:21.243042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:21.247513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:21.249696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:21.727164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:21.748986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:21.753234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:21.754763 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d00d1d9a-15c5-4d99-a3df-761d5e42da0b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2829 microversion: 2.42 time: 0.784588 Nov 27 20:56:21.755884 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1650/3453] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:56:20 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2829 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:21.763118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-83b20dcc-0d6b-43c3-8416-5b49af51df9d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:21.764971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-83b20dcc-0d6b-43c3-8416-5b49af51df9d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:21.774629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83b20dcc-0d6b-43c3-8416-5b49af51df9d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:21.775190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83b20dcc-0d6b-43c3-8416-5b49af51df9d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:21.776823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83b20dcc-0d6b-43c3-8416-5b49af51df9d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:21.778425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83b20dcc-0d6b-43c3-8416-5b49af51df9d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:21.864493 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-83b20dcc-0d6b-43c3-8416-5b49af51df9d tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.106747 Nov 27 20:56:21.865727 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1651/3454] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:21 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:21.871852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:21.872557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:21.904590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:21.905049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:21.905888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:21.906308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:22.039793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:22.062459 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b204d403-f314-418c-9d64-0759b9bc46a3 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1315 microversion: 2.1 time: 0.852927 Nov 27 20:56:22.069910 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1804/3455] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:21 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:22.082019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-297aa91a-5203-4512-b744-119fe23af3a2 req-584532aa-f4d5-49b9-8fd1-0115617b5421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9f1f68-ad07-4e06-9ae6-26f62f73982c", "tag": "694875b8-34bd-49ed-9e03-a417fefec552"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:22.088321 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:22.088321 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:22.102297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-297aa91a-5203-4512-b744-119fe23af3a2 req-584532aa-f4d5-49b9-8fd1-0115617b5421 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:22.102969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-297aa91a-5203-4512-b744-119fe23af3a2 req-584532aa-f4d5-49b9-8fd1-0115617b5421 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:22.124799 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-297aa91a-5203-4512-b744-119fe23af3a2 req-584532aa-f4d5-49b9-8fd1-0115617b5421 service nova] Creating event network-changed:694875b8-34bd-49ed-9e03-a417fefec552 for instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c on nch1-master-1 Nov 27 20:56:22.140603 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-297aa91a-5203-4512-b744-119fe23af3a2 req-584532aa-f4d5-49b9-8fd1-0115617b5421 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066857 Nov 27 20:56:22.142470 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1805/3456] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:22.160862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddfa2887-5b63-4148-9b7c-b275c3020ed4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:22.161649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddfa2887-5b63-4148-9b7c-b275c3020ed4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:22.169221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfa2887-5b63-4148-9b7c-b275c3020ed4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:22.169961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfa2887-5b63-4148-9b7c-b275c3020ed4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:22.171036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfa2887-5b63-4148-9b7c-b275c3020ed4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:22.171933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfa2887-5b63-4148-9b7c-b275c3020ed4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:22.202582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:22.218306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e462a36d-004f-4b01-973d-e19d9ebb0e3c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1312 microversion: 2.1 time: 0.348072 Nov 27 20:56:22.219689 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1652/3457] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:21 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:22.485667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddfa2887-5b63-4148-9b7c-b275c3020ed4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.339281 Nov 27 20:56:22.487156 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1806/3458] 10.222.0.21 () {60 vars in 1315 bytes} [Sat Nov 27 20:56:22 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/os-interface => generated 1831 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:22.876616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-385049a8-3432-4534-a438-594281c5c9a4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:22.877676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-385049a8-3432-4534-a438-594281c5c9a4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:22.890697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-385049a8-3432-4534-a438-594281c5c9a4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:22.893646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-385049a8-3432-4534-a438-594281c5c9a4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:22.895739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-385049a8-3432-4534-a438-594281c5c9a4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:22.898106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-385049a8-3432-4534-a438-594281c5c9a4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:22.975562 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-385049a8-3432-4534-a438-594281c5c9a4 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.103351 Nov 27 20:56:22.976581 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1653/3459] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:22 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:23.081446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:23.082272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:23.098115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:23.098834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:23.101835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:23.102586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:23.237945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:23.239953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:23.257311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:23.258162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:23.259489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:23.260643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:23.904669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:23.918787 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e266e0b-285f-43dc-ad4e-ef8aefa26b68 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1312 microversion: 2.1 time: 0.684890 Nov 27 20:56:23.921709 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1654/3460] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:23 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1312 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:23.988715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2fbfc58-093b-4e09-aef2-89efad293473 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:23.989859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2fbfc58-093b-4e09-aef2-89efad293473 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:24.002678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2fbfc58-093b-4e09-aef2-89efad293473 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.004577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2fbfc58-093b-4e09-aef2-89efad293473 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.006005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2fbfc58-093b-4e09-aef2-89efad293473 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.009758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2fbfc58-093b-4e09-aef2-89efad293473 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.081010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2fbfc58-093b-4e09-aef2-89efad293473 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.097988 Nov 27 20:56:24.082352 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1655/3461] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:23 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:24.311092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:24.318941 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-260b67d8-a181-4091-8d54-9b9227be7863 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1503 microversion: 2.1 time: 1.241611 Nov 27 20:56:24.321699 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1807/3462] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:23 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1503 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:24.337289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af9d985e-b0b2-499e-af1c-ff2c5f43b2d9 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:24.338581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af9d985e-b0b2-499e-af1c-ff2c5f43b2d9 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:24.353448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af9d985e-b0b2-499e-af1c-ff2c5f43b2d9 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.354797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af9d985e-b0b2-499e-af1c-ff2c5f43b2d9 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.358590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af9d985e-b0b2-499e-af1c-ff2c5f43b2d9 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.361178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af9d985e-b0b2-499e-af1c-ff2c5f43b2d9 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.579566 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af9d985e-b0b2-499e-af1c-ff2c5f43b2d9 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.246687 Nov 27 20:56:24.580212 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1656/3463] 10.222.0.21 () {58 vars in 1295 bytes} [Sat Nov 27 20:56:24 2021] DELETE /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484/os-server-password => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:24.592303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f68befe6-4a6a-4214-8a3b-5e26c1b5161b tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:24.593052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f68befe6-4a6a-4214-8a3b-5e26c1b5161b tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:24.606870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f68befe6-4a6a-4214-8a3b-5e26c1b5161b tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.607393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f68befe6-4a6a-4214-8a3b-5e26c1b5161b tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.613166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f68befe6-4a6a-4214-8a3b-5e26c1b5161b tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.613973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f68befe6-4a6a-4214-8a3b-5e26c1b5161b tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.674933 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f68befe6-4a6a-4214-8a3b-5e26c1b5161b tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.088614 Nov 27 20:56:24.675614 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1808/3464] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:56:24 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484/os-server-password => generated 16 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 20:56:24.688426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:24.689364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:24.696959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.697714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.698792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.699582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.732463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:56:24.859164 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-815379c4-42d2-4be0-82d6-39738aaf320a tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 204 len: 0 microversion: 2.1 time: 0.173360 Nov 27 20:56:24.859164 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1657/3465] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:24 2021] DELETE /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:24.868331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:24.869283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:24.882656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.884742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.886038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.889327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.938219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:24.939080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:24.956590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.957172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:24.958234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:24.958795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:25.767292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:25.777577 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ba489b6-e4bf-4eca-8dfb-a25504b41864 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1509 microversion: 2.1 time: 0.914054 Nov 27 20:56:25.784929 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1809/3466] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:24 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1509 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:25.801983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5ea0b3f1-6209-4b84-9ff9-85d53db192a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:25.803195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5ea0b3f1-6209-4b84-9ff9-85d53db192a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:25.811045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ea0b3f1-6209-4b84-9ff9-85d53db192a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:25.811864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ea0b3f1-6209-4b84-9ff9-85d53db192a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:25.812846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ea0b3f1-6209-4b84-9ff9-85d53db192a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:25.813444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ea0b3f1-6209-4b84-9ff9-85d53db192a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:25.898463 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5ea0b3f1-6209-4b84-9ff9-85d53db192a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.107370 Nov 27 20:56:25.900853 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1810/3467] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:25 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:26.257461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:26.270036 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2623823e-d029-4e46-910c-4f0253d282b0 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1312 microversion: 2.1 time: 1.335704 Nov 27 20:56:26.284974 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1658/3468] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:24 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1312 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:26.802692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:26.803507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:26.831828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:26.833323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:26.834293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:26.834897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:26.914173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97c933ab-c0e5-456d-b59f-0a37b92222bb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:26.915380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-97c933ab-c0e5-456d-b59f-0a37b92222bb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:26.921760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97c933ab-c0e5-456d-b59f-0a37b92222bb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:26.922471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97c933ab-c0e5-456d-b59f-0a37b92222bb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:26.923525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97c933ab-c0e5-456d-b59f-0a37b92222bb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:26.924141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97c933ab-c0e5-456d-b59f-0a37b92222bb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:26.970916 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97c933ab-c0e5-456d-b59f-0a37b92222bb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.059715 Nov 27 20:56:26.971806 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1659/3469] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:26 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:27.080017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-670f124d-a20d-4f89-b6b9-653d76b9bb9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:27.082788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-670f124d-a20d-4f89-b6b9-653d76b9bb9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:27.100339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f124d-a20d-4f89-b6b9-653d76b9bb9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:27.101763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f124d-a20d-4f89-b6b9-653d76b9bb9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:27.106292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f124d-a20d-4f89-b6b9-653d76b9bb9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:27.107073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f124d-a20d-4f89-b6b9-653d76b9bb9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:27.194048 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-670f124d-a20d-4f89-b6b9-653d76b9bb9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 14 microversion: 2.42 time: 0.127089 Nov 27 20:56:27.194609 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1660/3470] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:27 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:27.206479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0c6b2146-260e-4d2a-aacb-eb6070ce2e86 req-b8fb73c3-982a-4d89-ae28-92a0f3a228c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "tag": "03e5badb-8172-486f-9775-23060da4f0c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:27.213486 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:27.213486 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:27.233071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0c6b2146-260e-4d2a-aacb-eb6070ce2e86 req-b8fb73c3-982a-4d89-ae28-92a0f3a228c6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:27.234423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0c6b2146-260e-4d2a-aacb-eb6070ce2e86 req-b8fb73c3-982a-4d89-ae28-92a0f3a228c6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:27.271424 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0c6b2146-260e-4d2a-aacb-eb6070ce2e86 req-b8fb73c3-982a-4d89-ae28-92a0f3a228c6 service nova] Creating event network-changed:03e5badb-8172-486f-9775-23060da4f0c7 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 20:56:27.288281 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0c6b2146-260e-4d2a-aacb-eb6070ce2e86 req-b8fb73c3-982a-4d89-ae28-92a0f3a228c6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092108 Nov 27 20:56:27.288886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1661/3471] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:27.303401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:27.305557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:27.322797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:27.326160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:27.328487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:27.329099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:27.984134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:27.999736 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-654d9f42-afb8-4d49-8d3e-17b1c2c8bbee tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1312 microversion: 2.1 time: 0.706808 Nov 27 20:56:27.999736 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1662/3472] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:27 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1312 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:28.008750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-01489f63-63c1-4b8c-81a4-c7d5bea867ac tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:28.012394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-01489f63-63c1-4b8c-81a4-c7d5bea867ac tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:28.012839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed72c3ee9064f34aa08e7b328100a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79be4e7871e9465b82698fe64c318285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:28.038549 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71f5b3d7-8e2a-4098-b7d1-4aabc675242c tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 200 len: 1509 microversion: 2.1 time: 1.239103 Nov 27 20:56:28.040409 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1811/3473] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:26 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 1509 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:28.043901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01489f63-63c1-4b8c-81a4-c7d5bea867ac tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:28.047699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01489f63-63c1-4b8c-81a4-c7d5bea867ac tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:28.050732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01489f63-63c1-4b8c-81a4-c7d5bea867ac tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:28.051476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01489f63-63c1-4b8c-81a4-c7d5bea867ac tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:28.135060 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-01489f63-63c1-4b8c-81a4-c7d5bea867ac tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.133308 Nov 27 20:56:28.140956 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1663/3474] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:27 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:28.206515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f9aa4c4-d85e-431c-a15d-6e28955d8196 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:28.207721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f9aa4c4-d85e-431c-a15d-6e28955d8196 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:28.218947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f9aa4c4-d85e-431c-a15d-6e28955d8196 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:28.220966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f9aa4c4-d85e-431c-a15d-6e28955d8196 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:28.224749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f9aa4c4-d85e-431c-a15d-6e28955d8196 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:28.225426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f9aa4c4-d85e-431c-a15d-6e28955d8196 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:28.313954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f9aa4c4-d85e-431c-a15d-6e28955d8196 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 14 microversion: 2.42 time: 0.111620 Nov 27 20:56:28.315097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1812/3475] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:28 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:29.014908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:29.015542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:29.026797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.032906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.033971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.034567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.059805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:29.061107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] [instance: 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:29.083413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.083874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.084698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.085354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.121193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] HTTP exception thrown: Instance 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 could not be found. Nov 27 20:56:29.122362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] Returning 404 to user: Instance 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:29.123413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0161a86c-0ce6-468a-b031-c92c33cd1439 tempest-ServerPasswordTestJSON-1614638584 tempest-ServerPasswordTestJSON-1614638584-project] 10.222.0.21 "GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484" status: 404 len: 111 microversion: 2.1 time: 0.068583 Nov 27 20:56:29.124566 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1813/3476] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:29 2021] GET /compute/v2.1/servers/6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:56:29.148507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-546abddd-fef4-4016-b3c9-cfbfeb869dd5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:29.149777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-546abddd-fef4-4016-b3c9-cfbfeb869dd5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:29.171011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546abddd-fef4-4016-b3c9-cfbfeb869dd5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.171484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546abddd-fef4-4016-b3c9-cfbfeb869dd5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.172285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546abddd-fef4-4016-b3c9-cfbfeb869dd5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.172725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-546abddd-fef4-4016-b3c9-cfbfeb869dd5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.231922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-546abddd-fef4-4016-b3c9-cfbfeb869dd5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.086876 Nov 27 20:56:29.232614 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1814/3477] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:29 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:29.326440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25f27941-9bf3-4371-a9cd-0ef401dc197f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:29.327808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-25f27941-9bf3-4371-a9cd-0ef401dc197f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:29.340839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25f27941-9bf3-4371-a9cd-0ef401dc197f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.341752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25f27941-9bf3-4371-a9cd-0ef401dc197f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.346835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25f27941-9bf3-4371-a9cd-0ef401dc197f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.349951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25f27941-9bf3-4371-a9cd-0ef401dc197f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.469309 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25f27941-9bf3-4371-a9cd-0ef401dc197f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 14 microversion: 2.42 time: 0.147631 Nov 27 20:56:29.475039 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1815/3478] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:29 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:29.482856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e64ce995-4438-485f-bda2-81668f13918c req-6cd7903b-12f0-4071-9d23-decc075132f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae0497d-307e-4b5d-bf33-4aa2bc4ff484", "name": "network-vif-deleted", "tag": "6fb19fc5-4537-4ccf-9fc1-97b530aaff0b"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:29.492420 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:29.492420 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:29.514192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e64ce995-4438-485f-bda2-81668f13918c req-6cd7903b-12f0-4071-9d23-decc075132f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:29.515330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e64ce995-4438-485f-bda2-81668f13918c req-6cd7903b-12f0-4071-9d23-decc075132f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:29.529541 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e64ce995-4438-485f-bda2-81668f13918c req-6cd7903b-12f0-4071-9d23-decc075132f9 service nova] Creating event network-vif-deleted:6fb19fc5-4537-4ccf-9fc1-97b530aaff0b for instance 6ae0497d-307e-4b5d-bf33-4aa2bc4ff484 on nch1-master-1 Nov 27 20:56:29.535365 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e64ce995-4438-485f-bda2-81668f13918c req-6cd7903b-12f0-4071-9d23-decc075132f9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058592 Nov 27 20:56:29.536496 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1816/3479] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:29.650052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:29.665573 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-52c47317-ca42-41dc-ba85-7a017157317a tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1312 microversion: 2.1 time: 0.648676 Nov 27 20:56:29.670797 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1664/3480] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:29 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1312 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:29.996228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-54973307-5df1-4740-85cc-ead5453514dd req-27bab618-5c85-4791-8de5-36bad40d608b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9f1f68-ad07-4e06-9ae6-26f62f73982c", "name": "network-vif-plugged", "status": "completed", "tag": "694875b8-34bd-49ed-9e03-a417fefec552"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:30.003815 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:30.003815 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:30.033188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-54973307-5df1-4740-85cc-ead5453514dd req-27bab618-5c85-4791-8de5-36bad40d608b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:30.033601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-54973307-5df1-4740-85cc-ead5453514dd req-27bab618-5c85-4791-8de5-36bad40d608b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:30.086417 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-54973307-5df1-4740-85cc-ead5453514dd req-27bab618-5c85-4791-8de5-36bad40d608b service nova] Creating event network-vif-plugged:694875b8-34bd-49ed-9e03-a417fefec552 for instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c on nch1-master-1 Nov 27 20:56:30.101289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-54973307-5df1-4740-85cc-ead5453514dd req-27bab618-5c85-4791-8de5-36bad40d608b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133802 Nov 27 20:56:30.102457 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1817/3481] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:30.247906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1902fb5a-2a22-42e1-91fd-a621234c37b9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:30.249564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1902fb5a-2a22-42e1-91fd-a621234c37b9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:30.265218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1902fb5a-2a22-42e1-91fd-a621234c37b9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:30.268013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1902fb5a-2a22-42e1-91fd-a621234c37b9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:30.272349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1902fb5a-2a22-42e1-91fd-a621234c37b9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:30.273764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1902fb5a-2a22-42e1-91fd-a621234c37b9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:30.382089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1902fb5a-2a22-42e1-91fd-a621234c37b9 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.129195 Nov 27 20:56:30.384126 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1665/3482] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:30 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:30.484526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa0d48dc-9d26-41da-b5a2-a34685701fbf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:30.485848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa0d48dc-9d26-41da-b5a2-a34685701fbf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:30.497428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa0d48dc-9d26-41da-b5a2-a34685701fbf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:30.502341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa0d48dc-9d26-41da-b5a2-a34685701fbf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:30.504111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa0d48dc-9d26-41da-b5a2-a34685701fbf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:30.505661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa0d48dc-9d26-41da-b5a2-a34685701fbf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:30.557304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa0d48dc-9d26-41da-b5a2-a34685701fbf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 14 microversion: 2.42 time: 0.077614 Nov 27 20:56:30.558708 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1818/3483] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:30 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:30.693672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:30.701379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:30.743191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:30.743785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:30.756220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:30.758040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:31.396521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca564942-60af-49a7-8d72-4cb4a0c71c99 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:31.397700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca564942-60af-49a7-8d72-4cb4a0c71c99 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:31.463465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca564942-60af-49a7-8d72-4cb4a0c71c99 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:31.463935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca564942-60af-49a7-8d72-4cb4a0c71c99 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:31.464754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca564942-60af-49a7-8d72-4cb4a0c71c99 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:31.472252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca564942-60af-49a7-8d72-4cb4a0c71c99 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:31.487848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:31.499868 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-382d7bca-f897-43f5-8a7a-e476ef144ab4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1312 microversion: 2.1 time: 0.813928 Nov 27 20:56:31.513995 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1666/3484] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:30 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1312 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:31.569089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c4e6db8-1927-4cc0-b0bf-a028abccfde3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:31.570090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c4e6db8-1927-4cc0-b0bf-a028abccfde3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:31.570491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca564942-60af-49a7-8d72-4cb4a0c71c99 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.177374 Nov 27 20:56:31.582932 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1819/3485] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:31 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:31.596339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c4e6db8-1927-4cc0-b0bf-a028abccfde3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:31.596805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c4e6db8-1927-4cc0-b0bf-a028abccfde3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:31.597624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c4e6db8-1927-4cc0-b0bf-a028abccfde3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:31.598073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c4e6db8-1927-4cc0-b0bf-a028abccfde3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:31.666718 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c4e6db8-1927-4cc0-b0bf-a028abccfde3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 14 microversion: 2.42 time: 0.101335 Nov 27 20:56:31.669587 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1667/3486] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:31 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:32.526434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:32.527867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:32.544876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:32.545506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:32.546454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:32.547062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:32.586535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-691bb497-1ced-4d25-a908-1ea5c123dc0f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:32.588393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-691bb497-1ced-4d25-a908-1ea5c123dc0f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:32.601779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691bb497-1ced-4d25-a908-1ea5c123dc0f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:32.601988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691bb497-1ced-4d25-a908-1ea5c123dc0f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:32.603010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691bb497-1ced-4d25-a908-1ea5c123dc0f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:32.603520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691bb497-1ced-4d25-a908-1ea5c123dc0f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:32.674287 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-691bb497-1ced-4d25-a908-1ea5c123dc0f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.091948 Nov 27 20:56:32.678226 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1668/3487] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:32 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:32.687418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87f9c1ca-c9ac-41cd-8f85-b000f7c8cf41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:32.688449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87f9c1ca-c9ac-41cd-8f85-b000f7c8cf41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:32.713242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87f9c1ca-c9ac-41cd-8f85-b000f7c8cf41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:32.713953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87f9c1ca-c9ac-41cd-8f85-b000f7c8cf41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:32.714947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87f9c1ca-c9ac-41cd-8f85-b000f7c8cf41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:32.715581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87f9c1ca-c9ac-41cd-8f85-b000f7c8cf41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:32.791579 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87f9c1ca-c9ac-41cd-8f85-b000f7c8cf41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 14 microversion: 2.42 time: 0.109447 Nov 27 20:56:32.796132 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1669/3488] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:32 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:33.242598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:33.265405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68bd6c3d-e825-49d3-94f8-d0b544e5e311 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1497 microversion: 2.1 time: 0.747288 Nov 27 20:56:33.270774 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1820/3489] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:32 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1497 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:33.285843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1c70370-e20f-4f18-9e9a-33694ffbf5fa tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:33.360940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_groups [None req-a1c70370-e20f-4f18-9e9a-33694ffbf5fa tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Querying cell fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) for 1 instances {{(pid=135679) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 27 20:56:33.388059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1c70370-e20f-4f18-9e9a-33694ffbf5fa tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.388476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1c70370-e20f-4f18-9e9a-33694ffbf5fa tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.464707 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a1c70370-e20f-4f18-9e9a-33694ffbf5fa tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups/c92b9628-904b-4b67-b0c3-33097a4d4bd6" status: 200 len: 221 microversion: 2.1 time: 0.183456 Nov 27 20:56:33.469971 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1670/3490] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:56:33 2021] GET /compute/v2.1/os-server-groups/c92b9628-904b-4b67-b0c3-33097a4d4bd6 => generated 221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:33.479156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:33.479611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:33.503105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.505279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.508731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.509011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.565537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:56:33.686383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37a4463f-ed5f-40d3-a39c-408cfc82eeed tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:33.687466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37a4463f-ed5f-40d3-a39c-408cfc82eeed tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:33.719241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a4463f-ed5f-40d3-a39c-408cfc82eeed tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.724526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a4463f-ed5f-40d3-a39c-408cfc82eeed tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.725465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a4463f-ed5f-40d3-a39c-408cfc82eeed tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.726272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37a4463f-ed5f-40d3-a39c-408cfc82eeed tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.749353 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed1b3140-087e-41e0-bc38-e55afb1c45a8 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 204 len: 0 microversion: 2.1 time: 0.275789 Nov 27 20:56:33.750217 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1821/3491] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:33 2021] DELETE /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:33.761411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:33.762427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:33.771157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.771964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.772951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.773574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.856831 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-37a4463f-ed5f-40d3-a39c-408cfc82eeed tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.173826 Nov 27 20:56:33.857951 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1671/3492] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:33 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:33.872450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8071c4d6-5079-47d3-ba59-40c137334efc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:33.880404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8071c4d6-5079-47d3-ba59-40c137334efc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:33.896608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8071c4d6-5079-47d3-ba59-40c137334efc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.898953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8071c4d6-5079-47d3-ba59-40c137334efc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.902620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8071c4d6-5079-47d3-ba59-40c137334efc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:33.904291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8071c4d6-5079-47d3-ba59-40c137334efc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:33.997855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8071c4d6-5079-47d3-ba59-40c137334efc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 8207 microversion: 2.42 time: 0.137739 Nov 27 20:56:33.998899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1672/3493] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:33 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 8207 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:56:34.351156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:34.371269 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9533cca6-b067-4a04-9b37-8d3b03f44552 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1503 microversion: 2.1 time: 0.605124 Nov 27 20:56:34.372585 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1822/3494] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:33 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1503 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:34.869580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56696104-2706-4a84-b109-da739b0e163e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:34.870606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56696104-2706-4a84-b109-da739b0e163e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:34.893999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56696104-2706-4a84-b109-da739b0e163e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:34.903727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56696104-2706-4a84-b109-da739b0e163e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:34.904594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56696104-2706-4a84-b109-da739b0e163e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:34.905044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56696104-2706-4a84-b109-da739b0e163e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:34.997320 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56696104-2706-4a84-b109-da739b0e163e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.129970 Nov 27 20:56:35.003864 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1673/3495] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:34 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:35.010352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ffb6790-411b-49ab-93c1-657175a79082 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:35.011542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ffb6790-411b-49ab-93c1-657175a79082 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:35.020343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ffb6790-411b-49ab-93c1-657175a79082 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:35.020802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ffb6790-411b-49ab-93c1-657175a79082 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:35.021603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ffb6790-411b-49ab-93c1-657175a79082 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:35.022049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ffb6790-411b-49ab-93c1-657175a79082 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:35.092402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ffb6790-411b-49ab-93c1-657175a79082 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 16400 microversion: 2.42 time: 0.086438 Nov 27 20:56:35.093818 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1823/3496] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:35 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 16400 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:35.393041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:35.394144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:35.407236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:35.409142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:35.412075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:35.413439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:35.520014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-93b4105f-fece-4078-872a-f7113e19a8b9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'create', calling method: .version_select at 0x7f15c6d38280>, body: {"keypair": {"name": "tempest-keypair-397718798"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:35.558224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-93b4105f-fece-4078-872a-f7113e19a8b9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:35.566342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-93b4105f-fece-4078-872a-f7113e19a8b9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for user dcb3f0e11efd43278f9c4c34f7eda52d and project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:35.980264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:35.989032 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7b696e8c-df27-4ec2-b909-5f463116e108 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1503 microversion: 2.1 time: 0.601640 Nov 27 20:56:35.995648 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1824/3497] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:35 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1503 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:36.013764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce194b20-f97d-4272-b01e-4fa118d150a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:36.015524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce194b20-f97d-4272-b01e-4fa118d150a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:36.040468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce194b20-f97d-4272-b01e-4fa118d150a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:36.047930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce194b20-f97d-4272-b01e-4fa118d150a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:36.048798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce194b20-f97d-4272-b01e-4fa118d150a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:36.049242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce194b20-f97d-4272-b01e-4fa118d150a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:36.118400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce194b20-f97d-4272-b01e-4fa118d150a5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.108199 Nov 27 20:56:36.119935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1825/3498] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:36 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:36.133665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-337439cd-f53b-4491-9937-6a1b00d3db29 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:36.136244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-337439cd-f53b-4491-9937-6a1b00d3db29 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:36.146422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337439cd-f53b-4491-9937-6a1b00d3db29 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:36.147080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337439cd-f53b-4491-9937-6a1b00d3db29 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:36.148685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337439cd-f53b-4491-9937-6a1b00d3db29 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:36.149359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-337439cd-f53b-4491-9937-6a1b00d3db29 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:36.210370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-337439cd-f53b-4491-9937-6a1b00d3db29 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 16400 microversion: 2.42 time: 0.083825 Nov 27 20:56:36.211292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1826/3499] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:36 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 16400 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:36.215743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-93b4105f-fece-4078-872a-f7113e19a8b9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:36.222697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-93b4105f-fece-4078-872a-f7113e19a8b9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for user dcb3f0e11efd43278f9c4c34f7eda52d and project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:36.241251 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-93b4105f-fece-4078-872a-f7113e19a8b9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.905923 Nov 27 20:56:36.242249 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1674/3500] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 20:56:35 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:36.416943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c8f67ad-183c-4a2c-b3dc-01e9b9290d31 tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15c739f5e0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:36.552298 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c8f67ad-183c-4a2c-b3dc-01e9b9290d31 tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/95f9b732-81b6-4bd4-8cb1-f126d3291900" status: 200 len: 343 microversion: 2.1 time: 0.139495 Nov 27 20:56:36.555297 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1827/3501] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 20:56:36 2021] GET /compute/v2.1/os-volumes/95f9b732-81b6-4bd4-8cb1-f126d3291900 => generated 343 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:37.014048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:37.014898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:37.036179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:37.037256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:37.038686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:37.043007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:37.229565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2090854057", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "39b4c68b-6f2a-4d98-a40b-89a7cdc47e01"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:37.347045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] validate_networks() for [('39b4c68b-6f2a-4d98-a40b-89a7cdc47e01', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:56:37.714684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b2bfa328264fb39c380fe21eae79cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0000db558e40a5a68130b07178b447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:37.732996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c419ba4c-99b9-4ea8-80b7-e55c0b3f33f4 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 200 len: 1461 microversion: 2.1 time: 0.724726 Nov 27 20:56:37.736317 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1675/3502] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:37 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 1461 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:37.742896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1f3392d-b334-411a-b682-76b0ebfd210a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:37.748081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b1f3392d-b334-411a-b682-76b0ebfd210a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:37.772116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1f3392d-b334-411a-b682-76b0ebfd210a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:37.775348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1f3392d-b334-411a-b682-76b0ebfd210a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:37.781962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1f3392d-b334-411a-b682-76b0ebfd210a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:37.782755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1f3392d-b334-411a-b682-76b0ebfd210a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:37.882694 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1f3392d-b334-411a-b682-76b0ebfd210a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.141518 Nov 27 20:56:37.884298 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1676/3503] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:37 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:37.893678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1124c041-9663-4782-824e-5684c11c5ff8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:37.906474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1124c041-9663-4782-824e-5684c11c5ff8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:37.925666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1124c041-9663-4782-824e-5684c11c5ff8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:37.928841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1124c041-9663-4782-824e-5684c11c5ff8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:37.932131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1124c041-9663-4782-824e-5684c11c5ff8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:37.932855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1124c041-9663-4782-824e-5684c11c5ff8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.021604 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1124c041-9663-4782-824e-5684c11c5ff8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 16400 microversion: 2.42 time: 0.134383 Nov 27 20:56:38.027161 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1677/3504] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:37 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 16400 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:38.037697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fa720f46-0e43-4dcd-aef4-500a654a7b75 req-158fdf20-5922-4c54-8bcf-046c499ae7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9f1f68-ad07-4e06-9ae6-26f62f73982c", "name": "network-vif-deleted", "tag": "694875b8-34bd-49ed-9e03-a417fefec552"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:38.054939 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:38.054939 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:38.072514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fa720f46-0e43-4dcd-aef4-500a654a7b75 req-158fdf20-5922-4c54-8bcf-046c499ae7e7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.074553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fa720f46-0e43-4dcd-aef4-500a654a7b75 req-158fdf20-5922-4c54-8bcf-046c499ae7e7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.104929 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fa720f46-0e43-4dcd-aef4-500a654a7b75 req-158fdf20-5922-4c54-8bcf-046c499ae7e7 service nova] Creating event network-vif-deleted:694875b8-34bd-49ed-9e03-a417fefec552 for instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c on nch1-master-1 Nov 27 20:56:38.124016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fa720f46-0e43-4dcd-aef4-500a654a7b75 req-158fdf20-5922-4c54-8bcf-046c499ae7e7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090227 Nov 27 20:56:38.124785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1678/3505] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:38.233939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:56:38.234555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:56:38.235029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:56:38.235514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:56:38.236350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:56:38.253911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ba598a5f-e70b-451b-bb61-57e6c57fce6e tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15d92da430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:38.260066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.262593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.283271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.284201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.350927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:38.363903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for user ed87ef17973a49f2a9108bdfbff65415 and project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:38.365999 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ba598a5f-e70b-451b-bb61-57e6c57fce6e tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/017cc740-160e-4436-b5fe-9bea1135da69" status: 200 len: 344 microversion: 2.1 time: 0.117638 Nov 27 20:56:38.366827 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1679/3506] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 20:56:38 2021] GET /compute/v2.1/os-volumes/017cc740-160e-4436-b5fe-9bea1135da69 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:56:38.430088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:56:38.433528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:56:38.541437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cc7fdd98-9358-4dfa-87ee-480a0cd4acde tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.477204 Nov 27 20:56:38.547967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1828/3507] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:56:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:56:38.553327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ce85ca8-c49d-451c-9b21-d0248cf6166c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:38.554305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ce85ca8-c49d-451c-9b21-d0248cf6166c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:38.754921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:38.755870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:38.776541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.778274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.791291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.792450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.843332 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] HTTP exception thrown: Instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c could not be found. Nov 27 20:56:38.844292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Returning 404 to user: Instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:38.845445 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2208869b-1789-46b8-baf2-c950879928a7 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 404 len: 111 microversion: 2.1 time: 0.096257 Nov 27 20:56:38.847194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1829/3508] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:38 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:38.864621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed7484df-4b2c-4fef-94ec-10257b21af21 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:38.888267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0ce85ca8-c49d-451c-9b21-d0248cf6166c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:38.898601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_groups [None req-ed7484df-4b2c-4fef-94ec-10257b21af21 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Querying cell fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) for 1 instances {{(pid=135680) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 27 20:56:38.900371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7484df-4b2c-4fef-94ec-10257b21af21 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.900829 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ce85ca8-c49d-451c-9b21-d0248cf6166c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1215 microversion: 2.1 time: 0.350143 Nov 27 20:56:38.901983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1680/3509] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:38 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1215 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:38.902763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7484df-4b2c-4fef-94ec-10257b21af21 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.918255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0abbcb1d-1507-4896-acad-7d60aeefed84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:38.924114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0abbcb1d-1507-4896-acad-7d60aeefed84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:38.933684 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed7484df-4b2c-4fef-94ec-10257b21af21 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.076785 Nov 27 20:56:38.935556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1830/3510] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 20:56:38 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:38.943713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0abbcb1d-1507-4896-acad-7d60aeefed84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.944181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0abbcb1d-1507-4896-acad-7d60aeefed84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.945160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0abbcb1d-1507-4896-acad-7d60aeefed84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.945618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0abbcb1d-1507-4896-acad-7d60aeefed84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:38.949603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-774a5a73-006e-4c0a-b976-0fc622732692 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:38.974819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_groups [None req-774a5a73-006e-4c0a-b976-0fc622732692 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Querying cell fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) for 1 instances {{(pid=135680) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 27 20:56:38.976860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-774a5a73-006e-4c0a-b976-0fc622732692 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:38.978790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-774a5a73-006e-4c0a-b976-0fc622732692 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.012510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-774a5a73-006e-4c0a-b976-0fc622732692 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/os-server-groups/c92b9628-904b-4b67-b0c3-33097a4d4bd6" status: 200 len: 183 microversion: 2.1 time: 0.068549 Nov 27 20:56:39.013816 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1831/3511] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:56:38 2021] GET /compute/v2.1/os-server-groups/c92b9628-904b-4b67-b0c3-33097a4d4bd6 => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:39.031128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.032662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:39.047878 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0abbcb1d-1507-4896-acad-7d60aeefed84 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.142420 Nov 27 20:56:39.059535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.065244 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1681/3512] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:38 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:39.066160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.067489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.067989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.082284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b3c81ee-8eee-4a7a-a2c4-7d6aaba04bc0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:39.101148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b3c81ee-8eee-4a7a-a2c4-7d6aaba04bc0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:39.113701 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] HTTP exception thrown: Instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c could not be found. Nov 27 20:56:39.116924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Returning 404 to user: Instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:39.120423 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b791720-6f99-458e-8a01-4653e602ec0b tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 404 len: 111 microversion: 2.1 time: 0.097055 Nov 27 20:56:39.124786 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1832/3513] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:39 2021] DELETE /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:39.133068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b3c81ee-8eee-4a7a-a2c4-7d6aaba04bc0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.134925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b3c81ee-8eee-4a7a-a2c4-7d6aaba04bc0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.137483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b3c81ee-8eee-4a7a-a2c4-7d6aaba04bc0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.137948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b3c81ee-8eee-4a7a-a2c4-7d6aaba04bc0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.140539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.141767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] [instance: 8f9f1f68-ad07-4e06-9ae6-26f62f73982c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:39.166900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.171429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.172150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.177640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.255394 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b3c81ee-8eee-4a7a-a2c4-7d6aaba04bc0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.185681 Nov 27 20:56:39.256342 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1682/3514] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:39 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:39.260538 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] HTTP exception thrown: Instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c could not be found. Nov 27 20:56:39.260538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Returning 404 to user: Instance 8f9f1f68-ad07-4e06-9ae6-26f62f73982c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:39.268219 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9de8e789-2ff8-4cdb-8c6d-1cf0fb85873f tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c" status: 404 len: 111 microversion: 2.1 time: 0.133052 Nov 27 20:56:39.268926 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1833/3515] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:39 2021] GET /compute/v2.1/servers/8f9f1f68-ad07-4e06-9ae6-26f62f73982c => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:39.278539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6afb645-cb61-49a0-a327-d4ce0162652c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.298906 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f6afb645-cb61-49a0-a327-d4ce0162652c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] HTTP exception thrown: Instance group a736c857-ab57-4deb-b57a-5c672953de5b could not be found. Nov 27 20:56:39.299671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6afb645-cb61-49a0-a327-d4ce0162652c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Returning 404 to user: Instance group a736c857-ab57-4deb-b57a-5c672953de5b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:39.300564 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6afb645-cb61-49a0-a327-d4ce0162652c tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/a736c857-ab57-4deb-b57a-5c672953de5b" status: 404 len: 117 microversion: 2.1 time: 0.027294 Nov 27 20:56:39.302427 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1683/3516] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:39 2021] DELETE /compute/v2.1/os-server-groups/a736c857-ab57-4deb-b57a-5c672953de5b => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:39.313360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-224b7bde-2023-4c6e-b361-5a78c11eab77 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.333372 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-224b7bde-2023-4c6e-b361-5a78c11eab77 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] HTTP exception thrown: Instance group d0587c82-77fd-4dd7-b24c-6941be361159 could not be found. Nov 27 20:56:39.333968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-224b7bde-2023-4c6e-b361-5a78c11eab77 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Returning 404 to user: Instance group d0587c82-77fd-4dd7-b24c-6941be361159 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:39.335582 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-224b7bde-2023-4c6e-b361-5a78c11eab77 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/d0587c82-77fd-4dd7-b24c-6941be361159" status: 404 len: 117 microversion: 2.1 time: 0.025728 Nov 27 20:56:39.350235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1834/3517] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:39 2021] DELETE /compute/v2.1/os-server-groups/d0587c82-77fd-4dd7-b24c-6941be361159 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:39.350534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e1e11b2-91e4-4444-b563-b630b1ac2c45 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.382132 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-7e1e11b2-91e4-4444-b563-b630b1ac2c45 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] HTTP exception thrown: Instance group 66b17366-9c0c-41f0-998f-f7d3b7138bfe could not be found. Nov 27 20:56:39.383799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e1e11b2-91e4-4444-b563-b630b1ac2c45 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Returning 404 to user: Instance group 66b17366-9c0c-41f0-998f-f7d3b7138bfe could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:39.388570 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e1e11b2-91e4-4444-b563-b630b1ac2c45 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/66b17366-9c0c-41f0-998f-f7d3b7138bfe" status: 404 len: 117 microversion: 2.1 time: 0.045373 Nov 27 20:56:39.396342 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1684/3518] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:39 2021] DELETE /compute/v2.1/os-server-groups/66b17366-9c0c-41f0-998f-f7d3b7138bfe => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:39.398861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85c0756e-f612-4706-b616-08b12b49cca1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.411244 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-85c0756e-f612-4706-b616-08b12b49cca1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] HTTP exception thrown: Instance group df180887-c748-4220-a265-88bd661fc493 could not be found. Nov 27 20:56:39.417063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85c0756e-f612-4706-b616-08b12b49cca1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Returning 404 to user: Instance group df180887-c748-4220-a265-88bd661fc493 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:56:39.418067 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85c0756e-f612-4706-b616-08b12b49cca1 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/df180887-c748-4220-a265-88bd661fc493" status: 404 len: 117 microversion: 2.1 time: 0.023538 Nov 27 20:56:39.421900 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1835/3519] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:39 2021] DELETE /compute/v2.1/os-server-groups/df180887-c748-4220-a265-88bd661fc493 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:56:39.430574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6399c0fe-ccc3-4a98-a56b-7a4190182771 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.519439 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6399c0fe-ccc3-4a98-a56b-7a4190182771 tempest-ServerGroupTestJSON-665657396 tempest-ServerGroupTestJSON-665657396-project] 10.222.0.21 "DELETE /compute/v2.1/os-server-groups/c92b9628-904b-4b67-b0c3-33097a4d4bd6" status: 204 len: 0 microversion: 2.1 time: 0.089628 Nov 27 20:56:39.524040 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1685/3520] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:56:39 2021] DELETE /compute/v2.1/os-server-groups/c92b9628-904b-4b67-b0c3-33097a4d4bd6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:39.919953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:39.921143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:39.933079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.933544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:39.934488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:39.940978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:40.060530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1761fe80-072a-415f-9628-9ee301eb376c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:40.061580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1761fe80-072a-415f-9628-9ee301eb376c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:40.075448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1761fe80-072a-415f-9628-9ee301eb376c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:40.078607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1761fe80-072a-415f-9628-9ee301eb376c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:40.083131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1761fe80-072a-415f-9628-9ee301eb376c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:40.083631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1761fe80-072a-415f-9628-9ee301eb376c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:40.153102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:40.170323 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26437f5c-c53e-4a75-bf98-7089f280d1b9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1211 microversion: 2.1 time: 0.255344 Nov 27 20:56:40.170926 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1836/3521] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:39 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1211 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:40.175290 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1761fe80-072a-415f-9628-9ee301eb376c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.118798 Nov 27 20:56:40.176311 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1686/3522] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:40 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:40.268433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35dcfd52-1d02-48db-8f2a-59de46362e49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:40.269261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35dcfd52-1d02-48db-8f2a-59de46362e49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:40.277658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35dcfd52-1d02-48db-8f2a-59de46362e49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:40.278958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35dcfd52-1d02-48db-8f2a-59de46362e49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:40.280239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35dcfd52-1d02-48db-8f2a-59de46362e49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:40.280819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35dcfd52-1d02-48db-8f2a-59de46362e49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:40.294965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c19c4534-4dad-4a9f-89e1-faebbc266185 tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15d92d6160>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:40.381566 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c19c4534-4dad-4a9f-89e1-faebbc266185 tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf" status: 200 len: 343 microversion: 2.1 time: 0.090542 Nov 27 20:56:40.381771 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35dcfd52-1d02-48db-8f2a-59de46362e49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.117572 Nov 27 20:56:40.382135 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1687/3523] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 20:56:40 2021] GET /compute/v2.1/os-volumes/070a8a7e-5cdd-4efb-a4a2-2ebab551a6cf => generated 343 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:40.388905 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1837/3524] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:40 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:40.395507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1b6b43a-2bd2-4359-a356-bcba754b216b tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15c6d2bf70>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:40.525915 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a1b6b43a-2bd2-4359-a356-bcba754b216b tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.135651 Nov 27 20:56:40.526998 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1688/3525] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 20:56:40 2021] GET /compute/v2.1/os-volumes => generated 1013 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:40.541406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0384635b-ab69-4fde-9ac7-a3476c094b0e tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15c739f310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:40.727808 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0384635b-ab69-4fde-9ac7-a3476c094b0e tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.192034 Nov 27 20:56:40.728469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1838/3526] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:56:40 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:40.757581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ec7bbf3-a6c3-4652-b300-aa1295f6fd6f tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15d9325310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:40.964163 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ec7bbf3-a6c3-4652-b300-aa1295f6fd6f tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.225498 Nov 27 20:56:40.964944 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1689/3527] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 20:56:40 2021] GET /compute/v2.1/os-volumes => generated 1013 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:40.979157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba68d4aa-87a4-4050-b4a2-d6aa6881eaee tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15c7559ca0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:41.168487 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba68d4aa-87a4-4050-b4a2-d6aa6881eaee tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.195811 Nov 27 20:56:41.169285 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1839/3528] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 20:56:40 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:56:41.188763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28f1f2e9-2b37-4743-8f1c-637c349f4932 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:41.190764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28f1f2e9-2b37-4743-8f1c-637c349f4932 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:41.191485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7876c570-c8fe-4c58-841e-83467d946d7c tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15d92cc9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:41.218975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f1f2e9-2b37-4743-8f1c-637c349f4932 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:41.219851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f1f2e9-2b37-4743-8f1c-637c349f4932 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:41.226032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f1f2e9-2b37-4743-8f1c-637c349f4932 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:41.229692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f1f2e9-2b37-4743-8f1c-637c349f4932 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:41.330197 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28f1f2e9-2b37-4743-8f1c-637c349f4932 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.140329 Nov 27 20:56:41.331696 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1840/3529] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:41 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:41.339861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:41.349224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:41.365497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:41.366614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:41.367931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:41.372326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:41.416883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7876c570-c8fe-4c58-841e-83467d946d7c tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.237141 Nov 27 20:56:41.425345 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1690/3530] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:56:41 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:41.430865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a41987f-d9c0-4cf1-aa0d-ba257add4291 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:41.432311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a41987f-d9c0-4cf1-aa0d-ba257add4291 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:41.442516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a41987f-d9c0-4cf1-aa0d-ba257add4291 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:41.442968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a41987f-d9c0-4cf1-aa0d-ba257add4291 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:41.443824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a41987f-d9c0-4cf1-aa0d-ba257add4291 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:41.444260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a41987f-d9c0-4cf1-aa0d-ba257add4291 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:41.511232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:41.526792 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae86df6c-5bfc-4fd1-aea1-11b4d1c33a38 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1273 microversion: 2.1 time: 0.193500 Nov 27 20:56:41.527916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1841/3531] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:41 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:41.532476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba870dc9-11c9-4249-8138-e49fe28dcb6c tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15d9483280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:41.534049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a41987f-d9c0-4cf1-aa0d-ba257add4291 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.107047 Nov 27 20:56:41.538375 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1691/3532] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:41 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:41.676019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba870dc9-11c9-4249-8138-e49fe28dcb6c tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.146852 Nov 27 20:56:41.683720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1842/3533] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:56:41 2021] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:41.689057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70dd3e0c-d651-47c8-91a6-c637c9e2ff4d tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15d9325dc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:41.803899 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70dd3e0c-d651-47c8-91a6-c637c9e2ff4d tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.118765 Nov 27 20:56:41.804712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1692/3534] 10.222.0.21 () {58 vars in 1187 bytes} [Sat Nov 27 20:56:41 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:41.820343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0b11a67-a401-430e-8b1f-2c22fcfa26bd tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] Calling method '.version_select at 0x7f15c7426c10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:41.911528 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0b11a67-a401-430e-8b1f-2c22fcfa26bd tempest-VolumesTestJSON-1175875664 tempest-VolumesTestJSON-1175875664-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.097966 Nov 27 20:56:41.912344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1843/3535] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 20:56:41 2021] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:42.346206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d2a88fc-cef0-4dec-8c86-1347e5303628 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:42.351158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d2a88fc-cef0-4dec-8c86-1347e5303628 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:42.364448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d2a88fc-cef0-4dec-8c86-1347e5303628 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:42.367656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d2a88fc-cef0-4dec-8c86-1347e5303628 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:42.371122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d2a88fc-cef0-4dec-8c86-1347e5303628 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:42.372069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d2a88fc-cef0-4dec-8c86-1347e5303628 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:42.458845 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d2a88fc-cef0-4dec-8c86-1347e5303628 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.119709 Nov 27 20:56:42.459730 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1693/3536] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:42 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:42.553624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:42.554306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91b011e8-a89f-4286-89b9-f5f2e9d034fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:42.555650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91b011e8-a89f-4286-89b9-f5f2e9d034fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:42.557823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:42.577621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:42.579212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91b011e8-a89f-4286-89b9-f5f2e9d034fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:42.579928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:42.584462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91b011e8-a89f-4286-89b9-f5f2e9d034fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:42.585337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:42.585824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:42.591847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91b011e8-a89f-4286-89b9-f5f2e9d034fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:42.592550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91b011e8-a89f-4286-89b9-f5f2e9d034fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:42.692669 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91b011e8-a89f-4286-89b9-f5f2e9d034fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.146121 Nov 27 20:56:42.695214 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1694/3537] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:42 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:42.746397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:42.761475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa36402d-567b-497a-b4bb-1c89d7271c23 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1273 microversion: 2.1 time: 0.218952 Nov 27 20:56:42.763516 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1844/3538] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:42 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:43.472485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-94c84fb4-722a-4123-97f4-2742bf7ec450 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:43.474284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-94c84fb4-722a-4123-97f4-2742bf7ec450 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:43.508219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94c84fb4-722a-4123-97f4-2742bf7ec450 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:43.510281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94c84fb4-722a-4123-97f4-2742bf7ec450 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:43.511400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94c84fb4-722a-4123-97f4-2742bf7ec450 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:43.513383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94c84fb4-722a-4123-97f4-2742bf7ec450 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:43.642498 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-94c84fb4-722a-4123-97f4-2742bf7ec450 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.175047 Nov 27 20:56:43.654599 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1695/3539] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:43 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:43.704720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07a51539-8c33-4036-9b2c-94440d611d5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:43.706268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07a51539-8c33-4036-9b2c-94440d611d5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:43.720446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a51539-8c33-4036-9b2c-94440d611d5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:43.721248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a51539-8c33-4036-9b2c-94440d611d5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:43.728817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a51539-8c33-4036-9b2c-94440d611d5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:43.741426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07a51539-8c33-4036-9b2c-94440d611d5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:43.778742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:43.779598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:43.831009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:43.845149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:43.848032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:43.850309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:43.875240 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07a51539-8c33-4036-9b2c-94440d611d5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.173081 Nov 27 20:56:43.877736 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1845/3540] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:43 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:56:44.218752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:44.236591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dcff8968-8917-4013-a91b-05b9cb580fcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.457845 Nov 27 20:56:44.237461 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1696/3541] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:43 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:44.667608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f8cc1cf-d1a3-4f46-bd94-fd999c9386c7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:44.668855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f8cc1cf-d1a3-4f46-bd94-fd999c9386c7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:44.724180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8cc1cf-d1a3-4f46-bd94-fd999c9386c7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:44.724846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8cc1cf-d1a3-4f46-bd94-fd999c9386c7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:44.732951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8cc1cf-d1a3-4f46-bd94-fd999c9386c7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:44.742538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f8cc1cf-d1a3-4f46-bd94-fd999c9386c7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:44.841820 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f8cc1cf-d1a3-4f46-bd94-fd999c9386c7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.182866 Nov 27 20:56:44.842588 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1846/3542] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:44 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:44.890715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05d061e9-0a1b-4a60-8113-8b24c763f823 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:44.892902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05d061e9-0a1b-4a60-8113-8b24c763f823 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:44.902830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d061e9-0a1b-4a60-8113-8b24c763f823 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:44.903234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d061e9-0a1b-4a60-8113-8b24c763f823 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:44.904282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d061e9-0a1b-4a60-8113-8b24c763f823 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:44.904949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05d061e9-0a1b-4a60-8113-8b24c763f823 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:44.987888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05d061e9-0a1b-4a60-8113-8b24c763f823 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.101508 Nov 27 20:56:44.988550 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1697/3543] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:44 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:56:45.036886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-52f58533-cc72-46d3-9400-53ff9e6612bf req-26f280d8-9a9b-4a1f-a9e7-8cc3dd8ced16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7841b8-818f-485c-b789-e010446bd1cf", "tag": "45c36b5a-9f79-4728-9745-287685417a74"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:45.056615 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:45.056615 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:45.077423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-52f58533-cc72-46d3-9400-53ff9e6612bf req-26f280d8-9a9b-4a1f-a9e7-8cc3dd8ced16 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:45.079292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-52f58533-cc72-46d3-9400-53ff9e6612bf req-26f280d8-9a9b-4a1f-a9e7-8cc3dd8ced16 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:45.093258 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-52f58533-cc72-46d3-9400-53ff9e6612bf req-26f280d8-9a9b-4a1f-a9e7-8cc3dd8ced16 service nova] Creating event network-changed:45c36b5a-9f79-4728-9745-287685417a74 for instance 0c7841b8-818f-485c-b789-e010446bd1cf on nch1-master-1 Nov 27 20:56:45.100067 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-52f58533-cc72-46d3-9400-53ff9e6612bf req-26f280d8-9a9b-4a1f-a9e7-8cc3dd8ced16 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075826 Nov 27 20:56:45.101213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1847/3544] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:45.257961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:45.259572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:45.270587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:45.271033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:45.271858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:45.272505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:45.673573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:45.685526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cdbec720-f144-439e-b3d7-a324d88e1b85 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.433596 Nov 27 20:56:45.686688 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1698/3545] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:45 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:45.866705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc01e13e-b6d0-4c2e-83d1-1edf8d31bd7a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:45.867950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc01e13e-b6d0-4c2e-83d1-1edf8d31bd7a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:45.905052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc01e13e-b6d0-4c2e-83d1-1edf8d31bd7a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:45.906508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc01e13e-b6d0-4c2e-83d1-1edf8d31bd7a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:45.909376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc01e13e-b6d0-4c2e-83d1-1edf8d31bd7a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:45.911794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc01e13e-b6d0-4c2e-83d1-1edf8d31bd7a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:46.001365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e16e7d3-c70e-43f7-b9ea-e87e96862976 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:46.003554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e16e7d3-c70e-43f7-b9ea-e87e96862976 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:46.028209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e16e7d3-c70e-43f7-b9ea-e87e96862976 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:46.029731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e16e7d3-c70e-43f7-b9ea-e87e96862976 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:46.031722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e16e7d3-c70e-43f7-b9ea-e87e96862976 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:46.032737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e16e7d3-c70e-43f7-b9ea-e87e96862976 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:46.055233 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc01e13e-b6d0-4c2e-83d1-1edf8d31bd7a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.205548 Nov 27 20:56:46.066782 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1848/3546] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:45 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:46.137691 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e16e7d3-c70e-43f7-b9ea-e87e96862976 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.140212 Nov 27 20:56:46.142324 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1699/3547] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:45 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:46.705716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:46.706434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:46.725453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:46.728100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:46.731375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:46.739356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:47.069565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e57ea948-40a9-465a-b138-6b49d1ad052c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:47.072057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e57ea948-40a9-465a-b138-6b49d1ad052c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:47.089569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e57ea948-40a9-465a-b138-6b49d1ad052c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:47.091841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e57ea948-40a9-465a-b138-6b49d1ad052c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:47.092940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e57ea948-40a9-465a-b138-6b49d1ad052c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:47.095857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e57ea948-40a9-465a-b138-6b49d1ad052c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:47.157920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e57ea948-40a9-465a-b138-6b49d1ad052c tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.092696 Nov 27 20:56:47.158959 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1700/3548] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:47 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:47.174013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1543560084", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "cc89b74e-c688-4f20-ab80-4dbda47338f8"}], "security_groups": [{"name": "tempest-securitygroup--1858349004"}], "key_name": "tempest-keypair-397718798", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "067f2dc6-20d2-42a1-bd57-6f30654d22f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:47.205386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:47.234483 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-688a18a0-a6e1-4cd0-ab22-aac428389bfd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.531878 Nov 27 20:56:47.236914 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1849/3549] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:46 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:47.250750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a7c5b86-c86b-479b-a5e4-a9e9fbdbf20d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:47.254275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a7c5b86-c86b-479b-a5e4-a9e9fbdbf20d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:47.268449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7c5b86-c86b-479b-a5e4-a9e9fbdbf20d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:47.269158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7c5b86-c86b-479b-a5e4-a9e9fbdbf20d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:47.270461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7c5b86-c86b-479b-a5e4-a9e9fbdbf20d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:47.271073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7c5b86-c86b-479b-a5e4-a9e9fbdbf20d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:47.330023 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a7c5b86-c86b-479b-a5e4-a9e9fbdbf20d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.091631 Nov 27 20:56:47.333325 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1850/3550] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:47 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:47.888140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] validate_networks() for [('cc89b74e-c688-4f20-ab80-4dbda47338f8', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:56:48.172317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea92160d-3c0d-40f8-82b2-04ef798fe584 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:48.173929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea92160d-3c0d-40f8-82b2-04ef798fe584 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:48.188895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea92160d-3c0d-40f8-82b2-04ef798fe584 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:48.189905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea92160d-3c0d-40f8-82b2-04ef798fe584 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:48.192698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea92160d-3c0d-40f8-82b2-04ef798fe584 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:48.193307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea92160d-3c0d-40f8-82b2-04ef798fe584 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:48.240613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea92160d-3c0d-40f8-82b2-04ef798fe584 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.073426 Nov 27 20:56:48.242619 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1851/3551] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:48 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:48.263992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:48.265337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:48.276809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:48.277608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:48.278667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:48.279367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:48.905681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:48.927532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for user dcb3f0e11efd43278f9c4c34f7eda52d and project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:48.930090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:48.944173 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f0b23a8-7009-43e1-b944-338fddaccc8e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.693118 Nov 27 20:56:48.949766 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1852/3552] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:48 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:48.963180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f8e868be-a0a9-4535-a524-e4e5b42dde5e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:48.969013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f8e868be-a0a9-4535-a524-e4e5b42dde5e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:48.984943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e868be-a0a9-4535-a524-e4e5b42dde5e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:48.985630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e868be-a0a9-4535-a524-e4e5b42dde5e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:48.986883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e868be-a0a9-4535-a524-e4e5b42dde5e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:48.988687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e868be-a0a9-4535-a524-e4e5b42dde5e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:49.012990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:56:49.013485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:56:49.019560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:56:49.024526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:56:49.024904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:56:49.065738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:49.066204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:49.067151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:49.067622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:49.083916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f8e868be-a0a9-4535-a524-e4e5b42dde5e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.131010 Nov 27 20:56:49.084933 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1853/3553] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:48 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:49.151788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:49.173513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Getting quotas for user dcb3f0e11efd43278f9c4c34f7eda52d and project 7860bb78a8bc43fd80d4c01ce057e5ef. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:49.254602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb7b893d-6b1f-47e6-b8e5-81002d5319d5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:49.256211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cb7b893d-6b1f-47e6-b8e5-81002d5319d5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:49.272535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb7b893d-6b1f-47e6-b8e5-81002d5319d5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:49.283875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb7b893d-6b1f-47e6-b8e5-81002d5319d5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:49.284866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb7b893d-6b1f-47e6-b8e5-81002d5319d5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:49.289577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb7b893d-6b1f-47e6-b8e5-81002d5319d5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:49.305475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:56:49.317370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='067f2dc6-20d2-42a1-bd57-6f30654d22f3',volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:56:49.409910 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cb7b893d-6b1f-47e6-b8e5-81002d5319d5 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.159391 Nov 27 20:56:49.410573 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1854/3554] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:49 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:49.667040 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77fe18e8-d04a-45d5-b867-d78123cb5bf9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.506341 Nov 27 20:56:49.676348 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1701/3555] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:56:47 2021] POST /compute/v2.1/servers => generated 407 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:56:49.687555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce0b84ba-49f6-4a82-af9a-87a200d1b4c3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:49.688447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce0b84ba-49f6-4a82-af9a-87a200d1b4c3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:49.965372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:49.966597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:50.007096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:50.011062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:50.011984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:50.012432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:50.058481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ce0b84ba-49f6-4a82-af9a-87a200d1b4c3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:50.072823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce0b84ba-49f6-4a82-af9a-87a200d1b4c3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1121 microversion: 2.1 time: 0.390260 Nov 27 20:56:50.076893 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1855/3556] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:49 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1121 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:50.098040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c56db53-e993-4a21-aff7-2d5020627391 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:50.100227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c56db53-e993-4a21-aff7-2d5020627391 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:50.156399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c56db53-e993-4a21-aff7-2d5020627391 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:50.162917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c56db53-e993-4a21-aff7-2d5020627391 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:50.165975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c56db53-e993-4a21-aff7-2d5020627391 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:50.166551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c56db53-e993-4a21-aff7-2d5020627391 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:50.337697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c56db53-e993-4a21-aff7-2d5020627391 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.244239 Nov 27 20:56:50.337697 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1856/3557] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:50 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:50.424516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80e9fd6c-4bc8-4cc5-8073-93dad0804d57 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:50.425824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80e9fd6c-4bc8-4cc5-8073-93dad0804d57 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:50.443666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80e9fd6c-4bc8-4cc5-8073-93dad0804d57 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:50.457669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80e9fd6c-4bc8-4cc5-8073-93dad0804d57 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:50.464890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80e9fd6c-4bc8-4cc5-8073-93dad0804d57 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:50.465809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80e9fd6c-4bc8-4cc5-8073-93dad0804d57 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:50.606231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80e9fd6c-4bc8-4cc5-8073-93dad0804d57 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.187133 Nov 27 20:56:50.614951 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1857/3558] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:50 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:50.708056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:50.740259 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-36cae3d0-43a4-4828-8c6d-5104e750fc28 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.765356 Nov 27 20:56:50.744831 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1702/3559] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:49 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:51.102082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:51.103917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:51.136044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.136044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:51.136924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.137413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:51.350352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b0ecc20-69e5-43c7-b03c-1249f9fc793b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:51.351481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b0ecc20-69e5-43c7-b03c-1249f9fc793b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:51.364070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:51.378429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0ecc20-69e5-43c7-b03c-1249f9fc793b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.380469 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1ba87e4-d0e7-43d3-a56e-e5f0182a5ef6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1163 microversion: 2.1 time: 0.289117 Nov 27 20:56:51.381979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0ecc20-69e5-43c7-b03c-1249f9fc793b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:51.383087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0ecc20-69e5-43c7-b03c-1249f9fc793b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.386040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0ecc20-69e5-43c7-b03c-1249f9fc793b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:51.398080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1858/3560] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:51 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1163 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:51.506418 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b0ecc20-69e5-43c7-b03c-1249f9fc793b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.161439 Nov 27 20:56:51.508330 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1703/3561] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:51 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:51.624576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7289531c-2939-4856-91e9-3d71adce085b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:51.626258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7289531c-2939-4856-91e9-3d71adce085b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:51.644356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7289531c-2939-4856-91e9-3d71adce085b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.645585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7289531c-2939-4856-91e9-3d71adce085b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:51.651503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7289531c-2939-4856-91e9-3d71adce085b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.653382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7289531c-2939-4856-91e9-3d71adce085b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:51.767980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:51.769310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:51.803132 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7289531c-2939-4856-91e9-3d71adce085b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.181772 Nov 27 20:56:51.804961 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1859/3562] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:51 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:51.811941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.813148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:51.815690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:51.819831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:52.272984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:52.288109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3748145b-6038-4b11-9c99-c2d8d2368239 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.529028 Nov 27 20:56:52.302473 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1704/3563] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:51 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:52.406895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:52.407755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:52.428582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:52.429547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:52.430610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:52.431362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:52.519453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-235da041-edd9-4b7e-9404-b5d7ca69f6e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:52.522407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-235da041-edd9-4b7e-9404-b5d7ca69f6e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:52.721813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:52.738040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cc8ba7f8-92a2-4936-8acb-b7a17532dd97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1237 microversion: 2.1 time: 0.341419 Nov 27 20:56:52.740053 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1860/3564] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:52 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1237 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:52.822205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2fd44df5-4244-47d1-b477-3b358c6550e3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:52.824091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2fd44df5-4244-47d1-b477-3b358c6550e3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:52.854436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fd44df5-4244-47d1-b477-3b358c6550e3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:52.860835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fd44df5-4244-47d1-b477-3b358c6550e3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:52.862279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fd44df5-4244-47d1-b477-3b358c6550e3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:52.867700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fd44df5-4244-47d1-b477-3b358c6550e3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:52.940981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2fd44df5-4244-47d1-b477-3b358c6550e3 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.125418 Nov 27 20:56:52.942828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1861/3565] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:52 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:56:53.315013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:53.316178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:53.346747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:53.348892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:53.351584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:53.352472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:53.530406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-235da041-edd9-4b7e-9404-b5d7ca69f6e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:53.531844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-235da041-edd9-4b7e-9404-b5d7ca69f6e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:53.534314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-235da041-edd9-4b7e-9404-b5d7ca69f6e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:53.534786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-235da041-edd9-4b7e-9404-b5d7ca69f6e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:53.627812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-235da041-edd9-4b7e-9404-b5d7ca69f6e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 1.113103 Nov 27 20:56:53.628659 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1705/3566] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:52 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:53.634928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5df88b7e-198b-4263-8465-2b3cb87da018 req-ebc2f41b-6c73-4e25-b40e-0f7e700bc746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7841b8-818f-485c-b789-e010446bd1cf", "name": "network-vif-plugged", "status": "completed", "tag": "45c36b5a-9f79-4728-9745-287685417a74"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:53.643025 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:53.643025 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:56:53.664824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5df88b7e-198b-4263-8465-2b3cb87da018 req-ebc2f41b-6c73-4e25-b40e-0f7e700bc746 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:53.666806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5df88b7e-198b-4263-8465-2b3cb87da018 req-ebc2f41b-6c73-4e25-b40e-0f7e700bc746 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:53.700995 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5df88b7e-198b-4263-8465-2b3cb87da018 req-ebc2f41b-6c73-4e25-b40e-0f7e700bc746 service nova] Creating event network-vif-plugged:45c36b5a-9f79-4728-9745-287685417a74 for instance 0c7841b8-818f-485c-b789-e010446bd1cf on nch1-master-1 Nov 27 20:56:53.716325 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5df88b7e-198b-4263-8465-2b3cb87da018 req-ebc2f41b-6c73-4e25-b40e-0f7e700bc746 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080667 Nov 27 20:56:53.717193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1706/3567] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:53.760164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:53.761235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:53.778039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:53.778737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:53.779812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:53.780556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:53.995964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:54.008472 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cea734c1-c4ba-424e-89f2-88e29d4ea0f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1237 microversion: 2.1 time: 0.253913 Nov 27 20:56:54.009621 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1707/3568] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:53 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1237 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:54.023911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c16cc07-c234-46bb-9c43-bcf3cfde4cdb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:54.025577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6c16cc07-c234-46bb-9c43-bcf3cfde4cdb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:54.039652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c16cc07-c234-46bb-9c43-bcf3cfde4cdb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:54.040157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c16cc07-c234-46bb-9c43-bcf3cfde4cdb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:54.044789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c16cc07-c234-46bb-9c43-bcf3cfde4cdb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:54.045293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c16cc07-c234-46bb-9c43-bcf3cfde4cdb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:54.069414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:54.081412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba76e530-3109-4ddd-b43a-940b5816c121 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.773990 Nov 27 20:56:54.082406 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1862/3569] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:53 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:54.150852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6c16cc07-c234-46bb-9c43-bcf3cfde4cdb tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.138731 Nov 27 20:56:54.155428 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1708/3570] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:54 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:54.641330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d896719-7c58-4ff6-bc44-9bbefd9dc75d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:54.642323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d896719-7c58-4ff6-bc44-9bbefd9dc75d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:54.663809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d896719-7c58-4ff6-bc44-9bbefd9dc75d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:54.664275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d896719-7c58-4ff6-bc44-9bbefd9dc75d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:54.665120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d896719-7c58-4ff6-bc44-9bbefd9dc75d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:54.665655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d896719-7c58-4ff6-bc44-9bbefd9dc75d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:54.747654 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d896719-7c58-4ff6-bc44-9bbefd9dc75d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.101401 Nov 27 20:56:54.748448 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1863/3571] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:54 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:55.047679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:55.049028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:55.058367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.059491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.060580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.061250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.103960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:55.104787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:55.126730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.129952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.132570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.137344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.824973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:55.839517 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2bea8d0c-ae46-4596-9341-b305dfc27142 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1315 microversion: 2.1 time: 0.736640 Nov 27 20:56:55.840828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1864/3572] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:55 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:55.848433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:55.848868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6c7b615-7198-4de0-b760-be398b83b54e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:55.850229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6c7b615-7198-4de0-b760-be398b83b54e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:55.865300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6c7b615-7198-4de0-b760-be398b83b54e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.867932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6c7b615-7198-4de0-b760-be398b83b54e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.869762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6c7b615-7198-4de0-b760-be398b83b54e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.870481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6c7b615-7198-4de0-b760-be398b83b54e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.874294 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-767f05e9-3749-4848-8271-9f59c4bf8cfc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.846112 Nov 27 20:56:55.886883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1709/3573] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:55 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:55.898338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-35d77339-a058-4087-937c-c908b9ab3c83 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:55.900322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-35d77339-a058-4087-937c-c908b9ab3c83 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:55.912017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35d77339-a058-4087-937c-c908b9ab3c83 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.916274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35d77339-a058-4087-937c-c908b9ab3c83 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.917727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35d77339-a058-4087-937c-c908b9ab3c83 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:55.918369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35d77339-a058-4087-937c-c908b9ab3c83 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:55.951524 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6c7b615-7198-4de0-b760-be398b83b54e tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.108720 Nov 27 20:56:55.953092 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1865/3574] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:55 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:55.981289 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-35d77339-a058-4087-937c-c908b9ab3c83 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.091895 Nov 27 20:56:55.985770 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1710/3575] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:55 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:56.858184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:56.859185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:56.880515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:56.883479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:56.893181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:56.894635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:56.902775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:56.905881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:56.920242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:56.921069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:56.923019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:56.923736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:57.281855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:57.293178 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-601da831-ac8e-4742-a8c1-f725391703eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.402269 Nov 27 20:56:57.294013 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1711/3576] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:56 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:56:57.451037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:57.471545 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5df87fb5-d0fc-45ac-876b-3f15cc635fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1502 microversion: 2.1 time: 0.604977 Nov 27 20:56:57.472228 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1866/3577] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:56 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1502 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:57.477005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-858ef3a4-45a5-4672-bb5c-053ecd5144fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:57.478686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-858ef3a4-45a5-4672-bb5c-053ecd5144fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:57.494597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-858ef3a4-45a5-4672-bb5c-053ecd5144fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:57.499870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-858ef3a4-45a5-4672-bb5c-053ecd5144fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:57.500737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-858ef3a4-45a5-4672-bb5c-053ecd5144fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:57.501185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-858ef3a4-45a5-4672-bb5c-053ecd5144fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:57.575009 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-858ef3a4-45a5-4672-bb5c-053ecd5144fe tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.101491 Nov 27 20:56:57.575713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1867/3578] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:57 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:57.588440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-099e566e-af37-4013-ba57-75d28b174167 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:57.591365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-099e566e-af37-4013-ba57-75d28b174167 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:57.613557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-099e566e-af37-4013-ba57-75d28b174167 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:57.614217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-099e566e-af37-4013-ba57-75d28b174167 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:57.615188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-099e566e-af37-4013-ba57-75d28b174167 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:57.615981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-099e566e-af37-4013-ba57-75d28b174167 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:57.690874 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-099e566e-af37-4013-ba57-75d28b174167 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.113761 Nov 27 20:56:57.695094 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1868/3579] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:57 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:57.704214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:57.714712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:57.723055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:57.725724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:57.726894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:57.730148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:57.782171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1128045831", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bec98bc9-0b5b-4b5f-b388-d430ab12ae4e"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:57.796246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:56:57.877564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] validate_networks() for [('bec98bc9-0b5b-4b5f-b388-d430ab12ae4e', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:56:58.025342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fa2f320-9a0a-4842-be44-a75a21408fad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 204 len: 0 microversion: 2.1 time: 0.325874 Nov 27 20:56:58.028921 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1869/3580] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:56:57 2021] DELETE /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:56:58.219648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8f489b05-0027-4b54-9dcb-4ebc0a4d46bb req-b5c229a0-a95d-4f20-9b33-ac9100ce42b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf02d0b-4468-4742-8c5e-399186f81700", "tag": "8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:58.221605 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:58.221605 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:56:58.241772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8f489b05-0027-4b54-9dcb-4ebc0a4d46bb req-b5c229a0-a95d-4f20-9b33-ac9100ce42b8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:58.242229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8f489b05-0027-4b54-9dcb-4ebc0a4d46bb req-b5c229a0-a95d-4f20-9b33-ac9100ce42b8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:58.277601 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8f489b05-0027-4b54-9dcb-4ebc0a4d46bb req-b5c229a0-a95d-4f20-9b33-ac9100ce42b8 service nova] Creating event network-changed:8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f for instance 7bf02d0b-4468-4742-8c5e-399186f81700 on nch2-master-1 Nov 27 20:56:58.296025 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8f489b05-0027-4b54-9dcb-4ebc0a4d46bb req-b5c229a0-a95d-4f20-9b33-ac9100ce42b8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261929 Nov 27 20:56:58.299579 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1870/3581] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:56:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:56:58.307167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:58.311838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:58.337431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:58.337867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:58.339156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:58.339156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:58.694446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:56:58.694941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:56:58.695463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:56:58.696580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:56:58.697211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:56:58.706991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:58.707730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:58.708748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:58.709405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:58.728229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Getting quotas for project ea113326fcea4903b6f63e84c0339fa7. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:56:58.734343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Getting quotas for user d83a3fe020954cddb42864198a20ea9d and project ea113326fcea4903b6f63e84c0339fa7. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:56:58.750006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:56:58.752655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:56:58.809332 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e00efece-a26b-436d-9ab7-a0a49f3b188b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.512752 Nov 27 20:56:58.810373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1712/3582] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:56:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:56:58.815602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:58.816913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:58.824592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:58.825374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:58.826680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:58.827134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:59.010846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:59.020928 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-787278e2-7aa6-400d-841e-908d707aee48 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.209004 Nov 27 20:56:59.022023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1713/3583] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:58 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:59.037157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f72271c0-424d-4aa4-9b2b-794e7af2f2e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:59.038439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f72271c0-424d-4aa4-9b2b-794e7af2f2e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:59.047527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72271c0-424d-4aa4-9b2b-794e7af2f2e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:59.048151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72271c0-424d-4aa4-9b2b-794e7af2f2e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:59.049114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72271c0-424d-4aa4-9b2b-794e7af2f2e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:59.049713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f72271c0-424d-4aa4-9b2b-794e7af2f2e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:59.120687 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f72271c0-424d-4aa4-9b2b-794e7af2f2e7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.087587 Nov 27 20:56:59.123746 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1714/3584] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:56:59 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:56:59.138810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86d1e59b-8e3c-4446-a48b-d82abccc13a2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:56:59.140361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-86d1e59b-8e3c-4446-a48b-d82abccc13a2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:59.160004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d1e59b-8e3c-4446-a48b-d82abccc13a2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:59.160820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d1e59b-8e3c-4446-a48b-d82abccc13a2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:59.162446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d1e59b-8e3c-4446-a48b-d82abccc13a2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:56:59.163245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d1e59b-8e3c-4446-a48b-d82abccc13a2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:56:59.301712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:59.313035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86d1e59b-8e3c-4446-a48b-d82abccc13a2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.168428 Nov 27 20:56:59.313901 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1715/3585] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:56:59 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:56:59.316860 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dad3f711-3e7d-468c-b153-a73348cd263b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1508 microversion: 2.1 time: 1.013590 Nov 27 20:56:59.318706 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1871/3586] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:58 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1508 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:56:59.323090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c002361a-4b91-4453-bd16-3e2e0d640fad tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:56:59.324598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c002361a-4b91-4453-bd16-3e2e0d640fad tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:56:59.413983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c002361a-4b91-4453-bd16-3e2e0d640fad tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:56:59.435322 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c002361a-4b91-4453-bd16-3e2e0d640fad tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1223 microversion: 2.1 time: 0.108449 Nov 27 20:56:59.445370 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1716/3587] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:56:59 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:00.039864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:00.040979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:00.064972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.065676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.066698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.070207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.136473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33f0e7c7-7a0d-4d85-afa4-46ccb8982258 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:00.137513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33f0e7c7-7a0d-4d85-afa4-46ccb8982258 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:00.161373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33f0e7c7-7a0d-4d85-afa4-46ccb8982258 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.162870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33f0e7c7-7a0d-4d85-afa4-46ccb8982258 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.163843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33f0e7c7-7a0d-4d85-afa4-46ccb8982258 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.165650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33f0e7c7-7a0d-4d85-afa4-46ccb8982258 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.257147 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33f0e7c7-7a0d-4d85-afa4-46ccb8982258 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 32600 microversion: 2.1 time: 0.125342 Nov 27 20:57:00.257855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1717/3588] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:00 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 32600 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:00.332752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f792ed62-82b8-4d26-905d-01362915ed5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:00.334187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f792ed62-82b8-4d26-905d-01362915ed5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:00.369082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f792ed62-82b8-4d26-905d-01362915ed5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.372528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f792ed62-82b8-4d26-905d-01362915ed5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.381011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f792ed62-82b8-4d26-905d-01362915ed5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.382956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f792ed62-82b8-4d26-905d-01362915ed5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.500185 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f792ed62-82b8-4d26-905d-01362915ed5b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.178351 Nov 27 20:57:00.500927 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1718/3589] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:00 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:00.512961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:00.513861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:00.534348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.534809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.537212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.537990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.613590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.621011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.623196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lazy-loading 'fault' on Instance uuid 0c7841b8-818f-485c-b789-e010446bd1cf {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:57:00.719135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:00.733248 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fb660b3b-1863-480b-9d63-05c5366b0a67 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 200 len: 1305 microversion: 2.1 time: 0.230984 Nov 27 20:57:00.735776 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1719/3590] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:00 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:00.741476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1a35b005-933a-46a2-a072-03f476312ee4 req-c878a989-e05b-44ca-a62d-c42c1b92a213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7841b8-818f-485c-b789-e010446bd1cf", "name": "network-vif-deleted", "tag": "45c36b5a-9f79-4728-9745-287685417a74"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:00.743552 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:00.743552 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:00.762871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:00.772155 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8190e06-1b93-4888-8a81-23fc25f8fdca tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.737001 Nov 27 20:57:00.773035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1a35b005-933a-46a2-a072-03f476312ee4 req-c878a989-e05b-44ca-a62d-c42c1b92a213 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.773842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1a35b005-933a-46a2-a072-03f476312ee4 req-c878a989-e05b-44ca-a62d-c42c1b92a213 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.780055 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1872/3591] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:00 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:00.792073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:00.793368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:00.801172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1a35b005-933a-46a2-a072-03f476312ee4 req-c878a989-e05b-44ca-a62d-c42c1b92a213 service nova] Creating event network-vif-deleted:45c36b5a-9f79-4728-9745-287685417a74 for instance 0c7841b8-818f-485c-b789-e010446bd1cf on nch1-master-1 Nov 27 20:57:00.803361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.806225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.809305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:00.810048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:00.816484 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1a35b005-933a-46a2-a072-03f476312ee4 req-c878a989-e05b-44ca-a62d-c42c1b92a213 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078855 Nov 27 20:57:00.819392 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1720/3592] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:00.943749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:00.961613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6702ba85-d671-4ea6-9774-06e4d4237375 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1275 microversion: 2.1 time: 0.179628 Nov 27 20:57:00.974835 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1873/3593] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:00 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:01.272208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2db5bfbe-2ed8-4d33-8b08-feaecf722cb7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:01.273245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2db5bfbe-2ed8-4d33-8b08-feaecf722cb7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:01.291823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2db5bfbe-2ed8-4d33-8b08-feaecf722cb7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.293443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2db5bfbe-2ed8-4d33-8b08-feaecf722cb7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.297866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2db5bfbe-2ed8-4d33-8b08-feaecf722cb7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.302319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2db5bfbe-2ed8-4d33-8b08-feaecf722cb7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.427150 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2db5bfbe-2ed8-4d33-8b08-feaecf722cb7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action" status: 200 len: 40757 microversion: 2.1 time: 0.161560 Nov 27 20:57:01.428210 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1721/3594] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:01 2021] POST /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28/action => generated 40757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:01.512612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0cc087a-cc54-478d-9751-c4f3c355c5f8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:01.513751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f0cc087a-cc54-478d-9751-c4f3c355c5f8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:01.526263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0cc087a-cc54-478d-9751-c4f3c355c5f8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.530078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0cc087a-cc54-478d-9751-c4f3c355c5f8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.531336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0cc087a-cc54-478d-9751-c4f3c355c5f8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.533739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0cc087a-cc54-478d-9751-c4f3c355c5f8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.683525 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0cc087a-cc54-478d-9751-c4f3c355c5f8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.174583 Nov 27 20:57:01.690857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1874/3595] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:01 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:01.754504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:01.755229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:01.764773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.765238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.766035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.766478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.787240 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 0c7841b8-818f-485c-b789-e010446bd1cf could not be found. Nov 27 20:57:01.788029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 0c7841b8-818f-485c-b789-e010446bd1cf could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:57:01.788896 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-37de43ad-aa6c-4249-9bec-d363a9a34e5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 404 len: 111 microversion: 2.1 time: 0.038997 Nov 27 20:57:01.794679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:01.807873 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1722/3596] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:01 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:57:01.811364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:01.828964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.829978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.831209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:01.833372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:01.969652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-467605203", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "39b4c68b-6f2a-4d98-a40b-89a7cdc47e01"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:02.038779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] validate_networks() for [('39b4c68b-6f2a-4d98-a40b-89a7cdc47e01', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:57:02.071925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:02.083026 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7aed5e12-ee85-4dec-9eeb-9e8ca2a1036d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.291484 Nov 27 20:57:02.087275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1875/3597] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:01 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:02.093098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:02.094068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:02.101399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.103286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.104327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.104937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.194284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:02.206795 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9a33407-7796-42af-9fd4-de2d6d740b70 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1281 microversion: 2.1 time: 0.118082 Nov 27 20:57:02.221661 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1876/3598] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:02 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:02.278517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:02.279141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:02.287314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.287927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.290812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.291675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.332493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:57:02.494800 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eedeb007-f565-46d4-b60f-ce635d947e6f tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 204 len: 0 microversion: 2.1 time: 0.223075 Nov 27 20:57:02.495435 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1877/3599] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:57:02 2021] DELETE /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:57:02.507569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:02.507920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:02.526392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.526847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.528432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.529408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.802697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:02.812617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c504d43a-5a2f-4756-aa3c-e76b32e8cd0b tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1663 microversion: 2.1 time: 0.309392 Nov 27 20:57:02.825720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1878/3600] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:02 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1663 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:02.835010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-899f7c59-af15-4659-b83c-0c31a2d1a384 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:02.836585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-899f7c59-af15-4659-b83c-0c31a2d1a384 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:02.849294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-899f7c59-af15-4659-b83c-0c31a2d1a384 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.856599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-899f7c59-af15-4659-b83c-0c31a2d1a384 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.857776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-899f7c59-af15-4659-b83c-0c31a2d1a384 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:02.858423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-899f7c59-af15-4659-b83c-0c31a2d1a384 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:02.932002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-899f7c59-af15-4659-b83c-0c31a2d1a384 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.104636 Nov 27 20:57:02.932649 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1879/3601] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:02 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:03.103970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:03.105079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:03.127596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:03.127596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:03.127596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:03.127855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:03.527149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:03.540105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f8ea6997-a7ef-4fa6-a16e-58514fb30571 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.441639 Nov 27 20:57:03.540911 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1880/3602] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:03 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:03.575177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:03.579518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:03.594771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:03.595484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:03.604510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:03.605927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:03.857986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:57:03.858512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:57:03.858962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:57:03.859418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:57:03.859893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:57:03.882759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:03.884144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:03.885340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:03.886107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:03.923161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:57:03.940717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for user ed87ef17973a49f2a9108bdfbff65415 and project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:57:03.984961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:57:03.988455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:57:04.096851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-177f4482-84ee-4351-9083-6696cf91dc18 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.130788 Nov 27 20:57:04.097572 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1723/3603] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:57:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:57:04.122179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:04.123164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:04.130771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:04.131505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:04.134971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:04.136037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:04.580768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:04.610547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f50a4152-7399-4468-92f3-0b165860a0c9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 1.066837 Nov 27 20:57:04.612208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1881/3604] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:03 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:04.636706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a01b969-0e62-4944-9cf2-8d43422bd033 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:04.655113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a01b969-0e62-4944-9cf2-8d43422bd033 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:04.671154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a01b969-0e62-4944-9cf2-8d43422bd033 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:04.671780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a01b969-0e62-4944-9cf2-8d43422bd033 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:04.673461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a01b969-0e62-4944-9cf2-8d43422bd033 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:04.677109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a01b969-0e62-4944-9cf2-8d43422bd033 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:04.767983 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a01b969-0e62-4944-9cf2-8d43422bd033 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.150825 Nov 27 20:57:04.772503 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1882/3605] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:04 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:04.785980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b7e55f35-03d1-4adb-9e87-cec876fdc029 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:04.791980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b7e55f35-03d1-4adb-9e87-cec876fdc029 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:04.954887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b7e55f35-03d1-4adb-9e87-cec876fdc029 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:04.964275 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b7e55f35-03d1-4adb-9e87-cec876fdc029 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1214 microversion: 2.1 time: 0.190108 Nov 27 20:57:04.978380 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1883/3606] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:04 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:04.986065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:04.986722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:05.004945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:05.011759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:05.012929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:05.019803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:05.506415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:05.538423 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a9e0f56-843d-4dcb-8c83-9331410bd4ba tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1663 microversion: 2.1 time: 1.416901 Nov 27 20:57:05.540203 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1724/3607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:04 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1663 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:05.635335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:05.636207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:05.656078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:05.658374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:05.661405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:05.661868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:06.429958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:06.432143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:06.439650 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-753489ec-7837-4d87-8c9a-ff3066626204 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 1.459918 Nov 27 20:57:06.447994 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-60fec5d1-76e1-454c-8789-83101c0dbd84 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.814238 Nov 27 20:57:06.456125 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1725/3609] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:05 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:06.456268 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1884/3609] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:04 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:06.468494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3135170f-568b-47fc-a2fc-de254f210407 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:06.469241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:06.471538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3135170f-568b-47fc-a2fc-de254f210407 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:06.473959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:06.489892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3135170f-568b-47fc-a2fc-de254f210407 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:06.490665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:06.491333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:06.492272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:06.492701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3135170f-568b-47fc-a2fc-de254f210407 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:06.494929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3135170f-568b-47fc-a2fc-de254f210407 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:06.495528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:06.497394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3135170f-568b-47fc-a2fc-de254f210407 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:06.583931 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3135170f-568b-47fc-a2fc-de254f210407 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.124855 Nov 27 20:57:06.585296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1726/3610] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:06 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:06.593595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:06.595086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:06.604429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:06.605310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:06.606400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:06.607151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:06.654027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:06.662397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fde0cf51-cc44-4c64-8ba3-34288ab0b7ad tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1272 microversion: 2.1 time: 0.205386 Nov 27 20:57:06.663276 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1885/3611] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:06 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:06.828211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c837598a18f439d93cfce37b86aa235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659003b54d7c4726bc5197bfd351d3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:06.840523 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30447ffe-9fcf-4da7-a398-81cd82e13139 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 200 len: 1597 microversion: 2.1 time: 0.253027 Nov 27 20:57:06.841116 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1727/3612] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:06 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 1597 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:07.067799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9b9033e2-bc99-47bb-9da8-76c00947f248 req-dc5e2db2-8130-4f4d-8e9c-9a5bd5f72866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3742d74c-1fbd-42f7-8dd3-1af6053e9f28", "name": "network-vif-deleted", "tag": "5f40e7d5-e01b-48c4-a853-15b07fbabc1f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:07.069329 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:07.069329 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:07.079952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9b9033e2-bc99-47bb-9da8-76c00947f248 req-dc5e2db2-8130-4f4d-8e9c-9a5bd5f72866 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:07.080424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9b9033e2-bc99-47bb-9da8-76c00947f248 req-dc5e2db2-8130-4f4d-8e9c-9a5bd5f72866 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:07.110360 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9b9033e2-bc99-47bb-9da8-76c00947f248 req-dc5e2db2-8130-4f4d-8e9c-9a5bd5f72866 service nova] Creating event network-vif-deleted:5f40e7d5-e01b-48c4-a853-15b07fbabc1f for instance 3742d74c-1fbd-42f7-8dd3-1af6053e9f28 on nch2-master-1 Nov 27 20:57:07.119291 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9b9033e2-bc99-47bb-9da8-76c00947f248 req-dc5e2db2-8130-4f4d-8e9c-9a5bd5f72866 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055363 Nov 27 20:57:07.126165 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1886/3613] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:07.463764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:07.465879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:07.468832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:07.470318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:07.479679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:07.480412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:07.481354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:07.481954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:07.483293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:07.484455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:07.484581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:07.485821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.253248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:08.264628 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e357010b-63e6-4d12-88dd-f82ab07efacb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.805399 Nov 27 20:57:08.265578 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1887/3614] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:07 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:08.270732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f8008369-7dfa-45bd-ab06-b238eda15db7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:08.271849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f8008369-7dfa-45bd-ab06-b238eda15db7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:08.282701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8008369-7dfa-45bd-ab06-b238eda15db7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:08.283926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8008369-7dfa-45bd-ab06-b238eda15db7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.285909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8008369-7dfa-45bd-ab06-b238eda15db7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:08.287787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8008369-7dfa-45bd-ab06-b238eda15db7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.341738 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f8008369-7dfa-45bd-ab06-b238eda15db7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.071639 Nov 27 20:57:08.342499 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1888/3615] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:08 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:08.347975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:08.348687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:08.357357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:08.358390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.359369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:08.360060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.642644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:08.651520 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4412e62f-4f8d-452e-96b4-110e3dc5346c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.307476 Nov 27 20:57:08.652391 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1889/3616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:08 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:08.666459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:08.667427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] [instance: 3742d74c-1fbd-42f7-8dd3-1af6053e9f28] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:08.683463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:08.684206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.685179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:08.685775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.712657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] HTTP exception thrown: Instance 3742d74c-1fbd-42f7-8dd3-1af6053e9f28 could not be found. Nov 27 20:57:08.716135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Returning 404 to user: Instance 3742d74c-1fbd-42f7-8dd3-1af6053e9f28 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:57:08.718517 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa809f2c-f921-4a3e-9872-c2c976f6440a tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28" status: 404 len: 111 microversion: 2.1 time: 0.064849 Nov 27 20:57:08.725216 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1890/3617] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:08 2021] GET /compute/v2.1/servers/3742d74c-1fbd-42f7-8dd3-1af6053e9f28 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:57:08.732052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f7b009f-8690-4a62-9a3b-9fcec2a4e6d7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] Calling method '.version_select at 0x7f15c7f77310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:08.764176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f7b009f-8690-4a62-9a3b-9fcec2a4e6d7 tempest-ServersTestFqdnHostnames-2009011088 tempest-ServersTestFqdnHostnames-2009011088-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-371219246" status: 202 len: 0 microversion: 2.1 time: 0.037527 Nov 27 20:57:08.765709 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1891/3618] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 20:57:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-371219246 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:08.833092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d2907adb-1567-4dc9-9d96-171cfc50d799 req-96ed742e-ead4-4d02-9e67-82fca06c1ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff1ffe9-44c3-486f-82a9-680b299d2921", "tag": "961a8aab-3a21-4f48-887a-804874479b17"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:08.835432 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:08.835432 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:08.854513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d2907adb-1567-4dc9-9d96-171cfc50d799 req-96ed742e-ead4-4d02-9e67-82fca06c1ce0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:08.857928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d2907adb-1567-4dc9-9d96-171cfc50d799 req-96ed742e-ead4-4d02-9e67-82fca06c1ce0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:08.885856 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d2907adb-1567-4dc9-9d96-171cfc50d799 req-96ed742e-ead4-4d02-9e67-82fca06c1ce0 service nova] Creating event network-changed:961a8aab-3a21-4f48-887a-804874479b17 for instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 on nch1-master-1 Nov 27 20:57:08.892057 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d2907adb-1567-4dc9-9d96-171cfc50d799 req-96ed742e-ead4-4d02-9e67-82fca06c1ce0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065907 Nov 27 20:57:08.893470 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1892/3619] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:57:09.038900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:09.048464 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-59eb3075-a609-45b4-b06d-6e35c50c5823 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 1.587715 Nov 27 20:57:09.053254 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1728/3620] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:07 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:09.285484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:09.286473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:09.300291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:09.301043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:09.302839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:09.303499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:09.354389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-57666522-9076-45d1-b4f5-7700ea5100af tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:09.355411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-57666522-9076-45d1-b4f5-7700ea5100af tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:09.362951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57666522-9076-45d1-b4f5-7700ea5100af tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:09.363455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57666522-9076-45d1-b4f5-7700ea5100af tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:09.366987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57666522-9076-45d1-b4f5-7700ea5100af tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:09.368022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57666522-9076-45d1-b4f5-7700ea5100af tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:09.456866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-57666522-9076-45d1-b4f5-7700ea5100af tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.106634 Nov 27 20:57:09.458491 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1729/3621] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:09 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:57:09.657376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-873b5ad7-c05e-42ae-91ad-d47c2cfb0a9b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'create', calling method: .version_select at 0x7f15d92cc040>, body: {"keypair": {"name": "tempest-keypair-541549652"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:09.692363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-873b5ad7-c05e-42ae-91ad-d47c2cfb0a9b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Getting quotas for project c03be159839446f2a47ca07f13bb552c. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:57:09.700982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-873b5ad7-c05e-42ae-91ad-d47c2cfb0a9b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Getting quotas for user 8e7695cf8df749e9af62b1746e818ea3 and project c03be159839446f2a47ca07f13bb552c. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:57:09.830151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:09.839322 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79dbac45-01f7-45de-b241-e867a5e125ae tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.558800 Nov 27 20:57:09.840789 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1893/3622] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:09 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:09.857169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:09.858096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:09.865543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:09.866336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:09.867436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:09.868114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:10.045450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-873b5ad7-c05e-42ae-91ad-d47c2cfb0a9b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Getting quotas for project c03be159839446f2a47ca07f13bb552c. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:57:10.052740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-873b5ad7-c05e-42ae-91ad-d47c2cfb0a9b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Getting quotas for user 8e7695cf8df749e9af62b1746e818ea3 and project c03be159839446f2a47ca07f13bb552c. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:57:10.093109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-873b5ad7-c05e-42ae-91ad-d47c2cfb0a9b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.32 time: 0.441813 Nov 27 20:57:10.102480 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1730/3623] 10.222.0.21 () {62 vars in 1198 bytes} [Sat Nov 27 20:57:09 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 446 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 20:57:10.110902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:10.112713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:10.127404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:10.131972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:10.134391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:10.135050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:10.203008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:10.218438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04798afb-534a-4371-8978-fa0b972fc3e6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.372726 Nov 27 20:57:10.220492 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1894/3624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:09 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:10.431681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7eabc665-3250-46f9-abb3-b136afc37e35 req-d22062f9-e716-4559-96ba-999d659022c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf02d0b-4468-4742-8c5e-399186f81700", "name": "network-vif-plugged", "status": "completed", "tag": "8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:10.433385 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:10.433385 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:10.460349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7eabc665-3250-46f9-abb3-b136afc37e35 req-d22062f9-e716-4559-96ba-999d659022c4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:10.460804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7eabc665-3250-46f9-abb3-b136afc37e35 req-d22062f9-e716-4559-96ba-999d659022c4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:10.492754 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7eabc665-3250-46f9-abb3-b136afc37e35 req-d22062f9-e716-4559-96ba-999d659022c4 service nova] Creating event network-vif-plugged:8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f for instance 7bf02d0b-4468-4742-8c5e-399186f81700 on nch2-master-1 Nov 27 20:57:10.507071 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7eabc665-3250-46f9-abb3-b136afc37e35 req-d22062f9-e716-4559-96ba-999d659022c4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079196 Nov 27 20:57:10.511092 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1895/3625] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:10.540518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e8d5fa32-6b1a-463e-b0db-f4167ea36681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:10.541559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e8d5fa32-6b1a-463e-b0db-f4167ea36681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:10.574096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8d5fa32-6b1a-463e-b0db-f4167ea36681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:10.576411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8d5fa32-6b1a-463e-b0db-f4167ea36681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:10.579908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8d5fa32-6b1a-463e-b0db-f4167ea36681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:10.580362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8d5fa32-6b1a-463e-b0db-f4167ea36681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:10.654428 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e8d5fa32-6b1a-463e-b0db-f4167ea36681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.125220 Nov 27 20:57:10.658856 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1896/3626] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:10 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:10.769262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:10.782598 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2218c2da-b81b-4911-a9a7-7151dc779b12 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.677484 Nov 27 20:57:10.798436 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1731/3627] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:10 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:10.859779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:10.861306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:10.873851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:10.876204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:10.877338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:10.877996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:11.121976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:11.130817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2860599f-acec-4806-8c14-fa4752b18194 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.276793 Nov 27 20:57:11.140608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1897/3628] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:10 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:11.217131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-93fd9cdf-7f6c-4c10-8574-4f47077b2689 req-9d1b1f93-e355-4a30-99f0-2da2fbb5d647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c2b87a-8405-4308-a621-10f0104e888d", "tag": "ac049382-3c5c-431f-846c-8a82be6d6454"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:11.221155 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:11.221155 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:11.236820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:11.237426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:11.243316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-93fd9cdf-7f6c-4c10-8574-4f47077b2689 req-9d1b1f93-e355-4a30-99f0-2da2fbb5d647 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:11.245797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-93fd9cdf-7f6c-4c10-8574-4f47077b2689 req-9d1b1f93-e355-4a30-99f0-2da2fbb5d647 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:11.256284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:11.256683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:11.257679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:11.260183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:11.289045 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-93fd9cdf-7f6c-4c10-8574-4f47077b2689 req-9d1b1f93-e355-4a30-99f0-2da2fbb5d647 service nova] Creating event network-changed:ac049382-3c5c-431f-846c-8a82be6d6454 for instance 49c2b87a-8405-4308-a621-10f0104e888d on nch1-master-1 Nov 27 20:57:11.296665 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-93fd9cdf-7f6c-4c10-8574-4f47077b2689 req-9d1b1f93-e355-4a30-99f0-2da2fbb5d647 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090650 Nov 27 20:57:11.298839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1732/3629] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:11.560833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:11.578709 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9439f66-9cd0-458a-b4d0-a4695c0e2b14 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.343240 Nov 27 20:57:11.591768 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1898/3630] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:11 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:11.678149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-137149ae-e6dc-47f3-a52b-48e9c8776017 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:11.681693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-137149ae-e6dc-47f3-a52b-48e9c8776017 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:11.696093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-137149ae-e6dc-47f3-a52b-48e9c8776017 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:11.697188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-137149ae-e6dc-47f3-a52b-48e9c8776017 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:11.699669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-137149ae-e6dc-47f3-a52b-48e9c8776017 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:11.700845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-137149ae-e6dc-47f3-a52b-48e9c8776017 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:11.806297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:11.808028 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-137149ae-e6dc-47f3-a52b-48e9c8776017 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.142513 Nov 27 20:57:11.808804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:11.811328 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1733/3631] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:11 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:11.817114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:11.818103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:11.819228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:11.820158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:12.150230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:12.151719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:12.164316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:12.165356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:12.166400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:12.166847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:12.236378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:12.249914 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-399347c8-51b2-4093-99b7-d72ce824d1cc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1293 microversion: 2.1 time: 0.451672 Nov 27 20:57:12.251283 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1899/3632] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:11 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1293 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:12.600389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:12.601072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:12.615319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:12.618258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:12.619577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:12.625784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:12.633700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:12.648128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23966ed4-2c79-47a7-b31a-7c7be64cf606 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.501885 Nov 27 20:57:12.649668 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1734/3633] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:12 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:12.825683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6d678a8-4425-4333-8489-d9047010c1bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:12.827931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6d678a8-4425-4333-8489-d9047010c1bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:12.840650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d678a8-4425-4333-8489-d9047010c1bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:12.841642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d678a8-4425-4333-8489-d9047010c1bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:12.842874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d678a8-4425-4333-8489-d9047010c1bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:12.844095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d678a8-4425-4333-8489-d9047010c1bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:12.909008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6d678a8-4425-4333-8489-d9047010c1bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.090111 Nov 27 20:57:12.913684 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1735/3634] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:12 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:57:13.060319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:13.079879 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d090eaeb-a6db-4719-9754-8354f2fb4b37 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.484443 Nov 27 20:57:13.080859 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1900/3635] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:12 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:13.183713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] Calling method '.version_select at 0x7f15d92fa310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:13.189824 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:13.189824 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:13.193724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.194500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.237819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.238910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.269494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.270308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:13.271037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:13.271766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.283662 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33a81062-d731-4561-b27b-3d712be7d8e2 tempest-PortsAdminExtendedAttrsTestJSON-1640535655 tempest-PortsAdminExtendedAttrsTestJSON-1640535655-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.367096 Nov 27 20:57:13.286128 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1736/3636] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:57:12 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:13.293141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.294652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.296658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.297400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.667148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:13.667936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:13.683727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.684442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.685451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.686053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.771232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:13.794635 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1bd5525b-326a-4e6e-8736-6315340dade6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1484 microversion: 2.1 time: 0.522599 Nov 27 20:57:13.798378 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1901/3637] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:13 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1484 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:13.846587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b5143cc-cdd1-449f-bd15-ef5185f7ce53 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:13.849577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b5143cc-cdd1-449f-bd15-ef5185f7ce53 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:13.877478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b5143cc-cdd1-449f-bd15-ef5185f7ce53 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.878050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b5143cc-cdd1-449f-bd15-ef5185f7ce53 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:13.880913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b5143cc-cdd1-449f-bd15-ef5185f7ce53 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:13.882156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b5143cc-cdd1-449f-bd15-ef5185f7ce53 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:14.036271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:14.047148 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c58fce0-3fd7-42e1-bd23-02276a3dbe2c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.384702 Nov 27 20:57:14.048191 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1737/3638] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:13 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:14.067955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce87f48b-3aba-4289-bd7d-897afed6adfd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:14.069709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce87f48b-3aba-4289-bd7d-897afed6adfd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:14.079124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce87f48b-3aba-4289-bd7d-897afed6adfd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:14.080110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce87f48b-3aba-4289-bd7d-897afed6adfd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:14.081149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce87f48b-3aba-4289-bd7d-897afed6adfd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:14.082944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce87f48b-3aba-4289-bd7d-897afed6adfd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:14.141802 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce87f48b-3aba-4289-bd7d-897afed6adfd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.082618 Nov 27 20:57:14.143451 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1738/3639] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:14 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:14.151960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:14.152961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:14.162676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:14.163957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:14.166203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:14.166766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:14.498279 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b5143cc-cdd1-449f-bd15-ef5185f7ce53 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.684046 Nov 27 20:57:14.498928 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1902/3640] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 20:57:13 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/os-interface => generated 285 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:14.503535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1091232251", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "869e0cb1-cddc-4b0a-8f3a-3b205e8b5a35"}, {"port": "14e81df6-5fa0-4831-a0b4-1270866d1c86", "tag": "port-1"}, {"port": "decba21e-805a-4b68-9d38-6e3b44662ff5", "tag": "port-2"}, {"uuid": "2db01d42-b5d2-4173-a7f0-d71456cff74a", "tag": "net-1"}, {"uuid": "2db01d42-b5d2-4173-a7f0-d71456cff74a"}, {"uuid": "cd3220c8-70c2-46d1-9b13-a59a0a45a117", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cd3220c8-70c2-46d1-9b13-a59a0a45a117", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "caa38af6-5178-4b65-9a06-d11b9f7b1114", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "10ddafcd-c9e0-437c-8d6e-29009b4bedca", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d68e4828-a000-482f-90e9-83e87b933855", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2099423989"}], "key_name": "tempest-keypair-541549652", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:14.759927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:14.770780 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0ae0318-a436-4d1d-8ff6-90a1148443d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.625061 Nov 27 20:57:14.771948 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1739/3641] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:14 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:14.992055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] validate_networks() for [('869e0cb1-cddc-4b0a-8f3a-3b205e8b5a35', None, None, None, None, None), (None, None, '14e81df6-5fa0-4831-a0b4-1270866d1c86', None, None, None), (None, None, 'decba21e-805a-4b68-9d38-6e3b44662ff5', None, None, None), ('2db01d42-b5d2-4173-a7f0-d71456cff74a', None, None, None, None, None), ('2db01d42-b5d2-4173-a7f0-d71456cff74a', None, None, None, None, None), ('cd3220c8-70c2-46d1-9b13-a59a0a45a117', '10.2.2.100', None, None, None, None), ('cd3220c8-70c2-46d1-9b13-a59a0a45a117', '10.2.2.200', None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:57:15.068240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:15.069071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:15.088666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:15.089556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:15.095554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:15.096037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:15.339170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:15.349439 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-04dc4312-6da2-4c02-923b-9c90620e8397 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.286659 Nov 27 20:57:15.350431 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1740/3642] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:15 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:15.370738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-342eb5e1-fdc5-4b50-aff0-fdc96b1dbcc7 req-195c890c-c851-49c4-bbc7-815615fb5565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff1ffe9-44c3-486f-82a9-680b299d2921", "name": "network-vif-plugged", "status": "completed", "tag": "961a8aab-3a21-4f48-887a-804874479b17"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:15.373568 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:15.373568 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:15.382166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-342eb5e1-fdc5-4b50-aff0-fdc96b1dbcc7 req-195c890c-c851-49c4-bbc7-815615fb5565 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:15.383052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-342eb5e1-fdc5-4b50-aff0-fdc96b1dbcc7 req-195c890c-c851-49c4-bbc7-815615fb5565 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:15.401326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-342eb5e1-fdc5-4b50-aff0-fdc96b1dbcc7 req-195c890c-c851-49c4-bbc7-815615fb5565 service nova] Creating event network-vif-plugged:961a8aab-3a21-4f48-887a-804874479b17 for instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 on nch1-master-1 Nov 27 20:57:15.407433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-342eb5e1-fdc5-4b50-aff0-fdc96b1dbcc7 req-195c890c-c851-49c4-bbc7-815615fb5565 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055437 Nov 27 20:57:15.408989 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1741/3643] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:15.432200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-985c2635-e3b0-49f5-9576-91dc5f3ec4ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:15.437274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-985c2635-e3b0-49f5-9576-91dc5f3ec4ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:15.455645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-985c2635-e3b0-49f5-9576-91dc5f3ec4ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:15.456593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-985c2635-e3b0-49f5-9576-91dc5f3ec4ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:15.459591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-985c2635-e3b0-49f5-9576-91dc5f3ec4ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:15.462686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-985c2635-e3b0-49f5-9576-91dc5f3ec4ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:15.582729 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-985c2635-e3b0-49f5-9576-91dc5f3ec4ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.170682 Nov 27 20:57:15.583673 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1742/3644] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:15 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:15.790613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:15.792141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:15.800216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:15.801296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:15.802318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:15.802999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:15.982260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:15.993128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6289aad7-8de1-44bd-aa67-612de8f386ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.206018 Nov 27 20:57:15.994723 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1743/3645] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:15 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:16.368869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:16.370142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:16.383505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:16.384377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:16.385611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:16.386292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:16.583701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:16.599869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-811b06ca-38f6-4bf5-acac-6577fd323676 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1323 microversion: 2.1 time: 0.235600 Nov 27 20:57:16.604917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1744/3646] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:16 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:16.617653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a64edb0a-9548-44ea-b6d9-fa8438122681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:16.620122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a64edb0a-9548-44ea-b6d9-fa8438122681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:16.633197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64edb0a-9548-44ea-b6d9-fa8438122681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:16.634436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64edb0a-9548-44ea-b6d9-fa8438122681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:16.636978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64edb0a-9548-44ea-b6d9-fa8438122681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:16.637944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a64edb0a-9548-44ea-b6d9-fa8438122681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:16.696277 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a64edb0a-9548-44ea-b6d9-fa8438122681 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.088802 Nov 27 20:57:16.697613 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1745/3647] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:16 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:17.017981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:17.018678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:17.030149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:17.030641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:17.035016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:17.035016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:17.216480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:17.228978 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70188195-120b-4d35-a1fe-9beac3483fa6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.218762 Nov 27 20:57:17.229895 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1746/3648] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:17 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:17.451930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cd9a9505-359e-4120-90e9-b772f1e09bae req-8973f534-6258-44d8-b7e3-42c60e7a0e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c2b87a-8405-4308-a621-10f0104e888d", "name": "network-vif-plugged", "status": "completed", "tag": "ac049382-3c5c-431f-846c-8a82be6d6454"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:17.455970 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:17.455970 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:17.473819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cd9a9505-359e-4120-90e9-b772f1e09bae req-8973f534-6258-44d8-b7e3-42c60e7a0e23 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:17.478810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cd9a9505-359e-4120-90e9-b772f1e09bae req-8973f534-6258-44d8-b7e3-42c60e7a0e23 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:17.501058 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cd9a9505-359e-4120-90e9-b772f1e09bae req-8973f534-6258-44d8-b7e3-42c60e7a0e23 service nova] Creating event network-vif-plugged:ac049382-3c5c-431f-846c-8a82be6d6454 for instance 49c2b87a-8405-4308-a621-10f0104e888d on nch1-master-1 Nov 27 20:57:17.529370 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cd9a9505-359e-4120-90e9-b772f1e09bae req-8973f534-6258-44d8-b7e3-42c60e7a0e23 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073993 Nov 27 20:57:17.541494 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1747/3649] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:57:17.623621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:17.625835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:17.639078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:17.643743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:17.645158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:17.645888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:17.970004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:17.979608 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bda50368-c338-4082-b75b-cb31474e1431 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1519 microversion: 2.1 time: 0.361053 Nov 27 20:57:17.983539 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1748/3650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:17 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1519 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:17.991765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49730e1d-89b6-42a2-8da5-7e63c32e1920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:17.997036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49730e1d-89b6-42a2-8da5-7e63c32e1920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:18.014797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49730e1d-89b6-42a2-8da5-7e63c32e1920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.015573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49730e1d-89b6-42a2-8da5-7e63c32e1920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.016552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49730e1d-89b6-42a2-8da5-7e63c32e1920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.017173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49730e1d-89b6-42a2-8da5-7e63c32e1920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.100184 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49730e1d-89b6-42a2-8da5-7e63c32e1920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.107614 Nov 27 20:57:18.102121 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1749/3651] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:17 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:18.115851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c34f9f46-d4d4-45ba-b902-a334b53b03fb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:18.133814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c34f9f46-d4d4-45ba-b902-a334b53b03fb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:18.158146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c34f9f46-d4d4-45ba-b902-a334b53b03fb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.158915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c34f9f46-d4d4-45ba-b902-a334b53b03fb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.159826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c34f9f46-d4d4-45ba-b902-a334b53b03fb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.160296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c34f9f46-d4d4-45ba-b902-a334b53b03fb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.231463 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c34f9f46-d4d4-45ba-b902-a334b53b03fb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 14 microversion: 2.1 time: 0.128392 Nov 27 20:57:18.233877 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1750/3652] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:18 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:57:18.245246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:18.253808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:18.269579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.270435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.271475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.272140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.306176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lazy-loading 'flavor' on Instance uuid 7ff1ffe9-44c3-486f-82a9-680b299d2921 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:57:18.524952 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71841240-9410-4fdb-81ff-9eaa20dea9d3 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action" status: 200 len: 32 microversion: 2.1 time: 0.282827 Nov 27 20:57:18.526466 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1751/3653] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:18 2021] POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:57:18.538250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-608dee28-e4c7-42eb-a26c-60593bc56048 req-36f45780-76a7-45dd-85bf-0b2be7f29d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf02d0b-4468-4742-8c5e-399186f81700", "tag": "8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:18.542838 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:18.542838 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:18.566198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-608dee28-e4c7-42eb-a26c-60593bc56048 req-36f45780-76a7-45dd-85bf-0b2be7f29d81 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.568276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-608dee28-e4c7-42eb-a26c-60593bc56048 req-36f45780-76a7-45dd-85bf-0b2be7f29d81 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.595001 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-608dee28-e4c7-42eb-a26c-60593bc56048 req-36f45780-76a7-45dd-85bf-0b2be7f29d81 service nova] Creating event network-changed:8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f for instance 7bf02d0b-4468-4742-8c5e-399186f81700 on nch2-master-1 Nov 27 20:57:18.602737 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-608dee28-e4c7-42eb-a26c-60593bc56048 req-36f45780-76a7-45dd-85bf-0b2be7f29d81 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074300 Nov 27 20:57:18.606405 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1752/3654] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:18.623151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:18.625081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:18.636537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.638029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:18.639205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:18.639967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:19.126026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:19.136104 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-69856485-01bd-464b-abc2-9a0e6820843e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1314 microversion: 2.1 time: 0.525769 Nov 27 20:57:19.142063 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1753/3655] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:18 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:19.173332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:19.174216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:19.189285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:19.190282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:19.191370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:19.192052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:19.733266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:19.747045 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3df7ebac-c224-49e5-9dad-86740100d5bf tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.592998 Nov 27 20:57:19.749687 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1754/3656] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:19 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:19.765355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aa742a18-077d-496f-83ed-d490b7de8c01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:19.767639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aa742a18-077d-496f-83ed-d490b7de8c01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:19.787237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa742a18-077d-496f-83ed-d490b7de8c01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:19.792054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa742a18-077d-496f-83ed-d490b7de8c01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:19.793179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa742a18-077d-496f-83ed-d490b7de8c01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:19.796757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa742a18-077d-496f-83ed-d490b7de8c01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:19.930717 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aa742a18-077d-496f-83ed-d490b7de8c01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.177653 Nov 27 20:57:19.931626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1755/3657] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:19 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:19.941444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0baf0833-c45b-42c8-8ffb-c4e3b0fb6710 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:19.943313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0baf0833-c45b-42c8-8ffb-c4e3b0fb6710 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:19.964324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0baf0833-c45b-42c8-8ffb-c4e3b0fb6710 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:19.966858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0baf0833-c45b-42c8-8ffb-c4e3b0fb6710 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:19.968984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0baf0833-c45b-42c8-8ffb-c4e3b0fb6710 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:19.969491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0baf0833-c45b-42c8-8ffb-c4e3b0fb6710 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:20.027896 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0baf0833-c45b-42c8-8ffb-c4e3b0fb6710 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 14 microversion: 2.1 time: 0.094405 Nov 27 20:57:20.028553 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1756/3658] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:19 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:57:20.161227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:20.161921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:20.181187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:20.182034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:20.182965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:20.184534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:20.506317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:20.527072 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a6b365c5-ff26-40d6-9dbe-0be9e6daa75b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1501 microversion: 2.1 time: 0.371373 Nov 27 20:57:20.532792 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1757/3659] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:20 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1501 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:20.765349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:20.766290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:20.778427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:20.778918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:20.782481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:20.782988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:21.299125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:21.318198 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3fe7cd7-7239-4503-ae6e-b6acccb7c897 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.556969 Nov 27 20:57:21.319502 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1758/3660] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:20 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:21.336704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b33511f-a17d-49f4-a79d-0713ca5ed26d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:21.338320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b33511f-a17d-49f4-a79d-0713ca5ed26d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:21.348257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b33511f-a17d-49f4-a79d-0713ca5ed26d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:21.348782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b33511f-a17d-49f4-a79d-0713ca5ed26d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:21.349598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b33511f-a17d-49f4-a79d-0713ca5ed26d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:21.350037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b33511f-a17d-49f4-a79d-0713ca5ed26d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:21.401465 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b33511f-a17d-49f4-a79d-0713ca5ed26d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.079646 Nov 27 20:57:21.402233 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1759/3661] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:21 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:21.413010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa772c4c-4679-4403-b7d8-e51bc371f832 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:21.414723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa772c4c-4679-4403-b7d8-e51bc371f832 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:21.432166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa772c4c-4679-4403-b7d8-e51bc371f832 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:21.433925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa772c4c-4679-4403-b7d8-e51bc371f832 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:21.434911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa772c4c-4679-4403-b7d8-e51bc371f832 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:21.436492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa772c4c-4679-4403-b7d8-e51bc371f832 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:21.524101 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa772c4c-4679-4403-b7d8-e51bc371f832 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 14 microversion: 2.1 time: 0.120068 Nov 27 20:57:21.524923 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1760/3662] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:21 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:57:21.957063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:57:21.959963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:57:21.961182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:57:21.961957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:57:21.962881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:57:21.975978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:21.976650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:21.977618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:21.977916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.001004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Getting quotas for project c03be159839446f2a47ca07f13bb552c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:57:22.006705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Getting quotas for user 8e7695cf8df749e9af62b1746e818ea3 and project c03be159839446f2a47ca07f13bb552c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:57:22.254419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:57:22.261481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='caa38af6-5178-4b65-9a06-d11b9f7b1114',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='10ddafcd-c9e0-437c-8d6e-29009b4bedca',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d68e4828-a000-482f-90e9-83e87b933855',volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:57:22.262812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f986e2f-d4ac-4ed5-a12e-42ce18715da5"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:22.267483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:22.281270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.283870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.288820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.292478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.699594 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a8a6b30c-1b3d-4a21-aed3-3eb17e55060c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446391 Nov 27 20:57:22.701949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1761/3663] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 20:57:22 2021] POST /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:22.733993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:22.738607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:22.753947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.757873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.760125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.760662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.799662 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd7bc10b-04bd-404d-8771-fded4e9b65d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.298179 Nov 27 20:57:22.800757 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1903/3664] 10.222.0.21 () {62 vars in 1188 bytes} [Sat Nov 27 20:57:14 2021] POST /compute/v2.1/servers => generated 406 bytes in 8301 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 20:57:22.811602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae7352e8-6acc-4f6f-b81d-f5febfd0a7cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:22.812846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae7352e8-6acc-4f6f-b81d-f5febfd0a7cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:22.822035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae7352e8-6acc-4f6f-b81d-f5febfd0a7cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.822035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae7352e8-6acc-4f6f-b81d-f5febfd0a7cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.822808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae7352e8-6acc-4f6f-b81d-f5febfd0a7cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.823285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae7352e8-6acc-4f6f-b81d-f5febfd0a7cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.891214 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae7352e8-6acc-4f6f-b81d-f5febfd0a7cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.081826 Nov 27 20:57:22.892160 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1904/3665] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:22 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:22.907444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cdacb42f-ca4a-4400-bbf7-ebe03c10473e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:22.911507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cdacb42f-ca4a-4400-bbf7-ebe03c10473e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:22.933159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdacb42f-ca4a-4400-bbf7-ebe03c10473e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.933716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdacb42f-ca4a-4400-bbf7-ebe03c10473e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:22.934819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdacb42f-ca4a-4400-bbf7-ebe03c10473e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:22.936960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdacb42f-ca4a-4400-bbf7-ebe03c10473e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:23.039755 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cdacb42f-ca4a-4400-bbf7-ebe03c10473e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 14 microversion: 2.1 time: 0.145019 Nov 27 20:57:23.043509 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1905/3666] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:22 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:57:23.049631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:23.059983 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6bf44c9e-b916-44e4-82f0-b3daa8dbe837 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.356181 Nov 27 20:57:23.067768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b9053b3-62d3-4571-b97f-0a544efa6f22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:23.071483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b9053b3-62d3-4571-b97f-0a544efa6f22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:23.071804 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1762/3667] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:22 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:23.283789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b9053b3-62d3-4571-b97f-0a544efa6f22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:23.296780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b9053b3-62d3-4571-b97f-0a544efa6f22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:23.300876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b9053b3-62d3-4571-b97f-0a544efa6f22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:23.302667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b9053b3-62d3-4571-b97f-0a544efa6f22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1285 microversion: 2.32 time: 0.256644 Nov 27 20:57:23.304284 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1906/3668] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:23 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:23.908835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd3662f1-4ca7-4349-8010-9ba3c69dce55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:23.910985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd3662f1-4ca7-4349-8010-9ba3c69dce55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:23.937425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd3662f1-4ca7-4349-8010-9ba3c69dce55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:23.940349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd3662f1-4ca7-4349-8010-9ba3c69dce55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:23.943883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd3662f1-4ca7-4349-8010-9ba3c69dce55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:23.946160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd3662f1-4ca7-4349-8010-9ba3c69dce55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:24.055157 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd3662f1-4ca7-4349-8010-9ba3c69dce55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.155596 Nov 27 20:57:24.056653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e78296d0-2fa8-4930-aa49-6a2fce14159e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:24.060361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e78296d0-2fa8-4930-aa49-6a2fce14159e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:24.061100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1763/3669] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:23 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:24.070218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e78296d0-2fa8-4930-aa49-6a2fce14159e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:24.071766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e78296d0-2fa8-4930-aa49-6a2fce14159e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:24.072889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e78296d0-2fa8-4930-aa49-6a2fce14159e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:24.081861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:24.082550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:24.087649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e78296d0-2fa8-4930-aa49-6a2fce14159e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:24.096613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:24.097085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:24.097926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:24.098705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:24.175332 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e78296d0-2fa8-4930-aa49-6a2fce14159e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 14 microversion: 2.1 time: 0.126677 Nov 27 20:57:24.182227 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1907/3670] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:24 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:57:24.325453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:24.326398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:24.337739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:24.343872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:24.346054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:24.347715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:24.430847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:24.442079 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0d26541-0da2-4e9b-b616-2629d6e1d4ab tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.365314 Nov 27 20:57:24.444822 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1764/3671] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:24 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:24.511355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:24.545409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:24.549015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:24.550429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c7b969f4-99af-46a9-91cb-c549ec056f77 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1575 microversion: 2.32 time: 0.231333 Nov 27 20:57:24.551215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1908/3672] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:24 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:25.068447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c28910f-ace0-47f0-bf38-1fc34f1eaa01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:25.078485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c28910f-ace0-47f0-bf38-1fc34f1eaa01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:25.094890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c28910f-ace0-47f0-bf38-1fc34f1eaa01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.097763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c28910f-ace0-47f0-bf38-1fc34f1eaa01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.100572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c28910f-ace0-47f0-bf38-1fc34f1eaa01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.106084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c28910f-ace0-47f0-bf38-1fc34f1eaa01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.192062 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c28910f-ace0-47f0-bf38-1fc34f1eaa01 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.127265 Nov 27 20:57:25.196623 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1765/3673] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:25 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:57:25.196796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c7dd8b9-ee8a-4ae2-bb19-b1a18ce0566b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:25.196796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c7dd8b9-ee8a-4ae2-bb19-b1a18ce0566b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:25.211984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c7dd8b9-ee8a-4ae2-bb19-b1a18ce0566b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.212912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c7dd8b9-ee8a-4ae2-bb19-b1a18ce0566b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.216591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c7dd8b9-ee8a-4ae2-bb19-b1a18ce0566b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.217234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c7dd8b9-ee8a-4ae2-bb19-b1a18ce0566b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.288813 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c7dd8b9-ee8a-4ae2-bb19-b1a18ce0566b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 14 microversion: 2.1 time: 0.102685 Nov 27 20:57:25.293986 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1909/3674] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:25 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 20:57:25.493892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:25.495515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:25.516456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.518786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.521339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.527506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.574893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:25.576357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:25.612605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.615020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.618807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:25.621173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:25.949152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:25.966799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:25.968762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:25.973074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53707407-a427-46ca-8a46-e7e39ff020a4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1593 microversion: 2.32 time: 0.400620 Nov 27 20:57:25.986644 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1910/3675] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:25 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1593 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:57:26.205394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4bc358a6-a3a2-4a49-b063-0a59b461cacf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:26.208708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4bc358a6-a3a2-4a49-b063-0a59b461cacf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:26.234831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bc358a6-a3a2-4a49-b063-0a59b461cacf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.235760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bc358a6-a3a2-4a49-b063-0a59b461cacf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.238965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bc358a6-a3a2-4a49-b063-0a59b461cacf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.240871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bc358a6-a3a2-4a49-b063-0a59b461cacf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.286469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:26.303891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-caef6ffa-c95e-4855-97ae-d92b8b51a3c5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.840204 Nov 27 20:57:26.304534 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1766/3676] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:25 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:26.326542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05390893-4f15-4e83-94e0-6e4a56c744c8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:26.329349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05390893-4f15-4e83-94e0-6e4a56c744c8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:26.342277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05390893-4f15-4e83-94e0-6e4a56c744c8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.342740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05390893-4f15-4e83-94e0-6e4a56c744c8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.343583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05390893-4f15-4e83-94e0-6e4a56c744c8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.344023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05390893-4f15-4e83-94e0-6e4a56c744c8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.361296 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4bc358a6-a3a2-4a49-b063-0a59b461cacf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.160301 Nov 27 20:57:26.362743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1911/3677] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:26 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:57:26.374290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:26.376067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:26.391821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.394010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.395092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.400475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.449728 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05390893-4f15-4e83-94e0-6e4a56c744c8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 8205 microversion: 2.1 time: 0.140608 Nov 27 20:57:26.454304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1767/3678] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:26 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 8205 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:26.455443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:57:26.620255 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7c36c7d1-6950-4cea-a2f2-b9961ac58a00 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 204 len: 0 microversion: 2.1 time: 0.254811 Nov 27 20:57:26.622731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1912/3679] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:57:26 2021] DELETE /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:57:26.632280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:26.633188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:26.649346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.649850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.651338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:26.652181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:26.996014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:26.997259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:27.009427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.012762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.016606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.017340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.239331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:27.252457 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf816a27-d6c1-4d3e-9567-d22d16271abd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1553 microversion: 2.1 time: 0.623041 Nov 27 20:57:27.253307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1768/3680] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:26 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1553 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:27.323096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:27.323852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:27.331449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.337648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.341301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.342148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.420284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:27.442035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:27.451484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:27.457094 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-38bdb3b4-9274-482c-aa05-effc8acd68c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1661 microversion: 2.32 time: 0.464956 Nov 27 20:57:27.457968 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1913/3681] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:26 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1661 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:57:27.463745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4c5408e-254b-4031-8bbc-5a0c3a4680bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:27.465054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4c5408e-254b-4031-8bbc-5a0c3a4680bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:27.479232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4c5408e-254b-4031-8bbc-5a0c3a4680bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.480081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4c5408e-254b-4031-8bbc-5a0c3a4680bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.481464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4c5408e-254b-4031-8bbc-5a0c3a4680bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.482171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4c5408e-254b-4031-8bbc-5a0c3a4680bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.549026 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4c5408e-254b-4031-8bbc-5a0c3a4680bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.087857 Nov 27 20:57:27.556057 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1914/3682] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:27 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:27.569088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e7cf09a3-d966-465a-8ba5-f64a849f5c93 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:27.572462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e7cf09a3-d966-465a-8ba5-f64a849f5c93 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:27.603734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7cf09a3-d966-465a-8ba5-f64a849f5c93 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.610051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7cf09a3-d966-465a-8ba5-f64a849f5c93 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.613426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7cf09a3-d966-465a-8ba5-f64a849f5c93 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:27.615623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7cf09a3-d966-465a-8ba5-f64a849f5c93 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:27.744668 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e7cf09a3-d966-465a-8ba5-f64a849f5c93 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 16399 microversion: 2.1 time: 0.186773 Nov 27 20:57:27.749219 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1915/3683] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:27 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 16399 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:28.273062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:28.274904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:28.293431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:28.295791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:28.297888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:28.299794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:28.719899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:28.733944 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d5d8367-c63d-47d2-96b6-73445d04d6ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1553 microversion: 2.1 time: 0.464991 Nov 27 20:57:28.741379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1916/3684] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:28 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1553 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:28.749287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:28.765081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:28.784015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:28.784477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:28.785784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:28.785784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:28.993724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:29.016269 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb8f3a58-ed1a-4b8f-b319-358c402b5b87 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 1.697346 Nov 27 20:57:29.019547 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1769/3685] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:27 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:29.029522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b98600b7-4abd-4312-a4f0-b11d6c16d83e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:29.030785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b98600b7-4abd-4312-a4f0-b11d6c16d83e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:29.065200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b98600b7-4abd-4312-a4f0-b11d6c16d83e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:29.066296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b98600b7-4abd-4312-a4f0-b11d6c16d83e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:29.072394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b98600b7-4abd-4312-a4f0-b11d6c16d83e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:29.073337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b98600b7-4abd-4312-a4f0-b11d6c16d83e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:29.138491 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b98600b7-4abd-4312-a4f0-b11d6c16d83e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.117162 Nov 27 20:57:29.140182 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1770/3686] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:29 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:29.143943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:29.150689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7d16ad5-fff1-4312-b7f8-7bd47b6127ad tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:29.152216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7d16ad5-fff1-4312-b7f8-7bd47b6127ad tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:29.153251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:29.160031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:29.163066 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-beb12e36-1203-48cc-a3de-77761010bafd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1708 microversion: 2.32 time: 0.417721 Nov 27 20:57:29.168201 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1917/3687] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:28 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1708 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:29.170309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d16ad5-fff1-4312-b7f8-7bd47b6127ad tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:29.171007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d16ad5-fff1-4312-b7f8-7bd47b6127ad tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:29.172079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d16ad5-fff1-4312-b7f8-7bd47b6127ad tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:29.172882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d16ad5-fff1-4312-b7f8-7bd47b6127ad tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:29.253833 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7d16ad5-fff1-4312-b7f8-7bd47b6127ad tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 16399 microversion: 2.1 time: 0.111885 Nov 27 20:57:29.256252 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1771/3688] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:29 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 16399 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:29.754187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:29.755712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:29.776014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:29.780211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:29.784504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:29.786761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:30.036449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:30.037817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:30.057814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:30.058270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:30.059380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:30.059991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:30.781890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:30.799397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c644ff75-c808-4d58-a363-65fe0d8c0bcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1553 microversion: 2.1 time: 1.049630 Nov 27 20:57:30.804958 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1918/3689] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:29 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1553 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:30.810600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb32e9d1-1b4d-4441-b07b-c9d180a2e892 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:30.811869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb32e9d1-1b4d-4441-b07b-c9d180a2e892 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:30.832407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb32e9d1-1b4d-4441-b07b-c9d180a2e892 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:30.833869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb32e9d1-1b4d-4441-b07b-c9d180a2e892 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:30.838196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb32e9d1-1b4d-4441-b07b-c9d180a2e892 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:30.839423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb32e9d1-1b4d-4441-b07b-c9d180a2e892 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:30.917706 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb32e9d1-1b4d-4441-b07b-c9d180a2e892 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.110493 Nov 27 20:57:30.919146 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1919/3690] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:30 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:30.926405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:30.927206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:30.939210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:30.939787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:30.940719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:30.942136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:31.183027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:31.201085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-760cb91d-e913-4687-aef7-c257e59837d9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 1.166384 Nov 27 20:57:31.205039 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1772/3691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:30 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:57:31.220174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8c0a5249-7eef-464c-9fba-db337fbb9674 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:31.221914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8c0a5249-7eef-464c-9fba-db337fbb9674 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:31.249129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c0a5249-7eef-464c-9fba-db337fbb9674 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:31.249944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c0a5249-7eef-464c-9fba-db337fbb9674 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:31.261417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c0a5249-7eef-464c-9fba-db337fbb9674 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:31.261884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c0a5249-7eef-464c-9fba-db337fbb9674 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:31.336600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:31.349562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:31.353290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:31.357227 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8c0a5249-7eef-464c-9fba-db337fbb9674 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 16399 microversion: 2.1 time: 0.150166 Nov 27 20:57:31.358278 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1773/3692] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:31 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 16399 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:31.358815 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-77ab3ed3-2035-462a-bdaa-5a4cc8760b3b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1743 microversion: 2.32 time: 0.438361 Nov 27 20:57:31.359837 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1920/3693] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:30 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1743 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:31.821386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:31.822061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:31.837619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:31.838083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:31.838901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:31.839375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:31.928827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-460bf584-45e8-4497-987d-26ea366a7a87 req-2df5a488-545e-4386-ab69-ac46305c6620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c2b87a-8405-4308-a621-10f0104e888d", "name": "network-vif-deleted", "tag": "ac049382-3c5c-431f-846c-8a82be6d6454"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:31.930399 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:31.930399 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:31.947578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-460bf584-45e8-4497-987d-26ea366a7a87 req-2df5a488-545e-4386-ab69-ac46305c6620 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:31.948050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-460bf584-45e8-4497-987d-26ea366a7a87 req-2df5a488-545e-4386-ab69-ac46305c6620 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:31.973204 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-460bf584-45e8-4497-987d-26ea366a7a87 req-2df5a488-545e-4386-ab69-ac46305c6620 service nova] Creating event network-vif-deleted:ac049382-3c5c-431f-846c-8a82be6d6454 for instance 49c2b87a-8405-4308-a621-10f0104e888d on nch1-master-1 Nov 27 20:57:31.985686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-460bf584-45e8-4497-987d-26ea366a7a87 req-2df5a488-545e-4386-ab69-ac46305c6620 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062335 Nov 27 20:57:31.986247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1921/3694] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:57:31.998134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ccd3f64c-10d8-4a59-9b0e-a3b992a20bf8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:31.999614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ccd3f64c-10d8-4a59-9b0e-a3b992a20bf8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:32.012801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd3f64c-10d8-4a59-9b0e-a3b992a20bf8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.015976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd3f64c-10d8-4a59-9b0e-a3b992a20bf8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:32.018872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd3f64c-10d8-4a59-9b0e-a3b992a20bf8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.019739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd3f64c-10d8-4a59-9b0e-a3b992a20bf8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:32.034809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:32.049952 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dd5d6982-5ee0-4e08-a200-db9cd297663b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 200 len: 1511 microversion: 2.1 time: 0.233075 Nov 27 20:57:32.053086 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1774/3695] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:31 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:32.112375 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ccd3f64c-10d8-4a59-9b0e-a3b992a20bf8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.124466 Nov 27 20:57:32.114129 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1922/3696] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:31 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:32.219265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:32.220634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:32.233155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.240795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:32.241940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.242569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:32.370105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bcd23c4e-5946-4249-92e3-2dc21001f2ce tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:32.371223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bcd23c4e-5946-4249-92e3-2dc21001f2ce tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:32.382266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcd23c4e-5946-4249-92e3-2dc21001f2ce tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.387827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcd23c4e-5946-4249-92e3-2dc21001f2ce tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:32.388932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcd23c4e-5946-4249-92e3-2dc21001f2ce tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.389532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bcd23c4e-5946-4249-92e3-2dc21001f2ce tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:32.491274 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bcd23c4e-5946-4249-92e3-2dc21001f2ce tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.125381 Nov 27 20:57:32.492956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1923/3697] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:32 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:32.503633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:32.506246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:32.520502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.521564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:32.523510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:32.524220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.236502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:33.265091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:33.268867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:33.270393 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27119358-34cb-4aec-bd53-8f459ad9bbfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1837 microversion: 2.32 time: 0.775557 Nov 27 20:57:33.271815 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1924/3698] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:32 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1837 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:33.286227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:33.287839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:33.298355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.299180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.300111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.300630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.338386 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. Nov 27 20:57:33.339027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:57:33.340169 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cbf8fc2a-5aed-4d66-b113-671fc322a2e3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 404 len: 111 microversion: 2.1 time: 0.066980 Nov 27 20:57:33.343778 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1925/3699] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:33 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:57:33.349822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-345c9f16-c74e-44c1-99c1-a4900ca9bd13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:33.351843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-345c9f16-c74e-44c1-99c1-a4900ca9bd13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:33.360377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-345c9f16-c74e-44c1-99c1-a4900ca9bd13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.361079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-345c9f16-c74e-44c1-99c1-a4900ca9bd13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.362054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-345c9f16-c74e-44c1-99c1-a4900ca9bd13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.363213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-345c9f16-c74e-44c1-99c1-a4900ca9bd13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.417365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:33.455245 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-345c9f16-c74e-44c1-99c1-a4900ca9bd13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.112562 Nov 27 20:57:33.459036 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1926/3700] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:33 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:33.467079 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-923be8fb-ede2-448c-8971-cca742a0e766 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 1.252538 Nov 27 20:57:33.469289 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1775/3701] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:32 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:33.510340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-36533392-bba8-436c-8f5f-4481e3954e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:33.511626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36533392-bba8-436c-8f5f-4481e3954e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:33.519933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36533392-bba8-436c-8f5f-4481e3954e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.521552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36533392-bba8-436c-8f5f-4481e3954e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.522856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36533392-bba8-436c-8f5f-4481e3954e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.524071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36533392-bba8-436c-8f5f-4481e3954e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.583974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:33.584978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:33.590631 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-36533392-bba8-436c-8f5f-4481e3954e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.089911 Nov 27 20:57:33.592630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1927/3702] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:33 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:33.598332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.602407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.604614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:33.605365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:33.625873 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. Nov 27 20:57:33.627528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:57:33.629114 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-00841be4-9fe0-4c08-b6ed-1c8543792aa4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050853 Nov 27 20:57:33.634454 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1776/3703] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 20:57:33 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:57:33.942739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-207012346", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "39b4c68b-6f2a-4d98-a40b-89a7cdc47e01"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:34.040699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] validate_networks() for [('39b4c68b-6f2a-4d98-a40b-89a7cdc47e01', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:57:34.292950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:34.294017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:34.305919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:34.311557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:34.312436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:34.312878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:34.988773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:35.007934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:35.011361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:35.014136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eae3437d-fbc5-4d3a-8fe3-dc70bd672956 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1837 microversion: 2.32 time: 0.726303 Nov 27 20:57:35.015932 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1777/3704] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:34 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1837 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:57:35.021329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99bf1366-c37b-4fcc-8e1d-f97725c84b81 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:35.022741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99bf1366-c37b-4fcc-8e1d-f97725c84b81 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:35.030784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99bf1366-c37b-4fcc-8e1d-f97725c84b81 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.031682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99bf1366-c37b-4fcc-8e1d-f97725c84b81 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.032796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99bf1366-c37b-4fcc-8e1d-f97725c84b81 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.033853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99bf1366-c37b-4fcc-8e1d-f97725c84b81 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.101610 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99bf1366-c37b-4fcc-8e1d-f97725c84b81 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.083512 Nov 27 20:57:35.115373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1778/3705] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:35 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:35.124943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:35.126293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:35.140151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.140151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.140151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.140151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.778460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:35.788048 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c848b564-2ee7-4fae-b242-9995f563b790 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.669678 Nov 27 20:57:35.789149 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1779/3706] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:35 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:35.808421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:57:35.809027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:57:35.810593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:57:35.811692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:57:35.812314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:57:35.824287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-363424e8-dfb6-470c-a19c-7064d8a8611e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:35.827740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-363424e8-dfb6-470c-a19c-7064d8a8611e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:35.837739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.838741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.843022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.845132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.859928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-363424e8-dfb6-470c-a19c-7064d8a8611e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.860401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-363424e8-dfb6-470c-a19c-7064d8a8611e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.861237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-363424e8-dfb6-470c-a19c-7064d8a8611e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:35.861685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-363424e8-dfb6-470c-a19c-7064d8a8611e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:35.898599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:57:35.907985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for user ed87ef17973a49f2a9108bdfbff65415 and project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:57:35.951242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-363424e8-dfb6-470c-a19c-7064d8a8611e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.160200 Nov 27 20:57:35.959530 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1780/3707] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:35 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:35.964951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:57:35.972037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5d103aa2-af0f-482f-b9e2-5843e6f227e4 req-95424803-57fa-42eb-a70e-56458b03d1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "a5c35030-3d16-480b-990d-350880945284"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:35.976662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 2fab9b3d-b9f7-449d-badc-5d3e46958265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:57:35.989337 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:35.989337 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:36.037176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5d103aa2-af0f-482f-b9e2-5843e6f227e4 req-95424803-57fa-42eb-a70e-56458b03d1de service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:36.037661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5d103aa2-af0f-482f-b9e2-5843e6f227e4 req-95424803-57fa-42eb-a70e-56458b03d1de service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:36.084330 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5d103aa2-af0f-482f-b9e2-5843e6f227e4 req-95424803-57fa-42eb-a70e-56458b03d1de service nova] Creating event network-changed:a5c35030-3d16-480b-990d-350880945284 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch2-master-1 Nov 27 20:57:36.120653 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5d103aa2-af0f-482f-b9e2-5843e6f227e4 req-95424803-57fa-42eb-a70e-56458b03d1de service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141052 Nov 27 20:57:36.121684 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1781/3708] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:36.140029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:36.140755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:36.167491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:36.168299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:36.169528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:36.170425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:36.184474 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c7f8677-fc89-42bb-bccf-f31cfaf316d5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.245692 Nov 27 20:57:36.189592 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1928/3709] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:57:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:57:36.217334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab7fada9-80c6-4935-88fc-990924921bf1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:36.221276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab7fada9-80c6-4935-88fc-990924921bf1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:36.244848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab7fada9-80c6-4935-88fc-990924921bf1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:36.246635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab7fada9-80c6-4935-88fc-990924921bf1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:36.248251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab7fada9-80c6-4935-88fc-990924921bf1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:36.251359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab7fada9-80c6-4935-88fc-990924921bf1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:36.357700 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab7fada9-80c6-4935-88fc-990924921bf1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.162213 Nov 27 20:57:36.365616 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1929/3710] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:36 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:36.373035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a17f0448-0767-4665-b964-d00d9d56083d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:36.374589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a17f0448-0767-4665-b964-d00d9d56083d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 2fab9b3d-b9f7-449d-badc-5d3e46958265] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:36.648986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a17f0448-0767-4665-b964-d00d9d56083d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:36.656600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a17f0448-0767-4665-b964-d00d9d56083d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265" status: 200 len: 1214 microversion: 2.1 time: 0.288940 Nov 27 20:57:36.662597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1930/3711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:36 2021] GET /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265 => generated 1214 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:36.682541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c8a8abc-787e-4198-a320-067e97c649c8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:36.688215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c8a8abc-787e-4198-a320-067e97c649c8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 2fab9b3d-b9f7-449d-badc-5d3e46958265] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:36.784996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c8a8abc-787e-4198-a320-067e97c649c8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 2fab9b3d-b9f7-449d-badc-5d3e46958265] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:57:36.892884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:36.903125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:36.908183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:36.915749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-676b28d1-dafa-40a0-a1ed-f16e31bcfb97 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1837 microversion: 2.32 time: 0.788760 Nov 27 20:57:36.918611 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1782/3712] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:36 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1837 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:36.925771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:36.927371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:36.942800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:36.951210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:36.952507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:36.953177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:37.324090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:37.334634 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-159e9e31-c5b7-4325-a54e-96cfa8f71e26 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.414663 Nov 27 20:57:37.335348 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1783/3713] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:36 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:37.359651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf5e28de-f720-4eb0-909a-7f45367dc256 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:37.361187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf5e28de-f720-4eb0-909a-7f45367dc256 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:37.386806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf5e28de-f720-4eb0-909a-7f45367dc256 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:37.390108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf5e28de-f720-4eb0-909a-7f45367dc256 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:37.392381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf5e28de-f720-4eb0-909a-7f45367dc256 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:37.393047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf5e28de-f720-4eb0-909a-7f45367dc256 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:37.485290 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf5e28de-f720-4eb0-909a-7f45367dc256 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.135288 Nov 27 20:57:37.490537 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1784/3714] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:37 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:37.502461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c94ca4b-af2b-4efa-bfac-541d803a1319 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:37.504175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c94ca4b-af2b-4efa-bfac-541d803a1319 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:37.523764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c94ca4b-af2b-4efa-bfac-541d803a1319 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:37.524411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c94ca4b-af2b-4efa-bfac-541d803a1319 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:37.527041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c94ca4b-af2b-4efa-bfac-541d803a1319 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:37.531131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c94ca4b-af2b-4efa-bfac-541d803a1319 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:37.628543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c94ca4b-af2b-4efa-bfac-541d803a1319 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 24588 microversion: 2.42 time: 0.135986 Nov 27 20:57:37.634586 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1785/3715] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:37 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 24588 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:37.941147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:37.942336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:37.944472 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.scheduler.client.report [None req-9c8a8abc-787e-4198-a320-067e97c649c8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Deleted allocations for instance 2fab9b3d-b9f7-449d-badc-5d3e46958265 Nov 27 20:57:37.962191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:37.967403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:37.970625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:37.972237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:38.013175 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c8a8abc-787e-4198-a320-067e97c649c8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265" status: 204 len: 0 microversion: 2.1 time: 1.331865 Nov 27 20:57:38.024630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1931/3716] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:57:36 2021] DELETE /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265 => generated 0 bytes in 1347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:57:38.051733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:38.058664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 2fab9b3d-b9f7-449d-badc-5d3e46958265] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:38.106670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:38.109002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:38.111532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:38.119999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:38.168991 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 2fab9b3d-b9f7-449d-badc-5d3e46958265 could not be found. Nov 27 20:57:38.172876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 2fab9b3d-b9f7-449d-badc-5d3e46958265 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:57:38.176050 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1054b15-3c2f-4874-af88-1616dd3d1491 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265" status: 404 len: 111 microversion: 2.1 time: 0.145033 Nov 27 20:57:38.177735 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1932/3717] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:38 2021] GET /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:57:38.354764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:38.355736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:38.378453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:38.383299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:38.384580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:38.390397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:39.274113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:39.294584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:39.296561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:39.299742 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10d35851-be6a-4b47-8cff-378d3dfe150d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1858 microversion: 2.32 time: 1.366124 Nov 27 20:57:39.305275 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1786/3718] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:37 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1858 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:39.322063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-033cc4aa-e55b-4026-9580-51ec773d4253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:39.325150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-033cc4aa-e55b-4026-9580-51ec773d4253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:39.351452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-033cc4aa-e55b-4026-9580-51ec773d4253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:39.352286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-033cc4aa-e55b-4026-9580-51ec773d4253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:39.355605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-033cc4aa-e55b-4026-9580-51ec773d4253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:39.360100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-033cc4aa-e55b-4026-9580-51ec773d4253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:39.498558 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-033cc4aa-e55b-4026-9580-51ec773d4253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.189219 Nov 27 20:57:39.518347 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1787/3719] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:39 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:39.537704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-427ccd61-0c7e-4df3-a4bb-e14e87005b7d req-a4e5bf4b-7599-4372-a162-4ae5eb86876b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "14e81df6-5fa0-4831-a0b4-1270866d1c86"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:39.541227 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:39.541227 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:39.552676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-427ccd61-0c7e-4df3-a4bb-e14e87005b7d req-a4e5bf4b-7599-4372-a162-4ae5eb86876b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:39.553767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-427ccd61-0c7e-4df3-a4bb-e14e87005b7d req-a4e5bf4b-7599-4372-a162-4ae5eb86876b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:39.607383 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-427ccd61-0c7e-4df3-a4bb-e14e87005b7d req-a4e5bf4b-7599-4372-a162-4ae5eb86876b service nova] Creating event network-changed:14e81df6-5fa0-4831-a0b4-1270866d1c86 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch2-master-1 Nov 27 20:57:39.615352 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-427ccd61-0c7e-4df3-a4bb-e14e87005b7d req-a4e5bf4b-7599-4372-a162-4ae5eb86876b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093347 Nov 27 20:57:39.616337 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1788/3720] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:39.630712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1092926328", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "39b4c68b-6f2a-4d98-a40b-89a7cdc47e01"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:39.727947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:39.735891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-299e99cb-da21-4af3-8143-fcc828316efd tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 1.387676 Nov 27 20:57:39.736891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] validate_networks() for [('39b4c68b-6f2a-4d98-a40b-89a7cdc47e01', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:57:39.743824 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1933/3721] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:38 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:39.771413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50072f88-6ec2-4553-aa2a-ec93469fe8da tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:39.774052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-50072f88-6ec2-4553-aa2a-ec93469fe8da tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:39.789367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50072f88-6ec2-4553-aa2a-ec93469fe8da tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:39.797305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50072f88-6ec2-4553-aa2a-ec93469fe8da tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:39.808205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50072f88-6ec2-4553-aa2a-ec93469fe8da tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:39.809855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50072f88-6ec2-4553-aa2a-ec93469fe8da tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:39.933317 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50072f88-6ec2-4553-aa2a-ec93469fe8da tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 32608 microversion: 2.42 time: 0.187388 Nov 27 20:57:39.936531 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1934/3722] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:39 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 32608 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:40.333071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:40.333784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:40.357051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:40.362815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:40.364929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:40.365904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:41.460008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:41.480527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:41.486544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:41.496508 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4418c5c-1c9f-4ab0-8073-7e5b95678e72 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.168078 Nov 27 20:57:41.501447 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1935/3723] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:40 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:41.506458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cdb770ce-ef92-4d6c-9184-9b8aee739885 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:41.526779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cdb770ce-ef92-4d6c-9184-9b8aee739885 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:41.541432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdb770ce-ef92-4d6c-9184-9b8aee739885 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:41.545451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdb770ce-ef92-4d6c-9184-9b8aee739885 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:41.546511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdb770ce-ef92-4d6c-9184-9b8aee739885 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:41.552011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdb770ce-ef92-4d6c-9184-9b8aee739885 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:41.632520 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cdb770ce-ef92-4d6c-9184-9b8aee739885 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.129408 Nov 27 20:57:41.644916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1936/3724] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:41 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:41.674572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:41.705239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:41.723877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:41.724337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:41.728347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:41.729190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.320435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:57:42.321751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:57:42.324082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:57:42.324921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:57:42.326926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:57:42.358814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.361005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.384275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:42.406015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.407552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.419239 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-791d7a84-9a83-4af8-88ec-128eab2e7444 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.769547 Nov 27 20:57:42.420440 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1937/3725] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:41 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:42.447639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-67d31792-f509-427a-bc0d-0c45a8897fc5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:42.459086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-67d31792-f509-427a-bc0d-0c45a8897fc5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:42.473342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67d31792-f509-427a-bc0d-0c45a8897fc5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.474894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67d31792-f509-427a-bc0d-0c45a8897fc5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.477557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67d31792-f509-427a-bc0d-0c45a8897fc5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.478274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67d31792-f509-427a-bc0d-0c45a8897fc5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.481291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:57:42.491505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for user ed87ef17973a49f2a9108bdfbff65415 and project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:57:42.514090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:57:42.517395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:57:42.569203 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-67d31792-f509-427a-bc0d-0c45a8897fc5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 32608 microversion: 2.42 time: 0.132898 Nov 27 20:57:42.574894 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1938/3726] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:42 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 32608 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:42.590461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-84da499e-52e4-4f8c-b201-a14e27e75407 req-ab7d90e5-44b1-4953-8f4f-d5e39ebff2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "decba21e-805a-4b68-9d38-6e3b44662ff5"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:42.605461 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:42.605461 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:42.627511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-84da499e-52e4-4f8c-b201-a14e27e75407 req-ab7d90e5-44b1-4953-8f4f-d5e39ebff2f5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.628375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-84da499e-52e4-4f8c-b201-a14e27e75407 req-ab7d90e5-44b1-4953-8f4f-d5e39ebff2f5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.644597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5931192f-c347-4be6-ab35-7ed3fcdfa428 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.025712 Nov 27 20:57:42.645252 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1789/3727] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:57:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 3027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:57:42.650937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-84da499e-52e4-4f8c-b201-a14e27e75407 req-ab7d90e5-44b1-4953-8f4f-d5e39ebff2f5 service nova] Creating event network-changed:decba21e-805a-4b68-9d38-6e3b44662ff5 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch2-master-1 Nov 27 20:57:42.662726 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-84da499e-52e4-4f8c-b201-a14e27e75407 req-ab7d90e5-44b1-4953-8f4f-d5e39ebff2f5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085042 Nov 27 20:57:42.665753 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1939/3728] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:42.680978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:42.681868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:42.688644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b16049dd-c63e-4747-b6b1-40af4a072e8e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:42.695232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.695693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.696469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b16049dd-c63e-4747-b6b1-40af4a072e8e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:42.696615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.696948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.748033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b16049dd-c63e-4747-b6b1-40af4a072e8e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.749072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b16049dd-c63e-4747-b6b1-40af4a072e8e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.750291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b16049dd-c63e-4747-b6b1-40af4a072e8e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:42.750655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b16049dd-c63e-4747-b6b1-40af4a072e8e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:42.861060 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b16049dd-c63e-4747-b6b1-40af4a072e8e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.193528 Nov 27 20:57:42.865697 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1940/3729] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:42 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:42.879002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb294e75-3285-451c-8593-df6853190db8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:42.880032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cb294e75-3285-451c-8593-df6853190db8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:43.076660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cb294e75-3285-451c-8593-df6853190db8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:43.086756 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cb294e75-3285-451c-8593-df6853190db8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1215 microversion: 2.1 time: 0.219432 Nov 27 20:57:43.088793 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1941/3730] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:42 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:43.465809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:43.466436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:43.491206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:43.492467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:43.493512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:43.493942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:43.607741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:43.640855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:43.646925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:43.654460 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-093d0fa3-1312-4d2a-b7db-ab044f8d34f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.001570 Nov 27 20:57:43.658828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1790/3731] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:42 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:43.688475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-026b691f-fdf6-489d-b446-c922512eee25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:43.693727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-026b691f-fdf6-489d-b446-c922512eee25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:43.726085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026b691f-fdf6-489d-b446-c922512eee25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:43.726723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026b691f-fdf6-489d-b446-c922512eee25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:43.729178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026b691f-fdf6-489d-b446-c922512eee25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:43.731523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026b691f-fdf6-489d-b446-c922512eee25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:43.845942 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-026b691f-fdf6-489d-b446-c922512eee25 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 32608 microversion: 2.42 time: 0.184342 Nov 27 20:57:43.846673 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1791/3732] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:43 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 32608 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:43.878928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-474de64f-ee94-4991-a075-76edfaf0da5a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:43.881427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-474de64f-ee94-4991-a075-76edfaf0da5a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:43.911211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-474de64f-ee94-4991-a075-76edfaf0da5a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:43.912464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-474de64f-ee94-4991-a075-76edfaf0da5a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:43.915133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-474de64f-ee94-4991-a075-76edfaf0da5a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:43.916734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-474de64f-ee94-4991-a075-76edfaf0da5a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:43.999656 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-474de64f-ee94-4991-a075-76edfaf0da5a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.125575 Nov 27 20:57:44.000839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1792/3733] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:43 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:44.108420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:44.109412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:44.129260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:44.129674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:44.130374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:44.130825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:44.264585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:44.273354 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a75f875-be98-4b2b-adac-4a218bf37464 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1267 microversion: 2.1 time: 0.169043 Nov 27 20:57:44.277107 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1793/3734] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:44 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:44.498201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:44.509343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c7884b83-2921-4c5d-b1d2-bcae2e64bd60 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 1.075031 Nov 27 20:57:44.522041 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1942/3735] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:43 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:44.684199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:44.684826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:44.699709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:44.702995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:44.704087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:44.705210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:44.858364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-105eaa33-d429-464c-9d8c-061bd3871d68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:44.859948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-105eaa33-d429-464c-9d8c-061bd3871d68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:44.871025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-105eaa33-d429-464c-9d8c-061bd3871d68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:44.872219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-105eaa33-d429-464c-9d8c-061bd3871d68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:44.874293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-105eaa33-d429-464c-9d8c-061bd3871d68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:44.875134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-105eaa33-d429-464c-9d8c-061bd3871d68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:44.963579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-105eaa33-d429-464c-9d8c-061bd3871d68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.108433 Nov 27 20:57:44.965089 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1943/3736] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:44 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:57:45.016093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fae148f6-3c4c-4768-830f-03f98754493c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:45.018036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fae148f6-3c4c-4768-830f-03f98754493c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:45.034478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fae148f6-3c4c-4768-830f-03f98754493c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:45.037752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fae148f6-3c4c-4768-830f-03f98754493c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:45.039039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fae148f6-3c4c-4768-830f-03f98754493c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:45.040536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fae148f6-3c4c-4768-830f-03f98754493c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:45.119906 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fae148f6-3c4c-4768-830f-03f98754493c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.110855 Nov 27 20:57:45.124058 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1944/3737] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:45 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:45.283289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-c1f9cfc5-3e33-4bff-859d-2a5d9671a93c req-834177f7-4847-4d08-9c7b-9328d7794746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "6632957c-feee-4506-8295-b419d941abe2"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:45.286272 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:45.286272 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:45.309519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c1f9cfc5-3e33-4bff-859d-2a5d9671a93c req-834177f7-4847-4d08-9c7b-9328d7794746 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:45.310216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c1f9cfc5-3e33-4bff-859d-2a5d9671a93c req-834177f7-4847-4d08-9c7b-9328d7794746 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:45.334367 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-c1f9cfc5-3e33-4bff-859d-2a5d9671a93c req-834177f7-4847-4d08-9c7b-9328d7794746 service nova] Creating event network-changed:6632957c-feee-4506-8295-b419d941abe2 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch2-master-1 Nov 27 20:57:45.340673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:45.353285 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-c1f9cfc5-3e33-4bff-859d-2a5d9671a93c req-834177f7-4847-4d08-9c7b-9328d7794746 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074940 Nov 27 20:57:45.356374 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1945/3738] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:45.361750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:45.370627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:45.374543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:45.379055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:45.384048 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6882c0e-c049-4c1f-ba03-49f66b294c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.703553 Nov 27 20:57:45.386288 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1794/3739] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:44 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:57:45.393753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:45.395665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:45.397413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:45.398768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:45.529453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:45.530238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:45.550224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:45.551141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:45.558795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:45.560099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:45.645285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:45.662917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-293a244f-34ef-4472-8e17-8a435ee1ca4d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1273 microversion: 2.1 time: 0.305048 Nov 27 20:57:45.664743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1946/3740] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:45 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:45.673536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-27316873", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "8e775e0e-d0b2-44a7-affc-5b1f09fd1579"}, {"uuid": "269b2da3-6894-4325-8492-a6acca066ccb"}, {"uuid": "8e775e0e-d0b2-44a7-affc-5b1f09fd1579"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:45.782816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] validate_networks() for [('8e775e0e-d0b2-44a7-affc-5b1f09fd1579', None, None, None, None, None), ('269b2da3-6894-4325-8492-a6acca066ccb', None, None, None, None, None), ('8e775e0e-d0b2-44a7-affc-5b1f09fd1579', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:57:46.451618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:46.469520 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2001d2c-3ba3-494e-b18a-0b69cf5980f5 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1525 microversion: 2.1 time: 0.935631 Nov 27 20:57:46.470859 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1795/3741] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:45 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1525 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:46.475849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-575e1839-6a28-433d-8dee-825a3538f9b0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:46.477008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-575e1839-6a28-433d-8dee-825a3538f9b0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:46.489754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575e1839-6a28-433d-8dee-825a3538f9b0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:46.495656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575e1839-6a28-433d-8dee-825a3538f9b0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:46.497067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575e1839-6a28-433d-8dee-825a3538f9b0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:46.497723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575e1839-6a28-433d-8dee-825a3538f9b0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:46.606039 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-575e1839-6a28-433d-8dee-825a3538f9b0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.130530 Nov 27 20:57:46.608099 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1796/3742] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:46 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:46.643242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da933c53-b3f4-4591-876f-91fe743b5ca8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:46.650028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da933c53-b3f4-4591-876f-91fe743b5ca8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:46.662796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da933c53-b3f4-4591-876f-91fe743b5ca8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:46.664704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da933c53-b3f4-4591-876f-91fe743b5ca8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:46.666920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da933c53-b3f4-4591-876f-91fe743b5ca8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:46.668242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da933c53-b3f4-4591-876f-91fe743b5ca8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:46.732071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da933c53-b3f4-4591-876f-91fe743b5ca8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.120363 Nov 27 20:57:46.734698 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1797/3743] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:46 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:46.743556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:46.744648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:46.790578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:46.794031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:46.796130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:46.796130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:47.547884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:47.560254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:47.562181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:47.564921 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e60ea4c3-3098-4a72-b278-6c7ca3b8202e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.828232 Nov 27 20:57:47.566097 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1798/3744] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:46 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:47.572285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:47.573232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:47.581584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:47.582426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:47.583702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:47.584377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:48.743997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:48.761152 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d283565-7a50-4606-8b0f-3afe7235f924 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1315 microversion: 2.1 time: 1.193477 Nov 27 20:57:48.762487 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1799/3745] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:47 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1315 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:48.793477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:48.794682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:48.815751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:48.816637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:48.817778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:48.818422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.023425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:57:49.025508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:57:49.026156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:57:49.026740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:57:49.027420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:57:49.045812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.046531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.047666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.048288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.075235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Getting quotas for project 90d16fd50eb2412992297f88bb1d4580. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:57:49.082448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Getting quotas for user 2bb012478bf740468bba9fa762ac06ca and project 90d16fd50eb2412992297f88bb1d4580. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:57:49.098513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:57:49.113712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:57:49.174122 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0698a225-50c3-457b-85b6-c18674f6dedb tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.507599 Nov 27 20:57:49.175504 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1947/3746] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:57:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:57:49.181768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-467d336c-ee51-42d2-b6ee-2f9ed7fe132f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:49.183101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-467d336c-ee51-42d2-b6ee-2f9ed7fe132f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:49.190247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-467d336c-ee51-42d2-b6ee-2f9ed7fe132f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.191005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-467d336c-ee51-42d2-b6ee-2f9ed7fe132f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.192151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-467d336c-ee51-42d2-b6ee-2f9ed7fe132f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.192891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-467d336c-ee51-42d2-b6ee-2f9ed7fe132f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.255835 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-467d336c-ee51-42d2-b6ee-2f9ed7fe132f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078703 Nov 27 20:57:49.256812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1948/3747] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:49 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:49.282197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-55144bf6-b0d1-40f5-b0b3-157587c48262 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:49.286086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-55144bf6-b0d1-40f5-b0b3-157587c48262 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:49.325553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55144bf6-b0d1-40f5-b0b3-157587c48262 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.326205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55144bf6-b0d1-40f5-b0b3-157587c48262 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.327042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55144bf6-b0d1-40f5-b0b3-157587c48262 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.327512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55144bf6-b0d1-40f5-b0b3-157587c48262 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.445096 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-55144bf6-b0d1-40f5-b0b3-157587c48262 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.183380 Nov 27 20:57:49.450748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1949/3748] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:49 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:49.467625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a29f9f12-bcbc-4432-a4e0-05ddd6a3d3d3 req-16f89e5c-f6a7-439a-b77e-02d95f7c5fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "dab5072e-30d9-4a47-ba0e-926f7a2917e3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:49.472856 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:49.472856 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:49.498946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a29f9f12-bcbc-4432-a4e0-05ddd6a3d3d3 req-16f89e5c-f6a7-439a-b77e-02d95f7c5fa4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.499483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a29f9f12-bcbc-4432-a4e0-05ddd6a3d3d3 req-16f89e5c-f6a7-439a-b77e-02d95f7c5fa4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.543136 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a29f9f12-bcbc-4432-a4e0-05ddd6a3d3d3 req-16f89e5c-f6a7-439a-b77e-02d95f7c5fa4 service nova] Creating event network-changed:dab5072e-30d9-4a47-ba0e-926f7a2917e3 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch2-master-1 Nov 27 20:57:49.550482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:49.558650 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a29f9f12-bcbc-4432-a4e0-05ddd6a3d3d3 req-16f89e5c-f6a7-439a-b77e-02d95f7c5fa4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104550 Nov 27 20:57:49.568639 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1950/3749] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:49.581330 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5a34c36d-f02d-463c-b764-e6947b525a28 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1505 microversion: 2.1 time: 0.802592 Nov 27 20:57:49.585434 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1800/3750] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:48 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1505 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:49.597625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:49.597625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:49.606850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.607318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.608443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:49.608962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:49.619436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-df9c24b8-e8e6-4929-8108-57ddec8db90e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:49.622200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-df9c24b8-e8e6-4929-8108-57ddec8db90e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:49.828756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-df9c24b8-e8e6-4929-8108-57ddec8db90e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:49.836543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-df9c24b8-e8e6-4929-8108-57ddec8db90e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1211 microversion: 2.1 time: 0.235973 Nov 27 20:57:49.837679 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1801/3751] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:49 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1211 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:49.850071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1310eb77-b26f-4507-8019-ca90b1dfe590 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'create', calling method: .version_select at 0x7f15c6d2be50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1361444795", "description": "tempest-description-282878193"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:50.633640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:50.654207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:50.657756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:50.660858 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5a31ba7-d353-4003-ae06-fc437f74c545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.087436 Nov 27 20:57:50.665116 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1951/3752] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:49 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:50.670089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:50.670677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:50.689476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:50.690339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:50.691347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:50.691953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:50.938034 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1310eb77-b26f-4507-8019-ca90b1dfe590 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.094370 Nov 27 20:57:50.940281 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1802/3753] 10.222.0.21 () {60 vars in 1179 bytes} [Sat Nov 27 20:57:49 2021] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:50.946822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4631292a-1ee9-4330-9130-373bd8edfdd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:50.950101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4631292a-1ee9-4330-9130-373bd8edfdd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:50.967438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631292a-1ee9-4330-9130-373bd8edfdd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:50.969219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631292a-1ee9-4330-9130-373bd8edfdd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:50.972098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631292a-1ee9-4330-9130-373bd8edfdd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:50.973570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631292a-1ee9-4330-9130-373bd8edfdd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.086684 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4631292a-1ee9-4330-9130-373bd8edfdd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.144288 Nov 27 20:57:51.089321 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1803/3754] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:50 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:51.105154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-470da999-4ad3-4d72-a482-4e72113cc6c4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:51.112051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-470da999-4ad3-4d72-a482-4e72113cc6c4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:51.128533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470da999-4ad3-4d72-a482-4e72113cc6c4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.130994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470da999-4ad3-4d72-a482-4e72113cc6c4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.132935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470da999-4ad3-4d72-a482-4e72113cc6c4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.134187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-470da999-4ad3-4d72-a482-4e72113cc6c4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.145272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:51.157350 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7107efc-6a4f-4bb6-b6c7-7c4d7d2336d0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1315 microversion: 2.1 time: 0.490992 Nov 27 20:57:51.166834 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1952/3755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:50 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:51.181507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ca1a4788-8b43-4f4a-8dc7-01978b17e5e0 req-d96bc78c-d88b-4d34-8600-8bf250930880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e971ee8-48a3-48e9-b448-43f691848430", "tag": "ba5093c8-5e5f-466d-8325-216ffbb07fe4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:51.185017 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:51.185017 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:51.208547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ca1a4788-8b43-4f4a-8dc7-01978b17e5e0 req-d96bc78c-d88b-4d34-8600-8bf250930880 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.210971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ca1a4788-8b43-4f4a-8dc7-01978b17e5e0 req-d96bc78c-d88b-4d34-8600-8bf250930880 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.227924 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-470da999-4ad3-4d72-a482-4e72113cc6c4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.133395 Nov 27 20:57:51.230203 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1804/3756] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:51 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:51.237558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ca1a4788-8b43-4f4a-8dc7-01978b17e5e0 req-d96bc78c-d88b-4d34-8600-8bf250930880 service nova] Creating event network-changed:ba5093c8-5e5f-466d-8325-216ffbb07fe4 for instance 9e971ee8-48a3-48e9-b448-43f691848430 on nch1-master-1 Nov 27 20:57:51.238047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:51.242544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:51.250073 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ca1a4788-8b43-4f4a-8dc7-01978b17e5e0 req-d96bc78c-d88b-4d34-8600-8bf250930880 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079000 Nov 27 20:57:51.253174 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1953/3757] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:51.258288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.259204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.260494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.262007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.265576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1361444795"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:51.266205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:51.284651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.285111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.296696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.298441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.443236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:51.458060 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e045323c-d9e5-4c56-ba26-7f724e19342c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1269 microversion: 2.1 time: 0.225991 Nov 27 20:57:51.458762 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1805/3758] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:51 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:51.625062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f902e5c4-4e37-4912-a348-92f5a4a450a0 req-c0de9404-10e5-4b18-a7b0-26f261172942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "2d0104dc-e751-4773-8bd9-f4d85f534f51"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:51.627336 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:51.627336 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:57:51.641738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f902e5c4-4e37-4912-a348-92f5a4a450a0 req-c0de9404-10e5-4b18-a7b0-26f261172942 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.642203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f902e5c4-4e37-4912-a348-92f5a4a450a0 req-c0de9404-10e5-4b18-a7b0-26f261172942 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.667825 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f902e5c4-4e37-4912-a348-92f5a4a450a0 req-c0de9404-10e5-4b18-a7b0-26f261172942 service nova] Creating event network-changed:2d0104dc-e751-4773-8bd9-f4d85f534f51 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch2-master-1 Nov 27 20:57:51.684978 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f902e5c4-4e37-4912-a348-92f5a4a450a0 req-c0de9404-10e5-4b18-a7b0-26f261172942 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067584 Nov 27 20:57:51.687393 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1806/3759] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:51.698985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:51.702312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:51.710675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.712090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.713822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:51.715481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:51.854499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.security_group_api [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Adding security group 19368da8-0710-4106-a9fa-538f3db5e97e to port 961a8aab-3a21-4f48-887a-804874479b17 Nov 27 20:57:52.350061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:52.364938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:52.369155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:52.372650 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e373ea5-2751-42d3-9ca3-7d094565886a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.679618 Nov 27 20:57:52.383587 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1807/3760] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:51 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:52.392782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d5c64ada-5113-49ad-b44a-5b37ab09e587 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:52.393821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d5c64ada-5113-49ad-b44a-5b37ab09e587 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:52.405512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5c64ada-5113-49ad-b44a-5b37ab09e587 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.406299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5c64ada-5113-49ad-b44a-5b37ab09e587 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:52.408600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5c64ada-5113-49ad-b44a-5b37ab09e587 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.409650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5c64ada-5113-49ad-b44a-5b37ab09e587 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:52.488980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d5c64ada-5113-49ad-b44a-5b37ab09e587 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.113734 Nov 27 20:57:52.489938 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1808/3761] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:52 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:52.498980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:52.500897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:52.511541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.512392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:52.513674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.514598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:52.714484 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4f0d9b7-33ec-4e18-bf4f-c48198fe3f6c tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action" status: 202 len: 0 microversion: 2.1 time: 1.458755 Nov 27 20:57:52.721050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1954/3762] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:51 2021] POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action => generated 0 bytes in 1462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:52.728112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-31c3a1b6-bd93-42a8-8610-a3a44bd875d0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:52.732703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-31c3a1b6-bd93-42a8-8610-a3a44bd875d0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:52.762347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31c3a1b6-bd93-42a8-8610-a3a44bd875d0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.763523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31c3a1b6-bd93-42a8-8610-a3a44bd875d0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:52.766342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31c3a1b6-bd93-42a8-8610-a3a44bd875d0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.767061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31c3a1b6-bd93-42a8-8610-a3a44bd875d0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:52.905592 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-31c3a1b6-bd93-42a8-8610-a3a44bd875d0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.181916 Nov 27 20:57:52.912340 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1955/3763] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:52 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:52.920554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:52.921368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:52.930769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.931624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:52.932844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:52.933502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:53.328805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:53.346642 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b59dfab-f802-4bb2-abfe-99848c7b1d76 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1311 microversion: 2.1 time: 0.432207 Nov 27 20:57:53.348546 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1956/3764] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:52 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1311 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:53.356766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1361444795"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:53.357629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:53.375449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:53.375926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:53.376751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:53.377370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:53.632228 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.security_group_api [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Removing security group 19368da8-0710-4106-a9fa-538f3db5e97e from port 961a8aab-3a21-4f48-887a-804874479b17 Nov 27 20:57:53.912358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:53.921883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-594ecfd5-d272-4f96-b0d9-f9b893d3f4b3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1315 microversion: 2.1 time: 1.430093 Nov 27 20:57:53.935290 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1809/3765] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:52 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1315 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:53.940194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:53.940861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:53.955152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:53.955601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:53.956532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:53.956821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.598727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-01324ebb-2450-4eb2-8e9e-cedfb5044b9b tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action" status: 202 len: 0 microversion: 2.1 time: 1.247157 Nov 27 20:57:54.599893 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1957/3766] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:53 2021] POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:54.608719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70811bb3-c40f-43d8-a33f-5d4f4f0f1d8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:54.611797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70811bb3-c40f-43d8-a33f-5d4f4f0f1d8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:54.630408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70811bb3-c40f-43d8-a33f-5d4f4f0f1d8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:54.634447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70811bb3-c40f-43d8-a33f-5d4f4f0f1d8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.636523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70811bb3-c40f-43d8-a33f-5d4f4f0f1d8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:54.640085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70811bb3-c40f-43d8-a33f-5d4f4f0f1d8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.747849 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70811bb3-c40f-43d8-a33f-5d4f4f0f1d8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.144779 Nov 27 20:57:54.750077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1958/3767] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:54 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:54.766963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-178e0601-1281-4615-8d0b-1d7d5c11acc9 req-fe6f581b-c81e-4392-be24-376740944c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "e6b41390-a8e1-44f3-b5dd-7e6b200fe288"}, {"name": "network-changed", "server_uuid": "7ff1ffe9-44c3-486f-82a9-680b299d2921", "tag": "961a8aab-3a21-4f48-887a-804874479b17"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:54.774232 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:54.774232 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:54.796578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:54.813929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:54.817090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-178e0601-1281-4615-8d0b-1d7d5c11acc9 req-fe6f581b-c81e-4392-be24-376740944c04 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:54.817923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-178e0601-1281-4615-8d0b-1d7d5c11acc9 req-fe6f581b-c81e-4392-be24-376740944c04 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.818757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:54.823075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7eae2c53-9c33-4283-adff-d30bf8f72eea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.886455 Nov 27 20:57:54.826635 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1810/3768] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:53 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:54.840173 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-178e0601-1281-4615-8d0b-1d7d5c11acc9 req-fe6f581b-c81e-4392-be24-376740944c04 service nova] Creating event network-changed:e6b41390-a8e1-44f3-b5dd-7e6b200fe288 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch2-master-1 Nov 27 20:57:54.841454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ff3ea4a-db69-466f-b834-9e7c4a85eb1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:54.841844 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-178e0601-1281-4615-8d0b-1d7d5c11acc9 req-fe6f581b-c81e-4392-be24-376740944c04 service nova] Creating event network-changed:961a8aab-3a21-4f48-887a-804874479b17 for instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 on nch1-master-1 Nov 27 20:57:54.843179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ff3ea4a-db69-466f-b834-9e7c4a85eb1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:54.857467 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-178e0601-1281-4615-8d0b-1d7d5c11acc9 req-fe6f581b-c81e-4392-be24-376740944c04 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105645 Nov 27 20:57:54.858234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff3ea4a-db69-466f-b834-9e7c4a85eb1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:54.858698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff3ea4a-db69-466f-b834-9e7c4a85eb1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.859156 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1959/3769] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:54 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:54.863665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff3ea4a-db69-466f-b834-9e7c4a85eb1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:54.865133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff3ea4a-db69-466f-b834-9e7c4a85eb1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.886811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:54.888147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:54.898984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:54.899865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.900952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:54.901785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:54.954924 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ff3ea4a-db69-466f-b834-9e7c4a85eb1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.123077 Nov 27 20:57:54.957139 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1811/3770] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:54 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:54.968689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da5d703b-aabf-4b44-ab24-f55839346fb9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'create', calling method: .version_select at 0x7f15d94ba9d0>, body: {"pool": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:55.211143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:55.220510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce812664-e06c-4a41-b24e-26c953c9cec2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1332 microversion: 2.1 time: 0.359672 Nov 27 20:57:55.221112 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1960/3771] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:54 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1332 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:55.238065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:55.238706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:55.253660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:55.254086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:55.254885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:55.255364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:55.592423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:55.604686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79d9a45c-00fd-4a3c-a940-b6c13eee8611 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1315 microversion: 2.1 time: 0.369831 Nov 27 20:57:55.617405 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1961/3772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:55 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:55.764491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a149052-2770-4a60-9f75-fc36f43c4cb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:55.765641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a149052-2770-4a60-9f75-fc36f43c4cb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:55.781654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a149052-2770-4a60-9f75-fc36f43c4cb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:55.786627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a149052-2770-4a60-9f75-fc36f43c4cb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:55.789633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a149052-2770-4a60-9f75-fc36f43c4cb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:55.795164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a149052-2770-4a60-9f75-fc36f43c4cb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:55.891474 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a149052-2770-4a60-9f75-fc36f43c4cb5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.131298 Nov 27 20:57:55.895197 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1962/3773] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:55 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:55.909703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:55.915319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:55.924050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:55.924932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:55.925972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:55.926984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:56.460944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:56.471470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:56.473186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:56.474455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5cf98f43-e93c-4120-a02a-6d8bdf3bf00a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.576408 Nov 27 20:57:56.475091 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1963/3774] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:55 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:56.493953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3b59423-d8f4-4c88-aaba-ee33463a598c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:56.494977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d3b59423-d8f4-4c88-aaba-ee33463a598c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:56.512269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b59423-d8f4-4c88-aaba-ee33463a598c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:56.513133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b59423-d8f4-4c88-aaba-ee33463a598c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:56.514310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b59423-d8f4-4c88-aaba-ee33463a598c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:56.516069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3b59423-d8f4-4c88-aaba-ee33463a598c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:56.596437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3b59423-d8f4-4c88-aaba-ee33463a598c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.118289 Nov 27 20:57:56.603505 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1964/3775] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:56 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:56.610582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:56.611305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:56.627577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:56.628029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:56.628823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:56.636210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:57.099952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:57.124193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a218468d-00f6-4327-b924-0f6256b88aef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.517487 Nov 27 20:57:57.125214 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1965/3776] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:56 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:57.164042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:57.168849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:57.190841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:57.191120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:57.192990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:57.193765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.025344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:58.051603 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2430b611-7316-4176-a075-30c2025556bb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1315 microversion: 2.1 time: 0.903617 Nov 27 20:57:58.052519 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1966/3777] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:57 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1315 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:58.073232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-65fcd6ad-f7f9-428f-9802-b83abc316aa8 req-a8d100cc-d115-4c17-ab56-644ddae0b5bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff1ffe9-44c3-486f-82a9-680b299d2921", "tag": "961a8aab-3a21-4f48-887a-804874479b17"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:58.076264 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:58.076264 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:58.089438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-65fcd6ad-f7f9-428f-9802-b83abc316aa8 req-a8d100cc-d115-4c17-ab56-644ddae0b5bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.089883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-65fcd6ad-f7f9-428f-9802-b83abc316aa8 req-a8d100cc-d115-4c17-ab56-644ddae0b5bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.115138 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-65fcd6ad-f7f9-428f-9802-b83abc316aa8 req-a8d100cc-d115-4c17-ab56-644ddae0b5bd service nova] Creating event network-changed:961a8aab-3a21-4f48-887a-804874479b17 for instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 on nch1-master-1 Nov 27 20:57:58.122389 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-65fcd6ad-f7f9-428f-9802-b83abc316aa8 req-a8d100cc-d115-4c17-ab56-644ddae0b5bd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054468 Nov 27 20:57:58.123641 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1967/3778] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:58.158047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43d65b40-449d-41bf-a215-d3556fbb613e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:58.161050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43d65b40-449d-41bf-a215-d3556fbb613e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:58.175856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43d65b40-449d-41bf-a215-d3556fbb613e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.176364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43d65b40-449d-41bf-a215-d3556fbb613e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.177825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43d65b40-449d-41bf-a215-d3556fbb613e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.178391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43d65b40-449d-41bf-a215-d3556fbb613e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.252686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43d65b40-449d-41bf-a215-d3556fbb613e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.127204 Nov 27 20:57:58.259507 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1968/3779] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:58 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:57:58.266501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:58.267193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:58.277449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.278166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.279843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.281154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.730090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:58.747580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:58.749422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:58.751218 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a8217ba-8a85-4cdf-a921-448fa1a0e569 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.488860 Nov 27 20:57:58.762901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1969/3780] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:57:58 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:57:58.762901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-704fdccc-c0f2-44c9-862c-8539404973d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:58.762901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-704fdccc-c0f2-44c9-862c-8539404973d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:58.769540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-704fdccc-c0f2-44c9-862c-8539404973d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.770247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-704fdccc-c0f2-44c9-862c-8539404973d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.771460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-704fdccc-c0f2-44c9-862c-8539404973d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.772176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-704fdccc-c0f2-44c9-862c-8539404973d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.822795 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-704fdccc-c0f2-44c9-862c-8539404973d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.069644 Nov 27 20:57:58.824363 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1970/3781] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:57:58 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:57:58.834280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0fff466d-a0af-4aa4-9999-96bf6a81a5c2 req-b3d8df63-eb24-4669-bf62-dd55f66e043a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e971ee8-48a3-48e9-b448-43f691848430", "name": "network-vif-plugged", "status": "completed", "tag": "ba5093c8-5e5f-466d-8325-216ffbb07fe4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:57:58.836772 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:58.836772 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:57:58.848982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0fff466d-a0af-4aa4-9999-96bf6a81a5c2 req-b3d8df63-eb24-4669-bf62-dd55f66e043a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.849462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0fff466d-a0af-4aa4-9999-96bf6a81a5c2 req-b3d8df63-eb24-4669-bf62-dd55f66e043a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.873609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0fff466d-a0af-4aa4-9999-96bf6a81a5c2 req-b3d8df63-eb24-4669-bf62-dd55f66e043a service nova] Creating event network-vif-plugged:ba5093c8-5e5f-466d-8325-216ffbb07fe4 for instance 9e971ee8-48a3-48e9-b448-43f691848430 on nch1-master-1 Nov 27 20:57:58.886734 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0fff466d-a0af-4aa4-9999-96bf6a81a5c2 req-b3d8df63-eb24-4669-bf62-dd55f66e043a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060369 Nov 27 20:57:58.888894 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1971/3782] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:57:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:57:58.899462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:58.900650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:58.910332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.911149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:58.912321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:58.913822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:59.551300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:59.567438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6788d925-5791-4ee9-a36f-6c8b524b3dd9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.675321 Nov 27 20:57:59.569481 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1972/3783] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:58 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:57:59.576403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:57:59.585637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:57:59.605516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:59.605978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:59.608198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:57:59.609153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:57:59.963409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:57:59.995040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f51c87c-5f02-4685-b069-c679c2811102 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1315 microversion: 2.1 time: 0.423322 Nov 27 20:57:59.996566 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1973/3784] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:57:59 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:00.024943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b2607e7-2ea3-49bc-8a8a-7d10b9e43e7f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:00.027950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b2607e7-2ea3-49bc-8a8a-7d10b9e43e7f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:00.040887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2607e7-2ea3-49bc-8a8a-7d10b9e43e7f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.041850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2607e7-2ea3-49bc-8a8a-7d10b9e43e7f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.042891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2607e7-2ea3-49bc-8a8a-7d10b9e43e7f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.044789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2607e7-2ea3-49bc-8a8a-7d10b9e43e7f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.113317 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b2607e7-2ea3-49bc-8a8a-7d10b9e43e7f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.113597 Nov 27 20:58:00.114749 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1974/3785] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:57:59 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:00.123199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:00.124044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:00.134735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.136721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.139812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.140548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.548421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:00.562517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:00.566300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:00.568727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a8c59bc-f791-4a01-803d-644a55646e5b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.452665 Nov 27 20:58:00.602615 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1975/3786] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:00 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:00.610781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d75e4047-60b0-4d3a-9940-42ba44f6513b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:00.613781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d75e4047-60b0-4d3a-9940-42ba44f6513b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:00.623879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d75e4047-60b0-4d3a-9940-42ba44f6513b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.624588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d75e4047-60b0-4d3a-9940-42ba44f6513b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.625695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d75e4047-60b0-4d3a-9940-42ba44f6513b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.626389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d75e4047-60b0-4d3a-9940-42ba44f6513b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.681208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d75e4047-60b0-4d3a-9940-42ba44f6513b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.076828 Nov 27 20:58:00.682147 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1976/3787] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:00 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:00.689206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d5ad57fa-147a-4e99-9b09-d74963f04e78 req-73b3fea3-ad71-408b-95d9-8dad955ef78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "tag": "ad2be44c-7183-4c6d-99b8-d5e16696aadd"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:00.691168 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:00.691168 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:00.701830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d5ad57fa-147a-4e99-9b09-d74963f04e78 req-73b3fea3-ad71-408b-95d9-8dad955ef78e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.702526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d5ad57fa-147a-4e99-9b09-d74963f04e78 req-73b3fea3-ad71-408b-95d9-8dad955ef78e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.728804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d5ad57fa-147a-4e99-9b09-d74963f04e78 req-73b3fea3-ad71-408b-95d9-8dad955ef78e service nova] Creating event network-changed:ad2be44c-7183-4c6d-99b8-d5e16696aadd for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:00.737700 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d5ad57fa-147a-4e99-9b09-d74963f04e78 req-73b3fea3-ad71-408b-95d9-8dad955ef78e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052841 Nov 27 20:58:00.738888 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1977/3788] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:00.759928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:00.760770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:00.770288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.771228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.773474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:00.774972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:00.963296 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da5d703b-aabf-4b44-ab24-f55839346fb9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.004206 Nov 27 20:58:00.964006 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1812/3789] 10.222.0.21 () {60 vars in 1169 bytes} [Sat Nov 27 20:57:54 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:00.980234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.110"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:00.983218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:01.004732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:01.005368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:01.007633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:01.009089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:01.079151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Acquired lock "refresh_cache-7ff1ffe9-44c3-486f-82a9-680b299d2921" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:58:01.569554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:01.581863 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fac70a22-3398-4da7-be13-b08252e9e0f9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.841229 Nov 27 20:58:01.582829 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1978/3790] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:00 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:01.594625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:01.595570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:01.610305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:01.610768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:01.611598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:01.621263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:02.067529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:02.078818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd21bc21-d702-4ac8-bc47-2f1cf5cf1b56 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1502 microversion: 2.1 time: 0.492352 Nov 27 20:58:02.086005 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1979/3791] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:01 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1502 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:02.102292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-764b8158-409d-4bd9-b7b2-edd6918763c4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:02.104230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-764b8158-409d-4bd9-b7b2-edd6918763c4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:02.126484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764b8158-409d-4bd9-b7b2-edd6918763c4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:02.126958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764b8158-409d-4bd9-b7b2-edd6918763c4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:02.129368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764b8158-409d-4bd9-b7b2-edd6918763c4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:02.130558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764b8158-409d-4bd9-b7b2-edd6918763c4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:02.266599 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-764b8158-409d-4bd9-b7b2-edd6918763c4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.177443 Nov 27 20:58:02.268643 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1980/3792] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:02 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:02.280245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:02.282265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:02.299342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:02.300139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:02.302886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:02.304735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:02.940675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:02.955797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:02.957538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:02.960964 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a26f7c44-d73e-4ee9-8dca-614c50aae225 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.690666 Nov 27 20:58:02.961761 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1981/3793] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:02 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:02.978262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-463ff66a-652e-403b-b3e9-f7394f0eb334 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:02.979308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-463ff66a-652e-403b-b3e9-f7394f0eb334 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:02.986327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463ff66a-652e-403b-b3e9-f7394f0eb334 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:02.987100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463ff66a-652e-403b-b3e9-f7394f0eb334 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:02.988174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463ff66a-652e-403b-b3e9-f7394f0eb334 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:02.988887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463ff66a-652e-403b-b3e9-f7394f0eb334 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:03.040856 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-463ff66a-652e-403b-b3e9-f7394f0eb334 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.066739 Nov 27 20:58:03.042352 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1982/3794] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:02 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:03.056853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-33aa322c-222a-47ac-8f35-bfbf0f64b4aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:03.058751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-33aa322c-222a-47ac-8f35-bfbf0f64b4aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:03.072601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33aa322c-222a-47ac-8f35-bfbf0f64b4aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:03.076861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33aa322c-222a-47ac-8f35-bfbf0f64b4aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:03.078633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33aa322c-222a-47ac-8f35-bfbf0f64b4aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:03.080161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33aa322c-222a-47ac-8f35-bfbf0f64b4aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:03.227570 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-33aa322c-222a-47ac-8f35-bfbf0f64b4aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430/action" status: 202 len: 0 microversion: 2.1 time: 0.183459 Nov 27 20:58:03.233377 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1983/3795] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:03 2021] POST /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:03.241057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:03.241872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:03.254934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:03.255602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:03.257136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:03.258287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:03.552105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:03.567638 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-84f3e446-6e89-4b8b-9cf5-207cf1ed2558 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.332525 Nov 27 20:58:03.568248 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1984/3796] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:03 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:03.581939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d1312c29-1d0b-4ecb-ad87-29a6b87c4516 req-f7549523-a849-4d3a-a059-19fde82206c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "tag": "95cd7312-1395-4c53-9d65-8971e0e6c4f0"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:03.584024 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:03.584024 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:03.591863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Building network info cache for instance {{(pid=135679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:58:03.618589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d1312c29-1d0b-4ecb-ad87-29a6b87c4516 req-f7549523-a849-4d3a-a059-19fde82206c7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:03.620543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d1312c29-1d0b-4ecb-ad87-29a6b87c4516 req-f7549523-a849-4d3a-a059-19fde82206c7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:03.659199 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d1312c29-1d0b-4ecb-ad87-29a6b87c4516 req-f7549523-a849-4d3a-a059-19fde82206c7 service nova] Creating event network-changed:95cd7312-1395-4c53-9d65-8971e0e6c4f0 for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:03.678068 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d1312c29-1d0b-4ecb-ad87-29a6b87c4516 req-f7549523-a849-4d3a-a059-19fde82206c7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108346 Nov 27 20:58:03.678669 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1985/3797] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:03.684012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:03.686657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:03.708096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:03.708577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:03.712292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:03.715527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:04.329412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:04.342153 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8afe895f-9652-487a-8195-022faa689f64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1487 microversion: 2.1 time: 0.661801 Nov 27 20:58:04.349235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1986/3798] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:03 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1487 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:04.365206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a50acf43-a6a0-49e9-8b71-da6e9343a52c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:04.367374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a50acf43-a6a0-49e9-8b71-da6e9343a52c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:04.380948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50acf43-a6a0-49e9-8b71-da6e9343a52c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:04.381991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50acf43-a6a0-49e9-8b71-da6e9343a52c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:04.383656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50acf43-a6a0-49e9-8b71-da6e9343a52c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:04.384368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a50acf43-a6a0-49e9-8b71-da6e9343a52c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:04.470285 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a50acf43-a6a0-49e9-8b71-da6e9343a52c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.118354 Nov 27 20:58:04.474521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1987/3799] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:04 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:04.478513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-af8e3228-15be-4583-9b9b-942d5133cc0d req-b5658ed6-8458-49e8-aeea-1d5bf814fa49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff1ffe9-44c3-486f-82a9-680b299d2921", "tag": "961a8aab-3a21-4f48-887a-804874479b17"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:04.480118 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:04.480118 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:04.493285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-af8e3228-15be-4583-9b9b-942d5133cc0d req-b5658ed6-8458-49e8-aeea-1d5bf814fa49 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:04.493806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-af8e3228-15be-4583-9b9b-942d5133cc0d req-b5658ed6-8458-49e8-aeea-1d5bf814fa49 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:04.510092 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-af8e3228-15be-4583-9b9b-942d5133cc0d req-b5658ed6-8458-49e8-aeea-1d5bf814fa49 service nova] Creating event network-changed:961a8aab-3a21-4f48-887a-804874479b17 for instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 on nch1-master-1 Nov 27 20:58:04.518287 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-af8e3228-15be-4583-9b9b-942d5133cc0d req-b5658ed6-8458-49e8-aeea-1d5bf814fa49 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045420 Nov 27 20:58:04.519229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1988/3800] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:04.526770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:04.528718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:04.546596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:04.547022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:04.547884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:04.548999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:04.993423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:05.010281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:05.013474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:05.014730 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d1338f4-b1e5-4355-9c12-47dbd7ee7262 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.493941 Nov 27 20:58:05.015486 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1989/3801] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:04 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:05.024809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-760f0f45-aa82-413e-b2a2-5c69b33756b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:05.025785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-760f0f45-aa82-413e-b2a2-5c69b33756b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:05.042268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760f0f45-aa82-413e-b2a2-5c69b33756b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.044951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760f0f45-aa82-413e-b2a2-5c69b33756b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.050259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760f0f45-aa82-413e-b2a2-5c69b33756b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.051781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760f0f45-aa82-413e-b2a2-5c69b33756b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.155876 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-760f0f45-aa82-413e-b2a2-5c69b33756b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.138129 Nov 27 20:58:05.157011 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1990/3802] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:05 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:05.171368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:05.172559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:05.181909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.182981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.183875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.186481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.241566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:58:05.314297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Updating instance_info_cache with network_info: [{"id": "961a8aab-3a21-4f48-887a-804874479b17", "address": "fa:16:3e:bc:40:66", "network": {"id": "bec98bc9-0b5b-4b5f-b388-d430ab12ae4e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2039180822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ea113326fcea4903b6f63e84c0339fa7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap961a8aab-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:58:05.344831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Releasing lock "refresh_cache-7ff1ffe9-44c3-486f-82a9-680b299d2921" {{(pid=135679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:58:05.345926 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff85ea27-5d35-417f-8f7f-88cb7dac0d0a tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action" status: 202 len: 0 microversion: 2.1 time: 4.373569 Nov 27 20:58:05.347812 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1813/3803] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:00 2021] POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action => generated 0 bytes in 4376 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:58:05.364772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:05.367376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:05.390215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.391153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.392538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.393162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.407463 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a6fdea7-78dd-4288-b39c-af046bd17170 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 204 len: 0 microversion: 2.1 time: 0.244273 Nov 27 20:58:05.412030 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1991/3804] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:58:05 2021] DELETE /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:58:05.420831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.110"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:05.675679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:05.685934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6aec0ac6-1442-4703-a878-f8ae1233d061 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.336966 Nov 27 20:58:05.687699 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1814/3805] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:05 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:05.693716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:05.694541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:05.703171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.704523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.705316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.705859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.888106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:05.899828 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8875d6c-a344-4a3a-8347-e8211faa5ada tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1493 microversion: 2.1 time: 0.210452 Nov 27 20:58:05.901326 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1815/3806] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:05 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1493 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:05.909194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0e79318f-6416-4f89-a46a-1e0abac14777 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:05.910686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e79318f-6416-4f89-a46a-1e0abac14777 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:05.919983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e79318f-6416-4f89-a46a-1e0abac14777 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.920630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e79318f-6416-4f89-a46a-1e0abac14777 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.921664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e79318f-6416-4f89-a46a-1e0abac14777 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:05.922241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e79318f-6416-4f89-a46a-1e0abac14777 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:05.978643 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0e79318f-6416-4f89-a46a-1e0abac14777 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.074981 Nov 27 20:58:05.980795 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1816/3807] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:05 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:05.986996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a81dd60e-3634-464a-8112-63406f2eb0aa req-fc03816f-d67a-43e7-bb88-2483c2dcf540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "tag": "c5507caf-d3c6-4acf-851c-7c098f7db7ee"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:05.988864 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:05.988864 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:06.000871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a81dd60e-3634-464a-8112-63406f2eb0aa req-fc03816f-d67a-43e7-bb88-2483c2dcf540 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.001385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a81dd60e-3634-464a-8112-63406f2eb0aa req-fc03816f-d67a-43e7-bb88-2483c2dcf540 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.018236 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a81dd60e-3634-464a-8112-63406f2eb0aa req-fc03816f-d67a-43e7-bb88-2483c2dcf540 service nova] Creating event network-changed:c5507caf-d3c6-4acf-851c-7c098f7db7ee for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:06.024388 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a81dd60e-3634-464a-8112-63406f2eb0aa req-fc03816f-d67a-43e7-bb88-2483c2dcf540 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042264 Nov 27 20:58:06.025294 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1817/3808] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:06.035287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:06.036074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:06.043896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.044366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.045277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.045740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.153010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:06.161242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.161693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.163472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.164076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.413952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:06.430176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:06.432006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:06.433864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0b0820c-77e5-4226-ae3c-c35f2bd3e718 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.402981 Nov 27 20:58:06.447610 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1818/3809] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:06 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:06.453134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efd470a4-065c-484f-b534-0f396b89e25f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:06.454164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efd470a4-065c-484f-b534-0f396b89e25f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:06.462202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd470a4-065c-484f-b534-0f396b89e25f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.462669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd470a4-065c-484f-b534-0f396b89e25f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.463930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd470a4-065c-484f-b534-0f396b89e25f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.464433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd470a4-065c-484f-b534-0f396b89e25f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.522433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efd470a4-065c-484f-b534-0f396b89e25f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.073100 Nov 27 20:58:06.523113 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1819/3810] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:06 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:06.608850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Acquired lock "refresh_cache-7ff1ffe9-44c3-486f-82a9-680b299d2921" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 27 20:58:06.713577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:06.714461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:06.722805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.723580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.724572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.725694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.911046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:06.921134 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8927e903-5541-46a9-955e-aee361af7b05 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.215054 Nov 27 20:58:06.921872 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1820/3811] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:06 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:06.944173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:06.944960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:06.952736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.953446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:06.954669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:06.955145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:07.243729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:07.268877 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fba793ec-e397-499a-b3a9-c3808b3c6b80 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1493 microversion: 2.1 time: 0.328739 Nov 27 20:58:07.270458 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1821/3812] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:06 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1493 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:07.282130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6cd154a9-3d0a-4167-83d0-a8841d178a0f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:07.284820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6cd154a9-3d0a-4167-83d0-a8841d178a0f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:07.291870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cd154a9-3d0a-4167-83d0-a8841d178a0f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:07.292426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cd154a9-3d0a-4167-83d0-a8841d178a0f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:07.293543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cd154a9-3d0a-4167-83d0-a8841d178a0f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:07.294138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cd154a9-3d0a-4167-83d0-a8841d178a0f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:07.342989 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6cd154a9-3d0a-4167-83d0-a8841d178a0f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.069773 Nov 27 20:58:07.347706 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1822/3813] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:07 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:07.460126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:07.462170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:07.471835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:07.472301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:07.473114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:07.473560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:07.827278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:07.845477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:07.850095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:07.856172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bfaab8cf-9540-421d-9bec-957a091922ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.403596 Nov 27 20:58:07.857907 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1823/3814] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:07 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:07.876020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c9f05db-06b7-40c6-a680-1e480b1a3e55 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:07.877142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c9f05db-06b7-40c6-a680-1e480b1a3e55 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:07.891439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c9f05db-06b7-40c6-a680-1e480b1a3e55 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:07.892164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c9f05db-06b7-40c6-a680-1e480b1a3e55 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:07.894480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c9f05db-06b7-40c6-a680-1e480b1a3e55 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:07.895374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c9f05db-06b7-40c6-a680-1e480b1a3e55 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:07.984542 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c9f05db-06b7-40c6-a680-1e480b1a3e55 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.123808 Nov 27 20:58:07.988353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1824/3815] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:07 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:07.996622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:07.999838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:08.013402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.013541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.014392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.015206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.241615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:08.254038 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1d5e850f-63bd-4e98-982d-12119ff89704 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.267234 Nov 27 20:58:08.255119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1825/3816] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:07 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:08.260971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d2532b58-ef37-416d-867b-9a6085ab3835 req-a91e983e-30a1-48ad-a581-80e74d5f26a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e971ee8-48a3-48e9-b448-43f691848430", "name": "network-vif-deleted", "tag": "ba5093c8-5e5f-466d-8325-216ffbb07fe4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:08.262786 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:08.262786 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:08.271682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d2532b58-ef37-416d-867b-9a6085ab3835 req-a91e983e-30a1-48ad-a581-80e74d5f26a0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.272811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d2532b58-ef37-416d-867b-9a6085ab3835 req-a91e983e-30a1-48ad-a581-80e74d5f26a0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.290098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d2532b58-ef37-416d-867b-9a6085ab3835 req-a91e983e-30a1-48ad-a581-80e74d5f26a0 service nova] Creating event network-vif-deleted:ba5093c8-5e5f-466d-8325-216ffbb07fe4 for instance 9e971ee8-48a3-48e9-b448-43f691848430 on nch1-master-1 Nov 27 20:58:08.296106 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d2532b58-ef37-416d-867b-9a6085ab3835 req-a91e983e-30a1-48ad-a581-80e74d5f26a0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039499 Nov 27 20:58:08.297851 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1826/3817] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:08.304788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:08.305522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:08.316732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.317112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.318105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.319411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.372197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.372692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.373562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lazy-loading 'fault' on Instance uuid 9e971ee8-48a3-48e9-b448-43f691848430 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:58:08.444412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:08.466990 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d248d361-61a9-46e9-821f-8f460bc0a92e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 200 len: 1305 microversion: 2.1 time: 0.167485 Nov 27 20:58:08.479340 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1827/3818] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:08 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:08.488862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4631ecce-1780-413c-b487-7d14f0e6963a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:08.490761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4631ecce-1780-413c-b487-7d14f0e6963a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:08.501327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631ecce-1780-413c-b487-7d14f0e6963a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.502132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631ecce-1780-413c-b487-7d14f0e6963a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.503140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631ecce-1780-413c-b487-7d14f0e6963a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.503784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4631ecce-1780-413c-b487-7d14f0e6963a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.576956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4631ecce-1780-413c-b487-7d14f0e6963a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.081461 Nov 27 20:58:08.581812 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1828/3819] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:08 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:08.751878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Building network info cache for instance {{(pid=135680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 27 20:58:08.763464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-dcee8471-40de-4dd2-8766-f87d0f7f4854 req-67b615f4-1ca1-4a29-ba4b-29d40df2e5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff1ffe9-44c3-486f-82a9-680b299d2921", "tag": "961a8aab-3a21-4f48-887a-804874479b17"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:08.765869 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:08.765869 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:08.776060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dcee8471-40de-4dd2-8766-f87d0f7f4854 req-67b615f4-1ca1-4a29-ba4b-29d40df2e5b9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.776876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dcee8471-40de-4dd2-8766-f87d0f7f4854 req-67b615f4-1ca1-4a29-ba4b-29d40df2e5b9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.791235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-dcee8471-40de-4dd2-8766-f87d0f7f4854 req-67b615f4-1ca1-4a29-ba4b-29d40df2e5b9 service nova] Creating event network-changed:961a8aab-3a21-4f48-887a-804874479b17 for instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 on nch1-master-1 Nov 27 20:58:08.797917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-dcee8471-40de-4dd2-8766-f87d0f7f4854 req-67b615f4-1ca1-4a29-ba4b-29d40df2e5b9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039821 Nov 27 20:58:08.798625 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1829/3820] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:08.881827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:08.882619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:08.905472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.907036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:08.907953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:08.911652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:09.496412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:09.518317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:09.522997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:09.525496 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e405e7a-6501-4373-909c-776345fbaef5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.650597 Nov 27 20:58:09.536826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1830/3821] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:08 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:58:09.536826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a78f1002-b390-429e-a34a-63bf0ff422ed tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:09.536826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a78f1002-b390-429e-a34a-63bf0ff422ed tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:09.544308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78f1002-b390-429e-a34a-63bf0ff422ed tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:09.544931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78f1002-b390-429e-a34a-63bf0ff422ed tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:09.546201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78f1002-b390-429e-a34a-63bf0ff422ed tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:09.546802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78f1002-b390-429e-a34a-63bf0ff422ed tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:09.635509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a78f1002-b390-429e-a34a-63bf0ff422ed tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.102333 Nov 27 20:58:09.635509 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1831/3822] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:09 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:09.639327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:09.639327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:09.645367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:09.645834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:09.647430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:09.647895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:09.986783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:09.999982 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d49fe165-2f42-4528-8221-725f4d98097c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.366057 Nov 27 20:58:10.000608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1832/3823] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:09 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:10.005227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:10.006169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:10.012326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:10.012928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:10.013747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:10.014265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:10.029113 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 9e971ee8-48a3-48e9-b448-43f691848430 could not be found. Nov 27 20:58:10.029732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 9e971ee8-48a3-48e9-b448-43f691848430 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:58:10.030585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed7ec823-6262-4fcf-ad77-aabf61e5bba5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 404 len: 111 microversion: 2.1 time: 0.028794 Nov 27 20:58:10.043278 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1833/3824] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:10 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:58:10.043278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ede28ec-ff01-432a-b382-1eb5886f3932 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:10.043278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ede28ec-ff01-432a-b382-1eb5886f3932 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:10.056833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ede28ec-ff01-432a-b382-1eb5886f3932 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:10.057430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ede28ec-ff01-432a-b382-1eb5886f3932 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:10.058230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ede28ec-ff01-432a-b382-1eb5886f3932 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:10.060234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ede28ec-ff01-432a-b382-1eb5886f3932 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:10.112139 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ede28ec-ff01-432a-b382-1eb5886f3932 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078872 Nov 27 20:58:10.118716 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1834/3825] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:10 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:10.186510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Updating instance_info_cache with network_info: [{"id": "961a8aab-3a21-4f48-887a-804874479b17", "address": "fa:16:3e:bc:40:66", "network": {"id": "bec98bc9-0b5b-4b5f-b388-d430ab12ae4e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2039180822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ea113326fcea4903b6f63e84c0339fa7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap961a8aab-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=135680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:58:10.204429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1648440797", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "39b4c68b-6f2a-4d98-a40b-89a7cdc47e01"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:10.213417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Releasing lock "refresh_cache-7ff1ffe9-44c3-486f-82a9-680b299d2921" {{(pid=135680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 27 20:58:10.214653 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e61cb6b-34e5-4041-997b-1aa937948358 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action" status: 202 len: 0 microversion: 2.1 time: 4.801040 Nov 27 20:58:10.215523 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1992/3826] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:05 2021] POST /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921/action => generated 0 bytes in 4803 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 27 20:58:10.225457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-046a54a0-fd7f-4bfd-b0f3-51321c1db41d tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '.version_select at 0x7f15c759d040>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:10.304612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] validate_networks() for [('39b4c68b-6f2a-4d98-a40b-89a7cdc47e01', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:58:10.886660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:58:10.888144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:58:10.889252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:58:10.889901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:58:10.890721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:58:10.905020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:10.905821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:10.907129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:10.907835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:10.933023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:58:10.940242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for user ed87ef17973a49f2a9108bdfbff65415 and project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:58:10.966422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:58:10.969228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:58:11.042193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4017684d-a5be-4382-95f9-5f16aa87f4dc tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849486 Nov 27 20:58:11.043882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1835/3827] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:58:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 20:58:11.050434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:11.051818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:11.062282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.063212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:11.064775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.065499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:11.488590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:11.506950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:11.510115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:11.512019 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abc19e23-ba54-473a-ab16-5064fe429198 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.466240 Nov 27 20:58:11.513003 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1836/3828] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:11 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:11.520199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10c55c36-6b5c-413f-85ac-c5c95adf0b50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:11.522911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10c55c36-6b5c-413f-85ac-c5c95adf0b50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:11.530734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10c55c36-6b5c-413f-85ac-c5c95adf0b50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.531429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10c55c36-6b5c-413f-85ac-c5c95adf0b50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:11.534740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10c55c36-6b5c-413f-85ac-c5c95adf0b50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.535322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10c55c36-6b5c-413f-85ac-c5c95adf0b50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:11.649327 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10c55c36-6b5c-413f-85ac-c5c95adf0b50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.134993 Nov 27 20:58:11.657022 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1837/3829] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:11 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:11.674968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:11.675084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:11.696901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.697758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:11.698825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.699509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:11.948021 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-046a54a0-fd7f-4bfd-b0f3-51321c1db41d tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "DELETE /compute/v2.1/os-floating-ips/e11b6841-a951-44ba-bf77-c769dd09921d" status: 202 len: 0 microversion: 2.1 time: 1.726351 Nov 27 20:58:11.949362 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1993/3830] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:58:10 2021] DELETE /compute/v2.1/os-floating-ips/e11b6841-a951-44ba-bf77-c769dd09921d => generated 0 bytes in 1728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:11.972484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:11.973223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:11.987953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.988410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:11.989246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:11.989702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.074124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:12.081946 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f03bc38-9272-4e9a-b04f-cbe70bb0d8c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.421946 Nov 27 20:58:12.083907 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1838/3831] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:11 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:12.095224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:12.101229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-043d1d5f-c660-44d5-86f1-4cfc7d7ba31e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:12.102650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-043d1d5f-c660-44d5-86f1-4cfc7d7ba31e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:12.106417 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd861823-73d6-446c-b81c-234f4d8451ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1211 microversion: 2.1 time: 0.151113 Nov 27 20:58:12.107010 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1994/3832] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:11 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:12.119470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eadb27f0-5028-4d7a-8668-7db7a60c4d50 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '.version_select at 0x7f15c73e8040>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:12.123678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-043d1d5f-c660-44d5-86f1-4cfc7d7ba31e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.124840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-043d1d5f-c660-44d5-86f1-4cfc7d7ba31e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.126030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-043d1d5f-c660-44d5-86f1-4cfc7d7ba31e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.126880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-043d1d5f-c660-44d5-86f1-4cfc7d7ba31e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.232897 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-043d1d5f-c660-44d5-86f1-4cfc7d7ba31e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.146214 Nov 27 20:58:12.237448 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1839/3833] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:12 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:12.391833 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eadb27f0-5028-4d7a-8668-7db7a60c4d50 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "DELETE /compute/v2.1/os-security-groups/19368da8-0710-4106-a9fa-538f3db5e97e" status: 202 len: 0 microversion: 2.1 time: 0.282422 Nov 27 20:58:12.392571 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1995/3834] 10.222.0.21 () {58 vars in 1271 bytes} [Sat Nov 27 20:58:12 2021] DELETE /compute/v2.1/os-security-groups/19368da8-0710-4106-a9fa-538f3db5e97e => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:12.405364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:12.416794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:12.439902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.440604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.441775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.442231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.472405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:58:12.536479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:12.537972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:12.553912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.554699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.555559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.556220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.617188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07bf9562-f069-442e-8e6f-0bce345c6254 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 204 len: 0 microversion: 2.1 time: 0.218610 Nov 27 20:58:12.620922 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1840/3835] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:58:12 2021] DELETE /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:58:12.629482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:12.630191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:12.636568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.637027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.637835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.638284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.843510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:12.855279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:12.857022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:12.858061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16b6bcc0-598c-4545-a8f0-2309fa5703de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.329509 Nov 27 20:58:12.858710 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1996/3836] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:12 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:58:12.863197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-829113e5-8960-4eee-9fcd-6ef50523c2f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:12.864743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-829113e5-8960-4eee-9fcd-6ef50523c2f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:12.872888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-829113e5-8960-4eee-9fcd-6ef50523c2f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.873695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-829113e5-8960-4eee-9fcd-6ef50523c2f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.874646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-829113e5-8960-4eee-9fcd-6ef50523c2f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:12.875239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-829113e5-8960-4eee-9fcd-6ef50523c2f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:12.917929 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-829113e5-8960-4eee-9fcd-6ef50523c2f4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.057954 Nov 27 20:58:12.918584 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1997/3837] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:12 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:13.043650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:13.051456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ebb3f9e-07fd-4cea-b87e-d4e9daf4a8bb tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1511 microversion: 2.1 time: 0.426061 Nov 27 20:58:13.052034 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1841/3838] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:12 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:13.103011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:13.104485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:13.111960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.112413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.113225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.113838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.124765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:13.125830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:13.134615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.135536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.137432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.137888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.301282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:13.309004 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-214973e9-d84b-4adc-87e7-1d7b5bbc8d94 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.210964 Nov 27 20:58:13.309882 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1998/3839] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:13 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:13.324773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73ef82fb-62a5-406c-94be-25781a1cbdb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:13.326027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73ef82fb-62a5-406c-94be-25781a1cbdb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:13.335436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73ef82fb-62a5-406c-94be-25781a1cbdb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.336181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73ef82fb-62a5-406c-94be-25781a1cbdb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.337000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73ef82fb-62a5-406c-94be-25781a1cbdb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.337444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73ef82fb-62a5-406c-94be-25781a1cbdb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.386857 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73ef82fb-62a5-406c-94be-25781a1cbdb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.069752 Nov 27 20:58:13.387574 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 1999/3840] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:13 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:13.585263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:13.593694 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6be9e7e-d668-42c8-8004-261006ef7705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1273 microversion: 2.1 time: 0.472780 Nov 27 20:58:13.594656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1842/3841] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:13 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1273 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:13.878203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:13.878908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:13.886864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.887620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.888413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.888855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.930479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-acb1af2a-80d4-4fd5-b115-f335ee03275e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:13.931539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-acb1af2a-80d4-4fd5-b115-f335ee03275e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:13.942053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acb1af2a-80d4-4fd5-b115-f335ee03275e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.942769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acb1af2a-80d4-4fd5-b115-f335ee03275e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.943853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acb1af2a-80d4-4fd5-b115-f335ee03275e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:13.944469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-acb1af2a-80d4-4fd5-b115-f335ee03275e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:13.994462 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-acb1af2a-80d4-4fd5-b115-f335ee03275e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 24570 microversion: 2.1 time: 0.065367 Nov 27 20:58:14.000292 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1843/3842] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:13 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:14.076803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:14.079139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:14.097691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.098907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.100443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.101137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.153128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:14.163716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:14.165496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:14.167288 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e431f192-9a82-43f2-a92c-5cebe7e1bfae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.293023 Nov 27 20:58:14.179754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2000/3843] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:13 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:14.326393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:14.327018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:14.337429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.337889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.338688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.339143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.429328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:14.443127 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70e4dff8-6aa0-4179-bc38-3bca80a07eb6 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1511 microversion: 2.1 time: 0.377139 Nov 27 20:58:14.453575 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1844/3844] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:14 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1511 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:14.460434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da0369f2-65a7-4790-8728-897f13ab8300 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:14.462027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da0369f2-65a7-4790-8728-897f13ab8300 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:14.470598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da0369f2-65a7-4790-8728-897f13ab8300 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.471237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da0369f2-65a7-4790-8728-897f13ab8300 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.472095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da0369f2-65a7-4790-8728-897f13ab8300 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.472550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da0369f2-65a7-4790-8728-897f13ab8300 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.557632 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da0369f2-65a7-4790-8728-897f13ab8300 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.101545 Nov 27 20:58:14.563345 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1845/3845] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:14 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:14.571654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c968f50e-c197-4526-8796-d97027f403dc req-c7a0c38b-91c2-40d4-b4ff-061f4b57c561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "name": "network-vif-plugged", "status": "completed", "tag": "ad2be44c-7183-4c6d-99b8-d5e16696aadd"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:14.573203 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:14.573203 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:14.582576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c968f50e-c197-4526-8796-d97027f403dc req-c7a0c38b-91c2-40d4-b4ff-061f4b57c561 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.583029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c968f50e-c197-4526-8796-d97027f403dc req-c7a0c38b-91c2-40d4-b4ff-061f4b57c561 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.602776 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c968f50e-c197-4526-8796-d97027f403dc req-c7a0c38b-91c2-40d4-b4ff-061f4b57c561 service nova] Creating event network-vif-plugged:ad2be44c-7183-4c6d-99b8-d5e16696aadd for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:14.609969 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c968f50e-c197-4526-8796-d97027f403dc req-c7a0c38b-91c2-40d4-b4ff-061f4b57c561 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046136 Nov 27 20:58:14.611370 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1846/3846] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:14.622179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:14.622817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:14.633367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.634247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.637085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:14.637894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:14.648713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:14.661456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d40b6fcf-b679-4d09-96cb-b127df807aa9 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.339308 Nov 27 20:58:14.665529 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2001/3847] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:14 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:15.008908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ceffc56e-757f-4cdf-84bb-40906e900263 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:15.009839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ceffc56e-757f-4cdf-84bb-40906e900263 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:15.025809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceffc56e-757f-4cdf-84bb-40906e900263 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.026459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceffc56e-757f-4cdf-84bb-40906e900263 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.027449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceffc56e-757f-4cdf-84bb-40906e900263 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.028044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceffc56e-757f-4cdf-84bb-40906e900263 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.051481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:15.062348 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-537d33e6-6b5e-49c9-9c59-0f2752e79586 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.446734 Nov 27 20:58:15.063753 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1847/3848] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:14 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:15.117536 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ceffc56e-757f-4cdf-84bb-40906e900263 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.113830 Nov 27 20:58:15.118196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2002/3849] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:15 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:15.187491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:15.188116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:15.199934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.202981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.204757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.205480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.464246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:15.465466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:15.475324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.476022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.477069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.477852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.728824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:15.750642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:15.756579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:15.758600 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8cbc00f-b8db-4da4-b7fd-07faa13e6597 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.575191 Nov 27 20:58:15.766279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1848/3850] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:15 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:15.782594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ef8c367-20bb-4cab-8119-7be2cd386465 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:15.783645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ef8c367-20bb-4cab-8119-7be2cd386465 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:15.793041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ef8c367-20bb-4cab-8119-7be2cd386465 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.793786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ef8c367-20bb-4cab-8119-7be2cd386465 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.796373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ef8c367-20bb-4cab-8119-7be2cd386465 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.797225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ef8c367-20bb-4cab-8119-7be2cd386465 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.857101 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ef8c367-20bb-4cab-8119-7be2cd386465 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.087395 Nov 27 20:58:15.858866 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1849/3851] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:15 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:15.865128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:15.866234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:15.876719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.877736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.879173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:15.879871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:15.988730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:16.001549 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87e813f2-8cda-4a31-ae2c-4067d5f53da9 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1511 microversion: 2.1 time: 0.542493 Nov 27 20:58:16.002477 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2003/3852] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:15 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:16.087927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:16.089243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:16.118526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.119285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.120117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.120556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.251219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:16.269407 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6a94620-4888-427f-87e5-5117ee2170df tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.408935 Nov 27 20:58:16.272118 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1850/3853] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:15 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:16.283470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ad11bed-acf2-4e31-8aaf-56558178d9de tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:16.288374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ad11bed-acf2-4e31-8aaf-56558178d9de tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:16.303175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad11bed-acf2-4e31-8aaf-56558178d9de tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.309839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad11bed-acf2-4e31-8aaf-56558178d9de tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.310939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad11bed-acf2-4e31-8aaf-56558178d9de tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.311583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad11bed-acf2-4e31-8aaf-56558178d9de tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.390264 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ad11bed-acf2-4e31-8aaf-56558178d9de tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.113175 Nov 27 20:58:16.399679 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1851/3854] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:16 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:16.418971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f935d105-cc5a-4963-8333-89081d640144 req-9ddb897c-12a5-4672-967b-5a18dd59d45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a6bdc1-0d85-4563-8ef9-f6a0a17075a0", "tag": "4ebac182-8a28-42f8-9b81-45a0a7ad3616"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:16.422957 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:16.422957 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:16.451672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f935d105-cc5a-4963-8333-89081d640144 req-9ddb897c-12a5-4672-967b-5a18dd59d45e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.454710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f935d105-cc5a-4963-8333-89081d640144 req-9ddb897c-12a5-4672-967b-5a18dd59d45e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.476691 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f935d105-cc5a-4963-8333-89081d640144 req-9ddb897c-12a5-4672-967b-5a18dd59d45e service nova] Creating event network-changed:4ebac182-8a28-42f8-9b81-45a0a7ad3616 for instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 on nch1-master-1 Nov 27 20:58:16.483162 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f935d105-cc5a-4963-8333-89081d640144 req-9ddb897c-12a5-4672-967b-5a18dd59d45e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078421 Nov 27 20:58:16.485241 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1852/3855] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:16.535101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:16.543049 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8ce68fd-62cb-4d05-a8c4-470c550dfe25 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.465457 Nov 27 20:58:16.555965 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2004/3856] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:16 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:16.648744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d7cfa893-b702-46f0-a3f6-1e59fad2cf3e req-d6c8f416-057e-47db-9883-08ed4d0e97b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "name": "network-vif-plugged", "status": "completed", "tag": "95cd7312-1395-4c53-9d65-8971e0e6c4f0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:16.651170 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:16.651170 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:16.670838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d7cfa893-b702-46f0-a3f6-1e59fad2cf3e req-d6c8f416-057e-47db-9883-08ed4d0e97b2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.672496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d7cfa893-b702-46f0-a3f6-1e59fad2cf3e req-d6c8f416-057e-47db-9883-08ed4d0e97b2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.701482 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d7cfa893-b702-46f0-a3f6-1e59fad2cf3e req-d6c8f416-057e-47db-9883-08ed4d0e97b2 service nova] Creating event network-vif-plugged:95cd7312-1395-4c53-9d65-8971e0e6c4f0 for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:16.714690 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d7cfa893-b702-46f0-a3f6-1e59fad2cf3e req-d6c8f416-057e-47db-9883-08ed4d0e97b2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070780 Nov 27 20:58:16.715997 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1853/3857] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:16.782565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:16.786032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:16.796839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.797646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.799485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.800120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.872943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aef16e2f-8d8f-4c29-af12-6d7fabb5fd78 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:16.873972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aef16e2f-8d8f-4c29-af12-6d7fabb5fd78 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:16.896897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aef16e2f-8d8f-4c29-af12-6d7fabb5fd78 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.897998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aef16e2f-8d8f-4c29-af12-6d7fabb5fd78 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.899012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aef16e2f-8d8f-4c29-af12-6d7fabb5fd78 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:16.901559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aef16e2f-8d8f-4c29-af12-6d7fabb5fd78 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:16.994613 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aef16e2f-8d8f-4c29-af12-6d7fabb5fd78 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.125693 Nov 27 20:58:16.995726 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1854/3858] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:16 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:17.019671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:17.020662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:17.035211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.039612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.040851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.041468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.109741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.111224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.111692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lazy-loading 'fault' on Instance uuid 7ff1ffe9-44c3-486f-82a9-680b299d2921 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:58:17.164013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a3fe020954cddb42864198a20ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea113326fcea4903b6f63e84c0339fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:17.176216 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bbab1ed5-e8ff-4ab3-9227-9919313a6155 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 200 len: 1313 microversion: 2.1 time: 0.161518 Nov 27 20:58:17.176769 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1855/3859] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:17 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:17.202167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:17.267630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:17.275129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:17.279954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-426bcf28-d7b6-4b39-8926-6b62a1bd5640 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.503109 Nov 27 20:58:17.280573 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2005/3860] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:16 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:17.288774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:17.289848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:17.299118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.299983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.304440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.304995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.407578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-613b93b9-e9ff-4768-ae2c-41eb085edd8c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:17.409140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-613b93b9-e9ff-4768-ae2c-41eb085edd8c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:17.420456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-613b93b9-e9ff-4768-ae2c-41eb085edd8c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.421244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-613b93b9-e9ff-4768-ae2c-41eb085edd8c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.422332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-613b93b9-e9ff-4768-ae2c-41eb085edd8c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.423019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-613b93b9-e9ff-4768-ae2c-41eb085edd8c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.487530 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-613b93b9-e9ff-4768-ae2c-41eb085edd8c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.086097 Nov 27 20:58:17.489498 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2006/3861] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:17 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:17.570916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:17.572391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:17.579049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.579712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.580511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:17.582866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:17.896072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:17.904487 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-432bd8d5-4fff-4ed1-9484-db4f2a94e1cd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.343822 Nov 27 20:58:17.905082 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2007/3862] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:17 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:18.007276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b7af5347-17c3-42cf-a2b3-036510d1ba6c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:18.008225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b7af5347-17c3-42cf-a2b3-036510d1ba6c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:18.016308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7af5347-17c3-42cf-a2b3-036510d1ba6c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.016687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7af5347-17c3-42cf-a2b3-036510d1ba6c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.017932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7af5347-17c3-42cf-a2b3-036510d1ba6c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.018408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7af5347-17c3-42cf-a2b3-036510d1ba6c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.098049 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b7af5347-17c3-42cf-a2b3-036510d1ba6c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.094971 Nov 27 20:58:18.099663 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2008/3863] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:18 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:58:18.200175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:18.201335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] [instance: 7ff1ffe9-44c3-486f-82a9-680b299d2921] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:18.216492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.218992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.221452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.222887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.246417 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] HTTP exception thrown: Instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 could not be found. Nov 27 20:58:18.247863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] Returning 404 to user: Instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:58:18.248939 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c2e3305-5496-4b2d-b862-bc2d7c5329f4 tempest-ServerRescueTestJSONUnderV235-393340942 tempest-ServerRescueTestJSONUnderV235-393340942-project] 10.222.0.21 "GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921" status: 404 len: 111 microversion: 2.1 time: 0.058352 Nov 27 20:58:18.250136 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2009/3864] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:18 2021] GET /compute/v2.1/servers/7ff1ffe9-44c3-486f-82a9-680b299d2921 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 20:58:18.300453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:18.301074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:18.315590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.316893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.317773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.324761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.471583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:18.488000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-03714523-67f9-47dd-9ebb-2274866e5a46 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 1.203204 Nov 27 20:58:18.488930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1856/3865] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:17 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:18.499582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-655e9c36-0795-4ab7-962a-68f189d368a4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:18.500782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-655e9c36-0795-4ab7-962a-68f189d368a4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:18.513514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-655e9c36-0795-4ab7-962a-68f189d368a4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.514187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-655e9c36-0795-4ab7-962a-68f189d368a4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.515179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-655e9c36-0795-4ab7-962a-68f189d368a4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.515939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-655e9c36-0795-4ab7-962a-68f189d368a4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.566116 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-655e9c36-0795-4ab7-962a-68f189d368a4 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.070157 Nov 27 20:58:18.567210 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1857/3866] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:18 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:18.572827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-76ef974e-d52b-47b0-8d65-946a838619a5 req-ee970c47-eb45-4b8b-9835-09d20e01576c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff1ffe9-44c3-486f-82a9-680b299d2921", "name": "network-vif-deleted", "tag": "961a8aab-3a21-4f48-887a-804874479b17"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:18.574696 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:18.574696 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:18.583617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-76ef974e-d52b-47b0-8d65-946a838619a5 req-ee970c47-eb45-4b8b-9835-09d20e01576c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.584621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-76ef974e-d52b-47b0-8d65-946a838619a5 req-ee970c47-eb45-4b8b-9835-09d20e01576c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.597386 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-76ef974e-d52b-47b0-8d65-946a838619a5 req-ee970c47-eb45-4b8b-9835-09d20e01576c service nova] Creating event network-vif-deleted:961a8aab-3a21-4f48-887a-804874479b17 for instance 7ff1ffe9-44c3-486f-82a9-680b299d2921 on nch1-master-1 Nov 27 20:58:18.603697 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-76ef974e-d52b-47b0-8d65-946a838619a5 req-ee970c47-eb45-4b8b-9835-09d20e01576c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034840 Nov 27 20:58:18.604621 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1858/3867] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:18.732728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:18.744753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d0627625-ec93-4d0e-b151-e4b3b6c3d74f req-ba893aad-52f5-43e9-b4f3-ee8960c60ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "name": "network-vif-plugged", "status": "completed", "tag": "c5507caf-d3c6-4acf-851c-7c098f7db7ee"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:18.745303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:18.746845 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:18.746845 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:18.747317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:18.748500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23d1e6ac-33ee-452a-a8f9-939432d6355f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.452545 Nov 27 20:58:18.749095 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2010/3868] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:18 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:18.761031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d0627625-ec93-4d0e-b151-e4b3b6c3d74f req-ba893aad-52f5-43e9-b4f3-ee8960c60ff8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.762090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d0627625-ec93-4d0e-b151-e4b3b6c3d74f req-ba893aad-52f5-43e9-b4f3-ee8960c60ff8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.775805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d0627625-ec93-4d0e-b151-e4b3b6c3d74f req-ba893aad-52f5-43e9-b4f3-ee8960c60ff8 service nova] Creating event network-vif-plugged:c5507caf-d3c6-4acf-851c-7c098f7db7ee for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:18.781242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d0627625-ec93-4d0e-b151-e4b3b6c3d74f req-ba893aad-52f5-43e9-b4f3-ee8960c60ff8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043497 Nov 27 20:58:18.786250 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1859/3869] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:58:18.922267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:18.922915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:18.946075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.946075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:18.946075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:18.946075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.117755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c5998310-2cd6-43f8-b95d-b44417fe687b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:19.119560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c5998310-2cd6-43f8-b95d-b44417fe687b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:19.143006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5998310-2cd6-43f8-b95d-b44417fe687b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.144156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5998310-2cd6-43f8-b95d-b44417fe687b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.145553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5998310-2cd6-43f8-b95d-b44417fe687b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.147398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5998310-2cd6-43f8-b95d-b44417fe687b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.227837 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c5998310-2cd6-43f8-b95d-b44417fe687b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.117547 Nov 27 20:58:19.234469 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1860/3870] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:19 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:19.460187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:19.467441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b7d432d-2ad0-42d5-8429-b18d18c689aa tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.549057 Nov 27 20:58:19.468033 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2011/3871] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:18 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:19.508350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:19.509629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:19.527402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.528184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.529199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.529811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.577929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-732518e3-cc5a-498a-85a0-a29c60a17e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:19.579433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-732518e3-cc5a-498a-85a0-a29c60a17e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:19.586429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-732518e3-cc5a-498a-85a0-a29c60a17e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.587130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-732518e3-cc5a-498a-85a0-a29c60a17e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.588180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-732518e3-cc5a-498a-85a0-a29c60a17e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.588849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-732518e3-cc5a-498a-85a0-a29c60a17e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.645921 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-732518e3-cc5a-498a-85a0-a29c60a17e76 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.071999 Nov 27 20:58:19.648311 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2012/3872] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:19 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:19.769724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:19.770460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:19.788036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.788597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.789762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:19.790423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:19.924650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:19.937068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0cb3c87f-0774-479e-9834-9fafc8903627 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.434552 Nov 27 20:58:19.938241 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1861/3873] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:19 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:20.242625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a2788c5-1b57-473b-a375-2bae7ac6f1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:20.243613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a2788c5-1b57-473b-a375-2bae7ac6f1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:20.257715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a2788c5-1b57-473b-a375-2bae7ac6f1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.258458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a2788c5-1b57-473b-a375-2bae7ac6f1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:20.259528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a2788c5-1b57-473b-a375-2bae7ac6f1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.260156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a2788c5-1b57-473b-a375-2bae7ac6f1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:20.328357 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a2788c5-1b57-473b-a375-2bae7ac6f1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.090194 Nov 27 20:58:20.329621 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1862/3874] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:20 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:20.488918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:20.490422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:20.499800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.500547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:20.501884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.502723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:20.640205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:20.659192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:20.664630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:20.666144 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c305d173-c40f-4d88-9fec-4c3b8429a411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.900521 Nov 27 20:58:20.667391 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2013/3875] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:19 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:58:20.675053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0ce7302-dce6-4863-ab8d-90d1450c4bd6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:20.677118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b0ce7302-dce6-4863-ab8d-90d1450c4bd6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:20.692336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0ce7302-dce6-4863-ab8d-90d1450c4bd6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.692803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0ce7302-dce6-4863-ab8d-90d1450c4bd6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:20.694198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0ce7302-dce6-4863-ab8d-90d1450c4bd6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.694868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0ce7302-dce6-4863-ab8d-90d1450c4bd6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:20.758632 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0ce7302-dce6-4863-ab8d-90d1450c4bd6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.088738 Nov 27 20:58:20.759670 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2014/3876] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:20 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:20.956071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:20.957459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:20.968617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.969211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:20.972115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:20.973533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:21.092666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:21.102476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac23ceb4-e2d4-463a-bac0-152e7b3f85ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.618506 Nov 27 20:58:21.103954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1863/3877] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:20 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:21.342011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73987006-2e42-46a7-91c3-12e5dde1f128 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:21.343029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-73987006-2e42-46a7-91c3-12e5dde1f128 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:21.353123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73987006-2e42-46a7-91c3-12e5dde1f128 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:21.353834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73987006-2e42-46a7-91c3-12e5dde1f128 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:21.354901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73987006-2e42-46a7-91c3-12e5dde1f128 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:21.355538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73987006-2e42-46a7-91c3-12e5dde1f128 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:21.438797 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73987006-2e42-46a7-91c3-12e5dde1f128 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.098911 Nov 27 20:58:21.440335 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1864/3878] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:21 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:21.496479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:21.510243 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6723ff85-cd51-4fb6-89dd-d6dd53295bef tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1353 microversion: 2.1 time: 0.559727 Nov 27 20:58:21.511710 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2015/3879] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:20 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1353 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:21.691637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:21.692357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:21.703809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:21.704279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:21.705208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:21.705873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:21.774322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92c4701d-9dc2-4fbd-874e-94421c4bda27 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:21.775393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92c4701d-9dc2-4fbd-874e-94421c4bda27 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:21.783809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92c4701d-9dc2-4fbd-874e-94421c4bda27 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:21.784557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92c4701d-9dc2-4fbd-874e-94421c4bda27 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:21.798385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92c4701d-9dc2-4fbd-874e-94421c4bda27 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:21.799444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92c4701d-9dc2-4fbd-874e-94421c4bda27 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:21.883001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92c4701d-9dc2-4fbd-874e-94421c4bda27 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.114299 Nov 27 20:58:21.884996 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2016/3880] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:21 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:22.124451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:22.126363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:22.137362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.138408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.139778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.140545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.245213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:22.260402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:22.261906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:22.263338 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0769ee99-dccc-4929-b839-31037b35f5a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.577227 Nov 27 20:58:22.264150 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1865/3881] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:21 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:22.466684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb44fb13-120e-4252-bd71-5a9609757d58 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:22.467850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb44fb13-120e-4252-bd71-5a9609757d58 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:22.478913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb44fb13-120e-4252-bd71-5a9609757d58 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.479472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb44fb13-120e-4252-bd71-5a9609757d58 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.480362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb44fb13-120e-4252-bd71-5a9609757d58 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.480792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb44fb13-120e-4252-bd71-5a9609757d58 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.486284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:22.494330 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c81fd7a5-0a1e-41cd-bd13-a9cb8a7f33a6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.377477 Nov 27 20:58:22.494933 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2017/3882] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:22 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:22.528384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:22.529265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:22.544970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.545424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.546218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.546668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.624516 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb44fb13-120e-4252-bd71-5a9609757d58 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.173231 Nov 27 20:58:22.626022 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1866/3883] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:22 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:58:22.888811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:22.902112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89e63229-242f-4c0a-aa52-8f1f3f569c59 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:22.904033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89e63229-242f-4c0a-aa52-8f1f3f569c59 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:22.908296 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-feda9fac-5629-482c-b5c5-5bafe2c52794 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1803 microversion: 2.1 time: 0.383511 Nov 27 20:58:22.908908 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2018/3884] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:22 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1803 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:22.923094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e63229-242f-4c0a-aa52-8f1f3f569c59 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.924261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e63229-242f-4c0a-aa52-8f1f3f569c59 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.925630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e63229-242f-4c0a-aa52-8f1f3f569c59 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.926267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea3d62ed-6359-479f-99f6-15df31913a3e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:22.926616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89e63229-242f-4c0a-aa52-8f1f3f569c59 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.926862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea3d62ed-6359-479f-99f6-15df31913a3e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:22.963649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea3d62ed-6359-479f-99f6-15df31913a3e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.964900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea3d62ed-6359-479f-99f6-15df31913a3e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:22.967990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea3d62ed-6359-479f-99f6-15df31913a3e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:22.968543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea3d62ed-6359-479f-99f6-15df31913a3e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.008639 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea3d62ed-6359-479f-99f6-15df31913a3e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f/ips" status: 200 len: 218 microversion: 2.1 time: 0.086274 Nov 27 20:58:23.010068 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2019/3885] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 20:58:22 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f/ips => generated 218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:23.021151 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89e63229-242f-4c0a-aa52-8f1f3f569c59 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.127656 Nov 27 20:58:23.023062 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1867/3886] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:22 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:23.024293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:23.024737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:23.036583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.037964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.038959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.039647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.078871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:58:23.205498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6dd95ca8-13f8-4e21-add0-9f9538d7f516 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "DELETE /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 204 len: 0 microversion: 2.1 time: 0.188429 Nov 27 20:58:23.207593 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2020/3887] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:58:23 2021] DELETE /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:58:23.218347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:23.219047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:23.239362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.240241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.241272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.241991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.284710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:23.285454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:23.298195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.298679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.301736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.302190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.689950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:23.703937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:23.706321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:23.709847 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0db5b31f-80b4-442f-acf2-57aba40366dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.429850 Nov 27 20:58:23.720642 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2021/3888] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:23 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:23.727866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-be827603-9826-487d-b56c-1feff517bd45 req-b16ac97e-982e-4d9a-ac94-741c2a060880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a6bdc1-0d85-4563-8ef9-f6a0a17075a0", "name": "network-vif-plugged", "status": "completed", "tag": "4ebac182-8a28-42f8-9b81-45a0a7ad3616"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:23.730232 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:23.730232 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:23.738821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-be827603-9826-487d-b56c-1feff517bd45 req-b16ac97e-982e-4d9a-ac94-741c2a060880 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.739285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-be827603-9826-487d-b56c-1feff517bd45 req-b16ac97e-982e-4d9a-ac94-741c2a060880 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.757821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-be827603-9826-487d-b56c-1feff517bd45 req-b16ac97e-982e-4d9a-ac94-741c2a060880 service nova] Creating event network-vif-plugged:4ebac182-8a28-42f8-9b81-45a0a7ad3616 for instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 on nch1-master-1 Nov 27 20:58:23.763197 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-be827603-9826-487d-b56c-1feff517bd45 req-b16ac97e-982e-4d9a-ac94-741c2a060880 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040842 Nov 27 20:58:23.764141 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2022/3889] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:23.767096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:23.770143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:23.771859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:23.779282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.779282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.780138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.780610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.794902 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f378cb6e-526c-4d5b-b249-1e2ef0fec011 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1809 microversion: 2.1 time: 0.581263 Nov 27 20:58:23.810723 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1868/3890] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:23 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1809 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:23.824757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45156905-88e5-46c8-bc1f-1dd8bd2b30b2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:23.830098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45156905-88e5-46c8-bc1f-1dd8bd2b30b2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:23.842476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45156905-88e5-46c8-bc1f-1dd8bd2b30b2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.843349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45156905-88e5-46c8-bc1f-1dd8bd2b30b2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.844420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45156905-88e5-46c8-bc1f-1dd8bd2b30b2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:23.845169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45156905-88e5-46c8-bc1f-1dd8bd2b30b2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:23.915972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45156905-88e5-46c8-bc1f-1dd8bd2b30b2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.102966 Nov 27 20:58:23.917082 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1869/3891] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:23 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:23.975289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:23.991798 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0aedea23-a658-4c3d-bab8-6a3dcec3bd64 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.226392 Nov 27 20:58:23.992669 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2023/3892] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:23 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:24.035992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce231c69-92ab-4b98-9547-d74f030d73d7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:24.038027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce231c69-92ab-4b98-9547-d74f030d73d7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:24.053263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce231c69-92ab-4b98-9547-d74f030d73d7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:24.053722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce231c69-92ab-4b98-9547-d74f030d73d7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:24.054618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce231c69-92ab-4b98-9547-d74f030d73d7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:24.055786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce231c69-92ab-4b98-9547-d74f030d73d7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:24.122621 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce231c69-92ab-4b98-9547-d74f030d73d7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.092212 Nov 27 20:58:24.124285 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1870/3893] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:24 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:24.731990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:24.732675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:24.741327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:24.741771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:24.742658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:24.743174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:24.819935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:24.819935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:24.838448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:24.839178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:24.840030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:24.840730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:25.096484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:25.108276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:25.110286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:25.111967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e133d25e-0130-48b0-9663-940501adfa27 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.385691 Nov 27 20:58:25.112718 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2024/3894] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:24 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:25.119284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9d039d9c-c327-4050-b8bd-1daec3f10605 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:25.120743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9d039d9c-c327-4050-b8bd-1daec3f10605 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:25.130208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d039d9c-c327-4050-b8bd-1daec3f10605 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:25.131830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d039d9c-c327-4050-b8bd-1daec3f10605 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:25.132882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d039d9c-c327-4050-b8bd-1daec3f10605 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:25.134580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d039d9c-c327-4050-b8bd-1daec3f10605 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:25.185076 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9d039d9c-c327-4050-b8bd-1daec3f10605 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.070807 Nov 27 20:58:25.186108 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2025/3895] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:25 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:25.194180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:25.195609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:25.205104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:25.213436 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0ab2b69-97bf-473f-aaf8-356f8f3f1efd tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1809 microversion: 2.1 time: 0.403290 Nov 27 20:58:25.214870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:25.215622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:25.217372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:25.217826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1871/3896] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:24 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1809 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:25.223167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:25.227413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d2c8898-8187-4c19-8097-3cbab69812c7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:25.230127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d2c8898-8187-4c19-8097-3cbab69812c7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:25.245554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2c8898-8187-4c19-8097-3cbab69812c7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:25.246256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2c8898-8187-4c19-8097-3cbab69812c7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:25.247543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2c8898-8187-4c19-8097-3cbab69812c7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:25.248189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2c8898-8187-4c19-8097-3cbab69812c7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:25.296948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d2c8898-8187-4c19-8097-3cbab69812c7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.077108 Nov 27 20:58:25.300878 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1872/3897] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:25 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:25.598708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:25.611657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed84ffbb-5c84-4ff0-b767-b406819201ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1315 microversion: 2.1 time: 0.424086 Nov 27 20:58:25.612495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2026/3898] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:25 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:26.063416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1127a091-5704-413e-8532-c8603ac878f1 req-d6cd77d9-6892-4c0e-a7f7-9dbae663b3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "name": "network-vif-deleted", "tag": "c5507caf-d3c6-4acf-851c-7c098f7db7ee"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:26.065291 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:26.065291 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:26.074111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1127a091-5704-413e-8532-c8603ac878f1 req-d6cd77d9-6892-4c0e-a7f7-9dbae663b3fe service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.082147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1127a091-5704-413e-8532-c8603ac878f1 req-d6cd77d9-6892-4c0e-a7f7-9dbae663b3fe service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.106871 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1127a091-5704-413e-8532-c8603ac878f1 req-d6cd77d9-6892-4c0e-a7f7-9dbae663b3fe service nova] Creating event network-vif-deleted:c5507caf-d3c6-4acf-851c-7c098f7db7ee for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:26.119739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1127a091-5704-413e-8532-c8603ac878f1 req-d6cd77d9-6892-4c0e-a7f7-9dbae663b3fe service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061653 Nov 27 20:58:26.120680 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1873/3899] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:26.136186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:26.137567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:26.145125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.145943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.147648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.148359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.199362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-919f9f20-8b16-4d82-9169-4190a3d3f622 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:26.200892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-919f9f20-8b16-4d82-9169-4190a3d3f622 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:26.216622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-919f9f20-8b16-4d82-9169-4190a3d3f622 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.227820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-919f9f20-8b16-4d82-9169-4190a3d3f622 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.229828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-919f9f20-8b16-4d82-9169-4190a3d3f622 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.230545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-919f9f20-8b16-4d82-9169-4190a3d3f622 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.293382 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-919f9f20-8b16-4d82-9169-4190a3d3f622 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.098366 Nov 27 20:58:26.294491 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1874/3900] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:26 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:58:26.305315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:26.312585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:26.325856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.326717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.328078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.328767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.653239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:26.654965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:26.685321 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95da9cf2-f38f-44d4-80c0-5ec7b4ffad3d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1674 microversion: 2.1 time: 0.387741 Nov 27 20:58:26.687635 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1875/3901] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:26 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1674 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:26.692861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:26.695464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:26.696743 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00d78f7d-9bba-4f67-8b6c-32a19e71616b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.564399 Nov 27 20:58:26.705396 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2027/3902] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:26 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:26.713935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0e0b5df4-e2f7-407f-a0ad-afa6e4fc86d3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:26.716115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e0b5df4-e2f7-407f-a0ad-afa6e4fc86d3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:26.725348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e0b5df4-e2f7-407f-a0ad-afa6e4fc86d3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.726032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e0b5df4-e2f7-407f-a0ad-afa6e4fc86d3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.727948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e0b5df4-e2f7-407f-a0ad-afa6e4fc86d3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.731331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:26.731899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:26.732801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e0b5df4-e2f7-407f-a0ad-afa6e4fc86d3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.745351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.746144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.747584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:26.748244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:26.782536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0e0b5df4-e2f7-407f-a0ad-afa6e4fc86d3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.083086 Nov 27 20:58:26.786429 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1876/3903] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:26 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:27.307323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-630e4c18-9732-4ad1-ae1e-9203146a06d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:27.309200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-630e4c18-9732-4ad1-ae1e-9203146a06d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:27.317436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-630e4c18-9732-4ad1-ae1e-9203146a06d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.318923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-630e4c18-9732-4ad1-ae1e-9203146a06d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:27.320022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-630e4c18-9732-4ad1-ae1e-9203146a06d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.320716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-630e4c18-9732-4ad1-ae1e-9203146a06d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:27.372758 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-630e4c18-9732-4ad1-ae1e-9203146a06d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.069662 Nov 27 20:58:27.373712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1877/3904] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:27 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:27.474682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:27.490476 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1503 microversion: 2.1 time: 0.782469 Nov 27 20:58:27.492534 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2028/3905] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:26 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1503 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:27.509402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:27.509962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:27.517151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.517606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:27.518404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.518973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:27.549451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lazy-loading 'flavor' on Instance uuid 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:58:27.653352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:27.654345 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-967c2c8a-af6b-4537-9ecb-47b032158ec4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001534 Nov 27 20:58:27.654991 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2029/3906] 10.222.0.21 () {56 vars in 885 bytes} [Sat Nov 27 20:58:27 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 27 20:58:27.705440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:27.706150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:27.715645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.719118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:27.721010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.725982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:27.934098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e73fbbb-8109-4f5b-bca3-1b4bb15a0b3f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0/action" status: 202 len: 0 microversion: 2.1 time: 0.427288 Nov 27 20:58:27.937956 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1878/3907] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:27 2021] POST /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:27.944887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:27.945604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:27.957473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.958264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:27.960039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:27.960833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.146915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:28.157713 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85a62fa7-682f-46ae-87d4-55f8f93a6be0 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1653 microversion: 2.1 time: 0.456685 Nov 27 20:58:28.162651 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2030/3908] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:27 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1653 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:28.180792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5669f92b-e538-484f-8c08-724caf51b112 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:28.182843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5669f92b-e538-484f-8c08-724caf51b112 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:28.192586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5669f92b-e538-484f-8c08-724caf51b112 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:28.193737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5669f92b-e538-484f-8c08-724caf51b112 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.194609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5669f92b-e538-484f-8c08-724caf51b112 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:28.195214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5669f92b-e538-484f-8c08-724caf51b112 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.261190 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5669f92b-e538-484f-8c08-724caf51b112 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.087591 Nov 27 20:58:28.262724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2031/3909] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:28 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:28.273429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:28.274503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:28.284896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:28.286390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.287755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:28.288348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.423284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:28.460735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:28.464000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:28.465441 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5339a1d9-f567-47f6-aec2-2376d8b6c5f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.529428 Nov 27 20:58:28.477319 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1879/3910] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:27 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:28.482257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-18989968-31a8-4305-921e-7d43935e58e5 req-61935db0-2780-47a7-a4e4-960281c3febc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "name": "network-vif-deleted", "tag": "95cd7312-1395-4c53-9d65-8971e0e6c4f0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:28.483863 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:28.483863 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:28.491748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-18989968-31a8-4305-921e-7d43935e58e5 req-61935db0-2780-47a7-a4e4-960281c3febc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:28.492434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-18989968-31a8-4305-921e-7d43935e58e5 req-61935db0-2780-47a7-a4e4-960281c3febc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.508204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-18989968-31a8-4305-921e-7d43935e58e5 req-61935db0-2780-47a7-a4e4-960281c3febc service nova] Creating event network-vif-deleted:95cd7312-1395-4c53-9d65-8971e0e6c4f0 for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:28.513869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-18989968-31a8-4305-921e-7d43935e58e5 req-61935db0-2780-47a7-a4e4-960281c3febc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Nov 27 20:58:28.514991 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1880/3911] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:28.522066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64d4cfdc-aca6-40c0-9faf-844e1c86ae4a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:28.523354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64d4cfdc-aca6-40c0-9faf-844e1c86ae4a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:28.530951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64d4cfdc-aca6-40c0-9faf-844e1c86ae4a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:28.531709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64d4cfdc-aca6-40c0-9faf-844e1c86ae4a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.532664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64d4cfdc-aca6-40c0-9faf-844e1c86ae4a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:28.533285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64d4cfdc-aca6-40c0-9faf-844e1c86ae4a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:28.593457 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64d4cfdc-aca6-40c0-9faf-844e1c86ae4a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.076848 Nov 27 20:58:28.594814 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1881/3912] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:28 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:28.777648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:28.785838 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-afee4263-32f9-4330-9d8f-67081c577202 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.521619 Nov 27 20:58:28.795557 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2032/3913] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:28 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:29.180925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:29.181711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:29.189716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.190426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.191476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.192235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.227973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.228501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.228954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lazy-loading 'fault' on Instance uuid efc94c1a-9572-43c0-9a19-4ccded66857f {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:58:29.274657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-56c12143-ff4e-46ae-a1d0-2a062d764dde tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:29.275824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56c12143-ff4e-46ae-a1d0-2a062d764dde tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:29.286236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:29.290037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56c12143-ff4e-46ae-a1d0-2a062d764dde tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.292488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56c12143-ff4e-46ae-a1d0-2a062d764dde tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.293432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56c12143-ff4e-46ae-a1d0-2a062d764dde tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.293996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56c12143-ff4e-46ae-a1d0-2a062d764dde tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.301536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2bdc5932-e899-4e9b-a5a7-d4c4267d1402 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 200 len: 1301 microversion: 2.1 time: 0.125637 Nov 27 20:58:29.302218 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1882/3914] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:29 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:29.343977 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-56c12143-ff4e-46ae-a1d0-2a062d764dde tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.074101 Nov 27 20:58:29.345852 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2033/3915] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:29 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:29.496131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:29.496815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:29.517464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.517923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.524978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.524978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.606929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0044d621-6f0f-49a8-9031-8de88359ea84 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:29.608355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0044d621-6f0f-49a8-9031-8de88359ea84 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:29.616597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0044d621-6f0f-49a8-9031-8de88359ea84 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.617370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0044d621-6f0f-49a8-9031-8de88359ea84 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.618358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0044d621-6f0f-49a8-9031-8de88359ea84 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.619065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0044d621-6f0f-49a8-9031-8de88359ea84 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.678842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0044d621-6f0f-49a8-9031-8de88359ea84 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.075267 Nov 27 20:58:29.680589 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2034/3916] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:29 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:58:29.805544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:29.807265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:29.817476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.819126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.820418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:29.821027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:29.877879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:29.892242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:29.899108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:29.904233 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-342c4e07-d37a-450c-9e02-0c45649e1a60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.421657 Nov 27 20:58:29.906220 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1883/3917] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:29 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:30.031236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:30.039605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c32486cb-5698-4fdc-abe6-6f55166220dd tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.239198 Nov 27 20:58:30.040544 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2035/3918] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:29 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:30.208205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0729bd04-dd8a-4865-8909-b94422d8ba72 tempest-ExtensionsTest-1553180722 tempest-ExtensionsTest-1553180722-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:30.210851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0729bd04-dd8a-4865-8909-b94422d8ba72 tempest-ExtensionsTest-1553180722 tempest-ExtensionsTest-1553180722-project] 10.222.0.21 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.137553 Nov 27 20:58:30.211669 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1884/3919] 10.222.0.21 () {58 vars in 1169 bytes} [Sat Nov 27 20:58:30 2021] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:30.221244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0cdb78c-863e-47d2-9167-029bc8c7d08e tempest-ExtensionsTest-1553180722 tempest-ExtensionsTest-1553180722-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:30.223426 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0cdb78c-863e-47d2-9167-029bc8c7d08e tempest-ExtensionsTest-1553180722 tempest-ExtensionsTest-1553180722-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006665 Nov 27 20:58:30.223976 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2036/3920] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 20:58:30 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:30.321166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:30.322289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:30.339505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.340384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.344245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.344939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.358755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5ff86e9-6c8d-4c65-90e5-8c5a9fc744e8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:30.360497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c5ff86e9-6c8d-4c65-90e5-8c5a9fc744e8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:30.378366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5ff86e9-6c8d-4c65-90e5-8c5a9fc744e8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.378856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5ff86e9-6c8d-4c65-90e5-8c5a9fc744e8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.383402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5ff86e9-6c8d-4c65-90e5-8c5a9fc744e8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.383853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5ff86e9-6c8d-4c65-90e5-8c5a9fc744e8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.397515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] HTTP exception thrown: Instance efc94c1a-9572-43c0-9a19-4ccded66857f could not be found. Nov 27 20:58:30.399155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Returning 404 to user: Instance efc94c1a-9572-43c0-9a19-4ccded66857f could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:58:30.401182 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ec0b8f8a-cce1-40d0-9f5e-048f90ea2efc tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 404 len: 111 microversion: 2.1 time: 0.087166 Nov 27 20:58:30.405961 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1885/3921] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:30 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:58:30.465290 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c5ff86e9-6c8d-4c65-90e5-8c5a9fc744e8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.111553 Nov 27 20:58:30.467214 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2037/3922] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:30 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:30.588743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-72a2b981-e7da-46b2-aea4-d2b377520d8c req-1a16adcc-b7a1-4d42-9e6a-851fc5baa413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc94c1a-9572-43c0-9a19-4ccded66857f", "name": "network-vif-deleted", "tag": "ad2be44c-7183-4c6d-99b8-d5e16696aadd"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:30.593212 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:30.593212 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:58:30.616753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-72a2b981-e7da-46b2-aea4-d2b377520d8c req-1a16adcc-b7a1-4d42-9e6a-851fc5baa413 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.618480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-72a2b981-e7da-46b2-aea4-d2b377520d8c req-1a16adcc-b7a1-4d42-9e6a-851fc5baa413 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.640172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-72a2b981-e7da-46b2-aea4-d2b377520d8c req-1a16adcc-b7a1-4d42-9e6a-851fc5baa413 service nova] Creating event network-vif-deleted:ad2be44c-7183-4c6d-99b8-d5e16696aadd for instance efc94c1a-9572-43c0-9a19-4ccded66857f on nch2-master-1 Nov 27 20:58:30.645911 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-72a2b981-e7da-46b2-aea4-d2b377520d8c req-1a16adcc-b7a1-4d42-9e6a-851fc5baa413 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074513 Nov 27 20:58:30.647799 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1886/3923] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:30.691854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac41abc4-0426-495c-a3f9-c5562131be5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:30.693745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac41abc4-0426-495c-a3f9-c5562131be5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:30.706988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac41abc4-0426-495c-a3f9-c5562131be5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.707768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac41abc4-0426-495c-a3f9-c5562131be5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.709375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac41abc4-0426-495c-a3f9-c5562131be5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.712153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac41abc4-0426-495c-a3f9-c5562131be5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.777200 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac41abc4-0426-495c-a3f9-c5562131be5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.089227 Nov 27 20:58:30.777876 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2038/3924] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:30 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:30.924171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:30.925291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:30.939595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.940300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:30.941111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:30.941557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:31.060185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:31.070311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:31.087800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:31.088371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:31.089652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:31.090060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:31.404223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:31.413214 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3ce67180-9d1d-4cc5-8591-f47e653c6ec7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.359006 Nov 27 20:58:31.417134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2039/3925] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:31 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:31.419669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:31.434457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:31.440012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:31.442992 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a027f7c7-dab7-41ae-b439-4efa3792c170 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.523404 Nov 27 20:58:31.459805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1887/3926] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:30 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:31.478624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa04a970-ceea-436e-8146-a1ee9fc97cb7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:31.479701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa04a970-ceea-436e-8146-a1ee9fc97cb7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:31.492114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa04a970-ceea-436e-8146-a1ee9fc97cb7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:31.495532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa04a970-ceea-436e-8146-a1ee9fc97cb7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:31.496581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa04a970-ceea-436e-8146-a1ee9fc97cb7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:31.497819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa04a970-ceea-436e-8146-a1ee9fc97cb7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:31.580598 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa04a970-ceea-436e-8146-a1ee9fc97cb7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.106405 Nov 27 20:58:31.581923 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2040/3927] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:31 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:31.792652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89b9a671-9963-432e-8b13-6e7dfad9e120 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:31.794579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89b9a671-9963-432e-8b13-6e7dfad9e120 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:31.812174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89b9a671-9963-432e-8b13-6e7dfad9e120 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:31.814822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89b9a671-9963-432e-8b13-6e7dfad9e120 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:31.817015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89b9a671-9963-432e-8b13-6e7dfad9e120 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:31.819143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89b9a671-9963-432e-8b13-6e7dfad9e120 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:31.910615 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89b9a671-9963-432e-8b13-6e7dfad9e120 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.124496 Nov 27 20:58:31.919551 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1888/3928] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:31 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:32.434799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:32.436179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:32.462819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:32.463776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:32.466280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:32.466778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:32.481351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:32.484742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:32.486216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:32.486742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:32.487629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:32.488082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:32.868006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:32.882294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:32.888676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:32.891761 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b51e78a-73e1-4496-8f74-0f13b77bd29e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.433458 Nov 27 20:58:32.908230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1889/3929] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:32 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:32.916065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-09d393b5-2099-4847-b8f5-029c436f2ae2 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:32.917533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-09d393b5-2099-4847-b8f5-029c436f2ae2 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:32.933097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09d393b5-2099-4847-b8f5-029c436f2ae2 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:32.933915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09d393b5-2099-4847-b8f5-029c436f2ae2 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:32.934945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09d393b5-2099-4847-b8f5-029c436f2ae2 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:32.935964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09d393b5-2099-4847-b8f5-029c436f2ae2 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:33.018579 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-09d393b5-2099-4847-b8f5-029c436f2ae2 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.108182 Nov 27 20:58:33.019726 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1890/3930] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:32 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:33.033944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f19178eb-aa41-49eb-a41c-7c0572f15257 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:33.035645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f19178eb-aa41-49eb-a41c-7c0572f15257 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:33.044806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f19178eb-aa41-49eb-a41c-7c0572f15257 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:33.045617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f19178eb-aa41-49eb-a41c-7c0572f15257 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:33.046675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f19178eb-aa41-49eb-a41c-7c0572f15257 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:33.047380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f19178eb-aa41-49eb-a41c-7c0572f15257 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:33.118066 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f19178eb-aa41-49eb-a41c-7c0572f15257 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.094566 Nov 27 20:58:33.126552 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1891/3931] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:33 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:33.543806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:33.559078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cff854a9-38ad-49cf-806e-dcd84a00b5b7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 1.127744 Nov 27 20:58:33.560864 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2041/3932] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:32 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:33.916446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:33.917290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:33.931787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:33.933840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:33.938588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:33.939984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:34.031189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c4188c1-b8ed-4a05-be94-9fcc1bfc2e97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:34.032423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c4188c1-b8ed-4a05-be94-9fcc1bfc2e97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:34.050572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c4188c1-b8ed-4a05-be94-9fcc1bfc2e97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:34.051938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c4188c1-b8ed-4a05-be94-9fcc1bfc2e97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:34.053494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c4188c1-b8ed-4a05-be94-9fcc1bfc2e97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:34.055198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c4188c1-b8ed-4a05-be94-9fcc1bfc2e97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:34.140555 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c4188c1-b8ed-4a05-be94-9fcc1bfc2e97 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.113552 Nov 27 20:58:34.141944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2042/3933] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:34 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:34.154067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88c0bb85-5114-4c41-bf01-c5cf2aa12105 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:34.157936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88c0bb85-5114-4c41-bf01-c5cf2aa12105 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:34.176722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88c0bb85-5114-4c41-bf01-c5cf2aa12105 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:34.178594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88c0bb85-5114-4c41-bf01-c5cf2aa12105 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:34.181753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88c0bb85-5114-4c41-bf01-c5cf2aa12105 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:34.183906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88c0bb85-5114-4c41-bf01-c5cf2aa12105 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:34.290207 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88c0bb85-5114-4c41-bf01-c5cf2aa12105 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.143955 Nov 27 20:58:34.297031 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2043/3934] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:34 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:34.578023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:34.580115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:34.589913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:34.590660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:34.593278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:34.593926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:34.642217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:34.656063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:34.657679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:34.658830 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b605093b-87a3-4900-92e7-fc4be1c4699b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.747668 Nov 27 20:58:34.665770 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1892/3935] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:33 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:35.154766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56d15485-f14d-4275-81ec-773103c012b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:35.156684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56d15485-f14d-4275-81ec-773103c012b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:35.173302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d15485-f14d-4275-81ec-773103c012b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:35.173990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d15485-f14d-4275-81ec-773103c012b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:35.175112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d15485-f14d-4275-81ec-773103c012b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:35.175822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d15485-f14d-4275-81ec-773103c012b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:35.208101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:35.223818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27c5d901-6563-4bd3-8709-5c174505c735 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.649952 Nov 27 20:58:35.225113 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2044/3936] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:34 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:35.243812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56d15485-f14d-4275-81ec-773103c012b0 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.092870 Nov 27 20:58:35.244487 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1893/3937] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:35 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:35.308442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-179b7089-3c12-4ed9-82dd-1db4cdb4cd82 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:35.310539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-179b7089-3c12-4ed9-82dd-1db4cdb4cd82 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:35.321712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-179b7089-3c12-4ed9-82dd-1db4cdb4cd82 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:35.322282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-179b7089-3c12-4ed9-82dd-1db4cdb4cd82 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:35.327235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-179b7089-3c12-4ed9-82dd-1db4cdb4cd82 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:35.345329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-179b7089-3c12-4ed9-82dd-1db4cdb4cd82 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:35.428641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-179b7089-3c12-4ed9-82dd-1db4cdb4cd82 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.127823 Nov 27 20:58:35.430977 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2045/3938] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:35 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:35.680313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:35.681021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:35.697822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:35.698270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:35.699569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:35.700016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:36.242326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:36.243069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:36.257441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:36.278686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:36.281897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:36.286120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:36.723902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:36.750519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:36.759881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:36.763243 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b4e427ea-46b6-453c-8d3f-8a45ec1abfdb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.088666 Nov 27 20:58:36.766077 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1894/3939] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:35 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:36.777556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f9cff6f-5bd5-4406-ba7d-29b9b32e55e9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:36.780673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f9cff6f-5bd5-4406-ba7d-29b9b32e55e9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:36.802665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f9cff6f-5bd5-4406-ba7d-29b9b32e55e9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:36.803396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f9cff6f-5bd5-4406-ba7d-29b9b32e55e9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:36.807899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f9cff6f-5bd5-4406-ba7d-29b9b32e55e9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:36.808406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f9cff6f-5bd5-4406-ba7d-29b9b32e55e9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:36.881934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f9cff6f-5bd5-4406-ba7d-29b9b32e55e9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.114213 Nov 27 20:58:36.882622 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1895/3940] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:36 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:36.894550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ba3f40c-a136-42ac-b619-a236887c8a79 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:36.898776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ba3f40c-a136-42ac-b619-a236887c8a79 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:36.934655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba3f40c-a136-42ac-b619-a236887c8a79 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:36.934655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba3f40c-a136-42ac-b619-a236887c8a79 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:36.940619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba3f40c-a136-42ac-b619-a236887c8a79 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:36.941677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba3f40c-a136-42ac-b619-a236887c8a79 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:37.002822 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ba3f40c-a136-42ac-b619-a236887c8a79 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.118629 Nov 27 20:58:37.004599 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1896/3941] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:36 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:37.015498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:37.023423 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b8a6d26-af7a-469d-8afb-b990470645e4 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.785167 Nov 27 20:58:37.024633 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2046/3942] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:36 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:37.756903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-804224134", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "3fd2f6c4-1bed-4cf1-8283-6a7269d66b48"}, {"uuid": "48ac60c0-43f3-4ca5-b66b-7c008342cdfb"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:37.785691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:37.788106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:37.804713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:37.805174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:37.813270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:37.819863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:37.891355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] validate_networks() for [('3fd2f6c4-1bed-4cf1-8283-6a7269d66b48', None, None, None, None, None), ('48ac60c0-43f3-4ca5-b66b-7c008342cdfb', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:58:38.261505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:38.279475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:38.287502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:38.288924 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-621910e6-77d7-488a-ae15-be00cc2864c4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.508638 Nov 27 20:58:38.297329 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2047/3943] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:37 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:38.318644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6b9e725-a8bb-4c93-a550-9b748e150970 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:38.319609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6b9e725-a8bb-4c93-a550-9b748e150970 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:38.330913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6b9e725-a8bb-4c93-a550-9b748e150970 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:38.331562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6b9e725-a8bb-4c93-a550-9b748e150970 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:38.332548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6b9e725-a8bb-4c93-a550-9b748e150970 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:38.333512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6b9e725-a8bb-4c93-a550-9b748e150970 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:38.432582 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6b9e725-a8bb-4c93-a550-9b748e150970 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.132012 Nov 27 20:58:38.433909 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2048/3944] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:38 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:38.439798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-34b9ace4-6f92-4840-b546-278682128986 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:38.441800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-34b9ace4-6f92-4840-b546-278682128986 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:38.451639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b9ace4-6f92-4840-b546-278682128986 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:38.452387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b9ace4-6f92-4840-b546-278682128986 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:38.455765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b9ace4-6f92-4840-b546-278682128986 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:38.456416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34b9ace4-6f92-4840-b546-278682128986 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:38.534693 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-34b9ace4-6f92-4840-b546-278682128986 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.099185 Nov 27 20:58:38.538858 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2049/3945] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:38 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:38.542516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:38.543243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:38.563735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:38.564191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:38.564986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:38.565608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:38.840884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:38.851095 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e2a19c8-c639-4e3c-8eb1-ebbe0567ff6e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.314437 Nov 27 20:58:38.853139 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2050/3946] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:38 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:39.325523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:39.326376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:39.340862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.341644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.342691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.343541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.536359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:58:39.539954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:58:39.541342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:58:39.542258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:58:39.542951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:58:39.554152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.555719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.556554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.556999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.603964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Getting quotas for project 90d16fd50eb2412992297f88bb1d4580. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:58:39.627446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Getting quotas for user 2bb012478bf740468bba9fa762ac06ca and project 90d16fd50eb2412992297f88bb1d4580. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:58:39.688108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:58:39.691965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:58:39.785631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:39.805678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:39.810122 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a44cf390-10e9-4930-883f-f45b212bc26f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059973 Nov 27 20:58:39.811490 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1897/3947] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:58:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:58:39.811927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:39.816630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6f22a4d-a30c-4403-9721-6b4f1c7e2f45 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.500843 Nov 27 20:58:39.819916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2051/3948] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:39 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:58:39.836321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9e42c1f-e7cb-43ea-8456-45f038b17bc9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:39.837119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-afbcfe94-3d52-457d-8365-c468c661be41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:39.838349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-afbcfe94-3d52-457d-8365-c468c661be41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:39.844253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9e42c1f-e7cb-43ea-8456-45f038b17bc9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:39.851344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afbcfe94-3d52-457d-8365-c468c661be41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.861112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e42c1f-e7cb-43ea-8456-45f038b17bc9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.861605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e42c1f-e7cb-43ea-8456-45f038b17bc9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.862889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afbcfe94-3d52-457d-8365-c468c661be41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.863937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afbcfe94-3d52-457d-8365-c468c661be41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.864554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afbcfe94-3d52-457d-8365-c468c661be41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.864826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e42c1f-e7cb-43ea-8456-45f038b17bc9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:39.866552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9e42c1f-e7cb-43ea-8456-45f038b17bc9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:39.952290 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9e42c1f-e7cb-43ea-8456-45f038b17bc9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.132054 Nov 27 20:58:39.956782 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1898/3949] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:39 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:39.964207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9db047a-721f-498f-acfd-a40b9a9db184 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:39.964927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9db047a-721f-498f-acfd-a40b9a9db184 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:39.981826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-afbcfe94-3d52-457d-8365-c468c661be41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.157324 Nov 27 20:58:39.985091 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2052/3950] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:39 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:40.018761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:40.019812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:40.038668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:40.039659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:40.041050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:40.042016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:40.194381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f9db047a-721f-498f-acfd-a40b9a9db184 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:40.206600 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9db047a-721f-498f-acfd-a40b9a9db184 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1212 microversion: 2.1 time: 0.250047 Nov 27 20:58:40.209159 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1899/3951] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:39 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1212 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:40.590223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:40.599085 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cb2dd86-ff3b-4bd7-862f-b293e4607fa8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.611537 Nov 27 20:58:40.599723 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2053/3952] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:39 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:40.839104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:40.839792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:40.853962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:40.854396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:40.855201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:40.855676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:40.966696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0076ec7-84bc-4adf-a6c7-7a86dad4fcfd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:40.968072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f0076ec7-84bc-4adf-a6c7-7a86dad4fcfd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:40.977103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0076ec7-84bc-4adf-a6c7-7a86dad4fcfd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:40.977889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0076ec7-84bc-4adf-a6c7-7a86dad4fcfd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:40.978876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0076ec7-84bc-4adf-a6c7-7a86dad4fcfd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:40.979839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0076ec7-84bc-4adf-a6c7-7a86dad4fcfd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:41.045481 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0076ec7-84bc-4adf-a6c7-7a86dad4fcfd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.083657 Nov 27 20:58:41.046561 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2054/3953] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:40 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:41.054129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c09397a7-bf8c-4e14-97f4-40a6446a3402 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:41.056333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c09397a7-bf8c-4e14-97f4-40a6446a3402 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:41.066571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09397a7-bf8c-4e14-97f4-40a6446a3402 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:41.067216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09397a7-bf8c-4e14-97f4-40a6446a3402 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:41.068817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09397a7-bf8c-4e14-97f4-40a6446a3402 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:41.069646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09397a7-bf8c-4e14-97f4-40a6446a3402 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:41.128156 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c09397a7-bf8c-4e14-97f4-40a6446a3402 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078584 Nov 27 20:58:41.134856 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2055/3954] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:41 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:41.228600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:41.230246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:41.243039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:41.243896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:41.245265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:41.246156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:41.251612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:41.274058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:41.277121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:41.279046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-79a18782-6b09-4bd9-a0d4-55ce310781bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.444554 Nov 27 20:58:41.280091 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1900/3955] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:40 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:41.378743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:41.387482 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b6ae8bf-26ef-4da7-8aee-a05186fcfefa tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1264 microversion: 2.1 time: 0.165625 Nov 27 20:58:41.399640 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2056/3956] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:41 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:41.617447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:41.618455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:41.632619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:41.634008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:41.636374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:41.638285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.059564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23fad154-14db-4532-ae0c-4a106768551b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:42.061469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23fad154-14db-4532-ae0c-4a106768551b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:42.071018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fad154-14db-4532-ae0c-4a106768551b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.072068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fad154-14db-4532-ae0c-4a106768551b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.074064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fad154-14db-4532-ae0c-4a106768551b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.074805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fad154-14db-4532-ae0c-4a106768551b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.171039 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23fad154-14db-4532-ae0c-4a106768551b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.115416 Nov 27 20:58:42.177975 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2057/3957] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:42 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:42.187662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-55b73385-dd11-4db5-8c2b-96c19154666d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:42.188943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-55b73385-dd11-4db5-8c2b-96c19154666d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:42.196682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55b73385-dd11-4db5-8c2b-96c19154666d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.197407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55b73385-dd11-4db5-8c2b-96c19154666d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.198376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55b73385-dd11-4db5-8c2b-96c19154666d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.198977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55b73385-dd11-4db5-8c2b-96c19154666d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.294376 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-55b73385-dd11-4db5-8c2b-96c19154666d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.111948 Nov 27 20:58:42.295467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2058/3958] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:42 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:42.305910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:42.307723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:42.316274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.316961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.318653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.319956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.584566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:42.592077 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4c1f968b-0b09-4cba-9e6d-ce0ba72a35fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.979188 Nov 27 20:58:42.592682 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1901/3959] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:41 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:42.605495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:42.606115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:42.616148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.616612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.617410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:42.618048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:42.700578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:42.711901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:42.713650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:42.714837 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-803167d8-af70-4bd0-bb61-a6223e41c8e0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.417771 Nov 27 20:58:42.715937 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2059/3960] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:42 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:42.719310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:42.727916 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0df6b22-d010-488b-a2e3-3f81375409c2 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1270 microversion: 2.1 time: 0.130129 Nov 27 20:58:42.728693 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1902/3961] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:42 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:43.183634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e572cf41-48b7-403b-adb9-626e53c28253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:43.184736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e572cf41-48b7-403b-adb9-626e53c28253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:43.195838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e572cf41-48b7-403b-adb9-626e53c28253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.205945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e572cf41-48b7-403b-adb9-626e53c28253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.209825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e572cf41-48b7-403b-adb9-626e53c28253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.210428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e572cf41-48b7-403b-adb9-626e53c28253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.276230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e572cf41-48b7-403b-adb9-626e53c28253 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.096188 Nov 27 20:58:43.278511 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2060/3962] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:43 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:43.313450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3436388e-19e1-4b58-bfc7-9877ee698656 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:43.314448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3436388e-19e1-4b58-bfc7-9877ee698656 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:43.339813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3436388e-19e1-4b58-bfc7-9877ee698656 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.340850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3436388e-19e1-4b58-bfc7-9877ee698656 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.356147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3436388e-19e1-4b58-bfc7-9877ee698656 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.356616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3436388e-19e1-4b58-bfc7-9877ee698656 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.438433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3436388e-19e1-4b58-bfc7-9877ee698656 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.129118 Nov 27 20:58:43.440780 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1903/3963] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:43 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:43.609993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:43.611374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:43.620997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.621556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.622618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.623062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.737385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:43.738328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:43.749739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.750683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.751517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.751993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.767521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:43.778078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49825790-5486-4144-84b8-8b3660e520ae tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.171978 Nov 27 20:58:43.779060 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2061/3964] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:43 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:43.784577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:43.785318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:43.792164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.792985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:43.794411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:43.795020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:44.130527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:44.140138 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5c8c29b-8ca3-4079-97e1-b19e301d6a99 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1312 microversion: 2.1 time: 0.359534 Nov 27 20:58:44.141261 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2062/3965] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:43 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1312 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:44.290114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:44.304749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff3ff7db-fa3a-4bb8-9164-76c4098cca38 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:44.306584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff3ff7db-fa3a-4bb8-9164-76c4098cca38 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:44.307671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:44.309749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:44.312034 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe53926d-e76e-47a1-8696-8bbfde2324fe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.579706 Nov 27 20:58:44.313512 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1904/3966] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:43 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:58:44.324074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff3ff7db-fa3a-4bb8-9164-76c4098cca38 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:44.325606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff3ff7db-fa3a-4bb8-9164-76c4098cca38 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:44.325960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff3ff7db-fa3a-4bb8-9164-76c4098cca38 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:44.326693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff3ff7db-fa3a-4bb8-9164-76c4098cca38 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:44.390018 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff3ff7db-fa3a-4bb8-9164-76c4098cca38 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.103126 Nov 27 20:58:44.391549 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2063/3967] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:44 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:44.453910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c88707e9-89dc-4312-b1c2-378e167a9441 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:44.455566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c88707e9-89dc-4312-b1c2-378e167a9441 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:44.478318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c88707e9-89dc-4312-b1c2-378e167a9441 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:44.480893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c88707e9-89dc-4312-b1c2-378e167a9441 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:44.483015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c88707e9-89dc-4312-b1c2-378e167a9441 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:44.485207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c88707e9-89dc-4312-b1c2-378e167a9441 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:44.564574 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c88707e9-89dc-4312-b1c2-378e167a9441 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.116698 Nov 27 20:58:44.566025 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1905/3968] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:44 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:44.800466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:44.802451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:44.813996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:44.815329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:44.816566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:44.818435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.148767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:45.157294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:45.158582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:45.159351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-892e02b6-dcae-4730-9757-a1c60a7b334c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.367070 Nov 27 20:58:45.160387 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2064/3969] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:44 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:45.175075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.175853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.177355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.178013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.331422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:45.332598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:45.339827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.340441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.341431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.342032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.658112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:45.678880 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7edcfb98-c84f-44bd-ac17-0ab11fcff65e tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1312 microversion: 2.1 time: 0.523517 Nov 27 20:58:45.681629 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1906/3970] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:45 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1312 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:45.688185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d3388c5a-bf2a-41ba-bac8-f3607bf8b530 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:45.692541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d3388c5a-bf2a-41ba-bac8-f3607bf8b530 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:45.713905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3388c5a-bf2a-41ba-bac8-f3607bf8b530 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.714757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3388c5a-bf2a-41ba-bac8-f3607bf8b530 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.715874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3388c5a-bf2a-41ba-bac8-f3607bf8b530 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.717336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3388c5a-bf2a-41ba-bac8-f3607bf8b530 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.770290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:45.789149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:45.791313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:45.793190 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04db730f-5e26-4190-bc85-16fc070de61a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.465487 Nov 27 20:58:45.795216 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2065/3971] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:45 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:58:45.799312 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d3388c5a-bf2a-41ba-bac8-f3607bf8b530 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.116162 Nov 27 20:58:45.800486 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1907/3972] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:45 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:45.812920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88d71dcd-59bf-4d1f-9ca5-396df25f542f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:45.814465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88d71dcd-59bf-4d1f-9ca5-396df25f542f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:45.834523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d71dcd-59bf-4d1f-9ca5-396df25f542f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.835322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d71dcd-59bf-4d1f-9ca5-396df25f542f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.838160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d71dcd-59bf-4d1f-9ca5-396df25f542f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:45.839461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d71dcd-59bf-4d1f-9ca5-396df25f542f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:45.905093 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88d71dcd-59bf-4d1f-9ca5-396df25f542f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.108412 Nov 27 20:58:45.905763 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2066/3973] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:45 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:46.178337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:46.179735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:46.186866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.187351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:46.188148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.188594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:46.534466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:46.545660 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5dd93abc-377e-4174-946c-3528cbc54cc7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.372365 Nov 27 20:58:46.547434 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1908/3974] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:46 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:46.697869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:46.698628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:46.712907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.715868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:46.716836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.717952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:46.810280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8af916a3-164d-4529-a559-8711580d2f7a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:46.811219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8af916a3-164d-4529-a559-8711580d2f7a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:46.831686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8af916a3-164d-4529-a559-8711580d2f7a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.832318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8af916a3-164d-4529-a559-8711580d2f7a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:46.833343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8af916a3-164d-4529-a559-8711580d2f7a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.833949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8af916a3-164d-4529-a559-8711580d2f7a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:46.904238 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8af916a3-164d-4529-a559-8711580d2f7a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.097538 Nov 27 20:58:46.906144 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1909/3975] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:46 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:46.915001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:46.916525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:46.930720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.931456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:46.932469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:46.933069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:47.097118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:47.110809 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6965c39f-f716-4397-96c0-8a01097997c8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.417292 Nov 27 20:58:47.111591 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2067/3976] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:46 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:47.121146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06912d48-31ee-48f4-8799-6e063b2ec5d7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:47.121146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06912d48-31ee-48f4-8799-6e063b2ec5d7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:47.152120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06912d48-31ee-48f4-8799-6e063b2ec5d7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:47.157629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06912d48-31ee-48f4-8799-6e063b2ec5d7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:47.159386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06912d48-31ee-48f4-8799-6e063b2ec5d7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:47.161832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06912d48-31ee-48f4-8799-6e063b2ec5d7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:47.257047 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06912d48-31ee-48f4-8799-6e063b2ec5d7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.137615 Nov 27 20:58:47.257790 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2068/3977] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:47 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:47.266282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e99751b8-0c99-4280-a218-52e50e6314ad req-fc98d477-e8d8-4e29-885b-16c78fc0e84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac6332f8-a023-486b-8c76-12bd63305e2c", "tag": "1411e0e1-0ec8-4aa3-a13d-a478737b482d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:47.268222 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:47.268222 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:47.285408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e99751b8-0c99-4280-a218-52e50e6314ad req-fc98d477-e8d8-4e29-885b-16c78fc0e84e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:47.286731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e99751b8-0c99-4280-a218-52e50e6314ad req-fc98d477-e8d8-4e29-885b-16c78fc0e84e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:47.306810 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e99751b8-0c99-4280-a218-52e50e6314ad req-fc98d477-e8d8-4e29-885b-16c78fc0e84e service nova] Creating event network-changed:1411e0e1-0ec8-4aa3-a13d-a478737b482d for instance ac6332f8-a023-486b-8c76-12bd63305e2c on nch1-master-1 Nov 27 20:58:47.312649 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e99751b8-0c99-4280-a218-52e50e6314ad req-fc98d477-e8d8-4e29-885b-16c78fc0e84e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051937 Nov 27 20:58:47.314336 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2069/3978] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:47.564209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:47.565170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:47.580648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:47.581309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:47.582138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:47.587355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:47.966595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:47.987082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:47.990208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:47.992310 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-892166ed-ee62-4f78-a436-9c1cce0ae40f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.084783 Nov 27 20:58:47.994235 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1910/3979] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:46 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:48.003051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86f35f96-18fe-41c5-b4ba-16142d4f1f1a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:48.004332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-86f35f96-18fe-41c5-b4ba-16142d4f1f1a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:48.019436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86f35f96-18fe-41c5-b4ba-16142d4f1f1a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:48.020237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86f35f96-18fe-41c5-b4ba-16142d4f1f1a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:48.022237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86f35f96-18fe-41c5-b4ba-16142d4f1f1a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:48.022891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86f35f96-18fe-41c5-b4ba-16142d4f1f1a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:48.079954 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86f35f96-18fe-41c5-b4ba-16142d4f1f1a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.083615 Nov 27 20:58:48.081586 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1911/3980] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:47 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:48.131005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:48.132670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:48.141123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:48.141857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:48.142951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:48.143490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:48.143971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:48.152127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eff7c325-e056-4efd-bb05-847394f20544 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.592687 Nov 27 20:58:48.162723 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2070/3981] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:47 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:48.269031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c0e017f-3a9b-4f18-b4d9-93b1912cde55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:48.271156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c0e017f-3a9b-4f18-b4d9-93b1912cde55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:48.277144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0e017f-3a9b-4f18-b4d9-93b1912cde55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:48.277626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0e017f-3a9b-4f18-b4d9-93b1912cde55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:48.278414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0e017f-3a9b-4f18-b4d9-93b1912cde55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:48.278849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0e017f-3a9b-4f18-b4d9-93b1912cde55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:48.322358 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c0e017f-3a9b-4f18-b4d9-93b1912cde55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.057202 Nov 27 20:58:48.324056 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2071/3982] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:48 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:48.725123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:48.732890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de406b9e-0f85-4b85-85ca-1a05db9e3c55 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.607873 Nov 27 20:58:48.734069 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1912/3983] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:48 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:49.015872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:49.017215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:49.028516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.029325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.031372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.033074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.092450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f753bad7-d142-4a8c-8721-0ca5bbfd526e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:49.094334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f753bad7-d142-4a8c-8721-0ca5bbfd526e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:49.106807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f753bad7-d142-4a8c-8721-0ca5bbfd526e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.107552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f753bad7-d142-4a8c-8721-0ca5bbfd526e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.108671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f753bad7-d142-4a8c-8721-0ca5bbfd526e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.109192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f753bad7-d142-4a8c-8721-0ca5bbfd526e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.186936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f753bad7-d142-4a8c-8721-0ca5bbfd526e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.097990 Nov 27 20:58:49.192468 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1913/3984] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:49 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:49.198534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:49.199100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:49.220142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.220614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.222869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.223348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.674514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:49.686143 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8db695d3-c1fc-4bb3-a49b-04d89b89e276 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.492267 Nov 27 20:58:49.696861 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1914/3985] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:49 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:49.702219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27bca164-a750-4cec-9893-37fc6d43872e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:49.703238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27bca164-a750-4cec-9893-37fc6d43872e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:49.711515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bca164-a750-4cec-9893-37fc6d43872e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.712215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bca164-a750-4cec-9893-37fc6d43872e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.712620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:49.713769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bca164-a750-4cec-9893-37fc6d43872e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.714425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bca164-a750-4cec-9893-37fc6d43872e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.726863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:49.729472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:49.730892 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5aef890-a4b1-4405-9304-b01f0b342a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.721385 Nov 27 20:58:49.732775 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2072/3986] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:49 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:49.752663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-287a8c3b-97bc-4e4c-8af4-42ade4ea4166 req-1d9fb618-8fd4-4ad2-9e60-b1a0bac85fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac6332f8-a023-486b-8c76-12bd63305e2c", "tag": "0a44e963-93ea-488c-8fe6-c7ee1dfe6c0e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:49.754344 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:49.754344 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:49.765160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-287a8c3b-97bc-4e4c-8af4-42ade4ea4166 req-1d9fb618-8fd4-4ad2-9e60-b1a0bac85fd7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.766727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-287a8c3b-97bc-4e4c-8af4-42ade4ea4166 req-1d9fb618-8fd4-4ad2-9e60-b1a0bac85fd7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.780032 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-287a8c3b-97bc-4e4c-8af4-42ade4ea4166 req-1d9fb618-8fd4-4ad2-9e60-b1a0bac85fd7 service nova] Creating event network-changed:0a44e963-93ea-488c-8fe6-c7ee1dfe6c0e for instance ac6332f8-a023-486b-8c76-12bd63305e2c on nch1-master-1 Nov 27 20:58:49.782548 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27bca164-a750-4cec-9893-37fc6d43872e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.083631 Nov 27 20:58:49.783979 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1915/3987] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:49 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:49.790069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:49.791057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:49.793054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-287a8c3b-97bc-4e4c-8af4-42ade4ea4166 req-1d9fb618-8fd4-4ad2-9e60-b1a0bac85fd7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058514 Nov 27 20:58:49.793853 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2073/3988] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:49.799762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.800378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:49.801334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:49.802000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:50.158089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:50.166203 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f54147f6-15d5-48ee-9ccf-e2be61887df8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.380785 Nov 27 20:58:50.167075 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1916/3989] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:49 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:50.200108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12119b70-2640-4f66-aa21-f071834851cf tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:50.201706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12119b70-2640-4f66-aa21-f071834851cf tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:50.210087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12119b70-2640-4f66-aa21-f071834851cf tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:50.210579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12119b70-2640-4f66-aa21-f071834851cf tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:50.211409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12119b70-2640-4f66-aa21-f071834851cf tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:50.212018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12119b70-2640-4f66-aa21-f071834851cf tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:50.258434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12119b70-2640-4f66-aa21-f071834851cf tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.062215 Nov 27 20:58:50.260214 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2074/3990] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:50 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:50.705044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:50.705679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:50.716102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:50.719408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:50.720462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:50.722984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:50.756934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:50.757650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:50.775738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:50.775738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:50.775738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:50.776198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:51.074136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:51.103342 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48b0169f-5287-4089-a499-22ca2b9dac5c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.402518 Nov 27 20:58:51.108606 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1917/3991] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:50 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:51.119107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca4e8809-25b7-48bf-8a37-4542b767482f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:51.120547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca4e8809-25b7-48bf-8a37-4542b767482f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:51.130284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca4e8809-25b7-48bf-8a37-4542b767482f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:51.131053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca4e8809-25b7-48bf-8a37-4542b767482f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:51.133919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca4e8809-25b7-48bf-8a37-4542b767482f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:51.134575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca4e8809-25b7-48bf-8a37-4542b767482f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:51.154421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:51.165931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:51.167781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:51.169492 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e687af64-00d3-45cd-a347-34f1ff1ab8f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.423248 Nov 27 20:58:51.170750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2075/3992] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:50 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:51.184491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:51.185414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:51.193844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:51.194855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:51.196006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:51.196742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:51.199500 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca4e8809-25b7-48bf-8a37-4542b767482f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.089228 Nov 27 20:58:51.200168 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1918/3993] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:51 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:51.273128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb659ec6-40f7-4a33-b4e8-abbce45782a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:51.274547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb659ec6-40f7-4a33-b4e8-abbce45782a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:51.287864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb659ec6-40f7-4a33-b4e8-abbce45782a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:51.288481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb659ec6-40f7-4a33-b4e8-abbce45782a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:51.290130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb659ec6-40f7-4a33-b4e8-abbce45782a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:51.290844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb659ec6-40f7-4a33-b4e8-abbce45782a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:51.361157 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb659ec6-40f7-4a33-b4e8-abbce45782a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.093717 Nov 27 20:58:51.363205 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1919/3994] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:51 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:51.450284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:51.458154 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19891bab-c633-44ac-80ac-0bfbaaeabd78 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.278231 Nov 27 20:58:51.459388 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2076/3995] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:51 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:52.123204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:52.124715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:52.136201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.136660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.137462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.137902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.189715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:52.190407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:52.210654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.211205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.212410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.213215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.328215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:52.347061 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b3430ab-bdf9-4493-ac62-3c4f77c1b09a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.229914 Nov 27 20:58:52.357920 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1920/3996] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:52 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:52.364327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e302e1e7-afa0-498a-8ae8-1b9c14c6afd5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:52.365171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e302e1e7-afa0-498a-8ae8-1b9c14c6afd5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:52.372919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e302e1e7-afa0-498a-8ae8-1b9c14c6afd5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.373863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e302e1e7-afa0-498a-8ae8-1b9c14c6afd5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.375238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e302e1e7-afa0-498a-8ae8-1b9c14c6afd5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.375871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e302e1e7-afa0-498a-8ae8-1b9c14c6afd5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.434612 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e302e1e7-afa0-498a-8ae8-1b9c14c6afd5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.074965 Nov 27 20:58:52.435704 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1921/3997] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:52 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:52.448788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9442ed79-f97a-4396-9996-47e01385e43c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:52.451644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9442ed79-f97a-4396-9996-47e01385e43c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:52.461953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9442ed79-f97a-4396-9996-47e01385e43c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.462527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9442ed79-f97a-4396-9996-47e01385e43c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.463753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9442ed79-f97a-4396-9996-47e01385e43c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.464312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9442ed79-f97a-4396-9996-47e01385e43c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.525805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9442ed79-f97a-4396-9996-47e01385e43c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.088184 Nov 27 20:58:52.527398 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1922/3998] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:52 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:52.534758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:52.535612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:52.553003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.553003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.553003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:52.553003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:52.575682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:52.589993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:52.592111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:52.593896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92e340cf-9b2a-4fb2-a221-9023419cefff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.407743 Nov 27 20:58:52.595653 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2077/3999] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:52 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:58:52.730675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:52.743500 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-762dac20-9f96-49fb-89f8-ccc8f5848895 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.214709 Nov 27 20:58:52.744415 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1923/4000] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:52 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:53.366350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:53.367675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:53.376934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.380391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.384987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.385570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.447085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-892edc3c-1078-4c40-8d68-51c21c0ff99c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:53.448850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-892edc3c-1078-4c40-8d68-51c21c0ff99c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:53.460412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892edc3c-1078-4c40-8d68-51c21c0ff99c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.461238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892edc3c-1078-4c40-8d68-51c21c0ff99c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.462203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892edc3c-1078-4c40-8d68-51c21c0ff99c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.462804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-892edc3c-1078-4c40-8d68-51c21c0ff99c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.513995 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-892edc3c-1078-4c40-8d68-51c21c0ff99c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.071603 Nov 27 20:58:53.514661 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1924/4001] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:53 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:53.543855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56370bdf-b786-4874-905e-7f7d6044485d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:53.545174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56370bdf-b786-4874-905e-7f7d6044485d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:53.554353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56370bdf-b786-4874-905e-7f7d6044485d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.555041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56370bdf-b786-4874-905e-7f7d6044485d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.556284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56370bdf-b786-4874-905e-7f7d6044485d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.556963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56370bdf-b786-4874-905e-7f7d6044485d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.621610 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56370bdf-b786-4874-905e-7f7d6044485d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.085235 Nov 27 20:58:53.624679 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1925/4002] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:53 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:53.642323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:53.643553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:53.659376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.659830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.661349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.662074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.785524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:53.801777 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c310f409-1299-4a96-a3f3-b11fa78c64e8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1509 microversion: 2.1 time: 0.439177 Nov 27 20:58:53.812772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2078/4003] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:53 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:53.823178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:53.824039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:53.838476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.839111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.840111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:53.842495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:53.985208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:53.999298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:54.003186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:54.006233 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-240de3ca-22f4-45a0-984d-7b5839c3f705 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.377836 Nov 27 20:58:54.008424 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1926/4004] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:53 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:54.194247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:54.202546 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ec8cde1-eec1-462e-8347-fe357adc7b6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.388458 Nov 27 20:58:54.203291 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2079/4005] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:53 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:54.527827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7439c3c2-1f15-4a54-9447-c2f089cb85cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:54.529698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7439c3c2-1f15-4a54-9447-c2f089cb85cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:54.538709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7439c3c2-1f15-4a54-9447-c2f089cb85cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:54.540355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7439c3c2-1f15-4a54-9447-c2f089cb85cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:54.542201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7439c3c2-1f15-4a54-9447-c2f089cb85cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:54.543355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7439c3c2-1f15-4a54-9447-c2f089cb85cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:54.606089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7439c3c2-1f15-4a54-9447-c2f089cb85cf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.082117 Nov 27 20:58:54.607437 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1927/4006] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:54 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:54.634375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f94f499d-9480-414c-96db-35b7910ef7eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:54.636492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f94f499d-9480-414c-96db-35b7910ef7eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:54.644457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f94f499d-9480-414c-96db-35b7910ef7eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:54.645390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f94f499d-9480-414c-96db-35b7910ef7eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:54.647091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f94f499d-9480-414c-96db-35b7910ef7eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:54.648041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f94f499d-9480-414c-96db-35b7910ef7eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:54.694689 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f94f499d-9480-414c-96db-35b7910ef7eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.064189 Nov 27 20:58:54.696229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2080/4007] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:54 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:54.820190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:54.820892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:54.830076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:54.830998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:54.832184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:54.833573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:55.028066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:55.028763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:55.052843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:55.053437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:55.054296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:55.054742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:55.566048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:55.577312 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b3a0d0d-754c-48f4-9513-870c132d46ec tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1530 microversion: 2.1 time: 0.759501 Nov 27 20:58:55.578129 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1928/4008] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:54 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1530 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:55.587692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:55.591111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:55.606682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:55.607155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:55.607991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:55.610758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:55.746059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:55.809473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:55.820999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:55.825967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fad3bf04-c8b6-4d2f-b181-621f72725e09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.799879 Nov 27 20:58:55.840441 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2081/4009] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:55 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:55.862488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-27113ce7-7ea9-4379-8f0a-3010d1a0c377 req-2937b2d9-2449-4366-a123-cb174d35ac4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6332f8-a023-486b-8c76-12bd63305e2c", "name": "network-vif-plugged", "status": "completed", "tag": "1411e0e1-0ec8-4aa3-a13d-a478737b482d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:55.868378 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:55.868378 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:55.885575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-27113ce7-7ea9-4379-8f0a-3010d1a0c377 req-2937b2d9-2449-4366-a123-cb174d35ac4c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:55.886521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-27113ce7-7ea9-4379-8f0a-3010d1a0c377 req-2937b2d9-2449-4366-a123-cb174d35ac4c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:55.919047 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-27113ce7-7ea9-4379-8f0a-3010d1a0c377 req-2937b2d9-2449-4366-a123-cb174d35ac4c service nova] Creating event network-vif-plugged:1411e0e1-0ec8-4aa3-a13d-a478737b482d for instance ac6332f8-a023-486b-8c76-12bd63305e2c on nch1-master-1 Nov 27 20:58:55.936756 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-27113ce7-7ea9-4379-8f0a-3010d1a0c377 req-2937b2d9-2449-4366-a123-cb174d35ac4c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093380 Nov 27 20:58:55.937772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2082/4010] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:55.944637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a072e0b8-bcc3-46ef-b34a-d48033f02cfa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:55.945816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a072e0b8-bcc3-46ef-b34a-d48033f02cfa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:55.953735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a072e0b8-bcc3-46ef-b34a-d48033f02cfa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:55.954236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a072e0b8-bcc3-46ef-b34a-d48033f02cfa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:55.955023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a072e0b8-bcc3-46ef-b34a-d48033f02cfa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:55.955664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a072e0b8-bcc3-46ef-b34a-d48033f02cfa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:56.022457 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a072e0b8-bcc3-46ef-b34a-d48033f02cfa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078835 Nov 27 20:58:56.025373 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2083/4011] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:55 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:56.042611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-561cf2aa-e22a-47fe-9175-ca2b80fb0c50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:56.044729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-561cf2aa-e22a-47fe-9175-ca2b80fb0c50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:56.045967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:56.054193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-561cf2aa-e22a-47fe-9175-ca2b80fb0c50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:56.054399 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d1f6fac-53d1-4858-a94c-fa07cc65de16 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.474072 Nov 27 20:58:56.054803 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1929/4012] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:55 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:56.055326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-561cf2aa-e22a-47fe-9175-ca2b80fb0c50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:56.056483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-561cf2aa-e22a-47fe-9175-ca2b80fb0c50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:56.057113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-561cf2aa-e22a-47fe-9175-ca2b80fb0c50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:56.117254 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-561cf2aa-e22a-47fe-9175-ca2b80fb0c50 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.088910 Nov 27 20:58:56.120883 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2084/4013] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:56 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:56.597763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:56.598613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:56.617015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:56.617477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:56.618311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:56.618749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:56.849083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:56.849887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:56.870780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:56.873191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:56.876524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:56.877956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:56.975957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:56.991098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3c093d9-0d2b-4420-8441-e12f6043dd7e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.394954 Nov 27 20:58:57.005561 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1930/4014] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:56 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:57.040022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1dd8c08-3260-46b9-ae43-9f872ab8731f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:57.041242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b1dd8c08-3260-46b9-ae43-9f872ab8731f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:57.056713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1dd8c08-3260-46b9-ae43-9f872ab8731f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:57.059372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1dd8c08-3260-46b9-ae43-9f872ab8731f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:57.065153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1dd8c08-3260-46b9-ae43-9f872ab8731f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:57.077164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1dd8c08-3260-46b9-ae43-9f872ab8731f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:57.228353 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1dd8c08-3260-46b9-ae43-9f872ab8731f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.195503 Nov 27 20:58:57.233200 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1931/4015] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:57 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:57.251410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:57.254175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:57.287000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:57.291932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:57.298774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:57.299696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:57.426537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:57.443898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:57.446481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:57.452185 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87ac6904-37ff-4022-aeb2-15a0d9f7778f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.605644 Nov 27 20:58:57.454499 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2085/4016] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:56 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:57.467005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7efeff0-2daf-4501-8a73-53957658df84 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:57.468027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7efeff0-2daf-4501-8a73-53957658df84 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:57.486845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7efeff0-2daf-4501-8a73-53957658df84 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:57.487383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7efeff0-2daf-4501-8a73-53957658df84 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:57.490412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7efeff0-2daf-4501-8a73-53957658df84 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:57.490878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7efeff0-2daf-4501-8a73-53957658df84 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:57.584328 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7efeff0-2daf-4501-8a73-53957658df84 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.128243 Nov 27 20:58:57.585459 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2086/4017] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:57 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:57.691530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:57.710025 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cfa9105f-b488-43c7-ae3a-b28d0536af40 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.474455 Nov 27 20:58:57.710981 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1932/4018] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:57 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:58:57.971848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a017ca47-472a-48cb-a4d7-dbf4a476b930 req-15156dfb-394e-43d7-8a51-7389b1e927c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a6bdc1-0d85-4563-8ef9-f6a0a17075a0", "name": "network-vif-plugged", "status": "completed", "tag": "4ebac182-8a28-42f8-9b81-45a0a7ad3616"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:57.976021 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:57.976021 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:58:58.005333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a017ca47-472a-48cb-a4d7-dbf4a476b930 req-15156dfb-394e-43d7-8a51-7389b1e927c9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.012647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a017ca47-472a-48cb-a4d7-dbf4a476b930 req-15156dfb-394e-43d7-8a51-7389b1e927c9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.019026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:58.019771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:58.041420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.044804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.046466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.047095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.068000 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a017ca47-472a-48cb-a4d7-dbf4a476b930 req-15156dfb-394e-43d7-8a51-7389b1e927c9 service nova] Creating event network-vif-plugged:4ebac182-8a28-42f8-9b81-45a0a7ad3616 for instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 on nch1-master-1 Nov 27 20:58:58.089941 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a017ca47-472a-48cb-a4d7-dbf4a476b930 req-15156dfb-394e-43d7-8a51-7389b1e927c9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127517 Nov 27 20:58:58.093306 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2087/4019] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:58:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:58:58.243233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f13fb3e2-bb9b-46f6-a0e2-a383b20c79f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:58.244875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f13fb3e2-bb9b-46f6-a0e2-a383b20c79f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:58.264596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f13fb3e2-bb9b-46f6-a0e2-a383b20c79f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.272860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f13fb3e2-bb9b-46f6-a0e2-a383b20c79f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.276878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f13fb3e2-bb9b-46f6-a0e2-a383b20c79f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.281458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f13fb3e2-bb9b-46f6-a0e2-a383b20c79f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.417837 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f13fb3e2-bb9b-46f6-a0e2-a383b20c79f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.179094 Nov 27 20:58:58.422227 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2088/4020] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:58 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:58.478144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:58.479163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:58.487903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.488635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.489635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.491467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.559629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:58.572317 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f407f5e1-fce3-4cae-8398-bcd6c992f7c3 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.562255 Nov 27 20:58:58.575950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1933/4021] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:58 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:58.600972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1db7dec-2a02-43f6-b952-85e9aa0ec817 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:58.602002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1db7dec-2a02-43f6-b952-85e9aa0ec817 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:58.613168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1db7dec-2a02-43f6-b952-85e9aa0ec817 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.614222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1db7dec-2a02-43f6-b952-85e9aa0ec817 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.615374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1db7dec-2a02-43f6-b952-85e9aa0ec817 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.615885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1db7dec-2a02-43f6-b952-85e9aa0ec817 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.672462 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1db7dec-2a02-43f6-b952-85e9aa0ec817 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.079806 Nov 27 20:58:58.673147 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1934/4022] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:58 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:58:58.729026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:58.730631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:58.741767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.745625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:58.748900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:58.749650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:59.042580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:59.053456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7351f143-e5dc-4718-b2dd-808951ce0fc5 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.329064 Nov 27 20:58:59.054587 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1935/4023] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:58 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:58:59.224559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:59.240487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:59.243241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:59.246115 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4cd50aa7-4563-4bae-86a9-8ec9bef8a6bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.774543 Nov 27 20:58:59.263922 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2089/4024] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:58:58 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:58:59.434197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29077e90-3ab9-4f44-a80e-e0e879044f8e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:59.435857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29077e90-3ab9-4f44-a80e-e0e879044f8e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:59.456369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29077e90-3ab9-4f44-a80e-e0e879044f8e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:59.457393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29077e90-3ab9-4f44-a80e-e0e879044f8e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:59.458556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29077e90-3ab9-4f44-a80e-e0e879044f8e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:59.459213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29077e90-3ab9-4f44-a80e-e0e879044f8e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:59.519900 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29077e90-3ab9-4f44-a80e-e0e879044f8e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.093148 Nov 27 20:58:59.524572 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1936/4025] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:58:59 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:58:59.599875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:58:59.600505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:59.617971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:59.618434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:59.624021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:59.625511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:59.689680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fbd0fe26-51d1-4c35-81a5-ffeef77dac7f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:58:59.691211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fbd0fe26-51d1-4c35-81a5-ffeef77dac7f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:58:59.709704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0fe26-51d1-4c35-81a5-ffeef77dac7f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:59.711176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0fe26-51d1-4c35-81a5-ffeef77dac7f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:59.712252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0fe26-51d1-4c35-81a5-ffeef77dac7f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:58:59.715051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0fe26-51d1-4c35-81a5-ffeef77dac7f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:58:59.801943 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fbd0fe26-51d1-4c35-81a5-ffeef77dac7f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.117838 Nov 27 20:58:59.807136 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1937/4026] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:58:59 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:58:59.970766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:58:59.980861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b23a87a3-c722-41a8-a2fd-ded8c56fb777 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.392269 Nov 27 20:58:59.984002 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2090/4027] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:58:59 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:00.087036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:00.088819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:00.106019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.107762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.111306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.112011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.195076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1ab7576c-a257-4553-ae20-67b30bd04d0f req-d412718b-8015-4f64-8d6a-ba3d96d517ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6332f8-a023-486b-8c76-12bd63305e2c", "name": "network-vif-plugged", "status": "completed", "tag": "0a44e963-93ea-488c-8fe6-c7ee1dfe6c0e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:00.206257 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:00.206257 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:00.229459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1ab7576c-a257-4553-ae20-67b30bd04d0f req-d412718b-8015-4f64-8d6a-ba3d96d517ae service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.251408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1ab7576c-a257-4553-ae20-67b30bd04d0f req-d412718b-8015-4f64-8d6a-ba3d96d517ae service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.319773 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1ab7576c-a257-4553-ae20-67b30bd04d0f req-d412718b-8015-4f64-8d6a-ba3d96d517ae service nova] Creating event network-vif-plugged:0a44e963-93ea-488c-8fe6-c7ee1dfe6c0e for instance ac6332f8-a023-486b-8c76-12bd63305e2c on nch1-master-1 Nov 27 20:59:00.344343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1ab7576c-a257-4553-ae20-67b30bd04d0f req-d412718b-8015-4f64-8d6a-ba3d96d517ae service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155350 Nov 27 20:59:00.351048 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2091/4028] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:00.363389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:00.371939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:00.394665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.396018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.397167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.397777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.670288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:00.692768 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ba08b9d-b86a-4188-8258-25376b879809 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.619612 Nov 27 20:59:00.695144 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1938/4029] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:00 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:00.705616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da2aae42-3650-4d58-8bfc-b9c3195d0688 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:00.706944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da2aae42-3650-4d58-8bfc-b9c3195d0688 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:00.727204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da2aae42-3650-4d58-8bfc-b9c3195d0688 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.729773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da2aae42-3650-4d58-8bfc-b9c3195d0688 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.733709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da2aae42-3650-4d58-8bfc-b9c3195d0688 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.734796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da2aae42-3650-4d58-8bfc-b9c3195d0688 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.890526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da2aae42-3650-4d58-8bfc-b9c3195d0688 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.192677 Nov 27 20:59:00.898060 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1939/4030] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:00 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:00.924618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40cd6c62-1a63-45c4-be98-2203c86d6c4e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:00.927814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40cd6c62-1a63-45c4-be98-2203c86d6c4e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:00.959518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40cd6c62-1a63-45c4-be98-2203c86d6c4e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.961056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40cd6c62-1a63-45c4-be98-2203c86d6c4e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:00.965834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40cd6c62-1a63-45c4-be98-2203c86d6c4e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:00.968149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40cd6c62-1a63-45c4-be98-2203c86d6c4e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:01.092284 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40cd6c62-1a63-45c4-be98-2203c86d6c4e tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.191840 Nov 27 20:59:01.104716 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1940/4031] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:00 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:01.126665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:01.127594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:01.162760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:01.163221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:01.165977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:01.166428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:01.279577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:01.296381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:01.298447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:01.301141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab9ad850-9f7d-48a5-bc97-66114f59b0ff tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.947038 Nov 27 20:59:01.303355 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2092/4032] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:00 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:01.503316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:01.514330 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff3ff66d-1ef9-4138-9bf5-47a153505876 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.403760 Nov 27 20:59:01.514974 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1941/4033] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:01 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:01.715200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:01.716381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:01.739566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:01.740627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:01.745221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:01.747778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:01.909123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6aef5317-d401-404f-8d40-2ef4f4640d55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:01.910192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6aef5317-d401-404f-8d40-2ef4f4640d55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:01.926711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aef5317-d401-404f-8d40-2ef4f4640d55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:01.928982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aef5317-d401-404f-8d40-2ef4f4640d55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:01.930023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aef5317-d401-404f-8d40-2ef4f4640d55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:01.932011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aef5317-d401-404f-8d40-2ef4f4640d55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:02.025284 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6aef5317-d401-404f-8d40-2ef4f4640d55 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.120481 Nov 27 20:59:02.026230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1942/4034] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:01 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:02.114965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-506a47d3-b755-4e7a-8656-f382623bb5f6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:02.116303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-506a47d3-b755-4e7a-8656-f382623bb5f6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:02.137199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-506a47d3-b755-4e7a-8656-f382623bb5f6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:02.156397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-506a47d3-b755-4e7a-8656-f382623bb5f6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:02.157218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-506a47d3-b755-4e7a-8656-f382623bb5f6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:02.157528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-506a47d3-b755-4e7a-8656-f382623bb5f6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:02.295645 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-506a47d3-b755-4e7a-8656-f382623bb5f6 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.185292 Nov 27 20:59:02.304565 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1943/4035] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:02 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:02.327550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:02.328554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:02.345410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:02.345875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:02.346911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:02.348819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:02.478569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:02.490434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f584ebb-f0bb-4e9d-88aa-9a845da902de tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1333 microversion: 2.1 time: 0.777917 Nov 27 20:59:02.492596 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2093/4036] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:01 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1333 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:02.537216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:02.538103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:02.557557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:02.558039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:02.558961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:02.560171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:02.990554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:03.010558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:03.013990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:03.025695 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3c47a45-8101-4121-b0d2-f25dba4670ae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1823 microversion: 2.32 time: 0.703285 Nov 27 20:59:03.028327 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1944/4037] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:02 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1823 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:59:03.038491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fdd6b4d-4265-46b7-a2b3-5ca369bf1d41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:03.046112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1fdd6b4d-4265-46b7-a2b3-5ca369bf1d41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:03.064409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b4d-4265-46b7-a2b3-5ca369bf1d41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:03.066204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b4d-4265-46b7-a2b3-5ca369bf1d41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:03.067285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b4d-4265-46b7-a2b3-5ca369bf1d41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:03.069632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdd6b4d-4265-46b7-a2b3-5ca369bf1d41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:03.150711 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1fdd6b4d-4265-46b7-a2b3-5ca369bf1d41 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.116292 Nov 27 20:59:03.157293 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1945/4038] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:03 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:03.193681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:03.209905 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2647246f-e101-4edb-9870-bfbfdfa9c45a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.677623 Nov 27 20:59:03.213092 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2094/4039] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:02 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:03.317316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f5044e4-2319-4a75-9f15-ccafa985b669 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:03.318767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f5044e4-2319-4a75-9f15-ccafa985b669 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:03.336237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f5044e4-2319-4a75-9f15-ccafa985b669 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:03.336930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f5044e4-2319-4a75-9f15-ccafa985b669 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:03.338059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f5044e4-2319-4a75-9f15-ccafa985b669 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:03.338859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f5044e4-2319-4a75-9f15-ccafa985b669 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:03.419580 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f5044e4-2319-4a75-9f15-ccafa985b669 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.106672 Nov 27 20:59:03.438728 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1946/4040] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:03 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:03.508451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:03.509063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:03.517616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:03.518062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:03.518914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:03.526173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.052229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:04.056532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:04.060190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:04.068931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.069679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.070781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.071467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.081137 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a6080df7-1901-4e9c-88be-4168e633637b tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1667 microversion: 2.1 time: 0.575129 Nov 27 20:59:04.097436 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2095/4041] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:03 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1667 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:04.115605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-77e2d4c6-f550-4763-8970-ff5179e5c668 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:04.124386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-77e2d4c6-f550-4763-8970-ff5179e5c668 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:04.135837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77e2d4c6-f550-4763-8970-ff5179e5c668 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.136851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77e2d4c6-f550-4763-8970-ff5179e5c668 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.138274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77e2d4c6-f550-4763-8970-ff5179e5c668 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.139754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77e2d4c6-f550-4763-8970-ff5179e5c668 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.234030 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-77e2d4c6-f550-4763-8970-ff5179e5c668 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c/ips" status: 200 len: 178 microversion: 2.1 time: 0.134855 Nov 27 20:59:04.246770 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2096/4042] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 20:59:04 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c/ips => generated 178 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:04.256337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-56f22b53-1160-4bcd-8e6b-f01cd4bd0290 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:04.258997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56f22b53-1160-4bcd-8e6b-f01cd4bd0290 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:04.271115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56f22b53-1160-4bcd-8e6b-f01cd4bd0290 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.272451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56f22b53-1160-4bcd-8e6b-f01cd4bd0290 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.275898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56f22b53-1160-4bcd-8e6b-f01cd4bd0290 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.276171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56f22b53-1160-4bcd-8e6b-f01cd4bd0290 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.358303 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-56f22b53-1160-4bcd-8e6b-f01cd4bd0290 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.109790 Nov 27 20:59:04.359709 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2097/4043] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:04 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:04.368672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:04.371485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:04.388296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.389327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.390452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.391100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.743793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:04.758926 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1bdb9ae-23de-4e72-aea5-93f6e07a022d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.397418 Nov 27 20:59:04.761718 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2098/4044] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:04 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:04.777092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:04.778051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:04.795824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.797722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.800415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:04.801688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:04.869434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:59:04.946867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:04.970934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:04.976827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:04.979920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f22469b0-cfad-43cb-b227-6b1e7e58faca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1802 microversion: 2.32 time: 0.933011 Nov 27 20:59:04.982246 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1947/4045] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:04 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1802 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:04.988455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-283066e1-32be-40af-ac9b-db7706afcd4a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:04.989965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-283066e1-32be-40af-ac9b-db7706afcd4a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:05.002064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283066e1-32be-40af-ac9b-db7706afcd4a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.002873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283066e1-32be-40af-ac9b-db7706afcd4a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:05.004776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283066e1-32be-40af-ac9b-db7706afcd4a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.005560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-283066e1-32be-40af-ac9b-db7706afcd4a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:05.100099 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-283066e1-32be-40af-ac9b-db7706afcd4a tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.116133 Nov 27 20:59:05.104516 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1948/4046] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:04 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:05.117911 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9d7f79df-1845-40d3-ab0d-934e9e59ae77 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 204 len: 0 microversion: 2.1 time: 0.346815 Nov 27 20:59:05.122505 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2099/4047] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:59:04 2021] DELETE /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:05.133716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:05.134465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:05.150152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.150627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:05.151464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.151910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:05.372628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-232f330b-ac3d-471b-b091-59dbdcebfa07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:05.373996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-232f330b-ac3d-471b-b091-59dbdcebfa07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:05.389506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232f330b-ac3d-471b-b091-59dbdcebfa07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.393454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232f330b-ac3d-471b-b091-59dbdcebfa07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:05.397098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232f330b-ac3d-471b-b091-59dbdcebfa07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.401081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-232f330b-ac3d-471b-b091-59dbdcebfa07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:05.530416 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-232f330b-ac3d-471b-b091-59dbdcebfa07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.163306 Nov 27 20:59:05.535450 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2100/4048] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:05 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:05.779417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:05.780324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:05.795799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.800375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:05.802105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:05.802574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.114368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:06.136413 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ff3cade-e808-4544-b8f7-f64a5d936347 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1673 microversion: 2.1 time: 1.007691 Nov 27 20:59:06.149225 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1949/4049] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:05 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1673 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:06.156461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:06.157798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:06.180580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:06.181594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.184790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:06.185640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.532157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:06.555595 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4d709fc-d8a8-41aa-8349-849fb77220b2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.770258 Nov 27 20:59:06.556674 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2101/4050] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:05 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:06.568651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4994fc9c-2c25-4419-8400-24b01073cc11 req-ba309ad9-d87b-4bdb-b2eb-21f7c6926dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "6632957c-feee-4506-8295-b419d941abe2"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:06.572907 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:06.572907 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:06.598719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4994fc9c-2c25-4419-8400-24b01073cc11 req-ba309ad9-d87b-4bdb-b2eb-21f7c6926dd0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:06.599879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4994fc9c-2c25-4419-8400-24b01073cc11 req-ba309ad9-d87b-4bdb-b2eb-21f7c6926dd0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.629824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_external_events [req-4994fc9c-2c25-4419-8400-24b01073cc11 req-ba309ad9-d87b-4bdb-b2eb-21f7c6926dd0 service nova] Unable to find a host for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30. Dropping event network-vif-deleted {{(pid=135680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 20:59:06.632147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4994fc9c-2c25-4419-8400-24b01073cc11 req-ba309ad9-d87b-4bdb-b2eb-21f7c6926dd0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.070722 Nov 27 20:59:06.633011 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2102/4051] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:06 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 20:59:06.638597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b24636c-3592-4094-b8ca-a80a32486d30 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:06.639893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b24636c-3592-4094-b8ca-a80a32486d30 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:06.649592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b24636c-3592-4094-b8ca-a80a32486d30 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:06.650342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b24636c-3592-4094-b8ca-a80a32486d30 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.651693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b24636c-3592-4094-b8ca-a80a32486d30 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:06.652711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b24636c-3592-4094-b8ca-a80a32486d30 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.711127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b24636c-3592-4094-b8ca-a80a32486d30 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.076417 Nov 27 20:59:06.713066 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2103/4052] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:06 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:06.724807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51493dcb-fa24-4ef4-abf1-8994895707f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:06.726502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51493dcb-fa24-4ef4-abf1-8994895707f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:06.735797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51493dcb-fa24-4ef4-abf1-8994895707f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:06.737472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51493dcb-fa24-4ef4-abf1-8994895707f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.741068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51493dcb-fa24-4ef4-abf1-8994895707f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:06.742071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51493dcb-fa24-4ef4-abf1-8994895707f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:06.759137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:06.773071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:06.779559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:06.781145 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d234145-2e28-4c16-bf15-b5038ad77b91 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1734 microversion: 2.32 time: 0.630083 Nov 27 20:59:06.781909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1950/4053] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:06 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1734 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:06.809074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51493dcb-fa24-4ef4-abf1-8994895707f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.093963 Nov 27 20:59:06.811077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2104/4054] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:06 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:07.156302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:07.157135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:07.166639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.177249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:07.178295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.179062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:07.584748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:07.586055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:07.615208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.616851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:07.619289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.620798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:07.790586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:07.804913 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-020fdbd3-a2d2-46f4-8754-ef58afc2baad tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1673 microversion: 2.1 time: 0.653538 Nov 27 20:59:07.805574 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1951/4055] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:07 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1673 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:07.826576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f5511a6-9d16-4ca4-a9af-4c4f1a395227 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:07.828156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f5511a6-9d16-4ca4-a9af-4c4f1a395227 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:07.836032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5511a6-9d16-4ca4-a9af-4c4f1a395227 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.836744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5511a6-9d16-4ca4-a9af-4c4f1a395227 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:07.837798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5511a6-9d16-4ca4-a9af-4c4f1a395227 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.838417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5511a6-9d16-4ca4-a9af-4c4f1a395227 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:07.932406 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f5511a6-9d16-4ca4-a9af-4c4f1a395227 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.113408 Nov 27 20:59:07.937841 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1952/4056] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:07 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:07.948228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:07.949545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:07.961401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.962848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:07.964276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:07.964887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:08.399687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:08.412934 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e0a071a-f9ba-4217-8d20-e5e8662e3743 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.835100 Nov 27 20:59:08.414838 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2105/4057] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:07 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:08.426601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f43fbd6-3289-48ee-b97a-f1fe040f5931 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:08.428038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f43fbd6-3289-48ee-b97a-f1fe040f5931 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:08.450824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f43fbd6-3289-48ee-b97a-f1fe040f5931 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:08.452802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f43fbd6-3289-48ee-b97a-f1fe040f5931 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:08.455623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f43fbd6-3289-48ee-b97a-f1fe040f5931 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:08.459654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f43fbd6-3289-48ee-b97a-f1fe040f5931 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:08.559394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f43fbd6-3289-48ee-b97a-f1fe040f5931 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.141184 Nov 27 20:59:08.565388 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2106/4058] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:08 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:08.823480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:08.824382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:08.844809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:08.846441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:08.851843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:08.852524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.376297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:09.395952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:09.398022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:09.402003 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87394a8b-aba3-406c-a052-2d090cf85422 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1734 microversion: 2.32 time: 1.462195 Nov 27 20:59:09.419617 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1953/4059] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:07 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1734 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:09.430637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-928a4ccd-3212-4ed5-b44c-ac8cb414f381 req-86e8e59d-2f75-4dd2-ad8c-5bc0d3821cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "2d0104dc-e751-4773-8bd9-f4d85f534f51"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:09.435521 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:09.435521 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:09.461731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-928a4ccd-3212-4ed5-b44c-ac8cb414f381 req-86e8e59d-2f75-4dd2-ad8c-5bc0d3821cb4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.464461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-928a4ccd-3212-4ed5-b44c-ac8cb414f381 req-86e8e59d-2f75-4dd2-ad8c-5bc0d3821cb4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.469471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:09.481535 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b57761b7-17b7-4a08-a8f2-06c3e3b3201c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1673 microversion: 2.1 time: 0.662612 Nov 27 20:59:09.482221 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2107/4060] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:08 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1673 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:09.496429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f5ea71f-47f5-4b22-8c10-fc0bcc006bbe tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:09.504616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f5ea71f-47f5-4b22-8c10-fc0bcc006bbe tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:09.513869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_external_events [req-928a4ccd-3212-4ed5-b44c-ac8cb414f381 req-86e8e59d-2f75-4dd2-ad8c-5bc0d3821cb4 service nova] Unable to find a host for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30. Dropping event network-vif-deleted {{(pid=135679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 20:59:09.515744 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-928a4ccd-3212-4ed5-b44c-ac8cb414f381 req-86e8e59d-2f75-4dd2-ad8c-5bc0d3821cb4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.094633 Nov 27 20:59:09.521261 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1954/4061] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:09 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 20:59:09.533412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:09.535814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f5ea71f-47f5-4b22-8c10-fc0bcc006bbe tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.537837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f5ea71f-47f5-4b22-8c10-fc0bcc006bbe tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.537993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:09.539762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f5ea71f-47f5-4b22-8c10-fc0bcc006bbe tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.541013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f5ea71f-47f5-4b22-8c10-fc0bcc006bbe tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.569335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.572187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.575172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.576025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.654500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f5ea71f-47f5-4b22-8c10-fc0bcc006bbe tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.160266 Nov 27 20:59:09.657470 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2108/4062] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:09 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:09.672263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9d965c49-0629-49e0-8196-bf488f371bb1 req-5c35a074-ac6e-4625-a9ab-af7ca79bd93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6332f8-a023-486b-8c76-12bd63305e2c", "name": "network-vif-deleted", "tag": "0a44e963-93ea-488c-8fe6-c7ee1dfe6c0e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:09.677147 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:09.677147 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:09.698189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9d965c49-0629-49e0-8196-bf488f371bb1 req-5c35a074-ac6e-4625-a9ab-af7ca79bd93a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.699022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9d965c49-0629-49e0-8196-bf488f371bb1 req-5c35a074-ac6e-4625-a9ab-af7ca79bd93a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.730427 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9d965c49-0629-49e0-8196-bf488f371bb1 req-5c35a074-ac6e-4625-a9ab-af7ca79bd93a service nova] Creating event network-vif-deleted:0a44e963-93ea-488c-8fe6-c7ee1dfe6c0e for instance ac6332f8-a023-486b-8c76-12bd63305e2c on nch1-master-1 Nov 27 20:59:09.744692 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9d965c49-0629-49e0-8196-bf488f371bb1 req-5c35a074-ac6e-4625-a9ab-af7ca79bd93a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085271 Nov 27 20:59:09.746169 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2109/4063] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:09.756501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fef2535-ad6f-4147-96b2-ed622f2d13ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:09.758241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fef2535-ad6f-4147-96b2-ed622f2d13ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:09.774840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef2535-ad6f-4147-96b2-ed622f2d13ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.780463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef2535-ad6f-4147-96b2-ed622f2d13ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.781737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef2535-ad6f-4147-96b2-ed622f2d13ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:09.782348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef2535-ad6f-4147-96b2-ed622f2d13ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:09.857336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fef2535-ad6f-4147-96b2-ed622f2d13ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.109053 Nov 27 20:59:09.858624 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2110/4064] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:09 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:10.410909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:10.424420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:10.425392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:10.429655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7a1236c5-545b-480d-9dc7-a2fa2cb42b49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.906879 Nov 27 20:59:10.450250 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1955/4065] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:09 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:10.453211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:10.453995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:10.454969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:10.465070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:10.498211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:10.499072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:10.514182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:10.514934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:10.516062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:10.521220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:10.951069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:10.966204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9cbbe78-85a9-4a49-86ef-19f95948e3ca tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1496 microversion: 2.1 time: 0.471964 Nov 27 20:59:10.967559 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1956/4066] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:10 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1496 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:10.979299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b180ff12-a0b2-48a8-ba06-71e6cb9f9aa3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:10.980847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b180ff12-a0b2-48a8-ba06-71e6cb9f9aa3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:11.003037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b180ff12-a0b2-48a8-ba06-71e6cb9f9aa3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:11.003970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b180ff12-a0b2-48a8-ba06-71e6cb9f9aa3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:11.005105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b180ff12-a0b2-48a8-ba06-71e6cb9f9aa3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:11.005708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b180ff12-a0b2-48a8-ba06-71e6cb9f9aa3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:11.048097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:11.101206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:11.112771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:11.123629 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-91b269b8-97f8-4604-b6ce-8c03e55e2ee6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1640 microversion: 2.32 time: 0.700120 Nov 27 20:59:11.128709 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2111/4067] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:10 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1640 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:11.139598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f96ab05c-a38a-4818-b41d-ad687e910f6e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:11.145126 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b180ff12-a0b2-48a8-ba06-71e6cb9f9aa3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.175814 Nov 27 20:59:11.145817 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1957/4068] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:10 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:11.147730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f96ab05c-a38a-4818-b41d-ad687e910f6e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:11.162931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96ab05c-a38a-4818-b41d-ad687e910f6e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:11.163724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96ab05c-a38a-4818-b41d-ad687e910f6e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:11.165139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96ab05c-a38a-4818-b41d-ad687e910f6e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:11.165933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f96ab05c-a38a-4818-b41d-ad687e910f6e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:11.256257 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f96ab05c-a38a-4818-b41d-ad687e910f6e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.123461 Nov 27 20:59:11.257995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2112/4069] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:11 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:11.458125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:11.458720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:11.480888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:11.482393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:11.487338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:11.490476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:11.734208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f5e5de21-f13d-4569-9a53-70f94c60e6a6 req-b325ed33-ebb9-4973-a8e4-2279273d796b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "e6b41390-a8e1-44f3-b5dd-7e6b200fe288"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:11.735996 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:11.735996 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:11.756716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f5e5de21-f13d-4569-9a53-70f94c60e6a6 req-b325ed33-ebb9-4973-a8e4-2279273d796b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:11.757180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f5e5de21-f13d-4569-9a53-70f94c60e6a6 req-b325ed33-ebb9-4973-a8e4-2279273d796b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:11.791294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_external_events [req-f5e5de21-f13d-4569-9a53-70f94c60e6a6 req-b325ed33-ebb9-4973-a8e4-2279273d796b service nova] Unable to find a host for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30. Dropping event network-vif-deleted {{(pid=135680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 20:59:11.796432 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f5e5de21-f13d-4569-9a53-70f94c60e6a6 req-b325ed33-ebb9-4973-a8e4-2279273d796b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.064982 Nov 27 20:59:11.797885 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2113/4070] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:11 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 27 20:59:11.987982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:11.989604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:12.010383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.015106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.018683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.020250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.226999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:12.242450 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5d51966-20e7-4b77-9e66-f45d5652907f tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1454 microversion: 2.1 time: 0.262102 Nov 27 20:59:12.247478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2114/4071] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:11 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:12.262937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:12.272460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:12.293523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.293981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.294781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.295226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.450130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:12.459618 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f48ab831-3496-490a-a9f7-e907a78213e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 1.006006 Nov 27 20:59:12.460274 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1958/4072] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:11 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:12.480551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-538384c5-6b2f-45ef-906f-65cef6ef8583 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:12.481516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-538384c5-6b2f-45ef-906f-65cef6ef8583 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:12.516543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538384c5-6b2f-45ef-906f-65cef6ef8583 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.519359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538384c5-6b2f-45ef-906f-65cef6ef8583 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.525583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538384c5-6b2f-45ef-906f-65cef6ef8583 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.525973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538384c5-6b2f-45ef-906f-65cef6ef8583 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.618155 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-538384c5-6b2f-45ef-906f-65cef6ef8583 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.148882 Nov 27 20:59:12.618836 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1959/4073] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:12 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:12.631412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2da40fb6-47ec-42c4-91d6-4080cc19cd33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:12.635844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2da40fb6-47ec-42c4-91d6-4080cc19cd33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:12.647994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2da40fb6-47ec-42c4-91d6-4080cc19cd33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.651635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2da40fb6-47ec-42c4-91d6-4080cc19cd33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.656390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2da40fb6-47ec-42c4-91d6-4080cc19cd33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.659166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2da40fb6-47ec-42c4-91d6-4080cc19cd33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.769273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2da40fb6-47ec-42c4-91d6-4080cc19cd33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.144074 Nov 27 20:59:12.771529 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1960/4074] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:12 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:12.787213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-75b43a5b-ac4f-4913-8119-b554ff1878e2 req-01c71349-1393-4f48-a4ea-e542a700ba11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac6332f8-a023-486b-8c76-12bd63305e2c", "name": "network-vif-deleted", "tag": "1411e0e1-0ec8-4aa3-a13d-a478737b482d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:12.792100 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:12.792100 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:12.817012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-75b43a5b-ac4f-4913-8119-b554ff1878e2 req-01c71349-1393-4f48-a4ea-e542a700ba11 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:12.822394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-75b43a5b-ac4f-4913-8119-b554ff1878e2 req-01c71349-1393-4f48-a4ea-e542a700ba11 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:12.849374 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-75b43a5b-ac4f-4913-8119-b554ff1878e2 req-01c71349-1393-4f48-a4ea-e542a700ba11 service nova] Creating event network-vif-deleted:1411e0e1-0ec8-4aa3-a13d-a478737b482d for instance ac6332f8-a023-486b-8c76-12bd63305e2c on nch1-master-1 Nov 27 20:59:12.869949 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-75b43a5b-ac4f-4913-8119-b554ff1878e2 req-01c71349-1393-4f48-a4ea-e542a700ba11 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096736 Nov 27 20:59:12.873509 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1961/4075] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:13.129063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:13.165176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:13.171170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:13.172424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17dd99ee-93c7-417e-a148-10a200a408ee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1593 microversion: 2.32 time: 0.923691 Nov 27 20:59:13.190225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2115/4076] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:12 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1593 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:13.263336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:13.264308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:13.279660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.287370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.288338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.296650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.398575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.403327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.405497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lazy-loading 'fault' on Instance uuid ac6332f8-a023-486b-8c76-12bd63305e2c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 20:59:13.476676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb012478bf740468bba9fa762ac06ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d16fd50eb2412992297f88bb1d4580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:13.478035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:13.478758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:13.484553 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d62cbe9b-8c7f-4d02-b787-58d8711daa6d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 200 len: 1302 microversion: 2.1 time: 0.225997 Nov 27 20:59:13.494696 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1962/4077] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:13 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 1302 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:13.494926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.494926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.494926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.494926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.633001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9db8d887-b9ae-448e-be97-c317bfa00e37 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:13.634766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9db8d887-b9ae-448e-be97-c317bfa00e37 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:13.653767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db8d887-b9ae-448e-be97-c317bfa00e37 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.657635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db8d887-b9ae-448e-be97-c317bfa00e37 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.659016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db8d887-b9ae-448e-be97-c317bfa00e37 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.662865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9db8d887-b9ae-448e-be97-c317bfa00e37 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.777678 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9db8d887-b9ae-448e-be97-c317bfa00e37 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.150233 Nov 27 20:59:13.781588 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1963/4078] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:13 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:59:13.799583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b1f0daa-584e-47d5-b9b8-7b9561b99920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:13.804852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b1f0daa-584e-47d5-b9b8-7b9561b99920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:13.823382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b1f0daa-584e-47d5-b9b8-7b9561b99920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.825155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b1f0daa-584e-47d5-b9b8-7b9561b99920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.826244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b1f0daa-584e-47d5-b9b8-7b9561b99920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:13.829602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b1f0daa-584e-47d5-b9b8-7b9561b99920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:13.968228 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b1f0daa-584e-47d5-b9b8-7b9561b99920 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.184646 Nov 27 20:59:13.973190 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1964/4079] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:13 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:13.977606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-53b25759-b43d-4697-81ae-af2e1097f57a req-b4d88bf9-faa0-44be-8b33-beb74711f699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "dab5072e-30d9-4a47-ba0e-926f7a2917e3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:13.983682 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:13.983682 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:14.018847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-53b25759-b43d-4697-81ae-af2e1097f57a req-b4d88bf9-faa0-44be-8b33-beb74711f699 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:14.019871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-53b25759-b43d-4697-81ae-af2e1097f57a req-b4d88bf9-faa0-44be-8b33-beb74711f699 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:14.047138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_external_events [req-53b25759-b43d-4697-81ae-af2e1097f57a req-b4d88bf9-faa0-44be-8b33-beb74711f699 service nova] Unable to find a host for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30. Dropping event network-vif-deleted {{(pid=135679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 20:59:14.048587 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-53b25759-b43d-4697-81ae-af2e1097f57a req-b4d88bf9-faa0-44be-8b33-beb74711f699 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.078007 Nov 27 20:59:14.052094 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1965/4080] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:13 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 20:59:14.116588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:14.129065 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d2558d1-d85b-41fd-b6e3-563a6e0b3e4e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.652969 Nov 27 20:59:14.130993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2116/4081] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:13 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:14.192908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:14.193968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:14.205583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:14.206500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:14.216944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:14.217682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:14.503783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:14.504410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:14.519921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:14.522480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:14.523795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:14.526812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:14.577492 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] HTTP exception thrown: Instance ac6332f8-a023-486b-8c76-12bd63305e2c could not be found. Nov 27 20:59:14.578390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Returning 404 to user: Instance ac6332f8-a023-486b-8c76-12bd63305e2c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:59:14.581657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0f07a0a5-2b22-405e-9669-436d46a90a75 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 404 len: 111 microversion: 2.1 time: 0.083115 Nov 27 20:59:14.587213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2117/4082] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:14 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:14.609028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:14.626676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:14.628989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:14.630433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-69351d4d-96a3-4430-84f4-5b68b4a6a8df tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1525 microversion: 2.32 time: 0.441778 Nov 27 20:59:14.635682 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1966/4083] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:14 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1525 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:14.790331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ee44d56-5a90-4ece-a135-b811ab25c1fc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:14.791290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ee44d56-5a90-4ece-a135-b811ab25c1fc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:14.806213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ee44d56-5a90-4ece-a135-b811ab25c1fc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:14.806738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ee44d56-5a90-4ece-a135-b811ab25c1fc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:14.807611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ee44d56-5a90-4ece-a135-b811ab25c1fc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:14.808053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ee44d56-5a90-4ece-a135-b811ab25c1fc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:14.897429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ee44d56-5a90-4ece-a135-b811ab25c1fc tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.109564 Nov 27 20:59:14.905369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2118/4084] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:14 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:14.982243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d65bca1-d2e0-48d7-868e-3ad57c7b9a3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:14.984081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d65bca1-d2e0-48d7-868e-3ad57c7b9a3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:15.019299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d65bca1-d2e0-48d7-868e-3ad57c7b9a3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.020521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d65bca1-d2e0-48d7-868e-3ad57c7b9a3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.027841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d65bca1-d2e0-48d7-868e-3ad57c7b9a3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.032214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d65bca1-d2e0-48d7-868e-3ad57c7b9a3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.110510 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d65bca1-d2e0-48d7-868e-3ad57c7b9a3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.133395 Nov 27 20:59:15.112689 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1967/4085] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:14 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:15.147931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:15.148559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:15.164097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.166395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.168034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.169614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.581456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:15.591311 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19443b70-26ec-480d-b1fb-f1107c844701 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.448125 Nov 27 20:59:15.608807 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2119/4086] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:15 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:15.654648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:15.656129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:15.678982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.679968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.681040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.681709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.915021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:15.920270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25d993b1-f2d9-430c-843d-2be64dec1ef3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:15.922670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-25d993b1-f2d9-430c-843d-2be64dec1ef3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:15.960878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d993b1-f2d9-430c-843d-2be64dec1ef3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.967540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d993b1-f2d9-430c-843d-2be64dec1ef3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.971538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:15.975422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d993b1-f2d9-430c-843d-2be64dec1ef3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:15.982334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:15.983334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d993b1-f2d9-430c-843d-2be64dec1ef3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:15.995648 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1df8f7df-c68e-4f1b-a9ff-b5d8d73b93ac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1527 microversion: 2.32 time: 0.342076 Nov 27 20:59:16.013739 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1968/4087] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:15 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1527 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:16.088581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1e3de793-6acf-428f-a394-a3392c91ca1b req-8f502ac1-a55b-4af4-9bbc-83e9eb0ffa65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "a5c35030-3d16-480b-990d-350880945284"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:16.091040 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:16.091040 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:16.118641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1e3de793-6acf-428f-a394-a3392c91ca1b req-8f502ac1-a55b-4af4-9bbc-83e9eb0ffa65 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:16.119630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1e3de793-6acf-428f-a394-a3392c91ca1b req-8f502ac1-a55b-4af4-9bbc-83e9eb0ffa65 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:16.143959 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25d993b1-f2d9-430c-843d-2be64dec1ef3 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.235179 Nov 27 20:59:16.161256 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2120/4088] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:15 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:16.179267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1e3de793-6acf-428f-a394-a3392c91ca1b req-8f502ac1-a55b-4af4-9bbc-83e9eb0ffa65 service nova] Creating event network-vif-deleted:a5c35030-3d16-480b-990d-350880945284 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:16.187449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59c8767c-4914-4ee7-a33b-230720614bee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:16.190052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59c8767c-4914-4ee7-a33b-230720614bee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:16.201156 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1e3de793-6acf-428f-a394-a3392c91ca1b req-8f502ac1-a55b-4af4-9bbc-83e9eb0ffa65 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117619 Nov 27 20:59:16.205170 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1969/4089] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:16.208052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59c8767c-4914-4ee7-a33b-230720614bee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:16.211287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59c8767c-4914-4ee7-a33b-230720614bee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:16.212862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59c8767c-4914-4ee7-a33b-230720614bee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:16.214143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59c8767c-4914-4ee7-a33b-230720614bee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:16.305937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59c8767c-4914-4ee7-a33b-230720614bee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.139314 Nov 27 20:59:16.309683 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2121/4090] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:16 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:16.624788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:16.625866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:16.641315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:16.642227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:16.643328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:16.646524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:17.023838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:17.025859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:17.052461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:17.053844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:17.057102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:17.059735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:17.234497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:17.256558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:17.262637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:17.264714 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0dcbf071-4a6c-48e0-b366-06e9c92d54ca tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1593 microversion: 2.32 time: 0.247396 Nov 27 20:59:17.269255 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2122/4091] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:17 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1593 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:17.275718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80a82118-484d-402d-b1af-293e8250aacd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:17.276641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80a82118-484d-402d-b1af-293e8250aacd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:17.294992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80a82118-484d-402d-b1af-293e8250aacd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:17.296217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80a82118-484d-402d-b1af-293e8250aacd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:17.297368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80a82118-484d-402d-b1af-293e8250aacd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:17.297970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80a82118-484d-402d-b1af-293e8250aacd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:17.376361 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80a82118-484d-402d-b1af-293e8250aacd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.105251 Nov 27 20:59:17.382331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2123/4092] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:17 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:17.390775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f164014b-cf3c-4e88-8186-059f4fef1c86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:17.393336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f164014b-cf3c-4e88-8186-059f4fef1c86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:17.412860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f164014b-cf3c-4e88-8186-059f4fef1c86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:17.414518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f164014b-cf3c-4e88-8186-059f4fef1c86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:17.416400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f164014b-cf3c-4e88-8186-059f4fef1c86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:17.418956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f164014b-cf3c-4e88-8186-059f4fef1c86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:17.545564 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f164014b-cf3c-4e88-8186-059f4fef1c86 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.160465 Nov 27 20:59:17.566930 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2124/4093] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:17 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:18.174578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:18.202770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02ef988e-aac2-4a65-bfeb-2e7a6f68a786 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 1.588306 Nov 27 20:59:18.211928 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1970/4094] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:16 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:18.287963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:18.288720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:18.302472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:18.305106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:18.308018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:18.310530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:18.390008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ba9db475-f360-4360-9eef-71824a99de24 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:18.391176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ba9db475-f360-4360-9eef-71824a99de24 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:18.407218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba9db475-f360-4360-9eef-71824a99de24 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:18.407718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba9db475-f360-4360-9eef-71824a99de24 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:18.430685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba9db475-f360-4360-9eef-71824a99de24 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:18.432640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ba9db475-f360-4360-9eef-71824a99de24 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:18.501837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:18.520833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:18.525289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:18.526489 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-478cd353-672b-4965-a555-d30e00f45a99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1593 microversion: 2.32 time: 0.243190 Nov 27 20:59:18.527049 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2125/4095] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:18 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1593 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:18.531750 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ba9db475-f360-4360-9eef-71824a99de24 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.145910 Nov 27 20:59:18.532760 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1971/4096] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:18 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:59:18.566188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e24ae4e-da05-4993-ae6a-8e57e2bbf323 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:18.569740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e24ae4e-da05-4993-ae6a-8e57e2bbf323 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:18.582226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e24ae4e-da05-4993-ae6a-8e57e2bbf323 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:18.585855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e24ae4e-da05-4993-ae6a-8e57e2bbf323 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:18.586847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e24ae4e-da05-4993-ae6a-8e57e2bbf323 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:18.592469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e24ae4e-da05-4993-ae6a-8e57e2bbf323 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:18.670109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e24ae4e-da05-4993-ae6a-8e57e2bbf323 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.106973 Nov 27 20:59:18.671411 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1972/4097] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:18 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:19.228466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:19.229695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:19.238776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.241123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.243492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.243492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.547870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87817004-5e91-4343-8e3e-897acab766a9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:19.551768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87817004-5e91-4343-8e3e-897acab766a9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:19.575766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87817004-5e91-4343-8e3e-897acab766a9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.577868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87817004-5e91-4343-8e3e-897acab766a9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.580599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87817004-5e91-4343-8e3e-897acab766a9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.582167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87817004-5e91-4343-8e3e-897acab766a9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.683786 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87817004-5e91-4343-8e3e-897acab766a9 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.143413 Nov 27 20:59:19.689095 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1973/4098] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:19 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:59:19.697381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:19.700379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:19.718146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.718955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.722370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.723049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.792691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:19.800337 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c90dd72-a98c-4e7e-9eb3-afcd1b7dead7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1525 microversion: 2.1 time: 0.575841 Nov 27 20:59:19.803908 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2126/4099] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:19 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1525 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:19.817523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-210fc7c1-6270-44bf-9cca-958bd9751ccb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:19.818683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-210fc7c1-6270-44bf-9cca-958bd9751ccb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:19.830689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-210fc7c1-6270-44bf-9cca-958bd9751ccb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.832211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-210fc7c1-6270-44bf-9cca-958bd9751ccb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.838186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-210fc7c1-6270-44bf-9cca-958bd9751ccb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:19.838903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-210fc7c1-6270-44bf-9cca-958bd9751ccb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:19.917368 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-210fc7c1-6270-44bf-9cca-958bd9751ccb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.111872 Nov 27 20:59:19.918027 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2127/4100] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:19 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:20.068612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:20.092537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:20.101911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:20.109760 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73f479b8-5427-4c2a-a1c6-86d142859762 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1593 microversion: 2.32 time: 0.414866 Nov 27 20:59:20.111573 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1974/4101] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:19 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1593 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:20.474691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:20.475199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:20.488679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.489496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.490456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.494444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.513717 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] HTTP exception thrown: Instance ac6332f8-a023-486b-8c76-12bd63305e2c could not be found. Nov 27 20:59:20.514142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Returning 404 to user: Instance ac6332f8-a023-486b-8c76-12bd63305e2c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:59:20.515241 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2915b680-e438-404a-8110-995cca6ff6a8 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 404 len: 111 microversion: 2.1 time: 0.046139 Nov 27 20:59:20.516723 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2128/4102] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:59:20 2021] DELETE /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:20.526436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:20.527365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: ac6332f8-a023-486b-8c76-12bd63305e2c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:20.535893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.536544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.537492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.538087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.556900 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] HTTP exception thrown: Instance ac6332f8-a023-486b-8c76-12bd63305e2c could not be found. Nov 27 20:59:20.558752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Returning 404 to user: Instance ac6332f8-a023-486b-8c76-12bd63305e2c could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:59:20.560681 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c26bddcb-9daf-47d9-a9aa-faddf1288da4 tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c" status: 404 len: 111 microversion: 2.1 time: 0.039030 Nov 27 20:59:20.561247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1975/4103] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:20 2021] GET /compute/v2.1/servers/ac6332f8-a023-486b-8c76-12bd63305e2c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:20.571742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:20.572680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:20.580970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.584652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.584652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.584652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.601716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] HTTP exception thrown: Instance efc94c1a-9572-43c0-9a19-4ccded66857f could not be found. Nov 27 20:59:20.602313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Returning 404 to user: Instance efc94c1a-9572-43c0-9a19-4ccded66857f could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:59:20.603345 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9bcab126-2b0d-413c-b940-2e95ad23cb1c tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "DELETE /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 404 len: 111 microversion: 2.1 time: 0.037662 Nov 27 20:59:20.604287 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2129/4104] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:59:20 2021] DELETE /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:20.611764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:20.612520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] [instance: efc94c1a-9572-43c0-9a19-4ccded66857f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:20.620039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.620606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.621495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.622366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.651809 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] HTTP exception thrown: Instance efc94c1a-9572-43c0-9a19-4ccded66857f could not be found. Nov 27 20:59:20.653472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] Returning 404 to user: Instance efc94c1a-9572-43c0-9a19-4ccded66857f could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:59:20.654334 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64abfd22-888c-4ecc-93ad-25d7b2e5286d tempest-ServersTestMultiNic-598324236 tempest-ServersTestMultiNic-598324236-project] 10.222.0.21 "GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f" status: 404 len: 111 microversion: 2.1 time: 0.046317 Nov 27 20:59:20.658015 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1976/4105] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:20 2021] GET /compute/v2.1/servers/efc94c1a-9572-43c0-9a19-4ccded66857f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:20.696179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec31c60c-279e-4dbb-b892-ea2c0db1cb1f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:20.699032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ec31c60c-279e-4dbb-b892-ea2c0db1cb1f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:20.712294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec31c60c-279e-4dbb-b892-ea2c0db1cb1f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.721057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec31c60c-279e-4dbb-b892-ea2c0db1cb1f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.722346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec31c60c-279e-4dbb-b892-ea2c0db1cb1f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.723400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec31c60c-279e-4dbb-b892-ea2c0db1cb1f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.806475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec31c60c-279e-4dbb-b892-ea2c0db1cb1f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.113845 Nov 27 20:59:20.811137 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2130/4106] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:20 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:20.821539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:20.822245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:20.837975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.838914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.840244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.840921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.933460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a72ad6bd-9469-476d-82d9-8b469b5cdb23 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:20.934479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a72ad6bd-9469-476d-82d9-8b469b5cdb23 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:20.949643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72ad6bd-9469-476d-82d9-8b469b5cdb23 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.950094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72ad6bd-9469-476d-82d9-8b469b5cdb23 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:20.950896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72ad6bd-9469-476d-82d9-8b469b5cdb23 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:20.954973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a72ad6bd-9469-476d-82d9-8b469b5cdb23 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:21.032722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a72ad6bd-9469-476d-82d9-8b469b5cdb23 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.106377 Nov 27 20:59:21.033783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2131/4107] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:20 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:21.132991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:21.133902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:21.141339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:21.142036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:21.142989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:21.143710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:21.763148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:21.779067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:21.790007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:21.796475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5cf0e07f-f71e-439a-96e0-97685be58944 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1661 microversion: 2.32 time: 0.669620 Nov 27 20:59:21.802500 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2132/4108] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:21 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1661 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:59:21.823359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21a573ba-670e-48f7-9930-ead2d84f8f1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:21.828020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21a573ba-670e-48f7-9930-ead2d84f8f1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:21.842004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a573ba-670e-48f7-9930-ead2d84f8f1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:21.852604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a573ba-670e-48f7-9930-ead2d84f8f1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:21.856785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a573ba-670e-48f7-9930-ead2d84f8f1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:21.857249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a573ba-670e-48f7-9930-ead2d84f8f1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:21.902395 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21a573ba-670e-48f7-9930-ead2d84f8f1c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.087135 Nov 27 20:59:21.904233 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2133/4109] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:21 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:59:22.045345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7758918e-e37e-4625-be3f-708e7899a4ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:22.046651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7758918e-e37e-4625-be3f-708e7899a4ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:22.053882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7758918e-e37e-4625-be3f-708e7899a4ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:22.054673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7758918e-e37e-4625-be3f-708e7899a4ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:22.055476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7758918e-e37e-4625-be3f-708e7899a4ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:22.056167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7758918e-e37e-4625-be3f-708e7899a4ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:22.102830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7758918e-e37e-4625-be3f-708e7899a4ae tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.060720 Nov 27 20:59:22.103825 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2134/4110] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:22 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:22.156559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:22.169900 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1ec040be-2538-46af-bb3d-82d785eb9c58 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1507 microversion: 2.1 time: 1.348820 Nov 27 20:59:22.169900 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1977/4111] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:20 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1507 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:22.821923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:22.823508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:22.831870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:22.832596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:22.833705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:22.834309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:22.914675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9232580-07aa-4cab-bcbe-ab620c7033e7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:22.915808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9232580-07aa-4cab-bcbe-ab620c7033e7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:22.926908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9232580-07aa-4cab-bcbe-ab620c7033e7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:22.927828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9232580-07aa-4cab-bcbe-ab620c7033e7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:22.929541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9232580-07aa-4cab-bcbe-ab620c7033e7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:22.930854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9232580-07aa-4cab-bcbe-ab620c7033e7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:22.992485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9232580-07aa-4cab-bcbe-ab620c7033e7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.081871 Nov 27 20:59:22.994352 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1978/4112] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:22 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:23.117640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ce20879-5616-474d-bdf2-016207189b04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:23.118748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ce20879-5616-474d-bdf2-016207189b04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:23.136161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce20879-5616-474d-bdf2-016207189b04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:23.140743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce20879-5616-474d-bdf2-016207189b04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:23.142008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce20879-5616-474d-bdf2-016207189b04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:23.142599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce20879-5616-474d-bdf2-016207189b04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:23.240185 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ce20879-5616-474d-bdf2-016207189b04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.127431 Nov 27 20:59:23.248706 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1979/4113] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:23 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:23.259727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:23.261232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:23.271245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:23.271985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:23.272991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:23.273603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:23.428387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:23.456350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:23.458423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:23.461384 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f31f4f96-73b9-4ff4-8085-604fbc6482e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1696 microversion: 2.32 time: 0.645894 Nov 27 20:59:23.462209 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2135/4114] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:22 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1696 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:23.474130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2c466b9d-2317-4294-8c8f-3e1f6254060f req-00024dad-9807-4632-9938-64d78775ccb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a6bdc1-0d85-4563-8ef9-f6a0a17075a0", "name": "network-vif-unplugged", "status": "completed", "tag": "4ebac182-8a28-42f8-9b81-45a0a7ad3616"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:23.481519 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:23.481519 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:23.496304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2c466b9d-2317-4294-8c8f-3e1f6254060f req-00024dad-9807-4632-9938-64d78775ccb7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:23.498274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2c466b9d-2317-4294-8c8f-3e1f6254060f req-00024dad-9807-4632-9938-64d78775ccb7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:23.516579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2c466b9d-2317-4294-8c8f-3e1f6254060f req-00024dad-9807-4632-9938-64d78775ccb7 service nova] Creating event network-vif-unplugged:4ebac182-8a28-42f8-9b81-45a0a7ad3616 for instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 on nch1-master-1 Nov 27 20:59:23.525432 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2c466b9d-2317-4294-8c8f-3e1f6254060f req-00024dad-9807-4632-9938-64d78775ccb7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061696 Nov 27 20:59:23.526548 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2136/4115] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:23.758985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:23.782987 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-170ed0f5-1590-4650-a88b-d4301fb4e46f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1507 microversion: 2.1 time: 0.531521 Nov 27 20:59:23.784115 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1980/4116] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:23 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:24.006587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5426e0af-02df-4827-bde4-e799a0e9e7d8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:24.007627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5426e0af-02df-4827-bde4-e799a0e9e7d8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:24.018966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5426e0af-02df-4827-bde4-e799a0e9e7d8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.024297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5426e0af-02df-4827-bde4-e799a0e9e7d8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.027191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5426e0af-02df-4827-bde4-e799a0e9e7d8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.027862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5426e0af-02df-4827-bde4-e799a0e9e7d8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.118383 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5426e0af-02df-4827-bde4-e799a0e9e7d8 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.114937 Nov 27 20:59:24.121060 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2137/4117] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:24 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:24.255707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8d17e470-8add-48b3-a2c4-20bef8f657c5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:24.257948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8d17e470-8add-48b3-a2c4-20bef8f657c5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:24.270024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d17e470-8add-48b3-a2c4-20bef8f657c5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.270478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d17e470-8add-48b3-a2c4-20bef8f657c5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.271635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d17e470-8add-48b3-a2c4-20bef8f657c5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.272389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d17e470-8add-48b3-a2c4-20bef8f657c5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.344968 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8d17e470-8add-48b3-a2c4-20bef8f657c5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.093498 Nov 27 20:59:24.354437 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1981/4118] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:24 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:24.481915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:24.483145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:24.495883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.497732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.509295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.515099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.807554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:24.808265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:24.830459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.830953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.833167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:24.834246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:24.983829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:25.001118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:25.002784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:25.004980 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0086dbf3-fdfd-4adc-b96b-d9453cd17feb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1696 microversion: 2.32 time: 0.527501 Nov 27 20:59:25.016842 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2138/4119] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:24 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1696 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:25.130447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-539718ad-205f-4798-bfb9-3fab2f16fad7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:25.131679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-539718ad-205f-4798-bfb9-3fab2f16fad7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:25.143523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539718ad-205f-4798-bfb9-3fab2f16fad7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:25.144257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539718ad-205f-4798-bfb9-3fab2f16fad7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:25.147360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539718ad-205f-4798-bfb9-3fab2f16fad7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:25.148002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-539718ad-205f-4798-bfb9-3fab2f16fad7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:25.236409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-539718ad-205f-4798-bfb9-3fab2f16fad7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.110051 Nov 27 20:59:25.241658 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2139/4120] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:25 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:59:25.361578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d8aaab1-ebc9-4e3c-a3a6-62a8e9b42204 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:25.363531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d8aaab1-ebc9-4e3c-a3a6-62a8e9b42204 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:25.379008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8aaab1-ebc9-4e3c-a3a6-62a8e9b42204 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:25.381175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8aaab1-ebc9-4e3c-a3a6-62a8e9b42204 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:25.382835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8aaab1-ebc9-4e3c-a3a6-62a8e9b42204 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:25.383795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8aaab1-ebc9-4e3c-a3a6-62a8e9b42204 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:25.465682 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d8aaab1-ebc9-4e3c-a3a6-62a8e9b42204 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.109293 Nov 27 20:59:25.470176 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2140/4121] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:25 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:25.484288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:25.500941 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be28b161-05df-4679-b804-752eff831e60 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 200 len: 1450 microversion: 2.1 time: 0.697315 Nov 27 20:59:25.501528 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1982/4122] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:24 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 1450 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:25.523615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:25.524215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:25.538482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:25.543947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:25.546393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:25.548246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:25.612547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:59:25.621526 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.compute.api [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Working on deleting snapshot 818de2c5-6b85-447e-a23f-7725f517d358 from shelved instance... Nov 27 20:59:26.025662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:26.026224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:26.035578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:26.036044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:26.036854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:26.037353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:26.718828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:26.734280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:26.738972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:26.740263 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34397701-e32a-49ad-96ea-f254e315ce19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1743 microversion: 2.32 time: 0.718522 Nov 27 20:59:26.744013 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1983/4123] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:26 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1743 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:59:26.754861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-179bb307-f6c0-4025-a771-c83312acd8d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:26.759220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-179bb307-f6c0-4025-a771-c83312acd8d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:26.775513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179bb307-f6c0-4025-a771-c83312acd8d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:26.778821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179bb307-f6c0-4025-a771-c83312acd8d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:26.783273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179bb307-f6c0-4025-a771-c83312acd8d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:26.785388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-179bb307-f6c0-4025-a771-c83312acd8d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:26.859921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Doing local delete in cell fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=135680) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 27 20:59:26.861445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:26.867058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:26.867865 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.compute.api [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 27 20:59:26.873477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] deallocate_for_instance() {{(pid=135680) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 27 20:59:26.875728 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-179bb307-f6c0-4025-a771-c83312acd8d5 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.129031 Nov 27 20:59:26.877023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1984/4124] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:26 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:26.886724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-828ec6b8-1653-4a2b-b4c6-6b64e14c9db5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:26.888656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-828ec6b8-1653-4a2b-b4c6-6b64e14c9db5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:26.899415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ec6b8-1653-4a2b-b4c6-6b64e14c9db5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:26.900457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ec6b8-1653-4a2b-b4c6-6b64e14c9db5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:26.901908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ec6b8-1653-4a2b-b4c6-6b64e14c9db5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:26.902953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ec6b8-1653-4a2b-b4c6-6b64e14c9db5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:26.965874 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-828ec6b8-1653-4a2b-b4c6-6b64e14c9db5 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.085645 Nov 27 20:59:26.972139 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1985/4125] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:26 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:27.768305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:27.769591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:27.777829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:27.778301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:27.779208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:27.783613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.078361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Updating instance_info_cache with network_info: [] {{(pid=135680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 20:59:28.142929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:28.168466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:28.173913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:28.180760 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89305c5f-3c2b-4dd6-ab64-68ad482ae545 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1743 microversion: 2.32 time: 0.414490 Nov 27 20:59:28.201578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1986/4126] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:27 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1743 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:59:28.217005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29ba27e1-c860-4f29-adf2-0baaf2914d67 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:28.218444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29ba27e1-c860-4f29-adf2-0baaf2914d67 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:28.239600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29ba27e1-c860-4f29-adf2-0baaf2914d67 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:28.240470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29ba27e1-c860-4f29-adf2-0baaf2914d67 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.241653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29ba27e1-c860-4f29-adf2-0baaf2914d67 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:28.242295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29ba27e1-c860-4f29-adf2-0baaf2914d67 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.314414 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29ba27e1-c860-4f29-adf2-0baaf2914d67 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.111239 Nov 27 20:59:28.315070 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1987/4127] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:28 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:28.332088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b424ef39-cdb3-43eb-a867-fd7aa655fbe4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:28.333432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b424ef39-cdb3-43eb-a867-fd7aa655fbe4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:28.350382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b424ef39-cdb3-43eb-a867-fd7aa655fbe4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:28.351227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b424ef39-cdb3-43eb-a867-fd7aa655fbe4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.352303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b424ef39-cdb3-43eb-a867-fd7aa655fbe4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:28.353440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b424ef39-cdb3-43eb-a867-fd7aa655fbe4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.425030 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b424ef39-cdb3-43eb-a867-fd7aa655fbe4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.101950 Nov 27 20:59:28.426364 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1988/4128] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:28 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:28.449192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e24422e5-8e3f-409f-aa05-2e2128f1cc57 req-82d8d031-940f-45e5-984f-9ddc0b45dabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a6bdc1-0d85-4563-8ef9-f6a0a17075a0", "name": "network-vif-deleted", "tag": "4ebac182-8a28-42f8-9b81-45a0a7ad3616"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:28.452083 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:28.452083 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:28.488527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e24422e5-8e3f-409f-aa05-2e2128f1cc57 req-82d8d031-940f-45e5-984f-9ddc0b45dabf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:28.489092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e24422e5-8e3f-409f-aa05-2e2128f1cc57 req-82d8d031-940f-45e5-984f-9ddc0b45dabf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.495977 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-719e8263-e0c5-452c-b420-a3993ec8bf6b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 204 len: 0 microversion: 2.1 time: 2.975736 Nov 27 20:59:28.499903 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2141/4129] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:59:25 2021] DELETE /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 0 bytes in 2984 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:28.515708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:28.516366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:28.523389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_external_events [req-e24422e5-8e3f-409f-aa05-2e2128f1cc57 req-82d8d031-940f-45e5-984f-9ddc0b45dabf service nova] Unable to find a host for instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0. Dropping event network-vif-deleted {{(pid=135679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 20:59:28.525606 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e24422e5-8e3f-409f-aa05-2e2128f1cc57 req-82d8d031-940f-45e5-984f-9ddc0b45dabf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.096975 Nov 27 20:59:28.526960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1989/4130] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:28 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 100 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 20:59:28.533605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:28.534445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.536303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:28.536729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:28.581633 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 could not be found. Nov 27 20:59:28.583855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:59:28.589437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e2b4e94b-8beb-4563-8999-cbd3fb6ee58c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 404 len: 111 microversion: 2.1 time: 0.083595 Nov 27 20:59:28.591725 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2142/4131] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:28 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:28.782089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-497922653", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "39b4c68b-6f2a-4d98-a40b-89a7cdc47e01"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:28.903021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] validate_networks() for [('39b4c68b-6f2a-4d98-a40b-89a7cdc47e01', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:59:29.208867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:29.210132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:29.217911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:29.218469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:29.219547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:29.220280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:29.493881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:29.516162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:29.521093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:29.524135 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07340afe-3242-48ad-af10-3acff624b73e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1790 microversion: 2.32 time: 0.317574 Nov 27 20:59:29.524729 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2143/4132] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:29 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1790 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:59:29.531469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-952bdd56-0740-44ab-9ab1-2c5929269f98 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:29.532709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-952bdd56-0740-44ab-9ab1-2c5929269f98 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:29.541367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-952bdd56-0740-44ab-9ab1-2c5929269f98 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:29.542898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-952bdd56-0740-44ab-9ab1-2c5929269f98 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:29.544037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-952bdd56-0740-44ab-9ab1-2c5929269f98 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:29.544670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-952bdd56-0740-44ab-9ab1-2c5929269f98 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:29.620062 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-952bdd56-0740-44ab-9ab1-2c5929269f98 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.092521 Nov 27 20:59:29.621232 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2144/4133] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:29 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:29.628855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ff599ee-9047-4e4b-85c0-cdbf8aa66c2a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:29.631999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ff599ee-9047-4e4b-85c0-cdbf8aa66c2a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:29.641291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ff599ee-9047-4e4b-85c0-cdbf8aa66c2a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:29.642254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ff599ee-9047-4e4b-85c0-cdbf8aa66c2a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:29.644548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ff599ee-9047-4e4b-85c0-cdbf8aa66c2a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:29.645441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ff599ee-9047-4e4b-85c0-cdbf8aa66c2a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:29.703755 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ff599ee-9047-4e4b-85c0-cdbf8aa66c2a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.079718 Nov 27 20:59:29.709603 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2145/4134] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:29 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:30.311649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:59:30.313872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:59:30.314762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:59:30.315648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:59:30.316689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:59:30.329502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.330276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.331328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.332563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.354583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:59:30.361808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for user ed87ef17973a49f2a9108bdfbff65415 and project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:59:30.379585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:59:30.383188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:59:30.461378 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5839ff21-4ef6-466f-b37a-7239072fefc9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.683677 Nov 27 20:59:30.467774 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1990/4135] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:59:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:59:30.474102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f154951e-921f-4f3c-b853-0e7125f666ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:30.474803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f154951e-921f-4f3c-b853-0e7125f666ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:30.545471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:30.547319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:30.558714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.565070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f154951e-921f-4f3c-b853-0e7125f666ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:30.567455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.569664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.573463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.586228 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f154951e-921f-4f3c-b853-0e7125f666ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1214 microversion: 2.1 time: 0.115333 Nov 27 20:59:30.587184 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2146/4136] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:30 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:30.632759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ad30ccdd-c5f2-41fb-9148-6161a2c4c3b7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:30.633764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ad30ccdd-c5f2-41fb-9148-6161a2c4c3b7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:30.643700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad30ccdd-c5f2-41fb-9148-6161a2c4c3b7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.644842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad30ccdd-c5f2-41fb-9148-6161a2c4c3b7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.645662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad30ccdd-c5f2-41fb-9148-6161a2c4c3b7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.647301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad30ccdd-c5f2-41fb-9148-6161a2c4c3b7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.697667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ad30ccdd-c5f2-41fb-9148-6161a2c4c3b7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.067863 Nov 27 20:59:30.703730 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2147/4137] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:30 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 20:59:30.718584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5fa8f826-3062-4f90-9392-147e6aaaf4a4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:30.727872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5fa8f826-3062-4f90-9392-147e6aaaf4a4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:30.781287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fa8f826-3062-4f90-9392-147e6aaaf4a4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.785581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fa8f826-3062-4f90-9392-147e6aaaf4a4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.787678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fa8f826-3062-4f90-9392-147e6aaaf4a4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:30.789995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fa8f826-3062-4f90-9392-147e6aaaf4a4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:30.875070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5fa8f826-3062-4f90-9392-147e6aaaf4a4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.159422 Nov 27 20:59:30.877539 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2148/4138] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:30 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:31.349050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:31.372938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:31.381828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:31.384732 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c7056fd-03b7-4e3f-90f0-d1d94f2116a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1837 microversion: 2.32 time: 0.844643 Nov 27 20:59:31.401922 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1991/4139] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:30 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1837 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:31.606610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:31.608109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:31.640835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:31.641538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:31.647205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:31.648311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:31.724755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2bdc2a3b-c1f4-4386-a708-2a054c9f563f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:31.728261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2bdc2a3b-c1f4-4386-a708-2a054c9f563f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:31.740807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc2a3b-c1f4-4386-a708-2a054c9f563f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:31.741418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc2a3b-c1f4-4386-a708-2a054c9f563f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:31.742345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc2a3b-c1f4-4386-a708-2a054c9f563f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:31.742909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2bdc2a3b-c1f4-4386-a708-2a054c9f563f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:31.790953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:31.800962 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f222220-de4f-4798-8417-1a8b260bfa5b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1266 microversion: 2.1 time: 0.199895 Nov 27 20:59:31.802446 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2149/4140] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:31 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:31.811709 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2bdc2a3b-c1f4-4386-a708-2a054c9f563f tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 32643 microversion: 2.1 time: 0.098099 Nov 27 20:59:31.813053 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1992/4141] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:31 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 32643 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:31.890345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27bf7bf2-db80-409f-8793-f34c7499d743 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:31.891972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27bf7bf2-db80-409f-8793-f34c7499d743 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:31.920967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bf7bf2-db80-409f-8793-f34c7499d743 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:31.923409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bf7bf2-db80-409f-8793-f34c7499d743 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:31.927378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bf7bf2-db80-409f-8793-f34c7499d743 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:31.931576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27bf7bf2-db80-409f-8793-f34c7499d743 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:32.076760 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27bf7bf2-db80-409f-8793-f34c7499d743 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.192081 Nov 27 20:59:32.077906 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1993/4142] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:31 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:59:32.181819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-878999888", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2dde36fb-bdeb-4207-80d6-9a23277e3239"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:32.312412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] validate_networks() for [('2dde36fb-bdeb-4207-80d6-9a23277e3239', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:59:32.412271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:32.413293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:32.464061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:32.464832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:32.475280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:32.475280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:32.891060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:32.908178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:32.912210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:32.914180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac75d852-8d04-4e4c-8523-da383f937c20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1837 microversion: 2.32 time: 0.508244 Nov 27 20:59:32.934551 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1994/4143] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:32 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1837 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 20:59:32.940010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:32.940853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:32.949550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:32.950278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:32.951275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:32.951870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.084398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:33.095412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5fbbf405-21fe-46ba-8a30-39ade11ce08f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1272 microversion: 2.1 time: 0.157644 Nov 27 20:59:33.096852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1995/4144] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:32 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:33.103821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de28291f-80b1-46f3-b476-1fb2b6c7f6a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:33.105106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-de28291f-80b1-46f3-b476-1fb2b6c7f6a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:33.114112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de28291f-80b1-46f3-b476-1fb2b6c7f6a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.114793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de28291f-80b1-46f3-b476-1fb2b6c7f6a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.116000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de28291f-80b1-46f3-b476-1fb2b6c7f6a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.117808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de28291f-80b1-46f3-b476-1fb2b6c7f6a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.191766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de28291f-80b1-46f3-b476-1fb2b6c7f6a7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action" status: 200 len: 40798 microversion: 2.1 time: 0.090772 Nov 27 20:59:33.195955 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1996/4145] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:33 2021] POST /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700/action => generated 40798 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 20:59:33.207272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6df976fa-a45e-42f7-a407-1dcda5acbfda tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:33.209403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6df976fa-a45e-42f7-a407-1dcda5acbfda tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:33.218450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df976fa-a45e-42f7-a407-1dcda5acbfda tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.219427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df976fa-a45e-42f7-a407-1dcda5acbfda tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.220400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df976fa-a45e-42f7-a407-1dcda5acbfda tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.221114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df976fa-a45e-42f7-a407-1dcda5acbfda tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.321070 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6df976fa-a45e-42f7-a407-1dcda5acbfda tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.119561 Nov 27 20:59:33.325626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1997/4146] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:33 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:33.332389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:33.337515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:33.360781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.361883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.363298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.364090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.479124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:59:33.481179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:59:33.482786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:59:33.486093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:59:33.486781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:59:33.507745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.508768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.509816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.510764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.541823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Getting quotas for project 5399873bca254683bedebb5102a1b6e5. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:59:33.549223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Getting quotas for user 95f97f2e1958406b9dc0f258aa5a3f42 and project 5399873bca254683bedebb5102a1b6e5. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:59:33.570880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Going to run 2 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:59:33.574398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 2bbdff5d-514b-4cbc-8060-6d47df494d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:59:33.646404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=2bbdff5d-514b-4cbc-8060-6d47df494d46,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:59:33.657579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:33.671339 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1ac7e3c8-d163-49e0-ba33-dd1db944988c tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1603 microversion: 2.1 time: 0.347187 Nov 27 20:59:33.672081 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1998/4147] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:33 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1603 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:33.692699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-93044d10-0afb-4b0b-a0ef-21008202b8e3 req-05c59008-569a-413f-ad75-11a26964e85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "cef2b0c3-7e85-49c6-a464-7f8486966ae7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:33.692699 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:33.692699 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:33.692699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-93044d10-0afb-4b0b-a0ef-21008202b8e3 req-05c59008-569a-413f-ad75-11a26964e85b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.692699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-93044d10-0afb-4b0b-a0ef-21008202b8e3 req-05c59008-569a-413f-ad75-11a26964e85b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.731651 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-93044d10-0afb-4b0b-a0ef-21008202b8e3 req-05c59008-569a-413f-ad75-11a26964e85b service nova] Creating event network-changed:cef2b0c3-7e85-49c6-a464-7f8486966ae7 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:33.746521 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-93044d10-0afb-4b0b-a0ef-21008202b8e3 req-05c59008-569a-413f-ad75-11a26964e85b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070255 Nov 27 20:59:33.747899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 1999/4148] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:33.783208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6487cba5-6440-443c-b5bd-7638580821ac tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979225 Nov 27 20:59:33.787611 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2150/4149] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:59:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 20:59:33.796484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:33.800722 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:33.800722 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:33.804079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:33.807439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Searching by: {'deleted': False, 'project_id': '5399873bca254683bedebb5102a1b6e5'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:59:33.850550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.852378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.855861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.857318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.927625 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f5c45b2-d513-48c9-b69c-b26037a91692 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.136030 Nov 27 20:59:33.937301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2000/4150] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:59:33 2021] GET /compute/v2.1/servers => generated 675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:33.944093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40f23bf2-b5e3-4cbb-b263-82f55a0fce99 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:33.945097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40f23bf2-b5e3-4cbb-b263-82f55a0fce99 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:33.945218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:33.946195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:33.955134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.955657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:33.957194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:33.957930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:34.191239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-40f23bf2-b5e3-4cbb-b263-82f55a0fce99 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:34.202786 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40f23bf2-b5e3-4cbb-b263-82f55a0fce99 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1219 microversion: 2.1 time: 0.266704 Nov 27 20:59:34.205097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2151/4151] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:33 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:34.213512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:34.214562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:34.225423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:34.226133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:34.227729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:34.228366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:34.365519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:34.399101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27d7313f-9baa-4f6a-a7e1-85e73d51ff0d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1272 microversion: 2.1 time: 0.176211 Nov 27 20:59:34.402256 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2152/4152] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:34 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:34.413885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1089448e-ec3c-430a-ba8b-37f16dc1b478 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:34.415113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1089448e-ec3c-430a-ba8b-37f16dc1b478 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:34.451805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1089448e-ec3c-430a-ba8b-37f16dc1b478 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:34.451805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1089448e-ec3c-430a-ba8b-37f16dc1b478 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:34.452057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1089448e-ec3c-430a-ba8b-37f16dc1b478 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:34.459411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1089448e-ec3c-430a-ba8b-37f16dc1b478 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:34.532842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1089448e-ec3c-430a-ba8b-37f16dc1b478 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.128227 Nov 27 20:59:34.533659 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2153/4153] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:34 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:34.744505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:34.762603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:34.764696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:34.766468 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-19306c00-3c2a-42d2-8197-476cccd7b5f4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1837 microversion: 2.32 time: 0.828136 Nov 27 20:59:34.767641 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2001/4154] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:33 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1837 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:34.984238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:35.005875 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:35.005875 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:35.007836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:35.011913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Searching by: {'deleted': False, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:59:35.049424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.053436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.054951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.057815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.112743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:59:35.164777 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0aaad286-eebb-4030-b607-52ae92a87354 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.187715 Nov 27 20:59:35.166218 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2154/4155] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:59:34 2021] GET /compute/v2.1/servers => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:35.182871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:35.183818 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:35.183818 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:35.187224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:35.189316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Searching by: {'deleted': False, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 20:59:35.208199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.209677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.212096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.213865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.222671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:35.223482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:35.240717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.241582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.242386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.242827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.281367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 20:59:35.335819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:35.343604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.344217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.400955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:35.410253 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2c1557c-3931-407d-98a2-0c5ccb85f89a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1215 microversion: 2.1 time: 0.192149 Nov 27 20:59:35.411056 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2155/4156] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:35 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:35.418371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:35.419193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:35.433518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.434791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.437139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.440450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.849983 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20e00840-238d-4d43-ac39-3d22bafd329b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.675531 Nov 27 20:59:35.851781 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2002/4157] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:59:35 2021] GET /compute/v2.1/servers/detail => generated 1606 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:35.857520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07563ec8-fbf1-470b-acf6-ea8592d8742e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:35.858681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07563ec8-fbf1-470b-acf6-ea8592d8742e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:35.870980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07563ec8-fbf1-470b-acf6-ea8592d8742e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.871545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07563ec8-fbf1-470b-acf6-ea8592d8742e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.875516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07563ec8-fbf1-470b-acf6-ea8592d8742e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.876405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07563ec8-fbf1-470b-acf6-ea8592d8742e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.913919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:35.925820 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3696f076-5b4c-40ab-87bf-1c4d013309a0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 0.510636 Nov 27 20:59:35.927411 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2156/4158] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:35 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:35.942546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:35.943497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:35.945953 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07563ec8-fbf1-470b-acf6-ea8592d8742e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.092053 Nov 27 20:59:35.975582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.976017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.976855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:35.977296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:35.993104 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2003/4159] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:35 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:36.004171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc15993d-4043-48a8-ab94-8338c3f1665b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:36.038360 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc15993d-4043-48a8-ab94-8338c3f1665b tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040044 Nov 27 20:59:36.051318 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2004/4160] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 20:59:35 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:36.051318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2fa9c222-4fc5-409b-8fed-990588958bc0 req-e9accb05-6701-4d2e-a818-a812cdaef1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "14e81df6-5fa0-4831-a0b4-1270866d1c86"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:36.052561 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:36.052561 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:36.094566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2fa9c222-4fc5-409b-8fed-990588958bc0 req-e9accb05-6701-4d2e-a818-a812cdaef1b3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:36.095019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2fa9c222-4fc5-409b-8fed-990588958bc0 req-e9accb05-6701-4d2e-a818-a812cdaef1b3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:36.127923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2fa9c222-4fc5-409b-8fed-990588958bc0 req-e9accb05-6701-4d2e-a818-a812cdaef1b3 service nova] Creating event network-changed:14e81df6-5fa0-4831-a0b4-1270866d1c86 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:36.140920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2fa9c222-4fc5-409b-8fed-990588958bc0 req-e9accb05-6701-4d2e-a818-a812cdaef1b3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097816 Nov 27 20:59:36.141536 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2005/4161] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:36.429441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:36.430360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:36.440356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:36.441800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:36.442893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:36.443595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:36.568686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:36.587544 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87ee6ba1-6f9b-4f19-be3a-05183bc2a72c tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1277 microversion: 2.1 time: 0.163002 Nov 27 20:59:36.601277 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2006/4162] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:36 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:36.602477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:36.603007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:36.619523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:36.620348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:36.621659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:36.622518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:36.665997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:59:36.814557 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0fa6714-41c0-4425-ab89-60029602ce21 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 204 len: 0 microversion: 2.1 time: 0.218354 Nov 27 20:59:36.816258 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2007/4163] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:59:36 2021] DELETE /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:36.830697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:36.831844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:36.838934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:36.839793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:36.840795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:36.841392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:36.942810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:36.959376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:36.973124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:36.977821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-940e7f72-999b-43ce-9b78-3315b85f15f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1858 microversion: 2.32 time: 1.048801 Nov 27 20:59:36.978738 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2157/4164] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:35 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1858 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:36.994386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:36.995321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:37.005423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:37.006821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:37.007911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:37.008581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:37.916971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:37.925838 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d02373a-ff54-4ff3-be53-1a486ade5ed7 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1609 microversion: 2.1 time: 1.102123 Nov 27 20:59:37.926718 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2008/4165] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:36 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1609 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:37.932584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc6347e8-1d2f-4ef8-a622-b50d5eb27784 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:37.934529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc6347e8-1d2f-4ef8-a622-b50d5eb27784 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:37.944635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc6347e8-1d2f-4ef8-a622-b50d5eb27784 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:37.945141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc6347e8-1d2f-4ef8-a622-b50d5eb27784 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:37.946307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc6347e8-1d2f-4ef8-a622-b50d5eb27784 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:37.946841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc6347e8-1d2f-4ef8-a622-b50d5eb27784 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:38.004371 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc6347e8-1d2f-4ef8-a622-b50d5eb27784 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.076056 Nov 27 20:59:38.010290 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2009/4166] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:37 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:38.016954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:38.026547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b27209e-23e0-45f7-b97a-b4590936459a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 1.045959 Nov 27 20:59:38.026755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:38.027342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:38.036858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:38.037553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:38.038592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:38.039364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:38.045128 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2158/4167] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:36 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:38.050690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:38.051622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:38.062042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:38.062952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:38.064827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:38.065370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:38.210026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:38.224079 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c01d3716-ab9a-4a11-901c-d82e1b24329f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1277 microversion: 2.1 time: 0.209555 Nov 27 20:59:38.224692 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2010/4168] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:38 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:38.784682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c285de4f-1b19-4e2f-8654-616dc61bd024 req-d2371b1e-a30a-47ed-b598-209330624929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a7be90-3883-4d01-95a0-9cc6f69fa906", "tag": "bd09b9f1-fd18-496c-abd0-1c4f21cc9366"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:38.786400 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:38.786400 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:38.810952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c285de4f-1b19-4e2f-8654-616dc61bd024 req-d2371b1e-a30a-47ed-b598-209330624929 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:38.818189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c285de4f-1b19-4e2f-8654-616dc61bd024 req-d2371b1e-a30a-47ed-b598-209330624929 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:38.833427 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c285de4f-1b19-4e2f-8654-616dc61bd024 req-d2371b1e-a30a-47ed-b598-209330624929 service nova] Creating event network-changed:bd09b9f1-fd18-496c-abd0-1c4f21cc9366 for instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 on nch2-master-1 Nov 27 20:59:38.839317 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c285de4f-1b19-4e2f-8654-616dc61bd024 req-d2371b1e-a30a-47ed-b598-209330624929 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058238 Nov 27 20:59:38.841675 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2011/4169] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:59:38.944415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:38.945107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:38.964193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:38.965988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:38.967483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:38.969572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:39.110296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:39.129108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:39.131528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:39.132881 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-515d10ba-67be-48b9-9f6d-f583a9b14818 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1858 microversion: 2.32 time: 1.086386 Nov 27 20:59:39.135034 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2159/4170] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:38 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1858 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:39.141244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bdfe7cde-aae4-4509-9ba5-f6c1a2b7439d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:39.142441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bdfe7cde-aae4-4509-9ba5-f6c1a2b7439d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:39.150012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdfe7cde-aae4-4509-9ba5-f6c1a2b7439d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:39.150664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdfe7cde-aae4-4509-9ba5-f6c1a2b7439d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:39.151714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdfe7cde-aae4-4509-9ba5-f6c1a2b7439d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:39.152314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdfe7cde-aae4-4509-9ba5-f6c1a2b7439d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:39.353281 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bdfe7cde-aae4-4509-9ba5-f6c1a2b7439d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.214613 Nov 27 20:59:39.359795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2160/4171] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:39 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:39.367061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:39.368046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:39.375953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:39.376406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:39.377196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:39.377634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:39.515932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:39.527189 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d71cc40-bb11-4d2d-adc5-251ca958e0eb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1609 microversion: 2.1 time: 0.587090 Nov 27 20:59:39.528095 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2012/4172] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:38 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1609 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:39.532909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:39.533678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:39.541660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:39.542480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:39.543498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:39.544099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:40.069214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:40.080298 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b407b0cf-ecd8-47d6-abfc-ddeccd38df49 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 0.718268 Nov 27 20:59:40.084125 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2161/4173] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:39 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:40.153627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:40.154444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:40.155396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:40.167512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:40.167989 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-94d778ec-7a69-43f3-93e7-71fe2c9a51c4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.638685 Nov 27 20:59:40.168935 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2013/4174] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:39 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:40.169525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:40.171186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:40.172729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:40.367674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16465d81-a569-43cc-96ff-1fc25bc2d4c0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:40.369343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16465d81-a569-43cc-96ff-1fc25bc2d4c0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:40.377305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16465d81-a569-43cc-96ff-1fc25bc2d4c0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:40.378681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16465d81-a569-43cc-96ff-1fc25bc2d4c0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:40.379797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16465d81-a569-43cc-96ff-1fc25bc2d4c0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:40.380296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16465d81-a569-43cc-96ff-1fc25bc2d4c0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:40.434446 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16465d81-a569-43cc-96ff-1fc25bc2d4c0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.070373 Nov 27 20:59:40.436087 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2014/4175] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:40 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:40.546270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:40.546987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:40.556565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:40.557035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:40.557937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:40.558309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:41.216747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:41.236935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:41.239136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:41.240409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd4e94fa-0aa9-4c4e-820b-132f3a70a1d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.092031 Nov 27 20:59:41.252888 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2162/4176] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:40 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:41.252888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-55fe792a-e945-4888-825b-8a0731fae717 req-b9d63124-087a-4909-b7d1-195f5b8a117d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "decba21e-805a-4b68-9d38-6e3b44662ff5"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:41.252888 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:41.252888 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:41.257753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-55fe792a-e945-4888-825b-8a0731fae717 req-b9d63124-087a-4909-b7d1-195f5b8a117d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:41.258276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-55fe792a-e945-4888-825b-8a0731fae717 req-b9d63124-087a-4909-b7d1-195f5b8a117d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:41.270617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-55fe792a-e945-4888-825b-8a0731fae717 req-b9d63124-087a-4909-b7d1-195f5b8a117d service nova] Creating event network-changed:decba21e-805a-4b68-9d38-6e3b44662ff5 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:41.276349 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-55fe792a-e945-4888-825b-8a0731fae717 req-b9d63124-087a-4909-b7d1-195f5b8a117d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033066 Nov 27 20:59:41.277038 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2163/4177] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:41.283126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:41.283849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:41.291952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:41.292696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:41.293992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:41.294777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:41.318325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:41.326934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e794fe37-ddea-41a4-a4cd-920445835472 tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1609 microversion: 2.1 time: 0.785213 Nov 27 20:59:41.327836 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2015/4178] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:40 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1609 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:41.332932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:41.333928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:41.341136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:41.341690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:41.342566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:41.343094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:41.879507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:41.938933 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da1a322e-2d07-4d3b-a8ba-af594a1d9699 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.609747 Nov 27 20:59:41.939582 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2016/4179] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:41 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:41.946981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7521ab3f-4b86-4c58-bdf4-d5d1206639f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:41.948259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7521ab3f-4b86-4c58-bdf4-d5d1206639f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:41.959094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7521ab3f-4b86-4c58-bdf4-d5d1206639f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:41.959863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7521ab3f-4b86-4c58-bdf4-d5d1206639f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:41.961601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7521ab3f-4b86-4c58-bdf4-d5d1206639f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:41.962937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7521ab3f-4b86-4c58-bdf4-d5d1206639f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:42.025681 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7521ab3f-4b86-4c58-bdf4-d5d1206639f0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.083501 Nov 27 20:59:42.027508 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2017/4180] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:41 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:42.033936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0a66f59b-1398-4fd4-98d8-af72153d69f4 req-90640109-9ca2-47cb-b548-4142847f4df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bbdff5d-514b-4cbc-8060-6d47df494d46", "tag": "b4144523-0a7d-45d6-8421-1af4ee4eb23a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:42.035773 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:42.035773 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:42.043742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0a66f59b-1398-4fd4-98d8-af72153d69f4 req-90640109-9ca2-47cb-b548-4142847f4df8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:42.044191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0a66f59b-1398-4fd4-98d8-af72153d69f4 req-90640109-9ca2-47cb-b548-4142847f4df8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:42.058076 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0a66f59b-1398-4fd4-98d8-af72153d69f4 req-90640109-9ca2-47cb-b548-4142847f4df8 service nova] Creating event network-changed:b4144523-0a7d-45d6-8421-1af4ee4eb23a for instance 2bbdff5d-514b-4cbc-8060-6d47df494d46 on nch1-master-1 Nov 27 20:59:42.063173 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0a66f59b-1398-4fd4-98d8-af72153d69f4 req-90640109-9ca2-47cb-b548-4142847f4df8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033945 Nov 27 20:59:42.063851 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2018/4181] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:42.164856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:42.173347 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd509754-335c-4f69-843a-aaa757b45d39 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 0.894856 Nov 27 20:59:42.175368 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2164/4182] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:41 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:42.268778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:42.270049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:42.291483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:42.292396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:42.293762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:42.294484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:42.346346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:42.348736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:42.356533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:42.357357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:42.359070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:42.359810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:42.897973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:42.912917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b243c52-de11-43c2-8ffb-d28fb474bf3d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1541 microversion: 2.1 time: 0.571451 Nov 27 20:59:42.919461 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2165/4183] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:42 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1541 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:42.958130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:42.960858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:42.970800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:42.973123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:42.974764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:42.975899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:43.058929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:43.069947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:43.073707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:43.074990 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-94876f3b-f1d9-40a9-8b4a-91f6fb1e9175 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.814308 Nov 27 20:59:43.076054 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2019/4184] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:42 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:43.084827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21e402e4-a16b-43d2-94d6-ac10668b17a9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:43.086184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-21e402e4-a16b-43d2-94d6-ac10668b17a9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:43.095873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e402e4-a16b-43d2-94d6-ac10668b17a9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:43.097453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e402e4-a16b-43d2-94d6-ac10668b17a9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:43.098453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e402e4-a16b-43d2-94d6-ac10668b17a9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:43.099663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e402e4-a16b-43d2-94d6-ac10668b17a9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:43.160016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21e402e4-a16b-43d2-94d6-ac10668b17a9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.081576 Nov 27 20:59:43.161508 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2020/4185] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:43 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:43.196949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:43.197927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:43.208507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:43.209245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:43.210312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:43.210976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:43.579538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:43.590747 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-492f8d89-683f-4195-a1f9-e99b3be35103 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.637631 Nov 27 20:59:43.605772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2166/4186] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:42 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:43.665985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5b9629e2-6188-4705-8b3b-0b2162e4fa0f req-5b03f00d-4494-42b3-88c4-f822e6af6e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf02d0b-4468-4742-8c5e-399186f81700", "name": "network-vif-deleted", "tag": "8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:43.667666 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:43.667666 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:43.681083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5b9629e2-6188-4705-8b3b-0b2162e4fa0f req-5b03f00d-4494-42b3-88c4-f822e6af6e2c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:43.681534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5b9629e2-6188-4705-8b3b-0b2162e4fa0f req-5b03f00d-4494-42b3-88c4-f822e6af6e2c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:43.711757 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5b9629e2-6188-4705-8b3b-0b2162e4fa0f req-5b03f00d-4494-42b3-88c4-f822e6af6e2c service nova] Creating event network-vif-deleted:8bfcf1a5-a5c5-45eb-bee4-c4223d77d77f for instance 7bf02d0b-4468-4742-8c5e-399186f81700 on nch2-master-1 Nov 27 20:59:43.724400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5b9629e2-6188-4705-8b3b-0b2162e4fa0f req-5b03f00d-4494-42b3-88c4-f822e6af6e2c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061421 Nov 27 20:59:43.726137 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2167/4187] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:59:43.972021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:43.972944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:43.999877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.000387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.001259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.001708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.317691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb3f0e11efd43278f9c4c34f7eda52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860bb78a8bc43fd80d4c01ce057e5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:44.328990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-22f44ae3-5565-44f6-ba72-ad1e28fe452d tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 200 len: 1252 microversion: 2.1 time: 0.394500 Nov 27 20:59:44.330157 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2168/4188] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:43 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 1252 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:44.335622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:44.336456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:44.359173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.360433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.360628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.360936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.447232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:44.467954 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8098bf56-4ac4-4a43-9192-865f29458fa2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 1.279859 Nov 27 20:59:44.479568 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2021/4189] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:43 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:44.485831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2e5ff209-8951-4efb-8703-fe18b2be45bb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:44.489585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2e5ff209-8951-4efb-8703-fe18b2be45bb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:44.511953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5ff209-8951-4efb-8703-fe18b2be45bb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.512669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5ff209-8951-4efb-8703-fe18b2be45bb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.513650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5ff209-8951-4efb-8703-fe18b2be45bb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.514274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5ff209-8951-4efb-8703-fe18b2be45bb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.572480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2e5ff209-8951-4efb-8703-fe18b2be45bb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.089283 Nov 27 20:59:44.578766 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2022/4190] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:44 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:44.589919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f2d52e90-2b0f-41ab-b34e-bf75bf9cc023 req-5731ae32-691e-4224-a457-6aeb2fbd8820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d7875a-dab8-43cb-bf33-efb944a65a97", "tag": "3d04bbc6-1c06-45d6-ad10-58c0eee8d127"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:44.592253 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:44.592253 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:44.602783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f2d52e90-2b0f-41ab-b34e-bf75bf9cc023 req-5731ae32-691e-4224-a457-6aeb2fbd8820 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.603650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f2d52e90-2b0f-41ab-b34e-bf75bf9cc023 req-5731ae32-691e-4224-a457-6aeb2fbd8820 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.646310 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f2d52e90-2b0f-41ab-b34e-bf75bf9cc023 req-5731ae32-691e-4224-a457-6aeb2fbd8820 service nova] Creating event network-changed:3d04bbc6-1c06-45d6-ad10-58c0eee8d127 for instance 39d7875a-dab8-43cb-bf33-efb944a65a97 on nch1-master-1 Nov 27 20:59:44.651306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f2d52e90-2b0f-41ab-b34e-bf75bf9cc023 req-5731ae32-691e-4224-a457-6aeb2fbd8820 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068783 Nov 27 20:59:44.658911 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2023/4191] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:44.669540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:44.670260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:44.692158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.692828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:44.693992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:44.694605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.077009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:45.093389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:45.096079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:45.098528 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab35f990-64f0-43de-a33c-e0aa1e0bd1de tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.766535 Nov 27 20:59:45.118191 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2169/4192] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:44 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:45.236736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:45.257576 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e2f08dd1-d0b1-4f6a-86d1-4972fc108f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.596702 Nov 27 20:59:45.258886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2024/4193] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:44 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:45.350583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:45.351569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] [instance: 7bf02d0b-4468-4742-8c5e-399186f81700] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:45.359768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:45.360436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.361418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:45.362550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.383713 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] HTTP exception thrown: Instance 7bf02d0b-4468-4742-8c5e-399186f81700 could not be found. Nov 27 20:59:45.387530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Returning 404 to user: Instance 7bf02d0b-4468-4742-8c5e-399186f81700 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 20:59:45.390868 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27ad59b0-c40a-40fc-bd73-6cee41f3fecb tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700" status: 404 len: 111 microversion: 2.1 time: 0.045985 Nov 27 20:59:45.392594 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2170/4194] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:45 2021] GET /compute/v2.1/servers/7bf02d0b-4468-4742-8c5e-399186f81700 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:45.400759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-103ba926-4d15-46b4-8cf6-6f42cad21abd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] Calling method '.version_select at 0x7f15c734f430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:45.425764 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-103ba926-4d15-46b4-8cf6-6f42cad21abd tempest-ServersTestBootFromVolume-9867946 tempest-ServersTestBootFromVolume-9867946-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397718798" status: 202 len: 0 microversion: 2.1 time: 0.027579 Nov 27 20:59:45.426456 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2025/4195] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 20:59:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397718798 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:45.502965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:45.503840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:45.517100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:45.517950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.519008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:45.519710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.586267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-624d39e4-7e65-4033-8970-ed7147f4245a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:45.587235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-624d39e4-7e65-4033-8970-ed7147f4245a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:45.601176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-624d39e4-7e65-4033-8970-ed7147f4245a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:45.601637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-624d39e4-7e65-4033-8970-ed7147f4245a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.604641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-624d39e4-7e65-4033-8970-ed7147f4245a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:45.605126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-624d39e4-7e65-4033-8970-ed7147f4245a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.721075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-624d39e4-7e65-4033-8970-ed7147f4245a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.138528 Nov 27 20:59:45.734737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2026/4196] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:45 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:45.786952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-efbdc266-cf69-4eb2-8f4f-3c47a5ac04c0 req-2b0031bf-57cc-4c24-b167-d5efc268f1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:45.789024 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:45.789024 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:45.810561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-efbdc266-cf69-4eb2-8f4f-3c47a5ac04c0 req-2b0031bf-57cc-4c24-b167-d5efc268f1fe service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:45.811722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-efbdc266-cf69-4eb2-8f4f-3c47a5ac04c0 req-2b0031bf-57cc-4c24-b167-d5efc268f1fe service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:45.833260 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-efbdc266-cf69-4eb2-8f4f-3c47a5ac04c0 req-2b0031bf-57cc-4c24-b167-d5efc268f1fe service nova] Creating event network-changed:d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:45.840259 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-efbdc266-cf69-4eb2-8f4f-3c47a5ac04c0 req-2b0031bf-57cc-4c24-b167-d5efc268f1fe service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062238 Nov 27 20:59:45.841487 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2027/4197] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:46.128947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:46.130019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:46.140730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:46.141624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:46.143763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:46.145165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:46.719372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:46.733501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:46.733501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:46.734414 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a89608c-83e6-424c-bee2-c78cff499226 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.610278 Nov 27 20:59:46.734980 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2028/4198] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:46 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:46.740775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:46.741645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:46.751806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:46.752444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:46.754145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:46.754783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:46.842799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:46.858861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-74d97d91-15f7-4c5a-b0f8-09635c1c1617 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 1.361500 Nov 27 20:59:46.860329 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2171/4199] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:45 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:46.869507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-581751b0-1644-4d17-92ab-fa005c3a6211 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:46.870857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-581751b0-1644-4d17-92ab-fa005c3a6211 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:46.880199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-581751b0-1644-4d17-92ab-fa005c3a6211 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:46.880889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-581751b0-1644-4d17-92ab-fa005c3a6211 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:46.882058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-581751b0-1644-4d17-92ab-fa005c3a6211 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:46.882667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-581751b0-1644-4d17-92ab-fa005c3a6211 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:46.944222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-581751b0-1644-4d17-92ab-fa005c3a6211 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.082334 Nov 27 20:59:46.948799 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2172/4200] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:46 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:47.327705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:47.339704 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61cc828e-6d8e-4e9d-91ac-5c2b8d44bc3d tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.603375 Nov 27 20:59:47.340309 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2029/4201] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:46 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:47.757496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:47.758836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:47.782619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:47.783196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:47.784433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:47.784945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:47.880306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:47.881702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:47.888640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:47.889177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:47.890429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:47.890932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:48.308544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:48.320757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:48.322533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:48.323962 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-779b31e7-59c5-40e4-8bd3-62fdba8af9af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.573656 Nov 27 20:59:48.335869 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2173/4202] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:47 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:48.341064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cd765d83-04c3-475e-9861-68cce924af13 req-d93a933e-5027-4261-a4bf-29a0be61de9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "f797bf4c-f839-40c9-aa3e-3edb0a159de8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:48.342863 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:48.342863 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:48.351284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd765d83-04c3-475e-9861-68cce924af13 req-d93a933e-5027-4261-a4bf-29a0be61de9f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:48.352067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd765d83-04c3-475e-9861-68cce924af13 req-d93a933e-5027-4261-a4bf-29a0be61de9f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:48.366350 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cd765d83-04c3-475e-9861-68cce924af13 req-d93a933e-5027-4261-a4bf-29a0be61de9f service nova] Creating event network-changed:f797bf4c-f839-40c9-aa3e-3edb0a159de8 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:48.372656 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cd765d83-04c3-475e-9861-68cce924af13 req-d93a933e-5027-4261-a4bf-29a0be61de9f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034884 Nov 27 20:59:48.373935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2174/4203] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:48.381070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-757498d7-6922-4fde-9ef1-aa5a1b60dc56 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:48.382455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-757498d7-6922-4fde-9ef1-aa5a1b60dc56 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:48.391113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757498d7-6922-4fde-9ef1-aa5a1b60dc56 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:48.391871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757498d7-6922-4fde-9ef1-aa5a1b60dc56 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:48.393225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757498d7-6922-4fde-9ef1-aa5a1b60dc56 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:48.393915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757498d7-6922-4fde-9ef1-aa5a1b60dc56 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:48.458711 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-757498d7-6922-4fde-9ef1-aa5a1b60dc56 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.073991 Nov 27 20:59:48.463444 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2175/4204] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:48 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:48.464466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:48.465159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:48.481351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:48.482250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:48.483489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:48.484413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:48.866351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:48.874276 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8af90ba-afd9-44db-acb7-7bf1845d65e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 0.999461 Nov 27 20:59:48.884865 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2030/4205] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:47 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:48.973896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:49.001209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4713854d-dd6c-4962-9303-c0772f06b21b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.540411 Nov 27 20:59:49.008314 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2176/4206] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:48 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:49.344646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:49.345167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:49.363668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:49.369682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:49.370980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:49.371802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:49.417395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-c62ae173-651b-4eeb-b926-7a2b04ec8973 req-ecf726be-3beb-407f-82c2-3df3e4284e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7be90-3883-4d01-95a0-9cc6f69fa906", "name": "network-vif-plugged", "status": "completed", "tag": "bd09b9f1-fd18-496c-abd0-1c4f21cc9366"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:49.419611 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:49.419611 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:49.437488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c62ae173-651b-4eeb-b926-7a2b04ec8973 req-ecf726be-3beb-407f-82c2-3df3e4284e11 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:49.438215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c62ae173-651b-4eeb-b926-7a2b04ec8973 req-ecf726be-3beb-407f-82c2-3df3e4284e11 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:49.452266 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-c62ae173-651b-4eeb-b926-7a2b04ec8973 req-ecf726be-3beb-407f-82c2-3df3e4284e11 service nova] Creating event network-vif-plugged:bd09b9f1-fd18-496c-abd0-1c4f21cc9366 for instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 on nch2-master-1 Nov 27 20:59:49.457874 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-c62ae173-651b-4eeb-b926-7a2b04ec8973 req-ecf726be-3beb-407f-82c2-3df3e4284e11 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044236 Nov 27 20:59:49.460662 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2177/4207] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:59:49.488801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03961c08-0eb5-482d-bb06-495472cfbb32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:49.490267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03961c08-0eb5-482d-bb06-495472cfbb32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:49.520994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03961c08-0eb5-482d-bb06-495472cfbb32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:49.522672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03961c08-0eb5-482d-bb06-495472cfbb32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:49.523829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03961c08-0eb5-482d-bb06-495472cfbb32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:49.525147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03961c08-0eb5-482d-bb06-495472cfbb32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:49.598291 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03961c08-0eb5-482d-bb06-495472cfbb32 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.131016 Nov 27 20:59:49.605625 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2178/4208] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:49 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 20:59:49.760417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:49.775076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:49.778081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:49.780147 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1fd53fce-7fcf-43cb-936c-aca0a4ffe3bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.440553 Nov 27 20:59:49.780983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2031/4209] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:49 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:49.892244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:49.893263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:49.901286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:49.902163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:49.903026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:49.903497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:50.024576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:50.025780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:50.036436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:50.039671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:50.044686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:50.045425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:50.354225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:50.363522 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d2364cc-9681-420a-bc76-4b55c007078c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1314 microversion: 2.1 time: 0.475179 Nov 27 20:59:50.374342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2179/4210] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:49 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:50.439379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:50.462297 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66d18325-ff25-4318-9245-cc9b9f8f2066 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.441961 Nov 27 20:59:50.462892 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2032/4211] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:50 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:50.478600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fd80f8b6-3235-4be2-8302-83fd0fa0d747 req-30626ecd-fad8-4097-a4b0-abe312642037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "c24676eb-b68a-43ef-928f-8f5a3e6d3406"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:50.480950 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:50.480950 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:50.490201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fd80f8b6-3235-4be2-8302-83fd0fa0d747 req-30626ecd-fad8-4097-a4b0-abe312642037 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:50.491035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fd80f8b6-3235-4be2-8302-83fd0fa0d747 req-30626ecd-fad8-4097-a4b0-abe312642037 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:50.505741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fd80f8b6-3235-4be2-8302-83fd0fa0d747 req-30626ecd-fad8-4097-a4b0-abe312642037 service nova] Creating event network-changed:c24676eb-b68a-43ef-928f-8f5a3e6d3406 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:50.510672 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fd80f8b6-3235-4be2-8302-83fd0fa0d747 req-30626ecd-fad8-4097-a4b0-abe312642037 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035782 Nov 27 20:59:50.511571 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2180/4212] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:50.617788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e66fd496-f004-4930-a7d3-a003f57ca7fc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:50.619938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e66fd496-f004-4930-a7d3-a003f57ca7fc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:50.629432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e66fd496-f004-4930-a7d3-a003f57ca7fc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:50.630891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e66fd496-f004-4930-a7d3-a003f57ca7fc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:50.632221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e66fd496-f004-4930-a7d3-a003f57ca7fc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:50.632939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e66fd496-f004-4930-a7d3-a003f57ca7fc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:50.710427 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e66fd496-f004-4930-a7d3-a003f57ca7fc tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.099233 Nov 27 20:59:50.714974 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2033/4213] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:50 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:50.801130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:50.801939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:50.808976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:50.810291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:50.811784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:50.812242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.382462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:51.383199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:51.400450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.401183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.402788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.403552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.581292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:51.611050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:51.614057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:51.617500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a52112d5-0260-4710-a369-301f3172a8e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.821457 Nov 27 20:59:51.620031 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2181/4214] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:50 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:51.634435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1b206a6a-6097-41ec-b07c-07ee90ed174f req-7dfeadfd-8a10-4d93-a174-3af6f60f3a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbdff5d-514b-4cbc-8060-6d47df494d46", "name": "network-vif-plugged", "status": "completed", "tag": "b4144523-0a7d-45d6-8421-1af4ee4eb23a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:51.636434 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:51.636434 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:51.666142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1b206a6a-6097-41ec-b07c-07ee90ed174f req-7dfeadfd-8a10-4d93-a174-3af6f60f3a52 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.666583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1b206a6a-6097-41ec-b07c-07ee90ed174f req-7dfeadfd-8a10-4d93-a174-3af6f60f3a52 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.691608 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1b206a6a-6097-41ec-b07c-07ee90ed174f req-7dfeadfd-8a10-4d93-a174-3af6f60f3a52 service nova] Creating event network-vif-plugged:b4144523-0a7d-45d6-8421-1af4ee4eb23a for instance 2bbdff5d-514b-4cbc-8060-6d47df494d46 on nch1-master-1 Nov 27 20:59:51.704330 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1b206a6a-6097-41ec-b07c-07ee90ed174f req-7dfeadfd-8a10-4d93-a174-3af6f60f3a52 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082698 Nov 27 20:59:51.705641 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2182/4215] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:51.709240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:51.715908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:51.720606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:51.722377 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dbfde63d-dfd9-4f42-b14e-bc74e1b862e1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1501 microversion: 2.1 time: 0.341545 Nov 27 20:59:51.723402 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2034/4216] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:51 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:51.734429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4938a75e-c1f1-4e73-8e11-40c521ddaf10 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:51.735499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4938a75e-c1f1-4e73-8e11-40c521ddaf10 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:51.738532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.739279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.740879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.742685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.751813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4938a75e-c1f1-4e73-8e11-40c521ddaf10 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.752267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4938a75e-c1f1-4e73-8e11-40c521ddaf10 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.760710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4938a75e-c1f1-4e73-8e11-40c521ddaf10 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.761342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4938a75e-c1f1-4e73-8e11-40c521ddaf10 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.843701 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4938a75e-c1f1-4e73-8e11-40c521ddaf10 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.118624 Nov 27 20:59:51.849154 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2035/4217] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:51 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:51.857400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b817f64-1f41-4aa2-8931-576153929788 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:51.864421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b817f64-1f41-4aa2-8931-576153929788 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:51.864885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b817f64-1f41-4aa2-8931-576153929788 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:51.928808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b817f64-1f41-4aa2-8931-576153929788 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Going to try to stop instance {{(pid=135679) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 20:59:52.000917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b817f64-1f41-4aa2-8931-576153929788 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906/action" status: 202 len: 0 microversion: 2.1 time: 0.149056 Nov 27 20:59:52.003103 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2036/4218] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 20:59:51 2021] POST /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:52.013431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:52.014320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:52.021363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:52.022091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:52.023400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:52.024346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:52.261173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:52.283537 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a378b0dd-7b0a-4fc9-8921-54f120de7726 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.576380 Nov 27 20:59:52.287234 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2183/4219] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:51 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:52.380915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:52.388963 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9313f3aa-6fb7-4187-a10b-ae484ac067f1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.379979 Nov 27 20:59:52.417981 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2037/4220] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:52 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:52.545827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4d7fa9d8-9141-4fec-8225-91b8021c639c req-1342d459-ebff-4993-a8d9-3828e50c0e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "78e281c6-feff-4dc3-8b5f-015a2ed0fc39"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:52.547638 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:52.547638 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 20:59:52.557932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4d7fa9d8-9141-4fec-8225-91b8021c639c req-1342d459-ebff-4993-a8d9-3828e50c0e9b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:52.558950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4d7fa9d8-9141-4fec-8225-91b8021c639c req-1342d459-ebff-4993-a8d9-3828e50c0e9b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:52.576854 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4d7fa9d8-9141-4fec-8225-91b8021c639c req-1342d459-ebff-4993-a8d9-3828e50c0e9b service nova] Creating event network-changed:78e281c6-feff-4dc3-8b5f-015a2ed0fc39 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 20:59:52.582563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4d7fa9d8-9141-4fec-8225-91b8021c639c req-1342d459-ebff-4993-a8d9-3828e50c0e9b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041062 Nov 27 20:59:52.583484 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2184/4221] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 20:59:52.640213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:52.641162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:52.649470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:52.650240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:52.651244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:52.651909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:52.858677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a6ab7ac-58ec-49ca-a244-2839cb7010e2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:52.859880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a6ab7ac-58ec-49ca-a244-2839cb7010e2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:52.870941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a6ab7ac-58ec-49ca-a244-2839cb7010e2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:52.871670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a6ab7ac-58ec-49ca-a244-2839cb7010e2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:52.874696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a6ab7ac-58ec-49ca-a244-2839cb7010e2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:52.875154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a6ab7ac-58ec-49ca-a244-2839cb7010e2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:52.934300 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a6ab7ac-58ec-49ca-a244-2839cb7010e2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.080780 Nov 27 20:59:52.938709 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2185/4222] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:52 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:53.248170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:53.272198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:53.274224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:53.275597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70a3849a-c1e0-4617-a837-de9d63cf6b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.641381 Nov 27 20:59:53.287358 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2038/4223] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:52 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:53.307492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:53.309610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:53.318843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:53.319702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:53.320664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:53.321256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:53.411542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:53.414145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:53.428559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:53.434308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:53.438089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:53.439019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:53.690078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:53.700753 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8d677890-c064-4884-9561-175ed045f31f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.295458 Nov 27 20:59:53.712689 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2039/4224] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:53 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:53.727710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a625f0de-5601-493a-84e0-eebbe5a031bf req-24bb7ed1-0623-4bde-bc5f-c546c350efc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d7875a-dab8-43cb-bf33-efb944a65a97", "name": "network-vif-plugged", "status": "completed", "tag": "3d04bbc6-1c06-45d6-ad10-58c0eee8d127"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:53.729910 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:53.729910 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 20:59:53.737895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a625f0de-5601-493a-84e0-eebbe5a031bf req-24bb7ed1-0623-4bde-bc5f-c546c350efc5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:53.738463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a625f0de-5601-493a-84e0-eebbe5a031bf req-24bb7ed1-0623-4bde-bc5f-c546c350efc5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:53.740557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:53.748131 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00c23bcd-0d51-4375-b859-4c89e01a1888 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.448264 Nov 27 20:59:53.752633 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a625f0de-5601-493a-84e0-eebbe5a031bf req-24bb7ed1-0623-4bde-bc5f-c546c350efc5 service nova] Creating event network-vif-plugged:3d04bbc6-1c06-45d6-ad10-58c0eee8d127 for instance 39d7875a-dab8-43cb-bf33-efb944a65a97 on nch1-master-1 Nov 27 20:59:53.757522 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2186/4225] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:53 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:53.758638 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a625f0de-5601-493a-84e0-eebbe5a031bf req-24bb7ed1-0623-4bde-bc5f-c546c350efc5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035947 Nov 27 20:59:53.759357 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2040/4226] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 20:59:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 20:59:53.957229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bef6c119-864b-4aee-97c9-bf02b8afe05b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:53.960898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bef6c119-864b-4aee-97c9-bf02b8afe05b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:54.000396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bef6c119-864b-4aee-97c9-bf02b8afe05b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.000849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bef6c119-864b-4aee-97c9-bf02b8afe05b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:54.001649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bef6c119-864b-4aee-97c9-bf02b8afe05b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.009482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bef6c119-864b-4aee-97c9-bf02b8afe05b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:54.067330 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bef6c119-864b-4aee-97c9-bf02b8afe05b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.124605 Nov 27 20:59:54.068474 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2187/4227] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:53 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:54.296752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:54.297937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:54.304654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.305476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:54.306557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.307233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:54.693731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:54.706116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:54.720071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:54.720978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:54.729031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.729692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:54.730652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.734334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:54.740856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:54.741813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34e42439-02be-4d75-87f8-337edf896fac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.446533 Nov 27 20:59:54.742431 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2041/4228] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:54 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:54.769087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:54.770704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:54.784496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.786591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:54.788208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:54.791279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:55.152163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:55.168766 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc97b46d-650a-450a-9c4b-75bee2b034f6 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.449268 Nov 27 20:59:55.171210 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2188/4229] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:54 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:55.188295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2a8fcfb-c7ab-48e8-a9ee-3e2cc189dd17 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:55.189318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2a8fcfb-c7ab-48e8-a9ee-3e2cc189dd17 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:55.197808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2a8fcfb-c7ab-48e8-a9ee-3e2cc189dd17 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:55.201563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:55.221321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2a8fcfb-c7ab-48e8-a9ee-3e2cc189dd17 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:55.222606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2a8fcfb-c7ab-48e8-a9ee-3e2cc189dd17 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:55.223897 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11b38b11-a821-4fd6-aa20-3e5c6c387731 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1319 microversion: 2.1 time: 0.463079 Nov 27 20:59:55.224594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2a8fcfb-c7ab-48e8-a9ee-3e2cc189dd17 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:55.227273 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2042/4230] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:54 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:55.293286 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2a8fcfb-c7ab-48e8-a9ee-3e2cc189dd17 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.119770 Nov 27 20:59:55.298080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2189/4231] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:55 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:55.761673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:55.762298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:55.784965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:55.785443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:55.786294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:55.787024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:56.187372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:56.188076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:56.196165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:56.196915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:56.197727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:56.198350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:56.594334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:56.613336 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ae5abf2-04c5-434e-abcf-1065508f6a7b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.429937 Nov 27 20:59:56.614670 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2190/4232] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:56 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:56.620641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:56.621513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:56.649890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:56.650828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:56.652062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:56.652745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:56.739733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:56.756248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:56.757995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:56.759511 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-76fd214c-cb8f-4de2-baf3-4d6bdf4e2624 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.002238 Nov 27 20:59:56.760624 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2043/4233] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:55 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:56.775386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1bed8f3c-44c9-424d-aa24-57ab7b21a560 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:56.776561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1bed8f3c-44c9-424d-aa24-57ab7b21a560 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:56.784303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bed8f3c-44c9-424d-aa24-57ab7b21a560 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:56.784745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bed8f3c-44c9-424d-aa24-57ab7b21a560 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:56.785541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bed8f3c-44c9-424d-aa24-57ab7b21a560 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:56.785975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bed8f3c-44c9-424d-aa24-57ab7b21a560 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:56.854727 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1bed8f3c-44c9-424d-aa24-57ab7b21a560 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.092066 Nov 27 20:59:56.856193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2044/4234] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:56 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:56.986374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:57.012887 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86661cf0-499f-474d-93d8-37157c437534 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 200 len: 1506 microversion: 2.1 time: 0.391290 Nov 27 20:59:57.014257 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2191/4235] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:56 2021] GET /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:57.033530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:57.034776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 2bbdff5d-514b-4cbc-8060-6d47df494d46] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:57.041996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.042355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.043167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.043726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.412504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:57.421441 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81855f82-f054-4d49-a2ab-0f3ca45acd10 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/2bbdff5d-514b-4cbc-8060-6d47df494d46" status: 200 len: 1506 microversion: 2.1 time: 0.393476 Nov 27 20:59:57.443917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2045/4236] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:57 2021] GET /compute/v2.1/servers/2bbdff5d-514b-4cbc-8060-6d47df494d46 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:57.458131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:57.460219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 2bbdff5d-514b-4cbc-8060-6d47df494d46] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:57.469237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.470315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.471460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.474535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.525075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 2bbdff5d-514b-4cbc-8060-6d47df494d46] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:59:57.632114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:57.635834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:57.644425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.647859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.657998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.661249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.683247 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3cec3b5-590f-4625-beb0-6251c5fde122 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2bbdff5d-514b-4cbc-8060-6d47df494d46" status: 204 len: 0 microversion: 2.1 time: 0.231944 Nov 27 20:59:57.684364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2192/4237] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:59:57 2021] DELETE /compute/v2.1/servers/2bbdff5d-514b-4cbc-8060-6d47df494d46 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:57.699595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:57.700718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:57.710790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.711483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.713855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.714831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.762299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 39d7875a-dab8-43cb-bf33-efb944a65a97] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 20:59:57.899454 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-087e81b3-0abd-49f3-a105-81f381ff3cb9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97" status: 204 len: 0 microversion: 2.1 time: 0.209325 Nov 27 20:59:57.906832 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2193/4238] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 20:59:57 2021] DELETE /compute/v2.1/servers/39d7875a-dab8-43cb-bf33-efb944a65a97 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:57.913396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:57.914363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:57.924656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.925341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:57.927563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:57.927865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:58.153798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:58.167583 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34cbdbe7-5181-40b2-afce-82942d3a37b1 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.539992 Nov 27 20:59:58.169710 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2046/4239] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:57 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:58.184680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75519492-081d-4744-b31d-959f8eb1adb0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:58.189382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75519492-081d-4744-b31d-959f8eb1adb0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:58.211452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75519492-081d-4744-b31d-959f8eb1adb0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:58.213480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75519492-081d-4744-b31d-959f8eb1adb0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:58.215242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75519492-081d-4744-b31d-959f8eb1adb0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:58.215948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75519492-081d-4744-b31d-959f8eb1adb0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:58.290867 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75519492-081d-4744-b31d-959f8eb1adb0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.113029 Nov 27 20:59:58.295271 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2047/4240] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:58 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:58.305964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2115790930", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2dde36fb-bdeb-4207-80d6-9a23277e3239"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:58.451756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] validate_networks() for [('2dde36fb-bdeb-4207-80d6-9a23277e3239', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 20:59:58.518879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:58.537641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:58.539270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:58.540454 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-969da5a3-94c2-45dc-9c2e-210f88b1d24d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.632199 Nov 27 20:59:58.541013 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2194/4241] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:57 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 20:59:59.186345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:59.186957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:59.197142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.197872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:59.198852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.199312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:59.735973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 20:59:59.737230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 20:59:59.737624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 20:59:59.738056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 20:59:59.738456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 20:59:59.754695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.755163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:59.756024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.756476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:59.774507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 20:59:59.797723 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-595a27e5-e113-4ac9-a4c9-c51b4ef7e374 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.612054 Nov 27 20:59:59.800147 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2195/4242] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 20:59:59 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 20:59:59.813951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Getting quotas for project 5399873bca254683bedebb5102a1b6e5. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 20:59:59.817444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a254ce58-c08f-424c-b0e5-fa9e146edf38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 20:59:59.819025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a254ce58-c08f-424c-b0e5-fa9e146edf38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:59.827031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Getting quotas for user 95f97f2e1958406b9dc0f258aa5a3f42 and project 5399873bca254683bedebb5102a1b6e5. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 20:59:59.839439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a254ce58-c08f-424c-b0e5-fa9e146edf38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.839907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a254ce58-c08f-424c-b0e5-fa9e146edf38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:59.840820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a254ce58-c08f-424c-b0e5-fa9e146edf38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.841267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a254ce58-c08f-424c-b0e5-fa9e146edf38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:59.847022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Going to run 2 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 20:59:59.850133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:59:59.909324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=928d28f5-98f6-4791-943c-c9dd10b7ae32,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 20:59:59.933990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a254ce58-c08f-424c-b0e5-fa9e146edf38 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.129233 Nov 27 20:59:59.934799 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2196/4243] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 20:59:59 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 20:59:59.947203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 20:59:59.948250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 20:59:59.968922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.971857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 20:59:59.975567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 20:59:59.976769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:00.046633 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-57dd5a61-d4cf-4286-8a80-2ac8e2812825 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.746274 Nov 27 21:00:00.050111 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2048/4244] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:59:58 2021] POST /compute/v2.1/servers => generated 32 bytes in 1754 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 27 21:00:00.071013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:00.087842 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:00.087842 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:00.096858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:00.103156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Searching by: {'deleted': False, 'project_id': '5399873bca254683bedebb5102a1b6e5'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:00:00.178313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:00.178767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:00.182439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:00.184058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:00.253814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 21:00:00.415348 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02d216c6-d20e-439a-b787-7ec88b56c6fc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.348481 Nov 27 21:00:00.416024 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2049/4245] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 21:00:00 2021] GET /compute/v2.1/servers => generated 1335 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:00.429656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-83b5d9e9-4d6f-454a-bfbf-018569f7b9c7 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:00.432893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-83b5d9e9-4d6f-454a-bfbf-018569f7b9c7 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:00.614025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-83b5d9e9-4d6f-454a-bfbf-018569f7b9c7 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:00.621362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-83b5d9e9-4d6f-454a-bfbf-018569f7b9c7 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1218 microversion: 2.1 time: 0.198104 Nov 27 21:00:00.621962 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2050/4246] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:00 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:00.817289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:00.817908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:00.829436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:00.830111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:00.831647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:00.832254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:01.395462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:01.411884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:01.414583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:01.421182 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed867271-dc56-4f42-8342-9da40d0ca3f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.484533 Nov 27 21:00:01.422581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2197/4247] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 20:59:59 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:01.718696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bba76e0c-3ab8-4ec4-9b2c-c83542c6b4e0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:01.719758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bba76e0c-3ab8-4ec4-9b2c-c83542c6b4e0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:01.727566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba76e0c-3ab8-4ec4-9b2c-c83542c6b4e0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:01.728389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba76e0c-3ab8-4ec4-9b2c-c83542c6b4e0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:01.729206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba76e0c-3ab8-4ec4-9b2c-c83542c6b4e0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:01.730312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba76e0c-3ab8-4ec4-9b2c-c83542c6b4e0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:01.778931 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bba76e0c-3ab8-4ec4-9b2c-c83542c6b4e0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.354609 Nov 27 21:00:01.779625 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2198/4248] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:01 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:01.785832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:01.786652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:01.794005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:01.794656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:01.795614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:01.796053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:01.861104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:01.869356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17adc5ab-6f09-4a89-a48e-72e6148f5d82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1214 microversion: 2.1 time: 0.088595 Nov 27 21:00:01.869934 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2199/4249] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:01 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:01.879880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2178ba4d-d071-425e-a316-9c203d2fd55f req-f6f62de4-a603-4c5e-a74e-0b3aa469f9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d7875a-dab8-43cb-bf33-efb944a65a97", "name": "network-vif-deleted", "tag": "3d04bbc6-1c06-45d6-ad10-58c0eee8d127"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:01.881592 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:01.881592 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:01.896896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2178ba4d-d071-425e-a316-9c203d2fd55f req-f6f62de4-a603-4c5e-a74e-0b3aa469f9f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:01.900195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2178ba4d-d071-425e-a316-9c203d2fd55f req-f6f62de4-a603-4c5e-a74e-0b3aa469f9f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:01.916413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2178ba4d-d071-425e-a316-9c203d2fd55f req-f6f62de4-a603-4c5e-a74e-0b3aa469f9f9 service nova] Creating event network-vif-deleted:3d04bbc6-1c06-45d6-ad10-58c0eee8d127 for instance 39d7875a-dab8-43cb-bf33-efb944a65a97 on nch1-master-1 Nov 27 21:00:01.922472 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2178ba4d-d071-425e-a316-9c203d2fd55f req-f6f62de4-a603-4c5e-a74e-0b3aa469f9f9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050681 Nov 27 21:00:01.923455 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2200/4250] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:01.931516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ed6a83d8-ac1d-4828-b8fe-d4dddab1f5f5 req-e18685d3-8510-4472-bc5f-56c3076b5fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bbdff5d-514b-4cbc-8060-6d47df494d46", "name": "network-vif-deleted", "tag": "b4144523-0a7d-45d6-8421-1af4ee4eb23a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:01.936659 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:01.936659 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:01.948335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ed6a83d8-ac1d-4828-b8fe-d4dddab1f5f5 req-e18685d3-8510-4472-bc5f-56c3076b5fbb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:01.948558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ed6a83d8-ac1d-4828-b8fe-d4dddab1f5f5 req-e18685d3-8510-4472-bc5f-56c3076b5fbb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:01.972357 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ed6a83d8-ac1d-4828-b8fe-d4dddab1f5f5 req-e18685d3-8510-4472-bc5f-56c3076b5fbb service nova] Creating event network-vif-deleted:b4144523-0a7d-45d6-8421-1af4ee4eb23a for instance 2bbdff5d-514b-4cbc-8060-6d47df494d46 on nch1-master-1 Nov 27 21:00:01.977273 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ed6a83d8-ac1d-4828-b8fe-d4dddab1f5f5 req-e18685d3-8510-4472-bc5f-56c3076b5fbb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052709 Nov 27 21:00:01.977881 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2201/4251] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:02.150715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:02.158512 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a3931a2-4168-4e85-b51a-1c9e0a988ee8 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 1.344794 Nov 27 21:00:02.159838 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2051/4252] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:00 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:02.463432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:02.464391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:02.472763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:02.473590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:02.475548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:02.476234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:02.792089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0912998-6f15-43d3-85b2-add544437c00 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:02.793077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0912998-6f15-43d3-85b2-add544437c00 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:02.806663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0912998-6f15-43d3-85b2-add544437c00 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:02.808131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0912998-6f15-43d3-85b2-add544437c00 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:02.810318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0912998-6f15-43d3-85b2-add544437c00 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:02.810937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0912998-6f15-43d3-85b2-add544437c00 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:02.887906 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0912998-6f15-43d3-85b2-add544437c00 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.099586 Nov 27 21:00:02.888586 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2052/4253] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:02 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:02.901247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:02.903457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:02.944301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:02.945719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:02.947548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:02.947977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:02.985531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:03.009018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:03.011506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:03.015699 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e94d029f-7c7e-41ed-8977-6e2d4a2e15ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.576389 Nov 27 21:00:03.018851 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2202/4254] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:02 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:03.083367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:03.092861 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c63462fe-e701-4e72-9265-8fe3552f8be8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1276 microversion: 2.1 time: 0.201167 Nov 27 21:00:03.094320 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2053/4255] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:02 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:03.179376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:03.180710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:03.187651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:03.188108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:03.188907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:03.189333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:03.607435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:03.618738 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc90584f-479f-4813-8ff8-a3ab188c8542 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.442513 Nov 27 21:00:03.619356 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2203/4256] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:03 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:03.902417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-681705e5-373a-4264-a77b-07edaed5f32a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:03.903847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-681705e5-373a-4264-a77b-07edaed5f32a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:03.912026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-681705e5-373a-4264-a77b-07edaed5f32a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:03.912583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-681705e5-373a-4264-a77b-07edaed5f32a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:03.913711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-681705e5-373a-4264-a77b-07edaed5f32a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:03.914215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-681705e5-373a-4264-a77b-07edaed5f32a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:03.973068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-681705e5-373a-4264-a77b-07edaed5f32a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.075519 Nov 27 21:00:03.975378 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2054/4257] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:03 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:04.038954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:04.039798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:04.062079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:04.070812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:04.072206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:04.072665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:04.114870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:04.116887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:04.144139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:04.145954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:04.148345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:04.150161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:04.647676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:04.662738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:04.664619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:04.667030 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3fd0e148-31ef-4f6c-802d-18c10d83abe1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.633188 Nov 27 21:00:04.668063 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2204/4258] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:04 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:04.677300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:04.679842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:04.691955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:04.694880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:04.696045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:04.696974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:04.920930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:04.940719 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6402060d-c093-468d-8167-bf9c823127a9 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.832571 Nov 27 21:00:04.950182 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2055/4259] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:04 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:05.232028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:05.248292 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef3a773b-1ade-46cd-940e-ef1a75833705 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.576144 Nov 27 21:00:05.251681 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2205/4260] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:04 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:05.271542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-929e5d8c-7f9a-40d3-a538-f0b5e0ef6b48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:05.273079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-929e5d8c-7f9a-40d3-a538-f0b5e0ef6b48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:05.284995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-929e5d8c-7f9a-40d3-a538-f0b5e0ef6b48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:05.288495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-929e5d8c-7f9a-40d3-a538-f0b5e0ef6b48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:05.290573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-929e5d8c-7f9a-40d3-a538-f0b5e0ef6b48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:05.291022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-929e5d8c-7f9a-40d3-a538-f0b5e0ef6b48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:05.359357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1594068786", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "d9568fd8-159d-44c7-b6f5-91dbb9494e2e"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:05.365129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-929e5d8c-7f9a-40d3-a538-f0b5e0ef6b48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.111311 Nov 27 21:00:05.365873 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2206/4261] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:05 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:05.489286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] validate_networks() for [('d9568fd8-159d-44c7-b6f5-91dbb9494e2e', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:00:05.686283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:05.687621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:05.699411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:05.699862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:05.700655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:05.701660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:06.025801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:06.041257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:06.044142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:06.045477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-462e8cf6-62a3-4bd0-ae26-d7466d7770f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.363204 Nov 27 21:00:06.051886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2207/4262] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:05 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:06.065134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e906c9b6-283e-45e0-afdf-35b215a8a321 req-8883a567-4158-4ffc-88ff-324d31fdbd1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd9abec-0f4b-4206-924e-f951a3f36fb9", "tag": "642425fa-8b8a-437f-bd90-46213cfca81d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:06.067035 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:06.067035 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:06.082651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e906c9b6-283e-45e0-afdf-35b215a8a321 req-8883a567-4158-4ffc-88ff-324d31fdbd1c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:06.085029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e906c9b6-283e-45e0-afdf-35b215a8a321 req-8883a567-4158-4ffc-88ff-324d31fdbd1c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:06.118767 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e906c9b6-283e-45e0-afdf-35b215a8a321 req-8883a567-4158-4ffc-88ff-324d31fdbd1c service nova] Creating event network-changed:642425fa-8b8a-437f-bd90-46213cfca81d for instance efd9abec-0f4b-4206-924e-f951a3f36fb9 on nch1-master-1 Nov 27 21:00:06.125562 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e906c9b6-283e-45e0-afdf-35b215a8a321 req-8883a567-4158-4ffc-88ff-324d31fdbd1c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072075 Nov 27 21:00:06.126710 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2208/4263] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:06.134874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:06.142314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:06.159464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:06.159916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:06.160792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:06.161228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:06.554076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:06.565812 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf9cc181-9e78-4107-a0a9-c0cd9d050b2f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.433756 Nov 27 21:00:06.567176 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2209/4264] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:06 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:06.571856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:06.572465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:06.590017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:06.590568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:06.591345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:06.591730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:06.925654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:06.947809 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b138fcb-0540-426f-b15f-f65acd9e7e5a tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.379240 Nov 27 21:00:06.950703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2210/4265] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:06 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:06.961413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39cda739-d673-4c22-8989-2f523a8f4949 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:06.962632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39cda739-d673-4c22-8989-2f523a8f4949 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:06.969762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39cda739-d673-4c22-8989-2f523a8f4949 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:06.970578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39cda739-d673-4c22-8989-2f523a8f4949 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:06.971660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39cda739-d673-4c22-8989-2f523a8f4949 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:06.972319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39cda739-d673-4c22-8989-2f523a8f4949 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.053793 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39cda739-d673-4c22-8989-2f523a8f4949 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.099835 Nov 27 21:00:07.059312 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2211/4266] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:06 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:07.069112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:07.070124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:07.080644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.081520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.082536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.083146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.350705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:00:07.353425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:00:07.356124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:00:07.357126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:00:07.358886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:00:07.406785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.407354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.408769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.409296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.446962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Getting quotas for project dc5da228c74444d99bbd83366a9438ba. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:00:07.453503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Getting quotas for user 7be26c3cb58b4e9c96ad44105b5fe28a and project dc5da228c74444d99bbd83366a9438ba. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:00:07.466854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:00:07.469800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:00:07.514990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:07.526199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:07.528422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:07.531723 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e944cf01-bf7d-49ed-9fb8-ed806ccc36ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.467844 Nov 27 21:00:07.532992 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2212/4267] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:07 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:07.554654 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-273163ee-3461-425e-b48f-f2757d01354d tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.603052 Nov 27 21:00:07.562640 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2056/4268] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:00:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:00:07.565674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11a99b82-8af0-4981-b78e-78de8b01fd63 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:07.566711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-11a99b82-8af0-4981-b78e-78de8b01fd63 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:07.597411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:07.598060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:07.619291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.620824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.623600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.626440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.728369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-11a99b82-8af0-4981-b78e-78de8b01fd63 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:07.738869 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-11a99b82-8af0-4981-b78e-78de8b01fd63 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1217 microversion: 2.1 time: 0.177228 Nov 27 21:00:07.739533 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2213/4269] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:07 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:07.969557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:07.970890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:07.981376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.982389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:07.983868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:07.984649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:08.454063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:08.471081 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-955e2684-9bdb-49cb-b2a3-bf82e7a6c7a4 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.890825 Nov 27 21:00:08.471525 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2057/4270] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:07 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:08.484310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ae8df197-5019-4e63-be6e-4cd8b89efc1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:08.487063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae8df197-5019-4e63-be6e-4cd8b89efc1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:08.511739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae8df197-5019-4e63-be6e-4cd8b89efc1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:08.515910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae8df197-5019-4e63-be6e-4cd8b89efc1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:08.518900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae8df197-5019-4e63-be6e-4cd8b89efc1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:08.519625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae8df197-5019-4e63-be6e-4cd8b89efc1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:08.638962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ae8df197-5019-4e63-be6e-4cd8b89efc1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.162691 Nov 27 21:00:08.641731 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2058/4271] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:08 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:08.661429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2cf938a6-a35d-4f67-8fc3-e74b02ac7174 req-da85698e-b531-4677-88fe-4bfa853c3f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928d28f5-98f6-4791-943c-c9dd10b7ae32", "tag": "44c3230c-1b14-43bc-a6fe-b95af52a0f70"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:08.666481 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:08.666481 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:08.687539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2cf938a6-a35d-4f67-8fc3-e74b02ac7174 req-da85698e-b531-4677-88fe-4bfa853c3f8c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:08.689589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2cf938a6-a35d-4f67-8fc3-e74b02ac7174 req-da85698e-b531-4677-88fe-4bfa853c3f8c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:08.730391 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2cf938a6-a35d-4f67-8fc3-e74b02ac7174 req-da85698e-b531-4677-88fe-4bfa853c3f8c service nova] Creating event network-changed:44c3230c-1b14-43bc-a6fe-b95af52a0f70 for instance 928d28f5-98f6-4791-943c-c9dd10b7ae32 on nch1-master-1 Nov 27 21:00:08.741050 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2cf938a6-a35d-4f67-8fc3-e74b02ac7174 req-da85698e-b531-4677-88fe-4bfa853c3f8c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097510 Nov 27 21:00:08.742512 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2059/4272] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:08.749535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:08.750599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:08.757854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:08.759042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:08.760817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:08.761426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:08.866077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:08.876386 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5d4c45c-2921-4220-b329-6d028280a8fb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.913150 Nov 27 21:00:08.895063 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2214/4273] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:07 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:08.916490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:08.917439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:08.931573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:08.933661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:08.935108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:08.937921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:09.132203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:09.152399 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25178cab-b969-4bb1-8a0c-b5a653105535 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1269 microversion: 2.1 time: 0.253723 Nov 27 21:00:09.155413 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2215/4274] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:08 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:09.488855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:09.490403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:09.503433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:09.504156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:09.505181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:09.505838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:09.557109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:09.579791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:09.581559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:09.582945 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bee4e496-abb4-4327-a5c9-2963c5494634 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.838106 Nov 27 21:00:09.583736 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2060/4275] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:08 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:09.651645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8f8affd-61d9-4ba0-a456-530fefe53812 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:09.652844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8f8affd-61d9-4ba0-a456-530fefe53812 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:09.660969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8f8affd-61d9-4ba0-a456-530fefe53812 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:09.661626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8f8affd-61d9-4ba0-a456-530fefe53812 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:09.662594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8f8affd-61d9-4ba0-a456-530fefe53812 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:09.663205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8f8affd-61d9-4ba0-a456-530fefe53812 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:09.729168 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8f8affd-61d9-4ba0-a456-530fefe53812 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.081609 Nov 27 21:00:09.732797 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2061/4276] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:09 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:09.819709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:09.828195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6f1ea56-2c95-4d6e-b9d7-ac3979132f82 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.343665 Nov 27 21:00:09.829773 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2216/4277] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:09 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:09.916254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:09.919086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:09.945904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:09.947928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:09.951830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:09.955747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:10.179515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:10.181508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:10.201591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:10.205008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:10.208284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:10.208634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:10.628888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:10.646573 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6df113cd-2110-4b77-a952-e54cacb3b515 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.478870 Nov 27 21:00:10.648308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2217/4278] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:10 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:10.656433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:10.657490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:10.666798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:10.667495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:10.668475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:10.669827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:10.926987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:10.952687 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58b1406a-6446-4e48-aa86-1674a7bb342e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 1.041503 Nov 27 21:00:10.954481 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2062/4279] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:09 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:10.973284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc4af315-5444-4087-9455-1d3798769c7c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:10.977355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc4af315-5444-4087-9455-1d3798769c7c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:10.998649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc4af315-5444-4087-9455-1d3798769c7c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:10.999630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc4af315-5444-4087-9455-1d3798769c7c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.002899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc4af315-5444-4087-9455-1d3798769c7c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.003547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc4af315-5444-4087-9455-1d3798769c7c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.081851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc4af315-5444-4087-9455-1d3798769c7c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.124704 Nov 27 21:00:11.084146 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2063/4280] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:10 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:11.098143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f6826a04-f075-46cc-bc49-63a6685a098b req-4b83412d-79a3-42ee-a068-122c661230bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-plugged", "status": "completed", "tag": "cef2b0c3-7e85-49c6-a464-7f8486966ae7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:11.101159 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:11.101159 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:11.115389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f6826a04-f075-46cc-bc49-63a6685a098b req-4b83412d-79a3-42ee-a068-122c661230bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.117628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f6826a04-f075-46cc-bc49-63a6685a098b req-4b83412d-79a3-42ee-a068-122c661230bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.152369 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f6826a04-f075-46cc-bc49-63a6685a098b req-4b83412d-79a3-42ee-a068-122c661230bc service nova] Creating event network-vif-plugged:cef2b0c3-7e85-49c6-a464-7f8486966ae7 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:11.159586 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f6826a04-f075-46cc-bc49-63a6685a098b req-4b83412d-79a3-42ee-a068-122c661230bc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072463 Nov 27 21:00:11.160740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2064/4281] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:11.172650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:11.173601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:11.184888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.185620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.187053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.187693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.231125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:11.241920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:11.243781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:11.245266 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7b2caa30-4d6a-4ff3-afca-9c3cf2b1f119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.595357 Nov 27 21:00:11.246004 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2218/4282] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:10 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:11.666094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:11.668306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:11.680057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.680809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.681909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.682994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.932992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:11.947871 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84a8ccb3-628a-4ce7-9cbb-40cca581710a tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.784523 Nov 27 21:00:11.948786 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2065/4283] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:11 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:11.973159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:11.974179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:11.984404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.987074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:11.988865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:11.990772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:12.146108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:12.155466 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1079b4fc-95a1-4e3e-abfe-1926fe3ea547 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.495194 Nov 27 21:00:12.166286 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2219/4284] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:11 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:12.169946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cae74a3e-6acc-4d8a-9fb1-93d28759fe24 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:12.170933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cae74a3e-6acc-4d8a-9fb1-93d28759fe24 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:12.192989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae74a3e-6acc-4d8a-9fb1-93d28759fe24 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:12.193650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae74a3e-6acc-4d8a-9fb1-93d28759fe24 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:12.194706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae74a3e-6acc-4d8a-9fb1-93d28759fe24 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:12.195209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cae74a3e-6acc-4d8a-9fb1-93d28759fe24 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:12.296838 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cae74a3e-6acc-4d8a-9fb1-93d28759fe24 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.131684 Nov 27 21:00:12.300740 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2220/4285] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:12 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:12.351117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:12.354016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:12.382413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:12.386020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:12.388547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:12.392006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:12.394573 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d195463c-0947-430d-bbd7-beddc2cfe427 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.427049 Nov 27 21:00:12.394740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:12.396440 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2066/4286] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:11 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:12.538149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a70aada9-0226-4f2a-8cda-f68e9c4cd0d4 req-26464089-136d-4416-976a-01b538666c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28458f7d-6471-4d80-964d-5515d3479fd0", "tag": "a261d4bc-042d-442d-8a81-4f5da6cbd596"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:12.540360 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:12.540360 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:12.557885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a70aada9-0226-4f2a-8cda-f68e9c4cd0d4 req-26464089-136d-4416-976a-01b538666c67 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:12.558937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a70aada9-0226-4f2a-8cda-f68e9c4cd0d4 req-26464089-136d-4416-976a-01b538666c67 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:12.575681 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a70aada9-0226-4f2a-8cda-f68e9c4cd0d4 req-26464089-136d-4416-976a-01b538666c67 service nova] Creating event network-changed:a261d4bc-042d-442d-8a81-4f5da6cbd596 for instance 28458f7d-6471-4d80-964d-5515d3479fd0 on nch1-master-1 Nov 27 21:00:12.582701 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a70aada9-0226-4f2a-8cda-f68e9c4cd0d4 req-26464089-136d-4416-976a-01b538666c67 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049633 Nov 27 21:00:12.584796 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2067/4287] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:12.966445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:12.968204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:12.975896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:12.977357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:12.978548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:12.979234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.297051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:13.309589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:13.316630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:13.317976 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da97a1b4-a433-44a9-a8b6-279cc58e9302 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.015798 Nov 27 21:00:13.320637 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2221/4288] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:12 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:13.336132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:13.339312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:13.355453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:13.356431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.357556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:13.358237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.382512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:13.392218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a5ffdea5-f7c0-4af8-98f1-5262bb27b4dc tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.430455 Nov 27 21:00:13.410961 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2068/4289] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:12 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:13.417329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2947df8b-1bb1-4dac-96f2-5def71b95fb7 req-74ac9949-d024-4ae4-98c8-5384f661de46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-plugged", "status": "completed", "tag": "d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-plugged", "status": "completed", "tag": "f797bf4c-f839-40c9-aa3e-3edb0a159de8"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-plugged", "status": "completed", "tag": "78e281c6-feff-4dc3-8b5f-015a2ed0fc39"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:13.428598 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:13.428598 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:13.444027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2947df8b-1bb1-4dac-96f2-5def71b95fb7 req-74ac9949-d024-4ae4-98c8-5384f661de46 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:13.444481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2947df8b-1bb1-4dac-96f2-5def71b95fb7 req-74ac9949-d024-4ae4-98c8-5384f661de46 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.461354 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2947df8b-1bb1-4dac-96f2-5def71b95fb7 req-74ac9949-d024-4ae4-98c8-5384f661de46 service nova] Creating event network-vif-plugged:d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:13.461879 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2947df8b-1bb1-4dac-96f2-5def71b95fb7 req-74ac9949-d024-4ae4-98c8-5384f661de46 service nova] Creating event network-vif-plugged:f797bf4c-f839-40c9-aa3e-3edb0a159de8 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:13.462450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2947df8b-1bb1-4dac-96f2-5def71b95fb7 req-74ac9949-d024-4ae4-98c8-5384f661de46 service nova] Creating event network-vif-plugged:78e281c6-feff-4dc3-8b5f-015a2ed0fc39 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:13.469625 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2947df8b-1bb1-4dac-96f2-5def71b95fb7 req-74ac9949-d024-4ae4-98c8-5384f661de46 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055815 Nov 27 21:00:13.472027 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2069/4290] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:13.480724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a22532c9-44ae-4cde-96f6-ceeb2250aded tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:13.481655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a22532c9-44ae-4cde-96f6-ceeb2250aded tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:13.488717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a22532c9-44ae-4cde-96f6-ceeb2250aded tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:13.489180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a22532c9-44ae-4cde-96f6-ceeb2250aded tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.489990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a22532c9-44ae-4cde-96f6-ceeb2250aded tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:13.490430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a22532c9-44ae-4cde-96f6-ceeb2250aded tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.538061 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a22532c9-44ae-4cde-96f6-ceeb2250aded tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.061955 Nov 27 21:00:13.538743 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2070/4291] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:13 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:13.545503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:13.546460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:13.568031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:13.568582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.569429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:13.574994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:13.901607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:13.906957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:13.919419 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c4fbb706-552a-43ba-b2c8-e8c4562911e2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.379074 Nov 27 21:00:13.920356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7bce9fd0-dd09-4fb8-9a9f-56f40ad786d5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.588948 Nov 27 21:00:13.920945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2222/4292] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:13 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:13.922068 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2071/4293] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:13 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:14.342776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:14.343393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:14.353325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.354079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.355079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.356489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.415367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:14.417431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:14.430513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.431650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.432730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.433558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.666437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:14.677112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:14.679465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:14.681878 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6f97c64-890a-49a6-b887-95241f9e1b09 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.344929 Nov 27 21:00:14.682450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2072/4294] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:14 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:14.697175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a23131f3-bcc0-420d-96e9-04a928d7d57a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:14.699687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a23131f3-bcc0-420d-96e9-04a928d7d57a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:14.714664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23131f3-bcc0-420d-96e9-04a928d7d57a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.715138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23131f3-bcc0-420d-96e9-04a928d7d57a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.716160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23131f3-bcc0-420d-96e9-04a928d7d57a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.716614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23131f3-bcc0-420d-96e9-04a928d7d57a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.772331 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a23131f3-bcc0-420d-96e9-04a928d7d57a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.088150 Nov 27 21:00:14.773445 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2073/4295] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:14 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:14.918922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:14.928053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-313e646c-4a28-436e-bff6-ffb706ff841b tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.517482 Nov 27 21:00:14.928946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2223/4296] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:14 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:14.938555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:14.939805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:14.947156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.947639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.948017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:14.951605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.951605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.953920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:14.964084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.964591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:14.965458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:14.965900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:15.124123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:15.132298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0fca6989-8fd0-4984-9cfd-693fdff966a4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.198152 Nov 27 21:00:15.132873 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2074/4297] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:14 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:15.430665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:15.442040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9841868e-afa9-46a3-b2a4-2859c06206ee tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.499310 Nov 27 21:00:15.443291 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2224/4298] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:14 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:15.510037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-plugged", "status": "completed", "tag": "c24676eb-b68a-43ef-928f-8f5a3e6d3406"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-plugged", "status": "completed", "tag": "decba21e-805a-4b68-9d38-6e3b44662ff5"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-plugged", "status": "completed", "tag": "14e81df6-5fa0-4831-a0b4-1270866d1c86"}, {"server_uuid": "928d28f5-98f6-4791-943c-c9dd10b7ae32", "name": "network-vif-plugged", "status": "completed", "tag": "44c3230c-1b14-43bc-a6fe-b95af52a0f70"}, {"server_uuid": "efd9abec-0f4b-4206-924e-f951a3f36fb9", "name": "network-vif-plugged", "status": "completed", "tag": "642425fa-8b8a-437f-bd90-46213cfca81d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:15.519414 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:15.519414 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:15.543319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:15.544259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:15.562731 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Creating event network-vif-plugged:c24676eb-b68a-43ef-928f-8f5a3e6d3406 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:15.563306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Creating event network-vif-plugged:decba21e-805a-4b68-9d38-6e3b44662ff5 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:15.563831 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Creating event network-vif-plugged:14e81df6-5fa0-4831-a0b4-1270866d1c86 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:15.564415 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Creating event network-vif-plugged:44c3230c-1b14-43bc-a6fe-b95af52a0f70 for instance 928d28f5-98f6-4791-943c-c9dd10b7ae32 on nch1-master-1 Nov 27 21:00:15.564888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] Creating event network-vif-plugged:642425fa-8b8a-437f-bd90-46213cfca81d for instance efd9abec-0f4b-4206-924e-f951a3f36fb9 on nch1-master-1 Nov 27 21:00:15.574869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a17cd93f-f358-4099-945f-15a9d6b8ad0e req-244f312b-56a7-407b-92de-19aa6ed702df service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.073041 Nov 27 21:00:15.575972 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2075/4299] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:15 2021] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:15.711195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:15.711848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:15.730224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:15.730679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:15.731509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:15.734053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:15.785930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28125997-3128-4e0a-b93a-209ae22de93e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:15.787619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28125997-3128-4e0a-b93a-209ae22de93e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:15.803327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28125997-3128-4e0a-b93a-209ae22de93e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:15.803873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28125997-3128-4e0a-b93a-209ae22de93e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:15.804748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28125997-3128-4e0a-b93a-209ae22de93e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:15.805270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28125997-3128-4e0a-b93a-209ae22de93e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:15.854825 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28125997-3128-4e0a-b93a-209ae22de93e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.073097 Nov 27 21:00:15.860226 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2076/4300] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:15 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:15.946971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:15.948616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:15.956904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:15.958005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:15.959014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:15.959669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:16.215074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:16.223522 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7da7fff-9204-453a-9ede-da6fb1d51633 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.281862 Nov 27 21:00:16.224205 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2077/4301] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:15 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:16.229031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:16.229906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:16.236912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:16.237374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:16.238190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:16.238637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:16.483784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:16.495741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99d8479a-a1f1-41fc-bd7d-0321bcefd681 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.270167 Nov 27 21:00:16.507334 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2078/4302] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:16 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:16.512863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:16.513581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:16.522586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:16.523329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:16.524362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:16.525236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:16.729032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:16.739435 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e992394-1df2-409f-94d7-7968e0898d0b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1511 microversion: 2.1 time: 0.230681 Nov 27 21:00:16.750300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:16.767441 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2079/4303] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:16 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:16.769216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:16.771874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:16.774102 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-31f301e5-252b-4e80-9329-e30df813aadc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 1.074997 Nov 27 21:00:16.788608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2225/4304] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:15 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:16.868008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b022b30a-7788-4f99-9740-b13624639dc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:16.869353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b022b30a-7788-4f99-9740-b13624639dc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:16.875980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b022b30a-7788-4f99-9740-b13624639dc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:16.877309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b022b30a-7788-4f99-9740-b13624639dc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:16.878347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b022b30a-7788-4f99-9740-b13624639dc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:16.879028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b022b30a-7788-4f99-9740-b13624639dc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:16.927745 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b022b30a-7788-4f99-9740-b13624639dc9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.063371 Nov 27 21:00:16.928681 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2080/4305] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:16 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:17.242408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:17.243825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:17.252405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:17.253723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:17.254675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:17.255392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:17.514220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:17.514953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:17.525785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:17.535684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:17.536655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:17.537302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:17.662803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:17.700499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-056b5271-5d9c-469c-a385-b99e3aab1364 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1318 microversion: 2.1 time: 0.463019 Nov 27 21:00:17.701155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2226/4306] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:17 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:17.778076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:17.779975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:17.796213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:17.805392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:17.806710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:17.808225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.023706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:18.034099 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb0b5e85-b211-450b-ab1a-d8bbc91b3bc3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.524232 Nov 27 21:00:18.035482 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2081/4307] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:17 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:18.044678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:18.045175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:18.059851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.060781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.063809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.068552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.134802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:18.145584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-297b164d-562e-45c4-a636-77903cc01c57 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1488 microversion: 2.1 time: 0.375414 Nov 27 21:00:18.155354 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2227/4308] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:17 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1488 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:18.155354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7fca7bbc-5ad7-4104-b651-539493bface6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:18.155354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7fca7bbc-5ad7-4104-b651-539493bface6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:18.162787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fca7bbc-5ad7-4104-b651-539493bface6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.163238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fca7bbc-5ad7-4104-b651-539493bface6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.164496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fca7bbc-5ad7-4104-b651-539493bface6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.166394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7fca7bbc-5ad7-4104-b651-539493bface6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.233868 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7fca7bbc-5ad7-4104-b651-539493bface6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.085731 Nov 27 21:00:18.235192 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2228/4309] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:18 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:18.248184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:18.248910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:18.259663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.260225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.261476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.262133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.292806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:00:18.419055 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e7da8d7d-e03c-460d-8e59-641ff6e50bd2 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 204 len: 0 microversion: 2.1 time: 0.177583 Nov 27 21:00:18.420334 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2229/4310] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:18 2021] DELETE /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:00:18.429348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:18.430350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:18.436905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.437461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.438365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.439404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.546109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:18.558918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:18.561717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:18.563092 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aeb57b7b-4227-4cc3-977a-8a951c5c34ba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1879 microversion: 2.32 time: 0.526592 Nov 27 21:00:18.565444 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2082/4311] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:18 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1879 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:18.717683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:18.718784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:18.732411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.733490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.734741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:18.735418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:18.793013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:18.805832 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-119c23b0-9276-45be-aa48-49c7f632de96 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1494 microversion: 2.1 time: 0.380616 Nov 27 21:00:18.807090 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2230/4312] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:18 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1494 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:19.052110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:19.052731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:19.062616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.063960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.066938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.067721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.301490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:19.309693 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a01e77f8-ecc7-4302-96e2-35d3b6966ce6 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.261708 Nov 27 21:00:19.311083 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2231/4313] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:19 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:19.318537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89b29d81-7b15-4d9f-8175-94c45425d6d4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:19.320081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89b29d81-7b15-4d9f-8175-94c45425d6d4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:19.327107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b29d81-7b15-4d9f-8175-94c45425d6d4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.327874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b29d81-7b15-4d9f-8175-94c45425d6d4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.328739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b29d81-7b15-4d9f-8175-94c45425d6d4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.329247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b29d81-7b15-4d9f-8175-94c45425d6d4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.396965 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89b29d81-7b15-4d9f-8175-94c45425d6d4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.080215 Nov 27 21:00:19.398433 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2232/4314] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:19 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:19.537390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:19.548255 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6fbd953-2252-4166-844a-baec5f176d42 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1506 microversion: 2.1 time: 0.834030 Nov 27 21:00:19.550249 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2083/4315] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:18 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1506 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:19.570633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:19.572105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:19.588938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.589471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.594073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.594586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.597523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:19.598553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:19.605487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.606275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.607594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.608527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.948429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:19.960195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9482ff7-e187-4e38-bb7a-12c640ab500f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32" status: 200 len: 1505 microversion: 2.1 time: 0.394171 Nov 27 21:00:19.960794 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2233/4316] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:19 2021] GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:19.979672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:19.980551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:19.989012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.989443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:19.990266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:19.990698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.362923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:20.382235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:20.383869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:20.385486 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16f76199-d8f2-4cc1-ba70-3ce74ac3eeee tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2831 microversion: 2.32 time: 0.804003 Nov 27 21:00:20.386426 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2084/4317] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:00:19 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2831 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:20.391131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:20.392518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:20.401268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.401975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.405393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.406129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.439803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:00:20.541342 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a870053d-ad54-4831-807a-54fa9212fdd8 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32" status: 204 len: 0 microversion: 2.1 time: 0.152083 Nov 27 21:00:20.545331 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2085/4318] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:20 2021] DELETE /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:00:20.558446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7d5b5018-6b02-433d-8448-55d238fa6521 req-e7de99b7-57b7-4868-b38a-59f2fd43c9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28458f7d-6471-4d80-964d-5515d3479fd0", "name": "network-vif-plugged", "status": "completed", "tag": "a261d4bc-042d-442d-8a81-4f5da6cbd596"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:20.563197 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:20.563197 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:20.571686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7d5b5018-6b02-433d-8448-55d238fa6521 req-e7de99b7-57b7-4868-b38a-59f2fd43c9a9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.572562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7d5b5018-6b02-433d-8448-55d238fa6521 req-e7de99b7-57b7-4868-b38a-59f2fd43c9a9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.576189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:20.584384 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-18e43450-1615-4c1f-ab7c-7fa04d2bd86b tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1494 microversion: 2.1 time: 0.620265 Nov 27 21:00:20.585852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7d5b5018-6b02-433d-8448-55d238fa6521 req-e7de99b7-57b7-4868-b38a-59f2fd43c9a9 service nova] Creating event network-vif-plugged:a261d4bc-042d-442d-8a81-4f5da6cbd596 for instance 28458f7d-6471-4d80-964d-5515d3479fd0 on nch1-master-1 Nov 27 21:00:20.590141 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2234/4319] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:19 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1494 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:20.591878 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7d5b5018-6b02-433d-8448-55d238fa6521 req-e7de99b7-57b7-4868-b38a-59f2fd43c9a9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044246 Nov 27 21:00:20.593040 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2086/4320] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:20.594562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:20.597737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:20.599845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ccc6d56f-1a4e-4df5-9d80-2bafec4a9d2c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:20.600588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ccc6d56f-1a4e-4df5-9d80-2bafec4a9d2c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:20.607284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.607744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.608614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.608998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.609426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccc6d56f-1a4e-4df5-9d80-2bafec4a9d2c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.610144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccc6d56f-1a4e-4df5-9d80-2bafec4a9d2c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.611423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccc6d56f-1a4e-4df5-9d80-2bafec4a9d2c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.612188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ccc6d56f-1a4e-4df5-9d80-2bafec4a9d2c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.947849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:20.962851 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5fc48572-7044-429c-9f5e-c4b40f5eba61 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.365621 Nov 27 21:00:20.963474 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2235/4321] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:20 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:20.974977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebc7d1b7-ae22-4cde-8d8c-6a26432ec9a3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:20.977918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebc7d1b7-ae22-4cde-8d8c-6a26432ec9a3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:20.994749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc7d1b7-ae22-4cde-8d8c-6a26432ec9a3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.995199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc7d1b7-ae22-4cde-8d8c-6a26432ec9a3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:20.996049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc7d1b7-ae22-4cde-8d8c-6a26432ec9a3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:20.996485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc7d1b7-ae22-4cde-8d8c-6a26432ec9a3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:21.046099 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ccc6d56f-1a4e-4df5-9d80-2bafec4a9d2c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.451602 Nov 27 21:00:21.047105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2087/4322] 10.222.0.21 () {60 vars in 1315 bytes} [Sat Nov 27 21:00:20 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/os-interface => generated 1830 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:21.053562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:21.054346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:21.079668 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebc7d1b7-ae22-4cde-8d8c-6a26432ec9a3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.114634 Nov 27 21:00:21.080953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:21.081428 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2236/4323] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:20 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:21.086634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:21.104726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:21.108151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:21.184747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:00:21.379344 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0126b185-40a8-4224-8dde-a3f79fa40108 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 204 len: 0 microversion: 2.1 time: 0.328911 Nov 27 21:00:21.379930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2088/4324] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:21 2021] DELETE /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:00:21.390884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:21.395012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:21.405292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:21.405746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:21.411269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:21.412038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:21.607780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:21.608553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:21.618490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:21.624807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:21.628188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:21.628938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:21.784093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:21.793000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f849c6fc-2024-43bd-8be3-b473df68e329 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 200 len: 1452 microversion: 2.1 time: 0.189742 Nov 27 21:00:21.793611 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2089/4325] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:21 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:21.987293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:21.990490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:22.033310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:22.038314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:22.046024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:22.047766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:22.792249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:22.808557 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf985289-30f6-4885-a176-3759c7533dca tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32" status: 200 len: 1511 microversion: 2.1 time: 1.422935 Nov 27 21:00:22.809985 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2237/4326] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:21 2021] GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32 => generated 1511 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:22.821912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d4b6c325-a05a-425b-8955-0e0d7f4ce1bf req-07a4d61c-3eb4-4324-8417-6f528c21ad05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7be90-3883-4d01-95a0-9cc6f69fa906", "name": "network-vif-deleted", "tag": "bd09b9f1-fd18-496c-abd0-1c4f21cc9366"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:22.825170 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:22.825170 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:22.825942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:22.835597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d4b6c325-a05a-425b-8955-0e0d7f4ce1bf req-07a4d61c-3eb4-4324-8417-6f528c21ad05 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:22.836055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d4b6c325-a05a-425b-8955-0e0d7f4ce1bf req-07a4d61c-3eb4-4324-8417-6f528c21ad05 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:22.838841 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8cd1789e-2c94-4e21-815a-b932bf93f3f5 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1317 microversion: 2.1 time: 0.860053 Nov 27 21:00:22.840320 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2090/4327] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:21 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:22.851288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-907e3895-d6dd-48c4-82a2-4d3af31057e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:22.854633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-907e3895-d6dd-48c4-82a2-4d3af31057e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:22.864436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d4b6c325-a05a-425b-8955-0e0d7f4ce1bf req-07a4d61c-3eb4-4324-8417-6f528c21ad05 service nova] Creating event network-vif-deleted:bd09b9f1-fd18-496c-abd0-1c4f21cc9366 for instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 on nch2-master-1 Nov 27 21:00:22.869864 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d4b6c325-a05a-425b-8955-0e0d7f4ce1bf req-07a4d61c-3eb4-4324-8417-6f528c21ad05 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057458 Nov 27 21:00:22.870525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-907e3895-d6dd-48c4-82a2-4d3af31057e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:22.870898 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2238/4328] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:22.872932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-907e3895-d6dd-48c4-82a2-4d3af31057e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:22.877968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-907e3895-d6dd-48c4-82a2-4d3af31057e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:22.878788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:22.879160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-907e3895-d6dd-48c4-82a2-4d3af31057e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:22.879504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:22.886748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:22.887183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:22.888018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:22.888522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:22.903365 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 could not be found. Nov 27 21:00:22.904060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:22.905215 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-725cb607-7ad8-4db5-a919-a22d39d94458 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 404 len: 111 microversion: 2.1 time: 0.033018 Nov 27 21:00:22.906167 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2239/4329] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:22 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:23.013753 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-907e3895-d6dd-48c4-82a2-4d3af31057e8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.171815 Nov 27 21:00:23.022165 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2091/4330] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:22 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:23.107659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-967513553", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "39b4c68b-6f2a-4d98-a40b-89a7cdc47e01"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:23.178991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] validate_networks() for [('39b4c68b-6f2a-4d98-a40b-89a7cdc47e01', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:00:23.830405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:23.831099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:23.842360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:23.842814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:23.843644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:23.854444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.136290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:24.153461 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ef48cf5-d5a3-43ed-934b-4c1a0c7987cf tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32" status: 200 len: 1511 microversion: 2.1 time: 0.327070 Nov 27 21:00:24.154720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2092/4331] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:23 2021] GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:24.160722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:24.161642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:24.168407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.169375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.170670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.171472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.480927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:24.496311 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fda23a60-d117-4608-b531-8a4980f9882c tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1506 microversion: 2.1 time: 0.340171 Nov 27 21:00:24.497572 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2093/4332] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:24 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:24.504405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18d8c538-c6e7-4261-a838-b2bf5a56f9d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:24.505703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18d8c538-c6e7-4261-a838-b2bf5a56f9d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:24.514992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18d8c538-c6e7-4261-a838-b2bf5a56f9d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.516099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18d8c538-c6e7-4261-a838-b2bf5a56f9d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.517362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18d8c538-c6e7-4261-a838-b2bf5a56f9d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.518189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18d8c538-c6e7-4261-a838-b2bf5a56f9d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.583637 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18d8c538-c6e7-4261-a838-b2bf5a56f9d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.084386 Nov 27 21:00:24.589460 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2094/4333] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:24 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:24.595455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:24.596342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:24.603772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.604537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.605405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.606009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.645839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:24.647531 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ba5a3a8-6973-4461-9d37-1d3cf60939e4 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0/os-instance-actions/req-273163ee-3461-425e-b48f-f2757d01354d" status: 200 len: 313 microversion: 2.1 time: 0.056628 Nov 27 21:00:24.649268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2095/4334] 10.222.0.21 () {58 vars in 1418 bytes} [Sat Nov 27 21:00:24 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0/os-instance-actions/req-273163ee-3461-425e-b48f-f2757d01354d => generated 313 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:24.664127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8da9d59c-2435-4d5b-a8b9-7ff051d6e163 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:24.665387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8da9d59c-2435-4d5b-a8b9-7ff051d6e163 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:24.673985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8da9d59c-2435-4d5b-a8b9-7ff051d6e163 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.674731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8da9d59c-2435-4d5b-a8b9-7ff051d6e163 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.675744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8da9d59c-2435-4d5b-a8b9-7ff051d6e163 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.676350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8da9d59c-2435-4d5b-a8b9-7ff051d6e163 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.784952 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8da9d59c-2435-4d5b-a8b9-7ff051d6e163 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "POST /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0/action" status: 202 len: 0 microversion: 2.1 time: 0.124910 Nov 27 21:00:24.787325 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2096/4335] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:00:24 2021] POST /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:24.796976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:24.798451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:24.812906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.814408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:24.816678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:24.818314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:25.218454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:25.246234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-69723edf-c3dd-453c-9098-2d50c574e698 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1508 microversion: 2.1 time: 0.454508 Nov 27 21:00:25.248309 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2097/4336] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:24 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:25.255106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:25.255987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:25.266580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:25.268545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:25.269521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:25.270122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:25.463563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:00:25.464470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:00:25.465109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:00:25.465745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:00:25.466326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:00:25.484241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:25.485009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:25.486040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:25.486751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:25.547410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:00:25.562949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Getting quotas for user ed87ef17973a49f2a9108bdfbff65415 and project 376670c463284dec902268e55ba60b72. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:00:25.603377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:00:25.614101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:00:25.667971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:25.686090 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71d1f0a9-582c-42a6-a4ed-a31ffe9940a2 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32" status: 200 len: 1511 microversion: 2.1 time: 0.436373 Nov 27 21:00:25.696137 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2098/4337] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:25 2021] GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32 => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:25.699752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d9cb0ab-4c7f-4d80-8d74-d9bad5670063 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:25.700759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d9cb0ab-4c7f-4d80-8d74-d9bad5670063 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:25.715411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d9cb0ab-4c7f-4d80-8d74-d9bad5670063 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:25.716850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d9cb0ab-4c7f-4d80-8d74-d9bad5670063 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:25.721034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d9cb0ab-4c7f-4d80-8d74-d9bad5670063 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:25.721746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d9cb0ab-4c7f-4d80-8d74-d9bad5670063 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:25.741408 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6684ed5-48e1-41fa-acc3-91d03917d126 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.639944 Nov 27 21:00:25.741997 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2240/4338] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:00:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 2642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:00:25.760613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af74a89a-7b68-4a00-8185-570c81c9751e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:25.761450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af74a89a-7b68-4a00-8185-570c81c9751e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:25.797119 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d9cb0ab-4c7f-4d80-8d74-d9bad5670063 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.101300 Nov 27 21:00:25.799011 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2099/4339] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:25 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:25.952785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-122828b8-295c-490a-b4c6-c7502cbeb2ea req-d3663ef1-9d32-48f7-8f7e-b24fcd6543f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928d28f5-98f6-4791-943c-c9dd10b7ae32", "name": "network-vif-deleted", "tag": "44c3230c-1b14-43bc-a6fe-b95af52a0f70"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:25.954369 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:25.954369 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:25.999848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-122828b8-295c-490a-b4c6-c7502cbeb2ea req-d3663ef1-9d32-48f7-8f7e-b24fcd6543f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.000737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-122828b8-295c-490a-b4c6-c7502cbeb2ea req-d3663ef1-9d32-48f7-8f7e-b24fcd6543f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.058931 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-122828b8-295c-490a-b4c6-c7502cbeb2ea req-d3663ef1-9d32-48f7-8f7e-b24fcd6543f9 service nova] Creating event network-vif-deleted:44c3230c-1b14-43bc-a6fe-b95af52a0f70 for instance 928d28f5-98f6-4791-943c-c9dd10b7ae32 on nch1-master-1 Nov 27 21:00:26.074710 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-122828b8-295c-490a-b4c6-c7502cbeb2ea req-d3663ef1-9d32-48f7-8f7e-b24fcd6543f9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125752 Nov 27 21:00:26.081630 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2100/4340] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:26.188062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9188fb2a-5e0d-4e61-a5da-c50ef3de2411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:26.189491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9188fb2a-5e0d-4e61-a5da-c50ef3de2411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:26.228081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9188fb2a-5e0d-4e61-a5da-c50ef3de2411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.229739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9188fb2a-5e0d-4e61-a5da-c50ef3de2411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.234717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9188fb2a-5e0d-4e61-a5da-c50ef3de2411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.238640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9188fb2a-5e0d-4e61-a5da-c50ef3de2411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.354392 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9188fb2a-5e0d-4e61-a5da-c50ef3de2411 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 14 microversion: 2.32 time: 0.181444 Nov 27 21:00:26.356082 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2101/4341] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:26 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:26.365897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:26.368524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:26.389471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.390243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.397305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.400267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.561078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-af74a89a-7b68-4a00-8185-570c81c9751e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:26.578266 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af74a89a-7b68-4a00-8185-570c81c9751e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1214 microversion: 2.1 time: 0.827488 Nov 27 21:00:26.579706 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2241/4342] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:25 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1214 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:26.705456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:26.706114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: 928d28f5-98f6-4791-943c-c9dd10b7ae32] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:26.717361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.717843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.724090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.724841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.753487 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] HTTP exception thrown: Instance 928d28f5-98f6-4791-943c-c9dd10b7ae32 could not be found. Nov 27 21:00:26.758484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Returning 404 to user: Instance 928d28f5-98f6-4791-943c-c9dd10b7ae32 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:26.762429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-378aeb66-696f-4995-9741-e2415f33f2f0 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32" status: 404 len: 111 microversion: 2.1 time: 0.061511 Nov 27 21:00:26.766393 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2242/4343] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:26 2021] GET /compute/v2.1/servers/928d28f5-98f6-4791-943c-c9dd10b7ae32 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:00:26.791897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:26.792736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:26.812332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.812866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.816020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.816552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.897739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:26.898623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:26.899361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lazy-loading 'fault' on Instance uuid efd9abec-0f4b-4206-924e-f951a3f36fb9 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:00:27.020425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f97f2e1958406b9dc0f258aa5a3f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5399873bca254683bedebb5102a1b6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:27.038399 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3f45e0a-0e00-47bb-876c-60d561abcac3 tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 200 len: 1308 microversion: 2.1 time: 0.268493 Nov 27 21:00:27.052034 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2243/4344] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:26 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:27.059515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d18cc0c-b285-4c2d-a386-0a1868d2681e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:27.061672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d18cc0c-b285-4c2d-a386-0a1868d2681e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:27.069651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d18cc0c-b285-4c2d-a386-0a1868d2681e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:27.071474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d18cc0c-b285-4c2d-a386-0a1868d2681e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:27.072373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d18cc0c-b285-4c2d-a386-0a1868d2681e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:27.073032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d18cc0c-b285-4c2d-a386-0a1868d2681e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:27.134173 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d18cc0c-b285-4c2d-a386-0a1868d2681e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078251 Nov 27 21:00:27.146760 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2244/4345] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:27 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:27.371623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7dac4045-d325-4001-810d-a0697feda4b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:27.373876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7dac4045-d325-4001-810d-a0697feda4b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:27.386382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dac4045-d325-4001-810d-a0697feda4b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:27.386839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dac4045-d325-4001-810d-a0697feda4b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:27.387676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dac4045-d325-4001-810d-a0697feda4b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:27.388136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dac4045-d325-4001-810d-a0697feda4b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:27.491680 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7dac4045-d325-4001-810d-a0697feda4b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 14 microversion: 2.32 time: 0.126959 Nov 27 21:00:27.493637 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2245/4346] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:27 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:27.578310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:27.599408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:27.600976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:27.605121 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d110f85-4cd7-4c80-bebb-cb67149f7b95 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1508 microversion: 2.1 time: 1.247259 Nov 27 21:00:27.620059 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2102/4347] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:26 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1508 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:27.630974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:27.632042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:27.633089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:27.633762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:27.715538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:27.725376 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b5faa69-24a0-4250-8d83-4810d3ab94c7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1284 microversion: 2.1 time: 0.131745 Nov 27 21:00:27.725950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2246/4348] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:27 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:28.057715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:28.058912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] [instance: efd9abec-0f4b-4206-924e-f951a3f36fb9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:28.074799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.076417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.077582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.078092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.099434 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] HTTP exception thrown: Instance efd9abec-0f4b-4206-924e-f951a3f36fb9 could not be found. Nov 27 21:00:28.100866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] Returning 404 to user: Instance efd9abec-0f4b-4206-924e-f951a3f36fb9 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:28.106646 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ef096f44-0f08-4c2c-93df-1d95bd8f8b5f tempest-MultipleCreateTestJSON-1189896937 tempest-MultipleCreateTestJSON-1189896937-project] 10.222.0.21 "GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9" status: 404 len: 111 microversion: 2.1 time: 0.048620 Nov 27 21:00:28.108056 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2103/4349] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:28 2021] GET /compute/v2.1/servers/efd9abec-0f4b-4206-924e-f951a3f36fb9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:28.152628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-311d5203-4986-42b2-84a6-5812516a9be1 req-f7ae18b7-dc55-42c9-9385-b32cea9f8031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "tag": "cef2b0c3-7e85-49c6-a464-7f8486966ae7"}, {"server_uuid": "efd9abec-0f4b-4206-924e-f951a3f36fb9", "name": "network-vif-deleted", "tag": "642425fa-8b8a-437f-bd90-46213cfca81d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:28.152853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec6fb342-40b3-46e4-b85a-84734a7b2531 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:28.153718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ec6fb342-40b3-46e4-b85a-84734a7b2531 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:28.154553 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:28.154553 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:28.162644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec6fb342-40b3-46e4-b85a-84734a7b2531 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.165909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec6fb342-40b3-46e4-b85a-84734a7b2531 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.167417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec6fb342-40b3-46e4-b85a-84734a7b2531 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.169595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec6fb342-40b3-46e4-b85a-84734a7b2531 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.171065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-311d5203-4986-42b2-84a6-5812516a9be1 req-f7ae18b7-dc55-42c9-9385-b32cea9f8031 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.172138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-311d5203-4986-42b2-84a6-5812516a9be1 req-f7ae18b7-dc55-42c9-9385-b32cea9f8031 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.202524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-311d5203-4986-42b2-84a6-5812516a9be1 req-f7ae18b7-dc55-42c9-9385-b32cea9f8031 service nova] Creating event network-changed:cef2b0c3-7e85-49c6-a464-7f8486966ae7 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:00:28.204972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-311d5203-4986-42b2-84a6-5812516a9be1 req-f7ae18b7-dc55-42c9-9385-b32cea9f8031 service nova] Creating event network-vif-deleted:642425fa-8b8a-437f-bd90-46213cfca81d for instance efd9abec-0f4b-4206-924e-f951a3f36fb9 on nch1-master-1 Nov 27 21:00:28.220246 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-311d5203-4986-42b2-84a6-5812516a9be1 req-f7ae18b7-dc55-42c9-9385-b32cea9f8031 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070903 Nov 27 21:00:28.221347 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2104/4350] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:28 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:00:28.263959 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec6fb342-40b3-46e4-b85a-84734a7b2531 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.114576 Nov 27 21:00:28.265457 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2247/4351] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:28 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:28.511561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-836dbb16-7df2-4b94-8b2e-1498b4308321 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:28.513042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-836dbb16-7df2-4b94-8b2e-1498b4308321 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:28.521692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836dbb16-7df2-4b94-8b2e-1498b4308321 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.522583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836dbb16-7df2-4b94-8b2e-1498b4308321 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.523904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836dbb16-7df2-4b94-8b2e-1498b4308321 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.524850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836dbb16-7df2-4b94-8b2e-1498b4308321 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.574869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-836dbb16-7df2-4b94-8b2e-1498b4308321 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 14 microversion: 2.32 time: 0.071994 Nov 27 21:00:28.576459 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2105/4352] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:28 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:28.636447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:28.637143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:28.650189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.650881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.653399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.654018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.744985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:28.746342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:28.762372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.762929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.764137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:28.766719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:28.995545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:29.005534 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78063de7-c75d-4cbc-a618-d83137adfb7e tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1506 microversion: 2.1 time: 0.373424 Nov 27 21:00:29.020650 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2248/4353] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:28 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:29.027983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a99b886d-5d46-495a-b944-4581f2428067 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '.version_select at 0x7f15d9370af0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:29.028542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a99b886d-5d46-495a-b944-4581f2428067 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:29.036805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99b886d-5d46-495a-b944-4581f2428067 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.037431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99b886d-5d46-495a-b944-4581f2428067 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.038402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99b886d-5d46-495a-b944-4581f2428067 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.039016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99b886d-5d46-495a-b944-4581f2428067 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.064659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:29.074380 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-939fb2d4-bbb0-4052-ac0f-a1a2690902cf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1272 microversion: 2.1 time: 0.335276 Nov 27 21:00:29.076465 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a99b886d-5d46-495a-b944-4581f2428067 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.054674 Nov 27 21:00:29.085596 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2249/4354] 10.222.0.21 () {58 vars in 1295 bytes} [Sat Nov 27 21:00:29 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0/os-instance-actions => generated 611 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:29.086541 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2106/4355] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:28 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:29.090676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:29.091418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:29.099373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.100666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.101655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.102255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.147879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:00:29.290736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9fb05b75-8fe6-4a76-96b7-9d9200539c68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:29.292118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9fb05b75-8fe6-4a76-96b7-9d9200539c68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:29.318630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddc1fa84-68fb-4622-a4be-fb979b60a7c3 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "DELETE /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 204 len: 0 microversion: 2.1 time: 0.231410 Nov 27 21:00:29.321923 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2250/4356] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:29 2021] DELETE /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:00:29.328975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fb05b75-8fe6-4a76-96b7-9d9200539c68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.330051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fb05b75-8fe6-4a76-96b7-9d9200539c68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.330935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fb05b75-8fe6-4a76-96b7-9d9200539c68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.331489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fb05b75-8fe6-4a76-96b7-9d9200539c68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.335571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:29.336272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:29.342821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.343392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.344540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.345620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.395720 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9fb05b75-8fe6-4a76-96b7-9d9200539c68 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.121291 Nov 27 21:00:29.397385 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2107/4357] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:29 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:29.595944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-931ae7b9-a3c4-4e56-a1fa-d3a7eb56560b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:29.599105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-931ae7b9-a3c4-4e56-a1fa-d3a7eb56560b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:29.613451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-931ae7b9-a3c4-4e56-a1fa-d3a7eb56560b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.614274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-931ae7b9-a3c4-4e56-a1fa-d3a7eb56560b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.615733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-931ae7b9-a3c4-4e56-a1fa-d3a7eb56560b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:29.616963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-931ae7b9-a3c4-4e56-a1fa-d3a7eb56560b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:29.703294 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-931ae7b9-a3c4-4e56-a1fa-d3a7eb56560b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 14 microversion: 2.32 time: 0.118995 Nov 27 21:00:29.706761 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2108/4358] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:29 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:30.042696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:30.051818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f388a850-8f60-4bab-a45a-30743f6e78df tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1512 microversion: 2.1 time: 0.725253 Nov 27 21:00:30.053125 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2251/4359] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:29 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1512 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:30.092411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:30.093918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:30.102497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:30.108003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:30.109070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:30.109686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:30.417384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c8eeba8-ec4c-4464-986b-cc3ae42a2fd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:30.418578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c8eeba8-ec4c-4464-986b-cc3ae42a2fd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:30.430352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c8eeba8-ec4c-4464-986b-cc3ae42a2fd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:30.432658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c8eeba8-ec4c-4464-986b-cc3ae42a2fd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:30.433804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c8eeba8-ec4c-4464-986b-cc3ae42a2fd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:30.434901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c8eeba8-ec4c-4464-986b-cc3ae42a2fd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:30.498340 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c8eeba8-ec4c-4464-986b-cc3ae42a2fd7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.092619 Nov 27 21:00:30.499333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2252/4360] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:30 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:30.711928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:30.719418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab6162e5-98d2-4d33-9b54-10f0a4144e2b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:30.721101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab6162e5-98d2-4d33-9b54-10f0a4144e2b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:30.723748 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad4dad37-6f31-48e6-ab4b-048b0927e59c tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1314 microversion: 2.1 time: 0.636128 Nov 27 21:00:30.724782 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2109/4361] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:30 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:30.741411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6162e5-98d2-4d33-9b54-10f0a4144e2b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:30.741869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6162e5-98d2-4d33-9b54-10f0a4144e2b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:30.742690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6162e5-98d2-4d33-9b54-10f0a4144e2b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:30.743575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab6162e5-98d2-4d33-9b54-10f0a4144e2b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:30.804750 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab6162e5-98d2-4d33-9b54-10f0a4144e2b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 14 microversion: 2.32 time: 0.093305 Nov 27 21:00:30.806342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2253/4362] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:30 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:31.070066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:31.070696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:31.081064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.082095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:31.083926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.084868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:31.511784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c6f653ee-4b2f-40eb-909b-a9e6ce05a10a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:31.512806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c6f653ee-4b2f-40eb-909b-a9e6ce05a10a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:31.520831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6f653ee-4b2f-40eb-909b-a9e6ce05a10a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.521451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6f653ee-4b2f-40eb-909b-a9e6ce05a10a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:31.522329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6f653ee-4b2f-40eb-909b-a9e6ce05a10a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.522842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6f653ee-4b2f-40eb-909b-a9e6ce05a10a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:31.598321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be26c3cb58b4e9c96ad44105b5fe28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5da228c74444d99bbd83366a9438ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:31.606402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c6f653ee-4b2f-40eb-909b-a9e6ce05a10a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.098526 Nov 27 21:00:31.611382 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8981131-9776-4983-8a6c-3e2ca11918dc tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 200 len: 1512 microversion: 2.1 time: 0.544882 Nov 27 21:00:31.614350 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2254/4363] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:31 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:31.623583 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2110/4364] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:31 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 1512 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:31.741657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:31.744040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:31.763392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.764800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:31.767731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.779542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:31.819809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bf2c035-89de-4ba1-8a18-bbe56fcfe3a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:31.820968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4bf2c035-89de-4ba1-8a18-bbe56fcfe3a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:31.858296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf2c035-89de-4ba1-8a18-bbe56fcfe3a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.860458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf2c035-89de-4ba1-8a18-bbe56fcfe3a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:31.862100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf2c035-89de-4ba1-8a18-bbe56fcfe3a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:31.867821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf2c035-89de-4ba1-8a18-bbe56fcfe3a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:32.021364 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4bf2c035-89de-4ba1-8a18-bbe56fcfe3a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 14 microversion: 2.32 time: 0.207695 Nov 27 21:00:32.031881 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2111/4365] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:31 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:32.044749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7c711f6d-64c8-4acf-84bd-fee09643ff81 req-4d12dd3f-8ef9-40e0-83de-f6a46f0d4516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28458f7d-6471-4d80-964d-5515d3479fd0", "name": "network-vif-deleted", "tag": "a261d4bc-042d-442d-8a81-4f5da6cbd596"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:32.048944 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:32.048944 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:32.068783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7c711f6d-64c8-4acf-84bd-fee09643ff81 req-4d12dd3f-8ef9-40e0-83de-f6a46f0d4516 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:32.069765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7c711f6d-64c8-4acf-84bd-fee09643ff81 req-4d12dd3f-8ef9-40e0-83de-f6a46f0d4516 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:32.107063 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7c711f6d-64c8-4acf-84bd-fee09643ff81 req-4d12dd3f-8ef9-40e0-83de-f6a46f0d4516 service nova] Creating event network-vif-deleted:a261d4bc-042d-442d-8a81-4f5da6cbd596 for instance 28458f7d-6471-4d80-964d-5515d3479fd0 on nch1-master-1 Nov 27 21:00:32.116211 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7c711f6d-64c8-4acf-84bd-fee09643ff81 req-4d12dd3f-8ef9-40e0-83de-f6a46f0d4516 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084061 Nov 27 21:00:32.117369 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2112/4366] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:32.266280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:32.278816 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d4b3e8b-2149-458f-bd22-7b1a41ef8cbb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1314 microversion: 2.1 time: 0.538708 Nov 27 21:00:32.283178 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2255/4367] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:31 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:32.622905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f89b6f51-c194-4c1f-840b-fb6680bb0ce1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:32.629569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:32.632454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] [instance: 28458f7d-6471-4d80-964d-5515d3479fd0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:32.637139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f89b6f51-c194-4c1f-840b-fb6680bb0ce1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:32.667035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:32.672588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:32.674985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f89b6f51-c194-4c1f-840b-fb6680bb0ce1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:32.677122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:32.680006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:32.683088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f89b6f51-c194-4c1f-840b-fb6680bb0ce1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:32.692651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f89b6f51-c194-4c1f-840b-fb6680bb0ce1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:32.695693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f89b6f51-c194-4c1f-840b-fb6680bb0ce1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:32.764113 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] HTTP exception thrown: Instance 28458f7d-6471-4d80-964d-5515d3479fd0 could not be found. Nov 27 21:00:32.764430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] Returning 404 to user: Instance 28458f7d-6471-4d80-964d-5515d3479fd0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:32.765265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c29ed1c-eee5-4e22-ab27-84beea7c6e51 tempest-InstanceActionsTestJSON-1157716546 tempest-InstanceActionsTestJSON-1157716546-project] 10.222.0.21 "GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0" status: 404 len: 111 microversion: 2.1 time: 0.139927 Nov 27 21:00:32.774852 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2256/4368] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:32 2021] GET /compute/v2.1/servers/28458f7d-6471-4d80-964d-5515d3479fd0 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:32.831384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f89b6f51-c194-4c1f-840b-fb6680bb0ce1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.211368 Nov 27 21:00:32.831384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2113/4369] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:32 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:33.039755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02c36dda-5335-4a9c-a3e4-9b982be311be tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:33.040695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02c36dda-5335-4a9c-a3e4-9b982be311be tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:33.057385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02c36dda-5335-4a9c-a3e4-9b982be311be tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:33.057835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02c36dda-5335-4a9c-a3e4-9b982be311be tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:33.058730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02c36dda-5335-4a9c-a3e4-9b982be311be tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:33.059167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02c36dda-5335-4a9c-a3e4-9b982be311be tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:33.117424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02c36dda-5335-4a9c-a3e4-9b982be311be tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 14 microversion: 2.32 time: 0.080917 Nov 27 21:00:33.121190 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2257/4370] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:33 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:33.184676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-6bd2e31a-2e77-454a-91c2-8e15f98a8382 req-9223c5cc-d9c5-466a-ad89-76a6b64a3638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736178dc-20e9-4ee0-b415-18983de0867b", "tag": "2744bd54-7d0a-4f87-930e-bc015c65ffb1"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:33.186376 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:33.186376 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:33.209077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6bd2e31a-2e77-454a-91c2-8e15f98a8382 req-9223c5cc-d9c5-466a-ad89-76a6b64a3638 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:33.210139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6bd2e31a-2e77-454a-91c2-8e15f98a8382 req-9223c5cc-d9c5-466a-ad89-76a6b64a3638 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:33.234276 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-6bd2e31a-2e77-454a-91c2-8e15f98a8382 req-9223c5cc-d9c5-466a-ad89-76a6b64a3638 service nova] Creating event network-changed:2744bd54-7d0a-4f87-930e-bc015c65ffb1 for instance 736178dc-20e9-4ee0-b415-18983de0867b on nch2-master-1 Nov 27 21:00:33.241383 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-6bd2e31a-2e77-454a-91c2-8e15f98a8382 req-9223c5cc-d9c5-466a-ad89-76a6b64a3638 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062116 Nov 27 21:00:33.242315 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2114/4371] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:33.305135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:33.305831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:33.320342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:33.320796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:33.321596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:33.322034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:33.842618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3bd23c02-7067-4420-8427-40c90101a09f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:33.844271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3bd23c02-7067-4420-8427-40c90101a09f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:33.861343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bd23c02-7067-4420-8427-40c90101a09f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:33.861804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bd23c02-7067-4420-8427-40c90101a09f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:33.862611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bd23c02-7067-4420-8427-40c90101a09f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:33.863055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bd23c02-7067-4420-8427-40c90101a09f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:33.880519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:33.924864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3bd23c02-7067-4420-8427-40c90101a09f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.086084 Nov 27 21:00:33.929199 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2115/4372] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:33 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:33.933146 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2b5b77f-c983-4fa3-b04f-db4397dfff94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1314 microversion: 2.1 time: 0.631240 Nov 27 21:00:33.936618 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2258/4373] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:33 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:34.129469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32daea7a-1e65-42c4-8cae-4b4351dc4d8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:34.131276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32daea7a-1e65-42c4-8cae-4b4351dc4d8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:34.141263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32daea7a-1e65-42c4-8cae-4b4351dc4d8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:34.143871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32daea7a-1e65-42c4-8cae-4b4351dc4d8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:34.145851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32daea7a-1e65-42c4-8cae-4b4351dc4d8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:34.147380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32daea7a-1e65-42c4-8cae-4b4351dc4d8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:34.228239 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32daea7a-1e65-42c4-8cae-4b4351dc4d8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 8182 microversion: 2.32 time: 0.102704 Nov 27 21:00:34.236430 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2116/4374] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:34 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 8182 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:00:34.940578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a32282f8-ab88-4303-991b-b3e6c7b423e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:34.941542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a32282f8-ab88-4303-991b-b3e6c7b423e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:34.952054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:34.952711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a32282f8-ab88-4303-991b-b3e6c7b423e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:34.953566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a32282f8-ab88-4303-991b-b3e6c7b423e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:34.953898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:34.954670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a32282f8-ab88-4303-991b-b3e6c7b423e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:34.955121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a32282f8-ab88-4303-991b-b3e6c7b423e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:34.971929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:34.974947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:34.975971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:34.980931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:35.020896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a32282f8-ab88-4303-991b-b3e6c7b423e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.084415 Nov 27 21:00:35.022151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2259/4375] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:34 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:35.242834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ccb7d78-d317-451a-8206-875ed705d3b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:35.249111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ccb7d78-d317-451a-8206-875ed705d3b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:35.267899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ccb7d78-d317-451a-8206-875ed705d3b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:35.268362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ccb7d78-d317-451a-8206-875ed705d3b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:35.269172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ccb7d78-d317-451a-8206-875ed705d3b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:35.269614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ccb7d78-d317-451a-8206-875ed705d3b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:35.367016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ccb7d78-d317-451a-8206-875ed705d3b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 16365 microversion: 2.32 time: 0.128194 Nov 27 21:00:35.370121 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2260/4376] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:35 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 16365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:36.036166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fad85164-26ad-4faa-8c75-4aaa1945129b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:36.037074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fad85164-26ad-4faa-8c75-4aaa1945129b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:36.046969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad85164-26ad-4faa-8c75-4aaa1945129b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:36.047520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad85164-26ad-4faa-8c75-4aaa1945129b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:36.049120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad85164-26ad-4faa-8c75-4aaa1945129b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:36.049567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fad85164-26ad-4faa-8c75-4aaa1945129b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:36.108109 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fad85164-26ad-4faa-8c75-4aaa1945129b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.077706 Nov 27 21:00:36.110972 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2261/4377] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:36 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:36.119844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:36.129703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9cacd9b6-73a3-49c1-add2-4515ec01585d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1314 microversion: 2.1 time: 1.181564 Nov 27 21:00:36.130383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2117/4378] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:34 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1314 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:36.379292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81f17157-ad34-44b7-b177-34c14f57d865 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:36.380298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81f17157-ad34-44b7-b177-34c14f57d865 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:36.401340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f17157-ad34-44b7-b177-34c14f57d865 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:36.402966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f17157-ad34-44b7-b177-34c14f57d865 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:36.404905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f17157-ad34-44b7-b177-34c14f57d865 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:36.405527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81f17157-ad34-44b7-b177-34c14f57d865 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:36.541507 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81f17157-ad34-44b7-b177-34c14f57d865 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 16365 microversion: 2.32 time: 0.166640 Nov 27 21:00:36.545217 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2262/4379] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:36 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 16365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:37.121249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55598f3c-976b-4b69-9dee-f5a37ce6add2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:37.122997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55598f3c-976b-4b69-9dee-f5a37ce6add2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:37.132888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55598f3c-976b-4b69-9dee-f5a37ce6add2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:37.133346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55598f3c-976b-4b69-9dee-f5a37ce6add2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:37.134146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55598f3c-976b-4b69-9dee-f5a37ce6add2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:37.134584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55598f3c-976b-4b69-9dee-f5a37ce6add2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:37.147961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:37.148659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:37.161071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:37.161522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:37.166753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:37.167218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:37.231541 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55598f3c-976b-4b69-9dee-f5a37ce6add2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.112894 Nov 27 21:00:37.233333 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2118/4380] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:37 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:37.553567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75b1e480-0ed0-44ba-898e-a70749b63ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:37.554621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75b1e480-0ed0-44ba-898e-a70749b63ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:37.567935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75b1e480-0ed0-44ba-898e-a70749b63ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:37.568390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75b1e480-0ed0-44ba-898e-a70749b63ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:37.575080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75b1e480-0ed0-44ba-898e-a70749b63ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:37.575809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75b1e480-0ed0-44ba-898e-a70749b63ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:37.664389 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75b1e480-0ed0-44ba-898e-a70749b63ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 16365 microversion: 2.32 time: 0.114801 Nov 27 21:00:37.665674 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2119/4381] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:37 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 16365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:37.760321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:37.770890 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52472a22-7271-4104-af84-b0dd0a4ffd94 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1314 microversion: 2.1 time: 0.627474 Nov 27 21:00:37.775999 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2263/4382] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:37 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:38.245638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74817480-09ff-45c6-b623-5e69f15f85e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:38.246946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-74817480-09ff-45c6-b623-5e69f15f85e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:38.261208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74817480-09ff-45c6-b623-5e69f15f85e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:38.262326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74817480-09ff-45c6-b623-5e69f15f85e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:38.263701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74817480-09ff-45c6-b623-5e69f15f85e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:38.264494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74817480-09ff-45c6-b623-5e69f15f85e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:38.322952 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74817480-09ff-45c6-b623-5e69f15f85e4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.081126 Nov 27 21:00:38.324021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2120/4383] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:38 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:38.676303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3de2bffe-317e-4ea2-b461-04520eab5180 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:38.677967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3de2bffe-317e-4ea2-b461-04520eab5180 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:38.691895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de2bffe-317e-4ea2-b461-04520eab5180 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:38.692619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de2bffe-317e-4ea2-b461-04520eab5180 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:38.693664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de2bffe-317e-4ea2-b461-04520eab5180 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:38.706224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3de2bffe-317e-4ea2-b461-04520eab5180 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:38.794515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:38.795226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:38.796658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3de2bffe-317e-4ea2-b461-04520eab5180 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 16365 microversion: 2.32 time: 0.124268 Nov 27 21:00:38.798154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2264/4384] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:38 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 16365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:38.805262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:38.805724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:38.812875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:38.814062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:39.273364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:39.304768 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42270c98-9cba-4097-94f2-74f730cbbfcb tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1314 microversion: 2.1 time: 0.513557 Nov 27 21:00:39.315236 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2121/4385] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:38 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:39.340319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd2a4963-0d74-4343-99c5-f48cc73acd9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:39.341364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd2a4963-0d74-4343-99c5-f48cc73acd9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:39.367025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd2a4963-0d74-4343-99c5-f48cc73acd9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:39.373203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd2a4963-0d74-4343-99c5-f48cc73acd9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:39.374932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd2a4963-0d74-4343-99c5-f48cc73acd9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:39.378903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd2a4963-0d74-4343-99c5-f48cc73acd9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:39.493223 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd2a4963-0d74-4343-99c5-f48cc73acd9e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.161442 Nov 27 21:00:39.500461 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2265/4386] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:39 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:39.808960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8dcecb49-bea0-4a29-ba01-b7a21a7dd2b1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:39.809998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8dcecb49-bea0-4a29-ba01-b7a21a7dd2b1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:39.823651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dcecb49-bea0-4a29-ba01-b7a21a7dd2b1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:39.825026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dcecb49-bea0-4a29-ba01-b7a21a7dd2b1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:39.830265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dcecb49-bea0-4a29-ba01-b7a21a7dd2b1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:39.831066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dcecb49-bea0-4a29-ba01-b7a21a7dd2b1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:39.833238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a92c1def-2fdb-4e53-bcb3-e0c2fafe96d0 req-0d9cf28b-86b4-4c0b-ac31-1f442ec96047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736178dc-20e9-4ee0-b415-18983de0867b", "name": "network-vif-plugged", "status": "completed", "tag": "2744bd54-7d0a-4f87-930e-bc015c65ffb1"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:39.834744 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:39.834744 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:39.852872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a92c1def-2fdb-4e53-bcb3-e0c2fafe96d0 req-0d9cf28b-86b4-4c0b-ac31-1f442ec96047 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:39.853328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a92c1def-2fdb-4e53-bcb3-e0c2fafe96d0 req-0d9cf28b-86b4-4c0b-ac31-1f442ec96047 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:39.882047 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a92c1def-2fdb-4e53-bcb3-e0c2fafe96d0 req-0d9cf28b-86b4-4c0b-ac31-1f442ec96047 service nova] Creating event network-vif-plugged:2744bd54-7d0a-4f87-930e-bc015c65ffb1 for instance 736178dc-20e9-4ee0-b415-18983de0867b on nch2-master-1 Nov 27 21:00:39.902455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a92c1def-2fdb-4e53-bcb3-e0c2fafe96d0 req-0d9cf28b-86b4-4c0b-ac31-1f442ec96047 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069562 Nov 27 21:00:39.905999 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2266/4387] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:39.925158 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8dcecb49-bea0-4a29-ba01-b7a21a7dd2b1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.120453 Nov 27 21:00:39.928547 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2122/4388] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:39 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:40.323160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:40.324202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:40.337221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:40.337680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:40.338717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:40.341727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:40.508997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c764468-412a-4cc1-bd04-2e19d50c84ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:40.510706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c764468-412a-4cc1-bd04-2e19d50c84ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:40.526066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c764468-412a-4cc1-bd04-2e19d50c84ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:40.552121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c764468-412a-4cc1-bd04-2e19d50c84ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:40.562879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c764468-412a-4cc1-bd04-2e19d50c84ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:40.564241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c764468-412a-4cc1-bd04-2e19d50c84ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:40.684136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c764468-412a-4cc1-bd04-2e19d50c84ce tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.179633 Nov 27 21:00:40.685280 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2123/4389] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:40 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:40.989110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:41.006884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af371078-5497-4dc1-b0bd-9e12d214e767 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1314 microversion: 2.1 time: 0.686884 Nov 27 21:00:41.007602 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2267/4390] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:40 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:41.021685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e8afd9e8-ff3a-4919-ae7e-4c9b7966503d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:41.023096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e8afd9e8-ff3a-4919-ae7e-4c9b7966503d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:41.036887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8afd9e8-ff3a-4919-ae7e-4c9b7966503d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:41.042620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8afd9e8-ff3a-4919-ae7e-4c9b7966503d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:41.044521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8afd9e8-ff3a-4919-ae7e-4c9b7966503d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:41.045182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8afd9e8-ff3a-4919-ae7e-4c9b7966503d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:41.110549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-773167449", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6f63875e-bf4a-47be-b2b4-689a7102b5e2"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:41.129478 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e8afd9e8-ff3a-4919-ae7e-4c9b7966503d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.119882 Nov 27 21:00:41.131177 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2268/4391] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:41 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:41.207691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] validate_networks() for [('6f63875e-bf4a-47be-b2b4-689a7102b5e2', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:00:41.698198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b77f3b97-7277-4280-9cb4-9400a83a3cc3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:41.699313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b77f3b97-7277-4280-9cb4-9400a83a3cc3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:41.715215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b77f3b97-7277-4280-9cb4-9400a83a3cc3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:41.716752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b77f3b97-7277-4280-9cb4-9400a83a3cc3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:41.719074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b77f3b97-7277-4280-9cb4-9400a83a3cc3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:41.720016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b77f3b97-7277-4280-9cb4-9400a83a3cc3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:41.780495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b77f3b97-7277-4280-9cb4-9400a83a3cc3 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.086804 Nov 27 21:00:41.781653 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2269/4392] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:41 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:41.984683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:00:41.985268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:00:41.985898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:00:41.987812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:00:41.988513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:00:42.001376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.002137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.004336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.005010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.029181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:42.030633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:42.044060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.044777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.046677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.047123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Getting quotas for project 57166f6505f544e38ae55d9360c4f40a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:00:42.048327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.057323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Getting quotas for user ff6493e665b046a1863572bcc9553866 and project 57166f6505f544e38ae55d9360c4f40a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:00:42.076469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Going to run 3 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:00:42.079281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:00:42.121815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=fda41fee-32f6-4482-a01d-5741ce9e405e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:00:42.195467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=be17e59d-66fb-4532-a358-99abd059f136,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:00:42.305628 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8a6f20f-02bc-4d4d-adc7-4084fddb3385 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.618796 Nov 27 21:00:42.318613 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2124/4393] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:00:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:00:42.329343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b6eeaf0-21bf-4a56-a58b-fc02307cc897 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:42.332707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b6eeaf0-21bf-4a56-a58b-fc02307cc897 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:42.353355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b6eeaf0-21bf-4a56-a58b-fc02307cc897 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.353818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b6eeaf0-21bf-4a56-a58b-fc02307cc897 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.354640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b6eeaf0-21bf-4a56-a58b-fc02307cc897 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.355081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b6eeaf0-21bf-4a56-a58b-fc02307cc897 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.434692 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b6eeaf0-21bf-4a56-a58b-fc02307cc897 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.114499 Nov 27 21:00:42.438805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2125/4394] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:42 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:42.447508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:42.459676 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:42.459676 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:00:42.463818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:42.465792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:00:42.514645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.515182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.517017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.517927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.553415 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c247e64b-2ead-4aa6-973e-3064660c47ae tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.115080 Nov 27 21:00:42.554452 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2126/4395] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 21:00:42 2021] GET /compute/v2.1/servers => generated 1015 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:42.568161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31ca6f1a-6410-44f1-b133-2d93b9f81c15 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:42.570343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31ca6f1a-6410-44f1-b133-2d93b9f81c15 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:42.595797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:42.603981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d566322-2a48-4d34-a8b8-19147f74b845 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1502 microversion: 2.1 time: 0.581468 Nov 27 21:00:42.618667 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2270/4396] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:42 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1502 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:42.623815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:42.624596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:42.631739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.632130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.633133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.633748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.671122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lazy-loading 'flavor' on Instance uuid 736178dc-20e9-4ee0-b415-18983de0867b {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:00:42.765660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31ca6f1a-6410-44f1-b133-2d93b9f81c15 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:42.778840 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31ca6f1a-6410-44f1-b133-2d93b9f81c15 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1222 microversion: 2.1 time: 0.216521 Nov 27 21:00:42.782664 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2127/4397] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:42 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:42.806424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20f998e9-1d65-4534-8c8a-df864577ab8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:42.807730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20f998e9-1d65-4534-8c8a-df864577ab8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:42.822519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20f998e9-1d65-4534-8c8a-df864577ab8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.824290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20f998e9-1d65-4534-8c8a-df864577ab8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.827222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b58e05b7-d55e-43a6-a6bf-bceb444d4ffe tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "POST /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b/action" status: 202 len: 0 microversion: 2.1 time: 0.204314 Nov 27 21:00:42.828309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20f998e9-1d65-4534-8c8a-df864577ab8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.830425 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2271/4398] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:00:42 2021] POST /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:42.833650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20f998e9-1d65-4534-8c8a-df864577ab8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.852486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:42.854547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:42.866678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.867484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.869067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:42.870134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:42.912892 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20f998e9-1d65-4534-8c8a-df864577ab8d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.117444 Nov 27 21:00:42.916868 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2128/4399] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:42 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:43.264069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:43.313460 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a41c75b-cc72-424f-9aa0-90fd68f92a62 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1510 microversion: 2.1 time: 0.471706 Nov 27 21:00:43.314623 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2272/4400] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:42 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1510 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:43.448243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f3c3d7c-438c-450a-9104-e89acde43e31 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:43.449859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f3c3d7c-438c-450a-9104-e89acde43e31 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:43.492693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3c3d7c-438c-450a-9104-e89acde43e31 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:43.493557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3c3d7c-438c-450a-9104-e89acde43e31 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:43.499482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3c3d7c-438c-450a-9104-e89acde43e31 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:43.503238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f3c3d7c-438c-450a-9104-e89acde43e31 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:43.693272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f3c3d7c-438c-450a-9104-e89acde43e31 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.250436 Nov 27 21:00:43.698566 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2129/4401] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:43 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:43.803663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1d3858d-af37-4419-baad-208a39631400 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:43.804893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1d3858d-af37-4419-baad-208a39631400 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:43.941109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1000d72c-3742-42e9-971f-599651a1a487 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:43.946130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1000d72c-3742-42e9-971f-599651a1a487 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:43.995196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1000d72c-3742-42e9-971f-599651a1a487 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:43.996888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1000d72c-3742-42e9-971f-599651a1a487 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.000351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1000d72c-3742-42e9-971f-599651a1a487 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:44.002011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1000d72c-3742-42e9-971f-599651a1a487 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.130940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1000d72c-3742-42e9-971f-599651a1a487 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.204731 Nov 27 21:00:44.138631 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2130/4402] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:43 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:44.178605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f1d3858d-af37-4419-baad-208a39631400 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:44.206382 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1d3858d-af37-4419-baad-208a39631400 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1222 microversion: 2.1 time: 0.407246 Nov 27 21:00:44.220453 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2273/4403] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:43 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1222 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:44.335283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:44.336817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:44.359220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:44.361479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.364101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:44.366569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.709935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6ed6e67-6b37-4536-a32a-17eb5e8f2a16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:44.711958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e6ed6e67-6b37-4536-a32a-17eb5e8f2a16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:44.716211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:44.720411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e67-6b37-4536-a32a-17eb5e8f2a16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:44.721188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e67-6b37-4536-a32a-17eb5e8f2a16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.722249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e67-6b37-4536-a32a-17eb5e8f2a16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:44.722910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e67-6b37-4536-a32a-17eb5e8f2a16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.726955 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2c48102-235f-454f-99ef-75884473964e tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1493 microversion: 2.1 time: 0.397974 Nov 27 21:00:44.738300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2131/4404] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:44 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1493 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:44.749421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:44.749926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:44.771204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:44.772049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.772865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:44.773527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:44.789723 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6ed6e67-6b37-4536-a32a-17eb5e8f2a16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.087485 Nov 27 21:00:44.802528 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2274/4405] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:44 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:44.826856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:00:45.013891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-08231e2b-59a0-4782-b762-4f6836a55bc5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 204 len: 0 microversion: 2.1 time: 0.269126 Nov 27 21:00:45.014856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2132/4406] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:44 2021] DELETE /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:00:45.025997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:45.028499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:45.061679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.063059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.065933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.067971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.147707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62b7edb7-9a0f-4686-b1a9-aad01f2affee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:45.149116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62b7edb7-9a0f-4686-b1a9-aad01f2affee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:45.163811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b7edb7-9a0f-4686-b1a9-aad01f2affee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.166332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b7edb7-9a0f-4686-b1a9-aad01f2affee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.170977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b7edb7-9a0f-4686-b1a9-aad01f2affee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.171743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b7edb7-9a0f-4686-b1a9-aad01f2affee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.295212 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62b7edb7-9a0f-4686-b1a9-aad01f2affee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.154057 Nov 27 21:00:45.300460 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2133/4407] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:45 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:45.321278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:45.322323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:45.353343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.372413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.378294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.380279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.760783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:45.778273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6489924-c006-4635-9e52-e55e1877ae4b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1274 microversion: 2.1 time: 0.470945 Nov 27 21:00:45.778882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2134/4408] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:45 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1274 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:45.805468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a09619d8-7ea3-4d6e-aa4b-54b5380153e3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:45.806923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a09619d8-7ea3-4d6e-aa4b-54b5380153e3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:45.820817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a09619d8-7ea3-4d6e-aa4b-54b5380153e3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.823970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a09619d8-7ea3-4d6e-aa4b-54b5380153e3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.824861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a09619d8-7ea3-4d6e-aa4b-54b5380153e3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:45.825307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a09619d8-7ea3-4d6e-aa4b-54b5380153e3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:45.910645 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a09619d8-7ea3-4d6e-aa4b-54b5380153e3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.108981 Nov 27 21:00:45.915674 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2135/4409] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:45 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:46.314567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:46.315322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b423a334-6fee-42d6-86aa-1559d08b67b8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:46.317195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b423a334-6fee-42d6-86aa-1559d08b67b8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:46.327599 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac9014de-31c2-4de4-a380-de33f7d37c8f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1499 microversion: 2.1 time: 1.303814 Nov 27 21:00:46.328453 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2275/4410] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:45 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1499 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:46.392896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b423a334-6fee-42d6-86aa-1559d08b67b8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:46.394346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b423a334-6fee-42d6-86aa-1559d08b67b8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:46.405928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b423a334-6fee-42d6-86aa-1559d08b67b8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:46.407695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b423a334-6fee-42d6-86aa-1559d08b67b8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:46.514203 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b423a334-6fee-42d6-86aa-1559d08b67b8 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.202936 Nov 27 21:00:46.517853 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2136/4411] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:46 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:46.801630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:46.802423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:46.815984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:46.816468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:46.817324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:46.820237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:46.925561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74375ab2-5715-4d59-9511-802afa878f35 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:46.931345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-74375ab2-5715-4d59-9511-802afa878f35 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:46.955752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74375ab2-5715-4d59-9511-802afa878f35 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:46.956683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74375ab2-5715-4d59-9511-802afa878f35 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:46.960528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74375ab2-5715-4d59-9511-802afa878f35 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:46.961289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74375ab2-5715-4d59-9511-802afa878f35 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:46.981395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:46.999566 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4666bd42-d8ce-4808-b156-53f1cfa90fd8 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1280 microversion: 2.1 time: 0.199693 Nov 27 21:00:47.002713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2276/4412] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:46 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:47.045156 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74375ab2-5715-4d59-9511-802afa878f35 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.124592 Nov 27 21:00:47.046163 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2137/4413] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:46 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:47.352182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:47.353482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:47.367644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:47.370916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:47.373664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:47.377454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:47.528463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1594cef4-211a-49b3-a6e6-c61d3a758af7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:47.529686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1594cef4-211a-49b3-a6e6-c61d3a758af7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:47.542403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1594cef4-211a-49b3-a6e6-c61d3a758af7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:47.542403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1594cef4-211a-49b3-a6e6-c61d3a758af7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:47.547798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1594cef4-211a-49b3-a6e6-c61d3a758af7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:47.548500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1594cef4-211a-49b3-a6e6-c61d3a758af7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:47.622923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1594cef4-211a-49b3-a6e6-c61d3a758af7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.098333 Nov 27 21:00:47.624049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2138/4414] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:47 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:47.838443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:47.855609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aeb9491c-5993-4f00-8d9f-df3f559dd3a5 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1499 microversion: 2.1 time: 0.505922 Nov 27 21:00:47.859493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2277/4415] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:47 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1499 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:48.021902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:48.022701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:48.037947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.038416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.039210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.039681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.074174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb78f29f-1597-406c-b6cb-39a56413be47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:48.085385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fb78f29f-1597-406c-b6cb-39a56413be47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:48.121261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb78f29f-1597-406c-b6cb-39a56413be47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.123165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb78f29f-1597-406c-b6cb-39a56413be47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.128095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb78f29f-1597-406c-b6cb-39a56413be47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.128650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb78f29f-1597-406c-b6cb-39a56413be47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.263676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:48.276487 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fb78f29f-1597-406c-b6cb-39a56413be47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.222350 Nov 27 21:00:48.277813 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2278/4416] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:48 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:48.281526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e085f817-3b6b-45cc-9abb-5b342ede8e20 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1280 microversion: 2.1 time: 0.260073 Nov 27 21:00:48.282649 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2139/4417] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:48 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1280 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:48.284002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a30dc645-0bdc-4001-922f-717cec914aa0 req-b335575d-2120-4a39-81d6-d703c1596046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736178dc-20e9-4ee0-b415-18983de0867b", "name": "network-vif-deleted", "tag": "2744bd54-7d0a-4f87-930e-bc015c65ffb1"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:48.289763 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:48.289763 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:48.307774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a30dc645-0bdc-4001-922f-717cec914aa0 req-b335575d-2120-4a39-81d6-d703c1596046 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.308223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a30dc645-0bdc-4001-922f-717cec914aa0 req-b335575d-2120-4a39-81d6-d703c1596046 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.324695 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a30dc645-0bdc-4001-922f-717cec914aa0 req-b335575d-2120-4a39-81d6-d703c1596046 service nova] Creating event network-vif-deleted:2744bd54-7d0a-4f87-930e-bc015c65ffb1 for instance 736178dc-20e9-4ee0-b415-18983de0867b on nch2-master-1 Nov 27 21:00:48.345950 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a30dc645-0bdc-4001-922f-717cec914aa0 req-b335575d-2120-4a39-81d6-d703c1596046 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066550 Nov 27 21:00:48.346831 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2279/4418] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:48.639233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a006b4fe-f662-4e07-92da-deb2c4d341eb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:48.640403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a006b4fe-f662-4e07-92da-deb2c4d341eb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:48.663969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a006b4fe-f662-4e07-92da-deb2c4d341eb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.665268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a006b4fe-f662-4e07-92da-deb2c4d341eb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.674839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a006b4fe-f662-4e07-92da-deb2c4d341eb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.677670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a006b4fe-f662-4e07-92da-deb2c4d341eb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.814722 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a006b4fe-f662-4e07-92da-deb2c4d341eb tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.181492 Nov 27 21:00:48.820338 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2140/4419] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:48 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:48.877007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:48.878577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:48.887592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.888417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.890441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.891993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.960607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:48.961077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:48.964414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lazy-loading 'fault' on Instance uuid 736178dc-20e9-4ee0-b415-18983de0867b {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:00:49.109877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed87ef17973a49f2a9108bdfbff65415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376670c463284dec902268e55ba60b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:49.118867 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed7b73c9-9991-408d-a57e-14221cbdc1ed tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 200 len: 1304 microversion: 2.1 time: 0.246607 Nov 27 21:00:49.121524 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2280/4420] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:48 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:49.290100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aa41d0f0-ec19-4ea9-a5a3-0542bec9cb74 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:49.291123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aa41d0f0-ec19-4ea9-a5a3-0542bec9cb74 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:49.301089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:49.302023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:49.319159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:49.319728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:49.324673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:49.325159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:49.327766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa41d0f0-ec19-4ea9-a5a3-0542bec9cb74 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:49.328289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa41d0f0-ec19-4ea9-a5a3-0542bec9cb74 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:49.329676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa41d0f0-ec19-4ea9-a5a3-0542bec9cb74 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:49.330130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa41d0f0-ec19-4ea9-a5a3-0542bec9cb74 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:49.414424 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aa41d0f0-ec19-4ea9-a5a3-0542bec9cb74 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.128953 Nov 27 21:00:49.416374 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2141/4421] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:49 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:49.817920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:49.830517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5772fc7a-ae2f-438b-9aea-33237420a740 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:49.832822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5772fc7a-ae2f-438b-9aea-33237420a740 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:49.845794 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-817239b2-b354-4c36-9e9c-f9926c84f9af tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 0.549449 Nov 27 21:00:49.850238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5772fc7a-ae2f-438b-9aea-33237420a740 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:49.851472 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2281/4422] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:49 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:00:49.864001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5772fc7a-ae2f-438b-9aea-33237420a740 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:49.864865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5772fc7a-ae2f-438b-9aea-33237420a740 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:49.865316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5772fc7a-ae2f-438b-9aea-33237420a740 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:49.971072 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5772fc7a-ae2f-438b-9aea-33237420a740 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.143450 Nov 27 21:00:49.973522 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2142/4423] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:49 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:50.144620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.145250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.156349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.157321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.158144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.158567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.191476 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 736178dc-20e9-4ee0-b415-18983de0867b could not be found. Nov 27 21:00:50.192084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 736178dc-20e9-4ee0-b415-18983de0867b could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.192914 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f4f3b16-5c45-4742-b0f5-72261174828d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 404 len: 111 microversion: 2.1 time: 0.058350 Nov 27 21:00:50.193465 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2282/4424] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:50 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.205805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.206669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.222666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.223885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.227388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.228785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.255749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 736178dc-20e9-4ee0-b415-18983de0867b could not be found. Nov 27 21:00:50.257449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 736178dc-20e9-4ee0-b415-18983de0867b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.259246 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ae62ee4-9e83-4c2f-977f-d9909b4d10c0 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 404 len: 111 microversion: 2.1 time: 0.058806 Nov 27 21:00:50.260500 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2143/4425] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:50 2021] DELETE /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.277971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.279134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 736178dc-20e9-4ee0-b415-18983de0867b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.290349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.290957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.292145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.293164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.325936 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 736178dc-20e9-4ee0-b415-18983de0867b could not be found. Nov 27 21:00:50.329486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 736178dc-20e9-4ee0-b415-18983de0867b could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.331801 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-000ea6eb-c86f-4827-98b8-91000b9cd812 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b" status: 404 len: 111 microversion: 2.1 time: 0.066970 Nov 27 21:00:50.332912 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2283/4426] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:50 2021] GET /compute/v2.1/servers/736178dc-20e9-4ee0-b415-18983de0867b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.342927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.344000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.353684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.357608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.359652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.360180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.400581 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 could not be found. Nov 27 21:00:50.405789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.407894 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c45e0666-d2a3-44d7-ae22-a0da8d9be255 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 404 len: 111 microversion: 2.1 time: 0.070317 Nov 27 21:00:50.423009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.423785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2144/4427] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:50 2021] DELETE /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.424100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: c6a7be90-3883-4d01-95a0-9cc6f69fa906] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.432958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.438642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.440512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.441215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.457617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c521cb97-df4f-4a46-8756-9bf3b97c57b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:50.459330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c521cb97-df4f-4a46-8756-9bf3b97c57b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.474648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c521cb97-df4f-4a46-8756-9bf3b97c57b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.475939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c521cb97-df4f-4a46-8756-9bf3b97c57b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.477059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c521cb97-df4f-4a46-8756-9bf3b97c57b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.477742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c521cb97-df4f-4a46-8756-9bf3b97c57b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.484490 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 could not be found. Nov 27 21:00:50.488006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance c6a7be90-3883-4d01-95a0-9cc6f69fa906 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.489795 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-485bed96-f8d0-42b2-8e47-c5b00910b13d tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906" status: 404 len: 111 microversion: 2.1 time: 0.074707 Nov 27 21:00:50.498689 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2284/4428] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:50 2021] GET /compute/v2.1/servers/c6a7be90-3883-4d01-95a0-9cc6f69fa906 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:00:50.504368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.513844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.534791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.535693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.536802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.539464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.575232 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 could not be found. Nov 27 21:00:50.580801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.584627 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1474c30b-f90e-4d0d-ad40-f2439cad7fa9 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 404 len: 111 microversion: 2.1 time: 0.082143 Nov 27 21:00:50.585942 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2285/4429] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:50 2021] DELETE /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.594042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.594886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.602371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.603375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.604378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.604953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.609247 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c521cb97-df4f-4a46-8756-9bf3b97c57b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.162144 Nov 27 21:00:50.617624 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2145/4430] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:50 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:50.630750 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 could not be found. Nov 27 21:00:50.632210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.633727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b086bebf-fe92-4fd8-957d-dcc116c6af6f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0" status: 404 len: 111 microversion: 2.1 time: 0.043801 Nov 27 21:00:50.640767 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2286/4431] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:50 2021] GET /compute/v2.1/servers/23a6bdc1-0d85-4563-8ef9-f6a0a17075a0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.644195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.644844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.655744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.656124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.658165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.658614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.688108 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 9e971ee8-48a3-48e9-b448-43f691848430 could not be found. Nov 27 21:00:50.688382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 9e971ee8-48a3-48e9-b448-43f691848430 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.690133 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b01898cc-819b-42fd-b93a-a1d0c9d5ee95 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 404 len: 111 microversion: 2.1 time: 0.051144 Nov 27 21:00:50.691310 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2146/4432] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:50 2021] DELETE /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.699415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.700633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 9e971ee8-48a3-48e9-b448-43f691848430] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.711427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.712470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.713765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.714457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.750216 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 9e971ee8-48a3-48e9-b448-43f691848430 could not be found. Nov 27 21:00:50.751500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 9e971ee8-48a3-48e9-b448-43f691848430 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.753270 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75d0c374-49ff-45bc-af0c-3f931ab1f644 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430" status: 404 len: 111 microversion: 2.1 time: 0.057096 Nov 27 21:00:50.758267 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2287/4433] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:50 2021] GET /compute/v2.1/servers/9e971ee8-48a3-48e9-b448-43f691848430 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.765014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.766076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 2fab9b3d-b9f7-449d-badc-5d3e46958265] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.779035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.779932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.780755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.781202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.846089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 2fab9b3d-b9f7-449d-badc-5d3e46958265 could not be found. Nov 27 21:00:50.848817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 2fab9b3d-b9f7-449d-badc-5d3e46958265 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.849757 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92476f74-3da4-4a8b-a055-79cfaf0f2dd7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265" status: 404 len: 111 microversion: 2.1 time: 0.089950 Nov 27 21:00:50.853639 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2147/4434] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:50 2021] DELETE /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.864384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.865015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 2fab9b3d-b9f7-449d-badc-5d3e46958265] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.871905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.873031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.873999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.874608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.875701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:50.878475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:50.899620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.900081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.900895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:50.901343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:50.952952 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 2fab9b3d-b9f7-449d-badc-5d3e46958265 could not be found. Nov 27 21:00:50.956872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 2fab9b3d-b9f7-449d-badc-5d3e46958265 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:50.962168 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89bc36dc-353e-496e-8e4f-1879343fdbcf tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265" status: 404 len: 111 microversion: 2.1 time: 0.104667 Nov 27 21:00:50.967790 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2288/4435] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:50 2021] GET /compute/v2.1/servers/2fab9b3d-b9f7-449d-badc-5d3e46958265 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:50.996926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3121a4d2-a6ce-43f8-bf6f-990b63f3f2ca tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:51.000075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3121a4d2-a6ce-43f8-bf6f-990b63f3f2ca tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:51.028683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3121a4d2-a6ce-43f8-bf6f-990b63f3f2ca tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:51.030419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3121a4d2-a6ce-43f8-bf6f-990b63f3f2ca tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:51.035038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3121a4d2-a6ce-43f8-bf6f-990b63f3f2ca tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:51.036988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3121a4d2-a6ce-43f8-bf6f-990b63f3f2ca tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:51.128391 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3121a4d2-a6ce-43f8-bf6f-990b63f3f2ca tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.146247 Nov 27 21:00:51.137429 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2289/4436] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:50 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:51.505672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-71476af8-7889-436e-a520-dec528f7a94c req-f86fc37e-289a-4637-9568-b7a47bba483a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be17e59d-66fb-4532-a358-99abd059f136", "tag": "224259aa-f342-4ded-891c-82a4330a6dfa"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:51.507507 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:51.507507 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:51.527183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-71476af8-7889-436e-a520-dec528f7a94c req-f86fc37e-289a-4637-9568-b7a47bba483a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:51.528518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-71476af8-7889-436e-a520-dec528f7a94c req-f86fc37e-289a-4637-9568-b7a47bba483a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:51.587412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-71476af8-7889-436e-a520-dec528f7a94c req-f86fc37e-289a-4637-9568-b7a47bba483a service nova] Creating event network-changed:224259aa-f342-4ded-891c-82a4330a6dfa for instance be17e59d-66fb-4532-a358-99abd059f136 on nch2-master-1 Nov 27 21:00:51.600825 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-71476af8-7889-436e-a520-dec528f7a94c req-f86fc37e-289a-4637-9568-b7a47bba483a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102807 Nov 27 21:00:51.604182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2290/4437] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:00:51.624031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c4c090e-a25c-46a1-a061-bee9f24dca2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:51.626704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c4c090e-a25c-46a1-a061-bee9f24dca2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:51.637936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4c090e-a25c-46a1-a061-bee9f24dca2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:51.639212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4c090e-a25c-46a1-a061-bee9f24dca2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:51.640544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4c090e-a25c-46a1-a061-bee9f24dca2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:51.642861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4c090e-a25c-46a1-a061-bee9f24dca2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:51.718427 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c4c090e-a25c-46a1-a061-bee9f24dca2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.099335 Nov 27 21:00:51.720492 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2291/4438] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:51 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:51.885877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:51.893729 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a512098-ef75-41e1-96e2-7f2d4682daa5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 1.029732 Nov 27 21:00:51.894308 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2148/4439] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:50 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:52.148894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6621106c-da98-471a-8752-fa7b9bdf5e74 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:52.150118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6621106c-da98-471a-8752-fa7b9bdf5e74 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:52.187151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6621106c-da98-471a-8752-fa7b9bdf5e74 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.193601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6621106c-da98-471a-8752-fa7b9bdf5e74 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.196851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6621106c-da98-471a-8752-fa7b9bdf5e74 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.200010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6621106c-da98-471a-8752-fa7b9bdf5e74 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.234813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:52.237137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:52.257017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.257674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.258394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.258852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.317261 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. Nov 27 21:00:52.317948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:52.326096 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b88ff881-0636-463a-902d-bcd1ee88c9ff tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 404 len: 111 microversion: 2.1 time: 0.088653 Nov 27 21:00:52.326736 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2149/4440] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:52 2021] DELETE /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:52.339284 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6621106c-da98-471a-8752-fa7b9bdf5e74 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.199419 Nov 27 21:00:52.345449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:52.348560 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2292/4441] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:52 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:52.351026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 49c2b87a-8405-4308-a621-10f0104e888d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:52.374855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.388874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.391894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.393973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.427712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. Nov 27 21:00:52.428508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 49c2b87a-8405-4308-a621-10f0104e888d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:52.429480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc537d07-0b16-445f-8a6e-d8532d347513 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d" status: 404 len: 111 microversion: 2.1 time: 0.097023 Nov 27 21:00:52.430692 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2150/4442] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:52 2021] GET /compute/v2.1/servers/49c2b87a-8405-4308-a621-10f0104e888d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:52.443199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:52.445226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:52.467032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.467766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.469984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.471902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.495715 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 0c7841b8-818f-485c-b789-e010446bd1cf could not be found. Nov 27 21:00:52.496652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 0c7841b8-818f-485c-b789-e010446bd1cf could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:52.497910 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5993d813-be67-4cce-af13-1dd29ca2cd5f tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 404 len: 111 microversion: 2.1 time: 0.062928 Nov 27 21:00:52.498664 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2293/4443] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:00:52 2021] DELETE /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:00:52.507941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:52.508945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] [instance: 0c7841b8-818f-485c-b789-e010446bd1cf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:52.519484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.520722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.522009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.522721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.543426 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] HTTP exception thrown: Instance 0c7841b8-818f-485c-b789-e010446bd1cf could not be found. Nov 27 21:00:52.544143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] Returning 404 to user: Instance 0c7841b8-818f-485c-b789-e010446bd1cf could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:00:52.545315 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bec77915-27aa-4b81-954d-5d8bb840d7d7 tempest-DeleteServersTestJSON-1501646271 tempest-DeleteServersTestJSON-1501646271-project] 10.222.0.21 "GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf" status: 404 len: 111 microversion: 2.1 time: 0.041843 Nov 27 21:00:52.546313 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2151/4444] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:52 2021] GET /compute/v2.1/servers/0c7841b8-818f-485c-b789-e010446bd1cf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:52.733075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19d45b15-08b6-4180-9117-5f0162326b19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:52.734139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19d45b15-08b6-4180-9117-5f0162326b19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:52.764425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d45b15-08b6-4180-9117-5f0162326b19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.767636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d45b15-08b6-4180-9117-5f0162326b19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.770498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d45b15-08b6-4180-9117-5f0162326b19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.771934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19d45b15-08b6-4180-9117-5f0162326b19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.886552 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19d45b15-08b6-4180-9117-5f0162326b19 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.157929 Nov 27 21:00:52.892246 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2294/4445] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:52 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:52.911729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:52.912469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:52.933891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.937520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:52.941456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:52.943002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:53.148252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-76c9e1de-045c-464e-ad65-81d1c6a26fc1 req-05a6d296-a856-4615-b58a-be7bbafdbf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029c8f1e-d549-4ac9-8ebe-6e110271af7d", "tag": "e28bdabf-8e3c-4ac0-a725-ed8d1d6d2f2d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:53.149570 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:53.149570 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:53.169353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-76c9e1de-045c-464e-ad65-81d1c6a26fc1 req-05a6d296-a856-4615-b58a-be7bbafdbf8d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:53.169865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-76c9e1de-045c-464e-ad65-81d1c6a26fc1 req-05a6d296-a856-4615-b58a-be7bbafdbf8d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:53.207533 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-76c9e1de-045c-464e-ad65-81d1c6a26fc1 req-05a6d296-a856-4615-b58a-be7bbafdbf8d service nova] Creating event network-changed:e28bdabf-8e3c-4ac0-a725-ed8d1d6d2f2d for instance 029c8f1e-d549-4ac9-8ebe-6e110271af7d on nch1-master-1 Nov 27 21:00:53.218510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-76c9e1de-045c-464e-ad65-81d1c6a26fc1 req-05a6d296-a856-4615-b58a-be7bbafdbf8d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074426 Nov 27 21:00:53.220829 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2295/4446] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:00:53.357628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc824ffe-1ac5-4a5c-89d9-c6bcdc62d73c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:53.359100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc824ffe-1ac5-4a5c-89d9-c6bcdc62d73c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:53.376370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc824ffe-1ac5-4a5c-89d9-c6bcdc62d73c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:53.377714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc824ffe-1ac5-4a5c-89d9-c6bcdc62d73c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:53.380442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc824ffe-1ac5-4a5c-89d9-c6bcdc62d73c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:53.384030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc824ffe-1ac5-4a5c-89d9-c6bcdc62d73c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:53.523229 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc824ffe-1ac5-4a5c-89d9-c6bcdc62d73c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.171659 Nov 27 21:00:53.527157 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2296/4447] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:53 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:53.900528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3217e4d-90ab-42cd-aaff-088d97f14de5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:53.905663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d3217e4d-90ab-42cd-aaff-088d97f14de5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:53.922083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3217e4d-90ab-42cd-aaff-088d97f14de5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:53.926489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3217e4d-90ab-42cd-aaff-088d97f14de5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:53.929349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3217e4d-90ab-42cd-aaff-088d97f14de5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:53.931917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3217e4d-90ab-42cd-aaff-088d97f14de5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:54.023966 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3217e4d-90ab-42cd-aaff-088d97f14de5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.127884 Nov 27 21:00:54.025076 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2297/4448] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:53 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:54.269262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d43d530e-256e-4609-80b4-dfea8fdb2995 req-18762ca2-fd29-487f-983e-d98a12e171d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda41fee-32f6-4482-a01d-5741ce9e405e", "tag": "6a817425-e604-4c3b-8fd2-825b29553f9f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:54.271117 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:54.271117 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:54.287799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d43d530e-256e-4609-80b4-dfea8fdb2995 req-18762ca2-fd29-487f-983e-d98a12e171d5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:54.291813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d43d530e-256e-4609-80b4-dfea8fdb2995 req-18762ca2-fd29-487f-983e-d98a12e171d5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:54.319862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d43d530e-256e-4609-80b4-dfea8fdb2995 req-18762ca2-fd29-487f-983e-d98a12e171d5 service nova] Creating event network-changed:6a817425-e604-4c3b-8fd2-825b29553f9f for instance fda41fee-32f6-4482-a01d-5741ce9e405e on nch1-master-1 Nov 27 21:00:54.332090 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d43d530e-256e-4609-80b4-dfea8fdb2995 req-18762ca2-fd29-487f-983e-d98a12e171d5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066813 Nov 27 21:00:54.332754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2298/4449] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:00:54.539334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-111dea17-6a93-4682-beb7-b38c0a326ef1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:54.540882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-111dea17-6a93-4682-beb7-b38c0a326ef1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:54.551451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:54.567388 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b34205ed-13e6-4c93-9921-3d66eeff6986 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 1.661074 Nov 27 21:00:54.568365 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2152/4450] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:52 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:54.569183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-111dea17-6a93-4682-beb7-b38c0a326ef1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:54.569915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-111dea17-6a93-4682-beb7-b38c0a326ef1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:54.571234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-111dea17-6a93-4682-beb7-b38c0a326ef1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:54.571927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-111dea17-6a93-4682-beb7-b38c0a326ef1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:54.639752 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-111dea17-6a93-4682-beb7-b38c0a326ef1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.101919 Nov 27 21:00:54.642967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2299/4451] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:54 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:55.041130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-361a0d9a-df63-47cb-8b97-7c623d02a939 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:55.042180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-361a0d9a-df63-47cb-8b97-7c623d02a939 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:55.050464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-361a0d9a-df63-47cb-8b97-7c623d02a939 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:55.050827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-361a0d9a-df63-47cb-8b97-7c623d02a939 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:55.051725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-361a0d9a-df63-47cb-8b97-7c623d02a939 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:55.052494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-361a0d9a-df63-47cb-8b97-7c623d02a939 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:55.101137 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-361a0d9a-df63-47cb-8b97-7c623d02a939 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.064894 Nov 27 21:00:55.102571 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2153/4452] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:55 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:55.589021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:55.590869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:55.604617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:55.605141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:55.605956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:55.608844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:55.655072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5c0d190d-718e-437f-b21a-1e4ab56097ef tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:55.657151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5c0d190d-718e-437f-b21a-1e4ab56097ef tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:55.673602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c0d190d-718e-437f-b21a-1e4ab56097ef tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:55.677208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c0d190d-718e-437f-b21a-1e4ab56097ef tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:55.681458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c0d190d-718e-437f-b21a-1e4ab56097ef tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:55.682406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c0d190d-718e-437f-b21a-1e4ab56097ef tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:55.751297 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5c0d190d-718e-437f-b21a-1e4ab56097ef tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.098265 Nov 27 21:00:55.754612 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2154/4453] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:55 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:00:56.122788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77316bdb-446b-4757-a4fb-b8a565a270f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:56.124484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77316bdb-446b-4757-a4fb-b8a565a270f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:56.137595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77316bdb-446b-4757-a4fb-b8a565a270f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:56.138213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77316bdb-446b-4757-a4fb-b8a565a270f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:56.139076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77316bdb-446b-4757-a4fb-b8a565a270f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:56.139656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77316bdb-446b-4757-a4fb-b8a565a270f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:56.207704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:56.221456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-584b99b3-1144-41a6-84df-cbb9ddc2ce3a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 0.636413 Nov 27 21:00:56.222412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2300/4454] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:55 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:56.242639 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77316bdb-446b-4757-a4fb-b8a565a270f0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.128541 Nov 27 21:00:56.248899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2155/4455] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:56 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:56.772113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49db0c49-7e2d-4f1a-92fa-3e9832843a40 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:56.775497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-49db0c49-7e2d-4f1a-92fa-3e9832843a40 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:56.796435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49db0c49-7e2d-4f1a-92fa-3e9832843a40 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:56.798976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49db0c49-7e2d-4f1a-92fa-3e9832843a40 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:56.800134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49db0c49-7e2d-4f1a-92fa-3e9832843a40 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:56.800810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49db0c49-7e2d-4f1a-92fa-3e9832843a40 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:56.914184 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49db0c49-7e2d-4f1a-92fa-3e9832843a40 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.151295 Nov 27 21:00:56.915702 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2301/4456] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:56 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:57.242157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:57.244232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:57.257693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85b591b0-6242-4578-8645-e8399955a39b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:57.259232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85b591b0-6242-4578-8645-e8399955a39b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:57.282384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b591b0-6242-4578-8645-e8399955a39b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:57.284798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:57.287294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b591b0-6242-4578-8645-e8399955a39b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:57.290265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b591b0-6242-4578-8645-e8399955a39b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:57.291053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:57.295179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:57.296553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b591b0-6242-4578-8645-e8399955a39b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:57.300287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:57.367550 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85b591b0-6242-4578-8645-e8399955a39b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.112844 Nov 27 21:00:57.370462 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2302/4457] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:57 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:57.657067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:57.665720 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-adf72743-5bbf-4411-b3d1-502fcf2890b1 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 0.429606 Nov 27 21:00:57.669596 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2156/4458] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:57 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:57.927787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45e83c65-ba94-4d8b-8273-9e959a58e6ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:57.929023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45e83c65-ba94-4d8b-8273-9e959a58e6ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:57.949942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45e83c65-ba94-4d8b-8273-9e959a58e6ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:57.950396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45e83c65-ba94-4d8b-8273-9e959a58e6ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:57.953877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45e83c65-ba94-4d8b-8273-9e959a58e6ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:57.955102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45e83c65-ba94-4d8b-8273-9e959a58e6ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:58.044016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45e83c65-ba94-4d8b-8273-9e959a58e6ad tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.118891 Nov 27 21:00:58.045819 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2303/4459] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:57 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:58.386900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1536509f-4ab3-4849-b0ff-a9a296ea137b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:58.388005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1536509f-4ab3-4849-b0ff-a9a296ea137b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:58.400649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1536509f-4ab3-4849-b0ff-a9a296ea137b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:58.401396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1536509f-4ab3-4849-b0ff-a9a296ea137b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:58.403660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1536509f-4ab3-4849-b0ff-a9a296ea137b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:58.404977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1536509f-4ab3-4849-b0ff-a9a296ea137b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:58.502888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1536509f-4ab3-4849-b0ff-a9a296ea137b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.119521 Nov 27 21:00:58.510316 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2157/4460] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:58 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:58.689654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:58.691650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:58.706973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:58.707504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:58.708282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:58.708828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:58.957572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:00:58.974172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c2ac375-f8d4-4a7a-8899-c143f73dc1c6 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 0.290803 Nov 27 21:00:58.974959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2304/4461] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:58 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:00:59.068574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ca3bf8c-af14-4316-83ad-62060d18fcac tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:59.073246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ca3bf8c-af14-4316-83ad-62060d18fcac tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:59.087798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ca3bf8c-af14-4316-83ad-62060d18fcac tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:59.089069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ca3bf8c-af14-4316-83ad-62060d18fcac tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:59.090568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ca3bf8c-af14-4316-83ad-62060d18fcac tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:59.092881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ca3bf8c-af14-4316-83ad-62060d18fcac tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:59.160147 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ca3bf8c-af14-4316-83ad-62060d18fcac tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.102792 Nov 27 21:00:59.166627 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2158/4462] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:59 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:59.518384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd2ce4bb-29c6-47b2-9eb9-3b23b6dd5a8c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:59.520259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd2ce4bb-29c6-47b2-9eb9-3b23b6dd5a8c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:00:59.529228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4bb-29c6-47b2-9eb9-3b23b6dd5a8c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:59.529918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4bb-29c6-47b2-9eb9-3b23b6dd5a8c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:59.531748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4bb-29c6-47b2-9eb9-3b23b6dd5a8c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:59.532495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4bb-29c6-47b2-9eb9-3b23b6dd5a8c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:59.587035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd2ce4bb-29c6-47b2-9eb9-3b23b6dd5a8c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.073902 Nov 27 21:00:59.588198 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2159/4463] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:00:59 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:00:59.603771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-51abdf68-377d-431f-a926-697bffbf0c5f req-c887e281-55e8-423d-977a-6aa114fc16d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be17e59d-66fb-4532-a358-99abd059f136", "name": "network-vif-plugged", "status": "completed", "tag": "224259aa-f342-4ded-891c-82a4330a6dfa"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:00:59.606344 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:59.606344 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:00:59.620780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-51abdf68-377d-431f-a926-697bffbf0c5f req-c887e281-55e8-423d-977a-6aa114fc16d7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:00:59.621547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-51abdf68-377d-431f-a926-697bffbf0c5f req-c887e281-55e8-423d-977a-6aa114fc16d7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:00:59.639579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-51abdf68-377d-431f-a926-697bffbf0c5f req-c887e281-55e8-423d-977a-6aa114fc16d7 service nova] Creating event network-vif-plugged:224259aa-f342-4ded-891c-82a4330a6dfa for instance be17e59d-66fb-4532-a358-99abd059f136 on nch2-master-1 Nov 27 21:00:59.647968 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-51abdf68-377d-431f-a926-697bffbf0c5f req-c887e281-55e8-423d-977a-6aa114fc16d7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372821 Nov 27 21:00:59.649679 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2305/4464] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:00:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:00:59.994802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:00:59.996076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:00.008577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:00.009330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:00.010452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:00.011094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:00.181967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-579dd15a-6de3-4970-867c-e887b1e1b643 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:00.182762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-579dd15a-6de3-4970-867c-e887b1e1b643 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:00.198172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-579dd15a-6de3-4970-867c-e887b1e1b643 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:00.198964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-579dd15a-6de3-4970-867c-e887b1e1b643 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:00.199842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-579dd15a-6de3-4970-867c-e887b1e1b643 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:00.201704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-579dd15a-6de3-4970-867c-e887b1e1b643 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:00.285181 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-579dd15a-6de3-4970-867c-e887b1e1b643 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.114482 Nov 27 21:01:00.286219 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2306/4465] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:00 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:00.357171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:00.378018 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0872fb8b-a06b-4ee4-8c24-2f6cf5f65ef4 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 0.387486 Nov 27 21:01:00.378960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2160/4466] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:00:59 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:00.607938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0ad6b4b-4a7c-43cd-8643-be5be4d727d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:00.616308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0ad6b4b-4a7c-43cd-8643-be5be4d727d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:00.635747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0ad6b4b-4a7c-43cd-8643-be5be4d727d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:00.636396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0ad6b4b-4a7c-43cd-8643-be5be4d727d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:00.638467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0ad6b4b-4a7c-43cd-8643-be5be4d727d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:00.641865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0ad6b4b-4a7c-43cd-8643-be5be4d727d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:00.772086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0ad6b4b-4a7c-43cd-8643-be5be4d727d4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.174948 Nov 27 21:01:00.778663 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2307/4467] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:00 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:01.298038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-994a8b97-416e-475a-bfdd-ae38c65f0c7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:01.298989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-994a8b97-416e-475a-bfdd-ae38c65f0c7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:01.310275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-994a8b97-416e-475a-bfdd-ae38c65f0c7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:01.310815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-994a8b97-416e-475a-bfdd-ae38c65f0c7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:01.315429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-994a8b97-416e-475a-bfdd-ae38c65f0c7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:01.315937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-994a8b97-416e-475a-bfdd-ae38c65f0c7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:01.396678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:01.397510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:01.410324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:01.410785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:01.413953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:01.414463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:01.418260 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-994a8b97-416e-475a-bfdd-ae38c65f0c7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.124451 Nov 27 21:01:01.422820 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2161/4468] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:01 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:01.668625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5e876247-204c-4fe6-ac7c-ffd8ae979b6b req-8d63aae7-c9fd-49b6-b160-c55e050a0015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029c8f1e-d549-4ac9-8ebe-6e110271af7d", "name": "network-vif-plugged", "status": "completed", "tag": "e28bdabf-8e3c-4ac0-a725-ed8d1d6d2f2d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:01.672340 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:01.672340 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:01.681750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5e876247-204c-4fe6-ac7c-ffd8ae979b6b req-8d63aae7-c9fd-49b6-b160-c55e050a0015 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:01.682597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5e876247-204c-4fe6-ac7c-ffd8ae979b6b req-8d63aae7-c9fd-49b6-b160-c55e050a0015 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:01.699857 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5e876247-204c-4fe6-ac7c-ffd8ae979b6b req-8d63aae7-c9fd-49b6-b160-c55e050a0015 service nova] Creating event network-vif-plugged:e28bdabf-8e3c-4ac0-a725-ed8d1d6d2f2d for instance 029c8f1e-d549-4ac9-8ebe-6e110271af7d on nch1-master-1 Nov 27 21:01:01.708357 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5e876247-204c-4fe6-ac7c-ffd8ae979b6b req-8d63aae7-c9fd-49b6-b160-c55e050a0015 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044983 Nov 27 21:01:01.710862 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2162/4469] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:01.763746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:01.788651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-51ed270a-38dc-419b-b3b4-3fc6aa2256b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:01.790033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-51ed270a-38dc-419b-b3b4-3fc6aa2256b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:01.808260 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40b80876-660e-4c81-8083-f47b76a92a1c tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 0.412537 Nov 27 21:01:01.813967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2308/4470] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:01 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:01.819806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51ed270a-38dc-419b-b3b4-3fc6aa2256b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:01.820984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51ed270a-38dc-419b-b3b4-3fc6aa2256b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:01.822145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51ed270a-38dc-419b-b3b4-3fc6aa2256b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:01.822814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51ed270a-38dc-419b-b3b4-3fc6aa2256b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:01.950872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-51ed270a-38dc-419b-b3b4-3fc6aa2256b3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.161933 Nov 27 21:01:01.950872 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2163/4471] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:01 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:02.439771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df86e492-012a-4612-8d92-d3461941b70b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:02.455083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-df86e492-012a-4612-8d92-d3461941b70b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:02.473046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df86e492-012a-4612-8d92-d3461941b70b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:02.474459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df86e492-012a-4612-8d92-d3461941b70b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:02.478203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df86e492-012a-4612-8d92-d3461941b70b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:02.478765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df86e492-012a-4612-8d92-d3461941b70b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:02.581482 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df86e492-012a-4612-8d92-d3461941b70b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.147377 Nov 27 21:01:02.582467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2309/4472] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:02 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:02.831950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:02.833372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:02.841916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:02.842741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:02.844634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:02.845301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:02.974657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a88b58e4-af4c-48bd-b2af-713f5d8360f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:02.979312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a88b58e4-af4c-48bd-b2af-713f5d8360f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:02.994431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a88b58e4-af4c-48bd-b2af-713f5d8360f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:02.995575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a88b58e4-af4c-48bd-b2af-713f5d8360f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:02.999004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a88b58e4-af4c-48bd-b2af-713f5d8360f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:03.000068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a88b58e4-af4c-48bd-b2af-713f5d8360f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:03.074613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a88b58e4-af4c-48bd-b2af-713f5d8360f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.119762 Nov 27 21:01:03.076247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2310/4473] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:02 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:03.268411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:03.276184 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-04003371-a963-4e0d-94f6-310407b7310a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1322 microversion: 2.1 time: 0.449538 Nov 27 21:01:03.289023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2164/4474] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:02 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:03.598403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b4b66c9-34b1-4d19-89b9-9b9ebb43b6a7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:03.599525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6b4b66c9-34b1-4d19-89b9-9b9ebb43b6a7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:03.610136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4b66c9-34b1-4d19-89b9-9b9ebb43b6a7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:03.610588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4b66c9-34b1-4d19-89b9-9b9ebb43b6a7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:03.611413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4b66c9-34b1-4d19-89b9-9b9ebb43b6a7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:03.611852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4b66c9-34b1-4d19-89b9-9b9ebb43b6a7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:03.710256 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b4b66c9-34b1-4d19-89b9-9b9ebb43b6a7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.117290 Nov 27 21:01:03.714783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2311/4475] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:03 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:04.088935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e6e6bfb-49b1-4c75-9ac1-c07818823cb7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:04.090195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e6e6bfb-49b1-4c75-9ac1-c07818823cb7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:04.107481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e6e6bfb-49b1-4c75-9ac1-c07818823cb7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.108718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e6e6bfb-49b1-4c75-9ac1-c07818823cb7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.111793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e6e6bfb-49b1-4c75-9ac1-c07818823cb7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.112335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e6e6bfb-49b1-4c75-9ac1-c07818823cb7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.196889 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e6e6bfb-49b1-4c75-9ac1-c07818823cb7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.113692 Nov 27 21:01:04.197849 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2165/4476] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:04 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:04.295586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:04.297253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:04.309031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.317599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.319128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.320043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.502434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-46ba88a2-9d51-4a56-ae19-c3f444f7dce2 req-1d4ad6ed-1d62-47aa-b0b6-fe55aa12473b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda41fee-32f6-4482-a01d-5741ce9e405e", "name": "network-vif-plugged", "status": "completed", "tag": "6a817425-e604-4c3b-8fd2-825b29553f9f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:04.504813 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:04.504813 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:04.521530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-46ba88a2-9d51-4a56-ae19-c3f444f7dce2 req-1d4ad6ed-1d62-47aa-b0b6-fe55aa12473b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.522422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-46ba88a2-9d51-4a56-ae19-c3f444f7dce2 req-1d4ad6ed-1d62-47aa-b0b6-fe55aa12473b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.547021 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-46ba88a2-9d51-4a56-ae19-c3f444f7dce2 req-1d4ad6ed-1d62-47aa-b0b6-fe55aa12473b service nova] Creating event network-vif-plugged:6a817425-e604-4c3b-8fd2-825b29553f9f for instance fda41fee-32f6-4482-a01d-5741ce9e405e on nch1-master-1 Nov 27 21:01:04.557524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-46ba88a2-9d51-4a56-ae19-c3f444f7dce2 req-1d4ad6ed-1d62-47aa-b0b6-fe55aa12473b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062301 Nov 27 21:01:04.560982 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2166/4477] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:04.681713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:04.691352 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-095e0a3a-ddc7-4b84-b462-c4ed8f90f7b2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 200 len: 1515 microversion: 2.1 time: 0.401693 Nov 27 21:01:04.695050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2312/4478] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:04 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 1515 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:04.711530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:04.712895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:04.722729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37a12f95-2da4-4d28-9dc5-adf276d94b07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:04.724288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37a12f95-2da4-4d28-9dc5-adf276d94b07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:04.729795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.730335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.732911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.733372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.746291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37a12f95-2da4-4d28-9dc5-adf276d94b07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.747786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37a12f95-2da4-4d28-9dc5-adf276d94b07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.751454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37a12f95-2da4-4d28-9dc5-adf276d94b07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:04.752122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37a12f95-2da4-4d28-9dc5-adf276d94b07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:04.824366 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37a12f95-2da4-4d28-9dc5-adf276d94b07 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.102563 Nov 27 21:01:04.831462 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2313/4479] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:04 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:05.090866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:05.100284 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-758c3b19-0d3a-4833-8978-a0f920380faa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136" status: 200 len: 1515 microversion: 2.1 time: 0.394773 Nov 27 21:01:05.111457 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2167/4480] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:04 2021] GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136 => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:05.116592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:05.117503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:05.125783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:05.126610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:05.127672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:05.128348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:05.209461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-416c1dbb-b642-4181-9904-6f84dfd65c6b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:05.210799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-416c1dbb-b642-4181-9904-6f84dfd65c6b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:05.219205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416c1dbb-b642-4181-9904-6f84dfd65c6b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:05.220392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416c1dbb-b642-4181-9904-6f84dfd65c6b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:05.221430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416c1dbb-b642-4181-9904-6f84dfd65c6b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:05.222125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-416c1dbb-b642-4181-9904-6f84dfd65c6b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:05.303676 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-416c1dbb-b642-4181-9904-6f84dfd65c6b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.097586 Nov 27 21:01:05.307688 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2168/4481] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:05 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:05.543866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:05.557090 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39190b55-88b7-4d2e-94cf-7280cc93eef3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 200 len: 1322 microversion: 2.1 time: 0.444282 Nov 27 21:01:05.558402 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2314/4482] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:05 2021] GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:05.839546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90c04a3f-6dd9-427e-a1b7-19fcab6f52f9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:05.841418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90c04a3f-6dd9-427e-a1b7-19fcab6f52f9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:05.852151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c04a3f-6dd9-427e-a1b7-19fcab6f52f9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:05.852947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c04a3f-6dd9-427e-a1b7-19fcab6f52f9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:05.854233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c04a3f-6dd9-427e-a1b7-19fcab6f52f9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:05.854945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c04a3f-6dd9-427e-a1b7-19fcab6f52f9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:05.912715 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90c04a3f-6dd9-427e-a1b7-19fcab6f52f9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078061 Nov 27 21:01:05.913279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2169/4483] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:05 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:06.318476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23da5a9d-a2c0-4316-ace9-b67322be7fef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:06.319984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23da5a9d-a2c0-4316-ace9-b67322be7fef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:06.329776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23da5a9d-a2c0-4316-ace9-b67322be7fef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.345849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23da5a9d-a2c0-4316-ace9-b67322be7fef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:06.348795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23da5a9d-a2c0-4316-ace9-b67322be7fef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.349785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23da5a9d-a2c0-4316-ace9-b67322be7fef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:06.404794 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23da5a9d-a2c0-4316-ace9-b67322be7fef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.090610 Nov 27 21:01:06.406415 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2315/4484] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:06 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:06.577164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:06.577912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:06.591286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.593901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:06.597006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.597502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:06.921643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:06.929407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a606bd43-1e1e-4221-90a2-159990ab32d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:06.930480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a606bd43-1e1e-4221-90a2-159990ab32d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:06.936016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8a406ec-37b1-47ac-a2ca-40e4b3b763aa tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 200 len: 1514 microversion: 2.1 time: 0.361073 Nov 27 21:01:06.938364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a606bd43-1e1e-4221-90a2-159990ab32d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.940643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a606bd43-1e1e-4221-90a2-159990ab32d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:06.943151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a606bd43-1e1e-4221-90a2-159990ab32d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.947921 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2170/4485] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:06 2021] GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 1514 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:06.948233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a606bd43-1e1e-4221-90a2-159990ab32d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:06.957039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:06.959732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:06.983642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.984268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:06.994751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:06.995314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:07.057425 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a606bd43-1e1e-4221-90a2-159990ab32d0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.132603 Nov 27 21:01:07.058367 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2316/4486] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:06 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:07.058632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:01:07.212872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54e2112a-5944-4c6c-94be-ebd2c02cf168 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 204 len: 0 microversion: 2.1 time: 0.262471 Nov 27 21:01:07.214391 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2171/4487] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:01:06 2021] DELETE /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:01:07.222682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:07.223420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:07.236990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:07.239050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:07.243626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:07.245065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:07.423127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-019f2ae1-195e-4c98-834f-9ad3d891f744 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:07.433437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-019f2ae1-195e-4c98-834f-9ad3d891f744 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:07.452657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019f2ae1-195e-4c98-834f-9ad3d891f744 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:07.455814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019f2ae1-195e-4c98-834f-9ad3d891f744 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:07.456772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019f2ae1-195e-4c98-834f-9ad3d891f744 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:07.458283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-019f2ae1-195e-4c98-834f-9ad3d891f744 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:07.532575 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-019f2ae1-195e-4c98-834f-9ad3d891f744 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.117778 Nov 27 21:01:07.533355 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2172/4488] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:07 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:07.566938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:07.579446 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88229de8-51c4-4f52-857e-8fbc114b6766 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 200 len: 1520 microversion: 2.1 time: 0.359183 Nov 27 21:01:07.580207 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2317/4489] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:07 2021] GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:08.075980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f59a3f5-2d8e-4a5c-873f-5a0f7bec2cea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:08.077833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f59a3f5-2d8e-4a5c-873f-5a0f7bec2cea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:08.091989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f59a3f5-2d8e-4a5c-873f-5a0f7bec2cea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:08.092839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f59a3f5-2d8e-4a5c-873f-5a0f7bec2cea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:08.094450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f59a3f5-2d8e-4a5c-873f-5a0f7bec2cea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:08.095146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f59a3f5-2d8e-4a5c-873f-5a0f7bec2cea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:08.162497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f59a3f5-2d8e-4a5c-873f-5a0f7bec2cea tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.096275 Nov 27 21:01:08.164115 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2173/4490] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:08 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:08.544797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4eefb576-0f1a-43ef-b881-0c3cfdd26aba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:08.545740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4eefb576-0f1a-43ef-b881-0c3cfdd26aba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:08.557371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eefb576-0f1a-43ef-b881-0c3cfdd26aba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:08.557725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eefb576-0f1a-43ef-b881-0c3cfdd26aba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:08.560397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eefb576-0f1a-43ef-b881-0c3cfdd26aba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:08.564337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eefb576-0f1a-43ef-b881-0c3cfdd26aba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:08.598536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:08.599238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:08.651946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:08.652413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:08.662128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:08.665020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:08.697189 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4eefb576-0f1a-43ef-b881-0c3cfdd26aba tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.155770 Nov 27 21:01:08.699927 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2318/4491] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:08 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:09.180651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fef308d-a973-496c-9b44-a8d8c9e4aa65 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:09.181811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fef308d-a973-496c-9b44-a8d8c9e4aa65 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:09.197683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef308d-a973-496c-9b44-a8d8c9e4aa65 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:09.200301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef308d-a973-496c-9b44-a8d8c9e4aa65 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:09.202465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef308d-a973-496c-9b44-a8d8c9e4aa65 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:09.204204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fef308d-a973-496c-9b44-a8d8c9e4aa65 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:09.220001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:09.234770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74486625-52fe-44d6-9194-93a52b0eb10f tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 200 len: 1520 microversion: 2.1 time: 0.639964 Nov 27 21:01:09.238518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2174/4492] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:08 2021] GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 1520 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:09.338297 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fef308d-a973-496c-9b44-a8d8c9e4aa65 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.163820 Nov 27 21:01:09.342344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2319/4493] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:09 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:09.710284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b7d8192-c564-45b0-8f27-d7b39348c03d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:09.711218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b7d8192-c564-45b0-8f27-d7b39348c03d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:09.732136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b7d8192-c564-45b0-8f27-d7b39348c03d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:09.732597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b7d8192-c564-45b0-8f27-d7b39348c03d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:09.733403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b7d8192-c564-45b0-8f27-d7b39348c03d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:09.734478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b7d8192-c564-45b0-8f27-d7b39348c03d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:09.801935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b7d8192-c564-45b0-8f27-d7b39348c03d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.095461 Nov 27 21:01:09.802983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2175/4494] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:09 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:10.255289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:10.256997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:10.273836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:10.285021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:10.285816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:10.290839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:10.558006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:10.587945 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49f72cdc-7c25-41a9-8853-979a3b7f0164 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 200 len: 1478 microversion: 2.1 time: 0.336697 Nov 27 21:01:10.589225 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2176/4495] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:10 2021] GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 1478 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:10.601933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-adddd65f-fa81-4219-9695-10fb4cf2dd61 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:10.603004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-adddd65f-fa81-4219-9695-10fb4cf2dd61 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:10.633595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adddd65f-fa81-4219-9695-10fb4cf2dd61 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:10.634211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adddd65f-fa81-4219-9695-10fb4cf2dd61 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:10.638519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adddd65f-fa81-4219-9695-10fb4cf2dd61 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:10.639118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adddd65f-fa81-4219-9695-10fb4cf2dd61 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:10.662662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1014329892", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef6c6178-d8bd-4309-ba9b-3100431bc7eb"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:10.744533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-adddd65f-fa81-4219-9695-10fb4cf2dd61 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.149986 Nov 27 21:01:10.751301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2177/4496] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:10 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:10.826553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] validate_networks() for [('ef6c6178-d8bd-4309-ba9b-3100431bc7eb', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:01:11.237498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b7824629-11c3-4c05-8ee3-2c52a02dedea req-a003bca7-01c8-496a-96d9-9bf3334beb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda41fee-32f6-4482-a01d-5741ce9e405e", "name": "network-vif-deleted", "tag": "6a817425-e604-4c3b-8fd2-825b29553f9f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:11.239148 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:11.239148 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:11.251237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b7824629-11c3-4c05-8ee3-2c52a02dedea req-a003bca7-01c8-496a-96d9-9bf3334beb8e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.253761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b7824629-11c3-4c05-8ee3-2c52a02dedea req-a003bca7-01c8-496a-96d9-9bf3334beb8e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.277414 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b7824629-11c3-4c05-8ee3-2c52a02dedea req-a003bca7-01c8-496a-96d9-9bf3334beb8e service nova] Creating event network-vif-deleted:6a817425-e604-4c3b-8fd2-825b29553f9f for instance fda41fee-32f6-4482-a01d-5741ce9e405e on nch1-master-1 Nov 27 21:01:11.285636 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b7824629-11c3-4c05-8ee3-2c52a02dedea req-a003bca7-01c8-496a-96d9-9bf3334beb8e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.531510 Nov 27 21:01:11.286524 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2178/4497] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:11.294259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d59a9559-7d60-4051-b0ea-d6fa5a2c91bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:11.295557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d59a9559-7d60-4051-b0ea-d6fa5a2c91bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:11.302352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d59a9559-7d60-4051-b0ea-d6fa5a2c91bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.303771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d59a9559-7d60-4051-b0ea-d6fa5a2c91bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.305198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d59a9559-7d60-4051-b0ea-d6fa5a2c91bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.305945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d59a9559-7d60-4051-b0ea-d6fa5a2c91bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.353750 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d59a9559-7d60-4051-b0ea-d6fa5a2c91bc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.065285 Nov 27 21:01:11.355273 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2179/4498] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:11 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:11.606515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:11.607228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:11.625665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.626455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.627576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.628274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.647186 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] HTTP exception thrown: Instance fda41fee-32f6-4482-a01d-5741ce9e405e could not be found. Nov 27 21:01:11.648039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 404 to user: Instance fda41fee-32f6-4482-a01d-5741ce9e405e could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:11.649140 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d9ec3da9-28b9-451c-b873-76ceca57fd5a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 404 len: 111 microversion: 2.1 time: 0.047365 Nov 27 21:01:11.650353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2180/4499] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:11 2021] GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:01:11.660821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:11.665628 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:11.665628 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:11.667980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:11.669160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:11.678554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.679653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.680767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.681501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.784951 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ffa2591-2992-4b41-a623-4210a1668ddf tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.129736 Nov 27 21:01:11.786053 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2181/4500] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:01:11 2021] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:01:11.796961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-261308b1-74c9-425d-854d-77527393a1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:11.798201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-261308b1-74c9-425d-854d-77527393a1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:11.825168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-261308b1-74c9-425d-854d-77527393a1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.826165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-261308b1-74c9-425d-854d-77527393a1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.829964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-261308b1-74c9-425d-854d-77527393a1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:11.830621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-261308b1-74c9-425d-854d-77527393a1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:11.929134 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-261308b1-74c9-425d-854d-77527393a1f4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.141545 Nov 27 21:01:11.934711 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2182/4501] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:11 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:11.946873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46beed93-e5fb-41c0-a8d1-379cb1ee1ec9 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:11.949791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46beed93-e5fb-41c0-a8d1-379cb1ee1ec9 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:11.954597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46beed93-e5fb-41c0-a8d1-379cb1ee1ec9 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016419 Nov 27 21:01:11.958411 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2183/4502] 10.222.0.21 () {58 vars in 1181 bytes} [Sat Nov 27 21:01:11 2021] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:01:11.969879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:11.979667 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:11.979667 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:11.982152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:11.983172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:12.002448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.007180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.008336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.009064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.079688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 21:01:12.159384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3724a59-97d1-4567-860f-f41fa1ce6ddd tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.195741 Nov 27 21:01:12.161239 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2184/4503] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 21:01:11 2021] GET /compute/v2.1/servers => generated 681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:12.177149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:12.181061 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:12.181061 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:12.183814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:12.184514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.servers [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Removing options 'limit' from query {{(pid=135679) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 27 21:01:12.185592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:12.192910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.193719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.197229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.198296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.231718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 21:01:12.289497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e574928b-df76-401d-83f5-6c2e56ab87f3 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.120370 Nov 27 21:01:12.290428 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2185/4504] 10.222.0.21 () {58 vars in 1143 bytes} [Sat Nov 27 21:01:12 2021] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:12.317059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fe5e402-684f-4fd1-b121-a6ff8969d1c2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:12.322505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fe5e402-684f-4fd1-b121-a6ff8969d1c2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:12.326169 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1fe5e402-684f-4fd1-b121-a6ff8969d1c2 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.022317 Nov 27 21:01:12.328324 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2186/4505] 10.222.0.21 () {58 vars in 1141 bytes} [Sat Nov 27 21:01:12 2021] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:01:12.343321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-734599d3-2228-45f0-baec-f94f5915a5b7 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:12.347169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-734599d3-2228-45f0-baec-f94f5915a5b7 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:12.350144 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-734599d3-2228-45f0-baec-f94f5915a5b7 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017221 Nov 27 21:01:12.350682 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2187/4506] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 21:01:12 2021] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:01:12.365265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4904c39e-989b-4ede-a67d-3d400a522e90 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:12.378680 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:12.378680 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:12.382616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4904c39e-989b-4ede-a67d-3d400a522e90 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:12.383986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4904c39e-989b-4ede-a67d-3d400a522e90 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:12.399602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.servers [None req-4904c39e-989b-4ede-a67d-3d400a522e90 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Flavor 'non_existing_flavor' could not be found {{(pid=135679) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Nov 27 21:01:12.405319 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4904c39e-989b-4ede-a67d-3d400a522e90 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.047260 Nov 27 21:01:12.407017 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2188/4507] 10.222.0.21 () {58 vars in 1177 bytes} [Sat Nov 27 21:01:12 2021] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:01:12.424915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce001d5b-2a93-4aec-abc5-cb4671cbfd44 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:12.426004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce001d5b-2a93-4aec-abc5-cb4671cbfd44 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:12.442053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce001d5b-2a93-4aec-abc5-cb4671cbfd44 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.442511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce001d5b-2a93-4aec-abc5-cb4671cbfd44 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.443332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce001d5b-2a93-4aec-abc5-cb4671cbfd44 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.447791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce001d5b-2a93-4aec-abc5-cb4671cbfd44 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.528515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce001d5b-2a93-4aec-abc5-cb4671cbfd44 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.118804 Nov 27 21:01:12.529708 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2189/4508] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:12 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:12.540684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:12.547880 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:12.547880 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:12.549744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:12.550524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:12.564791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.568931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.571839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.572300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.701107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:01:12.707137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:01:12.707934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:01:12.708568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:01:12.709298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:01:12.716265 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99782be0-b071-46c2-b51d-cc4ffb969370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.174914 Nov 27 21:01:12.717021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2190/4509] 10.222.0.21 () {58 vars in 1173 bytes} [Sat Nov 27 21:01:12 2021] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:01:12.728853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.732100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:12.735888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.736786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.737232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.745827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:12.746508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:12.758154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.758615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.762653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:12.763136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:12.774904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Getting quotas for project 2a621d68a46c42269f2eea4bc56c671f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:01:12.792899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Getting quotas for user 1ca08ebddb1742d18951633bf019d743 and project 2a621d68a46c42269f2eea4bc56c671f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:01:12.806847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:01:12.809766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:01:12.921993 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3be4fed9-c20b-4939-b5db-3430f41c625e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.901737 Nov 27 21:01:12.929112 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2320/4510] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:01:10 2021] POST /compute/v2.1/servers => generated 383 bytes in 2910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:01:12.939814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a0e6abf-ba51-4317-abdd-e093cc5c0ad0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:12.941497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a0e6abf-ba51-4317-abdd-e093cc5c0ad0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:12.982929 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d984a85-d3e8-457e-b057-708be2e9350b tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.257711 Nov 27 21:01:12.983547 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2191/4511] 10.222.0.21 () {58 vars in 1183 bytes} [Sat Nov 27 21:01:12 2021] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:01:13.003005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0bcaa362-f836-443f-aadf-fa6cd2a179e7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:13.004106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0bcaa362-f836-443f-aadf-fa6cd2a179e7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:13.034900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcaa362-f836-443f-aadf-fa6cd2a179e7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.035399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcaa362-f836-443f-aadf-fa6cd2a179e7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.046429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcaa362-f836-443f-aadf-fa6cd2a179e7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.046429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcaa362-f836-443f-aadf-fa6cd2a179e7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.125066 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0bcaa362-f836-443f-aadf-fa6cd2a179e7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.140129 Nov 27 21:01:13.129636 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2192/4512] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:12 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:13.131826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4a0e6abf-ba51-4317-abdd-e093cc5c0ad0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:13.134620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:13.138509 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:13.138509 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:13.140478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:13.141444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:13.148306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.148468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.149336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.149784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.156696 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a0e6abf-ba51-4317-abdd-e093cc5c0ad0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1214 microversion: 2.1 time: 0.219700 Nov 27 21:01:13.160926 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2321/4513] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:12 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:13.209918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 21:01:13.292377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:13.302257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.302733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.541805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a6627d3-cc43-4dfc-ac42-71fb37c5e833 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:13.542802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a6627d3-cc43-4dfc-ac42-71fb37c5e833 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:13.561083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a6627d3-cc43-4dfc-ac42-71fb37c5e833 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.561539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a6627d3-cc43-4dfc-ac42-71fb37c5e833 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.567080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a6627d3-cc43-4dfc-ac42-71fb37c5e833 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.567842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a6627d3-cc43-4dfc-ac42-71fb37c5e833 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.658368 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8d9d631b-9a8c-47a9-952c-0e465e0dc3c0 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.530935 Nov 27 21:01:13.660542 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2193/4514] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 21:01:13 2021] GET /compute/v2.1/servers/detail => generated 3023 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:13.671758 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a6627d3-cc43-4dfc-ac42-71fb37c5e833 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.134532 Nov 27 21:01:13.672408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2322/4515] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:13 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:13.685359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-284888c8-785c-4398-817d-dc75a918aba5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:13.689939 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:13.689939 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:13.691493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-284888c8-785c-4398-817d-dc75a918aba5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:13.693612 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-284888c8-785c-4398-817d-dc75a918aba5 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013195 Nov 27 21:01:13.700916 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2194/4516] 10.222.0.21 () {58 vars in 1177 bytes} [Sat Nov 27 21:01:13 2021] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:01:13.709042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:13.713522 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:13.713522 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:01:13.716546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:13.717349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Searching by: {'deleted': False, 'project_id': '57166f6505f544e38ae55d9360c4f40a'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:01:13.729572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.730078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.732245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.732981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.775089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 21:01:13.833036 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-01a1bdd3-0314-402e-8d25-9d6283549e73 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.130206 Nov 27 21:01:13.835691 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2323/4517] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 21:01:13 2021] GET /compute/v2.1/servers => generated 681 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:13.850433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:13.851297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:13.869786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.872251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.875859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.877854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.917813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] HTTP exception thrown: Instance fda41fee-32f6-4482-a01d-5741ce9e405e could not be found. Nov 27 21:01:13.920958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 404 to user: Instance fda41fee-32f6-4482-a01d-5741ce9e405e could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:13.924714 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5493b93-e40a-44cc-962d-4cd1ee85d370 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 404 len: 111 microversion: 2.1 time: 0.080221 Nov 27 21:01:13.928349 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2195/4518] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:01:13 2021] DELETE /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:13.937971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:13.938794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:13.955682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.956571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:13.957851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:13.958987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.032143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:01:14.136161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fb3e39f2-69b8-474b-ac9c-72cb3743cc4d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:14.137366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fb3e39f2-69b8-474b-ac9c-72cb3743cc4d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:14.149991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb3e39f2-69b8-474b-ac9c-72cb3743cc4d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.150538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb3e39f2-69b8-474b-ac9c-72cb3743cc4d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.151364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb3e39f2-69b8-474b-ac9c-72cb3743cc4d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.160157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb3e39f2-69b8-474b-ac9c-72cb3743cc4d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.217198 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-69b8f0bd-f774-438f-acda-11e26dd9f15e tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "DELETE /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136" status: 204 len: 0 microversion: 2.1 time: 0.284210 Nov 27 21:01:14.219620 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2324/4519] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:01:13 2021] DELETE /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:01:14.232836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:14.234386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:14.248852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.249764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.251948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.253087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.269550 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fb3e39f2-69b8-474b-ac9c-72cb3743cc4d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.121381 Nov 27 21:01:14.271991 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2196/4520] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:14 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:14.300751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:14.303727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:14.350590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.353388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.354765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.357188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.417953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:14.429386 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-13d46703-ff79-443d-af5c-00c8995f65e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1218 microversion: 2.1 time: 0.208203 Nov 27 21:01:14.433777 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2325/4521] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:14 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:14.441647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:01:14.618891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68884030-ddbe-474e-b28b-7fc5cf19c7be tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "DELETE /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 204 len: 0 microversion: 2.1 time: 0.345316 Nov 27 21:01:14.625367 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2197/4522] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:01:14 2021] DELETE /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:01:14.629561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:14.630526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: fda41fee-32f6-4482-a01d-5741ce9e405e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:14.647609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.648136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.661685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.661685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.684921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-145238cb-9943-49c8-98e9-e03a95873a53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:14.686324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-145238cb-9943-49c8-98e9-e03a95873a53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:14.693237 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] HTTP exception thrown: Instance fda41fee-32f6-4482-a01d-5741ce9e405e could not be found. Nov 27 21:01:14.694170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 404 to user: Instance fda41fee-32f6-4482-a01d-5741ce9e405e could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:14.695217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26308fbb-d595-4bad-8c9c-63d3f1bfba92 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e" status: 404 len: 111 microversion: 2.1 time: 0.069422 Nov 27 21:01:14.700327 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2326/4523] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:14 2021] GET /compute/v2.1/servers/fda41fee-32f6-4482-a01d-5741ce9e405e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:14.704832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-145238cb-9943-49c8-98e9-e03a95873a53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.706807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-145238cb-9943-49c8-98e9-e03a95873a53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.709304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:14.710510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:14.711841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-145238cb-9943-49c8-98e9-e03a95873a53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.712469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-145238cb-9943-49c8-98e9-e03a95873a53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.726732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.729455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.731128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:14.732858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:14.785323 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-145238cb-9943-49c8-98e9-e03a95873a53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.104501 Nov 27 21:01:14.789996 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2198/4524] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:14 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:15.085093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:15.112131 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8a4f11d1-637a-4e83-b52c-99188778c96a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136" status: 200 len: 1521 microversion: 2.1 time: 0.407161 Nov 27 21:01:15.115751 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2327/4525] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:14 2021] GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:15.284971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abe62360-a672-4b73-8ca0-1d75238d295d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:15.286708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abe62360-a672-4b73-8ca0-1d75238d295d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:15.311105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe62360-a672-4b73-8ca0-1d75238d295d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:15.313312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe62360-a672-4b73-8ca0-1d75238d295d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:15.316133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe62360-a672-4b73-8ca0-1d75238d295d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:15.316791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abe62360-a672-4b73-8ca0-1d75238d295d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:15.397908 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abe62360-a672-4b73-8ca0-1d75238d295d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.118394 Nov 27 21:01:15.406164 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2199/4526] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:15 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:15.449810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:15.450504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:15.461541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:15.462014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:15.465854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:15.466352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:15.762018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:15.783673 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43286342-a842-4276-a224-cab134a17cc9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1272 microversion: 2.1 time: 0.337716 Nov 27 21:01:15.786407 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2328/4527] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:15 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:15.803536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8c6bee1-1ed0-4d1f-b286-c7f40350b3a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:15.804561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8c6bee1-1ed0-4d1f-b286-c7f40350b3a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:15.830856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8c6bee1-1ed0-4d1f-b286-c7f40350b3a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:15.832567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8c6bee1-1ed0-4d1f-b286-c7f40350b3a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:15.836249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8c6bee1-1ed0-4d1f-b286-c7f40350b3a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:15.839614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8c6bee1-1ed0-4d1f-b286-c7f40350b3a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:15.953602 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8c6bee1-1ed0-4d1f-b286-c7f40350b3a2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.150545 Nov 27 21:01:15.955300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2200/4528] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:15 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:16.133711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:16.134437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:16.148156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:16.157168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:16.159718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:16.160343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:16.415175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e8b3480-bb34-4dad-ab7d-28b33a883bb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:16.417873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e8b3480-bb34-4dad-ab7d-28b33a883bb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:16.456627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e8b3480-bb34-4dad-ab7d-28b33a883bb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:16.459576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e8b3480-bb34-4dad-ab7d-28b33a883bb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:16.461157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e8b3480-bb34-4dad-ab7d-28b33a883bb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:16.462431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e8b3480-bb34-4dad-ab7d-28b33a883bb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:16.552609 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e8b3480-bb34-4dad-ab7d-28b33a883bb6 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.143010 Nov 27 21:01:16.553837 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2201/4529] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:16 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:16.811492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:16.813339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:16.826348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:16.826808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:16.827768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:16.828211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:17.005140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:17.038058 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4248cd0f-19f9-4165-a329-34679953cb02 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136" status: 200 len: 1521 microversion: 2.1 time: 0.908050 Nov 27 21:01:17.040423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2329/4530] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:16 2021] GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136 => generated 1521 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:17.050775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9cc069a7-52d4-4286-99e6-ec9dbb1bde9f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:17.053931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9cc069a7-52d4-4286-99e6-ec9dbb1bde9f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:17.064886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc069a7-52d4-4286-99e6-ec9dbb1bde9f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:17.065753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc069a7-52d4-4286-99e6-ec9dbb1bde9f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:17.067613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc069a7-52d4-4286-99e6-ec9dbb1bde9f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:17.068381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc069a7-52d4-4286-99e6-ec9dbb1bde9f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:17.178896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9cc069a7-52d4-4286-99e6-ec9dbb1bde9f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.136108 Nov 27 21:01:17.181080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2330/4531] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:17 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:17.266304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:17.314603 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70c9cdd8-719b-4c03-b040-0159b4741f02 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1272 microversion: 2.1 time: 0.504910 Nov 27 21:01:17.315605 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2202/4532] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:16 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:17.568822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ce550a3-4f79-47f3-86ba-beeddbffda95 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:17.570589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ce550a3-4f79-47f3-86ba-beeddbffda95 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:17.601423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ce550a3-4f79-47f3-86ba-beeddbffda95 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:17.603682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ce550a3-4f79-47f3-86ba-beeddbffda95 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:17.606304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ce550a3-4f79-47f3-86ba-beeddbffda95 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:17.607435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ce550a3-4f79-47f3-86ba-beeddbffda95 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:17.672622 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ce550a3-4f79-47f3-86ba-beeddbffda95 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.107498 Nov 27 21:01:17.678452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2331/4533] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:17 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:18.059185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:18.060576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:18.107442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:18.109869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:18.111135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:18.112447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:18.216926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2fb706fa-b36e-4895-bc14-b5edc1172265 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:18.222438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2fb706fa-b36e-4895-bc14-b5edc1172265 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:18.275820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb706fa-b36e-4895-bc14-b5edc1172265 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:18.280494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb706fa-b36e-4895-bc14-b5edc1172265 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:18.286069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb706fa-b36e-4895-bc14-b5edc1172265 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:18.289697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb706fa-b36e-4895-bc14-b5edc1172265 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:18.485874 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2fb706fa-b36e-4895-bc14-b5edc1172265 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.293907 Nov 27 21:01:18.490101 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2332/4534] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:18 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:18.519896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:18.526271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:18.577257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:18.578723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:18.582751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:18.607355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:19.534527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:19.551138 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-831bbe95-ec5e-4a3c-8391-4c0317be3366 tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136" status: 200 len: 1521 microversion: 2.1 time: 1.494098 Nov 27 21:01:19.553633 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2203/4535] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:18 2021] GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136 => generated 1521 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:19.568924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89d3a424-df51-4918-b8eb-fd4117e2a4bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:19.574004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89d3a424-df51-4918-b8eb-fd4117e2a4bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:19.589337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89d3a424-df51-4918-b8eb-fd4117e2a4bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:19.590468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89d3a424-df51-4918-b8eb-fd4117e2a4bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:19.594626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89d3a424-df51-4918-b8eb-fd4117e2a4bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:19.596684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89d3a424-df51-4918-b8eb-fd4117e2a4bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:19.664428 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89d3a424-df51-4918-b8eb-fd4117e2a4bf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.107038 Nov 27 21:01:19.667914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2204/4536] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:19 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:19.689824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab18763c-5835-4fac-90cb-d24f52d3b392 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:19.700043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab18763c-5835-4fac-90cb-d24f52d3b392 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:19.724520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab18763c-5835-4fac-90cb-d24f52d3b392 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:19.726555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab18763c-5835-4fac-90cb-d24f52d3b392 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:19.728664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab18763c-5835-4fac-90cb-d24f52d3b392 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:19.732263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab18763c-5835-4fac-90cb-d24f52d3b392 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:19.867359 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab18763c-5835-4fac-90cb-d24f52d3b392 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.197834 Nov 27 21:01:19.868539 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2205/4537] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:19 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:19.931630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8ce519f9-4984-412d-b18b-7b82ceb27525 req-8e2d38b7-8ca2-4f4b-80c6-08f2680c58c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029c8f1e-d549-4ac9-8ebe-6e110271af7d", "name": "network-vif-deleted", "tag": "e28bdabf-8e3c-4ac0-a725-ed8d1d6d2f2d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:19.933751 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:19.933751 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:19.944615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8ce519f9-4984-412d-b18b-7b82ceb27525 req-8e2d38b7-8ca2-4f4b-80c6-08f2680c58c6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:19.946476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8ce519f9-4984-412d-b18b-7b82ceb27525 req-8e2d38b7-8ca2-4f4b-80c6-08f2680c58c6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:19.965629 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8ce519f9-4984-412d-b18b-7b82ceb27525 req-8e2d38b7-8ca2-4f4b-80c6-08f2680c58c6 service nova] Creating event network-vif-deleted:e28bdabf-8e3c-4ac0-a725-ed8d1d6d2f2d for instance 029c8f1e-d549-4ac9-8ebe-6e110271af7d on nch1-master-1 Nov 27 21:01:19.976214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8ce519f9-4984-412d-b18b-7b82ceb27525 req-8e2d38b7-8ca2-4f4b-80c6-08f2680c58c6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049752 Nov 27 21:01:19.977268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2206/4538] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:01:19.989047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-74173bd4-7610-4d29-ad2a-8b1752f5135a req-ed8c9e81-5d4b-4132-8b59-e4bc0e068c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be17e59d-66fb-4532-a358-99abd059f136", "name": "network-vif-deleted", "tag": "224259aa-f342-4ded-891c-82a4330a6dfa"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:19.992217 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:19.992217 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:20.005431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-74173bd4-7610-4d29-ad2a-8b1752f5135a req-ed8c9e81-5d4b-4132-8b59-e4bc0e068c5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.006402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-74173bd4-7610-4d29-ad2a-8b1752f5135a req-ed8c9e81-5d4b-4132-8b59-e4bc0e068c5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.022499 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-74173bd4-7610-4d29-ad2a-8b1752f5135a req-ed8c9e81-5d4b-4132-8b59-e4bc0e068c5e service nova] Creating event network-vif-deleted:224259aa-f342-4ded-891c-82a4330a6dfa for instance be17e59d-66fb-4532-a358-99abd059f136 on nch2-master-1 Nov 27 21:01:20.029847 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-74173bd4-7610-4d29-ad2a-8b1752f5135a req-ed8c9e81-5d4b-4132-8b59-e4bc0e068c5e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049162 Nov 27 21:01:20.031948 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2207/4539] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:20.295617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:20.312571 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5735d5e1-a5d2-4ab1-86c5-38765e56774d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 1.805779 Nov 27 21:01:20.314721 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2333/4540] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:18 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:20.576395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:20.577644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:20.606436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.608266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.612571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.615964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.683656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6816b36a-9386-4d47-ae72-2f3205ff94c2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:20.685222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6816b36a-9386-4d47-ae72-2f3205ff94c2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:20.714568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6816b36a-9386-4d47-ae72-2f3205ff94c2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.715274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6816b36a-9386-4d47-ae72-2f3205ff94c2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.718002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6816b36a-9386-4d47-ae72-2f3205ff94c2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.721390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6816b36a-9386-4d47-ae72-2f3205ff94c2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.774586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.776950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.777632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lazy-loading 'fault' on Instance uuid be17e59d-66fb-4532-a358-99abd059f136 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:01:20.861738 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6816b36a-9386-4d47-ae72-2f3205ff94c2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.184061 Nov 27 21:01:20.863770 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2334/4541] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:20 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:20.883582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca9e43cd-88d7-4eb9-ab26-ffeee18d1d62 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:20.885845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca9e43cd-88d7-4eb9-ab26-ffeee18d1d62 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:20.907343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9e43cd-88d7-4eb9-ab26-ffeee18d1d62 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.909881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9e43cd-88d7-4eb9-ab26-ffeee18d1d62 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.912308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9e43cd-88d7-4eb9-ab26-ffeee18d1d62 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:20.914196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9e43cd-88d7-4eb9-ab26-ffeee18d1d62 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:20.916966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6493e665b046a1863572bcc9553866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57166f6505f544e38ae55d9360c4f40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:20.927208 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6ab13e7-93f3-4f81-a90f-540c3a825b2a tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136" status: 200 len: 1312 microversion: 2.1 time: 0.358011 Nov 27 21:01:20.935171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2208/4542] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:20 2021] GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:21.021896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca9e43cd-88d7-4eb9-ab26-ffeee18d1d62 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.143875 Nov 27 21:01:21.024867 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2335/4543] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:20 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:21.336187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:21.337160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:21.382460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:21.384339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:21.387913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:21.388842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:21.890018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-64cce0cd-3890-4f65-94d9-dc130782f38f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:21.890018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-64cce0cd-3890-4f65-94d9-dc130782f38f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:21.899297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64cce0cd-3890-4f65-94d9-dc130782f38f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:21.900415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64cce0cd-3890-4f65-94d9-dc130782f38f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:21.901735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64cce0cd-3890-4f65-94d9-dc130782f38f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:21.902427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-64cce0cd-3890-4f65-94d9-dc130782f38f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:21.982025 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-64cce0cd-3890-4f65-94d9-dc130782f38f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.111273 Nov 27 21:01:22.009893 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2336/4544] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:21 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:22.022835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:22.023933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: be17e59d-66fb-4532-a358-99abd059f136] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:22.041410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:22.042645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:22.044809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:22.045729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:22.072484 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] HTTP exception thrown: Instance be17e59d-66fb-4532-a358-99abd059f136 could not be found. Nov 27 21:01:22.073436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 404 to user: Instance be17e59d-66fb-4532-a358-99abd059f136 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:22.075097 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12a5a5a0-93e6-473a-8a94-59eaf6dd73ab tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136" status: 404 len: 111 microversion: 2.1 time: 0.062992 Nov 27 21:01:22.078992 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2337/4545] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:22 2021] GET /compute/v2.1/servers/be17e59d-66fb-4532-a358-99abd059f136 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:22.093962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb909ab8-d562-46e6-a5cc-b26b775fbd6e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:22.096475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fb909ab8-d562-46e6-a5cc-b26b775fbd6e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:22.109849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb909ab8-d562-46e6-a5cc-b26b775fbd6e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:22.111017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb909ab8-d562-46e6-a5cc-b26b775fbd6e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:22.118032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb909ab8-d562-46e6-a5cc-b26b775fbd6e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:22.120574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb909ab8-d562-46e6-a5cc-b26b775fbd6e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:22.235972 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fb909ab8-d562-46e6-a5cc-b26b775fbd6e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.143874 Nov 27 21:01:22.238828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2338/4546] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:22 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:22.268503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:22.278937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] [instance: 029c8f1e-d549-4ac9-8ebe-6e110271af7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:22.309927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:22.313763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:22.320830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:22.321787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:22.375145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] HTTP exception thrown: Instance 029c8f1e-d549-4ac9-8ebe-6e110271af7d could not be found. Nov 27 21:01:22.376579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] Returning 404 to user: Instance 029c8f1e-d549-4ac9-8ebe-6e110271af7d could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:22.380649 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7c3e958d-be98-4ff2-a122-f03b13daaefc tempest-ListServersNegativeTestJSON-1865350681 tempest-ListServersNegativeTestJSON-1865350681-project] 10.222.0.21 "GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d" status: 404 len: 111 microversion: 2.1 time: 0.136382 Nov 27 21:01:22.381531 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2339/4547] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:22 2021] GET /compute/v2.1/servers/029c8f1e-d549-4ac9-8ebe-6e110271af7d => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:22.735754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:22.748378 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0c1a0447-2a2d-449c-8a77-223f935d572c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 1.419833 Nov 27 21:01:22.749529 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2209/4548] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:21 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:23.017411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e28bdc30-db7d-450c-9f7d-56d989ff7029 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:23.020170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e28bdc30-db7d-450c-9f7d-56d989ff7029 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:23.041317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e28bdc30-db7d-450c-9f7d-56d989ff7029 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:23.044410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e28bdc30-db7d-450c-9f7d-56d989ff7029 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:23.047244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e28bdc30-db7d-450c-9f7d-56d989ff7029 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:23.049668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e28bdc30-db7d-450c-9f7d-56d989ff7029 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:23.173553 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e28bdc30-db7d-450c-9f7d-56d989ff7029 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.160470 Nov 27 21:01:23.179585 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2340/4549] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:23 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:23.254606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d9ddb4a1-17b1-4c76-a18d-64a47f0f3c10 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:23.256156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d9ddb4a1-17b1-4c76-a18d-64a47f0f3c10 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:23.279019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ddb4a1-17b1-4c76-a18d-64a47f0f3c10 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:23.284550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ddb4a1-17b1-4c76-a18d-64a47f0f3c10 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:23.288941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ddb4a1-17b1-4c76-a18d-64a47f0f3c10 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:23.290116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9ddb4a1-17b1-4c76-a18d-64a47f0f3c10 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:23.468668 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d9ddb4a1-17b1-4c76-a18d-64a47f0f3c10 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.221920 Nov 27 21:01:23.473326 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2210/4550] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:23 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:23.791093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:23.792302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:23.815156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:23.815842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:23.818195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:23.819898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:24.114124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3fc15cbe-edcc-4165-bd95-25f0bfcb2f63 req-834b0afb-11e0-49b2-ba4e-fa56df9f4de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24e78d1-535b-4ee2-8281-a712770fd872", "tag": "a2c2deae-bff9-4c9d-98be-596ea79c1679"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:24.116345 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:24.116345 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:24.136890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3fc15cbe-edcc-4165-bd95-25f0bfcb2f63 req-834b0afb-11e0-49b2-ba4e-fa56df9f4de0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:24.137326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3fc15cbe-edcc-4165-bd95-25f0bfcb2f63 req-834b0afb-11e0-49b2-ba4e-fa56df9f4de0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:24.186049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3fc15cbe-edcc-4165-bd95-25f0bfcb2f63 req-834b0afb-11e0-49b2-ba4e-fa56df9f4de0 service nova] Creating event network-changed:a2c2deae-bff9-4c9d-98be-596ea79c1679 for instance b24e78d1-535b-4ee2-8281-a712770fd872 on nch2-master-1 Nov 27 21:01:24.201390 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3fc15cbe-edcc-4165-bd95-25f0bfcb2f63 req-834b0afb-11e0-49b2-ba4e-fa56df9f4de0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091505 Nov 27 21:01:24.204124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2211/4551] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:01:24.209440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-517545a7-0aa9-4903-80d8-a507df4e2a57 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:24.210562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-517545a7-0aa9-4903-80d8-a507df4e2a57 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:24.237957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517545a7-0aa9-4903-80d8-a507df4e2a57 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:24.238596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517545a7-0aa9-4903-80d8-a507df4e2a57 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:24.239853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517545a7-0aa9-4903-80d8-a507df4e2a57 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:24.240971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-517545a7-0aa9-4903-80d8-a507df4e2a57 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:24.328329 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-517545a7-0aa9-4903-80d8-a507df4e2a57 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.122627 Nov 27 21:01:24.330518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2212/4552] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:24 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:24.485472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07fab56f-5bc9-4b98-8af7-044dc9cacd20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:24.487033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07fab56f-5bc9-4b98-8af7-044dc9cacd20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:24.513781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07fab56f-5bc9-4b98-8af7-044dc9cacd20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:24.515168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07fab56f-5bc9-4b98-8af7-044dc9cacd20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:24.520894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07fab56f-5bc9-4b98-8af7-044dc9cacd20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:24.522071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07fab56f-5bc9-4b98-8af7-044dc9cacd20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:24.644669 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07fab56f-5bc9-4b98-8af7-044dc9cacd20 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.164270 Nov 27 21:01:24.647860 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2213/4553] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:24 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:24.878703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:24.892239 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b917b10-3ce1-4c39-838a-436ca27bc95f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 1.128004 Nov 27 21:01:24.919892 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2341/4554] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:23 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:25.344099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6d4f91e-9e0b-4638-9aef-458e3a3b2e2f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:25.345360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6d4f91e-9e0b-4638-9aef-458e3a3b2e2f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:25.374936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d4f91e-9e0b-4638-9aef-458e3a3b2e2f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:25.375448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d4f91e-9e0b-4638-9aef-458e3a3b2e2f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:25.376265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d4f91e-9e0b-4638-9aef-458e3a3b2e2f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:25.376715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6d4f91e-9e0b-4638-9aef-458e3a3b2e2f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:25.477563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6d4f91e-9e0b-4638-9aef-458e3a3b2e2f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.139646 Nov 27 21:01:25.479072 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2214/4555] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:25 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:25.664848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-114416ac-d377-4d30-a03a-023b100c6f47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:25.666081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-114416ac-d377-4d30-a03a-023b100c6f47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:25.681682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-114416ac-d377-4d30-a03a-023b100c6f47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:25.682164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-114416ac-d377-4d30-a03a-023b100c6f47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:25.689958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-114416ac-d377-4d30-a03a-023b100c6f47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:25.692394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-114416ac-d377-4d30-a03a-023b100c6f47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:25.781136 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-114416ac-d377-4d30-a03a-023b100c6f47 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.125601 Nov 27 21:01:25.787459 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2342/4556] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:25 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:25.910584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:25.911822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:25.929208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:25.929847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:25.932824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:25.933934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:26.493289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a0644be-5541-43b7-85e3-0a4f9c4ad37e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:26.495575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a0644be-5541-43b7-85e3-0a4f9c4ad37e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:26.520313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a0644be-5541-43b7-85e3-0a4f9c4ad37e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:26.522968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a0644be-5541-43b7-85e3-0a4f9c4ad37e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:26.525294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a0644be-5541-43b7-85e3-0a4f9c4ad37e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:26.528254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:26.529229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a0644be-5541-43b7-85e3-0a4f9c4ad37e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:26.552917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24879c52-423c-42b4-9d7c-b99acdebb005 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 0.644773 Nov 27 21:01:26.554115 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2215/4557] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:25 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:26.648862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a0644be-5541-43b7-85e3-0a4f9c4ad37e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.161014 Nov 27 21:01:26.650239 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2343/4558] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:26 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:26.796527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63808bc5-8489-4c85-a22e-6c8e4b3c2fad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:26.800265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63808bc5-8489-4c85-a22e-6c8e4b3c2fad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:26.826097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63808bc5-8489-4c85-a22e-6c8e4b3c2fad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:26.828084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63808bc5-8489-4c85-a22e-6c8e4b3c2fad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:26.831394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63808bc5-8489-4c85-a22e-6c8e4b3c2fad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:26.833465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63808bc5-8489-4c85-a22e-6c8e4b3c2fad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:26.948042 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63808bc5-8489-4c85-a22e-6c8e4b3c2fad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.158167 Nov 27 21:01:26.949332 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2216/4559] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:26 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:27.570719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:27.572629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:27.594516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:27.595352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:27.597410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:27.599596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:27.662692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e10e2b39-e5f1-4c7c-83e5-302657dae451 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:27.664534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e10e2b39-e5f1-4c7c-83e5-302657dae451 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:27.685614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e10e2b39-e5f1-4c7c-83e5-302657dae451 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:27.686663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e10e2b39-e5f1-4c7c-83e5-302657dae451 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:27.688846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e10e2b39-e5f1-4c7c-83e5-302657dae451 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:27.692716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e10e2b39-e5f1-4c7c-83e5-302657dae451 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:27.825905 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e10e2b39-e5f1-4c7c-83e5-302657dae451 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.168080 Nov 27 21:01:27.828075 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2217/4560] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:27 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:27.969779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fae02d1c-2c35-4e12-bb65-929bb1b9643e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:27.973795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fae02d1c-2c35-4e12-bb65-929bb1b9643e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:28.002516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fae02d1c-2c35-4e12-bb65-929bb1b9643e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:28.004765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fae02d1c-2c35-4e12-bb65-929bb1b9643e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:28.006445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fae02d1c-2c35-4e12-bb65-929bb1b9643e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:28.007126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fae02d1c-2c35-4e12-bb65-929bb1b9643e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:28.157611 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fae02d1c-2c35-4e12-bb65-929bb1b9643e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.199182 Nov 27 21:01:28.159586 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2218/4561] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:27 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:28.442423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:28.464765 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-711a11d6-5ca7-4bbc-86fe-a96aa616a2b6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 0.898155 Nov 27 21:01:28.468235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2344/4562] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:27 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:28.865923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b93a7a5-c26d-4b42-b655-9fa705536e77 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:28.867235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0b93a7a5-c26d-4b42-b655-9fa705536e77 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:28.888196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b93a7a5-c26d-4b42-b655-9fa705536e77 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:28.888721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b93a7a5-c26d-4b42-b655-9fa705536e77 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:28.890098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b93a7a5-c26d-4b42-b655-9fa705536e77 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:28.891529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b93a7a5-c26d-4b42-b655-9fa705536e77 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:28.961959 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0b93a7a5-c26d-4b42-b655-9fa705536e77 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.124791 Nov 27 21:01:28.963033 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2219/4563] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:28 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:29.041693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd0fb79e-0765-4eb3-b6e9-37c9f6052d74 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2068956472", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:29.043792 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-bd0fb79e-0765-4eb3-b6e9-37c9f6052d74 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] HTTP exception thrown: min_count must be <= max_count Nov 27 21:01:29.044383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd0fb79e-0765-4eb3-b6e9-37c9f6052d74 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Returning 400 to user: min_count must be <= max_count {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:29.045217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bd0fb79e-0765-4eb3-b6e9-37c9f6052d74 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.196802 Nov 27 21:01:29.046741 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2345/4564] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:01:28 2021] POST /compute/v2.1/servers => generated 74 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:29.122379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5623b494-714c-4d31-acc1-5c98822baa32 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1515551985", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "max_count": 0}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:29.125014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5623b494-714c-4d31-acc1-5c98822baa32 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:29.126302 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5623b494-714c-4d31-acc1-5c98822baa32 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009413 Nov 27 21:01:29.127114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2220/4565] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:01:29 2021] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:01:29.188099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-63bb3641-9f6d-4a9e-9863-836c8622396a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:29.192209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61dbc71d-a322-4ddd-85bd-76ace7e6f517 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2024129329", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "max_count": 2.5}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:29.192389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-63bb3641-9f6d-4a9e-9863-836c8622396a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:29.193622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61dbc71d-a322-4ddd-85bd-76ace7e6f517 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:29.194441 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61dbc71d-a322-4ddd-85bd-76ace7e6f517 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020074 Nov 27 21:01:29.199751 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2221/4566] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:01:29 2021] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 27 21:01:29.228766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63bb3641-9f6d-4a9e-9863-836c8622396a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:29.228766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63bb3641-9f6d-4a9e-9863-836c8622396a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:29.231765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63bb3641-9f6d-4a9e-9863-836c8622396a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:29.233083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-63bb3641-9f6d-4a9e-9863-836c8622396a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:29.290490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ae929bf-b23d-4868-a6cd-77128791ba66 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-433182682", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 0}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:29.292621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ae929bf-b23d-4868-a6cd-77128791ba66 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:29.294337 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ae929bf-b23d-4868-a6cd-77128791ba66 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010833 Nov 27 21:01:29.296192 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2222/4567] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:01:29 2021] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 27 21:01:29.341107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-63bb3641-9f6d-4a9e-9863-836c8622396a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.173705 Nov 27 21:01:29.342070 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2346/4568] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:29 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:29.381274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aca66b7e-9cf5-4687-a3c4-d04721f3a904 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1929548830", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "min_count": 2.5}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:29.385416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aca66b7e-9cf5-4687-a3c4-d04721f3a904 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:01:29.386398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aca66b7e-9cf5-4687-a3c4-d04721f3a904 tempest-MultipleCreateNegativeTestJSON-2087652138 tempest-MultipleCreateNegativeTestJSON-2087652138-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009276 Nov 27 21:01:29.386978 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2223/4569] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:01:29 2021] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:01:29.484700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:29.485407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:29.505536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:29.507992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:29.511585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:29.514013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:29.822159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:29.838923 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c91b6e20-72c7-4f9a-b28d-ff55f0509713 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 0.359241 Nov 27 21:01:29.840136 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2347/4570] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:29 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:29.981052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d5ce5185-193d-4893-9bc6-966127586b88 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:29.982368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d5ce5185-193d-4893-9bc6-966127586b88 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:30.001405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5ce5185-193d-4893-9bc6-966127586b88 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:30.002358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5ce5185-193d-4893-9bc6-966127586b88 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:30.003610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5ce5185-193d-4893-9bc6-966127586b88 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:30.004615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d5ce5185-193d-4893-9bc6-966127586b88 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:30.081620 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d5ce5185-193d-4893-9bc6-966127586b88 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.107665 Nov 27 21:01:30.083912 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2224/4571] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:29 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:30.363128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-582a48d5-167b-4494-bb2f-959cf9f6bcd7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:30.364526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-582a48d5-167b-4494-bb2f-959cf9f6bcd7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:30.379522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-582a48d5-167b-4494-bb2f-959cf9f6bcd7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:30.380258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-582a48d5-167b-4494-bb2f-959cf9f6bcd7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:30.384118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-582a48d5-167b-4494-bb2f-959cf9f6bcd7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:30.384835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-582a48d5-167b-4494-bb2f-959cf9f6bcd7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:30.457822 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-582a48d5-167b-4494-bb2f-959cf9f6bcd7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.104109 Nov 27 21:01:30.458619 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2348/4572] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:30 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:30.858003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:30.859184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:30.871513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:30.872641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:30.875557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:30.880122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:31.097972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12b28a2d-30d3-405e-9979-2159d95005ee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:31.099153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12b28a2d-30d3-405e-9979-2159d95005ee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:31.108378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b28a2d-30d3-405e-9979-2159d95005ee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:31.109252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b28a2d-30d3-405e-9979-2159d95005ee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:31.110385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b28a2d-30d3-405e-9979-2159d95005ee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:31.111060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b28a2d-30d3-405e-9979-2159d95005ee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:31.215238 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12b28a2d-30d3-405e-9979-2159d95005ee tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.122901 Nov 27 21:01:31.227489 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2349/4573] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:31 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:31.471089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b810da24-6532-48c9-8f28-0976e19e3855 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:31.472299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b810da24-6532-48c9-8f28-0976e19e3855 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:31.490046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b810da24-6532-48c9-8f28-0976e19e3855 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:31.491820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b810da24-6532-48c9-8f28-0976e19e3855 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:31.494882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b810da24-6532-48c9-8f28-0976e19e3855 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:31.496628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b810da24-6532-48c9-8f28-0976e19e3855 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:31.591954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b810da24-6532-48c9-8f28-0976e19e3855 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.123831 Nov 27 21:01:31.598805 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2350/4574] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:31 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:31.604741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-497c3998-39ad-4ab2-a340-10bed16e9165 req-680b4d8b-c73f-4f4f-93a9-d1a0cf0d06b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24e78d1-535b-4ee2-8281-a712770fd872", "name": "network-vif-plugged", "status": "completed", "tag": "a2c2deae-bff9-4c9d-98be-596ea79c1679"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:31.612135 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:31.612135 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:01:31.638989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-497c3998-39ad-4ab2-a340-10bed16e9165 req-680b4d8b-c73f-4f4f-93a9-d1a0cf0d06b1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:31.643660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-497c3998-39ad-4ab2-a340-10bed16e9165 req-680b4d8b-c73f-4f4f-93a9-d1a0cf0d06b1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:31.662380 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-497c3998-39ad-4ab2-a340-10bed16e9165 req-680b4d8b-c73f-4f4f-93a9-d1a0cf0d06b1 service nova] Creating event network-vif-plugged:a2c2deae-bff9-4c9d-98be-596ea79c1679 for instance b24e78d1-535b-4ee2-8281-a712770fd872 on nch2-master-1 Nov 27 21:01:31.668983 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-497c3998-39ad-4ab2-a340-10bed16e9165 req-680b4d8b-c73f-4f4f-93a9-d1a0cf0d06b1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071829 Nov 27 21:01:31.671068 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2351/4575] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:31.859294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:31.869760 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ffc20819-d243-4702-b8ea-288d1d759f8d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 1.016159 Nov 27 21:01:31.871136 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2225/4576] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:30 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:32.237807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc56371c-4307-407d-bccd-40ccafb46ba2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:32.238940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc56371c-4307-407d-bccd-40ccafb46ba2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:32.247760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc56371c-4307-407d-bccd-40ccafb46ba2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:32.248525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc56371c-4307-407d-bccd-40ccafb46ba2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:32.250866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc56371c-4307-407d-bccd-40ccafb46ba2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:32.252270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc56371c-4307-407d-bccd-40ccafb46ba2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:32.399286 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc56371c-4307-407d-bccd-40ccafb46ba2 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.167121 Nov 27 21:01:32.400961 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2352/4577] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:32 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:32.609479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28a2caa0-8670-4c03-a31a-e8db43a0e24a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:32.612229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28a2caa0-8670-4c03-a31a-e8db43a0e24a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:32.643609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a2caa0-8670-4c03-a31a-e8db43a0e24a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:32.650422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a2caa0-8670-4c03-a31a-e8db43a0e24a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:32.654406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a2caa0-8670-4c03-a31a-e8db43a0e24a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:32.656090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a2caa0-8670-4c03-a31a-e8db43a0e24a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:32.755333 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28a2caa0-8670-4c03-a31a-e8db43a0e24a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.151636 Nov 27 21:01:32.762812 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2226/4578] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:32 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:32.891365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:32.892183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:32.911135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:32.911656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:32.912626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:32.913092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:33.416169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb421006-ec56-4cd3-bfa4-6bcd62488ecf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:33.418620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb421006-ec56-4cd3-bfa4-6bcd62488ecf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:33.428313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb421006-ec56-4cd3-bfa4-6bcd62488ecf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:33.431856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb421006-ec56-4cd3-bfa4-6bcd62488ecf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:33.434168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb421006-ec56-4cd3-bfa4-6bcd62488ecf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:33.435245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb421006-ec56-4cd3-bfa4-6bcd62488ecf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:33.488090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:33.496845 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-328aa626-a68b-4177-aed6-86553ee40c38 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1314 microversion: 2.1 time: 0.612196 Nov 27 21:01:33.504365 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2353/4579] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:32 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:33.521389 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb421006-ec56-4cd3-bfa4-6bcd62488ecf tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.110447 Nov 27 21:01:33.525388 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2227/4580] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:33 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:33.772524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-67b63020-e232-4686-b6ec-86d5a6137177 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:33.773605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-67b63020-e232-4686-b6ec-86d5a6137177 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:33.793754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b63020-e232-4686-b6ec-86d5a6137177 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:33.794215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b63020-e232-4686-b6ec-86d5a6137177 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:33.795017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b63020-e232-4686-b6ec-86d5a6137177 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:33.800627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b63020-e232-4686-b6ec-86d5a6137177 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:33.857989 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-67b63020-e232-4686-b6ec-86d5a6137177 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.090783 Nov 27 21:01:33.860536 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2354/4581] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:33 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:34.522367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:34.523060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:34.533890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:34.534360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:34.535178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:34.535654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:34.547993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f033b40a-7eeb-40ae-be7d-408929d975aa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:34.550571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f033b40a-7eeb-40ae-be7d-408929d975aa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:34.571915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f033b40a-7eeb-40ae-be7d-408929d975aa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:34.572750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f033b40a-7eeb-40ae-be7d-408929d975aa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:34.574840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f033b40a-7eeb-40ae-be7d-408929d975aa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:34.575715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f033b40a-7eeb-40ae-be7d-408929d975aa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:34.662683 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f033b40a-7eeb-40ae-be7d-408929d975aa tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.127511 Nov 27 21:01:34.663705 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2355/4582] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:34 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:34.878638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c6c37bc-42af-4de3-a1b2-bf6f9dc9f4d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:34.879946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c6c37bc-42af-4de3-a1b2-bf6f9dc9f4d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:34.906145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c6c37bc-42af-4de3-a1b2-bf6f9dc9f4d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:34.906685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c6c37bc-42af-4de3-a1b2-bf6f9dc9f4d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:34.909389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c6c37bc-42af-4de3-a1b2-bf6f9dc9f4d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:34.911920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c6c37bc-42af-4de3-a1b2-bf6f9dc9f4d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:35.032286 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c6c37bc-42af-4de3-a1b2-bf6f9dc9f4d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.163820 Nov 27 21:01:35.033028 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2356/4583] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:34 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:35.258771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1661753881", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "eef8bb54-479f-4853-ac91-4d8fd47d6e2d"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:35.355606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] validate_networks() for [('eef8bb54-479f-4853-ac91-4d8fd47d6e2d', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:01:35.720824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:35.729962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-93a1843e-2ae1-4f79-afc0-9d5ce144bbf5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1501 microversion: 2.1 time: 1.211593 Nov 27 21:01:35.743097 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2228/4584] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:34 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1501 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:35.757574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8a38cb9-6f68-4835-bf91-756e35fb0907 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:35.758644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8a38cb9-6f68-4835-bf91-756e35fb0907 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:35.773474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a38cb9-6f68-4835-bf91-756e35fb0907 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:35.775043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a38cb9-6f68-4835-bf91-756e35fb0907 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:35.776082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a38cb9-6f68-4835-bf91-756e35fb0907 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:35.777087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a38cb9-6f68-4835-bf91-756e35fb0907 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:35.839183 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8a38cb9-6f68-4835-bf91-756e35fb0907 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.093534 Nov 27 21:01:35.841738 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2229/4585] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:35 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:35.854566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:35.859389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:35.874235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:35.876000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:35.877560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:35.878442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:35.994614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lazy-loading 'flavor' on Instance uuid b24e78d1-535b-4ee2-8281-a712770fd872 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:01:36.007424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:01:36.008299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:01:36.008826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:01:36.011928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:01:36.013116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:01:36.064677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.066899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.068661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.081546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.167647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Getting quotas for project 998295c106db4d7b82c3c10f09fbe182. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:01:36.190971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Getting quotas for user ab09c8b68a1545fb8733dd571bc9db4b and project 998295c106db4d7b82c3c10f09fbe182. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:01:36.209545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:01:36.217479 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61b1eb40-5d98-401c-81c2-c184fdcb8cfe tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "POST /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872/action" status: 200 len: 32 microversion: 2.1 time: 0.372588 Nov 27 21:01:36.218544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:01:36.225948 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2230/4586] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:01:35 2021] POST /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:01:36.239879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6694fefe-3e5f-408e-8e9a-c2b212fb71a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:36.242086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6694fefe-3e5f-408e-8e9a-c2b212fb71a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:36.259436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6694fefe-3e5f-408e-8e9a-c2b212fb71a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.262514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6694fefe-3e5f-408e-8e9a-c2b212fb71a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.265089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6694fefe-3e5f-408e-8e9a-c2b212fb71a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.266112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6694fefe-3e5f-408e-8e9a-c2b212fb71a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.364742 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba492a37-18bb-4c38-b61e-c8e2215b4af9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314176 Nov 27 21:01:36.368393 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2357/4587] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:01:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:01:36.377836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:36.381845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:36.397837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.400501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.402518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.403183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.408966 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6694fefe-3e5f-408e-8e9a-c2b212fb71a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.177302 Nov 27 21:01:36.418638 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2231/4588] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:36 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:36.455928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dfd00afe-939b-4dd8-99ad-e53025a1b2ae tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:36.460502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dfd00afe-939b-4dd8-99ad-e53025a1b2ae tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:36.693004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dfd00afe-939b-4dd8-99ad-e53025a1b2ae tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:36.710803 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dfd00afe-939b-4dd8-99ad-e53025a1b2ae tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1217 microversion: 2.1 time: 0.287766 Nov 27 21:01:36.712826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2232/4589] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:36 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1217 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:36.860419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dad63dde-6ee1-4ad0-a538-79e384521d9c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:36.863241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dad63dde-6ee1-4ad0-a538-79e384521d9c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:36.876588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dad63dde-6ee1-4ad0-a538-79e384521d9c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.877057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dad63dde-6ee1-4ad0-a538-79e384521d9c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.878832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dad63dde-6ee1-4ad0-a538-79e384521d9c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:36.879507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dad63dde-6ee1-4ad0-a538-79e384521d9c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:36.966597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dad63dde-6ee1-4ad0-a538-79e384521d9c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.114503 Nov 27 21:01:36.971379 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2233/4590] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:36 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:37.433957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-25d69ef5-ade4-4545-a0d1-e56af2023209 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:37.435044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-25d69ef5-ade4-4545-a0d1-e56af2023209 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:37.467482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25d69ef5-ade4-4545-a0d1-e56af2023209 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:37.469851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25d69ef5-ade4-4545-a0d1-e56af2023209 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:37.471853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25d69ef5-ade4-4545-a0d1-e56af2023209 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:37.473481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25d69ef5-ade4-4545-a0d1-e56af2023209 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:37.593540 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-25d69ef5-ade4-4545-a0d1-e56af2023209 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.163457 Nov 27 21:01:37.594930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2234/4591] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:37 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:37.629137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:37.647071 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d33a346c-8f31-470e-8763-cea22f91e332 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 1.275896 Nov 27 21:01:37.649893 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2358/4592] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:36 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:37.731214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:37.732171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:37.744674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:37.745427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:37.747738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:37.749089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:37.852006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:37.872532 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bbcec9bb-5b97-4fba-8a3a-fba5d57a49d8 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1269 microversion: 2.1 time: 0.143978 Nov 27 21:01:37.885181 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2235/4593] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:37 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1269 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:37.988569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5e5b77d-fc67-4717-8c49-9b8ed680ddb7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:37.990710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5e5b77d-fc67-4717-8c49-9b8ed680ddb7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:38.005832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5e5b77d-fc67-4717-8c49-9b8ed680ddb7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.006756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5e5b77d-fc67-4717-8c49-9b8ed680ddb7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:38.009517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5e5b77d-fc67-4717-8c49-9b8ed680ddb7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.010223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5e5b77d-fc67-4717-8c49-9b8ed680ddb7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:38.073090 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5e5b77d-fc67-4717-8c49-9b8ed680ddb7 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.091653 Nov 27 21:01:38.075795 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2359/4594] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:37 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:38.611780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a395221b-a2eb-495f-93ae-ab84dd36c74b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:38.614688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a395221b-a2eb-495f-93ae-ab84dd36c74b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:38.640231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a395221b-a2eb-495f-93ae-ab84dd36c74b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.640845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a395221b-a2eb-495f-93ae-ab84dd36c74b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:38.642883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a395221b-a2eb-495f-93ae-ab84dd36c74b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.644016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a395221b-a2eb-495f-93ae-ab84dd36c74b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:38.670886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:38.679527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:38.706118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.706418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:38.707297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.707749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:38.737599 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a395221b-a2eb-495f-93ae-ab84dd36c74b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.134573 Nov 27 21:01:38.741713 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2236/4595] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:38 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:38.894357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:38.895466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:38.916225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.916638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:38.918712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:38.921903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:39.178312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:39.185928 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52603bb3-2247-4d7a-8100-3bc15379aee4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.519565 Nov 27 21:01:39.188641 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2360/4596] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:38 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:39.199996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ebe8fd9-8176-4624-a280-72e27c631113 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:39.204409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8ebe8fd9-8176-4624-a280-72e27c631113 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:39.218383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ebe8fd9-8176-4624-a280-72e27c631113 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:39.219048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ebe8fd9-8176-4624-a280-72e27c631113 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:39.224527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ebe8fd9-8176-4624-a280-72e27c631113 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:39.225231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ebe8fd9-8176-4624-a280-72e27c631113 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:39.294959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:39.310761 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8a1b048-435a-4a93-929b-a4cdd880ad7a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1275 microversion: 2.1 time: 0.422046 Nov 27 21:01:39.316024 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2237/4597] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:38 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1275 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:39.326851 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ebe8fd9-8176-4624-a280-72e27c631113 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.134160 Nov 27 21:01:39.331224 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2361/4598] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:39 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:39.750800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0dbb733-9c46-4985-8325-08237c890efc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:39.751461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0dbb733-9c46-4985-8325-08237c890efc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:39.767416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dbb733-9c46-4985-8325-08237c890efc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:39.769652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dbb733-9c46-4985-8325-08237c890efc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:39.770481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dbb733-9c46-4985-8325-08237c890efc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:39.770923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dbb733-9c46-4985-8325-08237c890efc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:39.902858 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0dbb733-9c46-4985-8325-08237c890efc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.156184 Nov 27 21:01:39.908510 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2238/4599] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:39 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:40.210225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:40.217815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:40.267449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:40.269591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:40.287946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:40.291526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:40.334691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:40.335393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:40.350642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:40.351570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:40.357354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:40.359001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:40.835195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:40.879013 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89b3a25d-2636-4051-a897-4d4ccac01a5b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.674199 Nov 27 21:01:40.879323 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2362/4600] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:40 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:40.913178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e70667ad-e29d-458d-958d-671de5e3afb4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:40.914151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e70667ad-e29d-458d-958d-671de5e3afb4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:40.949183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e70667ad-e29d-458d-958d-671de5e3afb4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:40.949650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e70667ad-e29d-458d-958d-671de5e3afb4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:40.952735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e70667ad-e29d-458d-958d-671de5e3afb4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:40.954070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e70667ad-e29d-458d-958d-671de5e3afb4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:41.055523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:41.062421 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e70667ad-e29d-458d-958d-671de5e3afb4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.167179 Nov 27 21:01:41.064941 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2363/4601] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:40 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:41.070022 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cfc8767c-5794-4f9a-8c2f-c5d1f86fa85a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.739319 Nov 27 21:01:41.079621 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2239/4602] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:40 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:41.088217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8869779c-5d51-4142-bccc-3fb8cc03d5d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:41.091311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8869779c-5d51-4142-bccc-3fb8cc03d5d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:41.109537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8869779c-5d51-4142-bccc-3fb8cc03d5d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:41.110519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8869779c-5d51-4142-bccc-3fb8cc03d5d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:41.111603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8869779c-5d51-4142-bccc-3fb8cc03d5d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:41.113281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8869779c-5d51-4142-bccc-3fb8cc03d5d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:41.216396 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8869779c-5d51-4142-bccc-3fb8cc03d5d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.147563 Nov 27 21:01:41.218956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2364/4603] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:41 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:41.908035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:41.911595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:41.940095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:41.940579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:41.941726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:41.942409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:42.077999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9def7c99-bb5c-4fe1-be05-a282f21e2647 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:42.079567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9def7c99-bb5c-4fe1-be05-a282f21e2647 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:42.095784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9def7c99-bb5c-4fe1-be05-a282f21e2647 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:42.096325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9def7c99-bb5c-4fe1-be05-a282f21e2647 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:42.097162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9def7c99-bb5c-4fe1-be05-a282f21e2647 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:42.102256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9def7c99-bb5c-4fe1-be05-a282f21e2647 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:42.208507 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9def7c99-bb5c-4fe1-be05-a282f21e2647 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.135483 Nov 27 21:01:42.209985 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2365/4604] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:42 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:42.232575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:42.236307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:42.251980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:42.252799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:42.254661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:42.255445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:42.945881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:42.957522 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d1a933f-3094-470c-8d4c-f60e5655392d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.746155 Nov 27 21:01:42.958302 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2366/4605] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:42 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:42.973553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf677022-9f4c-4e3e-ae19-287541b3d85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:42.974911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf677022-9f4c-4e3e-ae19-287541b3d85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:42.986563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf677022-9f4c-4e3e-ae19-287541b3d85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:42.987432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf677022-9f4c-4e3e-ae19-287541b3d85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:42.988471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf677022-9f4c-4e3e-ae19-287541b3d85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:42.989141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf677022-9f4c-4e3e-ae19-287541b3d85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:43.037133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf677022-9f4c-4e3e-ae19-287541b3d85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.071849 Nov 27 21:01:43.038672 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2367/4606] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:42 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:43.084829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:43.098085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3cc8f26d-b479-49f1-ad5e-be63062d9fa6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 1.202103 Nov 27 21:01:43.099999 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2240/4607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:41 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:43.223006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9462bb61-b8ac-4df4-a733-4fd5b391642f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:43.224639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9462bb61-b8ac-4df4-a733-4fd5b391642f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:43.241846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9462bb61-b8ac-4df4-a733-4fd5b391642f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:43.243051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9462bb61-b8ac-4df4-a733-4fd5b391642f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:43.245238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9462bb61-b8ac-4df4-a733-4fd5b391642f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:43.247362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9462bb61-b8ac-4df4-a733-4fd5b391642f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:43.361318 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9462bb61-b8ac-4df4-a733-4fd5b391642f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.142772 Nov 27 21:01:43.387339 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2368/4608] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:43 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:43.932239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b5a7b393-28a2-46e3-aeaa-8e63d517f6f9 req-cb321e31-300a-457e-b8a6-85cd0cf54fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b6c899-fdda-44b9-ab69-ac12532eb0a6", "tag": "6580fb53-9a2e-4175-a865-446fc1bf256a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:43.933833 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:43.933833 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:43.954120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b5a7b393-28a2-46e3-aeaa-8e63d517f6f9 req-cb321e31-300a-457e-b8a6-85cd0cf54fa3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:43.955476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b5a7b393-28a2-46e3-aeaa-8e63d517f6f9 req-cb321e31-300a-457e-b8a6-85cd0cf54fa3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:43.975514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:43.976489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:43.995916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:43.999055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.001662 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b5a7b393-28a2-46e3-aeaa-8e63d517f6f9 req-cb321e31-300a-457e-b8a6-85cd0cf54fa3 service nova] Creating event network-changed:6580fb53-9a2e-4175-a865-446fc1bf256a for instance c2b6c899-fdda-44b9-ab69-ac12532eb0a6 on nch1-master-1 Nov 27 21:01:44.004473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:44.010440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.034420 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b5a7b393-28a2-46e3-aeaa-8e63d517f6f9 req-cb321e31-300a-457e-b8a6-85cd0cf54fa3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106707 Nov 27 21:01:44.040279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2241/4609] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:44.061976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8a5dbe4-1a2b-45be-851f-91a2c5f6037d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:44.063039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8a5dbe4-1a2b-45be-851f-91a2c5f6037d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:44.083514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a5dbe4-1a2b-45be-851f-91a2c5f6037d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:44.084263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a5dbe4-1a2b-45be-851f-91a2c5f6037d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.085267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a5dbe4-1a2b-45be-851f-91a2c5f6037d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:44.091640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a5dbe4-1a2b-45be-851f-91a2c5f6037d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.197418 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8a5dbe4-1a2b-45be-851f-91a2c5f6037d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.151016 Nov 27 21:01:44.198824 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2242/4610] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:44 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:44.214587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:44.215434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:44.224808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:44.225623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.226662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:44.235170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.434648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:44.458987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1d9fba3-2796-49a6-8530-0da77a20d34f tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.487919 Nov 27 21:01:44.472215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2369/4611] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:43 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:44.486633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b9436f31-76b4-4aa0-b463-663dc8c45a19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:44.488143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b9436f31-76b4-4aa0-b463-663dc8c45a19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:44.506113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9436f31-76b4-4aa0-b463-663dc8c45a19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:44.506947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9436f31-76b4-4aa0-b463-663dc8c45a19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.508268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9436f31-76b4-4aa0-b463-663dc8c45a19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:44.509020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9436f31-76b4-4aa0-b463-663dc8c45a19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:44.573349 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b9436f31-76b4-4aa0-b463-663dc8c45a19 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.097736 Nov 27 21:01:44.574345 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2370/4612] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:44 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:44.865560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:44.875773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d9811a4b-ff12-4094-997b-6f28446ad15a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.675357 Nov 27 21:01:44.877461 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2243/4613] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:44 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:45.212920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c09b9b87-bc50-47f0-99c5-160384c8ab16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:45.215138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c09b9b87-bc50-47f0-99c5-160384c8ab16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:45.232127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09b9b87-bc50-47f0-99c5-160384c8ab16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.235029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09b9b87-bc50-47f0-99c5-160384c8ab16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:45.238002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09b9b87-bc50-47f0-99c5-160384c8ab16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.239316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09b9b87-bc50-47f0-99c5-160384c8ab16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:45.330412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c09b9b87-bc50-47f0-99c5-160384c8ab16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 24546 microversion: 2.32 time: 0.123768 Nov 27 21:01:45.331092 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2371/4614] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:45 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 24546 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:45.480517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:45.481697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:45.501773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.502491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:45.503511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.504115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:45.586448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-478af021-b171-492d-9485-5a86368ba7c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:45.592556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-478af021-b171-492d-9485-5a86368ba7c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:45.604577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478af021-b171-492d-9485-5a86368ba7c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.605054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478af021-b171-492d-9485-5a86368ba7c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:45.605854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478af021-b171-492d-9485-5a86368ba7c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.606304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478af021-b171-492d-9485-5a86368ba7c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:45.692490 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-478af021-b171-492d-9485-5a86368ba7c9 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.109952 Nov 27 21:01:45.693633 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2372/4615] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:45 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:45.894612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:45.895382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:45.925340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.925807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:45.926836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:45.927484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:46.059093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:46.071239 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70f9b178-c7a6-4258-a0f5-f10614f4c0cf tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.596094 Nov 27 21:01:46.074076 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2244/4616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:45 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:46.422809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:46.452354 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6debb09a-95dd-4259-980b-b3076b591a3b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.560658 Nov 27 21:01:46.462697 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2373/4617] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:45 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:46.705184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44af208b-d1b2-4288-a7b7-6da71f76c010 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:46.706861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-44af208b-d1b2-4288-a7b7-6da71f76c010 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:46.718035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b955e3bd-4173-48ea-8c4f-230449cb975e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:46.719003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44af208b-d1b2-4288-a7b7-6da71f76c010 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:46.719169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b955e3bd-4173-48ea-8c4f-230449cb975e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:46.723452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44af208b-d1b2-4288-a7b7-6da71f76c010 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:46.724537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44af208b-d1b2-4288-a7b7-6da71f76c010 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:46.725272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44af208b-d1b2-4288-a7b7-6da71f76c010 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:46.728421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b955e3bd-4173-48ea-8c4f-230449cb975e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:46.729231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b955e3bd-4173-48ea-8c4f-230449cb975e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:46.730276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b955e3bd-4173-48ea-8c4f-230449cb975e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:46.730944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b955e3bd-4173-48ea-8c4f-230449cb975e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:46.802472 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44af208b-d1b2-4288-a7b7-6da71f76c010 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.100684 Nov 27 21:01:46.810883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b955e3bd-4173-48ea-8c4f-230449cb975e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 32562 microversion: 2.32 time: 0.471486 Nov 27 21:01:46.815994 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2374/4618] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:46 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:46.816141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2245/4619] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:46 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 32562 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:47.092151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:47.092862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:47.099734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:47.100193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:47.101028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:47.101472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:47.470733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:47.471778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:47.490249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:47.491341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:47.492353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:47.492965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:47.900582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:47.914261 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2d45266-cdd7-4b03-b4d5-a6cce62fc17a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.448937 Nov 27 21:01:47.915187 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2246/4620] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:47 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:47.922437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b4a452b4-e9c1-474f-80a8-c4088ffb170e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:47.924221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b4a452b4-e9c1-474f-80a8-c4088ffb170e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:47.933017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a452b4-e9c1-474f-80a8-c4088ffb170e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:47.933992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a452b4-e9c1-474f-80a8-c4088ffb170e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:47.935079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a452b4-e9c1-474f-80a8-c4088ffb170e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:47.935825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4a452b4-e9c1-474f-80a8-c4088ffb170e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:47.952104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:47.970483 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e9f0beec-d657-45cc-a6b6-2c191c734875 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.882743 Nov 27 21:01:47.979714 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2375/4621] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:47 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:47.997141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8fc99bc9-ee4d-4d15-8e19-c4eb0a3f7caf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:48.000087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8fc99bc9-ee4d-4d15-8e19-c4eb0a3f7caf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:48.015007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc99bc9-ee4d-4d15-8e19-c4eb0a3f7caf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:48.016125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc99bc9-ee4d-4d15-8e19-c4eb0a3f7caf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:48.017083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc99bc9-ee4d-4d15-8e19-c4eb0a3f7caf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:48.017739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc99bc9-ee4d-4d15-8e19-c4eb0a3f7caf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:48.045470 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b4a452b4-e9c1-474f-80a8-c4088ffb170e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.127892 Nov 27 21:01:48.050056 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2247/4622] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:47 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:48.079555 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8fc99bc9-ee4d-4d15-8e19-c4eb0a3f7caf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 32562 microversion: 2.32 time: 0.097658 Nov 27 21:01:48.080890 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2376/4623] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:47 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 32562 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:48.934291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:48.935733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:48.962772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:48.963288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:48.969061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:48.969479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:48.998714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:49.000485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:49.019098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:49.019919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:49.024555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:49.025039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:49.304745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:49.315917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3c954e1-e8bb-4645-899c-9ffcc0d055a2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.387313 Nov 27 21:01:49.324270 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2248/4624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:48 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:49.331606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8fed7eb-775e-450a-a0de-52a3b7d35b47 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:49.336696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8fed7eb-775e-450a-a0de-52a3b7d35b47 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:49.345678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8fed7eb-775e-450a-a0de-52a3b7d35b47 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:49.346140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8fed7eb-775e-450a-a0de-52a3b7d35b47 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:49.347027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8fed7eb-775e-450a-a0de-52a3b7d35b47 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:49.347477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8fed7eb-775e-450a-a0de-52a3b7d35b47 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:49.402625 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8fed7eb-775e-450a-a0de-52a3b7d35b47 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.076446 Nov 27 21:01:49.403415 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2249/4625] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:49 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:49.412416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a2d0c5f-a8f1-4de4-8ab3-439839836a32 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:49.413633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a2d0c5f-a8f1-4de4-8ab3-439839836a32 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:49.421566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a2d0c5f-a8f1-4de4-8ab3-439839836a32 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:49.422396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a2d0c5f-a8f1-4de4-8ab3-439839836a32 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:49.423391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a2d0c5f-a8f1-4de4-8ab3-439839836a32 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:49.423879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a2d0c5f-a8f1-4de4-8ab3-439839836a32 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:49.479126 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a2d0c5f-a8f1-4de4-8ab3-439839836a32 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 32562 microversion: 2.32 time: 0.073595 Nov 27 21:01:49.479963 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2250/4626] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:49 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 32562 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:49.613295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:49.620786 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53abbd3e-bfbe-4499-9b7f-40b13fdaf7fb tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.636310 Nov 27 21:01:49.631050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2377/4627] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:48 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:50.337466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:50.338164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:50.354362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.355364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:50.359129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.359806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:50.414477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b784529f-d918-4b86-9eec-de8a42779161 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:50.416517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b784529f-d918-4b86-9eec-de8a42779161 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:50.436289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b784529f-d918-4b86-9eec-de8a42779161 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.438525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b784529f-d918-4b86-9eec-de8a42779161 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:50.442203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b784529f-d918-4b86-9eec-de8a42779161 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.444418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b784529f-d918-4b86-9eec-de8a42779161 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:50.543293 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b784529f-d918-4b86-9eec-de8a42779161 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.132788 Nov 27 21:01:50.545639 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2378/4628] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:50 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:50.553371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e83cbc4-eead-447d-8ade-a337028d0b99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:50.554584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e83cbc4-eead-447d-8ade-a337028d0b99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:50.572736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e83cbc4-eead-447d-8ade-a337028d0b99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.573363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e83cbc4-eead-447d-8ade-a337028d0b99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:50.576746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e83cbc4-eead-447d-8ade-a337028d0b99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.577521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e83cbc4-eead-447d-8ade-a337028d0b99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:50.685949 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e83cbc4-eead-447d-8ade-a337028d0b99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 32562 microversion: 2.32 time: 0.135746 Nov 27 21:01:50.688000 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2379/4629] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:50 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 32562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:50.704529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:50.706956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:50.721354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.722104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:50.723395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:50.734412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:51.096028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:51.120310 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb7c5538-8b80-4864-a018-4b7b3373cb8a tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.430626 Nov 27 21:01:51.134902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:51.137759 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2380/4630] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:50 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:51.147832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-98c2ce48-61bd-4afe-85b4-4dde1540e59d req-098397e1-941d-47f0-b998-0746abfd0084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b6c899-fdda-44b9-ab69-ac12532eb0a6", "name": "network-vif-plugged", "status": "completed", "tag": "6580fb53-9a2e-4175-a865-446fc1bf256a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:51.149485 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:51.149485 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:01:51.150931 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca44cda9-1917-4361-88e4-ccb371bc3e29 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.817959 Nov 27 21:01:51.152105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2251/4631] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:50 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:51.157633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-98c2ce48-61bd-4afe-85b4-4dde1540e59d req-098397e1-941d-47f0-b998-0746abfd0084 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:51.158512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-98c2ce48-61bd-4afe-85b4-4dde1540e59d req-098397e1-941d-47f0-b998-0746abfd0084 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:51.178024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-98c2ce48-61bd-4afe-85b4-4dde1540e59d req-098397e1-941d-47f0-b998-0746abfd0084 service nova] Creating event network-vif-plugged:6580fb53-9a2e-4175-a865-446fc1bf256a for instance c2b6c899-fdda-44b9-ab69-ac12532eb0a6 on nch1-master-1 Nov 27 21:01:51.184293 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-98c2ce48-61bd-4afe-85b4-4dde1540e59d req-098397e1-941d-47f0-b998-0746abfd0084 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044859 Nov 27 21:01:51.186089 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2381/4632] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:51.557057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9382912f-67ec-4cec-b891-97215d58ee6f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:51.558056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9382912f-67ec-4cec-b891-97215d58ee6f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:51.570093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9382912f-67ec-4cec-b891-97215d58ee6f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:51.571479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9382912f-67ec-4cec-b891-97215d58ee6f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:51.574130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9382912f-67ec-4cec-b891-97215d58ee6f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:51.574834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9382912f-67ec-4cec-b891-97215d58ee6f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:51.648190 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9382912f-67ec-4cec-b891-97215d58ee6f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.094885 Nov 27 21:01:51.649339 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2252/4633] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:51 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:51.702745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8863fac-1c70-4505-92b7-8f62205ba21c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:51.705652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8863fac-1c70-4505-92b7-8f62205ba21c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:51.720382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8863fac-1c70-4505-92b7-8f62205ba21c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:51.722105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8863fac-1c70-4505-92b7-8f62205ba21c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:51.724528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8863fac-1c70-4505-92b7-8f62205ba21c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:51.724828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8863fac-1c70-4505-92b7-8f62205ba21c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:51.802669 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8863fac-1c70-4505-92b7-8f62205ba21c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 32562 microversion: 2.32 time: 0.105981 Nov 27 21:01:51.803893 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2382/4634] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:51 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 32562 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:52.153374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:52.155694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:52.164851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.165616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.166873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.167665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.174367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:52.176431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:52.189431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.190730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.192051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.193677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.365954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:52.377210 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a6668b44-d8da-450b-a214-2d55d60746d1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.212456 Nov 27 21:01:52.380934 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2383/4635] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:52 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:52.661179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-980c0b95-68b7-4ca3-ab7d-601a29da8f04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:52.662066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-980c0b95-68b7-4ca3-ab7d-601a29da8f04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:52.669148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-980c0b95-68b7-4ca3-ab7d-601a29da8f04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.670096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-980c0b95-68b7-4ca3-ab7d-601a29da8f04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.671023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-980c0b95-68b7-4ca3-ab7d-601a29da8f04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.671487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-980c0b95-68b7-4ca3-ab7d-601a29da8f04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.719221 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-980c0b95-68b7-4ca3-ab7d-601a29da8f04 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.062487 Nov 27 21:01:52.721916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2384/4636] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:52 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:52.816494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1fd3b70-d8e1-4023-8cd3-d55e13a7ff24 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:52.818479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1fd3b70-d8e1-4023-8cd3-d55e13a7ff24 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:52.826215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fd3b70-d8e1-4023-8cd3-d55e13a7ff24 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.826668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fd3b70-d8e1-4023-8cd3-d55e13a7ff24 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.827614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fd3b70-d8e1-4023-8cd3-d55e13a7ff24 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:52.828066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fd3b70-d8e1-4023-8cd3-d55e13a7ff24 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:52.879084 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1fd3b70-d8e1-4023-8cd3-d55e13a7ff24 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 32562 microversion: 2.32 time: 0.066630 Nov 27 21:01:52.880022 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2385/4637] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:52 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 32562 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:52.952816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:52.965097 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f3f4b55-baba-449a-9c01-2d99b703cfd9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1317 microversion: 2.1 time: 0.818073 Nov 27 21:01:52.965690 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2253/4638] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:52 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1317 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:53.401239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:53.402145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:53.414973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:53.415497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:53.416448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:53.416924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:53.736107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e2347597-3793-4c95-8865-4220edbf4915 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:53.737140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e2347597-3793-4c95-8865-4220edbf4915 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:53.746835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2347597-3793-4c95-8865-4220edbf4915 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:53.748578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2347597-3793-4c95-8865-4220edbf4915 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:53.749451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2347597-3793-4c95-8865-4220edbf4915 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:53.750031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2347597-3793-4c95-8865-4220edbf4915 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:53.809127 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e2347597-3793-4c95-8865-4220edbf4915 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.077982 Nov 27 21:01:53.811554 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2254/4639] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:53 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:53.853298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:53.870360 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-768afb67-6933-45a7-8770-be87293082fc tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.473353 Nov 27 21:01:53.871070 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2386/4640] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:53 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:53.893747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc00ca70-ee0c-44e4-9cb3-692780fe04af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:53.896334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc00ca70-ee0c-44e4-9cb3-692780fe04af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:53.909671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc00ca70-ee0c-44e4-9cb3-692780fe04af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:53.911449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc00ca70-ee0c-44e4-9cb3-692780fe04af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:53.913886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc00ca70-ee0c-44e4-9cb3-692780fe04af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:53.914591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc00ca70-ee0c-44e4-9cb3-692780fe04af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:53.983975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:53.984498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:53.994010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc00ca70-ee0c-44e4-9cb3-692780fe04af tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.106633 Nov 27 21:01:53.999082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:53.999560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.004569 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2255/4641] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:53 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:54.004739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.004739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.437494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:54.463550 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d76402f-e4d6-4370-85d6-a241ec707514 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1506 microversion: 2.1 time: 0.484337 Nov 27 21:01:54.479348 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2387/4642] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:53 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:54.490030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f0bfce0b-b74e-4a67-9490-73bf2f7231ec tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:54.491926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f0bfce0b-b74e-4a67-9490-73bf2f7231ec tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:54.509949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0bfce0b-b74e-4a67-9490-73bf2f7231ec tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.511382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0bfce0b-b74e-4a67-9490-73bf2f7231ec tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.512968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0bfce0b-b74e-4a67-9490-73bf2f7231ec tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.514707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0bfce0b-b74e-4a67-9490-73bf2f7231ec tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.565704 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f0bfce0b-b74e-4a67-9490-73bf2f7231ec tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6/ips" status: 200 len: 109 microversion: 2.1 time: 0.086031 Nov 27 21:01:54.572335 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2256/4643] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:01:54 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6/ips => generated 109 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:54.584310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db0978e8-cf78-493c-9d8f-7a30ce9490b9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:54.585772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db0978e8-cf78-493c-9d8f-7a30ce9490b9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:54.597211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db0978e8-cf78-493c-9d8f-7a30ce9490b9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.601029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db0978e8-cf78-493c-9d8f-7a30ce9490b9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.602463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db0978e8-cf78-493c-9d8f-7a30ce9490b9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.603045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db0978e8-cf78-493c-9d8f-7a30ce9490b9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.634015 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db0978e8-cf78-493c-9d8f-7a30ce9490b9 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6/ips" status: 200 len: 109 microversion: 2.1 time: 0.055119 Nov 27 21:01:54.641975 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2388/4644] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:01:54 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6/ips => generated 109 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:54.646357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f32dd95f-0d22-46c6-9a9c-68fab0cd8f55 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:54.647025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f32dd95f-0d22-46c6-9a9c-68fab0cd8f55 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:54.655036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32dd95f-0d22-46c6-9a9c-68fab0cd8f55 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.655673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32dd95f-0d22-46c6-9a9c-68fab0cd8f55 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.656749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32dd95f-0d22-46c6-9a9c-68fab0cd8f55 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.657429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f32dd95f-0d22-46c6-9a9c-68fab0cd8f55 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.690921 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f32dd95f-0d22-46c6-9a9c-68fab0cd8f55 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6/ips/tempest-ServerAddressesTestJSON-2036404057-network" status: 200 len: 94 microversion: 2.1 time: 0.048583 Nov 27 21:01:54.692352 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2257/4645] 10.222.0.21 () {58 vars in 1400 bytes} [Sat Nov 27 21:01:54 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6/ips/tempest-ServerAddressesTestJSON-2036404057-network => generated 94 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:01:54.704877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:54.705469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:54.721247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.722088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.724650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.725206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.812626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:01:54.822509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c3efe701-fe47-41e3-83b6-fd0c5a025b13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:54.823747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c3efe701-fe47-41e3-83b6-fd0c5a025b13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:54.843120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3efe701-fe47-41e3-83b6-fd0c5a025b13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.847996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3efe701-fe47-41e3-83b6-fd0c5a025b13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.849369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3efe701-fe47-41e3-83b6-fd0c5a025b13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.850164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3efe701-fe47-41e3-83b6-fd0c5a025b13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.941496 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c3efe701-fe47-41e3-83b6-fd0c5a025b13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.122169 Nov 27 21:01:54.942193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2258/4646] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:54 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:54.955597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:54.957183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:54.973771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.974525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:54.977333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:54.978036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:55.012033 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5935e94-d66a-40b2-aa43-4a0b16c3dd5e tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 204 len: 0 microversion: 2.1 time: 0.312344 Nov 27 21:01:55.016006 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2389/4647] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:01:54 2021] DELETE /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:01:55.018899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc2b7016-f818-4864-bc40-9675ce398005 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:55.028855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc2b7016-f818-4864-bc40-9675ce398005 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:55.045656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b7016-f818-4864-bc40-9675ce398005 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:55.046613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b7016-f818-4864-bc40-9675ce398005 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:55.047713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b7016-f818-4864-bc40-9675ce398005 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:55.049554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b7016-f818-4864-bc40-9675ce398005 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:55.155222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc2b7016-f818-4864-bc40-9675ce398005 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.139593 Nov 27 21:01:55.156630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2390/4648] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:55 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:55.163537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:55.164300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:55.191153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:55.192110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:55.192767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:55.193783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:55.408593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:55.432840 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a6b1a80-f9ff-4e3e-a8bb-664170f0f6b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.484336 Nov 27 21:01:55.445452 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2259/4649] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:54 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:55.806575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:55.817107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f3e2e13-ee62-47c1-ae53-98e592e789ca tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1512 microversion: 2.1 time: 0.659765 Nov 27 21:01:55.817705 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2391/4650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:55 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1512 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:55.955845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e56fc4aa-054a-47eb-a3cd-3a828e28f88d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:55.957088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e56fc4aa-054a-47eb-a3cd-3a828e28f88d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:55.970901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e56fc4aa-054a-47eb-a3cd-3a828e28f88d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:55.971388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e56fc4aa-054a-47eb-a3cd-3a828e28f88d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:55.972651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e56fc4aa-054a-47eb-a3cd-3a828e28f88d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:55.973614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e56fc4aa-054a-47eb-a3cd-3a828e28f88d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:56.050167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e56fc4aa-054a-47eb-a3cd-3a828e28f88d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.099648 Nov 27 21:01:56.051880 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2260/4651] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:55 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:56.168086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-021f0d1b-a8d3-41e8-bb43-e04b5c83c7c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:56.169038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-021f0d1b-a8d3-41e8-bb43-e04b5c83c7c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:56.182536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021f0d1b-a8d3-41e8-bb43-e04b5c83c7c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:56.183588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021f0d1b-a8d3-41e8-bb43-e04b5c83c7c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:56.184808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021f0d1b-a8d3-41e8-bb43-e04b5c83c7c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:56.185457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-021f0d1b-a8d3-41e8-bb43-e04b5c83c7c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:56.280208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-021f0d1b-a8d3-41e8-bb43-e04b5c83c7c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.115236 Nov 27 21:01:56.286104 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2392/4652] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:56 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:56.453817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:56.455621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:56.468255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:56.468721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:56.469561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:56.476556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:56.838744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:56.839824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:56.853581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:56.854241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:56.855945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:56.856531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:57.115100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:57.127213 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eecc7de8-e912-4c6e-859b-71572f76f88d tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1512 microversion: 2.1 time: 0.293988 Nov 27 21:01:57.128664 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2393/4653] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:56 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:57.144789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3619134-f382-4166-83fb-c136e07fba7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:57.145912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3619134-f382-4166-83fb-c136e07fba7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:57.171223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3619134-f382-4166-83fb-c136e07fba7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:57.172624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3619134-f382-4166-83fb-c136e07fba7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:57.174275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3619134-f382-4166-83fb-c136e07fba7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:57.174953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3619134-f382-4166-83fb-c136e07fba7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:57.249544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3619134-f382-4166-83fb-c136e07fba7d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.106635 Nov 27 21:01:57.251074 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2394/4654] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:57 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:57.296620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5d821eb-e7e7-43e6-ac70-7f6c3790ce04 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:57.297756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5d821eb-e7e7-43e6-ac70-7f6c3790ce04 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:57.307008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d821eb-e7e7-43e6-ac70-7f6c3790ce04 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:57.307845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d821eb-e7e7-43e6-ac70-7f6c3790ce04 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:57.308962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d821eb-e7e7-43e6-ac70-7f6c3790ce04 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:57.309560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5d821eb-e7e7-43e6-ac70-7f6c3790ce04 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:57.392321 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5d821eb-e7e7-43e6-ac70-7f6c3790ce04 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.100974 Nov 27 21:01:57.393158 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2395/4655] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:57 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:57.414013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:57.426234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-804577b3-d1b5-448b-ad7f-9224a1f2a5db tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.974763 Nov 27 21:01:57.427963 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2261/4656] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:56 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:58.147000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:58.148400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:58.166204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.168019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.169226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.170171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.265140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21b10661-c896-404e-9395-69d036eb820e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:58.266267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-21b10661-c896-404e-9395-69d036eb820e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:58.282223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21b10661-c896-404e-9395-69d036eb820e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.282774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21b10661-c896-404e-9395-69d036eb820e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.283636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21b10661-c896-404e-9395-69d036eb820e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.284080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21b10661-c896-404e-9395-69d036eb820e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.365959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:58.371523 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21b10661-c896-404e-9395-69d036eb820e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.111531 Nov 27 21:01:58.377903 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2262/4657] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:58 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:58.378592 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec26a59e-0e82-40c9-bb50-d3e248c46e26 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1512 microversion: 2.1 time: 0.235421 Nov 27 21:01:58.379595 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2396/4658] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:58 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:58.405688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05cb7247-ab25-4cc7-9843-f5b90a4612c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:58.406804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05cb7247-ab25-4cc7-9843-f5b90a4612c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:58.415654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05cb7247-ab25-4cc7-9843-f5b90a4612c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.416843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05cb7247-ab25-4cc7-9843-f5b90a4612c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.418347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05cb7247-ab25-4cc7-9843-f5b90a4612c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.419068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05cb7247-ab25-4cc7-9843-f5b90a4612c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.446043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:58.447169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:58.464171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.466660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.469146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.469841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.547742 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05cb7247-ab25-4cc7-9843-f5b90a4612c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.144013 Nov 27 21:01:58.549990 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2263/4659] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:58 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:58.673821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:58.686515 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-851ecef4-58ba-4b03-983c-66b3c89adf46 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.245147 Nov 27 21:01:58.687113 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2397/4660] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:58 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:01:58.782463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8adb4b47-8861-417f-91cf-3e35628f7b9f req-70f457be-13dd-45db-b091-e3ff6cee4e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b6c899-fdda-44b9-ab69-ac12532eb0a6", "name": "network-vif-deleted", "tag": "6580fb53-9a2e-4175-a865-446fc1bf256a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:58.784660 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:58.784660 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:01:58.804882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8adb4b47-8861-417f-91cf-3e35628f7b9f req-70f457be-13dd-45db-b091-e3ff6cee4e09 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:58.806247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8adb4b47-8861-417f-91cf-3e35628f7b9f req-70f457be-13dd-45db-b091-e3ff6cee4e09 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:58.837899 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8adb4b47-8861-417f-91cf-3e35628f7b9f req-70f457be-13dd-45db-b091-e3ff6cee4e09 service nova] Creating event network-vif-deleted:6580fb53-9a2e-4175-a865-446fc1bf256a for instance c2b6c899-fdda-44b9-ab69-ac12532eb0a6 on nch1-master-1 Nov 27 21:01:58.847742 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8adb4b47-8861-417f-91cf-3e35628f7b9f req-70f457be-13dd-45db-b091-e3ff6cee4e09 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072073 Nov 27 21:01:58.849555 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2264/4661] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:01:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:01:59.396700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:59.397490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:59.399169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5fe21ba5-7c45-46c9-a26e-deddc7a30cfe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:59.402552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5fe21ba5-7c45-46c9-a26e-deddc7a30cfe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:59.415285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.416040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.418141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.418791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.425132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fe21ba5-7c45-46c9-a26e-deddc7a30cfe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.425600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fe21ba5-7c45-46c9-a26e-deddc7a30cfe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.426414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fe21ba5-7c45-46c9-a26e-deddc7a30cfe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.426886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fe21ba5-7c45-46c9-a26e-deddc7a30cfe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.470795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.471615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.472372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lazy-loading 'fault' on Instance uuid c2b6c899-fdda-44b9-ab69-ac12532eb0a6 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:01:59.533103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5fe21ba5-7c45-46c9-a26e-deddc7a30cfe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.150437 Nov 27 21:01:59.535236 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2398/4662] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:59 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:01:59.573232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-981b00ff-0541-4a90-b8d0-f56380404dae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:01:59.574570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-981b00ff-0541-4a90-b8d0-f56380404dae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:59.622566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09c8b68a1545fb8733dd571bc9db4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998295c106db4d7b82c3c10f09fbe182', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:01:59.625901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981b00ff-0541-4a90-b8d0-f56380404dae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.629226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981b00ff-0541-4a90-b8d0-f56380404dae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.630140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981b00ff-0541-4a90-b8d0-f56380404dae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.630635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981b00ff-0541-4a90-b8d0-f56380404dae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.631753 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8a0e90fd-7005-42b9-9ecd-dff7a57d5ae0 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 200 len: 1307 microversion: 2.1 time: 0.239635 Nov 27 21:01:59.632659 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2265/4663] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:59 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:01:59.705388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:01:59.706010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:01:59.719553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.720162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:01:59.720947 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-981b00ff-0541-4a90-b8d0-f56380404dae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.162068 Nov 27 21:01:59.722304 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2399/4664] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:01:59 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:01:59.730009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:01:59.730469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:00.141797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:00.162000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff20e847-6c21-4665-88d6-6d1beb2e2f31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.461121 Nov 27 21:02:00.176102 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2266/4665] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:01:59 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:00.547903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6e37e10-4cfb-4f57-b337-2553fc9e8c13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:00.549635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6e37e10-4cfb-4f57-b337-2553fc9e8c13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:00.560755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e37e10-4cfb-4f57-b337-2553fc9e8c13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:00.561471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e37e10-4cfb-4f57-b337-2553fc9e8c13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:00.562506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e37e10-4cfb-4f57-b337-2553fc9e8c13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:00.563204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e37e10-4cfb-4f57-b337-2553fc9e8c13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:00.622244 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6e37e10-4cfb-4f57-b337-2553fc9e8c13 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078654 Nov 27 21:02:00.623444 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2400/4666] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:00 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:00.656474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:00.657337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] [instance: c2b6c899-fdda-44b9-ab69-ac12532eb0a6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:00.664828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:00.665374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:00.666455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:00.667705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:00.691602 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] HTTP exception thrown: Instance c2b6c899-fdda-44b9-ab69-ac12532eb0a6 could not be found. Nov 27 21:02:00.692537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] Returning 404 to user: Instance c2b6c899-fdda-44b9-ab69-ac12532eb0a6 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:00.694038 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e58104d5-5471-49e5-808f-4df51a9802b5 tempest-ServerAddressesTestJSON-1783872953 tempest-ServerAddressesTestJSON-1783872953-project] 10.222.0.21 "GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6" status: 404 len: 111 microversion: 2.1 time: 0.044193 Nov 27 21:02:00.711481 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2267/4667] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:00 2021] GET /compute/v2.1/servers/c2b6c899-fdda-44b9-ab69-ac12532eb0a6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:02:00.735332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-831c0f89-bf1b-4296-910f-9fddccf9f6a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:00.736760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-831c0f89-bf1b-4296-910f-9fddccf9f6a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:00.745881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831c0f89-bf1b-4296-910f-9fddccf9f6a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:00.746678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831c0f89-bf1b-4296-910f-9fddccf9f6a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:00.748128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831c0f89-bf1b-4296-910f-9fddccf9f6a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:00.748880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831c0f89-bf1b-4296-910f-9fddccf9f6a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:00.818405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-831c0f89-bf1b-4296-910f-9fddccf9f6a3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.084797 Nov 27 21:02:00.819528 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2401/4668] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:00 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:01.195003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:01.196935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:01.205659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:01.212084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:01.212084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:01.212084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:01.638840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-404df216-f34a-4ee7-8620-e2cf60789e7a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:01.644830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-404df216-f34a-4ee7-8620-e2cf60789e7a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:01.668288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-404df216-f34a-4ee7-8620-e2cf60789e7a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:01.668804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-404df216-f34a-4ee7-8620-e2cf60789e7a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:01.670166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-404df216-f34a-4ee7-8620-e2cf60789e7a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:01.678021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-404df216-f34a-4ee7-8620-e2cf60789e7a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:01.765256 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-404df216-f34a-4ee7-8620-e2cf60789e7a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.133218 Nov 27 21:02:01.769900 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2402/4669] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:01 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:01.834581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef1b768e-d510-4ec9-a885-598fecb62072 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:01.838013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef1b768e-d510-4ec9-a885-598fecb62072 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:01.850921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef1b768e-d510-4ec9-a885-598fecb62072 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:01.851479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef1b768e-d510-4ec9-a885-598fecb62072 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:01.852269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef1b768e-d510-4ec9-a885-598fecb62072 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:01.852731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef1b768e-d510-4ec9-a885-598fecb62072 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:01.909680 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef1b768e-d510-4ec9-a885-598fecb62072 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.081756 Nov 27 21:02:01.910380 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2403/4670] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:01 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:02.113289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:02.121096 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40ffaa33-132e-47c4-8fbf-bcff31c864f4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.944575 Nov 27 21:02:02.124833 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2268/4671] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:01 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:02.781057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4d3ffcd-a018-48bc-b105-6fa384150844 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:02.782274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4d3ffcd-a018-48bc-b105-6fa384150844 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:02.790311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d3ffcd-a018-48bc-b105-6fa384150844 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:02.791117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d3ffcd-a018-48bc-b105-6fa384150844 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:02.792230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d3ffcd-a018-48bc-b105-6fa384150844 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:02.793001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4d3ffcd-a018-48bc-b105-6fa384150844 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:02.852431 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4d3ffcd-a018-48bc-b105-6fa384150844 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.077709 Nov 27 21:02:02.853125 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2404/4672] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:02 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:02.923120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d15858e-02ed-4589-979a-cecd9e60326d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:02.924087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d15858e-02ed-4589-979a-cecd9e60326d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:02.948291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d15858e-02ed-4589-979a-cecd9e60326d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:02.948662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d15858e-02ed-4589-979a-cecd9e60326d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:02.952627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d15858e-02ed-4589-979a-cecd9e60326d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:02.954386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d15858e-02ed-4589-979a-cecd9e60326d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:03.055031 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d15858e-02ed-4589-979a-cecd9e60326d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.136375 Nov 27 21:02:03.056214 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2269/4673] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:02 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:03.142725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:03.144154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:03.151049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:03.151608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:03.152469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:03.152965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:03.534906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:03.545088 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d95f83e-33f9-40e5-bf0e-2ae7e9dafca0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.406576 Nov 27 21:02:03.570023 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2405/4674] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:03 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:03.866918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5517f95-ff4e-4078-8ed2-93ead844bf11 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:03.868077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e5517f95-ff4e-4078-8ed2-93ead844bf11 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:03.875377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5517f95-ff4e-4078-8ed2-93ead844bf11 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:03.875835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5517f95-ff4e-4078-8ed2-93ead844bf11 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:03.876635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5517f95-ff4e-4078-8ed2-93ead844bf11 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:03.877077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5517f95-ff4e-4078-8ed2-93ead844bf11 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:03.950138 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5517f95-ff4e-4078-8ed2-93ead844bf11 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.087234 Nov 27 21:02:03.957074 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2270/4675] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:03 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:04.070198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c53aff6a-efbe-4f34-933c-4b3ff98688b6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:04.071555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c53aff6a-efbe-4f34-933c-4b3ff98688b6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:04.090021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53aff6a-efbe-4f34-933c-4b3ff98688b6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:04.092230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53aff6a-efbe-4f34-933c-4b3ff98688b6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:04.093408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53aff6a-efbe-4f34-933c-4b3ff98688b6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:04.095574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53aff6a-efbe-4f34-933c-4b3ff98688b6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:04.158060 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c53aff6a-efbe-4f34-933c-4b3ff98688b6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.092887 Nov 27 21:02:04.159107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2406/4676] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:04 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:04.565747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:04.566527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:04.574989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:04.575778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:04.576753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:04.577386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:04.967839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2e80d43-3687-48dd-be9f-dae08a8a0fbd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:04.969890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2e80d43-3687-48dd-be9f-dae08a8a0fbd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:04.984574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e80d43-3687-48dd-be9f-dae08a8a0fbd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:04.987827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e80d43-3687-48dd-be9f-dae08a8a0fbd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:04.989117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e80d43-3687-48dd-be9f-dae08a8a0fbd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:04.991010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e80d43-3687-48dd-be9f-dae08a8a0fbd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:05.003539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:05.016401 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4f2a09cf-e158-4865-87c0-c9646eee1c12 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1507 microversion: 2.1 time: 0.456007 Nov 27 21:02:05.020701 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2271/4677] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:04 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1507 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:05.052475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2e80d43-3687-48dd-be9f-dae08a8a0fbd tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.088814 Nov 27 21:02:05.056724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2407/4678] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:04 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:05.171278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc361a47-1376-4fbf-a7b0-75b49abe1fa0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:05.172342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc361a47-1376-4fbf-a7b0-75b49abe1fa0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:05.181038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc361a47-1376-4fbf-a7b0-75b49abe1fa0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:05.181604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc361a47-1376-4fbf-a7b0-75b49abe1fa0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:05.182490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc361a47-1376-4fbf-a7b0-75b49abe1fa0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:05.183078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc361a47-1376-4fbf-a7b0-75b49abe1fa0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:05.249482 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc361a47-1376-4fbf-a7b0-75b49abe1fa0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.082867 Nov 27 21:02:05.254973 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2272/4679] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:05 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:06.041616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:06.043301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:06.056287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:06.056754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:06.064829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:06.065564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-447d0578-a94f-4b39-bd8a-ce4443a7516d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:06.066060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:06.066685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-447d0578-a94f-4b39-bd8a-ce4443a7516d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:06.083907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447d0578-a94f-4b39-bd8a-ce4443a7516d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:06.084774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447d0578-a94f-4b39-bd8a-ce4443a7516d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:06.087395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447d0578-a94f-4b39-bd8a-ce4443a7516d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:06.088940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447d0578-a94f-4b39-bd8a-ce4443a7516d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:06.180210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-447d0578-a94f-4b39-bd8a-ce4443a7516d tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.118626 Nov 27 21:02:06.188626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2273/4680] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:06 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:06.266214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-838cd15e-a7df-47f3-865b-191a9a8aa642 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:06.267665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-838cd15e-a7df-47f3-865b-191a9a8aa642 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:06.282689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-838cd15e-a7df-47f3-865b-191a9a8aa642 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:06.286537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-838cd15e-a7df-47f3-865b-191a9a8aa642 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:06.290143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-838cd15e-a7df-47f3-865b-191a9a8aa642 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:06.290619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-838cd15e-a7df-47f3-865b-191a9a8aa642 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:06.414422 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-838cd15e-a7df-47f3-865b-191a9a8aa642 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.155317 Nov 27 21:02:06.415094 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2274/4681] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:06 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:06.483591 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:02:06.483823 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:02:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 (ip 10.222.0.21) !!! Nov 27 21:02:06.647446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-801809759", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:06.709249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:06.724444 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af815b0c-2687-48d2-92b1-edcdd52b6050 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1487 microversion: 2.1 time: 0.689917 Nov 27 21:02:06.725556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2408/4682] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:06 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1487 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:06.729189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] validate_networks() for [('5fc9f4b4-8604-4ff4-85b1-28e814a55b3b', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:02:06.905626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-361440344", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef6c6178-d8bd-4309-ba9b-3100431bc7eb"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:07.000347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] validate_networks() for [('ef6c6178-d8bd-4309-ba9b-3100431bc7eb', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:02:07.828269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:02:07.828925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:02:07.829444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:02:07.830205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:02:07.830922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:02:07.843293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:07.843883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:07.845084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:07.845656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:07.866279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Getting quotas for project 2a621d68a46c42269f2eea4bc56c671f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:02:07.873015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Getting quotas for user 1ca08ebddb1742d18951633bf019d743 and project 2a621d68a46c42269f2eea4bc56c671f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:02:07.889084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:02:07.891579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:02:07.961015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:02:07.961992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:02:07.962158 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d938a098-b9c2-45a5-a9b7-4a2bc11b30f7 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.058993 Nov 27 21:02:07.963118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2409/4683] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:06 2021] POST /compute/v2.1/servers => generated 383 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:02:07.967719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:02:07.968189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:02:07.968628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:02:07.974933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42b8938b-0401-4ad2-86f0-7d236c278896 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:07.980990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42b8938b-0401-4ad2-86f0-7d236c278896 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:07.984860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:07.985343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:07.988352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:07.989308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b8938b-0401-4ad2-86f0-7d236c278896 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:07.990285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b8938b-0401-4ad2-86f0-7d236c278896 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:07.991766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b8938b-0401-4ad2-86f0-7d236c278896 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:07.992445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b8938b-0401-4ad2-86f0-7d236c278896 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:08.004217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:08.068165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Getting quotas for project 85c58aa2d3dd4e09a26b5265084b8493. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:02:08.075854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Getting quotas for user 9a60782e0d8945c2b99dac616fda491d and project 85c58aa2d3dd4e09a26b5265084b8493. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:02:08.099514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:02:08.105477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:02:08.119011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42b8938b-0401-4ad2-86f0-7d236c278896 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.149004 Nov 27 21:02:08.120637 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2410/4684] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:07 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:08.134804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3ff5d9d7-19ac-4a1c-9c9e-2a877ff1ba38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:08.136365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3ff5d9d7-19ac-4a1c-9c9e-2a877ff1ba38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:08.149037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ff5d9d7-19ac-4a1c-9c9e-2a877ff1ba38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:08.151209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ff5d9d7-19ac-4a1c-9c9e-2a877ff1ba38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:08.152940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ff5d9d7-19ac-4a1c-9c9e-2a877ff1ba38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:08.155850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ff5d9d7-19ac-4a1c-9c9e-2a877ff1ba38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:08.193800 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0455a2bf-2c1f-4c87-bbb3-07c2f609ba13 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774717 Nov 27 21:02:08.194828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2275/4685] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:02:08.208255 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3ff5d9d7-19ac-4a1c-9c9e-2a877ff1ba38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.085979 Nov 27 21:02:08.209422 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2411/4686] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:08 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:08.215667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86b93c4e-1f97-4a35-b97d-d8d73a793ae4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:08.216994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-86b93c4e-1f97-4a35-b97d-d8d73a793ae4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:08.222233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a14dffc3-f7be-4dae-a3a5-550145741234 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:08.222984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a14dffc3-f7be-4dae-a3a5-550145741234 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:08.357793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-86b93c4e-1f97-4a35-b97d-d8d73a793ae4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:08.367382 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86b93c4e-1f97-4a35-b97d-d8d73a793ae4 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1213 microversion: 2.1 time: 0.169947 Nov 27 21:02:08.369279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2276/4687] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:08 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:08.729641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a14dffc3-f7be-4dae-a3a5-550145741234 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:08.736733 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a14dffc3-f7be-4dae-a3a5-550145741234 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1216 microversion: 2.1 time: 0.526454 Nov 27 21:02:08.739556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2412/4688] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:08 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1216 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:09.133305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c111e793-4865-41af-8fdd-157ef1db26df tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:09.134074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c111e793-4865-41af-8fdd-157ef1db26df tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:09.144141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c111e793-4865-41af-8fdd-157ef1db26df tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.144663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c111e793-4865-41af-8fdd-157ef1db26df tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.145518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c111e793-4865-41af-8fdd-157ef1db26df tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.146921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c111e793-4865-41af-8fdd-157ef1db26df tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.200953 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c111e793-4865-41af-8fdd-157ef1db26df tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.071706 Nov 27 21:02:09.201613 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2277/4689] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:09 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:09.227207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5370f01-17d4-49f5-bb52-8e5f4b2cc399 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:09.229208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5370f01-17d4-49f5-bb52-8e5f4b2cc399 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:09.239147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5370f01-17d4-49f5-bb52-8e5f4b2cc399 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.239884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5370f01-17d4-49f5-bb52-8e5f4b2cc399 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.240695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5370f01-17d4-49f5-bb52-8e5f4b2cc399 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.241187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5370f01-17d4-49f5-bb52-8e5f4b2cc399 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.300170 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5370f01-17d4-49f5-bb52-8e5f4b2cc399 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.081782 Nov 27 21:02:09.301653 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2413/4690] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:09 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:09.387535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:09.388317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:09.403815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.404530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.405530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.408282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.639017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:09.650030 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c97cd5a1-6c20-4805-98dc-85da7014961d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1265 microversion: 2.1 time: 0.267052 Nov 27 21:02:09.651465 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2278/4691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:09 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:09.756928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:09.757628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:09.765483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.766261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.767393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:09.768072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:09.893855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:09.903867 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f388e996-c4a4-4ff1-9462-ac31947e09b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1268 microversion: 2.1 time: 0.150201 Nov 27 21:02:09.915418 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2414/4692] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:09 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:10.227708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42bd9978-948e-41c8-8b73-32a877ec4f43 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:10.229276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42bd9978-948e-41c8-8b73-32a877ec4f43 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:10.240394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42bd9978-948e-41c8-8b73-32a877ec4f43 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.244861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42bd9978-948e-41c8-8b73-32a877ec4f43 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.245694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42bd9978-948e-41c8-8b73-32a877ec4f43 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.248970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42bd9978-948e-41c8-8b73-32a877ec4f43 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.308098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42bd9978-948e-41c8-8b73-32a877ec4f43 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.095338 Nov 27 21:02:10.315097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0248596-6651-4317-b798-f439d73a5a83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:10.315690 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2279/4693] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:10 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:10.317442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0248596-6651-4317-b798-f439d73a5a83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:10.325130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0248596-6651-4317-b798-f439d73a5a83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.326739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0248596-6651-4317-b798-f439d73a5a83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.327549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0248596-6651-4317-b798-f439d73a5a83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.328223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0248596-6651-4317-b798-f439d73a5a83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.381873 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0248596-6651-4317-b798-f439d73a5a83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.072584 Nov 27 21:02:10.382901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2415/4694] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:10 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:10.668095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:10.669503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:10.676986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.677596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.678579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.679120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.922643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:10.923532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:10.930638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.931206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.932140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:10.932829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:10.962145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:10.974080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd7dc1d5-267e-4fd2-89c6-251dd5af6718 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.309854 Nov 27 21:02:10.985300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2280/4695] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:10 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:11.064919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:11.073587 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e891a078-d7fa-4902-a450-5ca647e3ee17 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1274 microversion: 2.1 time: 0.155421 Nov 27 21:02:11.084089 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2416/4696] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:10 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:11.326017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f50dae8-4f48-4c23-8bc8-71f01436db0e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:11.327572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f50dae8-4f48-4c23-8bc8-71f01436db0e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:11.337205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f50dae8-4f48-4c23-8bc8-71f01436db0e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:11.337942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f50dae8-4f48-4c23-8bc8-71f01436db0e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:11.338748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f50dae8-4f48-4c23-8bc8-71f01436db0e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:11.339407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f50dae8-4f48-4c23-8bc8-71f01436db0e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:11.370470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-40fdb2da-ca47-4472-a5a8-eb816eabe823 req-95a2f570-b2de-4e85-81c5-225977efaad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fb9db5-02b8-492d-97c8-c1d5a21bda25", "tag": "a6449fff-e553-48b7-bba1-cc01f69cac40"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:11.374116 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:02:11.374116 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:02:11.400657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-40fdb2da-ca47-4472-a5a8-eb816eabe823 req-95a2f570-b2de-4e85-81c5-225977efaad7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:11.402197 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f50dae8-4f48-4c23-8bc8-71f01436db0e tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.082592 Nov 27 21:02:11.404207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-40fdb2da-ca47-4472-a5a8-eb816eabe823 req-95a2f570-b2de-4e85-81c5-225977efaad7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:11.404441 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2281/4697] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:11 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:11.419885 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-40fdb2da-ca47-4472-a5a8-eb816eabe823 req-95a2f570-b2de-4e85-81c5-225977efaad7 service nova] Creating event network-changed:a6449fff-e553-48b7-bba1-cc01f69cac40 for instance 65fb9db5-02b8-492d-97c8-c1d5a21bda25 on nch1-master-1 Nov 27 21:02:11.424167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4074ceb7-ee83-4d13-ade6-1d2b851da438 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:11.425822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4074ceb7-ee83-4d13-ade6-1d2b851da438 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:11.425971 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-40fdb2da-ca47-4472-a5a8-eb816eabe823 req-95a2f570-b2de-4e85-81c5-225977efaad7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065233 Nov 27 21:02:11.427118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2417/4698] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:02:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:02:11.435558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4074ceb7-ee83-4d13-ade6-1d2b851da438 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:11.436274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4074ceb7-ee83-4d13-ade6-1d2b851da438 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:11.437272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4074ceb7-ee83-4d13-ade6-1d2b851da438 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:11.437918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4074ceb7-ee83-4d13-ade6-1d2b851da438 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:11.496400 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4074ceb7-ee83-4d13-ade6-1d2b851da438 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.083498 Nov 27 21:02:11.498477 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2282/4699] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:11 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:11.997769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:11.998690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:12.007347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.008198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.009403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.010046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.092871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:12.094182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:12.102327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.103780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.104936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.107091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.394903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:12.404747 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c09acea4-59ae-408f-aedf-65eff2260cf6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.415821 Nov 27 21:02:12.414146 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2418/4700] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:11 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:12.417584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46b50eab-cb62-47fc-b397-7bd32beb5ac1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:12.418525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46b50eab-cb62-47fc-b397-7bd32beb5ac1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:12.426807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46b50eab-cb62-47fc-b397-7bd32beb5ac1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.427328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46b50eab-cb62-47fc-b397-7bd32beb5ac1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.428303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46b50eab-cb62-47fc-b397-7bd32beb5ac1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.428936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46b50eab-cb62-47fc-b397-7bd32beb5ac1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.477861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46b50eab-cb62-47fc-b397-7bd32beb5ac1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.066141 Nov 27 21:02:12.483029 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2419/4701] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:12 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:12.510679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b2970a7-4a84-4665-aff3-aa6d6e759dcf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:12.511926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b2970a7-4a84-4665-aff3-aa6d6e759dcf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:12.519087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2970a7-4a84-4665-aff3-aa6d6e759dcf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.519698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2970a7-4a84-4665-aff3-aa6d6e759dcf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.520783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2970a7-4a84-4665-aff3-aa6d6e759dcf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:12.521471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b2970a7-4a84-4665-aff3-aa6d6e759dcf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:12.524554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:12.534789 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dfedd0f5-00bf-4348-8895-62f2b89cf68d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1316 microversion: 2.1 time: 0.446826 Nov 27 21:02:12.535912 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2283/4702] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:12 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:12.579373 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b2970a7-4a84-4665-aff3-aa6d6e759dcf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.073063 Nov 27 21:02:12.580939 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2420/4703] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:12 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:13.173659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3bbdf09e-7ba5-44be-93d5-4a03811486d5 req-7b0dfc59-fcd1-4f2f-b016-e7af399a1818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8", "tag": "d3d58283-44aa-49b4-8ef5-5f49cb82acda"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:13.175969 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:02:13.175969 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:02:13.192820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3bbdf09e-7ba5-44be-93d5-4a03811486d5 req-7b0dfc59-fcd1-4f2f-b016-e7af399a1818 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.193356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3bbdf09e-7ba5-44be-93d5-4a03811486d5 req-7b0dfc59-fcd1-4f2f-b016-e7af399a1818 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.208025 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3bbdf09e-7ba5-44be-93d5-4a03811486d5 req-7b0dfc59-fcd1-4f2f-b016-e7af399a1818 service nova] Creating event network-changed:d3d58283-44aa-49b4-8ef5-5f49cb82acda for instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 on nch1-master-1 Nov 27 21:02:13.215046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3bbdf09e-7ba5-44be-93d5-4a03811486d5 req-7b0dfc59-fcd1-4f2f-b016-e7af399a1818 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210648 Nov 27 21:02:13.216539 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2284/4704] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:02:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:02:13.422317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:13.423767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:13.433060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.433844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.435912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.436698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.492045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c1c274c-ab80-4d2d-a71d-be0537816006 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:13.493557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c1c274c-ab80-4d2d-a71d-be0537816006 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:13.504624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c1c274c-ab80-4d2d-a71d-be0537816006 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.505431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c1c274c-ab80-4d2d-a71d-be0537816006 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.506530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c1c274c-ab80-4d2d-a71d-be0537816006 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.507705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c1c274c-ab80-4d2d-a71d-be0537816006 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.566655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c1c274c-ab80-4d2d-a71d-be0537816006 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.079974 Nov 27 21:02:13.572257 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2285/4705] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:13 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:13.575739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:13.576438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:13.584743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.585499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.586475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.587090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.666036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:13.676240 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1959aba5-5866-4cc8-a5bd-b5bf4be2ce64 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.258122 Nov 27 21:02:13.687748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2421/4706] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:13 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:13.709216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4daf37b-9f99-4105-b75c-403ec7eb100e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:13.710502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4daf37b-9f99-4105-b75c-403ec7eb100e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:13.717421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4daf37b-9f99-4105-b75c-403ec7eb100e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.718639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4daf37b-9f99-4105-b75c-403ec7eb100e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.719478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4daf37b-9f99-4105-b75c-403ec7eb100e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:13.719925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4daf37b-9f99-4105-b75c-403ec7eb100e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:13.767504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4daf37b-9f99-4105-b75c-403ec7eb100e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.078213 Nov 27 21:02:13.768129 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2422/4707] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:13 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:14.121693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:14.131550 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1b571ff-1748-47c8-b592-6f7b668849d4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1316 microversion: 2.1 time: 0.561248 Nov 27 21:02:14.132438 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2286/4708] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:13 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:14.589617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-749ad63c-b10f-4fc0-8961-68bd5eea5c49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:14.592419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-749ad63c-b10f-4fc0-8961-68bd5eea5c49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:14.602722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-749ad63c-b10f-4fc0-8961-68bd5eea5c49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:14.603824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-749ad63c-b10f-4fc0-8961-68bd5eea5c49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:14.605132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-749ad63c-b10f-4fc0-8961-68bd5eea5c49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:14.605971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-749ad63c-b10f-4fc0-8961-68bd5eea5c49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:14.660425 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-749ad63c-b10f-4fc0-8961-68bd5eea5c49 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.083050 Nov 27 21:02:14.661539 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2423/4709] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:14 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:14.694015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:14.694648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:14.705010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:14.705797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:14.706828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:14.707486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:14.782780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aea5b5a6-7263-4f3e-97c9-a10129c396b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:14.784607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aea5b5a6-7263-4f3e-97c9-a10129c396b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:14.792339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aea5b5a6-7263-4f3e-97c9-a10129c396b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:14.793179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aea5b5a6-7263-4f3e-97c9-a10129c396b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:14.794305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aea5b5a6-7263-4f3e-97c9-a10129c396b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:14.794980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aea5b5a6-7263-4f3e-97c9-a10129c396b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:14.853637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aea5b5a6-7263-4f3e-97c9-a10129c396b2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.074333 Nov 27 21:02:14.855721 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2424/4710] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:14 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:14.936486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:14.962558 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c7c00f5e-310e-4ffd-9b8b-1afe5c820ddb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.271703 Nov 27 21:02:14.963845 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2287/4711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:14 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:15.149323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:15.150145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:15.158829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:15.159671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:15.160685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:15.161331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:15.410429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:15.431644 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73291dee-4cbb-46c3-8815-91229ab8e454 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1316 microversion: 2.1 time: 0.286489 Nov 27 21:02:15.433516 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2425/4712] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:15 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:15.673714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3fcd4bb7-7a6a-4398-856f-607afbb78719 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:15.675123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3fcd4bb7-7a6a-4398-856f-607afbb78719 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:15.681695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fcd4bb7-7a6a-4398-856f-607afbb78719 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:15.682527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fcd4bb7-7a6a-4398-856f-607afbb78719 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:15.684328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fcd4bb7-7a6a-4398-856f-607afbb78719 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:15.685016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fcd4bb7-7a6a-4398-856f-607afbb78719 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:15.735610 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3fcd4bb7-7a6a-4398-856f-607afbb78719 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.066505 Nov 27 21:02:15.738661 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2288/4713] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:15 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:15.866766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9d3bcaca-858f-41c5-b000-e0948d9caff2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:15.868364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9d3bcaca-858f-41c5-b000-e0948d9caff2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:15.877367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d3bcaca-858f-41c5-b000-e0948d9caff2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:15.878152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d3bcaca-858f-41c5-b000-e0948d9caff2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:15.879178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d3bcaca-858f-41c5-b000-e0948d9caff2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:15.879818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d3bcaca-858f-41c5-b000-e0948d9caff2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:15.943474 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9d3bcaca-858f-41c5-b000-e0948d9caff2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.080687 Nov 27 21:02:15.944861 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2426/4714] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:15 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:15.987883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:15.988718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:15.999682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.000662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:16.001485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.002178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:16.450796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:16.451544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:16.463398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.463915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:16.464749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.465202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:16.540032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:16.553095 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66735be4-aaf2-4624-95c6-dd4bb1339e89 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.575034 Nov 27 21:02:16.566133 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2289/4715] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:15 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:16.705425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:16.714109 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6dfbf5d8-4ee2-4eb1-bd68-1f836deb7870 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1316 microversion: 2.1 time: 0.268148 Nov 27 21:02:16.716825 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2427/4716] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:16 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:16.751862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-adec864a-418d-45c9-b44f-9854301b03b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:16.753554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-adec864a-418d-45c9-b44f-9854301b03b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:16.773386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adec864a-418d-45c9-b44f-9854301b03b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.774281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adec864a-418d-45c9-b44f-9854301b03b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:16.776159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adec864a-418d-45c9-b44f-9854301b03b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.776803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adec864a-418d-45c9-b44f-9854301b03b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:16.828647 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-adec864a-418d-45c9-b44f-9854301b03b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.083309 Nov 27 21:02:16.830337 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2290/4717] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:16 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:16.958926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-125ec0ba-c1d0-44aa-876b-56f3a50ff33e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:16.961167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-125ec0ba-c1d0-44aa-876b-56f3a50ff33e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:16.976554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-125ec0ba-c1d0-44aa-876b-56f3a50ff33e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.977411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-125ec0ba-c1d0-44aa-876b-56f3a50ff33e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:16.978493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-125ec0ba-c1d0-44aa-876b-56f3a50ff33e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:16.979190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-125ec0ba-c1d0-44aa-876b-56f3a50ff33e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:17.051439 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-125ec0ba-c1d0-44aa-876b-56f3a50ff33e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.097710 Nov 27 21:02:17.055951 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2428/4718] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:16 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:17.573912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:17.575747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:17.589084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:17.596105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:17.597359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:17.598598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:17.733696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:17.734415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:17.752001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:17.752804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:17.753886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:17.754507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:18.150181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:18.163022 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2625209d-5bb0-448b-92f2-d87390f6e5e3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.594008 Nov 27 21:02:18.164011 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2291/4719] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:17 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:18.169017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78e0592f-bc12-46e6-8de1-55eaa2d76797 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:18.176609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78e0592f-bc12-46e6-8de1-55eaa2d76797 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:18.193802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78e0592f-bc12-46e6-8de1-55eaa2d76797 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:18.195071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78e0592f-bc12-46e6-8de1-55eaa2d76797 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:18.207061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78e0592f-bc12-46e6-8de1-55eaa2d76797 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:18.207845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78e0592f-bc12-46e6-8de1-55eaa2d76797 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:18.308856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78e0592f-bc12-46e6-8de1-55eaa2d76797 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.143275 Nov 27 21:02:18.309566 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2292/4720] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:18 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:18.319093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc509cdd-332f-4895-b3c7-e3d168b047b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:18.324051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc509cdd-332f-4895-b3c7-e3d168b047b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:18.342808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc509cdd-332f-4895-b3c7-e3d168b047b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:18.344451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc509cdd-332f-4895-b3c7-e3d168b047b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:18.347214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc509cdd-332f-4895-b3c7-e3d168b047b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:18.347712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc509cdd-332f-4895-b3c7-e3d168b047b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:18.435452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc509cdd-332f-4895-b3c7-e3d168b047b9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.123169 Nov 27 21:02:18.439608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2293/4721] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:18 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:18.760653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:18.773902 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4f95f94-e639-4ea0-9699-8fad90c6b346 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1316 microversion: 2.1 time: 1.043630 Nov 27 21:02:18.774521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2429/4722] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:17 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1316 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:19.180194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:19.181645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:19.191309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.192170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.194181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.194854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.321190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6ad641c-f6ae-4f33-889b-9128f2fc0bd4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:19.322788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6ad641c-f6ae-4f33-889b-9128f2fc0bd4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:19.345998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6ad641c-f6ae-4f33-889b-9128f2fc0bd4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.362021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6ad641c-f6ae-4f33-889b-9128f2fc0bd4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.364713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6ad641c-f6ae-4f33-889b-9128f2fc0bd4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.365351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6ad641c-f6ae-4f33-889b-9128f2fc0bd4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.462716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6ad641c-f6ae-4f33-889b-9128f2fc0bd4 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.145110 Nov 27 21:02:19.468966 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2430/4723] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:19 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:19.475749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-46b72714-d941-4880-86c5-e105190e63e3 req-d707c3e1-e4b9-4983-9254-13ef2e441efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8", "name": "network-vif-plugged", "status": "completed", "tag": "d3d58283-44aa-49b4-8ef5-5f49cb82acda"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:19.477497 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:02:19.477497 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:02:19.490199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-46b72714-d941-4880-86c5-e105190e63e3 req-d707c3e1-e4b9-4983-9254-13ef2e441efa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.495809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-46b72714-d941-4880-86c5-e105190e63e3 req-d707c3e1-e4b9-4983-9254-13ef2e441efa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.517906 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-46b72714-d941-4880-86c5-e105190e63e3 req-d707c3e1-e4b9-4983-9254-13ef2e441efa service nova] Creating event network-vif-plugged:d3d58283-44aa-49b4-8ef5-5f49cb82acda for instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 on nch1-master-1 Nov 27 21:02:19.525302 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-46b72714-d941-4880-86c5-e105190e63e3 req-d707c3e1-e4b9-4983-9254-13ef2e441efa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053379 Nov 27 21:02:19.526668 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2431/4724] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:02:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:02:19.540742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-95a4e777-232d-4eed-93fc-28f6648ff82e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:19.542121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-95a4e777-232d-4eed-93fc-28f6648ff82e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:19.551904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95a4e777-232d-4eed-93fc-28f6648ff82e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.552614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95a4e777-232d-4eed-93fc-28f6648ff82e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.554811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95a4e777-232d-4eed-93fc-28f6648ff82e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.567420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-95a4e777-232d-4eed-93fc-28f6648ff82e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.626329 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-95a4e777-232d-4eed-93fc-28f6648ff82e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.097874 Nov 27 21:02:19.627577 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2432/4725] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:19 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:19.674931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:19.685051 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2e2a65a-ad72-4586-8549-c99e4bb5ba48 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.506882 Nov 27 21:02:19.685925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2294/4726] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:19 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:19.790206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:19.790904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:19.798055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.798872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:19.799942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:19.800627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:20.128320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:20.140318 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fdf31e5b-e631-4496-a5d7-3c38507111e2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1316 microversion: 2.1 time: 0.354010 Nov 27 21:02:20.143665 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2433/4727] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:19 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:20.476583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7948d57a-4ef1-4911-9755-36e3df8d4d3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:20.477543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7948d57a-4ef1-4911-9755-36e3df8d4d3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:20.488343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7948d57a-4ef1-4911-9755-36e3df8d4d3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:20.488810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7948d57a-4ef1-4911-9755-36e3df8d4d3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:20.489740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7948d57a-4ef1-4911-9755-36e3df8d4d3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:20.490195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7948d57a-4ef1-4911-9755-36e3df8d4d3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:20.548382 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7948d57a-4ef1-4911-9755-36e3df8d4d3a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.075399 Nov 27 21:02:20.549503 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2295/4728] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:20 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:20.644891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-76bd38b4-2bad-4473-9ad7-71f889590521 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:20.646196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-76bd38b4-2bad-4473-9ad7-71f889590521 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:20.658057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76bd38b4-2bad-4473-9ad7-71f889590521 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:20.662563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76bd38b4-2bad-4473-9ad7-71f889590521 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:20.664614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76bd38b4-2bad-4473-9ad7-71f889590521 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:20.665488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76bd38b4-2bad-4473-9ad7-71f889590521 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:20.703849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:20.704985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:20.713378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:20.714845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:20.720138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:20.721703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:20.779714 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-76bd38b4-2bad-4473-9ad7-71f889590521 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.143357 Nov 27 21:02:20.782142 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2434/4729] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:20 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:21.067024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:21.075410 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3581504b-2281-4311-9296-65e863213912 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.376674 Nov 27 21:02:21.085204 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2296/4730] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:20 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:21.160018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:21.161359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:21.169322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:21.169864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:21.171041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:21.172146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:21.561512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f197fe3b-f1b8-4af8-a83f-48fbadb088fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:21.562448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f197fe3b-f1b8-4af8-a83f-48fbadb088fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:21.571724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:21.580572 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-94dad0f1-3eb2-4552-a9bd-dd247b5e5862 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1316 microversion: 2.1 time: 0.424576 Nov 27 21:02:21.586518 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2435/4731] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:21 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:21.592803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f197fe3b-f1b8-4af8-a83f-48fbadb088fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:21.594191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f197fe3b-f1b8-4af8-a83f-48fbadb088fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:21.597437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f197fe3b-f1b8-4af8-a83f-48fbadb088fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:21.598087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f197fe3b-f1b8-4af8-a83f-48fbadb088fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:21.648431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e7dd3c39-a13f-4476-9993-a00fc17ba5b2 req-00bea26b-9434-4174-bb35-c3d60c9307c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fb9db5-02b8-492d-97c8-c1d5a21bda25", "name": "network-vif-plugged", "status": "completed", "tag": "a6449fff-e553-48b7-bba1-cc01f69cac40"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:21.649956 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:02:21.649956 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:02:21.671530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e7dd3c39-a13f-4476-9993-a00fc17ba5b2 req-00bea26b-9434-4174-bb35-c3d60c9307c7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:21.672211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e7dd3c39-a13f-4476-9993-a00fc17ba5b2 req-00bea26b-9434-4174-bb35-c3d60c9307c7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:21.682592 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f197fe3b-f1b8-4af8-a83f-48fbadb088fe tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.125053 Nov 27 21:02:21.687011 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2297/4732] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:21 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:21.695125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e7dd3c39-a13f-4476-9993-a00fc17ba5b2 req-00bea26b-9434-4174-bb35-c3d60c9307c7 service nova] Creating event network-vif-plugged:a6449fff-e553-48b7-bba1-cc01f69cac40 for instance 65fb9db5-02b8-492d-97c8-c1d5a21bda25 on nch1-master-1 Nov 27 21:02:21.708842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e7dd3c39-a13f-4476-9993-a00fc17ba5b2 req-00bea26b-9434-4174-bb35-c3d60c9307c7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063818 Nov 27 21:02:21.710126 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2436/4733] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:02:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:02:21.793744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53fe5d4c-fc40-4ee5-b0b1-e61bc5e52c8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:21.795394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53fe5d4c-fc40-4ee5-b0b1-e61bc5e52c8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:21.814312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53fe5d4c-fc40-4ee5-b0b1-e61bc5e52c8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:21.815193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53fe5d4c-fc40-4ee5-b0b1-e61bc5e52c8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:21.817189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53fe5d4c-fc40-4ee5-b0b1-e61bc5e52c8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:21.817825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53fe5d4c-fc40-4ee5-b0b1-e61bc5e52c8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:21.942718 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53fe5d4c-fc40-4ee5-b0b1-e61bc5e52c8f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.153746 Nov 27 21:02:21.948439 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2298/4734] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:21 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:22.095287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:22.096018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:22.105757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.109288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:22.110347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.111805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:22.486249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:22.495211 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-933a94a8-eefa-4366-9b14-92e0c03875e5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.405951 Nov 27 21:02:22.505972 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2437/4735] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:22 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:22.610827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:22.613616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:22.623483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.624689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:22.625931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.627891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:22.695226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72936377-8ab4-4317-8919-adaf977e8512 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:22.696218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72936377-8ab4-4317-8919-adaf977e8512 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:22.702798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72936377-8ab4-4317-8919-adaf977e8512 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.703247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72936377-8ab4-4317-8919-adaf977e8512 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:22.709567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72936377-8ab4-4317-8919-adaf977e8512 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.710302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72936377-8ab4-4317-8919-adaf977e8512 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:22.779981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72936377-8ab4-4317-8919-adaf977e8512 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.088639 Nov 27 21:02:22.785086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2438/4736] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:22 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:22.961008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f4d5f68-d7a8-462a-a5a4-3999d4bec9e5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:22.962148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f4d5f68-d7a8-462a-a5a4-3999d4bec9e5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:22.970497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f4d5f68-d7a8-462a-a5a4-3999d4bec9e5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.970749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f4d5f68-d7a8-462a-a5a4-3999d4bec9e5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:22.971656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f4d5f68-d7a8-462a-a5a4-3999d4bec9e5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:22.972175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f4d5f68-d7a8-462a-a5a4-3999d4bec9e5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:23.072274 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f4d5f68-d7a8-462a-a5a4-3999d4bec9e5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.115803 Nov 27 21:02:23.077630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2439/4737] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:22 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:23.162503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:23.174672 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e075b81c-e76d-427e-9e9a-c19c75f36e1f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.574094 Nov 27 21:02:23.174672 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2299/4738] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:22 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:23.292978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1251992890", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:23.398398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] validate_networks() for [('5fc9f4b4-8604-4ff4-85b1-28e814a55b3b', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:02:23.515657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:23.516440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:23.561764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:23.565571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:23.569068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:23.570337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:24.108908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:24.118123 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee3dd6f3-548a-4f2e-9e76-b95ed6b7d369 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1313 microversion: 2.1 time: 0.608824 Nov 27 21:02:24.118875 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2300/4739] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:23 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:24.130110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42977a0d-3e64-4d6f-89fb-4a19e7e66767 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:24.131378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42977a0d-3e64-4d6f-89fb-4a19e7e66767 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:24.138570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42977a0d-3e64-4d6f-89fb-4a19e7e66767 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:24.139351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42977a0d-3e64-4d6f-89fb-4a19e7e66767 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:24.140385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42977a0d-3e64-4d6f-89fb-4a19e7e66767 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:24.141133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42977a0d-3e64-4d6f-89fb-4a19e7e66767 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:24.188607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42977a0d-3e64-4d6f-89fb-4a19e7e66767 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.061970 Nov 27 21:02:24.189669 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2301/4740] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:24 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:24.195960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebe0b887-3802-4f7d-9285-aac1a4aa0866 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:24.197001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebe0b887-3802-4f7d-9285-aac1a4aa0866 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:24.205479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebe0b887-3802-4f7d-9285-aac1a4aa0866 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:24.205944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebe0b887-3802-4f7d-9285-aac1a4aa0866 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:24.206746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebe0b887-3802-4f7d-9285-aac1a4aa0866 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:24.207494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebe0b887-3802-4f7d-9285-aac1a4aa0866 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:24.254282 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebe0b887-3802-4f7d-9285-aac1a4aa0866 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.062830 Nov 27 21:02:24.256305 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2302/4741] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:24 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:24.819223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:02:24.819757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:02:24.820135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:02:24.820548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:02:24.820959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:02:24.830783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:24.831239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:24.832169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:24.832609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:24.849196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Getting quotas for project 85c58aa2d3dd4e09a26b5265084b8493. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:02:24.854266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Getting quotas for user 9a60782e0d8945c2b99dac616fda491d and project 85c58aa2d3dd4e09a26b5265084b8493. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:02:24.866832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:02:24.869306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:02:24.916800 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a91ca655-0345-478c-9e7c-5e71236c50e0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630410 Nov 27 21:02:24.922946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2440/4742] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:02:24.928656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3834476b-41fb-4003-82ed-8b4716be8030 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:24.929697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3834476b-41fb-4003-82ed-8b4716be8030 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:25.012064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3834476b-41fb-4003-82ed-8b4716be8030 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:25.021382 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3834476b-41fb-4003-82ed-8b4716be8030 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1217 microversion: 2.1 time: 0.097050 Nov 27 21:02:25.022264 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2303/4743] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:24 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:25.136089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:25.136707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:25.144458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.145140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.146652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.147602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.201174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07df4d8c-2539-42ab-80fe-be4c0eb4ac72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:25.202878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07df4d8c-2539-42ab-80fe-be4c0eb4ac72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:25.212033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07df4d8c-2539-42ab-80fe-be4c0eb4ac72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.212951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07df4d8c-2539-42ab-80fe-be4c0eb4ac72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.213992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07df4d8c-2539-42ab-80fe-be4c0eb4ac72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.214749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07df4d8c-2539-42ab-80fe-be4c0eb4ac72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.260515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07df4d8c-2539-42ab-80fe-be4c0eb4ac72 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.062832 Nov 27 21:02:25.265283 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2304/4744] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:25 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:25.269925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-144161fe-f902-4c6b-b0f6-dfd0a1e8a0ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:25.271074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-144161fe-f902-4c6b-b0f6-dfd0a1e8a0ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:25.281024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-144161fe-f902-4c6b-b0f6-dfd0a1e8a0ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.282271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-144161fe-f902-4c6b-b0f6-dfd0a1e8a0ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.283875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-144161fe-f902-4c6b-b0f6-dfd0a1e8a0ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.284800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-144161fe-f902-4c6b-b0f6-dfd0a1e8a0ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.347286 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-144161fe-f902-4c6b-b0f6-dfd0a1e8a0ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.082280 Nov 27 21:02:25.348135 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2305/4745] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:25 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:25.900492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:25.912392 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb49c8e7-b7cf-45c4-bf6b-31fb8d6b089c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1499 microversion: 2.1 time: 0.780341 Nov 27 21:02:25.914292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2441/4746] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:25 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1499 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:25.932875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:25.934618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:25.942162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.942949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.944041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:25.944721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:25.981890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lazy-loading 'flavor' on Instance uuid 65fb9db5-02b8-492d-97c8-c1d5a21bda25 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:02:26.042687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:26.044058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:26.062689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.064267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.066125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.068933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.125048 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a51ef39-c150-4f09-87fb-f911db276b5c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "POST /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25/action" status: 200 len: 32 microversion: 2.1 time: 0.198069 Nov 27 21:02:26.128370 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2306/4747] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:02:25 2021] POST /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:02:26.138623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:26.142262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:26.153209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.154025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.155233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.155972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.255049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:26.265502 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9dbff099-f951-4928-9a94-b75239bc21de tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1287 microversion: 2.1 time: 0.229312 Nov 27 21:02:26.271102 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2442/4748] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:26 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1287 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:26.279627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-837ce6ff-f577-4fac-a5b1-bdd43e753b5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:26.281611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-837ce6ff-f577-4fac-a5b1-bdd43e753b5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:26.294073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-837ce6ff-f577-4fac-a5b1-bdd43e753b5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.295028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-837ce6ff-f577-4fac-a5b1-bdd43e753b5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.299009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-837ce6ff-f577-4fac-a5b1-bdd43e753b5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.299608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-837ce6ff-f577-4fac-a5b1-bdd43e753b5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.348611 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-837ce6ff-f577-4fac-a5b1-bdd43e753b5a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.075902 Nov 27 21:02:26.350829 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2443/4749] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:26 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:26.361723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-669cee5f-1185-4764-8caa-06317864a474 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:26.363398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-669cee5f-1185-4764-8caa-06317864a474 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:26.371323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-669cee5f-1185-4764-8caa-06317864a474 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.372643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-669cee5f-1185-4764-8caa-06317864a474 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.373497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-669cee5f-1185-4764-8caa-06317864a474 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:26.374010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-669cee5f-1185-4764-8caa-06317864a474 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:26.438226 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-669cee5f-1185-4764-8caa-06317864a474 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.080703 Nov 27 21:02:26.444997 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2444/4750] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:26 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:26.558766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:26.574856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f2ea85e-be19-4d0a-a78a-787635c023da tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.440214 Nov 27 21:02:26.576606 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2307/4751] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:26 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:27.290169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:27.291975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:27.304306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.304986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.305991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.306672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.361664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61e7f2e2-8f75-43b7-9457-5520aaac3b21 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:27.362893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61e7f2e2-8f75-43b7-9457-5520aaac3b21 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:27.370233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61e7f2e2-8f75-43b7-9457-5520aaac3b21 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.371163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61e7f2e2-8f75-43b7-9457-5520aaac3b21 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.373039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61e7f2e2-8f75-43b7-9457-5520aaac3b21 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.373757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61e7f2e2-8f75-43b7-9457-5520aaac3b21 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.436798 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61e7f2e2-8f75-43b7-9457-5520aaac3b21 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action" status: 200 len: 40746 microversion: 2.42 time: 0.078520 Nov 27 21:02:27.447565 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2308/4752] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:27 2021] POST /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:27.457574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:27.459689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:27.467332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.467846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.468847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.469466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.771182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:27.786116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:27.787649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:27.789882 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0df0e311-e90a-4195-b8d4-8c27b2a091b1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2947 microversion: 2.42 time: 0.340081 Nov 27 21:02:27.794741 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2309/4753] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:02:27 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2947 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:02:27.801331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d885800f-2beb-40c6-8a7b-84973a36ebe9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:27.807565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d885800f-2beb-40c6-8a7b-84973a36ebe9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:27.821319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d885800f-2beb-40c6-8a7b-84973a36ebe9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.821773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d885800f-2beb-40c6-8a7b-84973a36ebe9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.822777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d885800f-2beb-40c6-8a7b-84973a36ebe9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.823499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d885800f-2beb-40c6-8a7b-84973a36ebe9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.874225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d885800f-2beb-40c6-8a7b-84973a36ebe9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.080512 Nov 27 21:02:27.879703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2310/4754] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:27 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:27.883515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:27.885480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:27.893338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.893856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:27.895117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:27.895696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:28.141449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:28.149319 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22b1a494-3797-42e8-9cbc-26443acce4fb tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.273097 Nov 27 21:02:28.158332 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2311/4755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:27 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:28.163644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3465a208-3292-4384-8269-9a73c51f6c1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:28.164452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3465a208-3292-4384-8269-9a73c51f6c1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:28.171162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3465a208-3292-4384-8269-9a73c51f6c1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:28.171703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3465a208-3292-4384-8269-9a73c51f6c1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:28.172555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3465a208-3292-4384-8269-9a73c51f6c1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:28.173061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3465a208-3292-4384-8269-9a73c51f6c1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:28.348172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:28.359534 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-22ae2382-6e8e-42f2-b76d-65f8b613d6bc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1317 microversion: 2.1 time: 1.074486 Nov 27 21:02:28.360839 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2445/4756] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:27 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1317 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:28.365953 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3465a208-3292-4384-8269-9a73c51f6c1f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.206016 Nov 27 21:02:28.366321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e090fd69-84c1-4c6a-86a9-f5730ad74c85 req-2701126c-cec3-499c-8269-970b3903f031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb676012-35b4-4211-8697-7e40e308bf9a", "tag": "a229f58b-d847-4887-a5bf-89543c33aa82"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:28.374130 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2312/4757] 10.222.0.21 () {60 vars in 1315 bytes} [Sat Nov 27 21:02:28 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be/os-interface => generated 1831 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:02:28.377743 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:02:28.377743 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:02:28.385267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e090fd69-84c1-4c6a-86a9-f5730ad74c85 req-2701126c-cec3-499c-8269-970b3903f031 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:28.386011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e090fd69-84c1-4c6a-86a9-f5730ad74c85 req-2701126c-cec3-499c-8269-970b3903f031 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:28.404995 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e090fd69-84c1-4c6a-86a9-f5730ad74c85 req-2701126c-cec3-499c-8269-970b3903f031 service nova] Creating event network-changed:a229f58b-d847-4887-a5bf-89543c33aa82 for instance bb676012-35b4-4211-8697-7e40e308bf9a on nch2-master-1 Nov 27 21:02:28.431459 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e090fd69-84c1-4c6a-86a9-f5730ad74c85 req-2701126c-cec3-499c-8269-970b3903f031 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068740 Nov 27 21:02:28.432086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2446/4758] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:02:28.888595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a42287fb-3e86-482e-94be-a413645e9212 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:28.889766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a42287fb-3e86-482e-94be-a413645e9212 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:28.899111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a42287fb-3e86-482e-94be-a413645e9212 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:28.900096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a42287fb-3e86-482e-94be-a413645e9212 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:28.907391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a42287fb-3e86-482e-94be-a413645e9212 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:28.911190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a42287fb-3e86-482e-94be-a413645e9212 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:29.005627 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a42287fb-3e86-482e-94be-a413645e9212 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.122611 Nov 27 21:02:29.007193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2313/4759] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:28 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:29.169655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:29.170684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:29.179528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:29.180815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:29.181919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:29.182913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:29.378645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:29.381378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:29.393109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:29.395177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:29.396241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:29.398028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:29.442527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:29.457443 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08ab2d93-1f96-4ed4-b307-d6f48877e620 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.293729 Nov 27 21:02:29.458919 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2447/4760] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:29 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:30.020521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43765aa0-e617-47a5-a070-a2a5e8fcad01 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:30.021722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43765aa0-e617-47a5-a070-a2a5e8fcad01 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:30.030982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43765aa0-e617-47a5-a070-a2a5e8fcad01 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:30.031773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43765aa0-e617-47a5-a070-a2a5e8fcad01 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:30.032771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43765aa0-e617-47a5-a070-a2a5e8fcad01 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:30.033395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43765aa0-e617-47a5-a070-a2a5e8fcad01 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:30.087446 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43765aa0-e617-47a5-a070-a2a5e8fcad01 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.071802 Nov 27 21:02:30.094349 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2448/4761] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:30 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:30.173862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:30.183156 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3363e15e-9994-4315-ba17-21d3ca3feca7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1317 microversion: 2.1 time: 0.808691 Nov 27 21:02:30.186068 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2314/4762] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:29 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:30.477583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:30.478982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:30.488918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:30.489687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:30.490748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:30.491439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:30.923202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:30.941141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-acce0d63-bc5f-403d-9839-06fe0dba6216 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.466148 Nov 27 21:02:30.943734 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2449/4763] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:30 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:31.106382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3337917-bebc-4355-8611-b703c15ca8b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:31.107717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3337917-bebc-4355-8611-b703c15ca8b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:31.132261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3337917-bebc-4355-8611-b703c15ca8b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:31.132986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3337917-bebc-4355-8611-b703c15ca8b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:31.139749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3337917-bebc-4355-8611-b703c15ca8b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:31.140226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3337917-bebc-4355-8611-b703c15ca8b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:31.207604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:31.210700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:31.223664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:31.224360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:31.225361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:31.225803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:31.229271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3337917-bebc-4355-8611-b703c15ca8b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.118638 Nov 27 21:02:31.230686 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2315/4764] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:31 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:31.728780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:31.741219 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9b9d66b-ee45-4503-84b3-e9788dedba61 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1317 microversion: 2.1 time: 0.543067 Nov 27 21:02:31.758995 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2450/4765] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:31 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:31.960761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:31.961478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:31.972221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:31.972682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:31.973494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:31.973939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:32.242049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-abc885c0-ae51-42ab-be3e-0b70a33bd9ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:32.242994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-abc885c0-ae51-42ab-be3e-0b70a33bd9ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:32.254085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abc885c0-ae51-42ab-be3e-0b70a33bd9ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:32.257286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abc885c0-ae51-42ab-be3e-0b70a33bd9ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:32.260387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abc885c0-ae51-42ab-be3e-0b70a33bd9ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:32.261250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abc885c0-ae51-42ab-be3e-0b70a33bd9ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:32.372638 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-abc885c0-ae51-42ab-be3e-0b70a33bd9ec tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.132969 Nov 27 21:02:32.376830 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2451/4766] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:32 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:32.540210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:32.551782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a47e187a-2613-4f2c-aea4-3efd5a03da0c tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.592651 Nov 27 21:02:32.553363 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2316/4767] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:31 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:32.759688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:32.760955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:32.768450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:32.782850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:32.783940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:32.785878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:33.385267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e126b061-1791-4a7d-b1aa-ddf15272cda2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:33.386205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e126b061-1791-4a7d-b1aa-ddf15272cda2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:33.410380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e126b061-1791-4a7d-b1aa-ddf15272cda2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:33.411170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e126b061-1791-4a7d-b1aa-ddf15272cda2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:33.412477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e126b061-1791-4a7d-b1aa-ddf15272cda2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:33.415503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e126b061-1791-4a7d-b1aa-ddf15272cda2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:33.484722 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e126b061-1791-4a7d-b1aa-ddf15272cda2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.103170 Nov 27 21:02:33.488916 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2317/4768] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:33 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:33.572340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:33.573890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:33.584483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:33.585801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:33.587355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:33.588022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:33.628456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:33.642335 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75756373-91f1-4724-90ac-6df7d78e6adf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1317 microversion: 2.1 time: 0.886624 Nov 27 21:02:33.652988 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2452/4769] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:32 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:34.064061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:34.081740 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92e84a62-96b7-43c4-88a9-e5fbbb39c474 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.515229 Nov 27 21:02:34.082522 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2318/4770] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:33 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:34.502197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b473432c-d872-4d6e-bf47-69708da1b065 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:34.503337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b473432c-d872-4d6e-bf47-69708da1b065 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:34.525048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b473432c-d872-4d6e-bf47-69708da1b065 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:34.525782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b473432c-d872-4d6e-bf47-69708da1b065 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:34.529607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b473432c-d872-4d6e-bf47-69708da1b065 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:34.530322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b473432c-d872-4d6e-bf47-69708da1b065 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:34.596467 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b473432c-d872-4d6e-bf47-69708da1b065 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.100315 Nov 27 21:02:34.597976 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2453/4771] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:34 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:34.661741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:34.663075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:34.673996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:34.674999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:34.676322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:34.676946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:35.103819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:35.105139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:35.119728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:35.120981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:35.123103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:35.124713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:35.228095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:35.237075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29f21d1f-b160-4846-9231-7e1ef2528501 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1317 microversion: 2.1 time: 0.581076 Nov 27 21:02:35.240418 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2319/4772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:34 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:35.590661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:35.608027 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-823e876c-b67c-4cd4-b8f3-2a78358f3055 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.507188 Nov 27 21:02:35.617537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2454/4773] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:35 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:35.617780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-488a1943-28a8-4cf4-aa59-4d984ef25ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:35.617780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-488a1943-28a8-4cf4-aa59-4d984ef25ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:35.625042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-488a1943-28a8-4cf4-aa59-4d984ef25ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:35.625566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-488a1943-28a8-4cf4-aa59-4d984ef25ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:35.646993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-488a1943-28a8-4cf4-aa59-4d984ef25ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:35.647570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-488a1943-28a8-4cf4-aa59-4d984ef25ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:35.797101 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-488a1943-28a8-4cf4-aa59-4d984ef25ade tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.190406 Nov 27 21:02:35.798696 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2320/4774] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:35 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:36.066339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6fd9009b-b1ba-470c-ae8b-045e0402d7e7 req-e6c70e42-cf4e-49a7-9e85-4ab9ecc4314a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb676012-35b4-4211-8697-7e40e308bf9a", "name": "network-vif-plugged", "status": "completed", "tag": "a229f58b-d847-4887-a5bf-89543c33aa82"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:36.068271 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:02:36.068271 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:02:36.087659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6fd9009b-b1ba-470c-ae8b-045e0402d7e7 req-e6c70e42-cf4e-49a7-9e85-4ab9ecc4314a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:36.088649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6fd9009b-b1ba-470c-ae8b-045e0402d7e7 req-e6c70e42-cf4e-49a7-9e85-4ab9ecc4314a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:36.103841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6fd9009b-b1ba-470c-ae8b-045e0402d7e7 req-e6c70e42-cf4e-49a7-9e85-4ab9ecc4314a service nova] Creating event network-vif-plugged:a229f58b-d847-4887-a5bf-89543c33aa82 for instance bb676012-35b4-4211-8697-7e40e308bf9a on nch2-master-1 Nov 27 21:02:36.123539 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6fd9009b-b1ba-470c-ae8b-045e0402d7e7 req-e6c70e42-cf4e-49a7-9e85-4ab9ecc4314a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059335 Nov 27 21:02:36.124766 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2455/4775] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:02:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:02:36.255670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:36.256678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:36.264563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:36.265375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:36.266686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:36.267430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:36.627969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:36.628848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:36.642896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:36.646483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:36.647868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:36.648562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:36.680753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:36.698722 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ea3d123-d8c7-4489-ba53-b23b01577372 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1317 microversion: 2.1 time: 0.447531 Nov 27 21:02:36.710755 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2321/4776] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:36 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:36.810380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e08b7c0-24be-4c4d-a0e6-c2eb877b4743 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:36.811516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e08b7c0-24be-4c4d-a0e6-c2eb877b4743 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:36.852632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e08b7c0-24be-4c4d-a0e6-c2eb877b4743 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:36.853183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e08b7c0-24be-4c4d-a0e6-c2eb877b4743 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:36.855878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e08b7c0-24be-4c4d-a0e6-c2eb877b4743 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:36.856460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e08b7c0-24be-4c4d-a0e6-c2eb877b4743 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:36.919521 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e08b7c0-24be-4c4d-a0e6-c2eb877b4743 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.112776 Nov 27 21:02:36.920682 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2322/4777] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:36 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:37.126840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:37.139812 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d221b49f-bfca-4d35-bbda-c28c03f76594 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.518522 Nov 27 21:02:37.154477 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2456/4778] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:36 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:37.722344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:37.723285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:37.741362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:37.743126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:37.747003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:37.750268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:37.931966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1a622d5f-01b0-4c3f-9292-e1cee2100cbe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:37.933129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1a622d5f-01b0-4c3f-9292-e1cee2100cbe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:37.945143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a622d5f-01b0-4c3f-9292-e1cee2100cbe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:37.945607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a622d5f-01b0-4c3f-9292-e1cee2100cbe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:37.946415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a622d5f-01b0-4c3f-9292-e1cee2100cbe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:37.946856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1a622d5f-01b0-4c3f-9292-e1cee2100cbe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:38.058853 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1a622d5f-01b0-4c3f-9292-e1cee2100cbe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.130365 Nov 27 21:02:38.060319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2457/4779] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:37 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:38.162619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:38.163349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:38.171669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:38.172118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:38.172923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:38.173358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:38.618124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:38.629863 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28212000-e22a-43bc-8fe3-2b65580c906f tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.471307 Nov 27 21:02:38.631345 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2458/4780] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:38 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:38.811529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:38.826346 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15e904fb-8d26-402a-9bcb-6e6388967756 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1317 microversion: 2.1 time: 1.108099 Nov 27 21:02:38.840371 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2323/4781] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:37 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1317 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:39.070491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4e11e7c-79ef-4f87-8409-a43b28f4abe7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:39.071629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4e11e7c-79ef-4f87-8409-a43b28f4abe7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:39.092335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4e11e7c-79ef-4f87-8409-a43b28f4abe7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:39.095053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4e11e7c-79ef-4f87-8409-a43b28f4abe7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:39.096137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4e11e7c-79ef-4f87-8409-a43b28f4abe7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:39.096863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4e11e7c-79ef-4f87-8409-a43b28f4abe7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:39.179373 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4e11e7c-79ef-4f87-8409-a43b28f4abe7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.112739 Nov 27 21:02:39.180944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2459/4782] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:39 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:39.648180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:39.648809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:39.667503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:39.667989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:39.668799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:39.669241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:39.845142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:39.845882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:39.869209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:39.872437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:39.873504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:39.875811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:40.587123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:40.622746 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dae2a546-fcb7-48c6-bea9-90d3f856356a tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.978449 Nov 27 21:02:40.629885 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2324/4783] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:39 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:40.646839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d3cc340-3673-4771-a682-f06e7d4977ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:40.652562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d3cc340-3673-4771-a682-f06e7d4977ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:40.674474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3cc340-3673-4771-a682-f06e7d4977ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:40.676601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3cc340-3673-4771-a682-f06e7d4977ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:40.679588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3cc340-3673-4771-a682-f06e7d4977ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:40.681911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3cc340-3673-4771-a682-f06e7d4977ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:40.791571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:40.798732 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d3cc340-3673-4771-a682-f06e7d4977ea tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.166307 Nov 27 21:02:40.799608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2325/4784] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:40 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:40.806875 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1bbb2128-985c-41e0-af3a-8f7a55f1d4b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1506 microversion: 2.1 time: 0.966012 Nov 27 21:02:40.816445 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2460/4785] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:39 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1506 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:40.834767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:40.835422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:40.846541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:40.847046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:40.847898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:40.848516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:40.888660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:02:41.002532 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-185ddedf-628d-4624-a462-79ee32764fac tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 204 len: 0 microversion: 2.1 time: 0.171760 Nov 27 21:02:41.004486 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2326/4786] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:02:40 2021] DELETE /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:02:41.025025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:41.026347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:41.038997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:41.040505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:41.041601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:41.042252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:41.165928 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:02:41.166208 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:02:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:02:41.414011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:41.426371 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-269a5d69-b1fb-4440-8346-5b35535fd284 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1512 microversion: 2.1 time: 0.415919 Nov 27 21:02:41.438159 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2461/4787] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:41 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:41.665819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:41.673559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:41.684984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:41.686012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:41.686967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:41.688023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:41.813000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ccd6e05c-0161-47b6-a4fe-6765313f9fa4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:41.814521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ccd6e05c-0161-47b6-a4fe-6765313f9fa4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:41.821148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd6e05c-0161-47b6-a4fe-6765313f9fa4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:41.821994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd6e05c-0161-47b6-a4fe-6765313f9fa4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:41.823781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd6e05c-0161-47b6-a4fe-6765313f9fa4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:41.824777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ccd6e05c-0161-47b6-a4fe-6765313f9fa4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:41.901502 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ccd6e05c-0161-47b6-a4fe-6765313f9fa4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.093920 Nov 27 21:02:41.902490 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2462/4788] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:41 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:42.445770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:42.446738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:42.460806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:42.461604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:42.462736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:42.467421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:42.943467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:42.963070 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2e5a29d5-b380-4c2f-9589-3b4266cecfc6 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 1.322867 Nov 27 21:02:42.965407 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2327/4789] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:41 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:42.976393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8a025cd8-ca32-4431-889d-714ad6d3b328 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:42.977883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8a025cd8-ca32-4431-889d-714ad6d3b328 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:42.988800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a025cd8-ca32-4431-889d-714ad6d3b328 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:42.989517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a025cd8-ca32-4431-889d-714ad6d3b328 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:42.993177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a025cd8-ca32-4431-889d-714ad6d3b328 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:42.994560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a025cd8-ca32-4431-889d-714ad6d3b328 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:43.098400 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8a025cd8-ca32-4431-889d-714ad6d3b328 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.130834 Nov 27 21:02:43.099069 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2328/4790] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:42 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:43.249697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:43.259646 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d83d8892-a7b6-4929-b820-b0a14a8fed12 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1512 microversion: 2.1 time: 0.818579 Nov 27 21:02:43.260950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2463/4791] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:42 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1512 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:43.986287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:43.987915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:44.019900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:44.020364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:44.021190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:44.024088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:44.111414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03a7024d-4b49-4dee-b88a-b7f2b1f91b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:44.112357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03a7024d-4b49-4dee-b88a-b7f2b1f91b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:44.128908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a7024d-4b49-4dee-b88a-b7f2b1f91b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:44.129364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a7024d-4b49-4dee-b88a-b7f2b1f91b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:44.130783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a7024d-4b49-4dee-b88a-b7f2b1f91b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:44.131235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a7024d-4b49-4dee-b88a-b7f2b1f91b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:44.223064 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03a7024d-4b49-4dee-b88a-b7f2b1f91b83 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.113920 Nov 27 21:02:44.224518 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2464/4792] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:44 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:44.282823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:44.283919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:44.345340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:44.345340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:44.345340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:44.345340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:44.597439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:44.606152 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c4babef-76cf-4412-8ecd-8c37e252f0e0 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.626731 Nov 27 21:02:44.610767 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2329/4793] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:43 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:44.631281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f4cd2557-941e-4a82-8c64-2b651ddeb184 req-f0534f50-c9f4-49b5-8279-d094e2896f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb676012-35b4-4211-8697-7e40e308bf9a", "name": "network-vif-deleted", "tag": "a229f58b-d847-4887-a5bf-89543c33aa82"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:44.633100 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:02:44.633100 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:02:44.656825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f4cd2557-941e-4a82-8c64-2b651ddeb184 req-f0534f50-c9f4-49b5-8279-d094e2896f41 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:44.660829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f4cd2557-941e-4a82-8c64-2b651ddeb184 req-f0534f50-c9f4-49b5-8279-d094e2896f41 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:44.666822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:44.679421 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85205760-b30b-4c75-8e90-fb76e66ce52d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 200 len: 1470 microversion: 2.1 time: 0.405871 Nov 27 21:02:44.689852 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2465/4794] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:44 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:44.697688 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f4cd2557-941e-4a82-8c64-2b651ddeb184 req-f0534f50-c9f4-49b5-8279-d094e2896f41 service nova] Creating event network-vif-deleted:a229f58b-d847-4887-a5bf-89543c33aa82 for instance bb676012-35b4-4211-8697-7e40e308bf9a on nch2-master-1 Nov 27 21:02:44.713000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f4cd2557-941e-4a82-8c64-2b651ddeb184 req-f0534f50-c9f4-49b5-8279-d094e2896f41 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092412 Nov 27 21:02:44.713917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2330/4795] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:02:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:02:45.235303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-340383d6-c8ae-41a6-b1f3-6a23cddb5a02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:45.236236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-340383d6-c8ae-41a6-b1f3-6a23cddb5a02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:45.249547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-340383d6-c8ae-41a6-b1f3-6a23cddb5a02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.250015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-340383d6-c8ae-41a6-b1f3-6a23cddb5a02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:45.253273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-340383d6-c8ae-41a6-b1f3-6a23cddb5a02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.253838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-340383d6-c8ae-41a6-b1f3-6a23cddb5a02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:45.345907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-340383d6-c8ae-41a6-b1f3-6a23cddb5a02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.114176 Nov 27 21:02:45.347822 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2466/4796] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:45 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:45.633777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:45.641682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:45.661560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.662543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:45.664340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.670704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:45.702539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:45.703624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:45.727023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.727931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:45.729199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.729841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:45.772664 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. Nov 27 21:02:45.773267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:45.774123 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9076f84f-ce74-4e52-afb5-d168ea30f373 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 404 len: 111 microversion: 2.1 time: 0.080501 Nov 27 21:02:45.774709 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2467/4797] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:45 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:02:45.784448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:45.784774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:45.800939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.801320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:45.802129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:45.802660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:46.056899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:46.065919 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9b09991-5230-411b-acc3-674cbdb832c2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.286386 Nov 27 21:02:46.066520 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2468/4798] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:45 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:46.185731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fce54c62-69b2-45db-b3cd-47ec7c292baf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:46.187908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fce54c62-69b2-45db-b3cd-47ec7c292baf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:46.189039 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fce54c62-69b2-45db-b3cd-47ec7c292baf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.008590 Nov 27 21:02:46.190312 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2469/4799] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:46 2021] POST /compute/v2.1/servers => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:02:46.197958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:46.198768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:46.211963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:46.212756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:46.213771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:46.214957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:46.401393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:46.412256 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c1123f5-b07f-4c6d-8fbc-e52921bfe61d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.217901 Nov 27 21:02:46.425321 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2470/4800] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:46 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:46.431678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e776b755-8ea1-445d-a7f2-cb43e6eec554 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:46.432896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e776b755-8ea1-445d-a7f2-cb43e6eec554 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:46.439707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e776b755-8ea1-445d-a7f2-cb43e6eec554 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:46.440435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e776b755-8ea1-445d-a7f2-cb43e6eec554 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:46.441519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e776b755-8ea1-445d-a7f2-cb43e6eec554 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:46.442190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e776b755-8ea1-445d-a7f2-cb43e6eec554 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:46.512924 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e776b755-8ea1-445d-a7f2-cb43e6eec554 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.085827 Nov 27 21:02:46.520219 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2471/4801] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:46 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:46.534000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:46.535606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:46.567864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:46.568654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:46.569550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:46.570000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:46.639331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:46.649548 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d5e2657-8512-4b87-9ccb-0d80699f0b52 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 1.024514 Nov 27 21:02:46.662777 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2331/4802] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:45 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:46.832632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:46.844037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-49ed2820-ebda-49f9-abde-898238aa80b8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.322108 Nov 27 21:02:46.844639 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2472/4803] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:46 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:47.525821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-305148d8-7c48-44c0-a041-cd552366005e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:47.527655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-305148d8-7c48-44c0-a041-cd552366005e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:47.575958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-305148d8-7c48-44c0-a041-cd552366005e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:47.576483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-305148d8-7c48-44c0-a041-cd552366005e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:47.580718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-305148d8-7c48-44c0-a041-cd552366005e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:47.581260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-305148d8-7c48-44c0-a041-cd552366005e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:47.667162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:47.674376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:47.690378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:47.693132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:47.694124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:47.697678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:47.744178 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-305148d8-7c48-44c0-a041-cd552366005e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.222386 Nov 27 21:02:47.746695 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2332/4804] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:47 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:48.475818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:48.515385 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ef96a56-8680-43ce-833d-ab3d92e496e1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.850285 Nov 27 21:02:48.526156 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2473/4805] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:47 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:48.756844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf46ca78-ebf1-4b92-9e49-7dfba0361d89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:48.757874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf46ca78-ebf1-4b92-9e49-7dfba0361d89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:48.778428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf46ca78-ebf1-4b92-9e49-7dfba0361d89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:48.778888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf46ca78-ebf1-4b92-9e49-7dfba0361d89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:48.779735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf46ca78-ebf1-4b92-9e49-7dfba0361d89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:48.780327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf46ca78-ebf1-4b92-9e49-7dfba0361d89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:48.833208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebc23be9-1ce7-406b-828d-6ffc280ddbc2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1765717321", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "80a5bb1b-01cc-4cd5-8cc8-2614826723a2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:48.848696 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf46ca78-ebf1-4b92-9e49-7dfba0361d89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.094542 Nov 27 21:02:48.849660 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2333/4806] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:48 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:48.947022 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-ebc23be9-1ce7-406b-828d-6ffc280ddbc2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Block Device 80a5bb1b-01cc-4cd5-8cc8-2614826723a2 is not bootable. Nov 27 21:02:48.947810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebc23be9-1ce7-406b-828d-6ffc280ddbc2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Block Device 80a5bb1b-01cc-4cd5-8cc8-2614826723a2 is not bootable. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:48.948817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebc23be9-1ce7-406b-828d-6ffc280ddbc2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.120049 Nov 27 21:02:48.949454 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2474/4807] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:48 2021] POST /compute/v2.1/servers => generated 110 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:02:48.966304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:48.971024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:48.981638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:48.982471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:48.983561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:48.984247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:49.539418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:49.540048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:49.558972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:49.559880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:49.561363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:49.564824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:49.632530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:49.650926 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fbd0dc9c-150c-4a7d-8ec4-56043e5b4580 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.692257 Nov 27 21:02:49.651909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2334/4808] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:48 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:49.694163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:49.702825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:49.709388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:49.710160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:49.713062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:49.714417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:50.245128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:50.260739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cbd7de7c-15dc-496e-98b1-faaebb7f7076 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.581472 Nov 27 21:02:50.264413 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2335/4809] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:49 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:50.273465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f1351f7-8a8b-457b-aa2a-00a764bcf6a0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:50.293603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f1351f7-8a8b-457b-aa2a-00a764bcf6a0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:50.320215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f1351f7-8a8b-457b-aa2a-00a764bcf6a0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:50.324036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f1351f7-8a8b-457b-aa2a-00a764bcf6a0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:50.326496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f1351f7-8a8b-457b-aa2a-00a764bcf6a0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:50.329499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f1351f7-8a8b-457b-aa2a-00a764bcf6a0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:50.426142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:50.440928 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61f7556d-81f7-4bb0-be70-5b9e3b6a7ce5 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.910624 Nov 27 21:02:50.459384 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2475/4810] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:49 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:50.485909 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f1351f7-8a8b-457b-aa2a-00a764bcf6a0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.214122 Nov 27 21:02:50.492703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2336/4811] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:50 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:51.464046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:51.464856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:51.471847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:51.472317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:51.488759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:51.489359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:51.501128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78417244-2b69-4235-93d2-237ae113c5c0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:51.502172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78417244-2b69-4235-93d2-237ae113c5c0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:51.532444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78417244-2b69-4235-93d2-237ae113c5c0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:51.532906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78417244-2b69-4235-93d2-237ae113c5c0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:51.533735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78417244-2b69-4235-93d2-237ae113c5c0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:51.534186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78417244-2b69-4235-93d2-237ae113c5c0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:51.662309 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78417244-2b69-4235-93d2-237ae113c5c0 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.165601 Nov 27 21:02:51.663000 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2337/4812] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:51 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:52.070749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d2227f9-1feb-4dcb-a2a8-95c36aef9a70 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-326120858", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "destination_type": "local"}, {"source_type": "volume", "uuid": "80d0ddd8-7411-489b-8c3c-7a9be3ba1b98", "destination_type": "invalid"}], "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:52.072540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d2227f9-1feb-4dcb-a2a8-95c36aef9a70 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:52.073630 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d2227f9-1feb-4dcb-a2a8-95c36aef9a70 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.007524 Nov 27 21:02:52.078522 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2338/4813] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:52 2021] POST /compute/v2.1/servers => generated 155 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 27 21:02:52.083884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:52.084944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:52.094088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:52.094821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:52.095845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:52.096611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:52.245051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:52.257846 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac82493a-8a84-487d-977d-4c51834f5610 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.798447 Nov 27 21:02:52.260503 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2476/4814] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:51 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:52.416040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:52.451279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fea3872c-cc27-44f9-8839-9d974eaf258a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.370952 Nov 27 21:02:52.456741 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2339/4815] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:52 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:52.476133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:52.476760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:52.491227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:52.492681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:52.493728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:52.494345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:52.675494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ae3e1400-c8b0-4ea8-af2d-16041817eefc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:52.677619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae3e1400-c8b0-4ea8-af2d-16041817eefc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:52.702155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae3e1400-c8b0-4ea8-af2d-16041817eefc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:52.702905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae3e1400-c8b0-4ea8-af2d-16041817eefc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:52.707634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae3e1400-c8b0-4ea8-af2d-16041817eefc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:52.708362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae3e1400-c8b0-4ea8-af2d-16041817eefc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:52.809166 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ae3e1400-c8b0-4ea8-af2d-16041817eefc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.137714 Nov 27 21:02:52.810615 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2340/4816] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:52 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:53.024260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:53.036223 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb2c7514-1361-4bce-81a7-9fcab790ca81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.563764 Nov 27 21:02:53.037164 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2477/4817] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:52 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:53.148652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e1636ca-63cc-4182-aed3-389a76a7efd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1744462787", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:53.150621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e1636ca-63cc-4182-aed3-389a76a7efd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:53.151531 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e1636ca-63cc-4182-aed3-389a76a7efd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.007999 Nov 27 21:02:53.155022 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2341/4818] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:53 2021] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:02:53.163589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:53.165541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:53.192242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:53.193234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:53.195403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:53.197263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:53.278787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:53.280671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:53.314043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:53.316705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:53.318327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:53.321843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:53.736829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:53.746007 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a5730b7c-4bd4-44ab-9f1b-e362ffcee08e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.471810 Nov 27 21:02:53.750699 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2342/4819] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:53 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:53.820889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe9d6762-f10a-46e7-8cc1-0faeaa703270 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:53.821928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe9d6762-f10a-46e7-8cc1-0faeaa703270 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:53.841535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe9d6762-f10a-46e7-8cc1-0faeaa703270 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:53.842032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe9d6762-f10a-46e7-8cc1-0faeaa703270 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:53.842850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe9d6762-f10a-46e7-8cc1-0faeaa703270 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:53.843669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe9d6762-f10a-46e7-8cc1-0faeaa703270 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:53.900075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe9d6762-f10a-46e7-8cc1-0faeaa703270 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.082708 Nov 27 21:02:53.901124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2343/4820] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:53 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:54.125610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:54.139730 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d3fba57-48ad-4f00-b9b4-7477a36e0417 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.983109 Nov 27 21:02:54.141137 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2478/4821] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:53 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:54.160712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:54.161770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:54.169100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:54.169900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:54.170959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:54.171664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:54.719998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:54.727605 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f94b00b-9334-4f57-92eb-c262f5eabe95 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.572654 Nov 27 21:02:54.739285 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2344/4822] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:54 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:54.769889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:54.771177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:54.786612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:54.787140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:54.787982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:54.788419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:54.800928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f383fdc8-7cbf-41f0-b56e-63bc0e23b8ab tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:54.802268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f383fdc8-7cbf-41f0-b56e-63bc0e23b8ab tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:54.803405 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f383fdc8-7cbf-41f0-b56e-63bc0e23b8ab tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006346 Nov 27 21:02:54.807969 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2345/4823] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:54 2021] POST /compute/v2.1/servers => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:02:54.814330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:54.816096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:54.825445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:54.830447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:54.831648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:54.832571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:55.280074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:55.289364 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0db6e88-9b8a-45f0-80d1-e7516855c391 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.479997 Nov 27 21:02:55.292886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2346/4824] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:54 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:55.299130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a26d8c7b-03fe-4792-95e1-bf4264a4f2b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:55.300436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a26d8c7b-03fe-4792-95e1-bf4264a4f2b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:55.326097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26d8c7b-03fe-4792-95e1-bf4264a4f2b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:55.326930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26d8c7b-03fe-4792-95e1-bf4264a4f2b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:55.333907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26d8c7b-03fe-4792-95e1-bf4264a4f2b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:55.334698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26d8c7b-03fe-4792-95e1-bf4264a4f2b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:55.460236 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a26d8c7b-03fe-4792-95e1-bf4264a4f2b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.164476 Nov 27 21:02:55.465271 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2347/4825] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:55 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:55.479423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:55.483791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:55.525645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:55.526419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:55.528307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:55.529195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:55.529819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:55.541848 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c4d88ec-3c49-4eb6-b751-37efa3c3e436 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.777727 Nov 27 21:02:55.554287 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2479/4826] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:54 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:55.968015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:55.977340 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1faed23a-7991-44bc-aa6f-3a2091559edc tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.514067 Nov 27 21:02:55.981435 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2348/4827] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:55 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:56.069372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e5f4e66-232a-4d86-81e2-4a2538e75e3d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1153300500", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": -1, "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:56.085117 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-3e5f4e66-232a-4d86-81e2-4a2538e75e3d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Flavor -1 could not be found. Nov 27 21:02:56.086206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e5f4e66-232a-4d86-81e2-4a2538e75e3d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:56.087457 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e5f4e66-232a-4d86-81e2-4a2538e75e3d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.024489 Nov 27 21:02:56.096204 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2480/4828] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:56 2021] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:56.102342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:56.103046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:56.119725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.120481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.121673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.122855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.475867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10df51fc-7959-468b-a504-5a063ca7b237 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:56.476948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10df51fc-7959-468b-a504-5a063ca7b237 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:56.496327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10df51fc-7959-468b-a504-5a063ca7b237 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.497052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10df51fc-7959-468b-a504-5a063ca7b237 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.497869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10df51fc-7959-468b-a504-5a063ca7b237 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.498307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10df51fc-7959-468b-a504-5a063ca7b237 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.574041 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10df51fc-7959-468b-a504-5a063ca7b237 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.102327 Nov 27 21:02:56.579111 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2481/4829] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:56 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:56.589172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:56.590316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:56.600011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.600869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.602081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.602723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.690075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:56.702556 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-735f9c2e-a7c8-4725-b63c-b69c3f622efd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.605010 Nov 27 21:02:56.704286 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2349/4830] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:56 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:56.721393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:56.722288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:56.734873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.735595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.740950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:56.743858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:56.964711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:56.972664 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe0ef0e0-03bd-47de-bcfb-40289717fd19 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.255911 Nov 27 21:02:56.987659 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2350/4831] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:56 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:57.057643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bb20a16-44c7-432a-a95e-70daa3bdd9e4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1599603177", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:57.060079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bb20a16-44c7-432a-a95e-70daa3bdd9e4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:57.061162 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4bb20a16-44c7-432a-a95e-70daa3bdd9e4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008645 Nov 27 21:02:57.066538 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2351/4832] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:57 2021] POST /compute/v2.1/servers => generated 145 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:02:57.072490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:57.073108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:57.097239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:57.097942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:57.099016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:57.099654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:57.894055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:57.901993 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-df6305d2-f1bc-4485-8c29-a039082f754c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.834001 Nov 27 21:02:57.903690 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2352/4833] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:57 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:57.910639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-899f4a91-27ef-470b-92f7-cf385a3f0ab2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:57.912344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-899f4a91-27ef-470b-92f7-cf385a3f0ab2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:57.921552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-899f4a91-27ef-470b-92f7-cf385a3f0ab2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:57.922031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-899f4a91-27ef-470b-92f7-cf385a3f0ab2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:57.923957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-899f4a91-27ef-470b-92f7-cf385a3f0ab2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:57.925300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-899f4a91-27ef-470b-92f7-cf385a3f0ab2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:57.979873 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-899f4a91-27ef-470b-92f7-cf385a3f0ab2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.074438 Nov 27 21:02:57.985990 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2353/4834] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:57 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:57.992574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:57.993292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:58.001566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.002029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.002839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.003292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.208589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:58.219020 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d17c866b-2e74-401b-8033-f7599f0be4b1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.231741 Nov 27 21:02:58.219871 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2354/4835] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:57 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:58.279826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d16c6d04-1740-435e-9798-82779de870af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1972729298", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:58.287835 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d16c6d04-1740-435e-9798-82779de870af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 27 21:02:58.289263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d16c6d04-1740-435e-9798-82779de870af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:58.290751 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d16c6d04-1740-435e-9798-82779de870af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.016244 Nov 27 21:02:58.291856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2355/4836] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:58 2021] POST /compute/v2.1/servers => generated 123 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:02:58.302647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:58.303281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:58.311982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.313323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.314326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.314943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.673386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:58.693111 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23116c5d-f0be-4fea-8a6e-bed41a5e0be2 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1485 microversion: 2.1 time: 2.111593 Nov 27 21:02:58.695229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2482/4837] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:56 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1485 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:58.715824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0dd58e83-cc22-4af9-baab-49e318a88549 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:58.716378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0dd58e83-cc22-4af9-baab-49e318a88549 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:58.751895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dd58e83-cc22-4af9-baab-49e318a88549 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.752510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dd58e83-cc22-4af9-baab-49e318a88549 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.753464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dd58e83-cc22-4af9-baab-49e318a88549 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.756077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dd58e83-cc22-4af9-baab-49e318a88549 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.902493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:58.917617 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bcfd1cca-3283-440b-953c-f5da1bb634d8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.614047 Nov 27 21:02:58.918854 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2356/4838] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:58 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:02:58.938301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:58.938926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:58.966087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.966566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.973995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:58.974311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:58.990244 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0dd58e83-cc22-4af9-baab-49e318a88549 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "POST /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25/action" status: 202 len: 0 microversion: 2.1 time: 0.282082 Nov 27 21:02:58.994656 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2483/4839] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:02:58 2021] POST /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:02:59.002514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4743534b-1458-4bef-9f93-48062180a49d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:59.008888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4743534b-1458-4bef-9f93-48062180a49d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:59.016233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4743534b-1458-4bef-9f93-48062180a49d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:59.017051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4743534b-1458-4bef-9f93-48062180a49d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:59.018089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4743534b-1458-4bef-9f93-48062180a49d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:59.018905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4743534b-1458-4bef-9f93-48062180a49d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:59.137074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4743534b-1458-4bef-9f93-48062180a49d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.139239 Nov 27 21:02:59.137839 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2484/4840] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:02:58 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:02:59.143598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:59.150533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:02:59.166515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:59.167148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:59.170864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:02:59.178465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:02:59.357791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:02:59.368772 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dbfb7c71-2d09-4c53-a917-e840aeed27fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.436630 Nov 27 21:02:59.383284 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2357/4841] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:58 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:02:59.465174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1875d81b-a4c5-4c8b-baa5-940986ac8cc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029349870", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "key_name": "tempest-key-1088475366", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:02:59.546586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-1875d81b-a4c5-4c8b-baa5-940986ac8cc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] validate_networks() for [('5fc9f4b4-8604-4ff4-85b1-28e814a55b3b', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:02:59.977773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1875d81b-a4c5-4c8b-baa5-940986ac8cc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Invalid key_name provided. Nov 27 21:02:59.978391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1875d81b-a4c5-4c8b-baa5-940986ac8cc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid key_name provided. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:02:59.979234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1875d81b-a4c5-4c8b-baa5-940986ac8cc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.522915 Nov 27 21:02:59.981719 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2358/4842] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:02:59 2021] POST /compute/v2.1/servers => generated 70 bytes in 526 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:59.988544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:02:59.989169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:00.003053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:00.003542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:00.004362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:00.004811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:00.399297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:00.417502 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b5ec263-6eea-4084-a323-7721f0995732 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1493 microversion: 2.1 time: 1.277257 Nov 27 21:03:00.420093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2485/4843] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:59 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1493 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:00.442932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa7d9b90-a1c0-41c9-a3c2-a67b94952ae9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:00.448518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa7d9b90-a1c0-41c9-a3c2-a67b94952ae9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:00.473973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa7d9b90-a1c0-41c9-a3c2-a67b94952ae9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:00.474569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa7d9b90-a1c0-41c9-a3c2-a67b94952ae9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:00.475473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa7d9b90-a1c0-41c9-a3c2-a67b94952ae9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:00.475919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa7d9b90-a1c0-41c9-a3c2-a67b94952ae9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:00.531987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa7d9b90-a1c0-41c9-a3c2-a67b94952ae9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.110224 Nov 27 21:03:00.536369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2486/4844] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:00 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:00.549007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:00.556744 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8b7a8aa8-ba07-4f5b-a8a4-56a3ad20d09e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.571758 Nov 27 21:03:00.557339 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2359/4845] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:02:59 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:00.577257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:00.578560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:00.596808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:00.597541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:00.598632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:00.599745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:01.308345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:01.319317 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dbc7c949-5658-4885-a4e5-119150613450 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.748928 Nov 27 21:03:01.320516 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2487/4846] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:00 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:01.411110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a28ed8a0-0c17-4eac-b47c-7ce1f5fd5734 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1124387914", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:01.438237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:01.441349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:01.457940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:01.461639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:01.462846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:01.464142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:01.867498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:01.876722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6aeb90f8-c92c-49ed-a68e-55ef112462f1 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1493 microversion: 2.1 time: 0.442100 Nov 27 21:03:01.888365 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2488/4847] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:01 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1493 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:01.894286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea34dcb4-8c84-4b17-a25d-6ce4ee9af44c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:01.895850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea34dcb4-8c84-4b17-a25d-6ce4ee9af44c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:01.905128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea34dcb4-8c84-4b17-a25d-6ce4ee9af44c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:01.905974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea34dcb4-8c84-4b17-a25d-6ce4ee9af44c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:01.907053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea34dcb4-8c84-4b17-a25d-6ce4ee9af44c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:01.907755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea34dcb4-8c84-4b17-a25d-6ce4ee9af44c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:01.967283 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea34dcb4-8c84-4b17-a25d-6ce4ee9af44c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.075464 Nov 27 21:03:01.967981 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2489/4848] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:01 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:01.999185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.security_group_api [None req-a28ed8a0-0c17-4eac-b47c-7ce1f5fd5734 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Neutron security group does_not_exist not found {{(pid=135679) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 27 21:03:02.000456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a28ed8a0-0c17-4eac-b47c-7ce1f5fd5734 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 27 21:03:02.001475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a28ed8a0-0c17-4eac-b47c-7ce1f5fd5734 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:02.002593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a28ed8a0-0c17-4eac-b47c-7ce1f5fd5734 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.595777 Nov 27 21:03:02.003546 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2360/4849] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:03:01 2021] POST /compute/v2.1/servers => generated 106 bytes in 597 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:03:02.014942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:02.015889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:02.035120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:02.035938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:02.037031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:02.037633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:02.479730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:02.489797 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa46c265-a699-4581-ba67-7dba246d2bc6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.481199 Nov 27 21:03:02.493110 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2490/4850] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:02 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:02.512880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:02.513502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:02.529862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:02.535697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:02.536850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:02.537464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:02.897191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:02.907150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:02.923768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:02.924625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:02.925884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:02.926536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:02.989858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:03.013418 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd390b27-2bc3-4794-9b71-144e63c4ff57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.500756 Nov 27 21:03:03.014163 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2361/4851] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:02 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:03.032810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da8f9db4-d9e9-4d70-9ebd-8c9fa23d2dce tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:03.035367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da8f9db4-d9e9-4d70-9ebd-8c9fa23d2dce tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:03.060455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da8f9db4-d9e9-4d70-9ebd-8c9fa23d2dce tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:03.061685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da8f9db4-d9e9-4d70-9ebd-8c9fa23d2dce tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:03.066893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da8f9db4-d9e9-4d70-9ebd-8c9fa23d2dce tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:03.067544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da8f9db4-d9e9-4d70-9ebd-8c9fa23d2dce tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:03.164913 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da8f9db4-d9e9-4d70-9ebd-8c9fa23d2dce tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.148543 Nov 27 21:03:03.170698 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2362/4852] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:03 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:03.175911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d07eb540-8c7b-44a2-a341-dea7c950d6fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:03.180849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d07eb540-8c7b-44a2-a341-dea7c950d6fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 8f0b4dca-7a7c-4c40-aa54-4cf8ee350006] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:03.200798 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d07eb540-8c7b-44a2-a341-dea7c950d6fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 8f0b4dca-7a7c-4c40-aa54-4cf8ee350006 could not be found. Nov 27 21:03:03.204733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d07eb540-8c7b-44a2-a341-dea7c950d6fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 8f0b4dca-7a7c-4c40-aa54-4cf8ee350006 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:03.206256 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d07eb540-8c7b-44a2-a341-dea7c950d6fe tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "DELETE /compute/v2.1/servers/8f0b4dca-7a7c-4c40-aa54-4cf8ee350006" status: 404 len: 111 microversion: 2.1 time: 0.034281 Nov 27 21:03:03.208379 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2363/4853] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:03:03 2021] DELETE /compute/v2.1/servers/8f0b4dca-7a7c-4c40-aa54-4cf8ee350006 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:03.225321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:03.226008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:03.247044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:03.247613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:03.248486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:03.250635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:03.767764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:03.793963 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3c94ba2-c11c-470b-9c53-dd8fff6c6ff3 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1493 microversion: 2.1 time: 0.899971 Nov 27 21:03:03.795240 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2491/4854] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:02 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1493 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:04.162782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:04.179962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5135808b-2529-4e9b-a517-b5f2b975c925 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:04.183787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5135808b-2529-4e9b-a517-b5f2b975c925 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:04.207359 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e8c4c73-a281-4de1-8873-6495eaa0d437 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.993371 Nov 27 21:03:04.220247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2364/4855] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:03 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:04.220833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5135808b-2529-4e9b-a517-b5f2b975c925 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:04.223739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5135808b-2529-4e9b-a517-b5f2b975c925 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:04.227628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5135808b-2529-4e9b-a517-b5f2b975c925 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:04.230842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5135808b-2529-4e9b-a517-b5f2b975c925 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:04.246003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:04.246943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:04.284402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:04.286649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:04.289992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:04.290842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:04.363561 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5135808b-2529-4e9b-a517-b5f2b975c925 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.184428 Nov 27 21:03:04.369530 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2492/4856] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:04 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:04.814036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:04.815688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:04.833787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:04.834261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:04.837694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:04.839728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.137230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:05.158919 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f181d61-fff5-4254-92e9-a4b4f2ed574d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.923658 Nov 27 21:03:05.159703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2365/4857] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:04 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:05.180633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-67bf77e9-7fc3-4286-a4d2-4e48149de7cd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:05.181873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-67bf77e9-7fc3-4286-a4d2-4e48149de7cd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Failed to fetch instance by id 9223372036854775808 {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 27 21:03:05.183562 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-67bf77e9-7fc3-4286-a4d2-4e48149de7cd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 27 21:03:05.184493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-67bf77e9-7fc3-4286-a4d2-4e48149de7cd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:05.191240 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-67bf77e9-7fc3-4286-a4d2-4e48149de7cd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014240 Nov 27 21:03:05.192539 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2366/4858] 10.222.0.21 () {58 vars in 1187 bytes} [Sat Nov 27 21:03:05 2021] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:03:05.202989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:05.205874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:05.226536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.227212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.228551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.232082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.591390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:05.613031 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c64ddec-df5d-40dc-905a-08ad049ec392 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1499 microversion: 2.1 time: 0.803518 Nov 27 21:03:05.615472 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2493/4859] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:04 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1499 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:05.629949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca9cfd46-b466-45bd-aa5b-470200ff6479 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:05.630938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca9cfd46-b466-45bd-aa5b-470200ff6479 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:05.664229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9cfd46-b466-45bd-aa5b-470200ff6479 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.669114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9cfd46-b466-45bd-aa5b-470200ff6479 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.669992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9cfd46-b466-45bd-aa5b-470200ff6479 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.670443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca9cfd46-b466-45bd-aa5b-470200ff6479 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.725889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:05.745889 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2927dd82-515c-4b4d-8ba1-2261a6d2697e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.548482 Nov 27 21:03:05.758725 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2367/4860] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:05 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:05.758725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:05.758725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:05.764691 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca9cfd46-b466-45bd-aa5b-470200ff6479 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.146169 Nov 27 21:03:05.766099 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2494/4861] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:05 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:05.772817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:05.774657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.775117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.776030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.776977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.780271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:05.794594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.801159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.802229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.802843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.846439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:03:05.961312 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-563d7676-b909-4f14-9ca4-8f9f55eb9b86 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "DELETE /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 204 len: 0 microversion: 2.1 time: 0.212473 Nov 27 21:03:05.967386 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2368/4862] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:03:05 2021] DELETE /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:03:05.981245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:05.982629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:05.990164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.990681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:05.991594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:05.992235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:06.294999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:06.306724 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f25239d5-b897-42e6-962c-68d87c5881b9 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.337450 Nov 27 21:03:06.308183 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2369/4863] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:05 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:06.393683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:06.407345 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-433d93c5-473e-4f30-aaaa-cec672813745 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.638911 Nov 27 21:03:06.412855 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2495/4864] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:05 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:06.427907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e262d30-7fe3-489c-912c-6f5a1be2f537 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:06.428387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e262d30-7fe3-489c-912c-6f5a1be2f537 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Failed to fetch instance by id -1 {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 27 21:03:06.428898 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-7e262d30-7fe3-489c-912c-6f5a1be2f537 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance -1 could not be found. Nov 27 21:03:06.429448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e262d30-7fe3-489c-912c-6f5a1be2f537 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance -1 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:06.430453 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e262d30-7fe3-489c-912c-6f5a1be2f537 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.006276 Nov 27 21:03:06.438419 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2370/4865] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 21:03:06 2021] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:03:06.440417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:06.441221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:06.452198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:06.452901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:06.453955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:06.454636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:06.711216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:06.721231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1e2462f5-2e09-4af1-8a40-acf611bd9f42 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.285216 Nov 27 21:03:06.722302 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2496/4866] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:06 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:06.742500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:06.744213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:06.755476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:06.756473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:06.758214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:06.759069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:06.778901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c3511e4-4d12-4b00-97de-46a23562c5c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:06.780159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c3511e4-4d12-4b00-97de-46a23562c5c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:06.789306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c3511e4-4d12-4b00-97de-46a23562c5c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:06.793563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c3511e4-4d12-4b00-97de-46a23562c5c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:06.794756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c3511e4-4d12-4b00-97de-46a23562c5c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:06.795579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c3511e4-4d12-4b00-97de-46a23562c5c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:06.875427 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c3511e4-4d12-4b00-97de-46a23562c5c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.101190 Nov 27 21:03:06.883768 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2497/4867] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:06 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:07.160922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:07.179406 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d602fdc9-c00f-4c8e-88ef-9f3a061f0a16 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.439075 Nov 27 21:03:07.199690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e79c3603-4023-43b1-831a-b212ab3b6606 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:07.200481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e79c3603-4023-43b1-831a-b212ab3b6606 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 6366f3ed-a31c-4d90-8d1b-b2df6b23aa8d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:07.204570 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2371/4868] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:06 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:07.218436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e79c3603-4023-43b1-831a-b212ab3b6606 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 6366f3ed-a31c-4d90-8d1b-b2df6b23aa8d could not be found. Nov 27 21:03:07.220665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e79c3603-4023-43b1-831a-b212ab3b6606 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 6366f3ed-a31c-4d90-8d1b-b2df6b23aa8d could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:07.221627 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e79c3603-4023-43b1-831a-b212ab3b6606 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/6366f3ed-a31c-4d90-8d1b-b2df6b23aa8d/action" status: 404 len: 111 microversion: 2.1 time: 0.027084 Nov 27 21:03:07.223824 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2498/4869] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:07 2021] POST /compute/v2.1/servers/6366f3ed-a31c-4d90-8d1b-b2df6b23aa8d/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:03:07.245494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:07.246128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:07.253847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:07.254822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:07.255859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:07.256803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:07.327364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:07.328012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:07.349230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:07.350240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:07.351094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:07.351747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:07.692733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:07.713025 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ff1e075-c7c4-4668-b21a-346274489646 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.392081 Nov 27 21:03:07.713837 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2499/4870] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:07 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:07.892091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5726734-9e9b-4fa5-b578-2b2b1562188b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:07.893414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c5726734-9e9b-4fa5-b578-2b2b1562188b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:07.902880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5726734-9e9b-4fa5-b578-2b2b1562188b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:07.904426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5726734-9e9b-4fa5-b578-2b2b1562188b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:07.908094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5726734-9e9b-4fa5-b578-2b2b1562188b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:07.908887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5726734-9e9b-4fa5-b578-2b2b1562188b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:07.962246 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c5726734-9e9b-4fa5-b578-2b2b1562188b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.075019 Nov 27 21:03:07.966927 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2500/4871] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:07 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:08.208335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:08.217450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c42557c4-e1d6-472d-be10-fabc50c579c3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.988489 Nov 27 21:03:08.218064 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2372/4872] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:07 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:08.236089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:08.237169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:08.247392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.248196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:08.249340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.249834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:08.513971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:08.529848 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4e0f558-ecef-406b-b44e-09515fde0df3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.297892 Nov 27 21:03:08.531542 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2501/4873] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:08 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:08.548825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1965b5bd-5044-406a-ad9f-24d85b9c5f3f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:08.550362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1965b5bd-5044-406a-ad9f-24d85b9c5f3f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 259c0cfc-7b2d-4110-a787-9ffb69b1b440] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:08.560111 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1965b5bd-5044-406a-ad9f-24d85b9c5f3f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 259c0cfc-7b2d-4110-a787-9ffb69b1b440 could not be found. Nov 27 21:03:08.560647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1965b5bd-5044-406a-ad9f-24d85b9c5f3f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 259c0cfc-7b2d-4110-a787-9ffb69b1b440 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:08.564362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1965b5bd-5044-406a-ad9f-24d85b9c5f3f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/259c0cfc-7b2d-4110-a787-9ffb69b1b440/action" status: 404 len: 111 microversion: 2.1 time: 0.018408 Nov 27 21:03:08.565328 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2373/4874] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:08 2021] POST /compute/v2.1/servers/259c0cfc-7b2d-4110-a787-9ffb69b1b440/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:08.574006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:08.574882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:08.582261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.582997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:08.584000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.584614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:08.731202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:08.731896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:08.755493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.756272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:08.757261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.758099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:08.803655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:08.816653 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59a05dc2-001f-4b7a-9b3a-7ece431953d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.246138 Nov 27 21:03:08.817778 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2502/4875] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:08 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:08.840520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:08.842817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:08.856715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.858141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:08.859922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:08.861157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:09.123725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:09.140298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-683d9fc3-0015-4071-8202-6c93a3367606 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.413721 Nov 27 21:03:09.146455 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2374/4876] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:08 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:09.156911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28a0db7b-f49c-49c7-bbf3-9ec11059ec50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:09.158291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28a0db7b-f49c-49c7-bbf3-9ec11059ec50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:09.169800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a0db7b-f49c-49c7-bbf3-9ec11059ec50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:09.170683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a0db7b-f49c-49c7-bbf3-9ec11059ec50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:09.172271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a0db7b-f49c-49c7-bbf3-9ec11059ec50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:09.173012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a0db7b-f49c-49c7-bbf3-9ec11059ec50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:09.180951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:09.191347 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7385007-0af9-4c3a-b39b-f0d341f2d311 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.360178 Nov 27 21:03:09.192082 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2503/4877] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:08 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:09.213643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b7c88c2-071e-4d6b-9370-9efcb8b8ac59 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:09.223196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b7c88c2-071e-4d6b-9370-9efcb8b8ac59 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 1bd9084b-6f03-4c8d-9a04-eb82679043b4] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:09.243110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-3b7c88c2-071e-4d6b-9370-9efcb8b8ac59 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 1bd9084b-6f03-4c8d-9a04-eb82679043b4 could not be found. Nov 27 21:03:09.255353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b7c88c2-071e-4d6b-9370-9efcb8b8ac59 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 1bd9084b-6f03-4c8d-9a04-eb82679043b4 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:09.256464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b7c88c2-071e-4d6b-9370-9efcb8b8ac59 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/1bd9084b-6f03-4c8d-9a04-eb82679043b4" status: 404 len: 111 microversion: 2.1 time: 0.051651 Nov 27 21:03:09.258922 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2504/4878] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:09 2021] GET /compute/v2.1/servers/1bd9084b-6f03-4c8d-9a04-eb82679043b4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:03:09.268001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:09.274510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:09.291931 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28a0db7b-f49c-49c7-bbf3-9ec11059ec50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.143555 Nov 27 21:03:09.293626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2375/4879] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:09 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:09.297237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:09.297690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:09.298503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:09.300812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:10.167852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:10.168997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:10.195115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:10.203877 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e49076f-9500-455a-bc88-c7023b3af4fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.939734 Nov 27 21:03:10.208105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2505/4880] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:09 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:10.221911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:10.225379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:10.228789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:10.230213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:10.232178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:10.232917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:10.242847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:10.243613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:10.244644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:10.245590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:10.538957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:10.558207 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc4f0ded-c618-4f7a-8cbc-40d3df83fa6d tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1505 microversion: 2.1 time: 0.398208 Nov 27 21:03:10.559818 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2376/4881] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:10 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:10.566241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f87f17a-2c31-4c09-afbf-5834c816c3a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:10.567455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5f87f17a-2c31-4c09-afbf-5834c816c3a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:10.575432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f87f17a-2c31-4c09-afbf-5834c816c3a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:10.576430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f87f17a-2c31-4c09-afbf-5834c816c3a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:10.577514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f87f17a-2c31-4c09-afbf-5834c816c3a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:10.578324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f87f17a-2c31-4c09-afbf-5834c816c3a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:10.631974 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f87f17a-2c31-4c09-afbf-5834c816c3a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.070569 Nov 27 21:03:10.637150 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2377/4882] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:10 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:10.908006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:10.919434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d14b5f78-cb82-4e7d-93d5-c51ec8ba88a3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.694411 Nov 27 21:03:10.920193 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2506/4883] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:10 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:10.995316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4cce5343-9b52-4f09-9315-e649dd573faf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1308828900", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:10.995995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4cce5343-9b52-4f09-9315-e649dd573faf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:10.997222 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4cce5343-9b52-4f09-9315-e649dd573faf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008636 Nov 27 21:03:11.004600 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2378/4884] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:03:10 2021] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:03:11.019012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:11.020528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:11.028556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.029290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.030294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.030939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.566504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:11.576306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:11.577041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:11.599163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.601086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40a84f6f-aa16-41e0-97f6-89bdcd501a56 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.595264 Nov 27 21:03:11.602295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.603408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.604634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.605109 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2507/4885] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:11 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:11.621399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:11.622286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:11.634146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.635594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.635594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.635909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.835911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:11.851573 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e597a840-592c-4802-ad96-3e28a59ccf68 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 200 len: 1463 microversion: 2.1 time: 0.278697 Nov 27 21:03:11.855647 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2379/4886] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:11 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:11.862350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-17dbef66-4a9c-4deb-922c-f7b63e197ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:11.864197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-17dbef66-4a9c-4deb-922c-f7b63e197ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:11.885633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17dbef66-4a9c-4deb-922c-f7b63e197ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.886670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17dbef66-4a9c-4deb-922c-f7b63e197ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.893625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17dbef66-4a9c-4deb-922c-f7b63e197ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:11.895337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-17dbef66-4a9c-4deb-922c-f7b63e197ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:11.994003 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-17dbef66-4a9c-4deb-922c-f7b63e197ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.131426 Nov 27 21:03:11.994003 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2380/4887] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:11 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:11.994202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a5f033a5-70f5-4390-af1e-3d49cf4c031b req-8fbe89e2-5291-48f3-bc97-f242233dc908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fb9db5-02b8-492d-97c8-c1d5a21bda25", "name": "network-vif-deleted", "tag": "a6449fff-e553-48b7-bba1-cc01f69cac40"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:11.995752 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:03:11.995752 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:03:12.005070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a5f033a5-70f5-4390-af1e-3d49cf4c031b req-8fbe89e2-5291-48f3-bc97-f242233dc908 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.005735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a5f033a5-70f5-4390-af1e-3d49cf4c031b req-8fbe89e2-5291-48f3-bc97-f242233dc908 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.018605 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a5f033a5-70f5-4390-af1e-3d49cf4c031b req-8fbe89e2-5291-48f3-bc97-f242233dc908 service nova] Creating event network-vif-deleted:a6449fff-e553-48b7-bba1-cc01f69cac40 for instance 65fb9db5-02b8-492d-97c8-c1d5a21bda25 on nch1-master-1 Nov 27 21:03:12.025825 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a5f033a5-70f5-4390-af1e-3d49cf4c031b req-8fbe89e2-5291-48f3-bc97-f242233dc908 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034850 Nov 27 21:03:12.027289 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2381/4888] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:03:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:03:12.143361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:12.154572 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e4b1225-43b9-4db5-b4ea-08d22cf3c3b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.537372 Nov 27 21:03:12.155423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2508/4889] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:11 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:12.243000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11e4e252-f7bc-4839-919b-20ef56997dbd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1337772490", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:12.245651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11e4e252-f7bc-4839-919b-20ef56997dbd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:12.247435 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11e4e252-f7bc-4839-919b-20ef56997dbd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.009226 Nov 27 21:03:12.249075 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2382/4890] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:03:12 2021] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:03:12.261712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:12.262511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:12.269467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.270016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.271070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.271883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.664411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:12.677599 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4505a2a-a16c-4822-b8fa-9b1e7a697d77 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.422786 Nov 27 21:03:12.679309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2509/4891] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:12 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:12.701431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:12.702853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:12.714938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.715483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.716907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.717639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.874192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:12.875297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: 65fb9db5-02b8-492d-97c8-c1d5a21bda25] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:12.884484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.885287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.886812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.888201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.910068 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] HTTP exception thrown: Instance 65fb9db5-02b8-492d-97c8-c1d5a21bda25 could not be found. Nov 27 21:03:12.910837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Returning 404 to user: Instance 65fb9db5-02b8-492d-97c8-c1d5a21bda25 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:12.911865 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2e5200b-cb7a-4117-8fcf-544c923f9e09 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25" status: 404 len: 111 microversion: 2.1 time: 0.046227 Nov 27 21:03:12.912581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2510/4892] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:12 2021] GET /compute/v2.1/servers/65fb9db5-02b8-492d-97c8-c1d5a21bda25 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:03:12.924110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:12.924827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:12.934033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.934634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.935610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:12.936163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:12.968850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:03:13.076018 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebfd7a30-4903-4d49-b2fc-9b6f862a6c90 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 204 len: 0 microversion: 2.1 time: 0.156345 Nov 27 21:03:13.078287 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2511/4893] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:03:12 2021] DELETE /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:03:13.089422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b944a0ef-18b9-45ac-8adb-66d96889e247 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:13.091161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b944a0ef-18b9-45ac-8adb-66d96889e247 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:13.099533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b944a0ef-18b9-45ac-8adb-66d96889e247 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.100117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b944a0ef-18b9-45ac-8adb-66d96889e247 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:13.101185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b944a0ef-18b9-45ac-8adb-66d96889e247 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.102014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b944a0ef-18b9-45ac-8adb-66d96889e247 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:13.166013 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b944a0ef-18b9-45ac-8adb-66d96889e247 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.085776 Nov 27 21:03:13.171473 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2512/4894] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:13 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:13.192039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:13.196011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:13.212036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.212664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:13.215092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.216011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:13.459569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:13.472771 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-799e0b1e-7480-4cf1-831f-2c371129819b tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1493 microversion: 2.1 time: 0.297329 Nov 27 21:03:13.473359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2513/4895] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:13 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1493 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:13.501399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:13.508782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63f93445-650c-4f46-bab1-e8cdf2c9f93d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.816397 Nov 27 21:03:13.509965 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2383/4896] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:12 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:13.526829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf2f84e4-afab-43f7-81a9-f4ad2a0e4257 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:13.527544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf2f84e4-afab-43f7-81a9-f4ad2a0e4257 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 03f08585-de03-4fcd-b901-d73bc8fee50c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:13.537107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-bf2f84e4-afab-43f7-81a9-f4ad2a0e4257 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 03f08585-de03-4fcd-b901-d73bc8fee50c could not be found. Nov 27 21:03:13.537850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf2f84e4-afab-43f7-81a9-f4ad2a0e4257 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 03f08585-de03-4fcd-b901-d73bc8fee50c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:13.538936 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf2f84e4-afab-43f7-81a9-f4ad2a0e4257 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/03f08585-de03-4fcd-b901-d73bc8fee50c/action" status: 404 len: 111 microversion: 2.1 time: 0.016782 Nov 27 21:03:13.542713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2514/4897] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:13 2021] POST /compute/v2.1/servers/03f08585-de03-4fcd-b901-d73bc8fee50c/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:03:13.547992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:13.548929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:13.555427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.556046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:13.556980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.557732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:13.900251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:13.908876 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99b56ad6-20b8-46e9-84a3-f58ed1524b8f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.364728 Nov 27 21:03:13.911683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2384/4898] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:13 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:13.938051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:13.940011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:13.958327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.964021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:13.966345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:13.968910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.180415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27c31cd4-d6bb-4032-8298-2215bbe38a51 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:14.182602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27c31cd4-d6bb-4032-8298-2215bbe38a51 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:14.189536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27c31cd4-d6bb-4032-8298-2215bbe38a51 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.190112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27c31cd4-d6bb-4032-8298-2215bbe38a51 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.191327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27c31cd4-d6bb-4032-8298-2215bbe38a51 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.192224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27c31cd4-d6bb-4032-8298-2215bbe38a51 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.238493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:14.239888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27c31cd4-d6bb-4032-8298-2215bbe38a51 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.063611 Nov 27 21:03:14.246394 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2385/4899] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:14 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:14.256396 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39528417-19aa-4e9b-bc28-588ff84cb404 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.329190 Nov 27 21:03:14.260598 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2515/4900] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:13 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:14.278755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc24358e-fd42-4286-9b9b-e28458d5ac6b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:14.279077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc24358e-fd42-4286-9b9b-e28458d5ac6b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:14.288756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc24358e-fd42-4286-9b9b-e28458d5ac6b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.289518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc24358e-fd42-4286-9b9b-e28458d5ac6b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.291098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc24358e-fd42-4286-9b9b-e28458d5ac6b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.292220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc24358e-fd42-4286-9b9b-e28458d5ac6b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.387037 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc24358e-fd42-4286-9b9b-e28458d5ac6b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 202 len: 0 microversion: 2.1 time: 0.113254 Nov 27 21:03:14.388250 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2386/4901] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:14 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:14.396514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:14.397138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:14.414537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.414987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.415835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.416337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.491729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:14.492469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:14.502132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.503042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.504428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:14.505104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:14.788984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:14.799589 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-249c7459-fdb9-4098-acc1-ffa845d4b839 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1510 microversion: 2.1 time: 0.406677 Nov 27 21:03:14.801467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2516/4902] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:14 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:15.160447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:15.178699 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0b87f5d-8375-4464-860a-78d6ac6aa095 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1493 microversion: 2.1 time: 0.687732 Nov 27 21:03:15.180444 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2387/4903] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:14 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1493 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:15.253144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21335dcf-23e7-4e0c-988f-bf4d350854d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:15.254117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21335dcf-23e7-4e0c-988f-bf4d350854d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:15.264925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21335dcf-23e7-4e0c-988f-bf4d350854d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:15.266714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21335dcf-23e7-4e0c-988f-bf4d350854d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:15.269048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21335dcf-23e7-4e0c-988f-bf4d350854d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:15.270501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21335dcf-23e7-4e0c-988f-bf4d350854d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:15.325079 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21335dcf-23e7-4e0c-988f-bf4d350854d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.075770 Nov 27 21:03:15.327714 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2517/4904] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:15 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:15.818967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:15.820003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:15.829127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:15.829679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:15.830573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:15.831109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.197840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:16.198864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:16.207622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.208403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.210078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.210772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.234303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:16.250761 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54e97777-fefc-4c8d-a79e-4b8f281f9c80 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1490 microversion: 2.1 time: 0.436677 Nov 27 21:03:16.258883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2388/4905] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:15 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1490 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:16.275479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:16.277013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:16.288887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.289694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.290950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.292629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.319805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Cannot 'pause' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state paused Nov 27 21:03:16.320731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 409 to user: Cannot 'pause' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state paused {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:16.321769 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be4d7361-ecfe-4a3f-9cc8-1e5d302bdd4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 409 len: 143 microversion: 2.1 time: 0.050663 Nov 27 21:03:16.323091 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2389/4906] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:16 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 143 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 27 21:03:16.332390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab7af79d-6889-499c-beea-6fc854399a47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:16.333972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab7af79d-6889-499c-beea-6fc854399a47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:16.342458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab7af79d-6889-499c-beea-6fc854399a47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.344018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab7af79d-6889-499c-beea-6fc854399a47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.345013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab7af79d-6889-499c-beea-6fc854399a47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.345634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab7af79d-6889-499c-beea-6fc854399a47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.352484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca08ebddb1742d18951633bf019d743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a621d68a46c42269f2eea4bc56c671f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:16.368324 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ee22c207-eb5c-4e9e-9686-f3a4f7047a31 tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 200 len: 1451 microversion: 2.1 time: 0.172867 Nov 27 21:03:16.377393 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2518/4907] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:16 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:16.390776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c8e040eb-c472-43ce-a9c4-5ae09fcfab98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:16.392066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c8e040eb-c472-43ce-a9c4-5ae09fcfab98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:16.408219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e040eb-c472-43ce-a9c4-5ae09fcfab98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.409337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e040eb-c472-43ce-a9c4-5ae09fcfab98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.413481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e040eb-c472-43ce-a9c4-5ae09fcfab98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.414152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e040eb-c472-43ce-a9c4-5ae09fcfab98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.508114 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab7af79d-6889-499c-beea-6fc854399a47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 202 len: 0 microversion: 2.1 time: 0.179913 Nov 27 21:03:16.509707 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2390/4908] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:16 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:16.517978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3a4937b6-d54a-479d-bc34-b392374329cd req-99c9a932-90ae-4706-8902-1a95d3a3abdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24e78d1-535b-4ee2-8281-a712770fd872", "name": "network-vif-deleted", "tag": "a2c2deae-bff9-4c9d-98be-596ea79c1679"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:16.520059 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:03:16.520059 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:03:16.531745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3a4937b6-d54a-479d-bc34-b392374329cd req-99c9a932-90ae-4706-8902-1a95d3a3abdd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.532105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c8e040eb-c472-43ce-a9c4-5ae09fcfab98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.152931 Nov 27 21:03:16.532933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3a4937b6-d54a-479d-bc34-b392374329cd req-99c9a932-90ae-4706-8902-1a95d3a3abdd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.549736 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2519/4909] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:16 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:16.551010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3a4937b6-d54a-479d-bc34-b392374329cd req-99c9a932-90ae-4706-8902-1a95d3a3abdd service nova] Creating event network-vif-deleted:a2c2deae-bff9-4c9d-98be-596ea79c1679 for instance b24e78d1-535b-4ee2-8281-a712770fd872 on nch2-master-1 Nov 27 21:03:16.567279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3a4937b6-d54a-479d-bc34-b392374329cd req-99c9a932-90ae-4706-8902-1a95d3a3abdd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055296 Nov 27 21:03:16.570353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2391/4910] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:03:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:03:16.573143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:16.575069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:16.594305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.595144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:16.596697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:16.597571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:17.344640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:17.357756 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-155557a7-be43-4f96-9d21-4a8b53dfb926 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1497 microversion: 2.1 time: 0.800141 Nov 27 21:03:17.358882 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2520/4911] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:16 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1497 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:17.386351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:17.387687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] [instance: b24e78d1-535b-4ee2-8281-a712770fd872] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:17.395107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:17.395812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:17.396958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:17.397578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:17.414865 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] HTTP exception thrown: Instance b24e78d1-535b-4ee2-8281-a712770fd872 could not be found. Nov 27 21:03:17.415901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] Returning 404 to user: Instance b24e78d1-535b-4ee2-8281-a712770fd872 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:17.417581 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89a288ba-7d75-464c-bb68-1933c0b53f5e tempest-ServerRescueTestJSON-1433592414 tempest-ServerRescueTestJSON-1433592414-project] 10.222.0.21 "GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872" status: 404 len: 111 microversion: 2.1 time: 0.035444 Nov 27 21:03:17.421879 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2392/4912] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:17 2021] GET /compute/v2.1/servers/b24e78d1-535b-4ee2-8281-a712770fd872 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:17.553102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9d8e0f4-ee01-4843-978b-7909a441df53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:17.554309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9d8e0f4-ee01-4843-978b-7909a441df53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:17.561281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9d8e0f4-ee01-4843-978b-7909a441df53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:17.561965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9d8e0f4-ee01-4843-978b-7909a441df53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:17.562953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9d8e0f4-ee01-4843-978b-7909a441df53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:17.563662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9d8e0f4-ee01-4843-978b-7909a441df53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:17.628506 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9d8e0f4-ee01-4843-978b-7909a441df53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.078715 Nov 27 21:03:17.630120 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2521/4913] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:17 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:18.375627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:18.376607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:18.382868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:18.384034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:18.385606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:18.386133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:18.614157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:18.622486 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a472a5c4-0818-4a7d-a7af-4a7b45a96941 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.251009 Nov 27 21:03:18.623284 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2393/4914] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:18 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:18.646548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:18.648332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:18.656062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:18.661529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66471f82-29d5-4b47-bd09-d36d866d0509 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:18.662765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66471f82-29d5-4b47-bd09-d36d866d0509 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:18.663511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:18.664449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:18.667616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:18.674948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66471f82-29d5-4b47-bd09-d36d866d0509 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:18.676803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66471f82-29d5-4b47-bd09-d36d866d0509 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:18.677623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66471f82-29d5-4b47-bd09-d36d866d0509 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:18.678608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66471f82-29d5-4b47-bd09-d36d866d0509 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:18.736452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66471f82-29d5-4b47-bd09-d36d866d0509 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.078566 Nov 27 21:03:18.737991 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2394/4915] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:18 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:19.394037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:19.408510 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f3f29d13-756a-4c90-b732-acd5c5d72d90 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.768436 Nov 27 21:03:19.426008 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2522/4916] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:18 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:19.428832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:19.430054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:19.438203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:19.438769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:19.439667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:19.440178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:19.456307 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. Nov 27 21:03:19.456985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:19.457907 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a66825f3-8d07-4a7b-9c0c-da5d90f47e31 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a/action" status: 404 len: 111 microversion: 2.1 time: 0.033769 Nov 27 21:03:19.458866 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2395/4917] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:19 2021] POST /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:03:19.467117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:19.467879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:19.474072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:19.474591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:19.475479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:19.475982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:19.748971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9aac8a51-6b25-45a4-a2eb-312342cd7577 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:19.749890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9aac8a51-6b25-45a4-a2eb-312342cd7577 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:19.760894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9aac8a51-6b25-45a4-a2eb-312342cd7577 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:19.761622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9aac8a51-6b25-45a4-a2eb-312342cd7577 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:19.763868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9aac8a51-6b25-45a4-a2eb-312342cd7577 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:19.770159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9aac8a51-6b25-45a4-a2eb-312342cd7577 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:19.822886 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9aac8a51-6b25-45a4-a2eb-312342cd7577 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.077362 Nov 27 21:03:19.824293 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2396/4918] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:19 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:20.014824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:20.022364 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ddc2cd7-0319-4364-bb07-186f87075798 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.559376 Nov 27 21:03:20.035608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2523/4919] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:19 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:20.041527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:20.042223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:20.049190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.049888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.050901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.051601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.289309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:20.299565 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-41883135-97a8-4e7e-b9c5-ec91e5412399 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.262690 Nov 27 21:03:20.300447 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2397/4920] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:20 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:20.320879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db2d4975-8df6-4989-9bcb-bf5ab8d59bc1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:20.323185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db2d4975-8df6-4989-9bcb-bf5ab8d59bc1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: c613f190-2f02-4e72-ab28-40133aa740d9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:20.329351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-db2d4975-8df6-4989-9bcb-bf5ab8d59bc1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance c613f190-2f02-4e72-ab28-40133aa740d9 could not be found. Nov 27 21:03:20.330321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db2d4975-8df6-4989-9bcb-bf5ab8d59bc1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance c613f190-2f02-4e72-ab28-40133aa740d9 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:20.332099 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db2d4975-8df6-4989-9bcb-bf5ab8d59bc1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/c613f190-2f02-4e72-ab28-40133aa740d9/action" status: 404 len: 111 microversion: 2.1 time: 0.016392 Nov 27 21:03:20.333425 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2524/4921] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:20 2021] POST /compute/v2.1/servers/c613f190-2f02-4e72-ab28-40133aa740d9/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:03:20.343910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:20.345473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:20.352987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.354528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.355708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.356642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.834873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-541622f6-9dd7-44f6-a53e-a282fd15811a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:20.839049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-541622f6-9dd7-44f6-a53e-a282fd15811a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:20.854476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-541622f6-9dd7-44f6-a53e-a282fd15811a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.855189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-541622f6-9dd7-44f6-a53e-a282fd15811a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.857166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-541622f6-9dd7-44f6-a53e-a282fd15811a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.858821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:20.859807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-541622f6-9dd7-44f6-a53e-a282fd15811a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.888398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8222bbc-527a-4171-afc4-d323e3eb992f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.549885 Nov 27 21:03:20.889940 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2398/4922] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:20 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:20.908015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:20.908980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:20.917391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.918355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.920043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:20.920740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:20.940813 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-541622f6-9dd7-44f6-a53e-a282fd15811a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.109482 Nov 27 21:03:20.942133 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2525/4923] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:20 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:21.676093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:21.688916 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a78dbddb-ee7e-48ee-af93-8e3da02d7f97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.785089 Nov 27 21:03:21.689755 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2399/4924] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:20 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:21.707472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:21.709000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:21.716411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:21.716871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:21.717862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:21.718475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:21.733298 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. Nov 27 21:03:21.734174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:21.735208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65cd1102-bc58-4803-9c13-9f6a2b34a0ba tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a/action" status: 404 len: 111 microversion: 2.1 time: 0.031947 Nov 27 21:03:21.736163 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2526/4925] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:21 2021] POST /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:03:21.744864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:21.745743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:21.753068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:21.754929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:21.755968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:21.756970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:21.953147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98d741b1-4263-49d1-bccf-6c40a4604844 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:21.954085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98d741b1-4263-49d1-bccf-6c40a4604844 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:21.960952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98d741b1-4263-49d1-bccf-6c40a4604844 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:21.961689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98d741b1-4263-49d1-bccf-6c40a4604844 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:21.963370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98d741b1-4263-49d1-bccf-6c40a4604844 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:21.963997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98d741b1-4263-49d1-bccf-6c40a4604844 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:21.993730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:22.004529 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-959e41c1-5865-4d59-9072-021cce3079cf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.258374 Nov 27 21:03:22.005183 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2400/4926] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:21 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:22.026226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:22.027088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:22.036467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:22.039381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:22.041947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:22.042783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:22.072691 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98d741b1-4263-49d1-bccf-6c40a4604844 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.123242 Nov 27 21:03:22.079857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2527/4927] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:21 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:22.377327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:22.387073 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d65fe80b-02b1-4e6b-8ea9-06ebd6103a03 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.364839 Nov 27 21:03:22.387881 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2401/4928] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:22 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:22.410967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-228594c1-301c-4255-ab19-28c9c9873c2d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:22.412474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-228594c1-301c-4255-ab19-28c9c9873c2d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 61373078-b791-49f6-b8da-8cbb0139eb4a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:22.419772 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-228594c1-301c-4255-ab19-28c9c9873c2d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 61373078-b791-49f6-b8da-8cbb0139eb4a could not be found. Nov 27 21:03:22.420922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-228594c1-301c-4255-ab19-28c9c9873c2d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 61373078-b791-49f6-b8da-8cbb0139eb4a could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:22.421988 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-228594c1-301c-4255-ab19-28c9c9873c2d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/61373078-b791-49f6-b8da-8cbb0139eb4a/action" status: 404 len: 111 microversion: 2.1 time: 0.020363 Nov 27 21:03:22.422750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2528/4929] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:22 2021] POST /compute/v2.1/servers/61373078-b791-49f6-b8da-8cbb0139eb4a/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:22.443922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:22.444470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:22.453830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:22.454279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:22.455108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:22.456121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:22.748376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:22.756108 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e425005e-7392-4116-bee6-4508386b62a2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.315927 Nov 27 21:03:22.756823 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2402/4930] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:22 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:22.774678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:22.775424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:22.782810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:22.783375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:22.784169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:22.784607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:23.093492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e7f3f38-a4d9-4238-a298-71925df3221a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:23.095030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e7f3f38-a4d9-4238-a298-71925df3221a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:23.102869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e7f3f38-a4d9-4238-a298-71925df3221a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:23.103851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e7f3f38-a4d9-4238-a298-71925df3221a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:23.104647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e7f3f38-a4d9-4238-a298-71925df3221a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:23.105088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e7f3f38-a4d9-4238-a298-71925df3221a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:23.195855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e7f3f38-a4d9-4238-a298-71925df3221a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.102377 Nov 27 21:03:23.216847 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2403/4931] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:23 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:23.457952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:23.472794 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bea99ac5-a010-431c-b33f-32f32dc76857 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.700468 Nov 27 21:03:23.475584 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2529/4932] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:22 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:23.496369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-484b5346-8bf4-47f9-b642-7269f8554ac6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:23.497758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-484b5346-8bf4-47f9-b642-7269f8554ac6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: e06bc770-4fbf-40b2-88cd-27bf2c12cd72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:23.511386 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-484b5346-8bf4-47f9-b642-7269f8554ac6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance e06bc770-4fbf-40b2-88cd-27bf2c12cd72 could not be found. Nov 27 21:03:23.512789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-484b5346-8bf4-47f9-b642-7269f8554ac6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance e06bc770-4fbf-40b2-88cd-27bf2c12cd72 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:23.514398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-484b5346-8bf4-47f9-b642-7269f8554ac6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/e06bc770-4fbf-40b2-88cd-27bf2c12cd72/action" status: 404 len: 111 microversion: 2.1 time: 0.023444 Nov 27 21:03:23.517839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2404/4933] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:23 2021] POST /compute/v2.1/servers/e06bc770-4fbf-40b2-88cd-27bf2c12cd72/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:23.528904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:23.530001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:23.537300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:23.539373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:23.541755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:23.542480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:23.951019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:23.960158 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b90e029d-e531-4943-b148-40ad75df95bd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.438130 Nov 27 21:03:23.974806 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2530/4934] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:23 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:23.981748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:23.982734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:23.994654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:23.997427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:23.999568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.000172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.209185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bee59d06-acca-4350-ab55-045a19395e99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:24.212742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bee59d06-acca-4350-ab55-045a19395e99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:24.220909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee59d06-acca-4350-ab55-045a19395e99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.221483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee59d06-acca-4350-ab55-045a19395e99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.222392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee59d06-acca-4350-ab55-045a19395e99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.222971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bee59d06-acca-4350-ab55-045a19395e99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.286170 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bee59d06-acca-4350-ab55-045a19395e99 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.080622 Nov 27 21:03:24.293204 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2531/4935] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:24 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:24.443323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:24.458347 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c29a38e4-280d-41b6-bd5e-2c4385921a8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.482096 Nov 27 21:03:24.459587 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2405/4936] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:23 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:24.476436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:24.477385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:24.484775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.485456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.486240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.486857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.512551 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Cannot 'restore' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active Nov 27 21:03:24.513144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 409 to user: Cannot 'restore' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:24.514172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d461afb3-7748-47e4-861c-7834d0a024ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 409 len: 145 microversion: 2.1 time: 0.042418 Nov 27 21:03:24.515224 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2532/4937] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:24 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 145 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:03:24.523303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:24.524219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:24.531229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.532037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.532842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.533468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.844586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:24.856743 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d5a8927-aadc-47c7-9237-c74bf449f0af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.337313 Nov 27 21:03:24.857874 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2406/4938] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:24 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:24.874397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:24.875007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:24.882493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.883222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:24.884231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:24.884732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:25.298725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da619423-cc39-46df-b258-95cf8df0cf87 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:25.299691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da619423-cc39-46df-b258-95cf8df0cf87 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:25.306543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da619423-cc39-46df-b258-95cf8df0cf87 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:25.307007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da619423-cc39-46df-b258-95cf8df0cf87 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:25.307965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da619423-cc39-46df-b258-95cf8df0cf87 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:25.308412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da619423-cc39-46df-b258-95cf8df0cf87 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:25.388291 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da619423-cc39-46df-b258-95cf8df0cf87 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.093117 Nov 27 21:03:25.393726 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2407/4939] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:25 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:25.473401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:25.498032 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15229859-b72a-4e58-83da-3c04a87a882c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.627455 Nov 27 21:03:25.500134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2533/4940] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:24 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:25.519962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-074726da-0b09-49be-bfcc-8e7795b866c4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:25.521079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-074726da-0b09-49be-bfcc-8e7795b866c4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 04c29a92-9fa1-4c93-b84a-40c388aca37b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:25.533986 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-074726da-0b09-49be-bfcc-8e7795b866c4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 04c29a92-9fa1-4c93-b84a-40c388aca37b could not be found. Nov 27 21:03:25.534699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-074726da-0b09-49be-bfcc-8e7795b866c4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 04c29a92-9fa1-4c93-b84a-40c388aca37b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:25.536616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-074726da-0b09-49be-bfcc-8e7795b866c4 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/04c29a92-9fa1-4c93-b84a-40c388aca37b/action" status: 404 len: 111 microversion: 2.1 time: 0.022970 Nov 27 21:03:25.537677 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2408/4941] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:25 2021] POST /compute/v2.1/servers/04c29a92-9fa1-4c93-b84a-40c388aca37b/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:25.547063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:25.548030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:25.555112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:25.555966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:25.557015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:25.557961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.145383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:26.157602 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99065868-fca4-43a9-98bd-b543fac401a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.615556 Nov 27 21:03:26.159267 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2534/4942] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:25 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:26.177599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:26.178226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:26.187196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.190266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.191322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.191943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.403793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61035cdf-5656-4cd9-a17c-32d732fdb412 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:26.404811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61035cdf-5656-4cd9-a17c-32d732fdb412 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:26.417674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61035cdf-5656-4cd9-a17c-32d732fdb412 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.418119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61035cdf-5656-4cd9-a17c-32d732fdb412 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.418919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61035cdf-5656-4cd9-a17c-32d732fdb412 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.419375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61035cdf-5656-4cd9-a17c-32d732fdb412 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.490300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:26.516280 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13ac69d2-b5bc-48ad-ac77-949afe7d9cf3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.342907 Nov 27 21:03:26.516885 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2409/4943] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:26 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:26.538096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:26.539647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:26.571167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.571680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.572553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.579929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.593141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61035cdf-5656-4cd9-a17c-32d732fdb412 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.195770 Nov 27 21:03:26.609212 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2535/4944] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:26 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:26.676390 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Cannot 'resume' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active Nov 27 21:03:26.676994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 409 to user: Cannot 'resume' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:26.677851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-435172a8-891e-4554-9d02-79d59e46f3af tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 409 len: 144 microversion: 2.1 time: 0.145064 Nov 27 21:03:26.687027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:26.687760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:26.697028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.697537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:26.698317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:26.701430 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2410/4945] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:26 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 144 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 27 21:03:26.710027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:27.340247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:27.348921 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c737ad1-1a43-425d-9660-3e87fe7d6c47 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.665828 Nov 27 21:03:27.350338 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2536/4946] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:26 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:27.367850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:27.368682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:27.376806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:27.377506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:27.378592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:27.379234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:27.605619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9240db3-6c36-43ba-8eb3-9af261493ca6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:27.608469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9240db3-6c36-43ba-8eb3-9af261493ca6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:27.625041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9240db3-6c36-43ba-8eb3-9af261493ca6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:27.627116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9240db3-6c36-43ba-8eb3-9af261493ca6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:27.631701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9240db3-6c36-43ba-8eb3-9af261493ca6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:27.632426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9240db3-6c36-43ba-8eb3-9af261493ca6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:27.733935 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9240db3-6c36-43ba-8eb3-9af261493ca6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.131708 Nov 27 21:03:27.735341 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2537/4947] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:27 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:27.805849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:27.817720 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7f3ecb5-dfc3-4b71-9bca-2da4aecacd28 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.453181 Nov 27 21:03:27.822306 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2411/4948] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:27 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:28.031513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-523f995b-988f-4fbf-b5ee-597caf264789 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "5fc9f4b4-8604-4ff4-85b1-28e814a55b3b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:28.033118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-523f995b-988f-4fbf-b5ee-597caf264789 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:28.034190 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-523f995b-988f-4fbf-b5ee-597caf264789 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.007453 Nov 27 21:03:28.038936 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2412/4949] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:03:28 2021] POST /compute/v2.1/servers => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:03:28.044147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:28.045094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:28.055012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.055892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.057676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.058572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.102686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1787140135", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": "none"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:28.168052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:03:28.168847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:03:28.169579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:03:28.170411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:03:28.171083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:03:28.184068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.184902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.185864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.186476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.212282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Getting quotas for project fbe5ff330fa94dce90ceb417549101a1. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:03:28.219632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Getting quotas for user 909441655c7c49d2b68a0a589f5c422b and project fbe5ff330fa94dce90ceb417549101a1. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:03:28.237823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:03:28.248445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:03:28.323689 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cadf3c9e-a75c-49f7-94a7-7bfcdb4733b2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.415354 Nov 27 21:03:28.329234 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2538/4950] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 21:03:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 21:03:28.337554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19f292dc-b54a-49fa-8f89-9aa79d35abf2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:28.339476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19f292dc-b54a-49fa-8f89-9aa79d35abf2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:28.414532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19f292dc-b54a-49fa-8f89-9aa79d35abf2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:28.425268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19f292dc-b54a-49fa-8f89-9aa79d35abf2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:28.430648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19f292dc-b54a-49fa-8f89-9aa79d35abf2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:28.435833 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19f292dc-b54a-49fa-8f89-9aa79d35abf2 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1278 microversion: 2.54 time: 0.104084 Nov 27 21:03:28.438347 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2539/4951] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:28 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:28.472629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:28.484425 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-380d332f-7bb3-4eec-8ed7-5098f32b9835 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.443979 Nov 27 21:03:28.498275 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2413/4952] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:28 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:28.504361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:28.505307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:28.522553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.523007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.526054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.526513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.752300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ae7d85b3-8f4a-44ca-a1ed-ce3cd2380b50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:28.753332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae7d85b3-8f4a-44ca-a1ed-ce3cd2380b50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:28.783824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae7d85b3-8f4a-44ca-a1ed-ce3cd2380b50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.784283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae7d85b3-8f4a-44ca-a1ed-ce3cd2380b50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.785095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae7d85b3-8f4a-44ca-a1ed-ce3cd2380b50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:28.785760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae7d85b3-8f4a-44ca-a1ed-ce3cd2380b50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:28.902693 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ae7d85b3-8f4a-44ca-a1ed-ce3cd2380b50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.158723 Nov 27 21:03:28.903408 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2414/4953] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:28 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:29.062975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:29.074811 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88a9f152-210a-4983-af11-4ea55c9e1360 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.573938 Nov 27 21:03:29.077956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2540/4954] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:28 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:29.097941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-957dffb4-0492-47ba-bc91-d0ec2c070ca0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:29.098579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-957dffb4-0492-47ba-bc91-d0ec2c070ca0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 47ee94c9-c48d-4cf6-8b54-24d2b4d671ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:29.109148 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-957dffb4-0492-47ba-bc91-d0ec2c070ca0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 47ee94c9-c48d-4cf6-8b54-24d2b4d671ae could not be found. Nov 27 21:03:29.111055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-957dffb4-0492-47ba-bc91-d0ec2c070ca0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 47ee94c9-c48d-4cf6-8b54-24d2b4d671ae could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:03:29.111964 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-957dffb4-0492-47ba-bc91-d0ec2c070ca0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/47ee94c9-c48d-4cf6-8b54-24d2b4d671ae/action" status: 404 len: 111 microversion: 2.1 time: 0.018701 Nov 27 21:03:29.120182 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2415/4955] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:29 2021] POST /compute/v2.1/servers/47ee94c9-c48d-4cf6-8b54-24d2b4d671ae/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:29.122085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:29.122802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:29.142880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.148002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.149011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.152028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.459925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:29.460558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:29.473086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.473883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.475234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.476275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.553390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:29.563016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:29.564638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:29.565787 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-207d32bb-9f79-4263-95c1-46792af61128 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1330 microversion: 2.54 time: 0.110336 Nov 27 21:03:29.573066 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2416/4956] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:29 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:03:29.759684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:29.772690 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c89ccfa3-6112-481a-b7e6-2a957d06e1cb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.654499 Nov 27 21:03:29.775559 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2541/4957] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:29 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:29.794565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:29.795841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:29.804080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.804833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.805953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.806963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.916999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a3520bd-b9c4-4dc6-8951-f79d14d661a6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:29.918900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a3520bd-b9c4-4dc6-8951-f79d14d661a6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:29.925442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a3520bd-b9c4-4dc6-8951-f79d14d661a6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.925900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a3520bd-b9c4-4dc6-8951-f79d14d661a6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.927283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a3520bd-b9c4-4dc6-8951-f79d14d661a6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:29.927919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a3520bd-b9c4-4dc6-8951-f79d14d661a6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:29.983412 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a3520bd-b9c4-4dc6-8951-f79d14d661a6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.072884 Nov 27 21:03:29.984290 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2542/4958] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:29 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:30.090717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:30.098461 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8fac3ae1-cd86-4081-aa05-6f1d67f10e74 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.311632 Nov 27 21:03:30.099057 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2417/4959] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:29 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:30.120130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:30.120762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:30.128612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:30.129289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:30.130270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:30.130880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:30.158275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lazy-loading 'flavor' on Instance uuid d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:03:30.547077 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-075657c1-2e7d-46e1-8795-a38afa09be75 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 202 len: 0 microversion: 2.1 time: 0.431475 Nov 27 21:03:30.557081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:30.558144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:30.564219 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2543/4960] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:03:30 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:30.567208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:30.568128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:30.569917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:30.570608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:30.593216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:30.594603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:30.609015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:30.609863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:30.612217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:30.612937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:30.724140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:30.736569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:30.739458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:30.740902 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a8afe0f2-4f01-499a-a5a3-cf8e88eb2d86 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1336 microversion: 2.54 time: 0.153687 Nov 27 21:03:30.742067 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2544/4961] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:30 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1336 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:03:30.997563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fccc7190-5f56-4aee-ab3e-65953e5d7aae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:30.999827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fccc7190-5f56-4aee-ab3e-65953e5d7aae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:31.010188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fccc7190-5f56-4aee-ab3e-65953e5d7aae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:31.010751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fccc7190-5f56-4aee-ab3e-65953e5d7aae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:31.011692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fccc7190-5f56-4aee-ab3e-65953e5d7aae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:31.012541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fccc7190-5f56-4aee-ab3e-65953e5d7aae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:31.070554 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fccc7190-5f56-4aee-ab3e-65953e5d7aae tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.077353 Nov 27 21:03:31.075857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2545/4962] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:30 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:31.484338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:31.496311 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5bdab64-f355-47bd-99c2-02b429cca58f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.943556 Nov 27 21:03:31.497814 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2418/4963] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:30 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:31.765541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:31.766064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:31.774012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:31.774576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:31.775535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:31.775947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:31.905941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:31.914992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:31.916902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:31.918119 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17f07f42-9297-4516-adb5-1c7274a04ee0 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1336 microversion: 2.54 time: 0.156894 Nov 27 21:03:31.919244 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2546/4964] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:31 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1336 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:32.083646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4feed025-1548-4075-9887-baf6df14b135 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:32.084729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4feed025-1548-4075-9887-baf6df14b135 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:32.091892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4feed025-1548-4075-9887-baf6df14b135 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:32.092433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4feed025-1548-4075-9887-baf6df14b135 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:32.093233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4feed025-1548-4075-9887-baf6df14b135 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:32.093707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4feed025-1548-4075-9887-baf6df14b135 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:32.142984 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4feed025-1548-4075-9887-baf6df14b135 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.062953 Nov 27 21:03:32.148141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2419/4965] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:32 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:32.515333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:32.515897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:32.528412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:32.528864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:32.531056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:32.531708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:32.757032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:32.766313 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80157085-c263-462b-8284-f35b025c355d tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.254451 Nov 27 21:03:32.766944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2547/4966] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:32 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:32.938824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:32.939551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:32.948374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:32.949082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:32.950056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:32.951043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:33.037381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:33.047360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:33.049356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:33.050521 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0af01c8-5d2c-4c0c-a190-4afb6b1ef012 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1336 microversion: 2.54 time: 0.115966 Nov 27 21:03:33.051090 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2420/4967] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:32 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:33.156948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd837070-9b30-484f-9054-516f2fbaaa75 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:33.157860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd837070-9b30-484f-9054-516f2fbaaa75 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:33.169110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd837070-9b30-484f-9054-516f2fbaaa75 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:33.169902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd837070-9b30-484f-9054-516f2fbaaa75 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:33.175775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd837070-9b30-484f-9054-516f2fbaaa75 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:33.176164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd837070-9b30-484f-9054-516f2fbaaa75 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:33.236487 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd837070-9b30-484f-9054-516f2fbaaa75 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.083693 Nov 27 21:03:33.238229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2548/4968] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:33 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:33.783568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:33.784295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:33.791493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:33.792371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:33.793272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:33.793904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:33.950185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:33.962749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23d9d576-3166-40b6-9d18-8a660facef18 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.183064 Nov 27 21:03:33.963505 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2421/4969] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:33 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:34.075928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:34.077423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:34.084825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.085475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.086445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.087072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.168433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:34.177757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:34.179503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:34.180663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ad07941f-2a4b-481e-8b27-5e000e62c68c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1357 microversion: 2.54 time: 0.113293 Nov 27 21:03:34.182191 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2549/4970] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:34 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:34.199622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e2e8aee5-e08e-48b9-a812-c12fb5498d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Action: 'create', calling method: .version_select at 0x7f15c788d5e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-194026870"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:34.213728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-e2e8aee5-e08e-48b9-a812-c12fb5498d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Getting quotas for project fbe5ff330fa94dce90ceb417549101a1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:03:34.218665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-e2e8aee5-e08e-48b9-a812-c12fb5498d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Getting quotas for user 909441655c7c49d2b68a0a589f5c422b and project fbe5ff330fa94dce90ceb417549101a1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:03:34.248670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-985e19ca-d341-48c1-8b9a-bb9d779f22b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:34.249867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-985e19ca-d341-48c1-8b9a-bb9d779f22b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:34.256373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985e19ca-d341-48c1-8b9a-bb9d779f22b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.257174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985e19ca-d341-48c1-8b9a-bb9d779f22b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.258164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985e19ca-d341-48c1-8b9a-bb9d779f22b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.258840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-985e19ca-d341-48c1-8b9a-bb9d779f22b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.309009 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-985e19ca-d341-48c1-8b9a-bb9d779f22b7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.064801 Nov 27 21:03:34.309487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-e2e8aee5-e08e-48b9-a812-c12fb5498d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Getting quotas for project fbe5ff330fa94dce90ceb417549101a1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:03:34.309767 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2550/4971] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:34 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:34.317482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-e2e8aee5-e08e-48b9-a812-c12fb5498d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Getting quotas for user 909441655c7c49d2b68a0a589f5c422b and project fbe5ff330fa94dce90ceb417549101a1. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:03:34.333673 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e2e8aee5-e08e-48b9-a812-c12fb5498d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2334 microversion: 2.54 time: 0.138211 Nov 27 21:03:34.334573 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2422/4972] 10.222.0.21 () {62 vars in 1198 bytes} [Sat Nov 27 21:03:34 2021] POST /compute/v2.1/os-keypairs => generated 2334 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:03:34.345338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-194026870", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:34.346947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:34.354255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.354950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.355754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.356184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.457620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:03:34.458762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:03:34.459756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:03:34.460382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:03:34.460882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:03:34.560817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:34.568977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.569743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.570726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.571584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.614600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a46e302-0cd9-4c5f-a972-455621f0c6b3 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "POST /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76/action" status: 202 len: 1139 microversion: 2.54 time: 0.272770 Nov 27 21:03:34.616897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2551/4973] 10.222.0.21 () {62 vars in 1319 bytes} [Sat Nov 27 21:03:34 2021] POST /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76/action => generated 1139 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 27 21:03:34.633493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:34.634416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:34.641376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.642086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.643353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:34.643975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:34.754472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:34.775495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:34.777191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:34.781862 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c35e2f8e-75cd-4978-817f-dd1e912e64a6 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.152494 Nov 27 21:03:34.783494 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2423/4974] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:34 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:34.983408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:34.984782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:34.999676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:35.003452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:35.004345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:35.004793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:35.290377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:35.311314 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-679d1ce9-955e-4e84-85ac-6612d195b129 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.335361 Nov 27 21:03:35.313286 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2552/4975] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:34 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:35.328987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-50a3564e-69e6-4162-af68-d3e2c2007a98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:35.330594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-50a3564e-69e6-4162-af68-d3e2c2007a98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:35.337018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50a3564e-69e6-4162-af68-d3e2c2007a98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:35.338064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50a3564e-69e6-4162-af68-d3e2c2007a98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:35.338874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50a3564e-69e6-4162-af68-d3e2c2007a98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:35.339344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50a3564e-69e6-4162-af68-d3e2c2007a98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:35.387625 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-50a3564e-69e6-4162-af68-d3e2c2007a98 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.062354 Nov 27 21:03:35.388930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2424/4976] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:35 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:35.802735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:35.811325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:35.819901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:35.820671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:35.821558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:35.822407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:35.902849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:35.917442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:35.920073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:35.922000 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f02384ee-0883-40e5-b6ac-c740972f783c tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.123962 Nov 27 21:03:35.923241 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2553/4977] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:35 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:36.334491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:36.335216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:36.347077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:36.347858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:36.350586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:36.351541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:36.401793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b03a2dd8-da51-453c-81ca-2fde7ebac194 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:36.402695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b03a2dd8-da51-453c-81ca-2fde7ebac194 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:36.415218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b03a2dd8-da51-453c-81ca-2fde7ebac194 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:36.416719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b03a2dd8-da51-453c-81ca-2fde7ebac194 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:36.419226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b03a2dd8-da51-453c-81ca-2fde7ebac194 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:36.420330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b03a2dd8-da51-453c-81ca-2fde7ebac194 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:36.505026 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b03a2dd8-da51-453c-81ca-2fde7ebac194 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.108883 Nov 27 21:03:36.510247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2554/4978] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:36 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:36.641967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:36.666948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e787c60f-794c-4aca-ab73-127b8e30251a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.338535 Nov 27 21:03:36.668906 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2425/4979] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:36 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:36.943193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:36.948107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:36.964551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:36.966506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:36.967856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:36.968502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:37.131198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:37.142087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:37.143886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:37.145547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2deac698-c9ef-42bd-ba9e-a85f90e5367f tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.206948 Nov 27 21:03:37.146618 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2555/4980] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:36 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:37.521199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1ef4d28c-616f-418b-a0d2-cba7b30d7203 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:37.522141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1ef4d28c-616f-418b-a0d2-cba7b30d7203 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:37.529952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ef4d28c-616f-418b-a0d2-cba7b30d7203 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:37.530645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ef4d28c-616f-418b-a0d2-cba7b30d7203 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:37.531649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ef4d28c-616f-418b-a0d2-cba7b30d7203 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:37.532268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ef4d28c-616f-418b-a0d2-cba7b30d7203 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:37.588741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1ef4d28c-616f-418b-a0d2-cba7b30d7203 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.071089 Nov 27 21:03:37.589949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2426/4981] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:37 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:37.683735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:37.684887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:37.691954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:37.692633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:37.693592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:37.694196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:37.861689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:37.923353 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c4d2fc2-ef32-4a10-92e1-89e8101cbf3a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.239328 Nov 27 21:03:37.924808 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2556/4982] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:37 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:38.170770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:38.171811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:38.184267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:38.185185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:38.186309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:38.186934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:38.265104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:38.274631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:38.276694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:38.277864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6df487a5-c0fd-4ada-b3eb-93db1daaf2cf tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.114239 Nov 27 21:03:38.278423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2427/4983] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:38 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:38.611289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef03cd6c-560f-497b-9a3f-c29990276b53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:38.614448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef03cd6c-560f-497b-9a3f-c29990276b53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:38.643982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef03cd6c-560f-497b-9a3f-c29990276b53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:38.644946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef03cd6c-560f-497b-9a3f-c29990276b53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:38.645921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef03cd6c-560f-497b-9a3f-c29990276b53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:38.646738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef03cd6c-560f-497b-9a3f-c29990276b53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:38.700413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef03cd6c-560f-497b-9a3f-c29990276b53 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.099118 Nov 27 21:03:38.701088 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2557/4984] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:38 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:38.943126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:38.944802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:38.956765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:38.962785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:38.964159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:38.965638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:39.253894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:39.265001 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1fdcf316-f81c-4922-8553-d1036c1a7f30 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.327393 Nov 27 21:03:39.265592 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2428/4985] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:38 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:39.300704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:39.302506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:39.310910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:39.311293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:39.312263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:39.313038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:39.413306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:39.428122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:39.434554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:39.436082 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-971b288f-94a4-4d32-ba7d-ac536c986d7d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.141285 Nov 27 21:03:39.437188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2558/4986] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:39 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:39.713542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aa076173-7678-4a1d-ab3f-1a65f10694e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:39.714481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aa076173-7678-4a1d-ab3f-1a65f10694e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:39.724722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa076173-7678-4a1d-ab3f-1a65f10694e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:39.725183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa076173-7678-4a1d-ab3f-1a65f10694e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:39.726123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa076173-7678-4a1d-ab3f-1a65f10694e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:39.726468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa076173-7678-4a1d-ab3f-1a65f10694e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:39.779596 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aa076173-7678-4a1d-ab3f-1a65f10694e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.068897 Nov 27 21:03:39.780865 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2429/4987] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:39 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:40.288603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:40.290689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:40.300047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:40.300900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:40.302376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:40.303103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:40.455168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:40.455962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:40.468967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:40.475211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:40.476293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:40.476947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:40.605224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:40.621888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:40.625685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:40.627917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f81a96c-1af6-47b5-b384-f59e833685e4 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.176796 Nov 27 21:03:40.630223 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2430/4988] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:40 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:03:40.691576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:40.705784 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4af33716-7d45-4b91-b4a5-953f6c52db24 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.423496 Nov 27 21:03:40.708687 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2559/4989] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:40 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:40.795183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5304d7dc-3d1b-49a3-989b-f6831cbd0a7e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:40.796380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5304d7dc-3d1b-49a3-989b-f6831cbd0a7e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:40.809348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5304d7dc-3d1b-49a3-989b-f6831cbd0a7e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:40.811875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5304d7dc-3d1b-49a3-989b-f6831cbd0a7e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:40.814148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5304d7dc-3d1b-49a3-989b-f6831cbd0a7e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:40.814880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5304d7dc-3d1b-49a3-989b-f6831cbd0a7e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:40.870685 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5304d7dc-3d1b-49a3-989b-f6831cbd0a7e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.078731 Nov 27 21:03:40.876206 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2431/4990] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:40 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:41.650059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:41.651948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:41.661213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:41.661992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:41.663040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:41.663720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:41.727535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:41.728962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:41.751159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:41.753323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:41.754910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:41.757878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:41.908513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:41.923094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:41.927493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:41.933414 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e7ec02e-72fc-4645-9eeb-9f3a229a1654 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.287890 Nov 27 21:03:41.945982 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2560/4991] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:41 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:41.952010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6628b0d0-6d2f-4cbf-921a-184ecc77143b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:41.953103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6628b0d0-6d2f-4cbf-921a-184ecc77143b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:41.965172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6628b0d0-6d2f-4cbf-921a-184ecc77143b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:41.966731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6628b0d0-6d2f-4cbf-921a-184ecc77143b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:41.968714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6628b0d0-6d2f-4cbf-921a-184ecc77143b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:41.969318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6628b0d0-6d2f-4cbf-921a-184ecc77143b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:42.042224 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6628b0d0-6d2f-4cbf-921a-184ecc77143b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.098300 Nov 27 21:03:42.046797 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2561/4992] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:41 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:42.137088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:42.158970 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f99d9591-4abc-4540-8052-6c2662c3620c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1532 microversion: 2.1 time: 0.436908 Nov 27 21:03:42.159983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2432/4993] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:41 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1532 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:03:42.953642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:42.954354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:42.964294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:42.965221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:42.966218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:42.966901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:43.053969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f18066e-31c1-484d-9d47-0ecaf4c63284 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:43.054914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f18066e-31c1-484d-9d47-0ecaf4c63284 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:43.081750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:43.090820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:43.092759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f18066e-31c1-484d-9d47-0ecaf4c63284 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:43.097055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f18066e-31c1-484d-9d47-0ecaf4c63284 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:43.099659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:43.100035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f18066e-31c1-484d-9d47-0ecaf4c63284 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:43.101519 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a1c9fc1f-7092-4cef-a05b-57925af66dda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.152566 Nov 27 21:03:43.102175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f18066e-31c1-484d-9d47-0ecaf4c63284 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:43.103357 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2562/4994] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:42 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:03:43.167831 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f18066e-31c1-484d-9d47-0ecaf4c63284 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.117154 Nov 27 21:03:43.169548 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2433/4995] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:43 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:43.176675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:43.178139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:43.197410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:43.200533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:43.201817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:43.206772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:43.510453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:43.520862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e9af526d-fbfc-4955-b2b3-958c3d8c0224 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.347752 Nov 27 21:03:43.525566 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2563/4996] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:43 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:44.122644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:44.123468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:44.136937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:44.137273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:44.138893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:44.139386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:44.180091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-def98357-8e30-4d03-8406-47373ea63215 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:44.182243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-def98357-8e30-4d03-8406-47373ea63215 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:44.191933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def98357-8e30-4d03-8406-47373ea63215 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:44.198885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def98357-8e30-4d03-8406-47373ea63215 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:44.200063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def98357-8e30-4d03-8406-47373ea63215 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:44.200506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def98357-8e30-4d03-8406-47373ea63215 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:44.291041 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-def98357-8e30-4d03-8406-47373ea63215 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.112702 Nov 27 21:03:44.293375 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2564/4997] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:44 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:44.313810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:44.326071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:44.327618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:44.328805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c624df6-e0b0-46b1-8f22-d79e3690e113 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.211102 Nov 27 21:03:44.329380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2434/4998] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:44 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:44.543468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:44.544430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:44.559419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:44.560144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:44.561141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:44.562239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:45.312431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95a50743-971d-4d03-9dc9-2372ffdbbb64 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:45.313494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95a50743-971d-4d03-9dc9-2372ffdbbb64 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:45.329440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95a50743-971d-4d03-9dc9-2372ffdbbb64 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:45.329906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95a50743-971d-4d03-9dc9-2372ffdbbb64 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:45.330723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95a50743-971d-4d03-9dc9-2372ffdbbb64 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:45.331171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95a50743-971d-4d03-9dc9-2372ffdbbb64 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:45.425923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95a50743-971d-4d03-9dc9-2372ffdbbb64 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.123993 Nov 27 21:03:45.427043 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2435/4999] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:45 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:45.434416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:45.437619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:45.453616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:45.455802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:45.464243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:45.465088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:45.641783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:45.659434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:45.662894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:45.673599 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d11559d1-86f9-4818-859c-ac438bc6a14b tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.242856 Nov 27 21:03:45.675709 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2436/5000] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:45 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:45.822375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:45.837559 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8cf7efc-2a34-4e0a-a62a-e25962849c4a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 1.298243 Nov 27 21:03:45.851467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2565/5001] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:44 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:46.440922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-06b4e1d9-89af-4a13-8140-547269dad6a5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:46.442302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-06b4e1d9-89af-4a13-8140-547269dad6a5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:46.458057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b4e1d9-89af-4a13-8140-547269dad6a5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:46.461588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b4e1d9-89af-4a13-8140-547269dad6a5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:46.463415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b4e1d9-89af-4a13-8140-547269dad6a5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:46.468438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-06b4e1d9-89af-4a13-8140-547269dad6a5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:46.539773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-06b4e1d9-89af-4a13-8140-547269dad6a5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.104378 Nov 27 21:03:46.540563 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2437/5002] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:46 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:46.696465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:46.697784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:46.715137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:46.716046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:46.717420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:46.717700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:46.855711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:46.856674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:46.877454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:46.879762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:46.883306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:46.885988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:46.985395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:47.000259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:47.001784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:47.002972 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05552291-a0b8-4eec-82c2-f5cc78e8440d tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.312797 Nov 27 21:03:47.021134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2566/5003] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:46 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:47.255707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:47.268462 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-735e118a-36d3-45bd-958a-4892d454ef2e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.417469 Nov 27 21:03:47.271658 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2438/5004] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:46 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:47.556252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-302e9529-4a85-4e9a-b16e-393f84dbf921 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:47.557510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-302e9529-4a85-4e9a-b16e-393f84dbf921 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:47.580026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-302e9529-4a85-4e9a-b16e-393f84dbf921 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:47.581100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-302e9529-4a85-4e9a-b16e-393f84dbf921 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:47.582282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-302e9529-4a85-4e9a-b16e-393f84dbf921 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:47.582733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-302e9529-4a85-4e9a-b16e-393f84dbf921 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:47.670370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-302e9529-4a85-4e9a-b16e-393f84dbf921 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.121633 Nov 27 21:03:47.673155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2567/5005] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:47 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:47.749862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-30249ffc-42ac-411a-8f9f-4971fedd299f req-9e79855f-f164-4788-93b0-f0131a0fbe30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8", "name": "network-vif-plugged", "status": "completed", "tag": "d3d58283-44aa-49b4-8ef5-5f49cb82acda"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:47.752722 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:03:47.752722 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:03:47.775940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-30249ffc-42ac-411a-8f9f-4971fedd299f req-9e79855f-f164-4788-93b0-f0131a0fbe30 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:47.777470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-30249ffc-42ac-411a-8f9f-4971fedd299f req-9e79855f-f164-4788-93b0-f0131a0fbe30 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:47.792636 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-30249ffc-42ac-411a-8f9f-4971fedd299f req-9e79855f-f164-4788-93b0-f0131a0fbe30 service nova] Creating event network-vif-plugged:d3d58283-44aa-49b4-8ef5-5f49cb82acda for instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 on nch1-master-1 Nov 27 21:03:47.801561 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-30249ffc-42ac-411a-8f9f-4971fedd299f req-9e79855f-f164-4788-93b0-f0131a0fbe30 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057893 Nov 27 21:03:47.802763 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2439/5006] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:03:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:03:48.038600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:48.039307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:48.049773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:48.051218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:48.052672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:48.053292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:48.289994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:48.291577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:48.312819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:48.318048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:48.325647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:48.326966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:48.422449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:48.439356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:48.441213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:48.445646 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03af5430-26df-4cce-9911-811f4cdc3a1a tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.411678 Nov 27 21:03:48.451379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2568/5007] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:48 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:48.685545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b108263b-a689-4215-b797-ed52db83580a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:48.686845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b108263b-a689-4215-b797-ed52db83580a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:48.704525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b108263b-a689-4215-b797-ed52db83580a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:48.705586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b108263b-a689-4215-b797-ed52db83580a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:48.711565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b108263b-a689-4215-b797-ed52db83580a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:48.712389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b108263b-a689-4215-b797-ed52db83580a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:48.806035 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b108263b-a689-4215-b797-ed52db83580a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.124678 Nov 27 21:03:48.806720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2569/5008] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:48 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:48.903737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:48.920962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c04132b-2d7e-4182-b683-b968e0a664d6 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.636971 Nov 27 21:03:48.933700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2440/5009] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:48 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:49.481464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:49.483317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:49.503317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:49.515733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:49.519698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:49.520169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:49.717700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:49.736378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:49.740052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:49.743900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28dbdfa9-747b-4c42-a895-3cb9140b938e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.266987 Nov 27 21:03:49.746992 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2570/5010] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:49 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:49.818365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e591862f-6529-488a-8f2d-4569381c5fc6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:49.819483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e591862f-6529-488a-8f2d-4569381c5fc6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:49.844048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e591862f-6529-488a-8f2d-4569381c5fc6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:49.845487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e591862f-6529-488a-8f2d-4569381c5fc6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:49.849565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e591862f-6529-488a-8f2d-4569381c5fc6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:49.850046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e591862f-6529-488a-8f2d-4569381c5fc6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:49.939967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:49.940752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:49.956883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:49.963732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:49.973929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:49.974457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:50.018219 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e591862f-6529-488a-8f2d-4569381c5fc6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.203504 Nov 27 21:03:50.018918 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2441/5011] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:49 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:03:50.474094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:50.481917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3611aa99-a26e-4f8e-ae76-c68386fa8d8a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.546040 Nov 27 21:03:50.486700 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2571/5012] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:49 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:50.767021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:50.768304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:50.793115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:50.795866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:50.804396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:50.805063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:50.933171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:50.944301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:50.956727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:50.960452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3bf8ff50-da3e-4842-a497-bb597e59b281 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.198381 Nov 27 21:03:50.971407 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2442/5013] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:50 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:51.032317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e478e6d8-0d3c-46ff-be32-0f97d6d3bf5f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:51.033603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e478e6d8-0d3c-46ff-be32-0f97d6d3bf5f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:51.049952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e478e6d8-0d3c-46ff-be32-0f97d6d3bf5f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:51.051313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e478e6d8-0d3c-46ff-be32-0f97d6d3bf5f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:51.057637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e478e6d8-0d3c-46ff-be32-0f97d6d3bf5f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:51.058417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e478e6d8-0d3c-46ff-be32-0f97d6d3bf5f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:51.159323 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e478e6d8-0d3c-46ff-be32-0f97d6d3bf5f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.131256 Nov 27 21:03:51.166940 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2572/5014] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:51 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:51.511085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:51.511803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:51.532111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:51.532895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:51.533953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:51.534573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:51.982745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:51.986474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:51.999996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:52.003054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:52.009302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:52.009953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:52.130623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:52.151443 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee6bc614-539e-48b4-bf1d-071b30a21e8b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.652308 Nov 27 21:03:52.162373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2443/5015] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:51 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:52.174363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-76cdbcc4-29a9-4a63-8646-3ebacb852232 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:52.175400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-76cdbcc4-29a9-4a63-8646-3ebacb852232 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:52.189305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76cdbcc4-29a9-4a63-8646-3ebacb852232 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:52.189775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76cdbcc4-29a9-4a63-8646-3ebacb852232 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:52.190583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76cdbcc4-29a9-4a63-8646-3ebacb852232 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:52.191030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76cdbcc4-29a9-4a63-8646-3ebacb852232 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:52.210278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:52.225441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:52.235699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:52.242410 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0fa9d15c-bd7d-4570-9176-8d68aee69283 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.262856 Nov 27 21:03:52.246416 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2573/5016] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:51 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:52.360168 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-76cdbcc4-29a9-4a63-8646-3ebacb852232 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.189371 Nov 27 21:03:52.364530 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2444/5017] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:52 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:53.170232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:53.170832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:53.180610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:53.184007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:53.185432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:53.187150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:53.267119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:53.268299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:53.341263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:53.347580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:53.348718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:53.354931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:53.551929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:53.563203 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ccdfc30-effe-43d6-a606-0d950e45fae8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.396506 Nov 27 21:03:53.569483 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2574/5018] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:53 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:53.597844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5fd1117-256f-4865-ab82-da6e377be792 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:53.601191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5fd1117-256f-4865-ab82-da6e377be792 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:53.622074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:53.626067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5fd1117-256f-4865-ab82-da6e377be792 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:53.626554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5fd1117-256f-4865-ab82-da6e377be792 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:53.627403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5fd1117-256f-4865-ab82-da6e377be792 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:53.627848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5fd1117-256f-4865-ab82-da6e377be792 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:53.641522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:53.644317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:53.646605 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bbec127e-04b3-41bd-b406-62f590916e82 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.383885 Nov 27 21:03:53.647781 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2445/5019] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:53 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:53.723530 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5fd1117-256f-4865-ab82-da6e377be792 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.149968 Nov 27 21:03:53.732229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2575/5020] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:53 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:54.586140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:54.586800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:54.608434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:54.609439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:54.611416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:54.611873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:54.672354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:54.673379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:54.691508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:54.702220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:54.704286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:54.704995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:54.949688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:54.961966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:54.969728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:54.975201 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6898a916-764e-4691-b494-63dbb83bced8 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.308421 Nov 27 21:03:54.999051 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2576/5021] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:54 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:03:55.011644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-017649f8-d316-4ebb-819f-0a8b8ba9445a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:55.013950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-017649f8-d316-4ebb-819f-0a8b8ba9445a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:55.027228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017649f8-d316-4ebb-819f-0a8b8ba9445a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:55.028240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017649f8-d316-4ebb-819f-0a8b8ba9445a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:55.031169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017649f8-d316-4ebb-819f-0a8b8ba9445a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:55.032664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017649f8-d316-4ebb-819f-0a8b8ba9445a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:55.126509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-017649f8-d316-4ebb-819f-0a8b8ba9445a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.125885 Nov 27 21:03:55.128074 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2577/5022] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:54 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:55.212230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:55.230440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0e1c9fb-87f1-4e51-b15a-0674a0949ddb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.648342 Nov 27 21:03:55.231129 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2446/5023] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:54 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:56.003762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:56.003762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:56.009461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:56.009922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:56.010735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:56.011479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:56.118948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:56.136364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:56.137976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d7758c4-5af5-4aed-8313-1d13f107f7c9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:56.138931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d7758c4-5af5-4aed-8313-1d13f107f7c9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:56.140283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:56.141911 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0c88650-f926-4d18-a33f-685f79f31c96 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.149373 Nov 27 21:03:56.144105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2578/5024] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:55 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:56.158003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d7758c4-5af5-4aed-8313-1d13f107f7c9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:56.158769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d7758c4-5af5-4aed-8313-1d13f107f7c9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:56.160042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d7758c4-5af5-4aed-8313-1d13f107f7c9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:56.160737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d7758c4-5af5-4aed-8313-1d13f107f7c9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:56.229490 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d7758c4-5af5-4aed-8313-1d13f107f7c9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.094897 Nov 27 21:03:56.231991 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2447/5025] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:56 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:56.249314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:56.250299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:56.262861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:56.263370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:56.264178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:56.264618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:56.569598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:56.581701 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60176996-842f-4e8a-970a-bf75127bbaf7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.337440 Nov 27 21:03:56.583813 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2579/5026] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:56 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:57.163472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:57.168667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:57.184299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:57.185648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:57.187320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:57.214516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:57.243149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21e011c4-c088-449f-b20f-5a83b8d3d81f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:57.244194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21e011c4-c088-449f-b20f-5a83b8d3d81f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:57.258996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e011c4-c088-449f-b20f-5a83b8d3d81f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:57.260099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e011c4-c088-449f-b20f-5a83b8d3d81f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:57.263080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e011c4-c088-449f-b20f-5a83b8d3d81f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:57.263974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e011c4-c088-449f-b20f-5a83b8d3d81f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:57.395504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21e011c4-c088-449f-b20f-5a83b8d3d81f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.156581 Nov 27 21:03:57.400093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2580/5027] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:57 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:57.488824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:57.510597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:57.516893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:57.519455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b010c56-9b83-4515-87d9-18bdc4aeb890 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.361100 Nov 27 21:03:57.520934 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2448/5028] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:57 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:57.601738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:57.603874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:57.614718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:57.615174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:57.616010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:57.616455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:57.864111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:57.875759 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20c80427-1440-4c79-9053-4259bad09a60 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.278729 Nov 27 21:03:57.886557 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2581/5029] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:57 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:58.417897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2a2dd95-7a95-4e9d-a01e-b997aa22cf90 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:58.420772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2a2dd95-7a95-4e9d-a01e-b997aa22cf90 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:58.442009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd95-7a95-4e9d-a01e-b997aa22cf90 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:58.442834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd95-7a95-4e9d-a01e-b997aa22cf90 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:58.444847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd95-7a95-4e9d-a01e-b997aa22cf90 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:58.446562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2a2dd95-7a95-4e9d-a01e-b997aa22cf90 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:58.541184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:58.542412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:58.545727 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2a2dd95-7a95-4e9d-a01e-b997aa22cf90 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.139962 Nov 27 21:03:58.550506 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2449/5030] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:58 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:03:58.556758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:58.558591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:58.559745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:58.563510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:58.893556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:03:58.894412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:58.913516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:58.914485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:58.916096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:58.918041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:58.982720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:59.004134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:59.011777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:59.012985 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e402086-3b89-43a6-997c-4483792f0d32 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.477731 Nov 27 21:03:59.014097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2582/5031] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:03:58 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:03:59.258174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:03:59.268832 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c22ebaaa-b21b-4f9d-8216-fde6d7c44c41 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.379292 Nov 27 21:03:59.270200 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2450/5032] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:03:58 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:03:59.557944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d969da70-32cb-4d14-9be9-74c9ca3b0c22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:03:59.558646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d969da70-32cb-4d14-9be9-74c9ca3b0c22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:03:59.566727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d969da70-32cb-4d14-9be9-74c9ca3b0c22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:59.568404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d969da70-32cb-4d14-9be9-74c9ca3b0c22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:59.572749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d969da70-32cb-4d14-9be9-74c9ca3b0c22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:03:59.573452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d969da70-32cb-4d14-9be9-74c9ca3b0c22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:03:59.647845 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d969da70-32cb-4d14-9be9-74c9ca3b0c22 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.094243 Nov 27 21:03:59.649272 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2583/5033] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:03:59 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:00.034071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:00.034693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:00.046428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:00.049783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:00.050874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:00.051380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:00.155203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:00.168936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:00.175007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:00.177672 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-263996ed-61e6-460f-be15-68bd45a4f849 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.147341 Nov 27 21:04:00.178444 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2451/5034] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:00 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:04:00.290343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:00.290343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:00.310971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:00.311608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:00.312537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:00.313569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:00.604391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:00.615261 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47982153-2c64-407c-a90f-b964a6e1cf4c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.332285 Nov 27 21:04:00.617124 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2584/5035] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:00 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:00.659658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-edfde525-2c3b-4e98-95ad-3ccefb647d03 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:00.660884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-edfde525-2c3b-4e98-95ad-3ccefb647d03 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:00.673609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edfde525-2c3b-4e98-95ad-3ccefb647d03 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:00.674454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edfde525-2c3b-4e98-95ad-3ccefb647d03 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:00.675584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edfde525-2c3b-4e98-95ad-3ccefb647d03 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:00.676284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edfde525-2c3b-4e98-95ad-3ccefb647d03 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:00.755968 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-edfde525-2c3b-4e98-95ad-3ccefb647d03 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.100245 Nov 27 21:04:00.756886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2452/5036] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:00 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:01.207817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:01.212267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:01.228732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:01.229856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:01.231420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:01.232085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:01.337403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:01.349567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:01.357363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:01.359989 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42b9c52d-13b2-44bc-8e37-763cf7e568db tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1408 microversion: 2.54 time: 0.162983 Nov 27 21:04:01.363024 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2585/5037] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:01 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:01.635242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:01.636052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:01.656063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:01.656841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:01.659215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:01.662555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:01.769104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-901a0bc3-d9bb-4cf7-8a09-b5cddb3db67a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:01.770211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-901a0bc3-d9bb-4cf7-8a09-b5cddb3db67a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:01.781279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-901a0bc3-d9bb-4cf7-8a09-b5cddb3db67a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:01.787011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-901a0bc3-d9bb-4cf7-8a09-b5cddb3db67a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:01.788290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-901a0bc3-d9bb-4cf7-8a09-b5cddb3db67a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:01.788949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-901a0bc3-d9bb-4cf7-8a09-b5cddb3db67a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:01.882380 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-901a0bc3-d9bb-4cf7-8a09-b5cddb3db67a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.116554 Nov 27 21:04:01.884426 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2586/5038] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:01 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:02.258041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:02.293690 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6c57753-89d3-404e-9207-71a94811b6fb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.639848 Nov 27 21:04:02.312717 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2453/5039] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:01 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:02.382390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:02.383407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:02.394225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:02.394486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:02.399161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:02.406993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:02.585875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:02.598302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:02.601140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:02.604474 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b40d31af-5067-45b3-90a9-0718b923dff9 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1414 microversion: 2.54 time: 0.226140 Nov 27 21:04:02.605275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2587/5040] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:02 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1414 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:04:02.896536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6cae5ca5-4a5a-4191-a1f7-5b41ec12cf36 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:02.897629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6cae5ca5-4a5a-4191-a1f7-5b41ec12cf36 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:02.912019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cae5ca5-4a5a-4191-a1f7-5b41ec12cf36 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:02.912616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cae5ca5-4a5a-4191-a1f7-5b41ec12cf36 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:02.913601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cae5ca5-4a5a-4191-a1f7-5b41ec12cf36 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:02.914931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cae5ca5-4a5a-4191-a1f7-5b41ec12cf36 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:02.969163 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6cae5ca5-4a5a-4191-a1f7-5b41ec12cf36 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.077461 Nov 27 21:04:02.970119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2454/5041] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:02 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:03.318626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:03.319227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:03.336793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:03.337218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:03.340514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:03.340983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:03.548400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:03.598250 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8333b033-c1a9-44ce-8d8b-39277ede5e6f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1527 microversion: 2.1 time: 0.280668 Nov 27 21:04:03.599211 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2588/5042] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:03 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1527 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:03.625788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:03.626511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:03.636253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:03.636713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:03.637517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:03.644025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:03.766603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:03.777014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:03.778728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:03.780303 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11f2ddd5-654a-4d92-9f4f-812bada9c375 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1414 microversion: 2.54 time: 0.159227 Nov 27 21:04:03.795414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2455/5043] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:03 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1414 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:03.983718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1ac9e2c-8442-45eb-8f3f-a3fb292c73e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:03.985145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1ac9e2c-8442-45eb-8f3f-a3fb292c73e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:03.991360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1ac9e2c-8442-45eb-8f3f-a3fb292c73e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:03.991819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1ac9e2c-8442-45eb-8f3f-a3fb292c73e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:03.992663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1ac9e2c-8442-45eb-8f3f-a3fb292c73e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:03.993103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1ac9e2c-8442-45eb-8f3f-a3fb292c73e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:04.052016 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1ac9e2c-8442-45eb-8f3f-a3fb292c73e7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.071258 Nov 27 21:04:04.058365 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2589/5044] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:03 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:04.616196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:04.616812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:04.624486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:04.624938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:04.625735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:04.626175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:04.784378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:04.794023 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77e03d8a-0034-4934-8f77-2358e67d39be tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1509 microversion: 2.1 time: 0.181247 Nov 27 21:04:04.796556 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2456/5045] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:04 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:04.801514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:04.803570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:04.812628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:04.813606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:04.814772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:04.815629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:04.915735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:04.928049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:04.930875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:04.932386 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6d5bd38-c447-48fd-bfdb-ea0dafad12cc tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1414 microversion: 2.54 time: 0.136560 Nov 27 21:04:04.942564 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2590/5046] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:04 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:04:05.070634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34eb7f77-4d7c-480f-8053-a0f304072670 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:05.071622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34eb7f77-4d7c-480f-8053-a0f304072670 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:05.081218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eb7f77-4d7c-480f-8053-a0f304072670 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:05.081218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eb7f77-4d7c-480f-8053-a0f304072670 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:05.081218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eb7f77-4d7c-480f-8053-a0f304072670 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:05.081218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34eb7f77-4d7c-480f-8053-a0f304072670 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:05.138194 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34eb7f77-4d7c-480f-8053-a0f304072670 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.072335 Nov 27 21:04:05.148506 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2457/5047] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:05 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:05.813684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:05.814315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:05.821596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:05.822047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:05.822933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:05.823437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:05.966472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:05.967183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:05.974971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:05.975450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:05.976680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:05.977291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:06.034708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:06.042371 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-400fa8ca-98db-4494-ae09-90e3c18c0984 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1509 microversion: 2.1 time: 0.232385 Nov 27 21:04:06.045352 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2591/5048] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:05 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:06.080938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:06.092488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:06.094169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:06.095554 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-999b469d-a09a-447b-90d8-f0afaf241cda tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1399 microversion: 2.54 time: 0.134759 Nov 27 21:04:06.096691 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2458/5049] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:05 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1399 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:06.114682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5cff16d6-2826-4bd4-a1a7-04b339e48418 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '.version_select at 0x7f15d93a1d30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:06.143523 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5cff16d6-2826-4bd4-a1a7-04b339e48418 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-194026870" status: 204 len: 0 microversion: 2.54 time: 0.032776 Nov 27 21:04:06.144699 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2592/5050] 10.222.0.21 () {60 vars in 1315 bytes} [Sat Nov 27 21:04:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-194026870 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:04:06.159199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6304c480-5267-4e4e-9fc9-223c9a992146 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:06.160244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6304c480-5267-4e4e-9fc9-223c9a992146 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:06.185305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6304c480-5267-4e4e-9fc9-223c9a992146 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:06.185817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6304c480-5267-4e4e-9fc9-223c9a992146 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:06.186525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6304c480-5267-4e4e-9fc9-223c9a992146 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:06.186893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6304c480-5267-4e4e-9fc9-223c9a992146 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:06.190975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:06.192483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:06.200032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:06.200965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:06.202208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:06.202886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:06.247720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:04:06.274564 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6304c480-5267-4e4e-9fc9-223c9a992146 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.121098 Nov 27 21:04:06.279657 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2459/5051] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:06 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:06.398522 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c531953-dc05-40d7-8434-8f0d613cba9e tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 204 len: 0 microversion: 2.1 time: 0.232368 Nov 27 21:04:06.399206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2593/5052] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:04:06 2021] DELETE /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:04:06.408242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:06.409321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:06.418470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:06.419425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:06.420466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:06.421100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:06.506435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:06.514781 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a35aa982-9499-4615-bb63-fec51ed6c3af tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1339 microversion: 2.1 time: 0.110813 Nov 27 21:04:06.515712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2460/5053] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:06 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:07.037853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-341c693e-484a-45a9-8af4-87c6ada1fc4c req-09aad623-6187-4ff3-803b-cde046c925aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8", "name": "network-vif-unplugged", "status": "completed", "tag": "d3d58283-44aa-49b4-8ef5-5f49cb82acda"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:07.041412 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:07.041412 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:04:07.063720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:07.064589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:07.070615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-341c693e-484a-45a9-8af4-87c6ada1fc4c req-09aad623-6187-4ff3-803b-cde046c925aa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.071127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-341c693e-484a-45a9-8af4-87c6ada1fc4c req-09aad623-6187-4ff3-803b-cde046c925aa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.079802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.080256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.081137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.081592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.097810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_external_events [req-341c693e-484a-45a9-8af4-87c6ada1fc4c req-09aad623-6187-4ff3-803b-cde046c925aa service nova] Unable to find a host for instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8. Dropping event network-vif-unplugged {{(pid=135680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 21:04:07.099172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-341c693e-484a-45a9-8af4-87c6ada1fc4c req-09aad623-6187-4ff3-803b-cde046c925aa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066121 Nov 27 21:04:07.100316 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2594/5054] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:07 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 21:04:07.278400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:07.292369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0a019e7-253d-4b47-b3c7-129d70654752 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:07.292585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4aa30e71-fad7-41d7-ae8a-345e9bfcd904 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1452 microversion: 2.1 time: 0.234603 Nov 27 21:04:07.301882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2461/5055] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:07 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1452 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:07.303199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b0a019e7-253d-4b47-b3c7-129d70654752 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:07.310155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0a019e7-253d-4b47-b3c7-129d70654752 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.310623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0a019e7-253d-4b47-b3c7-129d70654752 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.311493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0a019e7-253d-4b47-b3c7-129d70654752 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.312129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0a019e7-253d-4b47-b3c7-129d70654752 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.314523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:07.315293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:07.324845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.325551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.326933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.327713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.371329 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0a019e7-253d-4b47-b3c7-129d70654752 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.083359 Nov 27 21:04:07.372646 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2595/5056] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:07 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:07.533414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:07.534288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:07.539238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:07.543496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.544066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.545271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.545823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.546770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56dd21ec-903a-4c3f-860c-36630d561331 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1452 microversion: 2.1 time: 0.239332 Nov 27 21:04:07.561917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2462/5057] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:07 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1452 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:07.603246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:07.604076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:07.610425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.610903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.611757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.612373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.638286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lazy-loading 'flavor' on Instance uuid d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:04:07.651227 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Cannot 'shelve' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state shelved_offloaded Nov 27 21:04:07.651871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 409 to user: Cannot 'shelve' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state shelved_offloaded {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:07.652718 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af090028-87c2-4b71-a619-0bc834220948 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 409 len: 155 microversion: 2.1 time: 0.053283 Nov 27 21:04:07.656743 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2463/5058] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:07 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 155 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 27 21:04:07.662329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e60c2ab5-fc31-40ca-b6d8-06eb3b6454e8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:07.662888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:07.672926 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3829ea1c-3a7c-45fd-9696-93e104b8cd50 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1339 microversion: 2.1 time: 0.144008 Nov 27 21:04:07.674907 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2596/5059] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:07 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:07.676641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e60c2ab5-fc31-40ca-b6d8-06eb3b6454e8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:07.690024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60c2ab5-fc31-40ca-b6d8-06eb3b6454e8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.690942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60c2ab5-fc31-40ca-b6d8-06eb3b6454e8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.692030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60c2ab5-fc31-40ca-b6d8-06eb3b6454e8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.692657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60c2ab5-fc31-40ca-b6d8-06eb3b6454e8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.916670 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e60c2ab5-fc31-40ca-b6d8-06eb3b6454e8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 202 len: 0 microversion: 2.1 time: 0.258362 Nov 27 21:04:07.917554 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2464/5060] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:07 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:07.927473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:07.928586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:07.938848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.939786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:07.941337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:07.941965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:08.207976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:08.219158 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ce54e46-b5a1-4d76-9309-f5fa1b67085a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1460 microversion: 2.1 time: 0.297197 Nov 27 21:04:08.220304 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2597/5061] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:07 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1460 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:08.397244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2adbfdb4-5257-4394-af46-0ae829a03dbd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:08.400770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2adbfdb4-5257-4394-af46-0ae829a03dbd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:08.407078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2adbfdb4-5257-4394-af46-0ae829a03dbd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:08.407761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2adbfdb4-5257-4394-af46-0ae829a03dbd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:08.408772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2adbfdb4-5257-4394-af46-0ae829a03dbd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:08.409762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2adbfdb4-5257-4394-af46-0ae829a03dbd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:08.485205 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2adbfdb4-5257-4394-af46-0ae829a03dbd tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.103382 Nov 27 21:04:08.492833 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2465/5062] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:08 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:08.694084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:08.694964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:08.714513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:08.715344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:08.722273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:08.722962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:08.769587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:08.770922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:08.771850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lazy-loading 'fault' on Instance uuid fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:04:08.839553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909441655c7c49d2b68a0a589f5c422b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe5ff330fa94dce90ceb417549101a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:08.852578 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60585d5f-2352-41d2-878c-0dba3b44ab24 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 200 len: 1344 microversion: 2.1 time: 0.162463 Nov 27 21:04:08.853516 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2598/5063] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:08 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 1344 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:09.239632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:09.245041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:09.263113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:09.272160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:09.274213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:09.274720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:09.505471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e23a72c-63a7-4de4-aceb-14b1af42a27b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:09.506405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e23a72c-63a7-4de4-aceb-14b1af42a27b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:09.521319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e23a72c-63a7-4de4-aceb-14b1af42a27b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:09.522055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e23a72c-63a7-4de4-aceb-14b1af42a27b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:09.523567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e23a72c-63a7-4de4-aceb-14b1af42a27b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:09.524537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e23a72c-63a7-4de4-aceb-14b1af42a27b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:09.547646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:09.559619 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9b4f36a-fa77-46d6-9e91-20c8703b2bf8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1462 microversion: 2.1 time: 0.324060 Nov 27 21:04:09.562033 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2466/5064] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:09 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1462 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:09.586280 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e23a72c-63a7-4de4-aceb-14b1af42a27b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.087684 Nov 27 21:04:09.587592 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2599/5065] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:09 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:09.870180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:09.870924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] [instance: fbe3daa1-3daa-4781-a6b5-578d8a3b5e76] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:09.878891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:09.879478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:09.880361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:09.881406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:09.901310 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] HTTP exception thrown: Instance fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 could not be found. Nov 27 21:04:09.902281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] Returning 404 to user: Instance fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:09.903341 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b274e262-fa4c-4b23-8c4a-4a24c90cde62 tempest-ServerShowV254Test-1671545794 tempest-ServerShowV254Test-1671545794-project] 10.222.0.21 "GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76" status: 404 len: 111 microversion: 2.1 time: 0.037894 Nov 27 21:04:09.904003 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2467/5066] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:09 2021] GET /compute/v2.1/servers/fbe3daa1-3daa-4781-a6b5-578d8a3b5e76 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:10.579745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:10.581715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:10.591684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:10.592291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:10.593345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:10.599973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a72c9838-51e5-4259-8c27-2440aefd4ea2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:10.601155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a72c9838-51e5-4259-8c27-2440aefd4ea2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:10.605779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:10.613842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a72c9838-51e5-4259-8c27-2440aefd4ea2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:10.617991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a72c9838-51e5-4259-8c27-2440aefd4ea2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:10.619123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a72c9838-51e5-4259-8c27-2440aefd4ea2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:10.619775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a72c9838-51e5-4259-8c27-2440aefd4ea2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:10.713542 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a72c9838-51e5-4259-8c27-2440aefd4ea2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.118042 Nov 27 21:04:10.714697 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2468/5067] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:10 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:11.040652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:11.051953 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8f7140c-7fdd-4609-9922-d509ebce96a9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.476738 Nov 27 21:04:11.052556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2600/5068] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:10 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:11.394670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e3e989c0-2b12-4975-94b4-870b2e4e091b req-e64080a4-4122-4e60-ac4a-2b1758577e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8", "tag": "d3d58283-44aa-49b4-8ef5-5f49cb82acda"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:11.400715 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:11.400715 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:04:11.411564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e3e989c0-2b12-4975-94b4-870b2e4e091b req-e64080a4-4122-4e60-ac4a-2b1758577e5f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:11.412368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e3e989c0-2b12-4975-94b4-870b2e4e091b req-e64080a4-4122-4e60-ac4a-2b1758577e5f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:11.431555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e3e989c0-2b12-4975-94b4-870b2e4e091b req-e64080a4-4122-4e60-ac4a-2b1758577e5f service nova] Creating event network-changed:d3d58283-44aa-49b4-8ef5-5f49cb82acda for instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 on nch2-master-1 Nov 27 21:04:11.436753 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e3e989c0-2b12-4975-94b4-870b2e4e091b req-e64080a4-4122-4e60-ac4a-2b1758577e5f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054735 Nov 27 21:04:11.437619 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2469/5069] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:11.725488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b45671aa-7a26-410c-8eb6-59394b13ed21 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:11.727096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b45671aa-7a26-410c-8eb6-59394b13ed21 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:11.741441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45671aa-7a26-410c-8eb6-59394b13ed21 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:11.741888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45671aa-7a26-410c-8eb6-59394b13ed21 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:11.742709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45671aa-7a26-410c-8eb6-59394b13ed21 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:11.743144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b45671aa-7a26-410c-8eb6-59394b13ed21 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:11.837612 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b45671aa-7a26-410c-8eb6-59394b13ed21 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.115731 Nov 27 21:04:11.842316 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2601/5070] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:11 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:12.074471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:12.075887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:12.097143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:12.097659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:12.101769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:12.103606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:12.458859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:12.495663 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9c74bc4-f67c-4e2f-8629-bc2513e64dd0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.421121 Nov 27 21:04:12.499474 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2470/5071] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:12 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:12.850975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6622295-4ff8-4da0-9d60-f547f602045f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:12.854892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6622295-4ff8-4da0-9d60-f547f602045f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:12.873992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6622295-4ff8-4da0-9d60-f547f602045f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:12.874809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6622295-4ff8-4da0-9d60-f547f602045f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:12.875953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6622295-4ff8-4da0-9d60-f547f602045f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:12.876809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6622295-4ff8-4da0-9d60-f547f602045f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:12.984504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6622295-4ff8-4da0-9d60-f547f602045f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.137880 Nov 27 21:04:12.985661 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2602/5072] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:12 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:13.525066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:13.525734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:13.553681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:13.556640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:13.560534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:13.563558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:13.998071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a458c93-87da-499c-9a5c-05add80854c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:13.999094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a458c93-87da-499c-9a5c-05add80854c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:14.034375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:14.043503 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c51bfd85-cf3b-404f-b104-4aafdfed388e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.528012 Nov 27 21:04:14.045108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a458c93-87da-499c-9a5c-05add80854c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:14.045605 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2471/5073] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:13 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:14.053538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a458c93-87da-499c-9a5c-05add80854c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:14.056700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a458c93-87da-499c-9a5c-05add80854c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:14.058939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a458c93-87da-499c-9a5c-05add80854c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:14.204492 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a458c93-87da-499c-9a5c-05add80854c1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.211696 Nov 27 21:04:14.206051 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2603/5074] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:13 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:15.063203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:15.064489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:15.080109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:15.080573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:15.081388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:15.081838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:15.216947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0dfc9e3-4f73-4cab-b8e3-f0dcd9324b33 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:15.217970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f0dfc9e3-4f73-4cab-b8e3-f0dcd9324b33 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:15.238130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dfc9e3-4f73-4cab-b8e3-f0dcd9324b33 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:15.239280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dfc9e3-4f73-4cab-b8e3-f0dcd9324b33 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:15.240274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dfc9e3-4f73-4cab-b8e3-f0dcd9324b33 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:15.249029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dfc9e3-4f73-4cab-b8e3-f0dcd9324b33 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:15.397330 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0dfc9e3-4f73-4cab-b8e3-f0dcd9324b33 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.183337 Nov 27 21:04:15.401531 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2604/5075] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:15 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:15.638474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:15.650291 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27392849-e14d-4bf4-8bae-eac2e658bd29 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.590512 Nov 27 21:04:15.650893 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2472/5076] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:15 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:16.414504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f31be0ff-cec8-4b6d-9a7f-4c61d6834119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:16.418304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f31be0ff-cec8-4b6d-9a7f-4c61d6834119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:16.433535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31be0ff-cec8-4b6d-9a7f-4c61d6834119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:16.435907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31be0ff-cec8-4b6d-9a7f-4c61d6834119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:16.437333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31be0ff-cec8-4b6d-9a7f-4c61d6834119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:16.439694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f31be0ff-cec8-4b6d-9a7f-4c61d6834119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:16.638555 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f31be0ff-cec8-4b6d-9a7f-4c61d6834119 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.228569 Nov 27 21:04:16.651344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2605/5077] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:16 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:16.673458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:16.674080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:16.689312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:16.693381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:16.695425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:16.712085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:17.203751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:17.217457 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b68f01f7-8c0d-4ee7-bad1-381d1ffe8b6c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.547292 Nov 27 21:04:17.218678 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2473/5078] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:16 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:17.652817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-761b5bb1-9386-4b44-ae69-3fd02871d9c3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:17.655540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-761b5bb1-9386-4b44-ae69-3fd02871d9c3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:17.682110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-761b5bb1-9386-4b44-ae69-3fd02871d9c3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:17.683482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-761b5bb1-9386-4b44-ae69-3fd02871d9c3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:17.685224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-761b5bb1-9386-4b44-ae69-3fd02871d9c3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:17.686083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-761b5bb1-9386-4b44-ae69-3fd02871d9c3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:17.767923 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-761b5bb1-9386-4b44-ae69-3fd02871d9c3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.120409 Nov 27 21:04:17.775040 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2606/5079] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:17 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:18.245566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:18.246241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:18.259481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:18.260930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:18.261775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:18.262248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:18.560677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:18.577620 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f4b3127-bb52-459f-8a15-debfe9ac0604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.335712 Nov 27 21:04:18.579553 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2474/5080] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:18 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:18.782611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00965a73-c17d-4428-adcc-ce2cd9b23318 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:18.784454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00965a73-c17d-4428-adcc-ce2cd9b23318 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:18.798640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00965a73-c17d-4428-adcc-ce2cd9b23318 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:18.799862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00965a73-c17d-4428-adcc-ce2cd9b23318 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:18.802455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00965a73-c17d-4428-adcc-ce2cd9b23318 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:18.804134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00965a73-c17d-4428-adcc-ce2cd9b23318 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:18.915005 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00965a73-c17d-4428-adcc-ce2cd9b23318 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.136404 Nov 27 21:04:18.916886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2607/5081] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:18 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:19.380737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-999013268", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "60372a06-7f1e-4c49-9e10-b019a24c919f"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:19.570963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] validate_networks() for [('60372a06-7f1e-4c49-9e10-b019a24c919f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:04:19.598976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:19.599649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:19.615375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:19.615982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:19.617383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:19.617839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:20.121252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:20.152621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9985a3c6-6950-44e5-b2e4-308ed328b82b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.558026 Nov 27 21:04:20.153291 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2608/5082] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:19 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:20.165330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78def20d-28b8-4506-8fd7-d5f00d2a097d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:20.190787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78def20d-28b8-4506-8fd7-d5f00d2a097d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:20.203457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78def20d-28b8-4506-8fd7-d5f00d2a097d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:20.206739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78def20d-28b8-4506-8fd7-d5f00d2a097d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:20.209493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78def20d-28b8-4506-8fd7-d5f00d2a097d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:20.210214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78def20d-28b8-4506-8fd7-d5f00d2a097d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:20.268909 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78def20d-28b8-4506-8fd7-d5f00d2a097d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.114356 Nov 27 21:04:20.270963 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2609/5083] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:20 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:20.420661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:04:20.423352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:04:20.425164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:04:20.426005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:04:20.426643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:04:20.447744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:20.451504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:20.451829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:20.452430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:20.501074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Getting quotas for project 00735fb3099849649f3659ccce46780f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:04:20.524997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Getting quotas for user b1067ef43ad34e12b55a057f063dd099 and project 00735fb3099849649f3659ccce46780f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:04:20.560009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:04:20.565055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:04:20.694234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-851936e2-9b77-4f61-95df-8c9659039daf tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623278 Nov 27 21:04:20.709230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2475/5084] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:04:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:04:20.714945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ccdaf8a-79ed-4d02-a752-639fa9a5b3f4 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:20.715811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ccdaf8a-79ed-4d02-a752-639fa9a5b3f4 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:20.902266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ccdaf8a-79ed-4d02-a752-639fa9a5b3f4 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:20.910976 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ccdaf8a-79ed-4d02-a752-639fa9a5b3f4 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1227 microversion: 2.1 time: 0.202770 Nov 27 21:04:20.916299 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2610/5085] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:20 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1227 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:21.173403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:21.174297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:21.183582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:21.183860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:21.185683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:21.187121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:21.283735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f29ea58b-4606-4a41-a8af-a29d3a39659f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:21.284668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f29ea58b-4606-4a41-a8af-a29d3a39659f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:21.307399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f29ea58b-4606-4a41-a8af-a29d3a39659f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:21.309366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f29ea58b-4606-4a41-a8af-a29d3a39659f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:21.318289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f29ea58b-4606-4a41-a8af-a29d3a39659f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:21.319880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f29ea58b-4606-4a41-a8af-a29d3a39659f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:21.461111 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f29ea58b-4606-4a41-a8af-a29d3a39659f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.177649 Nov 27 21:04:21.464836 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2611/5086] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:21 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:21.577345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:21.589579 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e3b8e74-1fa9-4f50-a5ab-2218a7e28902 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.421467 Nov 27 21:04:21.595619 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2476/5087] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:21 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:21.935316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:21.936391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:21.957403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:21.959765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:21.963077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:21.964133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:22.216296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:22.229105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-685db8f0-6cf5-427b-a4de-7b9e16a4ee81 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1279 microversion: 2.1 time: 0.298903 Nov 27 21:04:22.232636 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2612/5088] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:21 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1279 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:22.479495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a95ae2d6-a666-40cd-bd26-cb6e248542aa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:22.483990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a95ae2d6-a666-40cd-bd26-cb6e248542aa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:22.510481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a95ae2d6-a666-40cd-bd26-cb6e248542aa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:22.515861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a95ae2d6-a666-40cd-bd26-cb6e248542aa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:22.517416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a95ae2d6-a666-40cd-bd26-cb6e248542aa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:22.520886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a95ae2d6-a666-40cd-bd26-cb6e248542aa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:22.609170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:22.610604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:22.640995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:22.642512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:22.651084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:22.653478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:22.706698 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a95ae2d6-a666-40cd-bd26-cb6e248542aa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.239479 Nov 27 21:04:22.728544 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2477/5089] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:22 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:23.259712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:23.261312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:23.276958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:23.278101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:23.279298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:23.279958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:23.397560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:23.397560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f86a2a2-6c8d-4561-b523-d3fdff4e7187 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.738201 Nov 27 21:04:23.397560 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2613/5090] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:22 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:23.473524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:23.494440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a10b22dc-a036-4c18-bc43-a481db71024f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1285 microversion: 2.1 time: 0.244706 Nov 27 21:04:23.499601 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2478/5091] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:23 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:23.743123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-adbca60e-731a-471e-978d-9e1dc7b3f54f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:23.757917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-adbca60e-731a-471e-978d-9e1dc7b3f54f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:23.764938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adbca60e-731a-471e-978d-9e1dc7b3f54f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:23.765387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adbca60e-731a-471e-978d-9e1dc7b3f54f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:23.766228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adbca60e-731a-471e-978d-9e1dc7b3f54f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:23.766711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adbca60e-731a-471e-978d-9e1dc7b3f54f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:23.926409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-adbca60e-731a-471e-978d-9e1dc7b3f54f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.183622 Nov 27 21:04:23.929918 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2614/5092] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:23 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:24.362576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:24.363916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:24.375073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:24.385171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:24.387919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:24.388493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:24.520470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:24.521548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:24.549743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:24.550675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:24.553269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:24.553983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:25.387603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:25.404171 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-694b9a64-94e1-4e5b-af93-90d97384613f tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.891207 Nov 27 21:04:25.421557 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2615/5093] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:24 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:25.438783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05c0b2f8-7778-4c3f-8582-7c78c730cba7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:25.440154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05c0b2f8-7778-4c3f-8582-7c78c730cba7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:25.465941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05c0b2f8-7778-4c3f-8582-7c78c730cba7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:25.466675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05c0b2f8-7778-4c3f-8582-7c78c730cba7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:25.471163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05c0b2f8-7778-4c3f-8582-7c78c730cba7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:25.472531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05c0b2f8-7778-4c3f-8582-7c78c730cba7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:25.566296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:25.583462 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3dd0f288-b001-4e38-bd61-c670a13a6dd3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 1.224461 Nov 27 21:04:25.585986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2479/5094] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:24 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:25.619107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05c0b2f8-7778-4c3f-8582-7c78c730cba7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.195834 Nov 27 21:04:25.624219 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2616/5095] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:25 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:26.421916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:26.422533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:26.437866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:26.438306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:26.439325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:26.440204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:26.454755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-45e2ed3b-e005-431e-9bd5-9cc214bab4bc req-49a10527-7f6e-4685-af9e-24dcd8872955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d", "tag": "af22aa46-5e09-4ef8-9e39-a83bde137164"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:26.457165 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:26.457165 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:04:26.468094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-45e2ed3b-e005-431e-9bd5-9cc214bab4bc req-49a10527-7f6e-4685-af9e-24dcd8872955 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:26.468458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-45e2ed3b-e005-431e-9bd5-9cc214bab4bc req-49a10527-7f6e-4685-af9e-24dcd8872955 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:26.483332 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-45e2ed3b-e005-431e-9bd5-9cc214bab4bc req-49a10527-7f6e-4685-af9e-24dcd8872955 service nova] Creating event network-changed:af22aa46-5e09-4ef8-9e39-a83bde137164 for instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d on nch1-master-1 Nov 27 21:04:26.488921 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-45e2ed3b-e005-431e-9bd5-9cc214bab4bc req-49a10527-7f6e-4685-af9e-24dcd8872955 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038406 Nov 27 21:04:26.489594 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2617/5096] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:26.614733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:26.616006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:26.627821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:26.631671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:26.632252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:26.633124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:26.633885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:26.640863 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-204462e5-16bc-4773-b83f-a7435bf3d007 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.222830 Nov 27 21:04:26.641740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2480/5097] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:26 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:26.661402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-09ebb08a-2e35-49c9-867e-cbe90152472f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:26.664405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-09ebb08a-2e35-49c9-867e-cbe90152472f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:26.682138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09ebb08a-2e35-49c9-867e-cbe90152472f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:26.682909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09ebb08a-2e35-49c9-867e-cbe90152472f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:26.684373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09ebb08a-2e35-49c9-867e-cbe90152472f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:26.684888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09ebb08a-2e35-49c9-867e-cbe90152472f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:26.743890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-09ebb08a-2e35-49c9-867e-cbe90152472f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.089353 Nov 27 21:04:26.745079 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2481/5098] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:26 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:26.922727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:26.932106 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89cc3402-24af-41b2-a7d7-794a87080ab3 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.323277 Nov 27 21:04:26.933181 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2618/5099] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:26 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:27.660282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:27.661226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:27.670787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:27.671374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:27.672273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:27.672792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:27.756205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1bdc3f89-43e9-4c97-931c-e767886564d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:27.757381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1bdc3f89-43e9-4c97-931c-e767886564d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:27.765280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bdc3f89-43e9-4c97-931c-e767886564d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:27.765932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bdc3f89-43e9-4c97-931c-e767886564d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:27.766728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bdc3f89-43e9-4c97-931c-e767886564d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:27.767368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bdc3f89-43e9-4c97-931c-e767886564d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:27.814819 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1bdc3f89-43e9-4c97-931c-e767886564d1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.062151 Nov 27 21:04:27.818953 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2619/5100] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:27 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:27.917933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:27.925776 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fced0438-f9f9-4221-b26b-6bc37130b7bb tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.271560 Nov 27 21:04:27.935623 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2482/5101] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:27 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:27.951587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:27.952477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:27.960918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:27.961404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:27.962357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:27.962800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:28.208768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:28.219226 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-699bc21f-0bf4-463e-a9f2-73ae4aa7f29a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.273289 Nov 27 21:04:28.219886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2620/5102] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:27 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:28.826708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0cbffab-8bc8-4f6f-9e8a-c3e5194ea85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:28.827705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a0cbffab-8bc8-4f6f-9e8a-c3e5194ea85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:28.835881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0cbffab-8bc8-4f6f-9e8a-c3e5194ea85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:28.836574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0cbffab-8bc8-4f6f-9e8a-c3e5194ea85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:28.837385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0cbffab-8bc8-4f6f-9e8a-c3e5194ea85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:28.837831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0cbffab-8bc8-4f6f-9e8a-c3e5194ea85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:28.887691 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0cbffab-8bc8-4f6f-9e8a-c3e5194ea85e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.064691 Nov 27 21:04:28.888595 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2483/5103] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:28 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:28.943001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:28.943738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:28.951227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:28.951795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:28.952670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:28.953214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:29.120199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:29.128696 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d840fcad-4657-4404-8d79-544b99884ed2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.189301 Nov 27 21:04:29.129298 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2621/5104] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:28 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:29.239568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:29.240275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:29.248169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:29.248631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:29.249423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:29.249864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:29.453044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:29.474256 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a255901-0212-42e6-aceb-db1b75126abb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.238726 Nov 27 21:04:29.477165 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2484/5105] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:29 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:29.900933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b768bd7-d940-4b3a-a68b-35aa5b64bae1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:29.902552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b768bd7-d940-4b3a-a68b-35aa5b64bae1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:29.910976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b768bd7-d940-4b3a-a68b-35aa5b64bae1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:29.911559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b768bd7-d940-4b3a-a68b-35aa5b64bae1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:29.912517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b768bd7-d940-4b3a-a68b-35aa5b64bae1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:29.913147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b768bd7-d940-4b3a-a68b-35aa5b64bae1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:29.969804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b768bd7-d940-4b3a-a68b-35aa5b64bae1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.073598 Nov 27 21:04:29.972297 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2622/5106] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:29 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:30.146372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:30.146990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:30.153456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:30.154154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:30.154950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:30.155414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:30.381454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:30.394036 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1dbf30de-5f49-46b6-b8a1-0231d011e581 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.252140 Nov 27 21:04:30.394986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2485/5107] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:30 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:30.502099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:30.504681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:30.520823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:30.527499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:30.529045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:30.529663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:30.838800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:30.848791 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-966673be-3dd4-4853-901b-dc82e8df0f6e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.357541 Nov 27 21:04:30.849430 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2623/5108] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:30 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:30.988651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e822964-c51e-4c65-b645-b8a7064b1d8e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:30.990292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e822964-c51e-4c65-b645-b8a7064b1d8e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:31.010001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e822964-c51e-4c65-b645-b8a7064b1d8e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:31.010538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e822964-c51e-4c65-b645-b8a7064b1d8e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:31.011399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e822964-c51e-4c65-b645-b8a7064b1d8e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:31.012078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e822964-c51e-4c65-b645-b8a7064b1d8e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:31.071691 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e822964-c51e-4c65-b645-b8a7064b1d8e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.091842 Nov 27 21:04:31.073028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2486/5109] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:30 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:31.411303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:31.412215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:31.426212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:31.426947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:31.428303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:31.430468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:31.837007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:31.845797 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-626fae45-ecf3-4ab3-9d39-980714c99c01 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.438626 Nov 27 21:04:31.846831 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2624/5110] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:31 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:31.866930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:31.867661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:31.875551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:31.876010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:31.876984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:31.877427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:32.074913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:32.083690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b1c8b18-4a83-4f69-8832-81f67ddef340 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:32.084651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b1c8b18-4a83-4f69-8832-81f67ddef340 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:32.094399 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e75e589-8f2c-4a4d-a06e-e0d5da10007a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.232017 Nov 27 21:04:32.098539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b1c8b18-4a83-4f69-8832-81f67ddef340 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:32.099035 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2487/5111] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:31 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:32.099708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b1c8b18-4a83-4f69-8832-81f67ddef340 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:32.101232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b1c8b18-4a83-4f69-8832-81f67ddef340 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:32.101671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b1c8b18-4a83-4f69-8832-81f67ddef340 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:32.150216 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b1c8b18-4a83-4f69-8832-81f67ddef340 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.069717 Nov 27 21:04:32.150869 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2625/5112] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:32 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:32.849873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:32.850702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:32.859705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:32.860245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:32.861822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:32.862265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:32.863414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:32.864892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:32.874686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:32.876163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:32.877353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:32.878280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:32.896752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:04:32.989603 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6fde4d83-060e-4555-b387-de839e9c9d48 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "DELETE /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 204 len: 0 microversion: 2.42 time: 0.142249 Nov 27 21:04:32.990549 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2488/5113] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 21:04:32 2021] DELETE /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:04:33.003297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:33.004495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:33.012366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:33.013109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:33.014089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:33.014727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:33.252273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:33.265310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:33.267630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:33.269309 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ae71d717-6d39-4209-a731-c44fd7a910e1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2953 microversion: 2.42 time: 0.273886 Nov 27 21:04:33.270568 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2489/5114] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:32 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2953 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:33.278388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:33.279837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:33.290332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:33.291164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:33.292828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:33.293790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:33.318163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:33.343356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c0b610c-aa9a-4bfd-a452-f5e10f6c5fd2 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.483884 Nov 27 21:04:33.344786 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2626/5115] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:32 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:33.379304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bba5f7e0-0b7f-459e-9ad7-7f135fa4bf38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:33.380798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bba5f7e0-0b7f-459e-9ad7-7f135fa4bf38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:33.419446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba5f7e0-0b7f-459e-9ad7-7f135fa4bf38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:33.420009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba5f7e0-0b7f-459e-9ad7-7f135fa4bf38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:33.420893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba5f7e0-0b7f-459e-9ad7-7f135fa4bf38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:33.421366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba5f7e0-0b7f-459e-9ad7-7f135fa4bf38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:33.517834 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bba5f7e0-0b7f-459e-9ad7-7f135fa4bf38 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.171536 Nov 27 21:04:33.518729 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2627/5116] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:33 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:33.553058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:33.562967 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9c1b253-78ff-4c2c-9fdd-f544157f3487 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.287946 Nov 27 21:04:33.563735 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2490/5117] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:33 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:33.675661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f45b913a-1970-4d8d-ae8a-35e32eaf0bd0 req-17392d13-4b8f-4449-94d0-aac4da8c8f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d", "name": "network-vif-plugged", "status": "completed", "tag": "af22aa46-5e09-4ef8-9e39-a83bde137164"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:33.678624 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:33.678624 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:04:33.695538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f45b913a-1970-4d8d-ae8a-35e32eaf0bd0 req-17392d13-4b8f-4449-94d0-aac4da8c8f72 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:33.696062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f45b913a-1970-4d8d-ae8a-35e32eaf0bd0 req-17392d13-4b8f-4449-94d0-aac4da8c8f72 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:33.716123 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f45b913a-1970-4d8d-ae8a-35e32eaf0bd0 req-17392d13-4b8f-4449-94d0-aac4da8c8f72 service nova] Creating event network-vif-plugged:af22aa46-5e09-4ef8-9e39-a83bde137164 for instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d on nch1-master-1 Nov 27 21:04:33.724621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f45b913a-1970-4d8d-ae8a-35e32eaf0bd0 req-17392d13-4b8f-4449-94d0-aac4da8c8f72 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054861 Nov 27 21:04:33.727713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2628/5118] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:34.292090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:34.292851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:34.309300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.316167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:34.317057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.317515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:34.362227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:34.363247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:34.378629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.379090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:34.379941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.380388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:34.704467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:34.714325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:34.716464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:34.718169 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b8807c7-e910-4ef3-a4cf-75551daa041b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2953 microversion: 2.42 time: 0.431837 Nov 27 21:04:34.736029 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2491/5119] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:34 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2953 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:34.742198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38143746-f71a-4928-8e2f-1f4ca429e4dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:34.743680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-38143746-f71a-4928-8e2f-1f4ca429e4dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:34.752797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38143746-f71a-4928-8e2f-1f4ca429e4dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.753540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38143746-f71a-4928-8e2f-1f4ca429e4dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:34.754610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38143746-f71a-4928-8e2f-1f4ca429e4dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.754979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38143746-f71a-4928-8e2f-1f4ca429e4dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:34.832007 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38143746-f71a-4928-8e2f-1f4ca429e4dc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.094367 Nov 27 21:04:34.833326 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2492/5120] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:34 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:34.843620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:34.844124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:34.856869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.857342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:34.858162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:34.860129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:35.084179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:35.100940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6679c4fa-09b2-48ad-bea5-5c4443fb795a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.266475 Nov 27 21:04:35.102178 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2493/5121] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:34 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:35.213128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:35.220999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-492edfcf-a3ae-4f12-845d-8e16203cb5ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1327 microversion: 2.1 time: 0.863977 Nov 27 21:04:35.227490 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2629/5122] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:34 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1327 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:35.748275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:35.748895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:35.759576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:35.764543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:35.765574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:35.768543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:35.826670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9ddfadf2-9e03-4ab4-b839-35ca519def71 req-20b5aa33-90e7-4c23-ac70-bfa2b643ea46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8", "name": "network-vif-plugged", "status": "completed", "tag": "d3d58283-44aa-49b4-8ef5-5f49cb82acda"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:35.829682 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:35.829682 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:04:35.856211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9ddfadf2-9e03-4ab4-b839-35ca519def71 req-20b5aa33-90e7-4c23-ac70-bfa2b643ea46 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:35.856800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9ddfadf2-9e03-4ab4-b839-35ca519def71 req-20b5aa33-90e7-4c23-ac70-bfa2b643ea46 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:35.903688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9ddfadf2-9e03-4ab4-b839-35ca519def71 req-20b5aa33-90e7-4c23-ac70-bfa2b643ea46 service nova] Creating event network-vif-plugged:d3d58283-44aa-49b4-8ef5-5f49cb82acda for instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 on nch2-master-1 Nov 27 21:04:35.919862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9ddfadf2-9e03-4ab4-b839-35ca519def71 req-20b5aa33-90e7-4c23-ac70-bfa2b643ea46 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101614 Nov 27 21:04:35.920888 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2630/5123] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:04:35.958227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db10e3b4-ae4a-4037-bdef-af67eea80c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:35.974518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db10e3b4-ae4a-4037-bdef-af67eea80c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:35.999901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db10e3b4-ae4a-4037-bdef-af67eea80c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.000175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db10e3b4-ae4a-4037-bdef-af67eea80c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:36.000994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db10e3b4-ae4a-4037-bdef-af67eea80c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.001435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db10e3b4-ae4a-4037-bdef-af67eea80c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:36.108299 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db10e3b4-ae4a-4037-bdef-af67eea80c6f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.180434 Nov 27 21:04:36.109945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2631/5124] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:35 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:36.129325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:36.133091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:36.160134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.163541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:36.164640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.166693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:36.457230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:36.472922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:36.474493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:36.476349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c515a0da-fc79-4f2e-972b-775fe121e81c tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2953 microversion: 2.42 time: 0.732579 Nov 27 21:04:36.483226 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2494/5125] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:35 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2953 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:36.496882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:36.497684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:36.512615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.515061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:36.518421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.521212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:36.898028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:36.906262 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-938c49dc-6978-4f8f-ac67-f436a2226d57 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.790445 Nov 27 21:04:36.917674 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2632/5126] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:36 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:36.947822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:36.956884 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2707086-93cf-4bbd-ac10-69e9d4d0d3aa tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1526 microversion: 2.1 time: 0.471843 Nov 27 21:04:36.957833 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2495/5127] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:36 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1526 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:36.975007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:36.976382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:36.983088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.987860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:36.988844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:36.992233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.313420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd23eee3-4d6c-4275-9116-4520dedacd34 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Action: 'create', calling method: .version_select at 0x7f15c6e2df70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1255673624"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:37.340383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-fd23eee3-4d6c-4275-9116-4520dedacd34 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:04:37.346433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-fd23eee3-4d6c-4275-9116-4520dedacd34 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for user 21a4340936c347d3b226f54f99403219 and project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:04:37.348961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:37.357058 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4c8f6683-6292-4e3a-9992-52d31127a8a1 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1526 microversion: 2.1 time: 0.386309 Nov 27 21:04:37.357660 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2496/5128] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:36 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1526 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:37.379682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8af9f61-3c80-496f-9324-3543b20bf5e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:37.380668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8af9f61-3c80-496f-9324-3543b20bf5e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:37.388426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8af9f61-3c80-496f-9324-3543b20bf5e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.388883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8af9f61-3c80-496f-9324-3543b20bf5e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.389862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8af9f61-3c80-496f-9324-3543b20bf5e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.390450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8af9f61-3c80-496f-9324-3543b20bf5e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.455068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8af9f61-3c80-496f-9324-3543b20bf5e8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.078946 Nov 27 21:04:37.455958 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2497/5129] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:37 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:37.606661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-fd23eee3-4d6c-4275-9116-4520dedacd34 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:04:37.612771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-fd23eee3-4d6c-4275-9116-4520dedacd34 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for user 21a4340936c347d3b226f54f99403219 and project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:04:37.630504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd23eee3-4d6c-4275-9116-4520dedacd34 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.711459 Nov 27 21:04:37.631394 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2633/5130] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:04:36 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:37.643126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:37.643996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:37.650942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.651604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.652594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.653254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.653890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:37.654495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:37.664387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.664951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.665767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.667180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.687728 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] HTTP exception thrown: Instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d could not be found. Nov 27 21:04:37.691188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Returning 404 to user: Instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:37.692580 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68b6956b-f402-4898-a9c2-24bb3e33eb87 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 404 len: 111 microversion: 2.1 time: 0.235280 Nov 27 21:04:37.699920 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2498/5131] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:04:37 2021] DELETE /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:37.704758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:37.705387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:37.712019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.712473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:37.713272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:37.713769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.003538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:38.014467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fede2f06-56bf-4150-9129-2d9ad9b57b08 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1526 microversion: 2.1 time: 0.313390 Nov 27 21:04:38.015190 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2499/5132] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:37 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1526 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:38.022388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:38.023117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:38.049241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.049930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.052708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.054253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.364376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:38.374725 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abc9e7cd-404b-424e-92d6-47ac05a1f9bb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.356593 Nov 27 21:04:38.376639 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2500/5133] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:38 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:38.383305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Action: 'update', calling method: >, body: {"server": {"name": "7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d_new"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:38.385902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:38.394179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.395477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.396488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.397899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.418177 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] HTTP exception thrown: Instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d could not be found. Nov 27 21:04:38.419186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] Returning 404 to user: Instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:38.420745 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cfc91b0c-5c45-424d-902c-57d67f89d997 tempest-ServersNegativeTestMultiTenantJSON-1035179822 tempest-ServersNegativeTestMultiTenantJSON-1035179822-project] 10.222.0.21 "PUT /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 404 len: 111 microversion: 2.1 time: 0.042434 Nov 27 21:04:38.422519 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2501/5134] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:04:38 2021] PUT /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:38.436052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:38.437085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:38.444276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.445320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.446340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.447412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.498090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:04:38.647685 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20b6edb2-14be-4e32-880f-074e242b45af tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 204 len: 0 microversion: 2.1 time: 0.217088 Nov 27 21:04:38.648509 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2502/5135] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:04:38 2021] DELETE /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:04:38.657267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d3d03af-2f6e-4be8-bb91-3b9c4f438500 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:38.658879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d3d03af-2f6e-4be8-bb91-3b9c4f438500 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:38.666361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3d03af-2f6e-4be8-bb91-3b9c4f438500 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.666827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3d03af-2f6e-4be8-bb91-3b9c4f438500 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.668981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3d03af-2f6e-4be8-bb91-3b9c4f438500 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.669433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d3d03af-2f6e-4be8-bb91-3b9c4f438500 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.726771 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d3d03af-2f6e-4be8-bb91-3b9c4f438500 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.076589 Nov 27 21:04:38.730590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:38.731909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2503/5136] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:38 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:38.737827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:38.738989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:38.753435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:38.755463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:38.759727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd44cdef-9538-4a5d-bf3f-d4f83064e0d1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2932 microversion: 2.42 time: 1.120347 Nov 27 21:04:38.761536 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2634/5137] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:37 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2932 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:38.767561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-029dfba7-fc92-497e-a61f-fde7c3356089 req-148868e7-e1ea-4bd0-b6b1-b31cf39acff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-unplugged", "status": "completed", "tag": "80f6d4bb-15fa-48bb-b344-9306a5390104"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:38.770946 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:38.770946 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:04:38.775427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.775887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.776887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.777405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.783426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-029dfba7-fc92-497e-a61f-fde7c3356089 req-148868e7-e1ea-4bd0-b6b1-b31cf39acff1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:38.783885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-029dfba7-fc92-497e-a61f-fde7c3356089 req-148868e7-e1ea-4bd0-b6b1-b31cf39acff1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:38.834341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-029dfba7-fc92-497e-a61f-fde7c3356089 req-148868e7-e1ea-4bd0-b6b1-b31cf39acff1 service nova] Creating event network-vif-unplugged:80f6d4bb-15fa-48bb-b344-9306a5390104 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:38.858355 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-029dfba7-fc92-497e-a61f-fde7c3356089 req-148868e7-e1ea-4bd0-b6b1-b31cf39acff1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091493 Nov 27 21:04:38.859232 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2635/5138] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:39.055581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:39.068343 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f599566e-fc24-4ad7-b467-f55f98d06b80 tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1532 microversion: 2.1 time: 0.335132 Nov 27 21:04:39.069478 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2504/5139] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:38 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1532 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:39.394826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:39.395982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:39.407330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:39.408375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:39.409568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:39.410308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:39.739640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2d39885-4ddf-4679-aefc-c26a85189c79 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:39.740654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2d39885-4ddf-4679-aefc-c26a85189c79 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:39.752917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2d39885-4ddf-4679-aefc-c26a85189c79 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:39.756053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2d39885-4ddf-4679-aefc-c26a85189c79 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:39.757998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2d39885-4ddf-4679-aefc-c26a85189c79 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:39.759926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2d39885-4ddf-4679-aefc-c26a85189c79 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:39.863420 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2d39885-4ddf-4679-aefc-c26a85189c79 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.128424 Nov 27 21:04:39.868995 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2505/5140] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:39 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:39.874664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:39.875756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:39.885537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:39.886224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:39.887169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:39.887810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:40.120972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:40.129654 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35bb8fe8-08a3-4a79-ae16-45e8ec627cbf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1518 microversion: 2.1 time: 0.740002 Nov 27 21:04:40.130243 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2636/5141] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:39 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1518 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:40.153283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:40.153889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:40.169874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:40.170842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:40.171303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:40.172104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:40.172663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:40.190581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:40.192931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:40.194494 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7dfd2738-4968-4b42-aee4-38cacce4705a tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2911 microversion: 2.42 time: 0.324055 Nov 27 21:04:40.195594 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2506/5142] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:39 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2911 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:40.740049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:40.747992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c8d04c3c-8051-4d29-b0da-af2fc286ba47 req-6a2c8396-52bf-4a44-a539-789be1d541af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-deleted", "tag": "14f3487c-a918-45af-a334-40c24460e19d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:40.752017 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d9f7f68-ae02-42ad-adde-cf514982666b tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1532 microversion: 2.1 time: 0.602207 Nov 27 21:04:40.757466 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:40.757466 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:04:40.764854 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2637/5143] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:40 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1532 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:40.773926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c8d04c3c-8051-4d29-b0da-af2fc286ba47 req-6a2c8396-52bf-4a44-a539-789be1d541af service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:40.774609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c8d04c3c-8051-4d29-b0da-af2fc286ba47 req-6a2c8396-52bf-4a44-a539-789be1d541af service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:40.789597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c8d04c3c-8051-4d29-b0da-af2fc286ba47 req-6a2c8396-52bf-4a44-a539-789be1d541af service nova] Creating event network-vif-deleted:14f3487c-a918-45af-a334-40c24460e19d for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:40.811894 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c8d04c3c-8051-4d29-b0da-af2fc286ba47 req-6a2c8396-52bf-4a44-a539-789be1d541af service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069468 Nov 27 21:04:40.813356 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2507/5144] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:40.877419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-035ccffe-0df1-4e3d-b094-23a737a67546 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:40.878319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-unplugged", "status": "completed", "tag": "14f3487c-a918-45af-a334-40c24460e19d"}, {"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-unplugged", "status": "completed", "tag": "4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5"}, {"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-unplugged", "status": "completed", "tag": "41f728b6-b85b-4f6c-b3a2-991cfa305959"}, {"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-unplugged", "status": "completed", "tag": "03e5badb-8172-486f-9775-23060da4f0c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:40.879278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-035ccffe-0df1-4e3d-b094-23a737a67546 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:40.881316 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:40.881316 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:04:40.890007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:40.890804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:40.893580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-035ccffe-0df1-4e3d-b094-23a737a67546 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:40.894043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-035ccffe-0df1-4e3d-b094-23a737a67546 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:40.895046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-035ccffe-0df1-4e3d-b094-23a737a67546 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:40.895515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-035ccffe-0df1-4e3d-b094-23a737a67546 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:40.903771 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] Creating event network-vif-unplugged:14f3487c-a918-45af-a334-40c24460e19d for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:40.904619 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] Creating event network-vif-unplugged:4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:40.905344 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] Creating event network-vif-unplugged:41f728b6-b85b-4f6c-b3a2-991cfa305959 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:40.906040 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] Creating event network-vif-unplugged:03e5badb-8172-486f-9775-23060da4f0c7 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:40.911891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fdccf6e8-0ad3-437f-b647-e65ea15fdf3f req-4aab21e0-9e7e-418b-b90b-a85de880df21 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.037927 Nov 27 21:04:40.913098 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2508/5145] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:40.952830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-035ccffe-0df1-4e3d-b094-23a737a67546 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.079673 Nov 27 21:04:40.953506 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2638/5146] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:40 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:41.147428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:41.148500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:41.157170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:41.157718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:41.158731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:41.159245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:41.215405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:41.216732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:41.223816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:41.224353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:41.225754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:41.226406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:41.588339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:41.607766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f33a410-a866-42d1-a50b-5ba862eee7a8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.464044 Nov 27 21:04:41.623032 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2509/5147] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:41 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:41.628301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:41.629134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:41.641770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:41.642601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:41.643708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:41.644738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:41.972322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:41.982563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:41.984402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:41.985881 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7993ea77-e542-441a-b37a-a9db35b7d65f tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2751 microversion: 2.42 time: 0.774923 Nov 27 21:04:42.001218 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2639/5148] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:41 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2751 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:42.007187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:42.008129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:42.016734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.017254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.018051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.018490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.151785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1067ef43ad34e12b55a057f063dd099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00735fb3099849649f3659ccce46780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:42.162633 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2056456-11d5-44dc-82ee-e017ca9988ad tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 200 len: 1490 microversion: 2.1 time: 0.159811 Nov 27 21:04:42.163238 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2640/5149] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:42 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 1490 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:42.175146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11407d5e-5b1d-4d54-a8fe-882bb2d4ee17 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:42.178876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-11407d5e-5b1d-4d54-a8fe-882bb2d4ee17 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:42.192736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11407d5e-5b1d-4d54-a8fe-882bb2d4ee17 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.195133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11407d5e-5b1d-4d54-a8fe-882bb2d4ee17 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.196059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11407d5e-5b1d-4d54-a8fe-882bb2d4ee17 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.196424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11407d5e-5b1d-4d54-a8fe-882bb2d4ee17 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.203434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:42.218367 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abf3a211-f5df-4cea-9e5e-247dbcdc235c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.593867 Nov 27 21:04:42.219558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2510/5150] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:41 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:42.241359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1a571568-99cf-4613-bca6-d4d31b66f937 req-8e169aac-f8e4-40a7-8298-536f9f36da6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d", "name": "network-vif-deleted", "tag": "af22aa46-5e09-4ef8-9e39-a83bde137164"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:42.245269 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:42.245269 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:04:42.268216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1a571568-99cf-4613-bca6-d4d31b66f937 req-8e169aac-f8e4-40a7-8298-536f9f36da6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.268771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1a571568-99cf-4613-bca6-d4d31b66f937 req-8e169aac-f8e4-40a7-8298-536f9f36da6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.278845 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-11407d5e-5b1d-4d54-a8fe-882bb2d4ee17 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.113986 Nov 27 21:04:42.280024 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2641/5151] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:42 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:42.283817 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1a571568-99cf-4613-bca6-d4d31b66f937 req-8e169aac-f8e4-40a7-8298-536f9f36da6f service nova] Creating event network-vif-deleted:af22aa46-5e09-4ef8-9e39-a83bde137164 for instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d on nch1-master-1 Nov 27 21:04:42.285080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:42.289041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:42.290098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1a571568-99cf-4613-bca6-d4d31b66f937 req-8e169aac-f8e4-40a7-8298-536f9f36da6f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068666 Nov 27 21:04:42.291488 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2511/5152] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:42.308271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.309043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.309856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.310468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.762566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:42.789712 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40cd0d67-18b8-415a-b61e-a2f7e827c027 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.508040 Nov 27 21:04:42.790462 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2642/5153] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:42 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:42.809387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-acff4d5b-50fd-4b4e-aa61-6fbf40cdc0ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:42.819100 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-acff4d5b-50fd-4b4e-aa61-6fbf40cdc0ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 695e1ac5-562d-42c2-b38b-0e115c634695 has no mapping to a cell. Nov 27 21:04:42.824136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-acff4d5b-50fd-4b4e-aa61-6fbf40cdc0ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 695e1ac5-562d-42c2-b38b-0e115c634695 has no mapping to a cell. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:42.825224 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-acff4d5b-50fd-4b4e-aa61-6fbf40cdc0ca tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/695e1ac5-562d-42c2-b38b-0e115c634695/action" status: 404 len: 117 microversion: 2.1 time: 0.020324 Nov 27 21:04:42.826253 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2512/5154] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:42 2021] POST /compute/v2.1/servers/695e1ac5-562d-42c2-b38b-0e115c634695/action => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:42.833898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:42.834565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:42.843940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.852107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.856524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.857039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.939813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-447e4610-51d6-4b16-9d72-8d73e361f282 req-dbe5568a-abe2-4329-83e1-0bf5cf6d3664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-deleted", "tag": "80f6d4bb-15fa-48bb-b344-9306a5390104"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:42.941977 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:42.941977 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:04:42.955308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-447e4610-51d6-4b16-9d72-8d73e361f282 req-dbe5568a-abe2-4329-83e1-0bf5cf6d3664 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:42.956115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-447e4610-51d6-4b16-9d72-8d73e361f282 req-dbe5568a-abe2-4329-83e1-0bf5cf6d3664 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:42.969376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-447e4610-51d6-4b16-9d72-8d73e361f282 req-dbe5568a-abe2-4329-83e1-0bf5cf6d3664 service nova] Creating event network-vif-deleted:80f6d4bb-15fa-48bb-b344-9306a5390104 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:42.976125 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-447e4610-51d6-4b16-9d72-8d73e361f282 req-dbe5568a-abe2-4329-83e1-0bf5cf6d3664 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043895 Nov 27 21:04:42.977824 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2513/5155] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:43.009023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:43.009735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:43.021708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.022925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.023894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.024446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.322938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:43.343128 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c594c9f-e408-4d91-80be-1386e2f10831 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.509466 Nov 27 21:04:43.344178 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2643/5156] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:42 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:43.348758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:43.349380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] [instance: 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:43.363088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.363573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.372605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.373294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.395303 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] HTTP exception thrown: Instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d could not be found. Nov 27 21:04:43.396539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] Returning 404 to user: Instance 7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:43.398254 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86641e39-e19d-4b3f-af54-4e59c3caf8ac tempest-ServersNegativeTestMultiTenantJSON-176638699 tempest-ServersNegativeTestMultiTenantJSON-176638699-project] 10.222.0.21 "GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d" status: 404 len: 111 microversion: 2.1 time: 0.053071 Nov 27 21:04:43.401901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2644/5157] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:43 2021] GET /compute/v2.1/servers/7a798ccd-fa80-4cd5-ab5e-47e484a0ce1d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:43.408495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2926fec5-4c3b-4f82-94a8-cbb962e7dd80 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:43.410432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2926fec5-4c3b-4f82-94a8-cbb962e7dd80 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:43.419734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2926fec5-4c3b-4f82-94a8-cbb962e7dd80 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.420495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2926fec5-4c3b-4f82-94a8-cbb962e7dd80 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.421763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2926fec5-4c3b-4f82-94a8-cbb962e7dd80 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.422482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2926fec5-4c3b-4f82-94a8-cbb962e7dd80 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.453791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:43.466492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:43.471107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:43.474235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-805acf04-38a9-4ce5-bfe7-cea47d60be16 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2591 microversion: 2.42 time: 0.469675 Nov 27 21:04:43.476488 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2514/5158] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:43 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2591 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:43.484708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:43.485562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:43.506008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.508364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.516299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:43.517408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:43.520244 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2926fec5-4c3b-4f82-94a8-cbb962e7dd80 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.116520 Nov 27 21:04:43.520996 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2645/5159] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:43 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:43.940361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:43.950592 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c7dbb5c9-4cf3-483a-b575-41da0f0f6642 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.470462 Nov 27 21:04:43.951338 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2515/5160] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:43 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:43.985473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ca45365-d011-4f64-aa5d-9f0e2d6d859f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:43.986114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ca45365-d011-4f64-aa5d-9f0e2d6d859f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 9f86a1b2-52b7-4713-bb49-704ae259007a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:43.995327 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7ca45365-d011-4f64-aa5d-9f0e2d6d859f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 9f86a1b2-52b7-4713-bb49-704ae259007a could not be found. Nov 27 21:04:44.001922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ca45365-d011-4f64-aa5d-9f0e2d6d859f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 9f86a1b2-52b7-4713-bb49-704ae259007a could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:44.003464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ca45365-d011-4f64-aa5d-9f0e2d6d859f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/9f86a1b2-52b7-4713-bb49-704ae259007a/action" status: 404 len: 111 microversion: 2.1 time: 0.039687 Nov 27 21:04:44.005225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2646/5161] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:43 2021] POST /compute/v2.1/servers/9f86a1b2-52b7-4713-bb49-704ae259007a/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:44.012868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:44.013785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:44.021744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:44.022380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:44.023541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:44.024137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:44.352428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:44.364014 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47c0bb66-654e-4103-bfac-06f5d30f8993 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.352777 Nov 27 21:04:44.368762 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2516/5162] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:44 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:44.389510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:44.391165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:44.405243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:44.406374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:44.406688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:44.406904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:44.501462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:44.502459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:44.513931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:44.516406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:44.518086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:44.521243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.033101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:45.041267 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b43c100-f543-4964-afb9-090482731abf tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.655505 Nov 27 21:04:45.052271 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2647/5163] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:44 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:45.066231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b116407f-d615-4d6e-95f0-cfaf8c2389f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:45.067169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b116407f-d615-4d6e-95f0-cfaf8c2389f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:45.077094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b116407f-d615-4d6e-95f0-cfaf8c2389f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:45.077778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b116407f-d615-4d6e-95f0-cfaf8c2389f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.078764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b116407f-d615-4d6e-95f0-cfaf8c2389f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:45.079376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b116407f-d615-4d6e-95f0-cfaf8c2389f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.162665 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b116407f-d615-4d6e-95f0-cfaf8c2389f8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.109030 Nov 27 21:04:45.163363 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2648/5164] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:45 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:45.170777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5d6aa9f5-1294-4738-9d1a-9054da425d00 req-bfe1ad84-352b-45de-81f9-2e081edfa1bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-deleted", "tag": "4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:45.172272 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:45.172272 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:04:45.188185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5d6aa9f5-1294-4738-9d1a-9054da425d00 req-bfe1ad84-352b-45de-81f9-2e081edfa1bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:45.188639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5d6aa9f5-1294-4738-9d1a-9054da425d00 req-bfe1ad84-352b-45de-81f9-2e081edfa1bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.219071 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5d6aa9f5-1294-4738-9d1a-9054da425d00 req-bfe1ad84-352b-45de-81f9-2e081edfa1bc service nova] Creating event network-vif-deleted:4f5d35c6-05c7-4d77-9a4a-b0c6d97cade5 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:45.228776 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5d6aa9f5-1294-4738-9d1a-9054da425d00 req-bfe1ad84-352b-45de-81f9-2e081edfa1bc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064040 Nov 27 21:04:45.232128 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2649/5165] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:45.246581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:45.247243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:45.260302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:45.261553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.263714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:45.264289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.279137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:45.293814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:45.297232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lazy-loading 'flavor' on Instance uuid d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:04:45.297941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:45.300890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5d2018f-9aa9-4ea3-8651-24260eb2dae1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2545 microversion: 2.42 time: 0.805866 Nov 27 21:04:45.311467 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2517/5166] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:44 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2545 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:45.420823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-392847e0-f7c2-43b8-9611-b432a3e5a9f2 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 202 len: 0 microversion: 2.1 time: 0.186621 Nov 27 21:04:45.421812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2650/5167] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:45 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:45.433917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:45.434910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:45.444738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:45.448488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.451391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:45.453120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:45.964317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:45.973043 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f60969c-cdff-4244-96a5-2053a78c8e76 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1513 microversion: 2.1 time: 0.547033 Nov 27 21:04:45.977557 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2518/5168] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:45 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1513 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:46.177305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70789db7-6c98-4d3d-a1d3-98c032afa7c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:46.178441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70789db7-6c98-4d3d-a1d3-98c032afa7c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:46.196907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70789db7-6c98-4d3d-a1d3-98c032afa7c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:46.197760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70789db7-6c98-4d3d-a1d3-98c032afa7c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:46.200172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70789db7-6c98-4d3d-a1d3-98c032afa7c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:46.201002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70789db7-6c98-4d3d-a1d3-98c032afa7c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:46.292954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70789db7-6c98-4d3d-a1d3-98c032afa7c2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.111863 Nov 27 21:04:46.328639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:46.329837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:46.338701 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2651/5169] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:46 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:46.340751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:46.347727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:46.348632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:46.349196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:46.854954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:46.906991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:46.912066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:46.917630 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a25aaf57-b788-4b28-8009-93d68aaceee1 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2432 microversion: 2.42 time: 0.590401 Nov 27 21:04:46.943648 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2519/5170] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:46 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2432 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:47.004221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:47.005875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:47.025445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.025901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.026706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.027143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.351163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4098b9a-31b2-440b-991e-5104780b7ab5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:47.352179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f4098b9a-31b2-440b-991e-5104780b7ab5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:47.361413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4098b9a-31b2-440b-991e-5104780b7ab5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.361874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4098b9a-31b2-440b-991e-5104780b7ab5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.362681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4098b9a-31b2-440b-991e-5104780b7ab5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.374736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4098b9a-31b2-440b-991e-5104780b7ab5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.457273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f4098b9a-31b2-440b-991e-5104780b7ab5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.109174 Nov 27 21:04:47.460126 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2520/5171] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:47 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:47.733843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:47.742780 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bd9e4fde-22b4-4f92-a8f4-9248518739ec tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1496 microversion: 2.1 time: 0.752080 Nov 27 21:04:47.743713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2652/5172] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:46 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1496 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:47.761230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:47.761877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:47.783779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.784481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.785475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.788390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.865125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lazy-loading 'flavor' on Instance uuid d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:04:47.884789 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Cannot 'suspend' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state suspended Nov 27 21:04:47.886097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 409 to user: Cannot 'suspend' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state suspended {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:47.887171 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0b794b17-f9f3-4e01-88fd-5894a55a8fe7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 409 len: 148 microversion: 2.1 time: 0.130877 Nov 27 21:04:47.888728 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2521/5173] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:47 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 148 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:04:47.901998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b438e65-ffd9-4a98-87ae-4f285960b0fd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:47.903703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b438e65-ffd9-4a98-87ae-4f285960b0fd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:47.923990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b438e65-ffd9-4a98-87ae-4f285960b0fd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.923990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b438e65-ffd9-4a98-87ae-4f285960b0fd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.923990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b438e65-ffd9-4a98-87ae-4f285960b0fd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.923990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b438e65-ffd9-4a98-87ae-4f285960b0fd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.947393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:47.948597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:47.967581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.968239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:47.973616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:47.974824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:48.151058 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b438e65-ffd9-4a98-87ae-4f285960b0fd tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 202 len: 0 microversion: 2.1 time: 0.251598 Nov 27 21:04:48.157797 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2653/5174] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:47 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:48.182738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:48.188647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:48.206097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:48.206965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:48.208964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:48.209658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:48.851524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:48.870088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:48.872270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:48.876022 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff04fe11-3eb4-42b2-8967-ab37ba7f591b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2386 microversion: 2.42 time: 0.939954 Nov 27 21:04:48.877117 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2522/5175] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:47 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2386 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:48.889555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8e101679-74ff-4c10-9dbe-801d981f4f02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:48.900903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8e101679-74ff-4c10-9dbe-801d981f4f02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:48.918539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e101679-74ff-4c10-9dbe-801d981f4f02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:48.919235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e101679-74ff-4c10-9dbe-801d981f4f02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:48.920281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e101679-74ff-4c10-9dbe-801d981f4f02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:48.920911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8e101679-74ff-4c10-9dbe-801d981f4f02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:49.004163 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8e101679-74ff-4c10-9dbe-801d981f4f02 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.120709 Nov 27 21:04:49.008159 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2523/5176] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:48 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:49.018407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-04caac16-4cb6-4258-9bdb-bb9b05595c4d req-86dfbdd3-2c4f-43fd-9624-bedd3b6ee369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-deleted", "tag": "03e5badb-8172-486f-9775-23060da4f0c7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:49.022869 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:49.022869 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:04:49.033088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-04caac16-4cb6-4258-9bdb-bb9b05595c4d req-86dfbdd3-2c4f-43fd-9624-bedd3b6ee369 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:49.033801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-04caac16-4cb6-4258-9bdb-bb9b05595c4d req-86dfbdd3-2c4f-43fd-9624-bedd3b6ee369 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:49.055095 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-04caac16-4cb6-4258-9bdb-bb9b05595c4d req-86dfbdd3-2c4f-43fd-9624-bedd3b6ee369 service nova] Creating event network-vif-deleted:03e5badb-8172-486f-9775-23060da4f0c7 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:49.064932 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-04caac16-4cb6-4258-9bdb-bb9b05595c4d req-86dfbdd3-2c4f-43fd-9624-bedd3b6ee369 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053544 Nov 27 21:04:49.067763 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2524/5177] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:49.106083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:49.114452 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c84f1daa-de1f-4fd0-a9b3-0dde3b7d8c0f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1502 microversion: 2.1 time: 0.952076 Nov 27 21:04:49.117090 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2654/5178] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:48 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1502 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:49.902019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:49.907056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:49.924969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:49.928459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:49.929761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:49.930892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:50.019943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f383da32-f460-41d9-9241-9272559c6c49 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:50.020939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f383da32-f460-41d9-9241-9272559c6c49 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:50.040402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f383da32-f460-41d9-9241-9272559c6c49 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:50.041222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f383da32-f460-41d9-9241-9272559c6c49 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:50.043894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f383da32-f460-41d9-9241-9272559c6c49 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:50.044568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f383da32-f460-41d9-9241-9272559c6c49 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:50.152700 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f383da32-f460-41d9-9241-9272559c6c49 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.136691 Nov 27 21:04:50.156325 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2655/5179] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:50 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:50.172341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:50.173100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:50.202575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:50.203159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:50.207990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:50.215073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:50.394074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:50.413667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:50.415380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05f09b6a534240fc82a45ce979040e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f19e09c6b04ac1a559d52d9cad1c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:50.438921 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad0919ad-4ac9-46cf-ad49-c82179bf0b2b tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 200 len: 2027 microversion: 2.42 time: 0.546384 Nov 27 21:04:50.454886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2525/5180] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:49 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 2027 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:04:50.808001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:50.819010 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f62047d-cd9e-464a-859a-ac9a77bc8f81 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1502 microversion: 2.1 time: 0.659154 Nov 27 21:04:50.822043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2656/5181] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:50 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1502 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:51.099386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-07e97f3f-1dfa-47c1-a29b-7af11f07f117 req-12a7263e-60c6-4615-998f-d476ede7917f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76793c46-5fca-400a-9b35-d4b6346878be", "name": "network-vif-deleted", "tag": "41f728b6-b85b-4f6c-b3a2-991cfa305959"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:51.101963 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:04:51.101963 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:04:51.118582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-07e97f3f-1dfa-47c1-a29b-7af11f07f117 req-12a7263e-60c6-4615-998f-d476ede7917f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:51.119405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-07e97f3f-1dfa-47c1-a29b-7af11f07f117 req-12a7263e-60c6-4615-998f-d476ede7917f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:51.146618 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-07e97f3f-1dfa-47c1-a29b-7af11f07f117 req-12a7263e-60c6-4615-998f-d476ede7917f service nova] Creating event network-vif-deleted:41f728b6-b85b-4f6c-b3a2-991cfa305959 for instance 76793c46-5fca-400a-9b35-d4b6346878be on nch2-master-1 Nov 27 21:04:51.156940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-07e97f3f-1dfa-47c1-a29b-7af11f07f117 req-12a7263e-60c6-4615-998f-d476ede7917f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061285 Nov 27 21:04:51.170917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ceb87217-488b-4f79-8c31-c1502836fa4b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:51.172000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ceb87217-488b-4f79-8c31-c1502836fa4b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:51.178607 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2526/5182] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:04:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:04:51.183735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb87217-488b-4f79-8c31-c1502836fa4b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:51.184263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb87217-488b-4f79-8c31-c1502836fa4b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:51.185786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb87217-488b-4f79-8c31-c1502836fa4b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:51.186513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb87217-488b-4f79-8c31-c1502836fa4b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:51.309776 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ceb87217-488b-4f79-8c31-c1502836fa4b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.142767 Nov 27 21:04:51.316589 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2657/5183] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:51 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:51.471780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:51.472662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:51.487309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:51.487956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:51.489801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:51.491499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:51.515101 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] HTTP exception thrown: Instance 76793c46-5fca-400a-9b35-d4b6346878be could not be found. Nov 27 21:04:51.516256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Returning 404 to user: Instance 76793c46-5fca-400a-9b35-d4b6346878be could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:51.517528 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53bb24b4-8655-4979-ae58-9f5c2445c262 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 404 len: 111 microversion: 2.42 time: 0.052221 Nov 27 21:04:51.519027 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2527/5184] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:04:51 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:04:51.530737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40af9fe9-e417-4c79-a91a-ab3f1d2d09a0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '.version_select at 0x7f15d9389e50>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:51.555184 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40af9fe9-e417-4c79-a91a-ab3f1d2d09a0 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39484124" status: 204 len: 0 microversion: 2.42 time: 0.030502 Nov 27 21:04:51.566292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2658/5185] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:04:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39484124 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:04:51.838042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:51.838949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:51.846864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:51.847609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:51.848555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:51.849143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:52.302174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:52.311227 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e291b134-dacf-4aee-9c58-245cb5cd4697 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1502 microversion: 2.1 time: 0.476814 Nov 27 21:04:52.311862 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2528/5186] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:51 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1502 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:52.324408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d804941-f8fe-4391-a8da-539b899723a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:52.325460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d804941-f8fe-4391-a8da-539b899723a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:52.338646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d804941-f8fe-4391-a8da-539b899723a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:52.339107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d804941-f8fe-4391-a8da-539b899723a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:52.339938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d804941-f8fe-4391-a8da-539b899723a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:52.342537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d804941-f8fe-4391-a8da-539b899723a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:52.442980 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d804941-f8fe-4391-a8da-539b899723a8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.122012 Nov 27 21:04:52.445484 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2659/5187] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:52 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:53.328714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:53.329348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:53.344869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:53.347947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:53.352350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:53.354398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:53.459658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d86053b2-0854-414f-b624-e734863cf9d9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:53.476452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d86053b2-0854-414f-b624-e734863cf9d9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:53.494238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d86053b2-0854-414f-b624-e734863cf9d9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:53.496123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d86053b2-0854-414f-b624-e734863cf9d9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:53.498916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d86053b2-0854-414f-b624-e734863cf9d9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:53.499666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d86053b2-0854-414f-b624-e734863cf9d9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:53.583471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d86053b2-0854-414f-b624-e734863cf9d9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.128388 Nov 27 21:04:53.586588 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2660/5188] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:53 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:53.954370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:53.965041 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2967c844-3eb9-4054-9858-abb15ed1bab0 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.640107 Nov 27 21:04:53.967770 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2529/5189] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:53 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:53.986148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:53.986841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:54.001932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.002628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:54.004610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.005342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:54.470788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:54.482846 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-019b7ad9-4578-4e3e-9caa-8b1bd199af0a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.498441 Nov 27 21:04:54.484423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2661/5190] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:53 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:54.500152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4287d20-f486-4ce1-9f22-a0da1bd75cc7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:54.501562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f4287d20-f486-4ce1-9f22-a0da1bd75cc7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: ca737319-cc0e-4295-be8c-77f411bf7202] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:54.509358 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f4287d20-f486-4ce1-9f22-a0da1bd75cc7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance ca737319-cc0e-4295-be8c-77f411bf7202 could not be found. Nov 27 21:04:54.510248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4287d20-f486-4ce1-9f22-a0da1bd75cc7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance ca737319-cc0e-4295-be8c-77f411bf7202 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:54.511239 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f4287d20-f486-4ce1-9f22-a0da1bd75cc7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/ca737319-cc0e-4295-be8c-77f411bf7202/action" status: 404 len: 111 microversion: 2.1 time: 0.015903 Nov 27 21:04:54.520401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:54.521429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:54.526809 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2530/5191] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:54 2021] POST /compute/v2.1/servers/ca737319-cc0e-4295-be8c-77f411bf7202/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:54.531003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.531804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:54.532889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.533662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:54.598696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b706cd6a-208d-42cc-8617-f60c10b5dba5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:54.600144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b706cd6a-208d-42cc-8617-f60c10b5dba5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:54.618504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b706cd6a-208d-42cc-8617-f60c10b5dba5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.619295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b706cd6a-208d-42cc-8617-f60c10b5dba5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:54.620273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b706cd6a-208d-42cc-8617-f60c10b5dba5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.621027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b706cd6a-208d-42cc-8617-f60c10b5dba5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:54.681981 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b706cd6a-208d-42cc-8617-f60c10b5dba5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.087432 Nov 27 21:04:54.683653 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2531/5192] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:54 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:54.863614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:54.878830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a859511d-200b-4975-9c40-cb6278c7519e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.355659 Nov 27 21:04:54.891877 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2662/5193] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:54 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:54.898203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:54.899107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:54.911010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.916578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:54.917480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:54.917925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:55.380732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1854712040-access_point-2004339199", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "6ca13ca1-ce2e-44b8-9716-f8635f05b861"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1255673624", "security_groups": [{"name": "tempest-secgroup_access--11150490"}, {"name": "tempest-secgroup_general--403936855"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:55.500591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:55.519021 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb5c9717-bc15-482a-a3fb-02a65fc7f83e tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.625169 Nov 27 21:04:55.519835 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2532/5194] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:54 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:55.537611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:55.538403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:55.554384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:55.555963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:55.557268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:55.558116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:55.608693 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Cannot 'unpause' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active Nov 27 21:04:55.612267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 409 to user: Cannot 'unpause' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:55.614624 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-00a003c0-a88c-4cbb-979d-df9c192711f8 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 409 len: 145 microversion: 2.1 time: 0.081721 Nov 27 21:04:55.625554 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2533/5195] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:55 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 145 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:04:55.634003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:55.634619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:55.644360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:55.644929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:55.658928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:55.659420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:56.038701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:56.049467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7958d09f-f75d-4e90-9c90-064bec9f49f7 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.418265 Nov 27 21:04:56.053595 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2534/5196] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:55 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:04:56.064260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-174b3996-682e-4a5d-b874-d319e072789f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:56.064464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-174b3996-682e-4a5d-b874-d319e072789f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:56.082501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174b3996-682e-4a5d-b874-d319e072789f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:56.083008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174b3996-682e-4a5d-b874-d319e072789f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:56.084638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174b3996-682e-4a5d-b874-d319e072789f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:56.088739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-174b3996-682e-4a5d-b874-d319e072789f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:56.180489 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-174b3996-682e-4a5d-b874-d319e072789f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.125344 Nov 27 21:04:56.182631 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2535/5197] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:56 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:56.190669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:56.191659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:56.203445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:56.204099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:56.205118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:56.205702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:56.217658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] validate_networks() for [('6ca13ca1-ce2e-44b8-9716-f8635f05b861', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:04:56.610564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:56.618973 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8588e386-cdf0-4a9a-9767-089dba735704 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.434774 Nov 27 21:04:56.637437 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2536/5198] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:56 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:56.642877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b18c3e62-8515-4a71-b520-837cea2fd753 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:56.643498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b18c3e62-8515-4a71-b520-837cea2fd753 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 0c8f5b4b-a9bc-47f2-a975-4496870f3feb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:56.651064 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b18c3e62-8515-4a71-b520-837cea2fd753 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 0c8f5b4b-a9bc-47f2-a975-4496870f3feb could not be found. Nov 27 21:04:56.651694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b18c3e62-8515-4a71-b520-837cea2fd753 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 0c8f5b4b-a9bc-47f2-a975-4496870f3feb could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:56.652528 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b18c3e62-8515-4a71-b520-837cea2fd753 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/0c8f5b4b-a9bc-47f2-a975-4496870f3feb/action" status: 404 len: 111 microversion: 2.1 time: 0.013798 Nov 27 21:04:56.663342 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2537/5199] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:56 2021] POST /compute/v2.1/servers/0c8f5b4b-a9bc-47f2-a975-4496870f3feb/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:56.668294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:56.669111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:56.687526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:56.688259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:56.689359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:56.689964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:57.029095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:57.037411 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bae25f96-cd7d-49b0-895a-842098661ec5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.372344 Nov 27 21:04:57.041830 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2538/5200] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:56 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:57.060445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:57.062149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:57.071743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:57.073864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:57.092086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:57.098638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:57.780397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:57.794175 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f76d66c-80da-44e8-912d-676ae729e9da tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.736673 Nov 27 21:04:57.794827 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2539/5201] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:57 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:57.820913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-770f0a9c-8b6b-4e37-8b46-7e80f803cfef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:57.828250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-770f0a9c-8b6b-4e37-8b46-7e80f803cfef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:57.856210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770f0a9c-8b6b-4e37-8b46-7e80f803cfef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:57.856210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770f0a9c-8b6b-4e37-8b46-7e80f803cfef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:57.856660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770f0a9c-8b6b-4e37-8b46-7e80f803cfef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:57.860589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-770f0a9c-8b6b-4e37-8b46-7e80f803cfef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:57.871706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:04:57.872170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:04:57.872764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:04:57.873186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:04:57.873598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:04:57.904551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:57.905011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:57.905826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:57.906267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:57.972503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:04:57.998759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for user 21a4340936c347d3b226f54f99403219 and project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:04:58.000086 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-770f0a9c-8b6b-4e37-8b46-7e80f803cfef tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.190911 Nov 27 21:04:58.007799 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2540/5202] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:57 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:04:58.032828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:58.033912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:58.043022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:04:58.045289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:58.054676 ncdv-master-1 devstack@n-api.service[135680]: WARNING nova.utils [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1854712040-access_point-2004339199 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1854712040-ac Nov 27 21:04:58.055737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:04:58.057069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:58.058487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:58.060048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:58.116044 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Cannot 'unshelve' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active Nov 27 21:04:58.116971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 409 to user: Cannot 'unshelve' instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 while it is in vm_state active {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:58.118555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3163fbc-7f6d-4b55-8409-bca58effefce tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action" status: 409 len: 146 microversion: 2.1 time: 0.106144 Nov 27 21:04:58.119773 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2541/5203] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:04:58 2021] POST /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8/action => generated 146 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:04:58.129301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:58.130456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:58.151185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:58.151894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:58.153431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:58.155043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:58.171110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80317237-e49c-4d5a-9da5-d3d4ea4d811a tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 2.793998 Nov 27 21:04:58.172713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2663/5204] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:04:55 2021] POST /compute/v2.1/servers => generated 455 bytes in 2796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:04:58.200906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c0d0c9d-54c5-46c8-a35c-f5f4286f1aac tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:58.201808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c0d0c9d-54c5-46c8-a35c-f5f4286f1aac tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:58.548380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1c0d0c9d-54c5-46c8-a35c-f5f4286f1aac tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:58.556674 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c0d0c9d-54c5-46c8-a35c-f5f4286f1aac tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1295 microversion: 2.1 time: 0.372785 Nov 27 21:04:58.559993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2664/5205] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:58 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1295 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:58.897487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:58.914418 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11cc182e-2f1f-4365-8045-1d0e39b1483c tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.790353 Nov 27 21:04:58.931038 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2542/5206] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:58 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:58.936299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:58.936952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:58.954846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:58.957317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:58.963555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:58.964320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:59.020278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88230c02-9fd7-4d54-aef2-3bd8a353a6ad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:59.022209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88230c02-9fd7-4d54-aef2-3bd8a353a6ad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:59.043388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88230c02-9fd7-4d54-aef2-3bd8a353a6ad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:59.062216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88230c02-9fd7-4d54-aef2-3bd8a353a6ad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:59.063370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88230c02-9fd7-4d54-aef2-3bd8a353a6ad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:59.066153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88230c02-9fd7-4d54-aef2-3bd8a353a6ad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:59.174066 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88230c02-9fd7-4d54-aef2-3bd8a353a6ad tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.157696 Nov 27 21:04:59.176061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2543/5207] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:04:59 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:04:59.475469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:59.491158 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eadb1059-1e42-4332-aa23-918d74bb4a7a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.557340 Nov 27 21:04:59.492216 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2665/5208] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:58 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:59.515510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4144bdbd-c6c7-4be6-81ab-6f642eb767eb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1188919559_updated"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:04:59.516754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4144bdbd-c6c7-4be6-81ab-6f642eb767eb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: 541028b0-9149-4bdf-bb39-c7020d27c130] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:59.526942 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-4144bdbd-c6c7-4be6-81ab-6f642eb767eb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance 541028b0-9149-4bdf-bb39-c7020d27c130 could not be found. Nov 27 21:04:59.533406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4144bdbd-c6c7-4be6-81ab-6f642eb767eb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance 541028b0-9149-4bdf-bb39-c7020d27c130 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:04:59.534449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4144bdbd-c6c7-4be6-81ab-6f642eb767eb tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "PUT /compute/v2.1/servers/541028b0-9149-4bdf-bb39-c7020d27c130" status: 404 len: 111 microversion: 2.1 time: 0.023002 Nov 27 21:04:59.535456 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2544/5209] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:04:59 2021] PUT /compute/v2.1/servers/541028b0-9149-4bdf-bb39-c7020d27c130 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:59.544446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:59.545171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:59.557867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:59.559491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:59.561594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:59.563934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:59.575515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:59.576385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:04:59.591914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:59.592368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:59.593177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:04:59.593788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:04:59.958394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:04:59.967675 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c37f0024-2a85-43ad-a185-75ba19f532d1 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.427887 Nov 27 21:04:59.968263 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2666/5210] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:59 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:04:59.992005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:04:59.992881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:00.000403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:00.001927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:00.006867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:00.007589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:00.398668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:00.413014 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b83334aa-9b44-4dde-b58f-c4331f1abf24 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1347 microversion: 2.1 time: 0.840556 Nov 27 21:05:00.422969 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2545/5211] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:59 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1347 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:00.424091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b36e1d67-a32d-426a-9c82-5983e3395b89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:00.425353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b36e1d67-a32d-426a-9c82-5983e3395b89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:00.439329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b36e1d67-a32d-426a-9c82-5983e3395b89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:00.439756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b36e1d67-a32d-426a-9c82-5983e3395b89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:00.459741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b36e1d67-a32d-426a-9c82-5983e3395b89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:00.460361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b36e1d67-a32d-426a-9c82-5983e3395b89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:00.559514 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b36e1d67-a32d-426a-9c82-5983e3395b89 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.144026 Nov 27 21:05:00.564907 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2546/5212] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:00 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:00.698087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:00.707366 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8114a8a1-40f0-4638-9efc-005695d027e9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.722106 Nov 27 21:05:00.708642 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2667/5213] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:04:59 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:00.728152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4632ada9-391e-4861-9265-55d565930920 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:00.730302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4632ada9-391e-4861-9265-55d565930920 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:00.731491 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4632ada9-391e-4861-9265-55d565930920 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "PUT /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 400 len: 619 microversion: 2.1 time: 0.011087 Nov 27 21:05:00.732974 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2547/5214] 10.222.0.21 () {60 vars in 1256 bytes} [Sat Nov 27 21:05:00 2021] PUT /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 27 21:05:00.741673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:00.742528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:00.763206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:00.770636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:00.775095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:00.776058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:01.429688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:01.430680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:01.446778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:01.447507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:01.448474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:01.453446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:01.653985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:01.688394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1df2d837-61b9-4704-8560-ddb5371fe297 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.951463 Nov 27 21:05:01.700792 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2668/5215] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:00 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:01.714612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43e8d67b-0dde-4dbe-95e8-bed3a4a03d8d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:01.718173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43e8d67b-0dde-4dbe-95e8-bed3a4a03d8d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:01.731969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e8d67b-0dde-4dbe-95e8-bed3a4a03d8d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:01.732565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e8d67b-0dde-4dbe-95e8-bed3a4a03d8d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:01.733609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e8d67b-0dde-4dbe-95e8-bed3a4a03d8d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:01.734152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e8d67b-0dde-4dbe-95e8-bed3a4a03d8d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:01.845427 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43e8d67b-0dde-4dbe-95e8-bed3a4a03d8d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.147987 Nov 27 21:05:01.851346 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2669/5216] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:01 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:01.856125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:01.858062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:01.874832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:01.875344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:01.880074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:01.882977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:01.952409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:01.968327 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f5348f9-1402-4dea-9ecc-e8b1efc5bec0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1353 microversion: 2.1 time: 0.540980 Nov 27 21:05:01.969301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2548/5217] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:01 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1353 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:02.527986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:02.544902 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39fcc887-ddef-4913-bacc-9e4f0ac8c48f tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.695742 Nov 27 21:05:02.548424 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2670/5218] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:01 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:02.564278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ceba45d-a5e5-4d44-9992-acc9fb94910a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:02.566124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ceba45d-a5e5-4d44-9992-acc9fb94910a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:02.567094 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ceba45d-a5e5-4d44-9992-acc9fb94910a tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "PUT /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 400 len: 108 microversion: 2.1 time: 0.006829 Nov 27 21:05:02.571487 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2549/5219] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:05:02 2021] PUT /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:05:02.576989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:02.578599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:02.614095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:02.614639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:02.617622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:02.618167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:02.860073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b7e4bce-f66b-419d-8565-ad8d1d645bd9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:02.862625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b7e4bce-f66b-419d-8565-ad8d1d645bd9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:02.884716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7e4bce-f66b-419d-8565-ad8d1d645bd9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:02.886430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7e4bce-f66b-419d-8565-ad8d1d645bd9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:02.888545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7e4bce-f66b-419d-8565-ad8d1d645bd9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:02.889000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b7e4bce-f66b-419d-8565-ad8d1d645bd9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:02.987226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b7e4bce-f66b-419d-8565-ad8d1d645bd9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.131877 Nov 27 21:05:02.988656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2550/5220] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:02 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:02.993990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:03.001912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:03.032842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:03.033333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:03.034149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:03.037916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:03.148823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:03.157890 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0be5642b-885f-4c8f-b77b-34026a561604 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1505 microversion: 2.1 time: 0.585548 Nov 27 21:05:03.158477 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2671/5221] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:02 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1505 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:03.895336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:03.897352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:03.915199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:03.915710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:03.917786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:03.919721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:03.942595 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] HTTP exception thrown: Instance 76793c46-5fca-400a-9b35-d4b6346878be could not be found. Nov 27 21:05:03.943278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Returning 404 to user: Instance 76793c46-5fca-400a-9b35-d4b6346878be could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:03.944177 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-84b9e83d-1410-4546-8127-97ada0406068 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "DELETE /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 404 len: 111 microversion: 2.1 time: 0.054137 Nov 27 21:05:03.945080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2672/5222] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:05:03 2021] DELETE /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:05:03.954149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:03.954817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] [instance: 76793c46-5fca-400a-9b35-d4b6346878be] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:03.964514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:03.964978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:03.965886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:03.966680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:03.986070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] HTTP exception thrown: Instance 76793c46-5fca-400a-9b35-d4b6346878be could not be found. Nov 27 21:05:03.986911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] Returning 404 to user: Instance 76793c46-5fca-400a-9b35-d4b6346878be could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:03.988323 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c1b88a7-744e-4a53-96aa-e0b766628f33 tempest-TaggedBootDevicesTest_v242-2000740141 tempest-TaggedBootDevicesTest_v242-2000740141-project] 10.222.0.21 "GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be" status: 404 len: 111 microversion: 2.1 time: 0.038872 Nov 27 21:05:03.993905 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2673/5223] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:03 2021] GET /compute/v2.1/servers/76793c46-5fca-400a-9b35-d4b6346878be => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:05:04.000706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3fda7c27-70ce-458b-85d4-09cddf28663b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:04.001953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3fda7c27-70ce-458b-85d4-09cddf28663b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:04.007554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:04.020265 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8fb1036-a4e6-4dcf-8d9b-65a7e5eae1ba tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 1.029592 Nov 27 21:05:04.025254 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2551/5224] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:02 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:04.028960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fda7c27-70ce-458b-85d4-09cddf28663b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:04.029652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fda7c27-70ce-458b-85d4-09cddf28663b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:04.030773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fda7c27-70ce-458b-85d4-09cddf28663b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:04.031458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fda7c27-70ce-458b-85d4-09cddf28663b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:04.096679 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3fda7c27-70ce-458b-85d4-09cddf28663b tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.101111 Nov 27 21:05:04.097378 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2674/5225] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:03 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:05.040978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:05.042324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:05.065070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:05.065545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:05.066487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:05.066938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:05.113753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b7274ec6-6252-46cf-bb34-db9b089483c5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:05.114838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b7274ec6-6252-46cf-bb34-db9b089483c5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:05.140112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7274ec6-6252-46cf-bb34-db9b089483c5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:05.140774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7274ec6-6252-46cf-bb34-db9b089483c5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:05.145003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7274ec6-6252-46cf-bb34-db9b089483c5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:05.145703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7274ec6-6252-46cf-bb34-db9b089483c5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:05.330455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b7274ec6-6252-46cf-bb34-db9b089483c5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.220733 Nov 27 21:05:05.336004 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2675/5226] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:05 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:06.325402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:06.346478 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be0f3e89-006c-4f15-ab39-28c9c9bb5656 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 1.306593 Nov 27 21:05:06.351635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd4c6d9a-08e3-4d8a-83af-c60e909b1754 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:06.353458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd4c6d9a-08e3-4d8a-83af-c60e909b1754 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:06.357564 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2552/5227] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:05 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:06.372013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4c6d9a-08e3-4d8a-83af-c60e909b1754 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.374287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4c6d9a-08e3-4d8a-83af-c60e909b1754 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:06.376593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4c6d9a-08e3-4d8a-83af-c60e909b1754 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.378395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4c6d9a-08e3-4d8a-83af-c60e909b1754 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:06.467265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd4c6d9a-08e3-4d8a-83af-c60e909b1754 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.127972 Nov 27 21:05:06.467945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2676/5228] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:06 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:06.763511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:06.764059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:06.771804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.772479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:06.773479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.774090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:06.792409 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. Nov 27 21:05:06.793209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:06.794212 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62729bf3-f811-4162-bb81-d155999a49b5 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 404 len: 111 microversion: 2.1 time: 0.035177 Nov 27 21:05:06.795784 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2553/5229] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:05:06 2021] DELETE /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:05:06.821213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:06.822036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: bb676012-35b4-4211-8697-7e40e308bf9a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:06.864158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.868838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:06.871523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.871987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:06.928064 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. Nov 27 21:05:06.928481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance bb676012-35b4-4211-8697-7e40e308bf9a could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:06.933242 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0dbdf73-4824-45a7-9829-24ca08034441 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a" status: 404 len: 111 microversion: 2.1 time: 0.130568 Nov 27 21:05:06.935235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2677/5230] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:06 2021] GET /compute/v2.1/servers/bb676012-35b4-4211-8697-7e40e308bf9a => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:05:06.942123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:06.943994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:06.962930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.963629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:06.964885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:06.969314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.022772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:05:07.164455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a4b1d68-fa4b-42b8-83fe-ad625b266994 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 204 len: 0 microversion: 2.1 time: 0.225907 Nov 27 21:05:07.165157 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2554/5231] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:05:06 2021] DELETE /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:05:07.176175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:07.179431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:07.203117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:07.204299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.205888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:07.208370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.319118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5ee3a791-d056-4135-af2f-7339860e5290 req-cbb700cc-3ebb-4a05-a0a8-6d2d7ee47c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73f5655-5a54-4017-a8b8-1dacb1f718c0", "tag": "04aa03c2-a96d-486e-b422-4296e83311b0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:07.320771 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:07.320771 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:07.369187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5ee3a791-d056-4135-af2f-7339860e5290 req-cbb700cc-3ebb-4a05-a0a8-6d2d7ee47c15 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:07.369783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5ee3a791-d056-4135-af2f-7339860e5290 req-cbb700cc-3ebb-4a05-a0a8-6d2d7ee47c15 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.465327 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5ee3a791-d056-4135-af2f-7339860e5290 req-cbb700cc-3ebb-4a05-a0a8-6d2d7ee47c15 service nova] Creating event network-changed:04aa03c2-a96d-486e-b422-4296e83311b0 for instance b73f5655-5a54-4017-a8b8-1dacb1f718c0 on nch2-master-1 Nov 27 21:05:07.501062 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5ee3a791-d056-4135-af2f-7339860e5290 req-cbb700cc-3ebb-4a05-a0a8-6d2d7ee47c15 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186832 Nov 27 21:05:07.502410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2555/5232] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:05:07.518195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:07.519358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:07.544641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:07.545875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.547724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:07.551798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.866068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:07.874906 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cfb68573-f11a-4299-8785-a60270ec5422 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.705266 Nov 27 21:05:07.877679 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2678/5233] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:07 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:07.885935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-620a7e46-9ee3-42c6-b85e-21d70393628d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:07.887650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-620a7e46-9ee3-42c6-b85e-21d70393628d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:07.895015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-620a7e46-9ee3-42c6-b85e-21d70393628d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:07.896662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-620a7e46-9ee3-42c6-b85e-21d70393628d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.897752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-620a7e46-9ee3-42c6-b85e-21d70393628d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:07.898545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-620a7e46-9ee3-42c6-b85e-21d70393628d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:07.994338 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-620a7e46-9ee3-42c6-b85e-21d70393628d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.110867 Nov 27 21:05:07.998379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2679/5234] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:07 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:08.100312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:08.115609 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12746a8e-2275-4afc-beae-861a0f1f5311 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 0.609194 Nov 27 21:05:08.116533 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2556/5235] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:07 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:08.573049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f2e84de-037e-4e85-8996-b393dbe780f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'create', calling method: .version_select at 0x7f15d92c6160>, body: {"keypair": {"name": "tempest-keypair-622378582"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:08.590964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2f2e84de-037e-4e85-8996-b393dbe780f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:05:08.598647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2f2e84de-037e-4e85-8996-b393dbe780f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for user 67ee436ffe774a1eb71cdb910112c7eb and project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:05:08.895748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:08.897178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:08.915688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:08.918208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:08.920782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:08.921919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:09.145191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2f2e84de-037e-4e85-8996-b393dbe780f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:05:09.152684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2f2e84de-037e-4e85-8996-b393dbe780f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for user 67ee436ffe774a1eb71cdb910112c7eb and project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:05:09.169358 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f2e84de-037e-4e85-8996-b393dbe780f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.169122 Nov 27 21:05:09.170213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2680/5236] 10.222.0.21 () {62 vars in 1198 bytes} [Sat Nov 27 21:05:07 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1171 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:05:09.175918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96fca2e5-9146-4a69-8535-ec2acf8eaa1a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:09.177718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-96fca2e5-9146-4a69-8535-ec2acf8eaa1a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:09.187350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fca2e5-9146-4a69-8535-ec2acf8eaa1a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:09.188026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fca2e5-9146-4a69-8535-ec2acf8eaa1a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:09.188977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fca2e5-9146-4a69-8535-ec2acf8eaa1a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:09.189562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fca2e5-9146-4a69-8535-ec2acf8eaa1a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:09.247716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-96fca2e5-9146-4a69-8535-ec2acf8eaa1a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.074998 Nov 27 21:05:09.249720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2681/5237] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:09 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:09.256994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:09.257901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:09.266227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:09.267307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:09.268473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:09.269241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:09.560781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:09.576797 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1e9b397b-d13b-44f4-aaa1-e9544f42237b tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 0.686678 Nov 27 21:05:09.584939 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2557/5238] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:08 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:09.957892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:09.966956 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5d86b62-c1e2-4c52-bc78-951361c10c9d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 0.714888 Nov 27 21:05:09.967592 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2682/5239] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:09 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:10.260769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5cb41735-5af1-4be9-afa4-93c32f2c0ef4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:10.262454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5cb41735-5af1-4be9-afa4-93c32f2c0ef4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:10.271305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cb41735-5af1-4be9-afa4-93c32f2c0ef4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:10.272001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cb41735-5af1-4be9-afa4-93c32f2c0ef4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:10.273011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cb41735-5af1-4be9-afa4-93c32f2c0ef4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:10.273843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cb41735-5af1-4be9-afa4-93c32f2c0ef4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:10.353218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5cb41735-5af1-4be9-afa4-93c32f2c0ef4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.096092 Nov 27 21:05:10.360494 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2558/5240] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:10 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:10.601735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:10.602879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:10.620070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:10.623851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:10.624922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:10.625736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:10.984857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:10.988628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:10.998007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:10.998751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:10.999834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:11.000438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:11.372380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:11.384790 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b105defc-7d6c-48ee-bd36-c73937a1e9a5 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 0.404041 Nov 27 21:05:11.385761 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2559/5241] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:10 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:11.398837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f6fdbf2-da83-4663-9f0d-d3248b5d86f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:11.400101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f6fdbf2-da83-4663-9f0d-d3248b5d86f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:11.416097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf2-da83-4663-9f0d-d3248b5d86f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:11.420456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf2-da83-4663-9f0d-d3248b5d86f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:11.421959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf2-da83-4663-9f0d-d3248b5d86f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:11.422551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f6fdbf2-da83-4663-9f0d-d3248b5d86f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:11.512808 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f6fdbf2-da83-4663-9f0d-d3248b5d86f1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.124801 Nov 27 21:05:11.513562 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2560/5242] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:11 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:11.698838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a60782e0d8945c2b99dac616fda491d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c58aa2d3dd4e09a26b5265084b8493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:11.712942 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-514d42a5-0e72-4b26-a9a6-ac68a8a175b9 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 200 len: 1511 microversion: 2.1 time: 1.115415 Nov 27 21:05:11.713664 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2683/5243] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:10 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 1511 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:11.722829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ac260e48-57dd-4425-97b8-45f7f3f22047 req-ed1e2468-df64-4346-a535-36b252d74ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8", "name": "network-vif-deleted", "tag": "d3d58283-44aa-49b4-8ef5-5f49cb82acda"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:11.722829 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:11.722829 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:11.740851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ac260e48-57dd-4425-97b8-45f7f3f22047 req-ed1e2468-df64-4346-a535-36b252d74ed8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:11.741300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ac260e48-57dd-4425-97b8-45f7f3f22047 req-ed1e2468-df64-4346-a535-36b252d74ed8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:11.771499 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ac260e48-57dd-4425-97b8-45f7f3f22047 req-ed1e2468-df64-4346-a535-36b252d74ed8 service nova] Creating event network-vif-deleted:d3d58283-44aa-49b4-8ef5-5f49cb82acda for instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 on nch2-master-1 Nov 27 21:05:11.779660 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ac260e48-57dd-4425-97b8-45f7f3f22047 req-ed1e2468-df64-4346-a535-36b252d74ed8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063741 Nov 27 21:05:11.780840 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2561/5244] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:05:12.402277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:12.402891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:12.410798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:12.413243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:12.414364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:12.414841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:12.526408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-41651197-b0d2-43b8-b4c0-979ce4e78f68 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:12.527482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-41651197-b0d2-43b8-b4c0-979ce4e78f68 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:12.543787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41651197-b0d2-43b8-b4c0-979ce4e78f68 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:12.546505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41651197-b0d2-43b8-b4c0-979ce4e78f68 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:12.549766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41651197-b0d2-43b8-b4c0-979ce4e78f68 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:12.550258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41651197-b0d2-43b8-b4c0-979ce4e78f68 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:12.636188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-41651197-b0d2-43b8-b4c0-979ce4e78f68 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.113676 Nov 27 21:05:12.638433 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2562/5245] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:12 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:12.739692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:12.741393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] [instance: d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:12.754395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:12.763150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:12.767158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:12.768718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:12.770362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:12.775949 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07b9071d-a2e4-4136-ade6-cd8df965cbc2 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 0.374255 Nov 27 21:05:12.776746 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2684/5246] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:12 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:12.804442 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] HTTP exception thrown: Instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 could not be found. Nov 27 21:05:12.805862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] Returning 404 to user: Instance d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:12.808815 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-872aaf0a-abaf-42b8-84d1-e634516b2a97 tempest-ServersNegativeTestJSON-5863557 tempest-ServersNegativeTestJSON-5863557-project] 10.222.0.21 "GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8" status: 404 len: 111 microversion: 2.1 time: 0.082234 Nov 27 21:05:12.812702 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2563/5247] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:12 2021] GET /compute/v2.1/servers/d3d7fd85-4cf3-41e3-9a7f-f1b141ea88b8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:05:13.653269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f9ce251-57f1-4ef7-a547-c7421f4ed04d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:13.655499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f9ce251-57f1-4ef7-a547-c7421f4ed04d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:13.667107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f9ce251-57f1-4ef7-a547-c7421f4ed04d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:13.670614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f9ce251-57f1-4ef7-a547-c7421f4ed04d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:13.674715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f9ce251-57f1-4ef7-a547-c7421f4ed04d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:13.675172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f9ce251-57f1-4ef7-a547-c7421f4ed04d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:13.772356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f9ce251-57f1-4ef7-a547-c7421f4ed04d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.120558 Nov 27 21:05:13.773233 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2685/5248] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:13 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:13.793938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:13.794636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:13.806330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:13.812570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:13.813537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:13.814081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:14.715091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-66030799", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e625b12a-b3fa-4ce9-b29c-1debf46798ed"}], "security_groups": [{"name": "tempest-securitygroup--215966399"}], "key_name": "tempest-keypair-622378582", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:14.896534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:14.912047 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d55eeba1-f5dc-4456-afe1-aa102670a52f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 1.122486 Nov 27 21:05:14.921836 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2564/5249] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:13 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:14.926945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-800dd139-48b6-473c-8bd1-f090ce239975 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:14.931185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-800dd139-48b6-473c-8bd1-f090ce239975 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:14.947321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-800dd139-48b6-473c-8bd1-f090ce239975 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:14.952523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-800dd139-48b6-473c-8bd1-f090ce239975 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:14.953545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-800dd139-48b6-473c-8bd1-f090ce239975 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:14.954146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-800dd139-48b6-473c-8bd1-f090ce239975 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:15.037430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-800dd139-48b6-473c-8bd1-f090ce239975 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.114020 Nov 27 21:05:15.038106 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2565/5250] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:14 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:15.046562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1d71df9a-16dc-4a61-a3c4-9ed7c38acaa8 req-11477405-9a25-415b-b527-f5757ebff8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73f5655-5a54-4017-a8b8-1dacb1f718c0", "name": "network-vif-plugged", "status": "completed", "tag": "04aa03c2-a96d-486e-b422-4296e83311b0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:15.051485 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:15.051485 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:15.069715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1d71df9a-16dc-4a61-a3c4-9ed7c38acaa8 req-11477405-9a25-415b-b527-f5757ebff8b3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:15.074133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1d71df9a-16dc-4a61-a3c4-9ed7c38acaa8 req-11477405-9a25-415b-b527-f5757ebff8b3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:15.076814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] validate_networks() for [('e625b12a-b3fa-4ce9-b29c-1debf46798ed', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:05:15.107812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1d71df9a-16dc-4a61-a3c4-9ed7c38acaa8 req-11477405-9a25-415b-b527-f5757ebff8b3 service nova] Creating event network-vif-plugged:04aa03c2-a96d-486e-b422-4296e83311b0 for instance b73f5655-5a54-4017-a8b8-1dacb1f718c0 on nch2-master-1 Nov 27 21:05:15.113703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1d71df9a-16dc-4a61-a3c4-9ed7c38acaa8 req-11477405-9a25-415b-b527-f5757ebff8b3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074032 Nov 27 21:05:15.115511 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2566/5251] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:15.930612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:15.931486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:15.948374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:15.951402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:15.953616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:15.954290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:16.493453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:16.504705 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58d8e4da-5f0b-45df-a62b-4586fe6f898c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1470 microversion: 2.1 time: 0.579060 Nov 27 21:05:16.507140 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2567/5252] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:15 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1470 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:16.518822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ccfb232-e9f5-43bb-8c3d-e073d3c75083 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:16.518822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ccfb232-e9f5-43bb-8c3d-e073d3c75083 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:16.538789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccfb232-e9f5-43bb-8c3d-e073d3c75083 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:16.539153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccfb232-e9f5-43bb-8c3d-e073d3c75083 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:16.541070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccfb232-e9f5-43bb-8c3d-e073d3c75083 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:16.541526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccfb232-e9f5-43bb-8c3d-e073d3c75083 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:16.615800 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ccfb232-e9f5-43bb-8c3d-e073d3c75083 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.105592 Nov 27 21:05:16.619703 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2568/5253] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:16 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:16.690761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:05:16.691291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:05:16.691816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:05:16.692877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:05:16.694875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:05:16.706622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:16.707555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:16.708765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:16.709516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:16.736834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:05:16.743239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for user 67ee436ffe774a1eb71cdb910112c7eb and project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:05:16.763527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:05:16.763527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:05:16.827945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.118152 Nov 27 21:05:16.828881 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2686/5254] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 21:05:14 2021] POST /compute/v2.1/servers => generated 401 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 21:05:16.840466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:16.841465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:17.025893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:17.044347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:17.048190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:17.064034 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1279 microversion: 2.20 time: 0.228523 Nov 27 21:05:17.065765 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2569/5255] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:16 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1279 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:17.123036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:17.124129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001485 Nov 27 21:05:17.124781 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2687/5256] 10.222.0.21 () {56 vars in 885 bytes} [Sat Nov 27 21:05:17 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 27 21:05:17.137072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:17.140487 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.009533 Nov 27 21:05:17.141172 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2570/5257] 10.222.0.21 () {54 vars in 1034 bytes} [Sat Nov 27 21:05:17 2021] GET /compute/v2/ => generated 379 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 27 21:05:17.148910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:17.150439 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1cdd33d4-f89e-4f13-9391-ece09cfa2fab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001980 Nov 27 21:05:17.151778 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2688/5258] 10.222.0.21 () {54 vars in 1040 bytes} [Sat Nov 27 21:05:17 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:17.158292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:17.159533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b108497-b1bb-410b-ba8b-04d4a208b84c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001436 Nov 27 21:05:17.160367 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2571/5259] 10.222.0.21 () {56 vars in 885 bytes} [Sat Nov 27 21:05:17 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 27 21:05:17.524694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:17.525377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:17.545990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:17.548853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:17.549780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:17.551685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:17.634054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18bddf31-9871-4d18-a3c4-2d70e1cb85c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:17.635666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18bddf31-9871-4d18-a3c4-2d70e1cb85c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:17.655313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18bddf31-9871-4d18-a3c4-2d70e1cb85c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:17.658713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18bddf31-9871-4d18-a3c4-2d70e1cb85c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:17.664364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18bddf31-9871-4d18-a3c4-2d70e1cb85c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:17.665107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18bddf31-9871-4d18-a3c4-2d70e1cb85c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:17.751455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18bddf31-9871-4d18-a3c4-2d70e1cb85c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.124867 Nov 27 21:05:17.752217 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2572/5260] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:17 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:18.089663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:18.089663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:18.092521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:18.098017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.098683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.099935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.100657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.103825 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f06ee15-6a50-4225-8e1e-58ab9173201f tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1642 microversion: 2.1 time: 0.582718 Nov 27 21:05:18.115426 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2689/5261] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:17 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1642 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:18.143177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:18.145232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:18.164839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.165757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.169309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.169829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.223868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:18.237698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:18.246726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:18.248100 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-52e72bfb-6b3e-40f5-a101-5378e5c89a69 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1331 microversion: 2.20 time: 0.169010 Nov 27 21:05:18.259344 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2573/5262] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:18 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:18.502408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:18.517641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-073f4f75-dc28-4202-89b5-d210542b6f56 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1642 microversion: 2.1 time: 0.386116 Nov 27 21:05:18.519386 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2690/5263] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:18 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1642 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:18.534322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92919847-20aa-49ec-93ee-6741aa6077a3 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:18.535283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92919847-20aa-49ec-93ee-6741aa6077a3 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:18.552949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92919847-20aa-49ec-93ee-6741aa6077a3 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.553544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92919847-20aa-49ec-93ee-6741aa6077a3 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.554453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92919847-20aa-49ec-93ee-6741aa6077a3 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.554968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92919847-20aa-49ec-93ee-6741aa6077a3 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.765509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c573081b-9b85-4a3d-ab88-b32d44a4aed8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:18.767189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c573081b-9b85-4a3d-ab88-b32d44a4aed8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:18.776874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c573081b-9b85-4a3d-ab88-b32d44a4aed8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.777764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c573081b-9b85-4a3d-ab88-b32d44a4aed8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.778689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c573081b-9b85-4a3d-ab88-b32d44a4aed8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:18.779225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c573081b-9b85-4a3d-ab88-b32d44a4aed8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:18.832624 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c573081b-9b85-4a3d-ab88-b32d44a4aed8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.071827 Nov 27 21:05:18.850609 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2691/5264] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:18 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:19.150120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92919847-20aa-49ec-93ee-6741aa6077a3 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1793 microversion: 2.1 time: 0.614769 Nov 27 21:05:19.152042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2574/5265] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:18 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1793 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:19.269836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:19.272978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:19.309734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:19.312086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:19.313614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:19.315420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:19.470584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:19.500326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:19.502817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:19.504001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-54ea6498-6b94-4b6d-bec6-8cafc6ba588c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1337 microversion: 2.20 time: 0.240542 Nov 27 21:05:19.506864 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2692/5266] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:19 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1337 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:19.855611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29b48f31-386f-4668-a46f-fd291affbbac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:19.856529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29b48f31-386f-4668-a46f-fd291affbbac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:19.867289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b48f31-386f-4668-a46f-fd291affbbac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:19.871545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b48f31-386f-4668-a46f-fd291affbbac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:19.872578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b48f31-386f-4668-a46f-fd291affbbac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:19.873321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b48f31-386f-4668-a46f-fd291affbbac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:19.962173 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29b48f31-386f-4668-a46f-fd291affbbac tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.110961 Nov 27 21:05:19.968751 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2575/5267] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:19 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:20.523974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:20.525324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:20.537167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:20.538103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:20.539374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:20.540193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:20.982091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ae444be-33e7-42bd-aac1-923496f1d901 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:20.985486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ae444be-33e7-42bd-aac1-923496f1d901 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:21.000122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ae444be-33e7-42bd-aac1-923496f1d901 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:21.001030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ae444be-33e7-42bd-aac1-923496f1d901 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:21.006799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ae444be-33e7-42bd-aac1-923496f1d901 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:21.008961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ae444be-33e7-42bd-aac1-923496f1d901 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:21.132219 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ae444be-33e7-42bd-aac1-923496f1d901 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.156214 Nov 27 21:05:21.133523 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2576/5268] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:20 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:21.186074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:21.194888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:21.196441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:21.197594 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3160b3f-23e9-4120-a508-f3bb74122275 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.678149 Nov 27 21:05:21.215731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2693/5269] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:20 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:22.149464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2cb91c5e-ed1a-445b-b8be-0e47301458a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:22.152269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2cb91c5e-ed1a-445b-b8be-0e47301458a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:22.180114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2cb91c5e-ed1a-445b-b8be-0e47301458a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:22.183572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2cb91c5e-ed1a-445b-b8be-0e47301458a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:22.188770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2cb91c5e-ed1a-445b-b8be-0e47301458a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:22.189524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2cb91c5e-ed1a-445b-b8be-0e47301458a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:22.215493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:22.215901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:22.227586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:22.228044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:22.228851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:22.229294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:22.305479 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2cb91c5e-ed1a-445b-b8be-0e47301458a1 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.163531 Nov 27 21:05:22.306235 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2577/5270] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:22 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:22.794669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:22.810978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:22.815103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:22.820110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4262dffd-dc9a-4703-b6bd-84b74dcc8652 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.606689 Nov 27 21:05:22.822619 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2694/5271] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:22 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:05:23.319083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddb9a39f-4823-4c76-b5cb-9e05090d8244 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:23.319794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ea7ad395-e4dd-441b-968f-deb976dff7d0 req-8d2462ce-b1dc-4a6b-a4a0-5ce0bdcd0bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b1a80e3-263a-4ff5-9417-defdda26f981", "tag": "6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:23.321603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddb9a39f-4823-4c76-b5cb-9e05090d8244 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:23.321876 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:23.321876 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:23.337268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb9a39f-4823-4c76-b5cb-9e05090d8244 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:23.350407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb9a39f-4823-4c76-b5cb-9e05090d8244 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:23.353008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb9a39f-4823-4c76-b5cb-9e05090d8244 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:23.353765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddb9a39f-4823-4c76-b5cb-9e05090d8244 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:23.360478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ea7ad395-e4dd-441b-968f-deb976dff7d0 req-8d2462ce-b1dc-4a6b-a4a0-5ce0bdcd0bd2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:23.361293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ea7ad395-e4dd-441b-968f-deb976dff7d0 req-8d2462ce-b1dc-4a6b-a4a0-5ce0bdcd0bd2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:23.411466 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ea7ad395-e4dd-441b-968f-deb976dff7d0 req-8d2462ce-b1dc-4a6b-a4a0-5ce0bdcd0bd2 service nova] Creating event network-changed:6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9 for instance 0b1a80e3-263a-4ff5-9417-defdda26f981 on nch1-master-1 Nov 27 21:05:23.428106 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ea7ad395-e4dd-441b-968f-deb976dff7d0 req-8d2462ce-b1dc-4a6b-a4a0-5ce0bdcd0bd2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126770 Nov 27 21:05:23.429465 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2578/5272] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:23.449285 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddb9a39f-4823-4c76-b5cb-9e05090d8244 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.134974 Nov 27 21:05:23.451362 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2695/5273] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:23 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:23.855648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:23.856411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:23.874807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:23.875813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:23.876680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:23.877716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:24.462093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb3041a6-a9f2-4a5b-aca1-665f226c7d2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:24.463121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cb3041a6-a9f2-4a5b-aca1-665f226c7d2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:24.472801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb3041a6-a9f2-4a5b-aca1-665f226c7d2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:24.474740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb3041a6-a9f2-4a5b-aca1-665f226c7d2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:24.475860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb3041a6-a9f2-4a5b-aca1-665f226c7d2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:24.476527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb3041a6-a9f2-4a5b-aca1-665f226c7d2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:24.546107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cb3041a6-a9f2-4a5b-aca1-665f226c7d2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.086021 Nov 27 21:05:24.550709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:24.551354 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2696/5274] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:24 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:24.563277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:24.573179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:24.574844 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47c92677-adad-4fed-97fa-eb0e456263f6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.725662 Nov 27 21:05:24.575885 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2579/5275] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:23 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:24.592272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5cc66679-2296-4674-90a4-373fbb65f801 req-8710c54b-8b1d-4a99-a621-ae79d42be790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73f5655-5a54-4017-a8b8-1dacb1f718c0", "tag": "04aa03c2-a96d-486e-b422-4296e83311b0"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:24.593901 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:24.593901 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:05:24.612578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5cc66679-2296-4674-90a4-373fbb65f801 req-8710c54b-8b1d-4a99-a621-ae79d42be790 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:24.612578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5cc66679-2296-4674-90a4-373fbb65f801 req-8710c54b-8b1d-4a99-a621-ae79d42be790 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:24.642387 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5cc66679-2296-4674-90a4-373fbb65f801 req-8710c54b-8b1d-4a99-a621-ae79d42be790 service nova] Creating event network-changed:04aa03c2-a96d-486e-b422-4296e83311b0 for instance b73f5655-5a54-4017-a8b8-1dacb1f718c0 on nch2-master-1 Nov 27 21:05:24.659240 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5cc66679-2296-4674-90a4-373fbb65f801 req-8710c54b-8b1d-4a99-a621-ae79d42be790 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071146 Nov 27 21:05:24.659951 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2697/5276] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:25.564096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61a86bab-9b87-4062-b3e4-63f4791bcb29 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:25.565702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61a86bab-9b87-4062-b3e4-63f4791bcb29 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:25.581224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61a86bab-9b87-4062-b3e4-63f4791bcb29 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:25.583216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61a86bab-9b87-4062-b3e4-63f4791bcb29 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:25.587411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61a86bab-9b87-4062-b3e4-63f4791bcb29 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:25.588078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61a86bab-9b87-4062-b3e4-63f4791bcb29 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:25.595476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:25.596796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:25.609410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:25.614977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:25.616808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:25.617445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:25.680871 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61a86bab-9b87-4062-b3e4-63f4791bcb29 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.121552 Nov 27 21:05:25.682133 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2580/5277] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:25 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:26.261742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:26.277125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:26.280185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:26.282581 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba3812a3-9090-4ac0-bb96-99cdf36ace99 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.692067 Nov 27 21:05:26.284033 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2698/5278] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:25 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:26.694655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-df943998-ef08-45d6-bb4f-350928bcae50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:26.695839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-df943998-ef08-45d6-bb4f-350928bcae50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:26.725387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df943998-ef08-45d6-bb4f-350928bcae50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:26.725853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df943998-ef08-45d6-bb4f-350928bcae50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:26.728114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df943998-ef08-45d6-bb4f-350928bcae50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:26.729768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df943998-ef08-45d6-bb4f-350928bcae50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:26.827524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-df943998-ef08-45d6-bb4f-350928bcae50 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.137331 Nov 27 21:05:26.827960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2581/5279] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:26 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:27.308536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:27.310789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:27.339178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:27.340941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:27.341877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:27.342349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:27.807081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:27.823000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:27.827973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:27.830959 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4daaa80-f3d3-4554-90f2-58bf01314382 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.531436 Nov 27 21:05:27.835361 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2699/5280] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:27 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:27.840256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-072d4c5e-111b-42c1-97d9-aa63237fffc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:27.841332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-072d4c5e-111b-42c1-97d9-aa63237fffc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:27.861890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-072d4c5e-111b-42c1-97d9-aa63237fffc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:27.862132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-072d4c5e-111b-42c1-97d9-aa63237fffc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:27.867409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-072d4c5e-111b-42c1-97d9-aa63237fffc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:27.867860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-072d4c5e-111b-42c1-97d9-aa63237fffc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:27.986324 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-072d4c5e-111b-42c1-97d9-aa63237fffc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.150471 Nov 27 21:05:27.995594 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2582/5281] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:27 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:28.852943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:28.854294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:28.862281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:28.863541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:28.865496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:28.866492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:29.004285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38c14eba-beba-471e-aea9-da4906ec65f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:29.007685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-38c14eba-beba-471e-aea9-da4906ec65f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:29.016370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c14eba-beba-471e-aea9-da4906ec65f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:29.017112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c14eba-beba-471e-aea9-da4906ec65f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:29.018181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c14eba-beba-471e-aea9-da4906ec65f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:29.019090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c14eba-beba-471e-aea9-da4906ec65f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:29.073752 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38c14eba-beba-471e-aea9-da4906ec65f5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.073939 Nov 27 21:05:29.079903 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2583/5282] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:28 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:29.150813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:29.165355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:29.168767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:29.169929 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4a2ea44-e108-4831-b6dc-1ce6f39e3a0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.320694 Nov 27 21:05:29.179560 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2700/5283] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:28 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:30.100421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a992f058-4846-4a9e-834a-5bd94f422127 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:30.103522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a992f058-4846-4a9e-834a-5bd94f422127 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:30.115281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a992f058-4846-4a9e-834a-5bd94f422127 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:30.115771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a992f058-4846-4a9e-834a-5bd94f422127 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:30.116625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a992f058-4846-4a9e-834a-5bd94f422127 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:30.117160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a992f058-4846-4a9e-834a-5bd94f422127 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:30.200081 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a992f058-4846-4a9e-834a-5bd94f422127 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.116461 Nov 27 21:05:30.200508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:30.201666 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2584/5284] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:30 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:30.202121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:30.216239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:30.216840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:30.218269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:30.219782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:30.914968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:30.929031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:30.930535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:30.931679 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f574beb1-1411-454e-93d5-1d68f18d46a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.744947 Nov 27 21:05:30.941546 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2701/5285] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:30 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:31.214964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b70ee38b-4554-4e92-813a-3ca6d7beae85 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:31.216117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b70ee38b-4554-4e92-813a-3ca6d7beae85 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:31.235752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70ee38b-4554-4e92-813a-3ca6d7beae85 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:31.237919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70ee38b-4554-4e92-813a-3ca6d7beae85 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:31.241234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70ee38b-4554-4e92-813a-3ca6d7beae85 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:31.241795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70ee38b-4554-4e92-813a-3ca6d7beae85 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:31.307821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b70ee38b-4554-4e92-813a-3ca6d7beae85 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.097612 Nov 27 21:05:31.314029 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2585/5286] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:31 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:31.667924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3f882db1-8fc1-477f-a86a-233ac10071f0 req-f61e2253-9987-4e29-9590-8a3a6ab71981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1a80e3-263a-4ff5-9417-defdda26f981", "name": "network-vif-plugged", "status": "completed", "tag": "6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:31.670345 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:31.670345 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:05:31.684869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3f882db1-8fc1-477f-a86a-233ac10071f0 req-f61e2253-9987-4e29-9590-8a3a6ab71981 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:31.685613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3f882db1-8fc1-477f-a86a-233ac10071f0 req-f61e2253-9987-4e29-9590-8a3a6ab71981 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:31.711065 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3f882db1-8fc1-477f-a86a-233ac10071f0 req-f61e2253-9987-4e29-9590-8a3a6ab71981 service nova] Creating event network-vif-plugged:6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9 for instance 0b1a80e3-263a-4ff5-9417-defdda26f981 on nch1-master-1 Nov 27 21:05:31.722537 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3f882db1-8fc1-477f-a86a-233ac10071f0 req-f61e2253-9987-4e29-9590-8a3a6ab71981 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066297 Nov 27 21:05:31.724712 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2702/5287] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:31.964113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:31.965030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:31.983266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:31.983985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:31.987521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:31.988099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:32.260364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:32.270510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:32.272240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:32.273391 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ff2578a-b873-4875-992e-146e1ea3c952 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.318172 Nov 27 21:05:32.274157 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2586/5288] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:31 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:32.319856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35df4274-045a-486a-b3b4-ca9ffe5e5652 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:32.321286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35df4274-045a-486a-b3b4-ca9ffe5e5652 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:32.332905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35df4274-045a-486a-b3b4-ca9ffe5e5652 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:32.333376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35df4274-045a-486a-b3b4-ca9ffe5e5652 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:32.334187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35df4274-045a-486a-b3b4-ca9ffe5e5652 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:32.334916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35df4274-045a-486a-b3b4-ca9ffe5e5652 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:32.401447 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35df4274-045a-486a-b3b4-ca9ffe5e5652 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.085587 Nov 27 21:05:32.403027 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2703/5289] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:32 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:33.291586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:33.292210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:33.306487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:33.306973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:33.307913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:33.308569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:33.419151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47365f9c-26bf-4011-bb0e-1858616638f9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:33.421053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-47365f9c-26bf-4011-bb0e-1858616638f9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:33.430922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47365f9c-26bf-4011-bb0e-1858616638f9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:33.431646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47365f9c-26bf-4011-bb0e-1858616638f9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:33.434620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47365f9c-26bf-4011-bb0e-1858616638f9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:33.435667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47365f9c-26bf-4011-bb0e-1858616638f9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:33.589232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:33.598276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:33.601905 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47365f9c-26bf-4011-bb0e-1858616638f9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.191339 Nov 27 21:05:33.603350 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2704/5290] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:33 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:33.606050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:33.607221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ea80800-c03f-409d-802b-24e7d637511d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1404 microversion: 2.20 time: 0.319823 Nov 27 21:05:33.611559 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2587/5291] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:33 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1404 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:34.495795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1343588766", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "fdaaf7b5-1458-4159-852e-903b811d859c"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:34.555483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] validate_networks() for [('fdaaf7b5-1458-4159-852e-903b811d859c', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:05:34.615661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aa4a6b21-9119-4e93-9364-4803d51019fa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:34.617413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aa4a6b21-9119-4e93-9364-4803d51019fa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:34.632393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa4a6b21-9119-4e93-9364-4803d51019fa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:34.632859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa4a6b21-9119-4e93-9364-4803d51019fa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:34.633683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa4a6b21-9119-4e93-9364-4803d51019fa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:34.634132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa4a6b21-9119-4e93-9364-4803d51019fa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:34.685289 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aa4a6b21-9119-4e93-9364-4803d51019fa tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.074720 Nov 27 21:05:34.686653 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2588/5292] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:34 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:34.695044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:34.696049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:34.704260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:34.704901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:34.706176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:34.707645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:34.976763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:34.992667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:34.994360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:34.996188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64440df6-b18b-4ac3-afce-a4327869becd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1596 microversion: 2.20 time: 0.307948 Nov 27 21:05:34.999967 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2589/5293] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:34 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1596 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:35.017305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c3e8893e-aabe-495a-9e81-0b6b443f2499 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:35.017991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c3e8893e-aabe-495a-9e81-0b6b443f2499 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:35.032876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3e8893e-aabe-495a-9e81-0b6b443f2499 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:35.033851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3e8893e-aabe-495a-9e81-0b6b443f2499 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:35.037916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3e8893e-aabe-495a-9e81-0b6b443f2499 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:35.039117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3e8893e-aabe-495a-9e81-0b6b443f2499 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:35.118514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:05:35.118956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:05:35.119748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:05:35.120170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:05:35.120585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:05:35.139061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:35.139720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:35.140697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:35.141324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:35.184303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Getting quotas for project 2237b56d0b4b4fa3ace78023aa3fe435. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:05:35.190862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Getting quotas for user 7cd64b2d9718476ea2c0a4255c801b00 and project 2237b56d0b4b4fa3ace78023aa3fe435. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:05:35.205629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:05:35.209262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:05:35.298655 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52c13f54-2a3b-448b-a875-b2ec3e95b43b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.205923 Nov 27 21:05:35.299543 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2705/5294] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 21:05:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 21:05:35.314468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fdff937a-de1f-48fb-bcbe-234d9e2b25d8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:35.315085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fdff937a-de1f-48fb-bcbe-234d9e2b25d8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:35.352456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c3e8893e-aabe-495a-9e81-0b6b443f2499 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.339689 Nov 27 21:05:35.353304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2590/5295] 10.222.0.21 () {60 vars in 1315 bytes} [Sat Nov 27 21:05:35 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-interface => generated 284 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:05:35.465349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fdff937a-de1f-48fb-bcbe-234d9e2b25d8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:35.472576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fdff937a-de1f-48fb-bcbe-234d9e2b25d8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:35.477189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fdff937a-de1f-48fb-bcbe-234d9e2b25d8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:35.478557 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fdff937a-de1f-48fb-bcbe-234d9e2b25d8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1259 microversion: 2.21 time: 0.171663 Nov 27 21:05:35.486530 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2706/5296] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:35 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:35.698197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7161b9c-d608-4bd9-ba8e-636248272280 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:35.699127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7161b9c-d608-4bd9-ba8e-636248272280 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:35.714102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7161b9c-d608-4bd9-ba8e-636248272280 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:35.717654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7161b9c-d608-4bd9-ba8e-636248272280 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:35.721426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7161b9c-d608-4bd9-ba8e-636248272280 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:35.725630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7161b9c-d608-4bd9-ba8e-636248272280 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:35.829106 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7161b9c-d608-4bd9-ba8e-636248272280 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.135060 Nov 27 21:05:35.831382 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2591/5297] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:35 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:36.503424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:36.504574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:36.518711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:36.519453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:36.524298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:36.524959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:36.683017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:36.692536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:36.699368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:36.700455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4883c08d-9864-4af0-94b5-6036214956a8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1311 microversion: 2.21 time: 0.200985 Nov 27 21:05:36.715278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2707/5298] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:36 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:36.842410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc5be072-7df7-4a8c-a0f7-c183ad598110 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:36.844180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc5be072-7df7-4a8c-a0f7-c183ad598110 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:36.861407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5be072-7df7-4a8c-a0f7-c183ad598110 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:36.877738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5be072-7df7-4a8c-a0f7-c183ad598110 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:36.879540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5be072-7df7-4a8c-a0f7-c183ad598110 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:36.880150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc5be072-7df7-4a8c-a0f7-c183ad598110 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:36.972526 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc5be072-7df7-4a8c-a0f7-c183ad598110 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.134346 Nov 27 21:05:36.975514 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2592/5299] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:36 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:37.732217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:37.733077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:37.740288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:37.740726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:37.741836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:37.742521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:37.812368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d725913d-1e27-475b-bee1-36b91e202929 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:37.813866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d725913d-1e27-475b-bee1-36b91e202929 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:37.824146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d725913d-1e27-475b-bee1-36b91e202929 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:37.824831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d725913d-1e27-475b-bee1-36b91e202929 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:37.825712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d725913d-1e27-475b-bee1-36b91e202929 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:37.826359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d725913d-1e27-475b-bee1-36b91e202929 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:37.873878 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d725913d-1e27-475b-bee1-36b91e202929 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.066485 Nov 27 21:05:37.877358 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2593/5300] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:37 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:37.882930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-52e30dbe-2fc1-4871-87e3-00d4d985c423 req-3f05dd1d-2123-4410-ad6d-463ba83e62a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b1a80e3-263a-4ff5-9417-defdda26f981", "tag": "6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:37.884857 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.884857 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:37.896890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-52e30dbe-2fc1-4871-87e3-00d4d985c423 req-3f05dd1d-2123-4410-ad6d-463ba83e62a4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:37.897342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-52e30dbe-2fc1-4871-87e3-00d4d985c423 req-3f05dd1d-2123-4410-ad6d-463ba83e62a4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:37.913400 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-52e30dbe-2fc1-4871-87e3-00d4d985c423 req-3f05dd1d-2123-4410-ad6d-463ba83e62a4 service nova] Creating event network-changed:6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9 for instance 0b1a80e3-263a-4ff5-9417-defdda26f981 on nch1-master-1 Nov 27 21:05:37.920064 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-52e30dbe-2fc1-4871-87e3-00d4d985c423 req-3f05dd1d-2123-4410-ad6d-463ba83e62a4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042199 Nov 27 21:05:37.924521 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2594/5301] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:37.992805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db65faac-3325-4f7d-bcf3-78332a7c3c69 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:37.996494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db65faac-3325-4f7d-bcf3-78332a7c3c69 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:38.009832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db65faac-3325-4f7d-bcf3-78332a7c3c69 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:38.010629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db65faac-3325-4f7d-bcf3-78332a7c3c69 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:38.014742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db65faac-3325-4f7d-bcf3-78332a7c3c69 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:38.016352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db65faac-3325-4f7d-bcf3-78332a7c3c69 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:38.065795 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db65faac-3325-4f7d-bcf3-78332a7c3c69 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.082841 Nov 27 21:05:38.074415 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2595/5302] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:37 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:38.277093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:38.288718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:38.296257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:38.297804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e3a752d9-70ef-49ba-b929-7e43a02d6a30 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1317 microversion: 2.21 time: 0.569203 Nov 27 21:05:38.298504 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2708/5303] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:37 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:38.887865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-754f6892-80a1-4d00-835b-8b3a52801f19 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:38.888986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-754f6892-80a1-4d00-835b-8b3a52801f19 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:38.905699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-754f6892-80a1-4d00-835b-8b3a52801f19 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:38.906500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-754f6892-80a1-4d00-835b-8b3a52801f19 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:38.907766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-754f6892-80a1-4d00-835b-8b3a52801f19 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:38.908698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-754f6892-80a1-4d00-835b-8b3a52801f19 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:38.959972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-754f6892-80a1-4d00-835b-8b3a52801f19 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.076826 Nov 27 21:05:38.960649 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2596/5304] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:38 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:39.087512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53e6104a-c49f-4443-827d-9cc211dd3d7d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:39.090604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53e6104a-c49f-4443-827d-9cc211dd3d7d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:39.099134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53e6104a-c49f-4443-827d-9cc211dd3d7d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:39.099857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53e6104a-c49f-4443-827d-9cc211dd3d7d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:39.100830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53e6104a-c49f-4443-827d-9cc211dd3d7d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:39.102178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53e6104a-c49f-4443-827d-9cc211dd3d7d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:39.164172 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53e6104a-c49f-4443-827d-9cc211dd3d7d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.082965 Nov 27 21:05:39.165645 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2709/5305] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:39 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:39.324773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:39.326608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:39.336629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:39.337034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:39.354556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:39.357183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:39.970689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-427939e6-dd52-4b5b-93ea-da1090992d70 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:39.972523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-427939e6-dd52-4b5b-93ea-da1090992d70 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:39.984777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-427939e6-dd52-4b5b-93ea-da1090992d70 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:39.991931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-427939e6-dd52-4b5b-93ea-da1090992d70 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:39.993087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-427939e6-dd52-4b5b-93ea-da1090992d70 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:39.993800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-427939e6-dd52-4b5b-93ea-da1090992d70 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:40.071821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-427939e6-dd52-4b5b-93ea-da1090992d70 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.105132 Nov 27 21:05:40.072478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2710/5306] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:39 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:40.125500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:40.134469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:40.137442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:40.138692 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5a2ab57-c915-4b89-a8b2-63286d1957d0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.824323 Nov 27 21:05:40.148524 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2597/5307] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:39 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:40.177399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9d92c6d-ced3-4b20-b3cf-aa14067630f3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:40.179617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9d92c6d-ced3-4b20-b3cf-aa14067630f3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:40.196039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9d92c6d-ced3-4b20-b3cf-aa14067630f3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:40.196505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9d92c6d-ced3-4b20-b3cf-aa14067630f3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:40.197316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9d92c6d-ced3-4b20-b3cf-aa14067630f3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:40.199390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9d92c6d-ced3-4b20-b3cf-aa14067630f3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:40.302242 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9d92c6d-ced3-4b20-b3cf-aa14067630f3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.128793 Nov 27 21:05:40.307625 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2711/5308] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:40 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:41.082043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7744bd2c-c52f-48f2-a5ad-1cf0a3b5b2b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:41.082989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7744bd2c-c52f-48f2-a5ad-1cf0a3b5b2b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:41.111442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7744bd2c-c52f-48f2-a5ad-1cf0a3b5b2b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:41.119509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7744bd2c-c52f-48f2-a5ad-1cf0a3b5b2b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:41.120521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7744bd2c-c52f-48f2-a5ad-1cf0a3b5b2b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:41.121243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7744bd2c-c52f-48f2-a5ad-1cf0a3b5b2b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:41.168330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:41.169383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:41.181239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:41.187387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:41.192950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:41.195432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:41.229654 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7744bd2c-c52f-48f2-a5ad-1cf0a3b5b2b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.151020 Nov 27 21:05:41.230772 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2598/5309] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:41 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:41.317238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c64ee078-ef67-4f58-81d2-465536498e66 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:41.323544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c64ee078-ef67-4f58-81d2-465536498e66 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:41.340675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64ee078-ef67-4f58-81d2-465536498e66 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:41.342918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64ee078-ef67-4f58-81d2-465536498e66 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:41.346846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64ee078-ef67-4f58-81d2-465536498e66 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:41.348216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c64ee078-ef67-4f58-81d2-465536498e66 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:41.437005 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c64ee078-ef67-4f58-81d2-465536498e66 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.123073 Nov 27 21:05:41.439492 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2599/5310] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:41 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:41.799412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a3b9a0a7-67d1-4e8f-ad68-2f4fed4f1d73 req-c063fb77-ca14-40e6-81db-16184a50a5bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2", "tag": "4f813a81-a1ca-4308-9357-5abcfebd3d48"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:41.805067 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:41.805067 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:41.848549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a3b9a0a7-67d1-4e8f-ad68-2f4fed4f1d73 req-c063fb77-ca14-40e6-81db-16184a50a5bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:41.849018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a3b9a0a7-67d1-4e8f-ad68-2f4fed4f1d73 req-c063fb77-ca14-40e6-81db-16184a50a5bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:41.873977 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a3b9a0a7-67d1-4e8f-ad68-2f4fed4f1d73 req-c063fb77-ca14-40e6-81db-16184a50a5bd service nova] Creating event network-changed:4f813a81-a1ca-4308-9357-5abcfebd3d48 for instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 on nch2-master-1 Nov 27 21:05:41.883004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a3b9a0a7-67d1-4e8f-ad68-2f4fed4f1d73 req-c063fb77-ca14-40e6-81db-16184a50a5bd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086746 Nov 27 21:05:41.884230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2600/5311] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:05:41.926833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:41.945396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:41.947546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:41.950225 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-480f3379-5cc7-4da8-8de2-00689890e1e9 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.787297 Nov 27 21:05:41.952003 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2712/5312] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:41 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:05:42.245522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49d02476-9cc0-4daa-8e89-0863115b33fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:42.248458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49d02476-9cc0-4daa-8e89-0863115b33fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:42.260752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49d02476-9cc0-4daa-8e89-0863115b33fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:42.261828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49d02476-9cc0-4daa-8e89-0863115b33fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:42.262968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49d02476-9cc0-4daa-8e89-0863115b33fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:42.264047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49d02476-9cc0-4daa-8e89-0863115b33fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:42.284280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1093046907", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:42.329674 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49d02476-9cc0-4daa-8e89-0863115b33fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.090773 Nov 27 21:05:42.330753 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2601/5313] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:42 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:42.353766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:05:42.456372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-054da53b-008d-4f22-8557-1b710f838d56 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:42.457835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-054da53b-008d-4f22-8557-1b710f838d56 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:42.467065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-054da53b-008d-4f22-8557-1b710f838d56 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:42.467636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-054da53b-008d-4f22-8557-1b710f838d56 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:42.468516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-054da53b-008d-4f22-8557-1b710f838d56 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:42.469060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-054da53b-008d-4f22-8557-1b710f838d56 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:42.521100 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-054da53b-008d-4f22-8557-1b710f838d56 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.074019 Nov 27 21:05:42.523329 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2602/5314] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:42 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:42.969977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:42.970958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:42.979409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:42.980055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:42.981004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:42.981612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:43.131909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:43.140487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:43.142224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:43.143495 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6410b06c-bca7-4f88-9399-e5879d3a28c2 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.177588 Nov 27 21:05:43.144129 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2603/5315] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:42 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:43.340242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4f9ac5f7-3e26-4e10-8633-d92845e7ab3b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:43.341859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4f9ac5f7-3e26-4e10-8633-d92845e7ab3b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:43.349163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f9ac5f7-3e26-4e10-8633-d92845e7ab3b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:43.349839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f9ac5f7-3e26-4e10-8633-d92845e7ab3b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:43.353123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f9ac5f7-3e26-4e10-8633-d92845e7ab3b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:43.353608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f9ac5f7-3e26-4e10-8633-d92845e7ab3b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:43.401509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:05:43.401985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:05:43.403921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:05:43.404215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:05:43.405682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:05:43.415383 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4f9ac5f7-3e26-4e10-8633-d92845e7ab3b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.078621 Nov 27 21:05:43.418657 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2604/5316] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:43 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:43.429216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:43.429751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:43.447336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:43.447931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:43.481095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Getting quotas for project 4732694cf811451b8ffabd706cd72965. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:05:43.487221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Getting quotas for user e3dacaf685b54cf89bc9aa4e050b9a74 and project 4732694cf811451b8ffabd706cd72965. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:05:43.516261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:05:43.536191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe26135b-d39b-4760-9aef-82e51afab41d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:43.537310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe26135b-d39b-4760-9aef-82e51afab41d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:43.541034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:05:43.551691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26135b-d39b-4760-9aef-82e51afab41d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:43.552156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26135b-d39b-4760-9aef-82e51afab41d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:43.562865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26135b-d39b-4760-9aef-82e51afab41d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:43.563358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26135b-d39b-4760-9aef-82e51afab41d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:43.646840 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bba60886-2457-473f-a365-84fa78585ec2 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.365489 Nov 27 21:05:43.648943 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2713/5317] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:05:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:05:43.662699 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe26135b-d39b-4760-9aef-82e51afab41d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.132122 Nov 27 21:05:43.664380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2605/5318] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:43 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:43.681701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d7f0dca1-9d26-4ec4-b102-44fd22fb3a34 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:43.684039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d7f0dca1-9d26-4ec4-b102-44fd22fb3a34 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:43.845934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d7f0dca1-9d26-4ec4-b102-44fd22fb3a34 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:43.860916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d7f0dca1-9d26-4ec4-b102-44fd22fb3a34 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1215 microversion: 2.1 time: 0.192477 Nov 27 21:05:43.863910 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2714/5319] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:43 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:44.164057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:44.164909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:44.192346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.194379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:44.195519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.204298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:44.429080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8292dd9-c69e-4a9d-88a8-3589a3f451b4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:44.433914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8292dd9-c69e-4a9d-88a8-3589a3f451b4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:44.447850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8292dd9-c69e-4a9d-88a8-3589a3f451b4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.459902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8292dd9-c69e-4a9d-88a8-3589a3f451b4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:44.461102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8292dd9-c69e-4a9d-88a8-3589a3f451b4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.461707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8292dd9-c69e-4a9d-88a8-3589a3f451b4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:44.523688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8292dd9-c69e-4a9d-88a8-3589a3f451b4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.096103 Nov 27 21:05:44.529834 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2715/5320] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:44 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:44.676297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-844b299d-9437-4a35-90df-f5a56d44c3d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:44.677585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-844b299d-9437-4a35-90df-f5a56d44c3d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:44.684828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-844b299d-9437-4a35-90df-f5a56d44c3d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.685269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-844b299d-9437-4a35-90df-f5a56d44c3d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:44.686072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-844b299d-9437-4a35-90df-f5a56d44c3d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.686497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-844b299d-9437-4a35-90df-f5a56d44c3d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:44.733900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-844b299d-9437-4a35-90df-f5a56d44c3d2 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.061731 Nov 27 21:05:44.738421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2716/5321] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:44 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:44.793309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:44.801560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:44.803112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:44.804937 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-777fcad0-173a-4f20-9059-95ae1e4b333d tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.646177 Nov 27 21:05:44.810114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2606/5322] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:44 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:44.882298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:44.883266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:44.891017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.891685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:44.893557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:44.894148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:45.012676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:45.026086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ffb49e5f-bb83-481d-b4c2-a22db5120c8a tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1267 microversion: 2.1 time: 0.148847 Nov 27 21:05:45.027223 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2717/5323] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:44 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:45.543952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-127d6d4b-cdf6-425d-8e5e-7625aea5ece8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:45.545535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-127d6d4b-cdf6-425d-8e5e-7625aea5ece8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:45.573821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127d6d4b-cdf6-425d-8e5e-7625aea5ece8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:45.574601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127d6d4b-cdf6-425d-8e5e-7625aea5ece8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:45.580319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127d6d4b-cdf6-425d-8e5e-7625aea5ece8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:45.581153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127d6d4b-cdf6-425d-8e5e-7625aea5ece8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:45.658665 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-127d6d4b-cdf6-425d-8e5e-7625aea5ece8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 14 microversion: 2.20 time: 0.126477 Nov 27 21:05:45.662933 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2607/5324] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:45 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:45.749356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b54f2ab-9ece-4b66-b818-e81a1dc57b6a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:45.752923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b54f2ab-9ece-4b66-b818-e81a1dc57b6a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:45.771197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b54f2ab-9ece-4b66-b818-e81a1dc57b6a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:45.772839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b54f2ab-9ece-4b66-b818-e81a1dc57b6a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:45.773745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b54f2ab-9ece-4b66-b818-e81a1dc57b6a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:45.775743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b54f2ab-9ece-4b66-b818-e81a1dc57b6a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:45.826551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:45.827137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:45.847874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:45.848349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:45.849166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:45.849853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:45.860780 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b54f2ab-9ece-4b66-b818-e81a1dc57b6a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.118289 Nov 27 21:05:45.862483 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2718/5325] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:45 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:46.049816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:46.052075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:46.065999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:46.073039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:46.076212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:46.076966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:46.232861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:46.240155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:46.240832 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3bac23ce-c9e6-4143-8dc7-4458494ceded tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1273 microversion: 2.1 time: 0.200614 Nov 27 21:05:46.243590 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2719/5326] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:46 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:46.254134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:46.256915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:46.260555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-adea7079-cba2-4df8-b02d-a075257ea548 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.440081 Nov 27 21:05:46.275806 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2608/5327] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:45 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:46.670664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-127ff09b-3f8a-48e5-baf3-fb201b0bc72a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:46.671838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-127ff09b-3f8a-48e5-baf3-fb201b0bc72a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:46.679150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127ff09b-3f8a-48e5-baf3-fb201b0bc72a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:46.679742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127ff09b-3f8a-48e5-baf3-fb201b0bc72a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:46.680614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127ff09b-3f8a-48e5-baf3-fb201b0bc72a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:46.681124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127ff09b-3f8a-48e5-baf3-fb201b0bc72a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:46.750613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-127ff09b-3f8a-48e5-baf3-fb201b0bc72a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 8208 microversion: 2.20 time: 0.083835 Nov 27 21:05:46.755409 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2720/5328] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:46 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 8208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:46.874124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3a190c5-02bb-4bda-b1ac-53c636644a18 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:46.875768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3a190c5-02bb-4bda-b1ac-53c636644a18 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:46.884115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a190c5-02bb-4bda-b1ac-53c636644a18 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:46.884823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a190c5-02bb-4bda-b1ac-53c636644a18 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:46.886098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a190c5-02bb-4bda-b1ac-53c636644a18 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:46.886743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a190c5-02bb-4bda-b1ac-53c636644a18 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:46.940724 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3a190c5-02bb-4bda-b1ac-53c636644a18 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.070404 Nov 27 21:05:46.942940 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2609/5329] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:46 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:47.259365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:47.260053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:47.268985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.269483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.270267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.270704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.284617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:47.286000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:47.297562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.298519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.305020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.306124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.502742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:47.520913 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cebf0fce-3c60-4f6d-8de4-7e321ae79f70 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.266130 Nov 27 21:05:47.531087 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2721/5330] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:47 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:47.617408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:47.628270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:47.633447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:47.634835 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc250a30-4bde-4ccd-bdbc-930e7804e3f6 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.354692 Nov 27 21:05:47.636002 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2610/5331] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:47 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:47.763622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-369f7bee-ab24-4515-8e82-39ee655a1098 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:47.764652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-369f7bee-ab24-4515-8e82-39ee655a1098 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:47.776220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-369f7bee-ab24-4515-8e82-39ee655a1098 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.776938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-369f7bee-ab24-4515-8e82-39ee655a1098 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.778444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-369f7bee-ab24-4515-8e82-39ee655a1098 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.779135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-369f7bee-ab24-4515-8e82-39ee655a1098 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.813928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-27c50caf-4222-4503-9b38-da9680ac6691 req-4abbbce2-c4bb-4e25-abe5-fce7949aa137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1f2144-f62b-4da2-b69c-0387745fda48", "tag": "7edfdb58-5a15-4344-b301-c4b75f20ad29"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:47.817533 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:47.817533 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:47.863418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-369f7bee-ab24-4515-8e82-39ee655a1098 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 8208 microversion: 2.20 time: 0.101857 Nov 27 21:05:47.863620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-27c50caf-4222-4503-9b38-da9680ac6691 req-4abbbce2-c4bb-4e25-abe5-fce7949aa137 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.864017 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2722/5332] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:47 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 8208 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:47.864538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-27c50caf-4222-4503-9b38-da9680ac6691 req-4abbbce2-c4bb-4e25-abe5-fce7949aa137 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.891553 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-27c50caf-4222-4503-9b38-da9680ac6691 req-4abbbce2-c4bb-4e25-abe5-fce7949aa137 service nova] Creating event network-changed:7edfdb58-5a15-4344-b301-c4b75f20ad29 for instance cb1f2144-f62b-4da2-b69c-0387745fda48 on nch2-master-1 Nov 27 21:05:47.904799 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-27c50caf-4222-4503-9b38-da9680ac6691 req-4abbbce2-c4bb-4e25-abe5-fce7949aa137 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095367 Nov 27 21:05:47.905604 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2611/5333] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:47.958166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-565427db-3bd3-479c-af63-b19cb2958080 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:47.959286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-565427db-3bd3-479c-af63-b19cb2958080 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:47.967131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-565427db-3bd3-479c-af63-b19cb2958080 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.967868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-565427db-3bd3-479c-af63-b19cb2958080 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:47.968814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-565427db-3bd3-479c-af63-b19cb2958080 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:47.969600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-565427db-3bd3-479c-af63-b19cb2958080 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:48.040109 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-565427db-3bd3-479c-af63-b19cb2958080 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.087478 Nov 27 21:05:48.046815 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2723/5334] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:47 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:48.539647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:48.540537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:48.548436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:48.548952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:48.549992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:48.550984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:48.654287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:48.655219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:48.662877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:48.663439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:48.664289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:48.664942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:48.852768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:48.861513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:48.863670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:48.864796 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e864df0d-f0a5-4303-9832-807c930eb77a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.214665 Nov 27 21:05:48.865390 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2724/5335] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:48 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:05:48.879694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0d72e0d-82df-450a-9a47-c57417ca9b01 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:48.880548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0d72e0d-82df-450a-9a47-c57417ca9b01 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:48.886390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d72e0d-82df-450a-9a47-c57417ca9b01 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:48.886841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d72e0d-82df-450a-9a47-c57417ca9b01 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:48.887655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d72e0d-82df-450a-9a47-c57417ca9b01 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:48.888095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d72e0d-82df-450a-9a47-c57417ca9b01 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:48.940064 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0d72e0d-82df-450a-9a47-c57417ca9b01 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 16401 microversion: 2.20 time: 0.064329 Nov 27 21:05:48.943748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2725/5336] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:48 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 16401 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:49.014118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:49.024397 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d3b59043-8c2e-4c5d-ba9d-cc94876444e0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.490031 Nov 27 21:05:49.034078 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2612/5337] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:48 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:49.054677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21e3fa09-caa8-4930-b4a4-ee07c1791bdc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:49.055700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21e3fa09-caa8-4930-b4a4-ee07c1791bdc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:49.063147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3fa09-caa8-4930-b4a4-ee07c1791bdc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:49.063628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3fa09-caa8-4930-b4a4-ee07c1791bdc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:49.064436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3fa09-caa8-4930-b4a4-ee07c1791bdc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:49.065105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3fa09-caa8-4930-b4a4-ee07c1791bdc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:49.115956 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21e3fa09-caa8-4930-b4a4-ee07c1791bdc tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.064743 Nov 27 21:05:49.116877 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2726/5338] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:49 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:49.883503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:49.884125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:49.890600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:49.891346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:49.892258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:49.892792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:49.952873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a4e18b47-adfe-4aa1-b74a-2ad9f0dd556f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:49.954117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a4e18b47-adfe-4aa1-b74a-2ad9f0dd556f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:49.961069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4e18b47-adfe-4aa1-b74a-2ad9f0dd556f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:49.961701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4e18b47-adfe-4aa1-b74a-2ad9f0dd556f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:49.962684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4e18b47-adfe-4aa1-b74a-2ad9f0dd556f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:49.963308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4e18b47-adfe-4aa1-b74a-2ad9f0dd556f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:50.008302 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a4e18b47-adfe-4aa1-b74a-2ad9f0dd556f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 16401 microversion: 2.20 time: 0.059957 Nov 27 21:05:50.013119 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2727/5339] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:49 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 16401 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:50.049681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:50.051435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:50.061251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:50.061764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:50.062787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:50.063458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:50.154831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:50.163497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:50.165010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:50.166133 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efb41c97-16be-4bf3-b4c8-24dc9713f13b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.287747 Nov 27 21:05:50.181382 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2613/5340] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:49 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:50.187708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c707589f-7938-49eb-8384-b9b4ba770cd3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:50.188771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c707589f-7938-49eb-8384-b9b4ba770cd3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:50.195156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c707589f-7938-49eb-8384-b9b4ba770cd3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:50.195816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c707589f-7938-49eb-8384-b9b4ba770cd3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:50.197305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c707589f-7938-49eb-8384-b9b4ba770cd3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:50.198156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c707589f-7938-49eb-8384-b9b4ba770cd3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:50.261555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c707589f-7938-49eb-8384-b9b4ba770cd3 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.088804 Nov 27 21:05:50.266071 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2614/5341] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:50 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:50.380357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:50.394891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3ea71539-fca3-402c-a1a8-fb9f5fcc04b9 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.355689 Nov 27 21:05:50.395790 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2728/5342] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:50 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:50.516871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-012277b5-5570-4130-b108-86ce3f6b9f52 req-b7653efc-f50b-4e39-b0a6-0d0ab539cfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2", "name": "network-vif-plugged", "status": "completed", "tag": "4f813a81-a1ca-4308-9357-5abcfebd3d48"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:50.519675 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:50.519675 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:50.529812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-012277b5-5570-4130-b108-86ce3f6b9f52 req-b7653efc-f50b-4e39-b0a6-0d0ab539cfcc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:50.530297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-012277b5-5570-4130-b108-86ce3f6b9f52 req-b7653efc-f50b-4e39-b0a6-0d0ab539cfcc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:50.543331 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-012277b5-5570-4130-b108-86ce3f6b9f52 req-b7653efc-f50b-4e39-b0a6-0d0ab539cfcc service nova] Creating event network-vif-plugged:4f813a81-a1ca-4308-9357-5abcfebd3d48 for instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 on nch2-master-1 Nov 27 21:05:50.548821 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-012277b5-5570-4130-b108-86ce3f6b9f52 req-b7653efc-f50b-4e39-b0a6-0d0ab539cfcc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038433 Nov 27 21:05:50.550760 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2615/5343] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:51.022817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dbb15d35-6e30-4593-bcd3-bf1db1ab4e86 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:51.024798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dbb15d35-6e30-4593-bcd3-bf1db1ab4e86 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:51.034307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbb15d35-6e30-4593-bcd3-bf1db1ab4e86 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.035915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbb15d35-6e30-4593-bcd3-bf1db1ab4e86 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.036727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbb15d35-6e30-4593-bcd3-bf1db1ab4e86 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.037684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbb15d35-6e30-4593-bcd3-bf1db1ab4e86 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.090610 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dbb15d35-6e30-4593-bcd3-bf1db1ab4e86 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 16401 microversion: 2.20 time: 0.072863 Nov 27 21:05:51.094288 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2729/5344] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:51 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 16401 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:51.190306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:51.192436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:51.204036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.204593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.208125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.208125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.274496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9437210e-7fa4-424f-b43d-3a4aef845253 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:51.275950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9437210e-7fa4-424f-b43d-3a4aef845253 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:51.283056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9437210e-7fa4-424f-b43d-3a4aef845253 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.287299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9437210e-7fa4-424f-b43d-3a4aef845253 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.288383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9437210e-7fa4-424f-b43d-3a4aef845253 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.289049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9437210e-7fa4-424f-b43d-3a4aef845253 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.394743 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9437210e-7fa4-424f-b43d-3a4aef845253 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.122667 Nov 27 21:05:51.401483 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2730/5345] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:51 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:51.421419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:51.422456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:51.453928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.454694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.455891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:51.457343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:51.576641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:51.589102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:51.590783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:51.592084 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1487c196-e53f-4a4e-b4f0-976fe245d0f0 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1359 microversion: 2.21 time: 0.406671 Nov 27 21:05:51.592855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2616/5346] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:51 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:51.864000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:51.871587 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4397af9-6d0f-4620-96ed-9c230956d251 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.461819 Nov 27 21:05:51.872154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2731/5347] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:51 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:52.102838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e5faf03-a967-4bde-9ab1-b032d240c3e6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:52.103991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e5faf03-a967-4bde-9ab1-b032d240c3e6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:52.111241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e5faf03-a967-4bde-9ab1-b032d240c3e6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.111973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e5faf03-a967-4bde-9ab1-b032d240c3e6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:52.113162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e5faf03-a967-4bde-9ab1-b032d240c3e6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.114070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e5faf03-a967-4bde-9ab1-b032d240c3e6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:52.172827 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e5faf03-a967-4bde-9ab1-b032d240c3e6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 16401 microversion: 2.20 time: 0.073162 Nov 27 21:05:52.177430 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2617/5348] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:52 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 16401 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:52.409019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d7e0e43-6e42-4ed6-af46-c30e4bee576c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:52.410699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d7e0e43-6e42-4ed6-af46-c30e4bee576c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:52.417891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7e0e43-6e42-4ed6-af46-c30e4bee576c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.418697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7e0e43-6e42-4ed6-af46-c30e4bee576c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:52.419665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7e0e43-6e42-4ed6-af46-c30e4bee576c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.420308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7e0e43-6e42-4ed6-af46-c30e4bee576c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:52.486744 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d7e0e43-6e42-4ed6-af46-c30e4bee576c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.081001 Nov 27 21:05:52.492632 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2732/5349] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:52 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:52.613619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:52.614338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:52.623102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.623860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:52.625030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.626665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:52.888884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:52.889669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:52.898020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.898786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:52.899811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:52.900407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.099101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:53.115103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f2e5a42-7f18-480e-8e7e-211c48bf6537 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.225844 Nov 27 21:05:53.115103 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2733/5350] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:52 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:05:53.132252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:53.142825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:53.144328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:53.146964 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56da42a1-739a-482a-aa21-265c810b7478 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1551 microversion: 2.21 time: 0.539895 Nov 27 21:05:53.149553 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2618/5351] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:52 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1551 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:53.166763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:53.168693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:53.182870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.185771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97581167-b861-4e5f-8e75-ab2ab227c126 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:53.186183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.187215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-97581167-b861-4e5f-8e75-ab2ab227c126 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:53.189703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.190446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.202906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97581167-b861-4e5f-8e75-ab2ab227c126 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.203743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97581167-b861-4e5f-8e75-ab2ab227c126 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.204954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97581167-b861-4e5f-8e75-ab2ab227c126 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.205634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97581167-b861-4e5f-8e75-ab2ab227c126 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.257692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:05:53.322727 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97581167-b861-4e5f-8e75-ab2ab227c126 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.136982 Nov 27 21:05:53.326905 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2619/5352] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:53 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:53.479652 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4969fe95-f55d-4b33-bf5d-68458f90c544 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 204 len: 0 microversion: 2.21 time: 0.317231 Nov 27 21:05:53.480772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2734/5353] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 21:05:53 2021] DELETE /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:05:53.489906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:53.490890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:53.502464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8f79fa2-24dd-45fe-878a-eca6c1450063 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:53.503901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8f79fa2-24dd-45fe-878a-eca6c1450063 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:53.504623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.505091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.505902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.506354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.519719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8f79fa2-24dd-45fe-878a-eca6c1450063 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.520272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8f79fa2-24dd-45fe-878a-eca6c1450063 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.521427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8f79fa2-24dd-45fe-878a-eca6c1450063 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:53.528687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8f79fa2-24dd-45fe-878a-eca6c1450063 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:53.624689 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8f79fa2-24dd-45fe-878a-eca6c1450063 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.127867 Nov 27 21:05:53.628814 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2735/5354] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:53 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:53.716305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:53.728049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:53.730327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:53.731926 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b91ec623-6e0d-4ed4-b70d-befc1151494c tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1557 microversion: 2.21 time: 0.246193 Nov 27 21:05:53.744930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2620/5355] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:53 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1557 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:54.129637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:54.130673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:54.137649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.138106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.138891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.139527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.332128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebcd58b8-5b0b-4db9-99da-f26a7c1e8ab9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:54.335109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebcd58b8-5b0b-4db9-99da-f26a7c1e8ab9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:54.337187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:54.342322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebcd58b8-5b0b-4db9-99da-f26a7c1e8ab9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.343111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebcd58b8-5b0b-4db9-99da-f26a7c1e8ab9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.344172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebcd58b8-5b0b-4db9-99da-f26a7c1e8ab9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.344820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebcd58b8-5b0b-4db9-99da-f26a7c1e8ab9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.348145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-726d790c-8adf-4ac5-b64a-3142a4956512 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.223174 Nov 27 21:05:54.349617 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2736/5356] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:54 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:54.399996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebcd58b8-5b0b-4db9-99da-f26a7c1e8ab9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.071257 Nov 27 21:05:54.401121 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2621/5357] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:54 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:54.640702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ff6242a-0518-4a7d-ab16-ff17e99ee608 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:54.641934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ff6242a-0518-4a7d-ab16-ff17e99ee608 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:54.649385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff6242a-0518-4a7d-ab16-ff17e99ee608 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.650289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff6242a-0518-4a7d-ab16-ff17e99ee608 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.651300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff6242a-0518-4a7d-ab16-ff17e99ee608 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.652113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ff6242a-0518-4a7d-ab16-ff17e99ee608 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.712280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] Calling method '.version_select at 0x7f15c6d97670>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:54.713186 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:54.713186 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:05:54.714682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.715132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.717398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ff6242a-0518-4a7d-ab16-ff17e99ee608 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.080606 Nov 27 21:05:54.724004 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2622/5358] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:54 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:54.734573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.735026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.746217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.746672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.752908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:54.753260 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d52e192-e4be-451b-9fe5-2a189c37dd9a tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225 tempest-PortsAdminExtendedAttrsIpV6TestJSON-370891225-project-admin] 10.222.0.21 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.175557 Nov 27 21:05:54.754015 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2737/5359] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 21:05:54 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:54.754628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:54.763868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.764696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.765837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:54.766323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:54.996459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:55.005758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:55.007421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:55.008874 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc63b221-c1a0-4262-aef1-f7da0772fdf8 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1557 microversion: 2.21 time: 0.260247 Nov 27 21:05:55.009748 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2623/5360] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:54 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1557 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:55.365759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:55.366368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:55.373041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:55.373721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:55.374678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:55.375311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:55.411923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eca0b95e-424c-40e7-8bd0-c31818dd258e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:55.413149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eca0b95e-424c-40e7-8bd0-c31818dd258e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:55.424599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca0b95e-424c-40e7-8bd0-c31818dd258e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:55.427902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca0b95e-424c-40e7-8bd0-c31818dd258e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:55.428975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca0b95e-424c-40e7-8bd0-c31818dd258e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:55.429436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eca0b95e-424c-40e7-8bd0-c31818dd258e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:55.505101 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eca0b95e-424c-40e7-8bd0-c31818dd258e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.096876 Nov 27 21:05:55.509108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2624/5361] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:55 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:05:55.616641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:55.625554 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70dddca5-4aec-4118-ab92-b01346f96d7e tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.263371 Nov 27 21:05:55.626210 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2738/5362] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:55 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:55.641644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cfbf8a4d-d942-44d3-bcee-26c7443f6dcf req-9cb0667a-bdc4-4bb5-b69e-61c5f7b29b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2", "name": "network-vif-deleted", "tag": "4f813a81-a1ca-4308-9357-5abcfebd3d48"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:55.643220 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:55.643220 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:05:55.654190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cfbf8a4d-d942-44d3-bcee-26c7443f6dcf req-9cb0667a-bdc4-4bb5-b69e-61c5f7b29b3f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:55.654860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cfbf8a4d-d942-44d3-bcee-26c7443f6dcf req-9cb0667a-bdc4-4bb5-b69e-61c5f7b29b3f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:55.668066 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cfbf8a4d-d942-44d3-bcee-26c7443f6dcf req-9cb0667a-bdc4-4bb5-b69e-61c5f7b29b3f service nova] Creating event network-vif-deleted:4f813a81-a1ca-4308-9357-5abcfebd3d48 for instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 on nch2-master-1 Nov 27 21:05:55.673467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cfbf8a4d-d942-44d3-bcee-26c7443f6dcf req-9cb0667a-bdc4-4bb5-b69e-61c5f7b29b3f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036103 Nov 27 21:05:55.674620 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2625/5363] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:55.730553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61547d8d-1010-402e-bad4-7a204f520ec9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:55.731939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61547d8d-1010-402e-bad4-7a204f520ec9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:55.739855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61547d8d-1010-402e-bad4-7a204f520ec9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:55.740457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61547d8d-1010-402e-bad4-7a204f520ec9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:55.741396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61547d8d-1010-402e-bad4-7a204f520ec9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:55.742138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61547d8d-1010-402e-bad4-7a204f520ec9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:55.801844 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61547d8d-1010-402e-bad4-7a204f520ec9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.074995 Nov 27 21:05:55.803333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2739/5364] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:55 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:56.029972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:56.031406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:56.041979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.042949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.043364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.043937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.080741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.082169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.082794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lazy-loading 'fault' on Instance uuid 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:05:56.139159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:56.148265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:56.149998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cd64b2d9718476ea2c0a4255c801b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2237b56d0b4b4fa3ace78023aa3fe435', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:56.151267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c7c07696-bfff-47ad-b007-399b7697d50a tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 200 len: 1349 microversion: 2.21 time: 0.127221 Nov 27 21:05:56.151936 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2626/5365] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:56 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 1349 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:05:56.458710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0d825e69-05f1-4181-a064-82f69e7b7b23 req-5be60079-2979-4fa0-ade3-99d4534fa896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1f2144-f62b-4da2-b69c-0387745fda48", "name": "network-vif-plugged", "status": "completed", "tag": "7edfdb58-5a15-4344-b301-c4b75f20ad29"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:56.460307 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:56.460307 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:05:56.469306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0d825e69-05f1-4181-a064-82f69e7b7b23 req-5be60079-2979-4fa0-ade3-99d4534fa896 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.469758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0d825e69-05f1-4181-a064-82f69e7b7b23 req-5be60079-2979-4fa0-ade3-99d4534fa896 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.482187 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0d825e69-05f1-4181-a064-82f69e7b7b23 req-5be60079-2979-4fa0-ade3-99d4534fa896 service nova] Creating event network-vif-plugged:7edfdb58-5a15-4344-b301-c4b75f20ad29 for instance cb1f2144-f62b-4da2-b69c-0387745fda48 on nch2-master-1 Nov 27 21:05:56.487714 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0d825e69-05f1-4181-a064-82f69e7b7b23 req-5be60079-2979-4fa0-ade3-99d4534fa896 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033790 Nov 27 21:05:56.488319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2740/5366] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:05:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:05:56.519984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-383cd330-98a2-441a-9e7f-ef72085c1f9b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:56.521055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-383cd330-98a2-441a-9e7f-ef72085c1f9b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:56.529751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-383cd330-98a2-441a-9e7f-ef72085c1f9b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.530523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-383cd330-98a2-441a-9e7f-ef72085c1f9b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.531437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-383cd330-98a2-441a-9e7f-ef72085c1f9b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.532656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-383cd330-98a2-441a-9e7f-ef72085c1f9b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.584658 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-383cd330-98a2-441a-9e7f-ef72085c1f9b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.071199 Nov 27 21:05:56.588490 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2627/5367] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:56 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:56.644694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:56.645391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:56.652214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.652691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.653508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.653946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.817769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cda0f2a5-d05f-46df-9569-3b9c39d325e9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:56.822921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cda0f2a5-d05f-46df-9569-3b9c39d325e9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:56.832956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda0f2a5-d05f-46df-9569-3b9c39d325e9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.833417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda0f2a5-d05f-46df-9569-3b9c39d325e9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.834220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda0f2a5-d05f-46df-9569-3b9c39d325e9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:56.834665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda0f2a5-d05f-46df-9569-3b9c39d325e9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:56.882182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:56.890109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cda0f2a5-d05f-46df-9569-3b9c39d325e9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.077512 Nov 27 21:05:56.894894 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-93d5c58c-fb77-44c3-b267-0f5e1234ad71 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.251347 Nov 27 21:05:56.895185 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2628/5368] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:56 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:56.895317 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2741/5369] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:56 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:57.170794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:57.171706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:57.179274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.179749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.180627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.181096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.196269 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] HTTP exception thrown: Instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 could not be found. Nov 27 21:05:57.196874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Returning 404 to user: Instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:57.197777 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a9e1fbf-23b7-42c9-b6d8-8e19e951c742 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 404 len: 111 microversion: 2.21 time: 0.031130 Nov 27 21:05:57.198418 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2629/5370] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:05:57 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:05:57.206839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35169490-fa5d-4c41-8c58-42bdc991463b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '.version_select at 0x7f15d93c30d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:57.207511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35169490-fa5d-4c41-8c58-42bdc991463b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:57.214108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35169490-fa5d-4c41-8c58-42bdc991463b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.214557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35169490-fa5d-4c41-8c58-42bdc991463b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.215383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35169490-fa5d-4c41-8c58-42bdc991463b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.215825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35169490-fa5d-4c41-8c58-42bdc991463b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.285493 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35169490-fa5d-4c41-8c58-42bdc991463b tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.082555 Nov 27 21:05:57.286212 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2742/5371] 10.222.0.21 () {60 vars in 1336 bytes} [Sat Nov 27 21:05:57 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2/os-instance-actions => generated 611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:05:57.298447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:57.299291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:57.312828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.313297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.314113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.324008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.338560 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] HTTP exception thrown: Instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 could not be found. Nov 27 21:05:57.339372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Returning 404 to user: Instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:57.340221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-209f82f0-2ef3-4837-8014-b05fabca7a54 tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 404 len: 111 microversion: 2.1 time: 0.046017 Nov 27 21:05:57.340778 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2630/5372] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:05:57 2021] DELETE /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:05:57.349013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:57.350001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] [instance: 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:57.356185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.356841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.357841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.358464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.375192 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] HTTP exception thrown: Instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 could not be found. Nov 27 21:05:57.376113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] Returning 404 to user: Instance 2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:05:57.377074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f33b3bc-f861-492a-bf62-1afe75dec2db tempest-InstanceActionsV221TestJSON-20452772 tempest-InstanceActionsV221TestJSON-20452772-project] 10.222.0.21 "GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2" status: 404 len: 111 microversion: 2.1 time: 0.032223 Nov 27 21:05:57.377791 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2743/5373] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:57 2021] GET /compute/v2.1/servers/2a4eb675-fcde-4cac-8b59-2e3bec9e8cf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:05:57.602148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a8564fa-b72e-4593-890b-13c63d68c9c8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:57.605468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a8564fa-b72e-4593-890b-13c63d68c9c8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:57.612166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a8564fa-b72e-4593-890b-13c63d68c9c8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.613347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a8564fa-b72e-4593-890b-13c63d68c9c8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.614156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a8564fa-b72e-4593-890b-13c63d68c9c8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.614598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a8564fa-b72e-4593-890b-13c63d68c9c8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.655619 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a8564fa-b72e-4593-890b-13c63d68c9c8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.062696 Nov 27 21:05:57.660008 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2631/5374] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:57 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:57.903528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-303540d2-47e2-40f3-aff7-8d35d32b6053 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:57.905235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-303540d2-47e2-40f3-aff7-8d35d32b6053 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:57.913586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:57.914293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:57.914566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-303540d2-47e2-40f3-aff7-8d35d32b6053 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.915438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-303540d2-47e2-40f3-aff7-8d35d32b6053 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.917142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-303540d2-47e2-40f3-aff7-8d35d32b6053 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.917654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-303540d2-47e2-40f3-aff7-8d35d32b6053 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.923671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.925050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.926038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:57.926639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:57.975609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-303540d2-47e2-40f3-aff7-8d35d32b6053 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.076894 Nov 27 21:05:57.976600 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2744/5375] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:57 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:58.364787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:58.372845 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61001068-16fb-4d15-8672-d864c3deb6dd tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1315 microversion: 2.1 time: 0.464097 Nov 27 21:05:58.373423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2632/5376] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:57 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:58.668512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-245d1286-4327-42a4-a2d4-d4cc0a0cf4ea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:58.669523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-245d1286-4327-42a4-a2d4-d4cc0a0cf4ea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:58.676918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1286-4327-42a4-a2d4-d4cc0a0cf4ea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:58.677563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1286-4327-42a4-a2d4-d4cc0a0cf4ea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:58.678599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1286-4327-42a4-a2d4-d4cc0a0cf4ea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:58.679185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1286-4327-42a4-a2d4-d4cc0a0cf4ea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:58.728582 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-245d1286-4327-42a4-a2d4-d4cc0a0cf4ea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.062916 Nov 27 21:05:58.735391 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2745/5377] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:58 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:58.989408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07923221-f18e-455b-aae8-fd81d6395544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:58.990453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07923221-f18e-455b-aae8-fd81d6395544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:59.007092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07923221-f18e-455b-aae8-fd81d6395544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.008052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07923221-f18e-455b-aae8-fd81d6395544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.009097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07923221-f18e-455b-aae8-fd81d6395544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.009740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07923221-f18e-455b-aae8-fd81d6395544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.071758 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07923221-f18e-455b-aae8-fd81d6395544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.087364 Nov 27 21:05:59.073260 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2633/5378] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:58 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:59.391189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:59.392514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:59.402633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.403387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.404411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.405324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.651953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:05:59.673011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e70e1e6-7996-44e4-a71b-36547f19ebe0 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1465 microversion: 2.1 time: 0.285209 Nov 27 21:05:59.676104 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2746/5379] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:59 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1465 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:05:59.721494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:59.722661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:59.747338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-24aca6c4-7d6b-4e69-8f33-663138e9cc07 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:05:59.748923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-24aca6c4-7d6b-4e69-8f33-663138e9cc07 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:59.762170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.762633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.766700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24aca6c4-7d6b-4e69-8f33-663138e9cc07 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.767661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24aca6c4-7d6b-4e69-8f33-663138e9cc07 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.768307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.769780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.771028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24aca6c4-7d6b-4e69-8f33-663138e9cc07 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.771519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24aca6c4-7d6b-4e69-8f33-663138e9cc07 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.839181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:05:59.850432 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-24aca6c4-7d6b-4e69-8f33-663138e9cc07 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.114390 Nov 27 21:05:59.851143 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2747/5380] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:05:59 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:05:59.967935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-76a79a9f-dddb-406f-a8ad-c71660fad6e7 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 204 len: 0 microversion: 2.1 time: 0.251387 Nov 27 21:05:59.970019 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2634/5381] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:05:59 2021] DELETE /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:05:59.984157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:05:59.984866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:05:59.994172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.994682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:05:59.995618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:05:59.996810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:00.086511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8786ab15-561c-4bd4-b2d1-ca7e2bb89d4e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:00.088289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8786ab15-561c-4bd4-b2d1-ca7e2bb89d4e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:00.100475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8786ab15-561c-4bd4-b2d1-ca7e2bb89d4e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:00.101077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8786ab15-561c-4bd4-b2d1-ca7e2bb89d4e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:00.102697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8786ab15-561c-4bd4-b2d1-ca7e2bb89d4e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:00.103706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8786ab15-561c-4bd4-b2d1-ca7e2bb89d4e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:00.161980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8786ab15-561c-4bd4-b2d1-ca7e2bb89d4e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.081730 Nov 27 21:06:00.163196 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2635/5382] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:00 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:00.171399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:00.181123 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9431273b-ef49-4708-b94c-24b429f73901 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1471 microversion: 2.1 time: 0.205427 Nov 27 21:06:00.181886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2748/5383] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:59 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:00.864493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3132b1f8-b897-4c63-9e12-2f99aa103de2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:00.865764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3132b1f8-b897-4c63-9e12-2f99aa103de2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:00.874179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3132b1f8-b897-4c63-9e12-2f99aa103de2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:00.875001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3132b1f8-b897-4c63-9e12-2f99aa103de2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:00.876261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3132b1f8-b897-4c63-9e12-2f99aa103de2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:00.876724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3132b1f8-b897-4c63-9e12-2f99aa103de2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:00.924820 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3132b1f8-b897-4c63-9e12-2f99aa103de2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.065962 Nov 27 21:06:00.925692 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2636/5384] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:00 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:01.174969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de25a221-68ff-405b-b58a-6e2b9fd3d9b5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:01.176093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de25a221-68ff-405b-b58a-6e2b9fd3d9b5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:01.188426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de25a221-68ff-405b-b58a-6e2b9fd3d9b5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:01.189079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de25a221-68ff-405b-b58a-6e2b9fd3d9b5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:01.189910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de25a221-68ff-405b-b58a-6e2b9fd3d9b5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:01.190391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de25a221-68ff-405b-b58a-6e2b9fd3d9b5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:01.200696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:01.201403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:01.203748 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:06:01.203898 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:06:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 (ip 10.222.0.21) !!! Nov 27 21:06:01.230122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:01.232385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:01.235795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:01.236293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:01.263399 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de25a221-68ff-405b-b58a-6e2b9fd3d9b5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.092652 Nov 27 21:06:01.264638 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2749/5385] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:01 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:01.526369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:01.540151 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca51e809-1f90-4ac8-9c0a-308c84371a66 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1471 microversion: 2.1 time: 0.344559 Nov 27 21:06:01.540787 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2637/5386] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:01 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:01.938520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3a7f57bd-d1e5-4127-a538-4de2732dfa18 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:01.939593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3a7f57bd-d1e5-4127-a538-4de2732dfa18 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:01.960739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a7f57bd-d1e5-4127-a538-4de2732dfa18 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:01.961198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a7f57bd-d1e5-4127-a538-4de2732dfa18 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:01.962097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a7f57bd-d1e5-4127-a538-4de2732dfa18 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:01.962434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a7f57bd-d1e5-4127-a538-4de2732dfa18 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:02.007780 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3a7f57bd-d1e5-4127-a538-4de2732dfa18 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.073569 Nov 27 21:06:02.008865 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2750/5387] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:01 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:02.279155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d260af02-6d4d-40e8-b11c-512df3afda1d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:02.281942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d260af02-6d4d-40e8-b11c-512df3afda1d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:02.311635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d260af02-6d4d-40e8-b11c-512df3afda1d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:02.314852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d260af02-6d4d-40e8-b11c-512df3afda1d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:02.316691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d260af02-6d4d-40e8-b11c-512df3afda1d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:02.318008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d260af02-6d4d-40e8-b11c-512df3afda1d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:02.397447 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d260af02-6d4d-40e8-b11c-512df3afda1d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.107322 Nov 27 21:06:02.400547 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2638/5388] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:02 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:02.460597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e413d084-5884-47c1-b1f5-8713713bb05d req-ed75afb9-760a-404b-a8b4-0bb9d1731ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1f2144-f62b-4da2-b69c-0387745fda48", "name": "network-vif-deleted", "tag": "7edfdb58-5a15-4344-b301-c4b75f20ad29"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:02.462303 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:02.462303 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:06:02.482336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e413d084-5884-47c1-b1f5-8713713bb05d req-ed75afb9-760a-404b-a8b4-0bb9d1731ac4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:02.482657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e413d084-5884-47c1-b1f5-8713713bb05d req-ed75afb9-760a-404b-a8b4-0bb9d1731ac4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:02.506342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e413d084-5884-47c1-b1f5-8713713bb05d req-ed75afb9-760a-404b-a8b4-0bb9d1731ac4 service nova] Creating event network-vif-deleted:7edfdb58-5a15-4344-b301-c4b75f20ad29 for instance cb1f2144-f62b-4da2-b69c-0387745fda48 on nch2-master-1 Nov 27 21:06:02.523888 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e413d084-5884-47c1-b1f5-8713713bb05d req-ed75afb9-760a-404b-a8b4-0bb9d1731ac4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067691 Nov 27 21:06:02.531412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2751/5389] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:02.561438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:02.562151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:02.593739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:02.605212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:02.606229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:02.606693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:02.682760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:02.683703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:02.684323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lazy-loading 'fault' on Instance uuid cb1f2144-f62b-4da2-b69c-0387745fda48 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:06:02.737041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dacaf685b54cf89bc9aa4e050b9a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732694cf811451b8ffabd706cd72965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:02.753637 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7a93cfc3-e1de-40d9-83e3-7e7e782d4a15 tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 200 len: 1305 microversion: 2.1 time: 0.195904 Nov 27 21:06:02.756230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2639/5390] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:02 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 1305 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:03.023950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15eb3464-a57c-45c9-ad3a-f252ec4c06c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:03.025211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15eb3464-a57c-45c9-ad3a-f252ec4c06c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:03.039205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15eb3464-a57c-45c9-ad3a-f252ec4c06c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:03.040766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15eb3464-a57c-45c9-ad3a-f252ec4c06c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:03.041896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15eb3464-a57c-45c9-ad3a-f252ec4c06c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:03.042505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15eb3464-a57c-45c9-ad3a-f252ec4c06c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:03.091905 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15eb3464-a57c-45c9-ad3a-f252ec4c06c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.075445 Nov 27 21:06:03.093232 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2752/5391] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:03 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:03.410710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-482075ed-8ea6-4050-89ca-93e32975dd57 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:03.412060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-482075ed-8ea6-4050-89ca-93e32975dd57 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:03.419761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-482075ed-8ea6-4050-89ca-93e32975dd57 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:03.420284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-482075ed-8ea6-4050-89ca-93e32975dd57 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:03.421310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-482075ed-8ea6-4050-89ca-93e32975dd57 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:03.421981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-482075ed-8ea6-4050-89ca-93e32975dd57 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:03.491907 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-482075ed-8ea6-4050-89ca-93e32975dd57 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.085472 Nov 27 21:06:03.492586 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2640/5392] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:03 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:03.774814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:03.776532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] [instance: cb1f2144-f62b-4da2-b69c-0387745fda48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:03.784892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:03.785599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:03.786941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:03.787502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:03.804169 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] HTTP exception thrown: Instance cb1f2144-f62b-4da2-b69c-0387745fda48 could not be found. Nov 27 21:06:03.805076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] Returning 404 to user: Instance cb1f2144-f62b-4da2-b69c-0387745fda48 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:06:03.806484 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cb675056-4748-4d07-a447-3fbac55beb1d tempest-VolumesNegativeTest-1095374484 tempest-VolumesNegativeTest-1095374484-project] 10.222.0.21 "GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48" status: 404 len: 111 microversion: 2.1 time: 0.036720 Nov 27 21:06:03.813115 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2753/5393] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:03 2021] GET /compute/v2.1/servers/cb1f2144-f62b-4da2-b69c-0387745fda48 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:06:04.104807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81d3fcb9-ad2b-4df9-ba7d-0a6b3d0fc484 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:04.106215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81d3fcb9-ad2b-4df9-ba7d-0a6b3d0fc484 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:04.128824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d3fcb9-ad2b-4df9-ba7d-0a6b3d0fc484 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:04.130490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d3fcb9-ad2b-4df9-ba7d-0a6b3d0fc484 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:04.134465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d3fcb9-ad2b-4df9-ba7d-0a6b3d0fc484 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:04.134968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81d3fcb9-ad2b-4df9-ba7d-0a6b3d0fc484 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:04.220280 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81d3fcb9-ad2b-4df9-ba7d-0a6b3d0fc484 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.119867 Nov 27 21:06:04.220971 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2641/5394] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:04 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:04.506353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90dc1f0d-e913-4c7c-aae3-1ba9e308f3c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:04.508628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-90dc1f0d-e913-4c7c-aae3-1ba9e308f3c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:04.520729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90dc1f0d-e913-4c7c-aae3-1ba9e308f3c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:04.526181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90dc1f0d-e913-4c7c-aae3-1ba9e308f3c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:04.527276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90dc1f0d-e913-4c7c-aae3-1ba9e308f3c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:04.529452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90dc1f0d-e913-4c7c-aae3-1ba9e308f3c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:04.623107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-90dc1f0d-e913-4c7c-aae3-1ba9e308f3c6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.122598 Nov 27 21:06:04.624254 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2754/5395] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:04 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:05.239562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b28452bf-60b1-4531-812c-af5d9e4119f4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:05.240765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b28452bf-60b1-4531-812c-af5d9e4119f4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:05.250695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b28452bf-60b1-4531-812c-af5d9e4119f4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:05.251283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b28452bf-60b1-4531-812c-af5d9e4119f4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:05.252195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b28452bf-60b1-4531-812c-af5d9e4119f4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:05.253419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b28452bf-60b1-4531-812c-af5d9e4119f4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:05.322601 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b28452bf-60b1-4531-812c-af5d9e4119f4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.091973 Nov 27 21:06:05.325057 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2642/5396] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:05 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:05.642505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06ea7cc4-2a5a-461a-9c77-512abad17c2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:05.646527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06ea7cc4-2a5a-461a-9c77-512abad17c2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:05.677112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06ea7cc4-2a5a-461a-9c77-512abad17c2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:05.677975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06ea7cc4-2a5a-461a-9c77-512abad17c2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:05.680300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06ea7cc4-2a5a-461a-9c77-512abad17c2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:05.681268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06ea7cc4-2a5a-461a-9c77-512abad17c2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:05.780704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06ea7cc4-2a5a-461a-9c77-512abad17c2e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.147727 Nov 27 21:06:05.783009 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2755/5397] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:05 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:06.345802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a33f261e-d68a-4adc-9eb9-eaf9544809c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:06.347712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a33f261e-d68a-4adc-9eb9-eaf9544809c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:06.357817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33f261e-d68a-4adc-9eb9-eaf9544809c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:06.358535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33f261e-d68a-4adc-9eb9-eaf9544809c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:06.360729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33f261e-d68a-4adc-9eb9-eaf9544809c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:06.361589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33f261e-d68a-4adc-9eb9-eaf9544809c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:06.483958 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a33f261e-d68a-4adc-9eb9-eaf9544809c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 24570 microversion: 2.20 time: 0.149559 Nov 27 21:06:06.491078 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2643/5398] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:06 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 24570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:06.794678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6b07ab6-f57b-4c23-8cb6-955460234955 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:06.795734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6b07ab6-f57b-4c23-8cb6-955460234955 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:06.814086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b07ab6-f57b-4c23-8cb6-955460234955 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:06.814549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b07ab6-f57b-4c23-8cb6-955460234955 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:06.815953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b07ab6-f57b-4c23-8cb6-955460234955 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:06.816388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b07ab6-f57b-4c23-8cb6-955460234955 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:06.900219 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6b07ab6-f57b-4c23-8cb6-955460234955 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.109429 Nov 27 21:06:06.901340 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2756/5399] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:06 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:07.501137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73a4428c-a346-446c-8647-4b0ea59a8462 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:07.503081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-73a4428c-a346-446c-8647-4b0ea59a8462 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:07.517195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73a4428c-a346-446c-8647-4b0ea59a8462 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:07.518670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73a4428c-a346-446c-8647-4b0ea59a8462 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:07.521380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73a4428c-a346-446c-8647-4b0ea59a8462 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:07.523438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73a4428c-a346-446c-8647-4b0ea59a8462 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:07.636956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73a4428c-a346-446c-8647-4b0ea59a8462 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.140572 Nov 27 21:06:07.637656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2644/5400] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:07 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:07.840836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1702081559", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24dac3ac-1146-4be6-b1df-ff69289a0028"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:07.919338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fabbbcf9-1f21-469a-ad04-03c22a85359d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:07.919338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fabbbcf9-1f21-469a-ad04-03c22a85359d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:07.945515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fabbbcf9-1f21-469a-ad04-03c22a85359d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:07.946123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fabbbcf9-1f21-469a-ad04-03c22a85359d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:07.947017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fabbbcf9-1f21-469a-ad04-03c22a85359d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:07.947512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fabbbcf9-1f21-469a-ad04-03c22a85359d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:07.962430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] validate_networks() for [('24dac3ac-1146-4be6-b1df-ff69289a0028', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:06:08.077558 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fabbbcf9-1f21-469a-ad04-03c22a85359d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.162816 Nov 27 21:06:08.078321 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2645/5401] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:07 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:08.547801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:06:08.548565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:06:08.549237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:06:08.550016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:06:08.550438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:06:08.565974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:08.566424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:08.567239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:08.572109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:08.639023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Getting quotas for project 2fcfaa0229934ca2881bd510e1a2aade. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:06:08.650822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aa9e644a-711d-4d1c-9a50-ded156445946 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:08.651455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aa9e644a-711d-4d1c-9a50-ded156445946 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:08.653027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Getting quotas for user 0b931665afff4f99b4804188e9ae1438 and project 2fcfaa0229934ca2881bd510e1a2aade. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:06:08.668722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa9e644a-711d-4d1c-9a50-ded156445946 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:08.669524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa9e644a-711d-4d1c-9a50-ded156445946 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:08.670477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa9e644a-711d-4d1c-9a50-ded156445946 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:08.672143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa9e644a-711d-4d1c-9a50-ded156445946 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:08.693466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:06:08.696006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:06:08.764706 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aa9e644a-711d-4d1c-9a50-ded156445946 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.119622 Nov 27 21:06:08.771862 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2646/5402] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:08 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:08.831360 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3eadbb67-6e13-401c-89e1-31a150035b67 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.270474 Nov 27 21:06:08.832629 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2757/5403] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:06:07 2021] POST /compute/v2.1/servers => generated 383 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:06:08.842579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9baeb3a-1d17-4d69-a3ef-6fc39fa61e63 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:08.852110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9baeb3a-1d17-4d69-a3ef-6fc39fa61e63 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:09.002611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9baeb3a-1d17-4d69-a3ef-6fc39fa61e63 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:09.009442 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9baeb3a-1d17-4d69-a3ef-6fc39fa61e63 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1222 microversion: 2.1 time: 0.170723 Nov 27 21:06:09.030102 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2647/5404] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:08 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1222 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:09.102873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e94309e4-af37-48a5-80f3-a4224ae0eeaf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:09.104281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e94309e4-af37-48a5-80f3-a4224ae0eeaf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:09.120451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94309e4-af37-48a5-80f3-a4224ae0eeaf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:09.121959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94309e4-af37-48a5-80f3-a4224ae0eeaf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:09.124122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94309e4-af37-48a5-80f3-a4224ae0eeaf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:09.127106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e94309e4-af37-48a5-80f3-a4224ae0eeaf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:09.223481 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e94309e4-af37-48a5-80f3-a4224ae0eeaf tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.135908 Nov 27 21:06:09.225331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2758/5405] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:09 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:09.258451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-38876440", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24dac3ac-1146-4be6-b1df-ff69289a0028"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:09.394120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] validate_networks() for [('24dac3ac-1146-4be6-b1df-ff69289a0028', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:06:09.778100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e22f94c1-83db-4d57-89aa-150cff830208 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:09.779141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e22f94c1-83db-4d57-89aa-150cff830208 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:09.793911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e22f94c1-83db-4d57-89aa-150cff830208 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:09.794637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e22f94c1-83db-4d57-89aa-150cff830208 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:09.796731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e22f94c1-83db-4d57-89aa-150cff830208 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:09.797480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e22f94c1-83db-4d57-89aa-150cff830208 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:09.926713 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e22f94c1-83db-4d57-89aa-150cff830208 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.152963 Nov 27 21:06:09.931895 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2759/5406] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:09 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:10.238394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a966ce43-ece4-402a-b9a7-2f6bad3ed531 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:10.239221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a966ce43-ece4-402a-b9a7-2f6bad3ed531 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:10.254950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a966ce43-ece4-402a-b9a7-2f6bad3ed531 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:10.257889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a966ce43-ece4-402a-b9a7-2f6bad3ed531 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:10.259061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a966ce43-ece4-402a-b9a7-2f6bad3ed531 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:10.260851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a966ce43-ece4-402a-b9a7-2f6bad3ed531 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:10.301868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:06:10.302439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:06:10.303342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:06:10.303785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:06:10.304751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:06:10.321239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:10.322105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:10.324662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:10.327672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:10.353600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a966ce43-ece4-402a-b9a7-2f6bad3ed531 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.119134 Nov 27 21:06:10.359425 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2760/5407] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:10 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:10.370455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Getting quotas for project 2fcfaa0229934ca2881bd510e1a2aade. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:06:10.381509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Getting quotas for user 0b931665afff4f99b4804188e9ae1438 and project 2fcfaa0229934ca2881bd510e1a2aade. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:06:10.445470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:06:10.456608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:06:10.629843 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7584519c-5342-4c0d-b320-1cb91419b9cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.388914 Nov 27 21:06:10.632515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2648/5408] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:06:09 2021] POST /compute/v2.1/servers => generated 383 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:06:10.643446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8a8d093-3c3e-4315-bed4-5c898bc36484 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:10.644636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8a8d093-3c3e-4315-bed4-5c898bc36484 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:10.915459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8a8d093-3c3e-4315-bed4-5c898bc36484 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:10.944799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b5126b0-2435-4b9c-ab51-a71bb1f4b13b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:10.946394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b5126b0-2435-4b9c-ab51-a71bb1f4b13b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:10.954065 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8a8d093-3c3e-4315-bed4-5c898bc36484 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1220 microversion: 2.1 time: 0.310597 Nov 27 21:06:10.956199 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2761/5409] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:10 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1220 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:10.966053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5126b0-2435-4b9c-ab51-a71bb1f4b13b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:10.968320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5126b0-2435-4b9c-ab51-a71bb1f4b13b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:10.972206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5126b0-2435-4b9c-ab51-a71bb1f4b13b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:10.974605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b5126b0-2435-4b9c-ab51-a71bb1f4b13b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:11.088882 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b5126b0-2435-4b9c-ab51-a71bb1f4b13b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.150366 Nov 27 21:06:11.092192 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2649/5410] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:10 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:11.368490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23580c52-7cbc-4fac-83bc-8dd5e970f544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:11.370460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23580c52-7cbc-4fac-83bc-8dd5e970f544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:11.391803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23580c52-7cbc-4fac-83bc-8dd5e970f544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:11.392276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23580c52-7cbc-4fac-83bc-8dd5e970f544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:11.396314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23580c52-7cbc-4fac-83bc-8dd5e970f544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:11.400657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23580c52-7cbc-4fac-83bc-8dd5e970f544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:11.540464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23580c52-7cbc-4fac-83bc-8dd5e970f544 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.176149 Nov 27 21:06:11.542021 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2762/5411] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:11 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:11.977851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:11.979384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:11.987906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:11.988781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:11.991803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:11.992713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:12.103549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-940ef26c-5c43-40b8-845f-6b60469256d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:12.104528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-940ef26c-5c43-40b8-845f-6b60469256d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:12.121418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940ef26c-5c43-40b8-845f-6b60469256d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:12.123221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940ef26c-5c43-40b8-845f-6b60469256d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:12.126025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940ef26c-5c43-40b8-845f-6b60469256d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:12.126479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-940ef26c-5c43-40b8-845f-6b60469256d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:12.128172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:12.142528 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64848dd9-4734-49b9-a14d-4f57dc2ffa69 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1216 microversion: 2.1 time: 0.171858 Nov 27 21:06:12.152021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2650/5412] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:11 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:12.214689 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-940ef26c-5c43-40b8-845f-6b60469256d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.115838 Nov 27 21:06:12.215382 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2763/5413] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:12 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:12.554810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2c3c363-6927-4712-ac3f-e8ec6a311ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:12.556526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2c3c363-6927-4712-ac3f-e8ec6a311ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:12.577408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2c3c363-6927-4712-ac3f-e8ec6a311ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:12.577911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2c3c363-6927-4712-ac3f-e8ec6a311ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:12.580276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2c3c363-6927-4712-ac3f-e8ec6a311ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:12.580774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2c3c363-6927-4712-ac3f-e8ec6a311ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:12.680959 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2c3c363-6927-4712-ac3f-e8ec6a311ed9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.130903 Nov 27 21:06:12.685249 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2651/5414] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:12 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:13.165365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:13.166133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:13.187748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:13.188227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:13.190038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:13.190492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:13.229119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6514567d-de68-4a38-a915-d0f06e3d4070 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:13.230158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6514567d-de68-4a38-a915-d0f06e3d4070 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:13.247421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6514567d-de68-4a38-a915-d0f06e3d4070 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:13.249463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6514567d-de68-4a38-a915-d0f06e3d4070 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:13.250341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6514567d-de68-4a38-a915-d0f06e3d4070 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:13.250788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6514567d-de68-4a38-a915-d0f06e3d4070 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:13.333368 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6514567d-de68-4a38-a915-d0f06e3d4070 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.108920 Nov 27 21:06:13.334594 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2652/5415] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:13 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:13.391273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:13.410635 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0a23732-0244-476a-b3d3-779b1b1c2edd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1278 microversion: 2.1 time: 0.253511 Nov 27 21:06:13.411903 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2764/5416] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:13 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:13.696553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29c15077-64d8-4b86-bfbd-a56f555f7bc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:13.697779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29c15077-64d8-4b86-bfbd-a56f555f7bc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:13.720242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29c15077-64d8-4b86-bfbd-a56f555f7bc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:13.729519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29c15077-64d8-4b86-bfbd-a56f555f7bc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:13.731896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29c15077-64d8-4b86-bfbd-a56f555f7bc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:13.732749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29c15077-64d8-4b86-bfbd-a56f555f7bc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:13.865603 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29c15077-64d8-4b86-bfbd-a56f555f7bc9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.176260 Nov 27 21:06:13.866184 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2653/5417] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:13 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:14.368231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfc18e14-1736-4e58-81b8-9bb1b5ac35db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:14.370038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfc18e14-1736-4e58-81b8-9bb1b5ac35db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:14.379351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc18e14-1736-4e58-81b8-9bb1b5ac35db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:14.380193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc18e14-1736-4e58-81b8-9bb1b5ac35db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:14.381261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc18e14-1736-4e58-81b8-9bb1b5ac35db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:14.382376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc18e14-1736-4e58-81b8-9bb1b5ac35db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:14.451930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:14.452657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:14.460923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:14.461388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:14.462209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:14.462658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:14.463671 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfc18e14-1736-4e58-81b8-9bb1b5ac35db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.120450 Nov 27 21:06:14.464337 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2765/5418] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:14 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:14.627668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:14.642791 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-44a54279-136f-4125-ab73-ba88b5475fee tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1278 microversion: 2.1 time: 0.216033 Nov 27 21:06:14.645176 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2654/5419] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:14 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:14.878517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9fcddd0c-3675-40b4-9ea7-95821d06fc16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:14.879550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9fcddd0c-3675-40b4-9ea7-95821d06fc16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:14.891636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fcddd0c-3675-40b4-9ea7-95821d06fc16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:14.892105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fcddd0c-3675-40b4-9ea7-95821d06fc16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:14.893664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fcddd0c-3675-40b4-9ea7-95821d06fc16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:14.894109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fcddd0c-3675-40b4-9ea7-95821d06fc16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:14.917315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-361a3572-1717-4714-90ea-30e2b99a423a req-4232ed35-9383-4d44-9797-1601434b0f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7896504e-013d-42df-9c95-1445b03b7e48", "tag": "b613c97a-4d90-417e-b201-5f479ccadf21"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:14.919672 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:14.919672 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:06:14.936392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-361a3572-1717-4714-90ea-30e2b99a423a req-4232ed35-9383-4d44-9797-1601434b0f0a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:14.936847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-361a3572-1717-4714-90ea-30e2b99a423a req-4232ed35-9383-4d44-9797-1601434b0f0a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:14.959610 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-361a3572-1717-4714-90ea-30e2b99a423a req-4232ed35-9383-4d44-9797-1601434b0f0a service nova] Creating event network-changed:b613c97a-4d90-417e-b201-5f479ccadf21 for instance 7896504e-013d-42df-9c95-1445b03b7e48 on nch2-master-1 Nov 27 21:06:14.966206 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-361a3572-1717-4714-90ea-30e2b99a423a req-4232ed35-9383-4d44-9797-1601434b0f0a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293395 Nov 27 21:06:14.967190 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2766/5420] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:14.976984 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9fcddd0c-3675-40b4-9ea7-95821d06fc16 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.102627 Nov 27 21:06:14.981306 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2655/5421] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:14 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:15.483244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f85c1ce-0ed3-4fba-882b-96bdf3bb6c80 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:15.485955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f85c1ce-0ed3-4fba-882b-96bdf3bb6c80 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:15.493271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85c1ce-0ed3-4fba-882b-96bdf3bb6c80 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:15.493983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85c1ce-0ed3-4fba-882b-96bdf3bb6c80 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:15.495065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85c1ce-0ed3-4fba-882b-96bdf3bb6c80 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:15.495964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85c1ce-0ed3-4fba-882b-96bdf3bb6c80 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:15.585213 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f85c1ce-0ed3-4fba-882b-96bdf3bb6c80 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.106739 Nov 27 21:06:15.585893 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2767/5422] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:15 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:15.666406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:15.668657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:15.683805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:15.684850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:15.689192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:15.690285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:15.992370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96a10e35-1bd1-4bdc-80d5-cd950952e599 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:15.993969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-96a10e35-1bd1-4bdc-80d5-cd950952e599 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:16.015430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96a10e35-1bd1-4bdc-80d5-cd950952e599 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:16.016341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96a10e35-1bd1-4bdc-80d5-cd950952e599 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:16.017431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96a10e35-1bd1-4bdc-80d5-cd950952e599 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:16.018877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96a10e35-1bd1-4bdc-80d5-cd950952e599 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:16.120503 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-96a10e35-1bd1-4bdc-80d5-cd950952e599 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.132587 Nov 27 21:06:16.121252 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2768/5423] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:15 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:16.465612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:16.492139 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ff7c6aa-86c1-4fda-9b47-9c2831b17321 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1320 microversion: 2.1 time: 0.831966 Nov 27 21:06:16.498485 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2656/5424] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:15 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1320 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:16.600054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f380bdcf-1aac-4309-99a7-81c5ec55811d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:16.601261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f380bdcf-1aac-4309-99a7-81c5ec55811d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:16.616317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f380bdcf-1aac-4309-99a7-81c5ec55811d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:16.620449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f380bdcf-1aac-4309-99a7-81c5ec55811d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:16.621905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f380bdcf-1aac-4309-99a7-81c5ec55811d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:16.622477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f380bdcf-1aac-4309-99a7-81c5ec55811d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:16.709922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f380bdcf-1aac-4309-99a7-81c5ec55811d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.114847 Nov 27 21:06:16.715500 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2769/5425] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:16 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:16.864984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-43be8c18-8912-438f-97dc-ea65eb296066 req-e64b34dd-d481-49c2-a817-99148d434149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa59779-cb4a-4c93-9512-ba7c5570d157", "tag": "cd5b57d3-f3a1-4ea3-8f34-be4de4c3781f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:16.866533 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:16.866533 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:06:16.885183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-43be8c18-8912-438f-97dc-ea65eb296066 req-e64b34dd-d481-49c2-a817-99148d434149 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:16.885625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-43be8c18-8912-438f-97dc-ea65eb296066 req-e64b34dd-d481-49c2-a817-99148d434149 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:16.916003 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-43be8c18-8912-438f-97dc-ea65eb296066 req-e64b34dd-d481-49c2-a817-99148d434149 service nova] Creating event network-changed:cd5b57d3-f3a1-4ea3-8f34-be4de4c3781f for instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 on nch1-master-1 Nov 27 21:06:16.923544 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-43be8c18-8912-438f-97dc-ea65eb296066 req-e64b34dd-d481-49c2-a817-99148d434149 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062897 Nov 27 21:06:16.924942 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2657/5426] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:17.133831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e76042c-7842-44ec-ae28-0cd9b7cfcffb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:17.135144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e76042c-7842-44ec-ae28-0cd9b7cfcffb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:17.151741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e76042c-7842-44ec-ae28-0cd9b7cfcffb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:17.152304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e76042c-7842-44ec-ae28-0cd9b7cfcffb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:17.153306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e76042c-7842-44ec-ae28-0cd9b7cfcffb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:17.154173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e76042c-7842-44ec-ae28-0cd9b7cfcffb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:17.225657 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e76042c-7842-44ec-ae28-0cd9b7cfcffb tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.096303 Nov 27 21:06:17.231367 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2770/5427] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:17 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:17.516158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:17.516838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:17.530184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:17.540182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:17.545077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:17.549772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:17.726928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b047565d-5e4e-41eb-9a83-b7d87106807d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:17.735791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b047565d-5e4e-41eb-9a83-b7d87106807d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:17.754091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b047565d-5e4e-41eb-9a83-b7d87106807d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:17.755514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b047565d-5e4e-41eb-9a83-b7d87106807d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:17.758151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b047565d-5e4e-41eb-9a83-b7d87106807d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:17.758913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b047565d-5e4e-41eb-9a83-b7d87106807d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:17.857076 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b047565d-5e4e-41eb-9a83-b7d87106807d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.137661 Nov 27 21:06:17.858182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2771/5428] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:17 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:17.897292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:17.907233 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4681ad39-a9d7-478b-aaf7-1da4dd4cd454 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1320 microversion: 2.1 time: 0.395702 Nov 27 21:06:17.917998 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2658/5429] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:17 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:18.241230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8480639-cb4e-449b-acb2-91c0656c1e60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:18.242492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8480639-cb4e-449b-acb2-91c0656c1e60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:18.268053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8480639-cb4e-449b-acb2-91c0656c1e60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:18.269437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8480639-cb4e-449b-acb2-91c0656c1e60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:18.270446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8480639-cb4e-449b-acb2-91c0656c1e60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:18.271055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8480639-cb4e-449b-acb2-91c0656c1e60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:18.331387 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8480639-cb4e-449b-acb2-91c0656c1e60 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.096549 Nov 27 21:06:18.335946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2772/5430] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:18 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:18.869087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b5aacef-b715-43a5-8055-78f1181320ab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:18.870415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b5aacef-b715-43a5-8055-78f1181320ab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:18.877489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b5aacef-b715-43a5-8055-78f1181320ab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:18.878190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b5aacef-b715-43a5-8055-78f1181320ab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:18.879233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b5aacef-b715-43a5-8055-78f1181320ab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:18.879937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b5aacef-b715-43a5-8055-78f1181320ab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:18.926698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:18.928352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:18.938952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:18.939560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:18.940407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:18.940824 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b5aacef-b715-43a5-8055-78f1181320ab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.075053 Nov 27 21:06:18.941301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:18.945548 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2659/5431] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:18 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:19.120456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:19.129411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6daa3d6-0c42-4815-a099-9f7d03724cf5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1320 microversion: 2.1 time: 0.207543 Nov 27 21:06:19.129999 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2773/5432] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:18 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:19.344539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4f1dc010-8347-4046-8c44-baf75b5947e6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:19.345981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4f1dc010-8347-4046-8c44-baf75b5947e6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:19.353350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f1dc010-8347-4046-8c44-baf75b5947e6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:19.353898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f1dc010-8347-4046-8c44-baf75b5947e6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:19.354768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f1dc010-8347-4046-8c44-baf75b5947e6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:19.355319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f1dc010-8347-4046-8c44-baf75b5947e6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:19.405194 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4f1dc010-8347-4046-8c44-baf75b5947e6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.064915 Nov 27 21:06:19.406108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2660/5433] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:19 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:19.953393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28b3ada6-c6e5-447f-8762-0c1c9ea737a0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:19.955043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28b3ada6-c6e5-447f-8762-0c1c9ea737a0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:19.963033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b3ada6-c6e5-447f-8762-0c1c9ea737a0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:19.963749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b3ada6-c6e5-447f-8762-0c1c9ea737a0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:19.964734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b3ada6-c6e5-447f-8762-0c1c9ea737a0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:19.965176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b3ada6-c6e5-447f-8762-0c1c9ea737a0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:20.012788 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28b3ada6-c6e5-447f-8762-0c1c9ea737a0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.062859 Nov 27 21:06:20.013907 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2774/5434] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:19 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:20.146966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:20.149197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:20.160850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:20.161708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:20.162707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:20.163530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:20.417109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cadef90e-bd27-4b58-98c1-6a62826eedb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:20.418567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cadef90e-bd27-4b58-98c1-6a62826eedb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:20.425805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadef90e-bd27-4b58-98c1-6a62826eedb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:20.426610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadef90e-bd27-4b58-98c1-6a62826eedb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:20.427648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadef90e-bd27-4b58-98c1-6a62826eedb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:20.428301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadef90e-bd27-4b58-98c1-6a62826eedb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:20.494270 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cadef90e-bd27-4b58-98c1-6a62826eedb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.081244 Nov 27 21:06:20.496411 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2775/5435] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:20 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:20.500370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:20.508640 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fbc7aa50-b9e8-4e17-9efa-d0a72faddc66 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1320 microversion: 2.1 time: 0.366524 Nov 27 21:06:20.509228 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2661/5436] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:20 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:21.028755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99257cfe-e7d0-4c00-822b-f2f867843be7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:21.030966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99257cfe-e7d0-4c00-822b-f2f867843be7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:21.041533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99257cfe-e7d0-4c00-822b-f2f867843be7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:21.041983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99257cfe-e7d0-4c00-822b-f2f867843be7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:21.042813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99257cfe-e7d0-4c00-822b-f2f867843be7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:21.043272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99257cfe-e7d0-4c00-822b-f2f867843be7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:21.120008 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99257cfe-e7d0-4c00-822b-f2f867843be7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.098477 Nov 27 21:06:21.124182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2776/5437] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:21 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:21.506837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f85c7a26-f411-4f61-b617-7ccc99e54a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:21.508675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f85c7a26-f411-4f61-b617-7ccc99e54a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:21.517024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85c7a26-f411-4f61-b617-7ccc99e54a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:21.517767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85c7a26-f411-4f61-b617-7ccc99e54a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:21.519013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85c7a26-f411-4f61-b617-7ccc99e54a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:21.519822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85c7a26-f411-4f61-b617-7ccc99e54a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:21.528086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:21.529014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:21.536859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:21.537522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:21.538510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:21.539101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:21.597766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f85c7a26-f411-4f61-b617-7ccc99e54a43 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.095242 Nov 27 21:06:21.602694 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2662/5438] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:21 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:21.700039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:21.710273 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1021ab27-b7aa-45cb-8ed8-ee48affd56b3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1320 microversion: 2.1 time: 0.187765 Nov 27 21:06:21.710911 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2777/5439] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:21 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:21.945806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-57b7836b-21b8-4212-aaba-197dba46473d req-b7394e4c-92b7-47cd-aaba-637de4c64db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa59779-cb4a-4c93-9512-ba7c5570d157", "name": "network-vif-plugged", "status": "completed", "tag": "cd5b57d3-f3a1-4ea3-8f34-be4de4c3781f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:21.948276 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:21.948276 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:06:21.958277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-57b7836b-21b8-4212-aaba-197dba46473d req-b7394e4c-92b7-47cd-aaba-637de4c64db6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:21.958895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-57b7836b-21b8-4212-aaba-197dba46473d req-b7394e4c-92b7-47cd-aaba-637de4c64db6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:21.972742 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-57b7836b-21b8-4212-aaba-197dba46473d req-b7394e4c-92b7-47cd-aaba-637de4c64db6 service nova] Creating event network-vif-plugged:cd5b57d3-f3a1-4ea3-8f34-be4de4c3781f for instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 on nch1-master-1 Nov 27 21:06:21.979756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-57b7836b-21b8-4212-aaba-197dba46473d req-b7394e4c-92b7-47cd-aaba-637de4c64db6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274651 Nov 27 21:06:21.980392 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2663/5440] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:22.132524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b94a0718-74f9-4a9b-9799-87a8168069f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:22.134058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b94a0718-74f9-4a9b-9799-87a8168069f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:22.142108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b94a0718-74f9-4a9b-9799-87a8168069f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:22.142815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b94a0718-74f9-4a9b-9799-87a8168069f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:22.144025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b94a0718-74f9-4a9b-9799-87a8168069f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:22.144640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b94a0718-74f9-4a9b-9799-87a8168069f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:22.386458 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b94a0718-74f9-4a9b-9799-87a8168069f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.257530 Nov 27 21:06:22.387111 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2778/5441] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:22 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:22.612321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5066d0c3-9158-4c67-bc21-24d2177bc809 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:22.614078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5066d0c3-9158-4c67-bc21-24d2177bc809 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:22.639121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5066d0c3-9158-4c67-bc21-24d2177bc809 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:22.641813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5066d0c3-9158-4c67-bc21-24d2177bc809 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:22.643183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5066d0c3-9158-4c67-bc21-24d2177bc809 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:22.643764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5066d0c3-9158-4c67-bc21-24d2177bc809 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:22.738376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5066d0c3-9158-4c67-bc21-24d2177bc809 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.131640 Nov 27 21:06:22.739440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:22.740466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:22.743759 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2664/5442] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:22 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:22.750654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:22.751243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:22.752281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:22.752856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:22.912620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:22.921439 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1be67985-369e-4e90-96fc-559c1a29b731 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1320 microversion: 2.1 time: 0.188757 Nov 27 21:06:22.922656 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2779/5443] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:22 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:23.398453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe2a0ad8-36ba-4027-a673-eed7fd0d8e74 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:23.399486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe2a0ad8-36ba-4027-a673-eed7fd0d8e74 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:23.406293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2a0ad8-36ba-4027-a673-eed7fd0d8e74 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:23.406757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2a0ad8-36ba-4027-a673-eed7fd0d8e74 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:23.407580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2a0ad8-36ba-4027-a673-eed7fd0d8e74 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:23.408020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2a0ad8-36ba-4027-a673-eed7fd0d8e74 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:23.459004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe2a0ad8-36ba-4027-a673-eed7fd0d8e74 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.064229 Nov 27 21:06:23.459710 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2665/5444] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:23 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:23.754531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8954f87f-d069-44f2-9afd-3139ad94fc4d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:23.755514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8954f87f-d069-44f2-9afd-3139ad94fc4d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:23.766729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8954f87f-d069-44f2-9afd-3139ad94fc4d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:23.767187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8954f87f-d069-44f2-9afd-3139ad94fc4d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:23.768064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8954f87f-d069-44f2-9afd-3139ad94fc4d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:23.768510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8954f87f-d069-44f2-9afd-3139ad94fc4d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:23.822174 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8954f87f-d069-44f2-9afd-3139ad94fc4d tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.071199 Nov 27 21:06:23.823748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2780/5445] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:23 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:23.947151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:23.948613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:23.958026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:23.958839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:23.960146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:23.960801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.046329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4bac7d99-80a3-4925-948b-70a18a50503a req-552e192c-a4f5-4cf5-b746-c377810758fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7896504e-013d-42df-9c95-1445b03b7e48", "name": "network-vif-plugged", "status": "completed", "tag": "b613c97a-4d90-417e-b201-5f479ccadf21"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:24.048301 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:24.048301 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:06:24.059671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4bac7d99-80a3-4925-948b-70a18a50503a req-552e192c-a4f5-4cf5-b746-c377810758fa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.061262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4bac7d99-80a3-4925-948b-70a18a50503a req-552e192c-a4f5-4cf5-b746-c377810758fa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.074951 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4bac7d99-80a3-4925-948b-70a18a50503a req-552e192c-a4f5-4cf5-b746-c377810758fa service nova] Creating event network-vif-plugged:b613c97a-4d90-417e-b201-5f479ccadf21 for instance 7896504e-013d-42df-9c95-1445b03b7e48 on nch2-master-1 Nov 27 21:06:24.080823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4bac7d99-80a3-4925-948b-70a18a50503a req-552e192c-a4f5-4cf5-b746-c377810758fa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038603 Nov 27 21:06:24.081726 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2781/5446] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:06:24.193799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:24.219326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8f06f99-b681-4472-b3a5-b971ee46bddf tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1515 microversion: 2.1 time: 0.282911 Nov 27 21:06:24.221647 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2666/5447] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:23 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:24.239361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:24.240400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:24.251213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.252418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.253413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.254761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.298877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lazy-loading 'flavor' on Instance uuid 5fa59779-cb4a-4c93-9512-ba7c5570d157 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:06:24.430665 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-030c7cc0-04f0-426b-b870-6f9ef1d162ab tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157/action" status: 200 len: 32 microversion: 2.1 time: 0.191673 Nov 27 21:06:24.430665 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2782/5448] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:06:24 2021] POST /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:06:24.435522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:24.436143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:24.443632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.444317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.445510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.445961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.475074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40cabd2a-57ff-4229-9f76-b8b8776ebd45 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:24.477697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40cabd2a-57ff-4229-9f76-b8b8776ebd45 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:24.490224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cabd2a-57ff-4229-9f76-b8b8776ebd45 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.490953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cabd2a-57ff-4229-9f76-b8b8776ebd45 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.492383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cabd2a-57ff-4229-9f76-b8b8776ebd45 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.493848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40cabd2a-57ff-4229-9f76-b8b8776ebd45 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.563389 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40cabd2a-57ff-4229-9f76-b8b8776ebd45 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.094656 Nov 27 21:06:24.569653 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2783/5449] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:24 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:24.639922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:24.648223 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8262cb84-d02a-402a-9d5c-eee1b6ded0a7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.216411 Nov 27 21:06:24.648816 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2667/5450] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:24 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:24.836036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-82a17b7a-08af-44d4-83be-a989441e6254 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:24.837052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-82a17b7a-08af-44d4-83be-a989441e6254 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:24.844336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a17b7a-08af-44d4-83be-a989441e6254 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.844795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a17b7a-08af-44d4-83be-a989441e6254 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.845577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a17b7a-08af-44d4-83be-a989441e6254 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:24.846020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82a17b7a-08af-44d4-83be-a989441e6254 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:24.888099 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-82a17b7a-08af-44d4-83be-a989441e6254 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.056028 Nov 27 21:06:24.892171 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2784/5451] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:24 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:25.578640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3bb6d7c-3d99-4ab9-a506-22e2f15d8a96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:25.580240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3bb6d7c-3d99-4ab9-a506-22e2f15d8a96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:25.596061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3bb6d7c-3d99-4ab9-a506-22e2f15d8a96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:25.599772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3bb6d7c-3d99-4ab9-a506-22e2f15d8a96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:25.601061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3bb6d7c-3d99-4ab9-a506-22e2f15d8a96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:25.607582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3bb6d7c-3d99-4ab9-a506-22e2f15d8a96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:25.666861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:25.668040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:25.675765 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3bb6d7c-3d99-4ab9-a506-22e2f15d8a96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.103089 Nov 27 21:06:25.676941 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2668/5452] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:25 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:25.678875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:25.679337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:25.681145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:25.686429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:25.900595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c4f7955-bf6d-4488-969b-f2387462c76f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:25.901801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c4f7955-bf6d-4488-969b-f2387462c76f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:25.909965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4f7955-bf6d-4488-969b-f2387462c76f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:25.910647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4f7955-bf6d-4488-969b-f2387462c76f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:25.911826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4f7955-bf6d-4488-969b-f2387462c76f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:25.912285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4f7955-bf6d-4488-969b-f2387462c76f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:25.959524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c4f7955-bf6d-4488-969b-f2387462c76f tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.062650 Nov 27 21:06:25.961057 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2669/5453] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:25 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:25.978302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:25.986466 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ad3c40d1-b5ad-4e4b-bb83-9da561507e78 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.324727 Nov 27 21:06:25.987043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2785/5454] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:25 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:26.688158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3f76809-c0c9-4046-8f4e-aa0d2fc0fa5d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:26.689185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3f76809-c0c9-4046-8f4e-aa0d2fc0fa5d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:26.697772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3f76809-c0c9-4046-8f4e-aa0d2fc0fa5d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:26.698351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3f76809-c0c9-4046-8f4e-aa0d2fc0fa5d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:26.699189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3f76809-c0c9-4046-8f4e-aa0d2fc0fa5d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:26.699601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3f76809-c0c9-4046-8f4e-aa0d2fc0fa5d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:26.742914 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3f76809-c0c9-4046-8f4e-aa0d2fc0fa5d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.058785 Nov 27 21:06:26.743826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2670/5455] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:26 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:26.972872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-242e49ec-f6f1-4f5d-80a7-77dfcc1e6df9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:26.974284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-242e49ec-f6f1-4f5d-80a7-77dfcc1e6df9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:26.981965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-242e49ec-f6f1-4f5d-80a7-77dfcc1e6df9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:26.982707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-242e49ec-f6f1-4f5d-80a7-77dfcc1e6df9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:26.983720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-242e49ec-f6f1-4f5d-80a7-77dfcc1e6df9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:26.984323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-242e49ec-f6f1-4f5d-80a7-77dfcc1e6df9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.005525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:27.006513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:27.014738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.015787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.016956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.018617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.033515 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-242e49ec-f6f1-4f5d-80a7-77dfcc1e6df9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action" status: 200 len: 40701 microversion: 2.32 time: 0.064576 Nov 27 21:06:27.034447 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2786/5456] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:26 2021] POST /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/action => generated 40701 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:27.046831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:27.047984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:27.056258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.057298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.058582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.059572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.232209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:27.241764 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-020d7d59-fd20-4695-a500-500b997872a0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.241085 Nov 27 21:06:27.242268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2671/5457] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:26 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:27.288132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:27.297334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:27.298952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:27.300208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bd5175e1-22d1-4a5b-ae47-8f13551cc7a9 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2950 microversion: 2.32 time: 0.258797 Nov 27 21:06:27.301097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2787/5458] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:06:27 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2950 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:06:27.334463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7eaaa11e-5be8-4a16-a709-420832a20c71 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:27.335222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7eaaa11e-5be8-4a16-a709-420832a20c71 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:27.342398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eaaa11e-5be8-4a16-a709-420832a20c71 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.342927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eaaa11e-5be8-4a16-a709-420832a20c71 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.343829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eaaa11e-5be8-4a16-a709-420832a20c71 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.344359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7eaaa11e-5be8-4a16-a709-420832a20c71 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.497444 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7eaaa11e-5be8-4a16-a709-420832a20c71 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.166270 Nov 27 21:06:27.498989 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2672/5459] 10.222.0.21 () {60 vars in 1315 bytes} [Sat Nov 27 21:06:27 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30/os-interface => generated 1830 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:06:27.755391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f687a4a-3689-4ec1-9bab-963aa27f5c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:27.756358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f687a4a-3689-4ec1-9bab-963aa27f5c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:27.763125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f687a4a-3689-4ec1-9bab-963aa27f5c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.763798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f687a4a-3689-4ec1-9bab-963aa27f5c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.764475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f687a4a-3689-4ec1-9bab-963aa27f5c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:27.764923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f687a4a-3689-4ec1-9bab-963aa27f5c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:27.806101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f687a4a-3689-4ec1-9bab-963aa27f5c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.054734 Nov 27 21:06:27.806844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2788/5460] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:27 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:28.264461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:28.265248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:28.273478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:28.274229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:28.275669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:28.276313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:28.472628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:28.478922 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9052c5a-fe34-4714-9a4f-0892b2e30701 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.221470 Nov 27 21:06:28.479615 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2673/5461] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:28 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:28.818591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6307397-8e8b-4bc1-a148-711fcb6bfb3c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:28.819713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6307397-8e8b-4bc1-a148-711fcb6bfb3c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:28.826955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6307397-8e8b-4bc1-a148-711fcb6bfb3c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:28.827452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6307397-8e8b-4bc1-a148-711fcb6bfb3c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:28.828250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6307397-8e8b-4bc1-a148-711fcb6bfb3c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:28.828697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6307397-8e8b-4bc1-a148-711fcb6bfb3c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:28.878579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6307397-8e8b-4bc1-a148-711fcb6bfb3c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.064001 Nov 27 21:06:28.880082 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2789/5462] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:28 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:29.497347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:29.498177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:29.505644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:29.506105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:29.506902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:29.507670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:29.725818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:29.734985 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8d3ec116-8abf-4b66-997c-7b9eafe6ee1e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.242124 Nov 27 21:06:29.735608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2674/5463] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:29 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:29.891242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc9f55cf-9729-4ea0-8556-0377d4d0aed3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:29.893290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc9f55cf-9729-4ea0-8556-0377d4d0aed3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:29.902119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9f55cf-9729-4ea0-8556-0377d4d0aed3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:29.903000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9f55cf-9729-4ea0-8556-0377d4d0aed3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:29.904076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9f55cf-9729-4ea0-8556-0377d4d0aed3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:29.904755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc9f55cf-9729-4ea0-8556-0377d4d0aed3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:30.194501 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc9f55cf-9729-4ea0-8556-0377d4d0aed3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.307236 Nov 27 21:06:30.195467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2790/5464] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:29 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:30.753726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:30.754978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:30.764222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:30.764980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:30.766076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:30.766565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:30.912242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:30.921363 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86da2471-6051-4b9a-94a8-9471d90dc5e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.172687 Nov 27 21:06:30.921976 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2675/5465] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:30 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:31.207455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42a724f4-aac1-4d80-91aa-cb61e71e14d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:31.209197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42a724f4-aac1-4d80-91aa-cb61e71e14d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:31.217105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a724f4-aac1-4d80-91aa-cb61e71e14d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:31.217564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a724f4-aac1-4d80-91aa-cb61e71e14d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:31.218356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a724f4-aac1-4d80-91aa-cb61e71e14d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:31.218795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42a724f4-aac1-4d80-91aa-cb61e71e14d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:31.263581 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42a724f4-aac1-4d80-91aa-cb61e71e14d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.060553 Nov 27 21:06:31.264228 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2791/5466] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:31 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:31.938859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:31.940671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:31.947601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:31.948273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:31.949266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:31.949930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:32.090370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:32.099382 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-447b0883-8963-48ea-9f71-271ca46f08ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.163998 Nov 27 21:06:32.100325 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2676/5467] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:31 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:32.276802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1d3e5bdb-c18a-447f-a436-01b7bb81ad58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:32.278725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1d3e5bdb-c18a-447f-a436-01b7bb81ad58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:32.289209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bdb-c18a-447f-a436-01b7bb81ad58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:32.289844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bdb-c18a-447f-a436-01b7bb81ad58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:32.290725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bdb-c18a-447f-a436-01b7bb81ad58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:32.291432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d3e5bdb-c18a-447f-a436-01b7bb81ad58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:32.354869 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1d3e5bdb-c18a-447f-a436-01b7bb81ad58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.082596 Nov 27 21:06:32.355977 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2792/5468] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:32 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:33.121269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:33.122677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:33.134655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:33.135395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:33.137015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:33.138010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:33.370469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8452453-0cf8-4170-9de8-f94787698e9c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:33.372150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8452453-0cf8-4170-9de8-f94787698e9c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:33.409727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8452453-0cf8-4170-9de8-f94787698e9c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:33.415068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8452453-0cf8-4170-9de8-f94787698e9c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:33.417607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8452453-0cf8-4170-9de8-f94787698e9c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:33.422005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8452453-0cf8-4170-9de8-f94787698e9c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:33.468840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:33.478424 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0683121e-025c-4ec2-aebe-144fa65b96ca tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.361793 Nov 27 21:06:33.481657 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2677/5469] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:33 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:33.530935 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8452453-0cf8-4170-9de8-f94787698e9c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.165942 Nov 27 21:06:33.531908 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2793/5470] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:33 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:34.497937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:34.499376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:34.507078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:34.507929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:34.508968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:34.509627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:34.542975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1423cf9-cc13-4888-83f1-f57cfb6b4736 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:34.546799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d1423cf9-cc13-4888-83f1-f57cfb6b4736 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:34.555025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1423cf9-cc13-4888-83f1-f57cfb6b4736 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:34.557554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1423cf9-cc13-4888-83f1-f57cfb6b4736 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:34.558689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1423cf9-cc13-4888-83f1-f57cfb6b4736 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:34.559331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1423cf9-cc13-4888-83f1-f57cfb6b4736 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:34.613429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1423cf9-cc13-4888-83f1-f57cfb6b4736 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.074666 Nov 27 21:06:34.614042 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2794/5471] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:34 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:34.789478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:34.797308 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b2455e5-e0ce-4438-926d-d3c70fdf59b8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.303246 Nov 27 21:06:34.798231 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2678/5472] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:34 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:35.630900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aee26c5c-7699-488f-b2d9-98498cb2225a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:35.633295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aee26c5c-7699-488f-b2d9-98498cb2225a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:35.643673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aee26c5c-7699-488f-b2d9-98498cb2225a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:35.644423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aee26c5c-7699-488f-b2d9-98498cb2225a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:35.645724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aee26c5c-7699-488f-b2d9-98498cb2225a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:35.646485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aee26c5c-7699-488f-b2d9-98498cb2225a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:35.706565 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aee26c5c-7699-488f-b2d9-98498cb2225a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.082994 Nov 27 21:06:35.715608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2795/5473] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:35 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:35.821772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:35.823709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:35.852839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:35.853890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:35.858904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:35.859497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:36.261419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:36.278543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf7ce5d2-0544-4b9c-b62f-9483452aa344 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.468023 Nov 27 21:06:36.279234 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2679/5474] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:35 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:36.288498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1196396259", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "3c2305ad-2518-4293-9163-cfc7ab918fa2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1255673624", "security_groups": []}, "os:scheduler_hints": {"different_host": ["b73f5655-5a54-4017-a8b8-1dacb1f718c0"]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:36.406897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] validate_networks() for [('3c2305ad-2518-4293-9163-cfc7ab918fa2', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:06:36.728348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-459ddbba-01eb-4ac5-bfd5-e16d252405f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:36.730113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-459ddbba-01eb-4ac5-bfd5-e16d252405f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:36.739442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-459ddbba-01eb-4ac5-bfd5-e16d252405f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:36.740270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-459ddbba-01eb-4ac5-bfd5-e16d252405f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:36.741228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-459ddbba-01eb-4ac5-bfd5-e16d252405f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:36.741824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-459ddbba-01eb-4ac5-bfd5-e16d252405f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:36.825486 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-459ddbba-01eb-4ac5-bfd5-e16d252405f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.111143 Nov 27 21:06:36.832208 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2680/5475] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:36 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:37.298574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:37.300038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:37.309410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:37.311389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:37.314687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:37.316319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:37.359282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:06:37.359799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:06:37.360329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:06:37.360990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:06:37.361482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:06:37.382304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:37.383901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:37.385151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:37.385800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:37.420148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:06:37.428728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Getting quotas for user 21a4340936c347d3b226f54f99403219 and project 8367cf5d4f724cabb1d4ac0a8e7a6b89. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:06:37.469157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:06:37.477960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:06:37.574554 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ab5c011-586d-4b9d-96c9-b51ee03ec512 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.293764 Nov 27 21:06:37.578263 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2796/5476] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:06:36 2021] POST /compute/v2.1/servers => generated 361 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:06:37.588486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:37.591907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da3a35b6-af40-45b4-8031-43ff613facf3 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:37.594686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da3a35b6-af40-45b4-8031-43ff613facf3 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:37.602167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-209ed319-710c-47ff-bbcf-0e435e776688 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.309952 Nov 27 21:06:37.603157 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2681/5477] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:37 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:37.698211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da3a35b6-af40-45b4-8031-43ff613facf3 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:37.711325 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da3a35b6-af40-45b4-8031-43ff613facf3 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1242 microversion: 2.1 time: 0.123415 Nov 27 21:06:37.712913 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2797/5478] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:37 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:37.841523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6dbdab78-cd6a-46fb-b736-e6934ef29384 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:37.842455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6dbdab78-cd6a-46fb-b736-e6934ef29384 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:37.852395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbdab78-cd6a-46fb-b736-e6934ef29384 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:37.853788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbdab78-cd6a-46fb-b736-e6934ef29384 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:37.855029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbdab78-cd6a-46fb-b736-e6934ef29384 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:37.856734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dbdab78-cd6a-46fb-b736-e6934ef29384 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:37.948181 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6dbdab78-cd6a-46fb-b736-e6934ef29384 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.111022 Nov 27 21:06:37.952762 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2682/5479] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:37 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:38.620956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:38.622314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:38.640742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:38.645110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:38.647240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:38.647953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:38.732899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:38.747814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:38.781261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:38.781729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:38.782602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:38.783234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:38.916308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:38.926903 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32d8f033-75bc-4d20-863d-3e9afddc544d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1238 microversion: 2.1 time: 0.200234 Nov 27 21:06:38.929935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:38.937762 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2683/5480] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:38 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1238 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:38.938011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d1ef4a2-6ade-4a45-b097-1fcbd366bd90 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.321194 Nov 27 21:06:38.938493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2798/5481] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:38 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:38.968544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f5c4d51-53e3-4103-8d0b-8390c6050eb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:38.971848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f5c4d51-53e3-4103-8d0b-8390c6050eb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:38.977991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f5c4d51-53e3-4103-8d0b-8390c6050eb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:38.978587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f5c4d51-53e3-4103-8d0b-8390c6050eb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:38.979750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f5c4d51-53e3-4103-8d0b-8390c6050eb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:38.980433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f5c4d51-53e3-4103-8d0b-8390c6050eb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:39.067538 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f5c4d51-53e3-4103-8d0b-8390c6050eb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.104901 Nov 27 21:06:39.069102 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2684/5482] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:38 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:39.945495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:39.947027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:39.955888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:39.956593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:39.970153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:39.970603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:39.971440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:39.971879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:39.975404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:39.975859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:39.976916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:39.977106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:40.068785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:40.077916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12651ba8-3556-4bce-bce0-6b2edb76f56b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.137630 Nov 27 21:06:40.078728 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2799/5483] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:39 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:40.084275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a192caa-e44b-4c60-b929-efd798c18503 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:40.085615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a192caa-e44b-4c60-b929-efd798c18503 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:40.094126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a192caa-e44b-4c60-b929-efd798c18503 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:40.094983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a192caa-e44b-4c60-b929-efd798c18503 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:40.096849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a192caa-e44b-4c60-b929-efd798c18503 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:40.097782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a192caa-e44b-4c60-b929-efd798c18503 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:40.175389 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a192caa-e44b-4c60-b929-efd798c18503 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.094390 Nov 27 21:06:40.175981 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2800/5484] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:40 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:40.183296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:40.194419 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-991b0df5-77fd-4f16-9efd-a6252f256252 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.243071 Nov 27 21:06:40.195364 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2685/5485] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:39 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:41.098534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:41.099944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:41.115366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:41.115865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:41.118790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:41.119238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:41.187048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c2d6764f-6535-4e1d-b28a-7e43668032e3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:41.188236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c2d6764f-6535-4e1d-b28a-7e43668032e3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:41.212338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d6764f-6535-4e1d-b28a-7e43668032e3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:41.213318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d6764f-6535-4e1d-b28a-7e43668032e3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:41.214527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d6764f-6535-4e1d-b28a-7e43668032e3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:41.215537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d6764f-6535-4e1d-b28a-7e43668032e3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:41.310930 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c2d6764f-6535-4e1d-b28a-7e43668032e3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.128314 Nov 27 21:06:41.312983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2686/5486] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:41 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:41.321226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:41.321935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:41.344288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:41.345395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:41.346512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:41.347126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:41.476066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:41.486524 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-babfc25b-afdd-4577-a17d-2f82f690a25b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.393901 Nov 27 21:06:41.494100 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2801/5487] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:41 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:41.551566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:41.563465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5a935572-4033-42ef-807a-f65612436637 req-0b1d9de8-73d4-4108-93a6-2b7f4f0c5b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aa18b08-2216-447b-a821-c1fd7cfa67c6", "tag": "bd5f150c-0bba-4f1a-a18b-b447241a905f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:41.565182 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:41.565182 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:06:41.575544 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-691fd014-12fb-46b2-aa27-d2860f7ca196 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.260956 Nov 27 21:06:41.576131 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2687/5488] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:41 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:41.582123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5a935572-4033-42ef-807a-f65612436637 req-0b1d9de8-73d4-4108-93a6-2b7f4f0c5b38 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:41.582776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5a935572-4033-42ef-807a-f65612436637 req-0b1d9de8-73d4-4108-93a6-2b7f4f0c5b38 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:41.598290 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5a935572-4033-42ef-807a-f65612436637 req-0b1d9de8-73d4-4108-93a6-2b7f4f0c5b38 service nova] Creating event network-changed:bd5f150c-0bba-4f1a-a18b-b447241a905f for instance 5aa18b08-2216-447b-a821-c1fd7cfa67c6 on nch1-master-1 Nov 27 21:06:41.604738 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5a935572-4033-42ef-807a-f65612436637 req-0b1d9de8-73d4-4108-93a6-2b7f4f0c5b38 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060194 Nov 27 21:06:41.606309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2802/5489] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:06:42.324180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56158c6f-1236-470a-92f3-7261b6ec469a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:42.325195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56158c6f-1236-470a-92f3-7261b6ec469a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:42.337134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56158c6f-1236-470a-92f3-7261b6ec469a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:42.339787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56158c6f-1236-470a-92f3-7261b6ec469a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:42.342281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56158c6f-1236-470a-92f3-7261b6ec469a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:42.342961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56158c6f-1236-470a-92f3-7261b6ec469a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:42.407935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56158c6f-1236-470a-92f3-7261b6ec469a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.084783 Nov 27 21:06:42.409619 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2688/5490] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:42 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:42.507471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:42.508892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:42.517196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:42.517963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:42.518453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:42.518894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:42.593013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:42.593714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:42.606306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:42.607018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:42.608740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:42.609208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:42.664535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:42.685918 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d09eb671-0c57-4d79-9c26-1f4ffe11df6b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.185367 Nov 27 21:06:42.686521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2803/5491] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:42 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:42.865510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:42.874897 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d586ede-110c-41b2-b189-90e2ebd141ac tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.285716 Nov 27 21:06:42.884693 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2689/5492] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:42 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:43.419719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1cc0fa33-3d0b-4794-a903-407123a21597 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:43.420644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1cc0fa33-3d0b-4794-a903-407123a21597 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:43.427076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc0fa33-3d0b-4794-a903-407123a21597 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:43.427569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc0fa33-3d0b-4794-a903-407123a21597 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:43.428356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc0fa33-3d0b-4794-a903-407123a21597 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:43.428806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc0fa33-3d0b-4794-a903-407123a21597 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:43.468675 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1cc0fa33-3d0b-4794-a903-407123a21597 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.052572 Nov 27 21:06:43.469337 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2804/5493] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:43 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:43.703035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:43.703608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:43.710340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:43.710789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:43.711589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:43.712029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:43.793420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:43.801214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f7af268-c108-4bc7-ae1d-6194507066ea tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.101963 Nov 27 21:06:43.801775 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2690/5494] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:43 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:43.892487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:43.893192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:43.900539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:43.900997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:43.901781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:43.902223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:44.041252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:44.048598 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58055617-dd0c-49da-b6b3-7210db3ab519 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.160111 Nov 27 21:06:44.050146 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2805/5495] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:43 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:44.311897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-119134299", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "0771b852-2194-43c2-9f78-4a1a5847b501"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:44.367489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] validate_networks() for [('0771b852-2194-43c2-9f78-4a1a5847b501', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:06:44.480601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bba7ab9c-ba88-4555-800c-20cab592a2ca tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:44.481444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bba7ab9c-ba88-4555-800c-20cab592a2ca tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:44.488167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba7ab9c-ba88-4555-800c-20cab592a2ca tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:44.488629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba7ab9c-ba88-4555-800c-20cab592a2ca tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:44.489447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba7ab9c-ba88-4555-800c-20cab592a2ca tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:44.489886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bba7ab9c-ba88-4555-800c-20cab592a2ca tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:44.544102 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bba7ab9c-ba88-4555-800c-20cab592a2ca tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.067137 Nov 27 21:06:44.545350 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2806/5496] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:44 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:44.819062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:44.819794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:44.826693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:44.827151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:44.827966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:44.828407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:44.912587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:44.920419 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-29bfb3a3-63d5-4480-a769-df15a4779fa6 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.106217 Nov 27 21:06:44.922875 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2807/5497] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:44 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:44.923020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:06:44.923620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:06:44.924195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:06:44.925053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:06:44.925573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:06:44.934887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:44.935367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:44.936217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:44.936660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:44.957430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Getting quotas for project f916d44620e3418a8916382d00618dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:06:44.962452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Getting quotas for user bd92ea56b41244a58e3a959f665431c2 and project f916d44620e3418a8916382d00618dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:06:44.975198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:06:44.978369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:06:45.025969 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9c96e20-01da-446b-acc7-cbf52975d303 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717719 Nov 27 21:06:45.031442 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2691/5498] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:06:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:06:45.036451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fe4eaec1-669c-483e-8d93-f816daa9619b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:45.037056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fe4eaec1-669c-483e-8d93-f816daa9619b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:45.066559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:45.067179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:45.073864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:45.074338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:45.075131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:45.075607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:45.121613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fe4eaec1-669c-483e-8d93-f816daa9619b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:45.133259 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fe4eaec1-669c-483e-8d93-f816daa9619b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1213 microversion: 2.1 time: 0.100446 Nov 27 21:06:45.133844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2808/5499] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:45 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:45.276115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:45.284557 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ddd602de-3956-4865-9444-7823b350f0e9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.222134 Nov 27 21:06:45.285160 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2692/5500] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:45 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:45.556651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e72187f8-b3ff-4938-873c-70e215d7959b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:45.557974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e72187f8-b3ff-4938-873c-70e215d7959b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:45.564326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e72187f8-b3ff-4938-873c-70e215d7959b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:45.564771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e72187f8-b3ff-4938-873c-70e215d7959b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:45.565550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e72187f8-b3ff-4938-873c-70e215d7959b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:45.565980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e72187f8-b3ff-4938-873c-70e215d7959b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:45.605874 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e72187f8-b3ff-4938-873c-70e215d7959b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.052879 Nov 27 21:06:45.606757 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2809/5501] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:45 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:45.936448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:45.937062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:45.944060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:45.944504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:45.945360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:45.945794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:46.090315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:46.100040 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b22f2eb1-2250-49b8-8447-54f24f0fc14d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.167277 Nov 27 21:06:46.100927 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2693/5502] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:45 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:46.153213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:46.154157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:46.162610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:46.163142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:46.164175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:46.164690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:46.236105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:46.247194 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eca9e76f-d9f1-4a29-96be-06d9942344b9 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1271 microversion: 2.1 time: 0.099426 Nov 27 21:06:46.248937 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2810/5503] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:46 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:46.301863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:46.302610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:46.308803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:46.309453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:46.310415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:46.311021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:46.543648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:46.552297 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86218b47-7e78-4e89-84d8-897e15eff224 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.254369 Nov 27 21:06:46.553119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2694/5504] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:46 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:46.618441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10a028ff-14db-42a8-b782-461a94b824a4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:46.619396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10a028ff-14db-42a8-b782-461a94b824a4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:46.626000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10a028ff-14db-42a8-b782-461a94b824a4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:46.626464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10a028ff-14db-42a8-b782-461a94b824a4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:46.627273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10a028ff-14db-42a8-b782-461a94b824a4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:46.628267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10a028ff-14db-42a8-b782-461a94b824a4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:46.670011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10a028ff-14db-42a8-b782-461a94b824a4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.055069 Nov 27 21:06:46.670621 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2811/5505] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:46 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:47.117878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:47.118493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:47.126169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.126641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.127467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.127917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.266669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:47.267464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:47.275056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.275537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.276401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.276853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.280985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:47.289706 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa869bde-eb15-4973-b8d5-1325cef9fa2b tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.175395 Nov 27 21:06:47.290285 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2695/5506] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:47 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:47.441620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:47.452094 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd92cd89-8e62-4dfc-8dce-9dfc48c9c5a5 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.189579 Nov 27 21:06:47.453421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2812/5507] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:47 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:47.491991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-dfe6235b-9ae1-4131-9f94-b3eebaf73f07 req-395a43a7-16f7-49be-b642-44393dbd08f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfeb79d3-6bf2-4d24-9f06-9ff60e170931", "tag": "9101f8e1-94cc-4943-98a2-eba62038f7e4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:47.495139 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:47.495139 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:06:47.514628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dfe6235b-9ae1-4131-9f94-b3eebaf73f07 req-395a43a7-16f7-49be-b642-44393dbd08f0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.515430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dfe6235b-9ae1-4131-9f94-b3eebaf73f07 req-395a43a7-16f7-49be-b642-44393dbd08f0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.527592 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-dfe6235b-9ae1-4131-9f94-b3eebaf73f07 req-395a43a7-16f7-49be-b642-44393dbd08f0 service nova] Creating event network-changed:9101f8e1-94cc-4943-98a2-eba62038f7e4 for instance bfeb79d3-6bf2-4d24-9f06-9ff60e170931 on nch2-master-1 Nov 27 21:06:47.532726 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-dfe6235b-9ae1-4131-9f94-b3eebaf73f07 req-395a43a7-16f7-49be-b642-44393dbd08f0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049070 Nov 27 21:06:47.533322 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2696/5508] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:47.568612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:47.569226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:47.576379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.576841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.577634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.578079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.686001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f7fe0bb-c31c-48e4-8b16-a8627e3cbc65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:47.689222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f7fe0bb-c31c-48e4-8b16-a8627e3cbc65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:47.697357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f7fe0bb-c31c-48e4-8b16-a8627e3cbc65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.698051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f7fe0bb-c31c-48e4-8b16-a8627e3cbc65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.699056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f7fe0bb-c31c-48e4-8b16-a8627e3cbc65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.699691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f7fe0bb-c31c-48e4-8b16-a8627e3cbc65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.721638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:47.731774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-11a002ee-9ec8-4f8a-88f2-e08c2b181494 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.166865 Nov 27 21:06:47.732394 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2813/5509] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:47 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:47.756503 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f7fe0bb-c31c-48e4-8b16-a8627e3cbc65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.077789 Nov 27 21:06:47.757626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2697/5510] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:47 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:47.844495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cab31131-f5ed-4d31-b4df-dcf67492b920 req-edaff2e7-7ecb-4c86-8faf-e023e60e06e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa18b08-2216-447b-a821-c1fd7cfa67c6", "name": "network-vif-plugged", "status": "completed", "tag": "bd5f150c-0bba-4f1a-a18b-b447241a905f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:47.846198 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:47.846198 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:06:47.854117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cab31131-f5ed-4d31-b4df-dcf67492b920 req-edaff2e7-7ecb-4c86-8faf-e023e60e06e9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:47.854751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cab31131-f5ed-4d31-b4df-dcf67492b920 req-edaff2e7-7ecb-4c86-8faf-e023e60e06e9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:47.866478 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cab31131-f5ed-4d31-b4df-dcf67492b920 req-edaff2e7-7ecb-4c86-8faf-e023e60e06e9 service nova] Creating event network-vif-plugged:bd5f150c-0bba-4f1a-a18b-b447241a905f for instance 5aa18b08-2216-447b-a821-c1fd7cfa67c6 on nch1-master-1 Nov 27 21:06:47.872323 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cab31131-f5ed-4d31-b4df-dcf67492b920 req-edaff2e7-7ecb-4c86-8faf-e023e60e06e9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031907 Nov 27 21:06:47.873215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2814/5511] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:48.306843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:48.307587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:48.315979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.316441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.317265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.317741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.451111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:48.459483 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a337fe4-5f07-49a8-ad5b-8587b709d858 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1300 microversion: 2.1 time: 0.156631 Nov 27 21:06:48.460067 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2698/5512] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:48 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:48.470899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:48.472144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:48.479089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.479572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.480346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.480785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.618943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:48.626927 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e92150a-693c-4893-a168-f020ea1d1f09 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.159877 Nov 27 21:06:48.628107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2815/5513] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:48 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:48.749354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:48.750192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:48.756945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.757803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.758268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.758988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.768839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0665d5f-5a52-47e0-9c1b-c28dbc6b0aad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:48.770035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0665d5f-5a52-47e0-9c1b-c28dbc6b0aad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:48.776292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0665d5f-5a52-47e0-9c1b-c28dbc6b0aad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.777058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0665d5f-5a52-47e0-9c1b-c28dbc6b0aad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.778393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0665d5f-5a52-47e0-9c1b-c28dbc6b0aad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:48.779188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0665d5f-5a52-47e0-9c1b-c28dbc6b0aad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:48.825880 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0665d5f-5a52-47e0-9c1b-c28dbc6b0aad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.060707 Nov 27 21:06:48.826927 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2816/5514] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:48 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:48.914733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:48.922341 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8a2e493-3fdb-4879-ab89-356c8278dfc8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.176956 Nov 27 21:06:48.923046 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2699/5515] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:48 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:49.476961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:49.477664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:49.485122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.485580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.486397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.486839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.577138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:49.585223 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a90b0b2-f052-488b-a6eb-311f5f5ea88c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1473 microversion: 2.1 time: 0.112550 Nov 27 21:06:49.585780 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2817/5516] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:49 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1473 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:49.601003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:49.601642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:49.608265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.608722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.609491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.609924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.645584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:49.646188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:49.652751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.653199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.653982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.654416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.693774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:49.701222 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30a881fa-ef3d-4693-81d6-64c5f54120d9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1473 microversion: 2.1 time: 0.103843 Nov 27 21:06:49.701800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2700/5517] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:49 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1473 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:49.716537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e3cc5cc3-0294-422b-8101-6a67fa810608 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:49.717145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e3cc5cc3-0294-422b-8101-6a67fa810608 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:49.723040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3cc5cc3-0294-422b-8101-6a67fa810608 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.723523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3cc5cc3-0294-422b-8101-6a67fa810608 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.724301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3cc5cc3-0294-422b-8101-6a67fa810608 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.724736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3cc5cc3-0294-422b-8101-6a67fa810608 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.786592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:49.794148 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-091323f3-c0d5-4bd8-8527-1f60c55cefa7 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.152018 Nov 27 21:06:49.794802 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2818/5518] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:49 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:49.810118 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e3cc5cc3-0294-422b-8101-6a67fa810608 tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1624 microversion: 2.1 time: 0.097054 Nov 27 21:06:49.810672 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2701/5519] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:49 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1624 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:49.826195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97fd15a6-8a57-4b0c-9946-571d56aed40d tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:49.826747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97fd15a6-8a57-4b0c-9946-571d56aed40d tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:49.832847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fd15a6-8a57-4b0c-9946-571d56aed40d tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.833303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fd15a6-8a57-4b0c-9946-571d56aed40d tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.834264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fd15a6-8a57-4b0c-9946-571d56aed40d tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.834711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fd15a6-8a57-4b0c-9946-571d56aed40d tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.838931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b963667d-8040-4a22-a787-bca0c160402e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:49.839988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b963667d-8040-4a22-a787-bca0c160402e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:49.845747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b963667d-8040-4a22-a787-bca0c160402e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.846230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b963667d-8040-4a22-a787-bca0c160402e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.847003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b963667d-8040-4a22-a787-bca0c160402e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.847576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b963667d-8040-4a22-a787-bca0c160402e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.887854 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b963667d-8040-4a22-a787-bca0c160402e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.052288 Nov 27 21:06:49.888748 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2702/5520] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:49 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:49.942705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:49.943433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:49.950476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.950917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.951734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:49.952179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:49.972645 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97fd15a6-8a57-4b0c-9946-571d56aed40d tempest-TestSecurityGroupsBasicOps-181105384 tempest-TestSecurityGroupsBasicOps-181105384-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1912 microversion: 2.1 time: 0.150084 Nov 27 21:06:49.973211 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2819/5521] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:49 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1912 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:50.033967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:50.034467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:50.040916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.041474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.042324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.042771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.067948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:06:50.085374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:50.093322 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-82ce14fd-a220-4639-a384-fb45eda11de0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.155316 Nov 27 21:06:50.093904 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2703/5522] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:49 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:50.141913 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1ee21ea-0a43-46dc-a0d0-bd8bc90c556c tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 204 len: 0 microversion: 2.1 time: 0.111635 Nov 27 21:06:50.142508 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2820/5523] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:06:50 2021] DELETE /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:06:50.152175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:50.152775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:50.159586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.160046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.160952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.161427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.246276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:50.253715 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74f825de-2cc9-47b8-827b-f1637034355e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1479 microversion: 2.1 time: 0.106813 Nov 27 21:06:50.254279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2704/5524] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:50 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1479 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:50.812137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:50.812850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:50.820093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.820548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.821330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.821805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.899470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ff54153-9f6b-472c-8f7e-20acc5e1f485 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:50.900772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ff54153-9f6b-472c-8f7e-20acc5e1f485 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:50.907536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ff54153-9f6b-472c-8f7e-20acc5e1f485 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.907997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ff54153-9f6b-472c-8f7e-20acc5e1f485 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.908828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ff54153-9f6b-472c-8f7e-20acc5e1f485 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:50.909272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ff54153-9f6b-472c-8f7e-20acc5e1f485 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:50.954610 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ff54153-9f6b-472c-8f7e-20acc5e1f485 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.058678 Nov 27 21:06:50.959569 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2705/5525] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:50 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:50.959702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:50.968416 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19b919c0-2263-43ef-a616-5c9665a0cb53 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.160381 Nov 27 21:06:50.968982 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2821/5526] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:50 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:51.120150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:51.121171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:51.128873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.129360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:51.130161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.130601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:51.269753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:51.270445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:51.277167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.277683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:51.278532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.279036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:51.293500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:51.301885 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-69c9edac-0833-40fd-8e0c-eb6d8a6a7214 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.195662 Nov 27 21:06:51.302610 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2706/5527] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:51 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:51.364351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:51.372128 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba698ba9-c62f-4dd0-b1e1-73ee455c2566 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1479 microversion: 2.1 time: 0.106210 Nov 27 21:06:51.372695 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2822/5528] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:51 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1479 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:51.966418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-374e1e95-faa3-41d4-8e21-76f3460c71c5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:51.967499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-374e1e95-faa3-41d4-8e21-76f3460c71c5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:51.974595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374e1e95-faa3-41d4-8e21-76f3460c71c5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.975044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374e1e95-faa3-41d4-8e21-76f3460c71c5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:51.975861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374e1e95-faa3-41d4-8e21-76f3460c71c5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.976294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374e1e95-faa3-41d4-8e21-76f3460c71c5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:51.985019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:51.985613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:51.992601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.993050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:51.993829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:51.994438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:52.027120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-374e1e95-faa3-41d4-8e21-76f3460c71c5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.064543 Nov 27 21:06:52.027846 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2707/5529] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:51 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:52.240454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:52.248191 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae29c7ae-53e2-431b-90a9-565dc5d18d55 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.266824 Nov 27 21:06:52.248760 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2823/5530] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:51 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:52.321595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:52.322455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:52.331110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:52.331597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:52.332386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:52.332826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:52.389893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:52.390589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:52.397623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:52.398484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:52.399739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:52.400374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:52.513923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:52.525265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-116268f5-0576-45cd-8cbc-bcebfd9f0da4 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 200 len: 1479 microversion: 2.1 time: 0.138937 Nov 27 21:06:52.525841 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2824/5531] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:52 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 1479 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:52.526036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:52.531195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-71e38efb-93de-46e8-ae26-a8339e6812dd req-4f5b2094-2795-46e8-8f8b-c8dc30b846bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa18b08-2216-447b-a821-c1fd7cfa67c6", "name": "network-vif-deleted", "tag": "bd5f150c-0bba-4f1a-a18b-b447241a905f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:52.533163 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:52.533163 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:06:52.534633 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a3ded91-3f98-4dd1-bd7b-37d33e1d432a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.217827 Nov 27 21:06:52.549170 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2708/5532] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:52 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:52.553419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-71e38efb-93de-46e8-ae26-a8339e6812dd req-4f5b2094-2795-46e8-8f8b-c8dc30b846bb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:52.554072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-71e38efb-93de-46e8-ae26-a8339e6812dd req-4f5b2094-2795-46e8-8f8b-c8dc30b846bb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:52.568717 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-71e38efb-93de-46e8-ae26-a8339e6812dd req-4f5b2094-2795-46e8-8f8b-c8dc30b846bb service nova] Creating event network-vif-deleted:bd5f150c-0bba-4f1a-a18b-b447241a905f for instance 5aa18b08-2216-447b-a821-c1fd7cfa67c6 on nch1-master-1 Nov 27 21:06:52.574530 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-71e38efb-93de-46e8-ae26-a8339e6812dd req-4f5b2094-2795-46e8-8f8b-c8dc30b846bb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046924 Nov 27 21:06:52.575417 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2825/5533] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:53.038461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5552ceeb-d5e9-4cd8-87a7-3c859b5c91b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:53.039328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5552ceeb-d5e9-4cd8-87a7-3c859b5c91b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:53.046242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5552ceeb-d5e9-4cd8-87a7-3c859b5c91b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.046695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5552ceeb-d5e9-4cd8-87a7-3c859b5c91b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.047510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5552ceeb-d5e9-4cd8-87a7-3c859b5c91b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.047951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5552ceeb-d5e9-4cd8-87a7-3c859b5c91b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.091661 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5552ceeb-d5e9-4cd8-87a7-3c859b5c91b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.056749 Nov 27 21:06:53.092542 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2709/5534] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:53 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:53.265422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:53.266115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:53.273070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.273519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.274309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.274731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.412995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:53.420491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca83af5b-9631-47fe-a5b0-ea90c6364b67 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.159121 Nov 27 21:06:53.421053 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2826/5535] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:53 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:53.542222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:53.543085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: 5aa18b08-2216-447b-a821-c1fd7cfa67c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:53.550895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.551470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.552325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.552859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.553851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:53.554521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:53.562250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.562732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.563522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:53.563963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:53.568427 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] HTTP exception thrown: Instance 5aa18b08-2216-447b-a821-c1fd7cfa67c6 could not be found. Nov 27 21:06:53.569031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Returning 404 to user: Instance 5aa18b08-2216-447b-a821-c1fd7cfa67c6 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:06:53.569999 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95d4e62b-55c4-46e8-8a6d-eabc653ebb3d tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6" status: 404 len: 111 microversion: 2.1 time: 0.031866 Nov 27 21:06:53.570826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2710/5536] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:53 2021] GET /compute/v2.1/servers/5aa18b08-2216-447b-a821-c1fd7cfa67c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:06:53.840904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:53.848486 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4954dbb7-4f93-4a80-bdb9-bf5ee4a9d187 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.298434 Nov 27 21:06:53.849072 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2827/5537] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:53 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:54.102844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d296fb85-3afb-4bcc-8994-e7d26dfb883c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:54.104010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d296fb85-3afb-4bcc-8994-e7d26dfb883c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:54.110858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d296fb85-3afb-4bcc-8994-e7d26dfb883c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:54.112102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d296fb85-3afb-4bcc-8994-e7d26dfb883c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:54.112911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d296fb85-3afb-4bcc-8994-e7d26dfb883c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:54.113349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d296fb85-3afb-4bcc-8994-e7d26dfb883c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:54.161474 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d296fb85-3afb-4bcc-8994-e7d26dfb883c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.062350 Nov 27 21:06:54.165502 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2711/5538] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:54 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:54.438134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:54.439427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:54.447042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:54.447541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:54.448331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:54.448761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:54.680222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:54.693622 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-532e24b3-9cef-448c-b3a4-e7a42f5fe602 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.259929 Nov 27 21:06:54.694800 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2828/5539] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:54 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:54.708555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-58c316b0-6f9a-454d-b141-dc7212536945 req-b527ab57-f343-4d08-bb81-ddcb7bcec159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfeb79d3-6bf2-4d24-9f06-9ff60e170931", "name": "network-vif-plugged", "status": "completed", "tag": "9101f8e1-94cc-4943-98a2-eba62038f7e4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:54.709246 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:54.709246 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:06:54.719196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-58c316b0-6f9a-454d-b141-dc7212536945 req-b527ab57-f343-4d08-bb81-ddcb7bcec159 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:54.720651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-58c316b0-6f9a-454d-b141-dc7212536945 req-b527ab57-f343-4d08-bb81-ddcb7bcec159 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:54.733428 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-58c316b0-6f9a-454d-b141-dc7212536945 req-b527ab57-f343-4d08-bb81-ddcb7bcec159 service nova] Creating event network-vif-plugged:9101f8e1-94cc-4943-98a2-eba62038f7e4 for instance bfeb79d3-6bf2-4d24-9f06-9ff60e170931 on nch2-master-1 Nov 27 21:06:54.743965 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-58c316b0-6f9a-454d-b141-dc7212536945 req-b527ab57-f343-4d08-bb81-ddcb7bcec159 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040627 Nov 27 21:06:54.744786 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2712/5540] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:06:54.866902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:54.868029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:54.875517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:54.876152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:54.877166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:54.877738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:55.170021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:55.175211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af21151a-01b6-4719-b3b2-90ecd550a883 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:55.176943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af21151a-01b6-4719-b3b2-90ecd550a883 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:55.177598 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1751b592-0258-4a7a-8c00-6e8c95b3fc04 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.315078 Nov 27 21:06:55.183331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af21151a-01b6-4719-b3b2-90ecd550a883 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:55.183789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af21151a-01b6-4719-b3b2-90ecd550a883 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:55.184797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af21151a-01b6-4719-b3b2-90ecd550a883 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:55.185527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af21151a-01b6-4719-b3b2-90ecd550a883 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:55.187229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2829/5541] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:54 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:55.234608 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af21151a-01b6-4719-b3b2-90ecd550a883 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.064592 Nov 27 21:06:55.238604 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2713/5542] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:55 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:06:55.709873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:55.710422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:55.717357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:55.717857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:55.723896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:55.724788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:55.869467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:55.878592 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53cdb752-4c3c-4045-b5c8-d30f62d2c350 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1313 microversion: 2.1 time: 0.172484 Nov 27 21:06:55.879167 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2830/5543] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:55 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:56.196522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:56.198221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:56.206489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:56.207192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:56.222015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:56.222749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:56.248778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4854a78e-9e2b-471c-80b2-462703c4e8b5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:56.250237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4854a78e-9e2b-471c-80b2-462703c4e8b5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:56.280545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4854a78e-9e2b-471c-80b2-462703c4e8b5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:56.281249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4854a78e-9e2b-471c-80b2-462703c4e8b5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:56.282262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4854a78e-9e2b-471c-80b2-462703c4e8b5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:56.288613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4854a78e-9e2b-471c-80b2-462703c4e8b5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:56.406818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4854a78e-9e2b-471c-80b2-462703c4e8b5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.163050 Nov 27 21:06:56.413313 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2831/5544] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:56 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:56.809190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:56.820602 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88fe06be-c6dd-40e2-9313-4441b072128f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1521 microversion: 2.1 time: 0.629845 Nov 27 21:06:56.821656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2714/5545] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:56 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:56.896626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:56.897388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:56.904683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:56.905150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:56.905937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:56.906429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.047634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:57.055490 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a8ccf9a5-bb00-46ba-b687-0d8065313bf0 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1497 microversion: 2.1 time: 0.163668 Nov 27 21:06:57.056272 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2832/5546] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:56 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:57.421369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d820fc51-6bee-4a6f-bde4-564eb4823b31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:57.427731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d820fc51-6bee-4a6f-bde4-564eb4823b31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:57.436451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d820fc51-6bee-4a6f-bde4-564eb4823b31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.437142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d820fc51-6bee-4a6f-bde4-564eb4823b31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.438877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d820fc51-6bee-4a6f-bde4-564eb4823b31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.440288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d820fc51-6bee-4a6f-bde4-564eb4823b31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.496769 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d820fc51-6bee-4a6f-bde4-564eb4823b31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.079062 Nov 27 21:06:57.497001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:57.497492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:57.501172 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2715/5547] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:57 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:57.513363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.513930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.514931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.515455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.541794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:06:57.631578 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bda67631-5cea-409e-9720-e3cae985f005 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 204 len: 0 microversion: 2.1 time: 0.137440 Nov 27 21:06:57.634032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2833/5548] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:06:57 2021] DELETE /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:06:57.645095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:57.646393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:57.660979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.660979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.660979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.660979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.840984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:57.842835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:57.856046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.858247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.867715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:57.868897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:57.938293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:57.946402 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc84405b-a908-4af7-a392-7cad85896d49 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1503 microversion: 2.1 time: 0.307642 Nov 27 21:06:57.947982 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2716/5549] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:57 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:58.069416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:58.078931 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e92706ab-220a-45c9-b681-797eed0670ef tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1501 microversion: 2.1 time: 0.244155 Nov 27 21:06:58.086564 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2834/5550] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:57 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1501 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:58.097408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:58.098032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.105580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.106042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.106837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.107325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.363772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:58.371443 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a5ec7052-340f-4426-951d-00e2bbc6f66f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1516 microversion: 2.1 time: 0.279756 Nov 27 21:06:58.372010 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2717/5551] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:58 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1516 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:58.391076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f25ff7a-2976-4658-98ea-c8d5d804f0bb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:58.393117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f25ff7a-2976-4658-98ea-c8d5d804f0bb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 31015724-44a1-4afe-9906-7a7feef6d7ef] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.400940 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-5f25ff7a-2976-4658-98ea-c8d5d804f0bb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Instance 31015724-44a1-4afe-9906-7a7feef6d7ef could not be found. Nov 27 21:06:58.401813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f25ff7a-2976-4658-98ea-c8d5d804f0bb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 404 to user: Instance 31015724-44a1-4afe-9906-7a7feef6d7ef could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:06:58.402739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f25ff7a-2976-4658-98ea-c8d5d804f0bb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/31015724-44a1-4afe-9906-7a7feef6d7ef/action" status: 404 len: 111 microversion: 2.1 time: 0.017892 Nov 27 21:06:58.403639 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2835/5552] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:06:58 2021] POST /compute/v2.1/servers/31015724-44a1-4afe-9906-7a7feef6d7ef/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:06:58.414309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29854c1d-691e-4ed5-ba80-eef3470c674a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:58.414973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29854c1d-691e-4ed5-ba80-eef3470c674a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.422995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29854c1d-691e-4ed5-ba80-eef3470c674a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.425366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29854c1d-691e-4ed5-ba80-eef3470c674a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.427678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29854c1d-691e-4ed5-ba80-eef3470c674a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.428275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29854c1d-691e-4ed5-ba80-eef3470c674a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.432512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:58.433258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.442599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.443313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.444295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.444730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.472772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:06:58.519748 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29854c1d-691e-4ed5-ba80-eef3470c674a tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action" status: 202 len: 0 microversion: 2.1 time: 0.109756 Nov 27 21:06:58.520993 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2718/5553] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:06:58 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:58.534644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-72e838f7-5da4-4936-9eed-9f0fde680e59 req-c3844112-06c7-4c13-9b70-41cd21800c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73f5655-5a54-4017-a8b8-1dacb1f718c0", "tag": "04aa03c2-a96d-486e-b422-4296e83311b0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:58.536988 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:58.536988 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:06:58.546582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-72e838f7-5da4-4936-9eed-9f0fde680e59 req-c3844112-06c7-4c13-9b70-41cd21800c19 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.547326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-72e838f7-5da4-4936-9eed-9f0fde680e59 req-c3844112-06c7-4c13-9b70-41cd21800c19 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.563404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-72e838f7-5da4-4936-9eed-9f0fde680e59 req-c3844112-06c7-4c13-9b70-41cd21800c19 service nova] Creating event network-changed:04aa03c2-a96d-486e-b422-4296e83311b0 for instance b73f5655-5a54-4017-a8b8-1dacb1f718c0 on nch2-master-1 Nov 27 21:06:58.570403 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-72e838f7-5da4-4936-9eed-9f0fde680e59 req-c3844112-06c7-4c13-9b70-41cd21800c19 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047818 Nov 27 21:06:58.575360 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2719/5554] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:06:58.582228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-685afe06-4341-4796-8c1d-b5237b15fef0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:58.583529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-685afe06-4341-4796-8c1d-b5237b15fef0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.590687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-685afe06-4341-4796-8c1d-b5237b15fef0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.591655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-685afe06-4341-4796-8c1d-b5237b15fef0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.593012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-685afe06-4341-4796-8c1d-b5237b15fef0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.593625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-685afe06-4341-4796-8c1d-b5237b15fef0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.614931 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08f9a1ce-3f4f-46e6-a301-803d23dbad98 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 204 len: 0 microversion: 2.1 time: 0.186814 Nov 27 21:06:58.616469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2836/5555] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:06:58 2021] DELETE /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:06:58.623019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:58.624035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.630848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.631596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.633511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.634088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.649551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-685afe06-4341-4796-8c1d-b5237b15fef0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.072239 Nov 27 21:06:58.651427 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2720/5556] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:58 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:58.659143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:58.660091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.668431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.669155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.670335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.671060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.800880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:58.811575 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f69f90a3-c7cc-4f49-988f-bb751374c9d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1521 microversion: 2.1 time: 0.193509 Nov 27 21:06:58.812768 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2837/5557] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:58 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:58.965828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:58.966634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:58.979688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.980812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.984674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:58.993026 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a67d563-b157-4c7d-926b-5fae5f8fe920 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1767 microversion: 2.1 time: 0.340239 Nov 27 21:06:58.993464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:58.994307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:58.996802 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2721/5558] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:58 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1767 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:59.285098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:59.310643 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8a87c64c-eafc-48c4-9966-3d0ce69863c1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 200 len: 1503 microversion: 2.1 time: 0.337771 Nov 27 21:06:59.311567 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2838/5559] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:58 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:06:59.662690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0e23d079-dde6-42f6-bb4e-17b7ca74b175 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:59.664344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e23d079-dde6-42f6-bb4e-17b7ca74b175 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:59.672114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e23d079-dde6-42f6-bb4e-17b7ca74b175 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:59.672817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e23d079-dde6-42f6-bb4e-17b7ca74b175 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:59.674114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e23d079-dde6-42f6-bb4e-17b7ca74b175 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:59.674756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e23d079-dde6-42f6-bb4e-17b7ca74b175 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:59.719312 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0e23d079-dde6-42f6-bb4e-17b7ca74b175 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.060737 Nov 27 21:06:59.719975 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2722/5560] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:06:59 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:06:59.750567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2add5bd2-a0b7-468c-951b-92113c2e06a1 req-181d9303-b0d5-4864-b808-46f8326eec0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfeb79d3-6bf2-4d24-9f06-9ff60e170931", "name": "network-vif-deleted", "tag": "9101f8e1-94cc-4943-98a2-eba62038f7e4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:06:59.753364 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:06:59.753364 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:06:59.763017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2add5bd2-a0b7-468c-951b-92113c2e06a1 req-181d9303-b0d5-4864-b808-46f8326eec0c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:59.763486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2add5bd2-a0b7-468c-951b-92113c2e06a1 req-181d9303-b0d5-4864-b808-46f8326eec0c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:59.776478 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2add5bd2-a0b7-468c-951b-92113c2e06a1 req-181d9303-b0d5-4864-b808-46f8326eec0c service nova] Creating event network-vif-deleted:9101f8e1-94cc-4943-98a2-eba62038f7e4 for instance bfeb79d3-6bf2-4d24-9f06-9ff60e170931 on nch2-master-1 Nov 27 21:06:59.782643 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2add5bd2-a0b7-468c-951b-92113c2e06a1 req-181d9303-b0d5-4864-b808-46f8326eec0c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 Nov 27 21:06:59.783384 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2839/5561] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:06:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:06:59.830981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:06:59.831751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:06:59.838875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:59.839380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:59.840231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:06:59.840665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:06:59.974354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:06:59.981834 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84ffa923-4e46-422f-b39e-20100ebb8a81 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1501 microversion: 2.1 time: 0.155883 Nov 27 21:06:59.982419 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2723/5562] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:06:59 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:06:59.999769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:00.002255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:00.008489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.009151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.010146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.010589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.013334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:00.014083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:00.020870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.021342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.022141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.022589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.035151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lazy-loading 'flavor' on Instance uuid 7896504e-013d-42df-9c95-1445b03b7e48 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:07:00.046722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Cannot 'rescue' instance 7896504e-013d-42df-9c95-1445b03b7e48 while it is in vm_state paused Nov 27 21:07:00.047351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 409 to user: Cannot 'rescue' instance 7896504e-013d-42df-9c95-1445b03b7e48 while it is in vm_state paused {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:00.048182 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cadd9051-2e84-41f9-9932-23ef6c1aaa38 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action" status: 409 len: 144 microversion: 2.1 time: 0.053675 Nov 27 21:07:00.048996 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2840/5563] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:06:59 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action => generated 144 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:07:00.056668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83f97718-140d-4ea1-b765-8b17e1df43d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:00.057197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-83f97718-140d-4ea1-b765-8b17e1df43d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:00.063085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f97718-140d-4ea1-b765-8b17e1df43d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.063586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f97718-140d-4ea1-b765-8b17e1df43d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.064865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f97718-140d-4ea1-b765-8b17e1df43d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.065308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f97718-140d-4ea1-b765-8b17e1df43d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.132086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83f97718-140d-4ea1-b765-8b17e1df43d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action" status: 202 len: 0 microversion: 2.1 time: 0.078757 Nov 27 21:07:00.132763 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2841/5564] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:07:00 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:07:00.144445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:00.145156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:00.152491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.152491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.153366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.153810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.186510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:00.198006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aeebb116-e806-450f-8c08-efa61fc72ef0 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1648 microversion: 2.1 time: 0.187925 Nov 27 21:07:00.198697 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2724/5565] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:00 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1648 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:00.297258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:00.307602 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e7eab079-3a6f-47d8-b550-388961d2b0cd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1508 microversion: 2.1 time: 0.167045 Nov 27 21:07:00.319533 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2842/5566] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:00 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:00.329564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:00.330318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: bfeb79d3-6bf2-4d24-9f06-9ff60e170931] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:00.337951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.339054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.341338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.341708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.361957 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] HTTP exception thrown: Instance bfeb79d3-6bf2-4d24-9f06-9ff60e170931 could not be found. Nov 27 21:07:00.363050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Returning 404 to user: Instance bfeb79d3-6bf2-4d24-9f06-9ff60e170931 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:00.363965 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4eb81957-b733-42fd-b1ef-e05119433813 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931" status: 404 len: 111 microversion: 2.1 time: 0.039105 Nov 27 21:07:00.364532 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2725/5567] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:00 2021] GET /compute/v2.1/servers/bfeb79d3-6bf2-4d24-9f06-9ff60e170931 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:07:00.418780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2064938661", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "0771b852-2194-43c2-9f78-4a1a5847b501"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:00.490314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] validate_networks() for [('0771b852-2194-43c2-9f78-4a1a5847b501', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:07:00.731339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31a67275-c418-47e7-96d3-0a9a825dcc10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:00.732193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31a67275-c418-47e7-96d3-0a9a825dcc10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:00.739172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31a67275-c418-47e7-96d3-0a9a825dcc10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.739710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31a67275-c418-47e7-96d3-0a9a825dcc10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.740518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31a67275-c418-47e7-96d3-0a9a825dcc10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:00.741028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31a67275-c418-47e7-96d3-0a9a825dcc10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:00.784596 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31a67275-c418-47e7-96d3-0a9a825dcc10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.057209 Nov 27 21:07:00.788825 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2726/5568] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:00 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:01.216013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:01.216706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:01.224260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.224706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.225486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.225922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.343411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:07:01.344792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:07:01.346225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:07:01.346440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:07:01.346836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:07:01.358587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.359044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.359915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.360361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.383617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a4340936c347d3b226f54f99403219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:01.390536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Getting quotas for project f916d44620e3418a8916382d00618dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:07:01.392263 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ad82f44-2c7d-4d14-9b0c-a6b793b319f7 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 200 len: 1648 microversion: 2.1 time: 0.180911 Nov 27 21:07:01.392980 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2727/5569] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:01 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 1648 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:07:01.397232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Getting quotas for user bd92ea56b41244a58e3a959f665431c2 and project f916d44620e3418a8916382d00618dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:07:01.398416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:01.399984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:01.409358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.410022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.411001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.411661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.413525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:07:01.417758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:07:01.479436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9639e9a8-5aad-4e54-bd2c-86df01dcd19b tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064274 Nov 27 21:07:01.480126 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2843/5570] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:07:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:07:01.491714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f1537f0-fa1f-4d98-b160-44ad00975d17 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:01.495179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f1537f0-fa1f-4d98-b160-44ad00975d17 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:01.569765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3f1537f0-fa1f-4d98-b160-44ad00975d17 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:01.577891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f1537f0-fa1f-4d98-b160-44ad00975d17 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1214 microversion: 2.1 time: 0.090163 Nov 27 21:07:01.579307 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2844/5571] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:01 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:01.624313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:01.631829 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b96bf517-5594-4968-9447-8824ee067e3e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1516 microversion: 2.1 time: 0.237791 Nov 27 21:07:01.632761 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2728/5572] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:01 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:01.796812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a1a19f47-4f11-4f71-b0b2-85510fde6938 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:01.797804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a1a19f47-4f11-4f71-b0b2-85510fde6938 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:01.802132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7665746b-3220-4ce1-b5e9-46f6853c6916 req-507cf878-a604-4eae-9f93-9c403320ef12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73f5655-5a54-4017-a8b8-1dacb1f718c0", "name": "network-vif-deleted", "tag": "04aa03c2-a96d-486e-b422-4296e83311b0"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:01.803772 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:01.803772 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:07:01.817988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7665746b-3220-4ce1-b5e9-46f6853c6916 req-507cf878-a604-4eae-9f93-9c403320ef12 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.820841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7665746b-3220-4ce1-b5e9-46f6853c6916 req-507cf878-a604-4eae-9f93-9c403320ef12 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.824129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a19f47-4f11-4f71-b0b2-85510fde6938 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.826183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a19f47-4f11-4f71-b0b2-85510fde6938 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.829314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a19f47-4f11-4f71-b0b2-85510fde6938 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:01.830881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1a19f47-4f11-4f71-b0b2-85510fde6938 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:01.845270 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7665746b-3220-4ce1-b5e9-46f6853c6916 req-507cf878-a604-4eae-9f93-9c403320ef12 service nova] Creating event network-vif-deleted:04aa03c2-a96d-486e-b422-4296e83311b0 for instance b73f5655-5a54-4017-a8b8-1dacb1f718c0 on nch2-master-1 Nov 27 21:07:01.886495 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7665746b-3220-4ce1-b5e9-46f6853c6916 req-507cf878-a604-4eae-9f93-9c403320ef12 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086805 Nov 27 21:07:01.890443 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2729/5573] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:07:01.936161 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a1a19f47-4f11-4f71-b0b2-85510fde6938 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.142828 Nov 27 21:07:01.940306 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2845/5574] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:01 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:02.410948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:02.411750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] [instance: b73f5655-5a54-4017-a8b8-1dacb1f718c0] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:02.418059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:02.418559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:02.419435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:02.419941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:02.437714 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] HTTP exception thrown: Instance b73f5655-5a54-4017-a8b8-1dacb1f718c0 could not be found. Nov 27 21:07:02.438325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Returning 404 to user: Instance b73f5655-5a54-4017-a8b8-1dacb1f718c0 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:02.439178 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ed5e1ab-9236-45bf-bec0-9851d0fb0dd9 tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0" status: 404 len: 111 microversion: 2.1 time: 0.033501 Nov 27 21:07:02.439778 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2730/5575] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:02 2021] GET /compute/v2.1/servers/b73f5655-5a54-4017-a8b8-1dacb1f718c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:07:02.598420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:02.599316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:02.614799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:02.615708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:02.616532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:02.616970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:02.732743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:02.740823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-baa1c761-4542-44f4-a71c-e2854f3de961 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1274 microversion: 2.1 time: 0.147484 Nov 27 21:07:02.741724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2846/5576] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:02 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:02.951361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98e492bc-c2b6-4392-a9f4-f67d4752a31c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:02.952280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98e492bc-c2b6-4392-a9f4-f67d4752a31c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:02.960107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e492bc-c2b6-4392-a9f4-f67d4752a31c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:02.961009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e492bc-c2b6-4392-a9f4-f67d4752a31c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:02.962030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e492bc-c2b6-4392-a9f4-f67d4752a31c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:02.962793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e492bc-c2b6-4392-a9f4-f67d4752a31c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:03.010376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98e492bc-c2b6-4392-a9f4-f67d4752a31c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.062275 Nov 27 21:07:03.011788 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2731/5577] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:02 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:03.204055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:03.205266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:03.219789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:03.220239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:03.221074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:03.221513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:03.259194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lazy-loading 'flavor' on Instance uuid 7896504e-013d-42df-9c95-1445b03b7e48 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:07:03.391652 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04dbc812-6b9f-48fb-b8ed-8511cf2215e8 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action" status: 200 len: 32 microversion: 2.1 time: 0.190646 Nov 27 21:07:03.393466 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2847/5578] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:07:03 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:07:03.413548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:03.415689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:03.435641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:03.436782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:03.437972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:03.438703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:03.762084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:03.764390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:03.773131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:03.773768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:03.774602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:03.775038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:03.813084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:03.821098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b215239-a892-43cf-a329-8274519b2d23 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.422621 Nov 27 21:07:03.821901 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2732/5579] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:03 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:04.024333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f7517f98-ea81-46d9-a844-2e9dc2e3605b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:04.025539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f7517f98-ea81-46d9-a844-2e9dc2e3605b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:04.032068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:04.034482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7517f98-ea81-46d9-a844-2e9dc2e3605b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:04.035192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7517f98-ea81-46d9-a844-2e9dc2e3605b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:04.036725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7517f98-ea81-46d9-a844-2e9dc2e3605b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:04.037451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7517f98-ea81-46d9-a844-2e9dc2e3605b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:04.054638 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4c49c7d-00d5-4300-9320-211ef0b60f24 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.299010 Nov 27 21:07:04.055660 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2848/5580] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:03 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:07:04.096734 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f7517f98-ea81-46d9-a844-2e9dc2e3605b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.077271 Nov 27 21:07:04.097579 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2733/5581] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:04 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:07:04.513044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-549ef5b0-b050-429a-95d6-799afe52800f req-29e20433-6c6d-4881-8cac-e619e0aeadb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16495f29-b412-4fc8-8851-21f4471f7247", "tag": "53013d13-d0f6-4cc7-82ad-5773aa2bbcfd"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:04.514734 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:04.514734 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:07:04.541762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-549ef5b0-b050-429a-95d6-799afe52800f req-29e20433-6c6d-4881-8cac-e619e0aeadb2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:04.543051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-549ef5b0-b050-429a-95d6-799afe52800f req-29e20433-6c6d-4881-8cac-e619e0aeadb2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:04.560540 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-549ef5b0-b050-429a-95d6-799afe52800f req-29e20433-6c6d-4881-8cac-e619e0aeadb2 service nova] Creating event network-changed:53013d13-d0f6-4cc7-82ad-5773aa2bbcfd for instance 16495f29-b412-4fc8-8851-21f4471f7247 on nch2-master-1 Nov 27 21:07:04.571495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-549ef5b0-b050-429a-95d6-799afe52800f req-29e20433-6c6d-4881-8cac-e619e0aeadb2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064857 Nov 27 21:07:04.572232 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2849/5582] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:07:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:07:04.840025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:04.840927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:04.848969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:04.849706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:04.850621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:04.851195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:05.073602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:05.074911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:05.085131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:05.086018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:05.088306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:05.089502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:05.141112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:05.163739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0987c5e3-5126-4610-a718-cc78430e87e4 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.327976 Nov 27 21:07:05.164482 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2734/5583] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:04 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:05.170125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b32a8b29-681f-4180-83ce-ce88e73ec0ff tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:05.171173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b32a8b29-681f-4180-83ce-ce88e73ec0ff tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:05.178768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b32a8b29-681f-4180-83ce-ce88e73ec0ff tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:05.179231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b32a8b29-681f-4180-83ce-ce88e73ec0ff tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:05.180053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b32a8b29-681f-4180-83ce-ce88e73ec0ff tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:05.180670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b32a8b29-681f-4180-83ce-ce88e73ec0ff tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:05.223758 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b32a8b29-681f-4180-83ce-ce88e73ec0ff tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.057554 Nov 27 21:07:05.225113 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2735/5584] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:05 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:05.436854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:05.452460 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0634ec77-3a81-4a0b-b962-7b5937133e1c tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.384426 Nov 27 21:07:05.463150 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2850/5585] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:05 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:07:06.182258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:06.183162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:06.195133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:06.202900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:06.203941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:06.204505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:06.235967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c5eca86-be23-459c-8fb4-42233aa91215 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:06.237523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c5eca86-be23-459c-8fb4-42233aa91215 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:06.246838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c5eca86-be23-459c-8fb4-42233aa91215 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:06.250275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c5eca86-be23-459c-8fb4-42233aa91215 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:06.252670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c5eca86-be23-459c-8fb4-42233aa91215 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:06.253493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c5eca86-be23-459c-8fb4-42233aa91215 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:06.337217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c5eca86-be23-459c-8fb4-42233aa91215 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.105275 Nov 27 21:07:06.342292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2851/5586] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:06 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:07:06.412581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:06.421130 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ffd084f-abb9-4c67-8912-59b40a0e8877 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.243485 Nov 27 21:07:06.422040 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2736/5587] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:06 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:06.475281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:06.476465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:06.495057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:06.496132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:06.497264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:06.498129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:06.795953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:06.805492 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-646b6fce-eff9-4718-b686-f3d077690eaa tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.338614 Nov 27 21:07:06.806082 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2852/5588] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:06 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:07.298121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b6a21da-d746-4aee-b3f6-4baf5b451c8e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] Calling method '.version_select at 0x7f15c7fb9040>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:07.327279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b6a21da-d746-4aee-b3f6-4baf5b451c8e tempest-TestSecurityGroupsBasicOps-1854712040 tempest-TestSecurityGroupsBasicOps-1854712040-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1255673624" status: 202 len: 0 microversion: 2.1 time: 0.032759 Nov 27 21:07:07.327859 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2737/5589] 10.222.0.21 () {58 vars in 1277 bytes} [Sat Nov 27 21:07:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1255673624 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:07.351456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4529a454-3f5e-4ae9-ab20-f4f4ca9c70f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:07.352399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4529a454-3f5e-4ae9-ab20-f4f4ca9c70f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:07.361399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4529a454-3f5e-4ae9-ab20-f4f4ca9c70f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:07.362410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4529a454-3f5e-4ae9-ab20-f4f4ca9c70f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:07.363443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4529a454-3f5e-4ae9-ab20-f4f4ca9c70f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:07.364201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4529a454-3f5e-4ae9-ab20-f4f4ca9c70f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:07.408926 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4529a454-3f5e-4ae9-ab20-f4f4ca9c70f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.061132 Nov 27 21:07:07.410596 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2853/5590] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:07 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:07.448311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:07.449146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:07.459357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:07.460011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:07.460954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:07.461855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:07.682528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:07.691504 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3c84bb9-aa12-46f0-80d5-64c565ea04ad tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.256289 Nov 27 21:07:07.692281 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2738/5591] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:07 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:07.822589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:07.823336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:07.830307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:07.830783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:07.831589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:07.832025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:08.026138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:08.034830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7743ae3-6f55-4792-8b74-cd760b5d0fff tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.216207 Nov 27 21:07:08.035616 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2854/5592] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:07 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:08.421507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f6ca475-88ad-48a5-9119-47c9d2ee1adf tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:08.422460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f6ca475-88ad-48a5-9119-47c9d2ee1adf tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:08.429282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f6ca475-88ad-48a5-9119-47c9d2ee1adf tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:08.429996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f6ca475-88ad-48a5-9119-47c9d2ee1adf tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:08.430785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f6ca475-88ad-48a5-9119-47c9d2ee1adf tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:08.431222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f6ca475-88ad-48a5-9119-47c9d2ee1adf tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:08.480580 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f6ca475-88ad-48a5-9119-47c9d2ee1adf tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.062757 Nov 27 21:07:08.481322 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2739/5593] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:08 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:08.709008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:08.709755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:08.716562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:08.717427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:08.718447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:08.719388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:08.916216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:08.923943 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05765c97-2cb2-4514-be39-e9b37ba37e0b tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.219153 Nov 27 21:07:08.924686 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2855/5594] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:08 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:09.052474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:09.053330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:09.060615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:09.061080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:09.061876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:09.062325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:09.242182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:09.249723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e283f1a4-5723-4ab3-a9a3-28e8d668c6e1 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.201458 Nov 27 21:07:09.260761 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2740/5595] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:09 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:09.493832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfa1bdfd-2980-4f2d-9128-29495026ea65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:09.494956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfa1bdfd-2980-4f2d-9128-29495026ea65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:09.502421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfa1bdfd-2980-4f2d-9128-29495026ea65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:09.502969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfa1bdfd-2980-4f2d-9128-29495026ea65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:09.503876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfa1bdfd-2980-4f2d-9128-29495026ea65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:09.504317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfa1bdfd-2980-4f2d-9128-29495026ea65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:09.550725 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfa1bdfd-2980-4f2d-9128-29495026ea65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.060962 Nov 27 21:07:09.551438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2856/5596] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:09 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:09.940947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:09.941563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:09.949186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:09.949648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:09.950432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:09.950874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:10.091321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:10.111820 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ec7bdc9-d9e9-4e67-8404-379537340ad9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.174535 Nov 27 21:07:10.112419 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2741/5597] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:09 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:10.268859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:10.269624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:10.277367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:10.277886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:10.278726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:10.279322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:10.422439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:10.429842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e58494fb-3350-4561-a39c-ec03fc89421a tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.165835 Nov 27 21:07:10.430392 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2857/5598] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:10 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:10.561960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0d0b27f-c167-4797-98b6-6f578d2f5e21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:10.562933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0d0b27f-c167-4797-98b6-6f578d2f5e21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:10.569880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d0b27f-c167-4797-98b6-6f578d2f5e21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:10.570325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d0b27f-c167-4797-98b6-6f578d2f5e21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:10.571102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d0b27f-c167-4797-98b6-6f578d2f5e21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:10.571568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0d0b27f-c167-4797-98b6-6f578d2f5e21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:10.613680 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0d0b27f-c167-4797-98b6-6f578d2f5e21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.055305 Nov 27 21:07:10.614262 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2742/5599] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:10 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:10.774910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-201778a7-a64f-45dd-820d-faa29ff6027b req-01f77a40-a135-45b2-bf94-280ac32d2f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16495f29-b412-4fc8-8851-21f4471f7247", "name": "network-vif-plugged", "status": "completed", "tag": "53013d13-d0f6-4cc7-82ad-5773aa2bbcfd"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:10.776489 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:10.776489 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:07:10.783922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-201778a7-a64f-45dd-820d-faa29ff6027b req-01f77a40-a135-45b2-bf94-280ac32d2f29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:10.784446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-201778a7-a64f-45dd-820d-faa29ff6027b req-01f77a40-a135-45b2-bf94-280ac32d2f29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:10.795772 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-201778a7-a64f-45dd-820d-faa29ff6027b req-01f77a40-a135-45b2-bf94-280ac32d2f29 service nova] Creating event network-vif-plugged:53013d13-d0f6-4cc7-82ad-5773aa2bbcfd for instance 16495f29-b412-4fc8-8851-21f4471f7247 on nch2-master-1 Nov 27 21:07:10.801007 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-201778a7-a64f-45dd-820d-faa29ff6027b req-01f77a40-a135-45b2-bf94-280ac32d2f29 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029882 Nov 27 21:07:10.801779 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2858/5600] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:07:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:07:11.129853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:11.130658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:11.138784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:11.139242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:11.140077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:11.140520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:11.288488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:11.296139 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e54c396-a5d7-47cb-86c2-0ed31cc47e9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.170654 Nov 27 21:07:11.302382 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2743/5601] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:11 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:11.449000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:11.450295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:11.457411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:11.457870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:11.458661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:11.459105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:11.592624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:11.600751 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d0d676d-8270-4c46-85c1-133925dd69bf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.157268 Nov 27 21:07:11.601332 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2859/5602] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:11 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:11.625454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c0d7bc3-6e3d-4556-a652-b098a957d1be tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:11.626397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c0d7bc3-6e3d-4556-a652-b098a957d1be tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:11.633487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c0d7bc3-6e3d-4556-a652-b098a957d1be tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:11.633938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c0d7bc3-6e3d-4556-a652-b098a957d1be tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:11.634958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c0d7bc3-6e3d-4556-a652-b098a957d1be tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:11.635521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c0d7bc3-6e3d-4556-a652-b098a957d1be tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:11.686395 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c0d7bc3-6e3d-4556-a652-b098a957d1be tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.064567 Nov 27 21:07:11.687180 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2744/5603] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:11 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:12.314419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:12.315032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:12.321513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:12.322010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:12.322902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:12.323374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:12.464579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:12.473664 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27a80bed-dbe7-41af-97f3-f1ad84f6e74c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.163698 Nov 27 21:07:12.474235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2860/5604] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:12 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:12.618272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:12.618882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:12.626816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:12.627317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:12.628099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:12.628538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:12.697989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1518c14d-b0a9-4ccd-be6b-54b5fc21c321 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:12.698906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1518c14d-b0a9-4ccd-be6b-54b5fc21c321 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:12.705014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1518c14d-b0a9-4ccd-be6b-54b5fc21c321 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:12.705760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1518c14d-b0a9-4ccd-be6b-54b5fc21c321 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:12.706798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1518c14d-b0a9-4ccd-be6b-54b5fc21c321 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:12.707272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1518c14d-b0a9-4ccd-be6b-54b5fc21c321 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:12.762637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1518c14d-b0a9-4ccd-be6b-54b5fc21c321 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.068234 Nov 27 21:07:12.766382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:12.768916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2861/5605] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:12 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:07:12.778499 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88704c0d-3800-4aa2-84f1-ba12761a4195 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1314 microversion: 2.1 time: 0.164329 Nov 27 21:07:12.779303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2745/5606] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:12 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:13.491522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:13.492220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:13.499801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.500255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.501035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.501477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.633709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:13.641523 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75f3b743-c9ce-4baf-8b98-840cdf8d28e7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1502 microversion: 2.1 time: 0.154203 Nov 27 21:07:13.642095 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2862/5607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:13 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:13.658004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b00e3144-c126-4707-91c1-6b49f923c0fd"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:13.659057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:13.666629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.667023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.667820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.668260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.691317 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Cannot 'attach_volume' instance 7896504e-013d-42df-9c95-1445b03b7e48 while it is in vm_state rescued Nov 27 21:07:13.691897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 409 to user: Cannot 'attach_volume' instance 7896504e-013d-42df-9c95-1445b03b7e48 while it is in vm_state rescued {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:13.692710 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2de43ff6-0bac-42c6-88a0-f836edc6eca5 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038647 Nov 27 21:07:13.693284 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2746/5608] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:07:13 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:07:13.701551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68186719-5f12-4808-af15-d0143d4dfeb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:13.702115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68186719-5f12-4808-af15-d0143d4dfeb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:13.708037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68186719-5f12-4808-af15-d0143d4dfeb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.708485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68186719-5f12-4808-af15-d0143d4dfeb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.709256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68186719-5f12-4808-af15-d0143d4dfeb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.709693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68186719-5f12-4808-af15-d0143d4dfeb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.773145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68186719-5f12-4808-af15-d0143d4dfeb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action" status: 202 len: 0 microversion: 2.1 time: 0.075125 Nov 27 21:07:13.773907 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2863/5609] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:07:13 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:13.780091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15936d54-15c1-4290-813a-301c7fef4f8b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:13.781138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15936d54-15c1-4290-813a-301c7fef4f8b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:13.782061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:13.783227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:13.787557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15936d54-15c1-4290-813a-301c7fef4f8b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.788145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15936d54-15c1-4290-813a-301c7fef4f8b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.789083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15936d54-15c1-4290-813a-301c7fef4f8b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.789600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15936d54-15c1-4290-813a-301c7fef4f8b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.792657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.793681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.794298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.795016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.834796 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15936d54-15c1-4290-813a-301c7fef4f8b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.058165 Nov 27 21:07:13.838871 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2747/5610] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:13 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:13.840874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:13.841805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:13.848793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.849250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:13.850045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:13.850484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:14.006062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:14.007451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:14.015487 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f3aca3d8-7114-4987-ac96-c44e137dc215 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1497 microversion: 2.1 time: 0.178300 Nov 27 21:07:14.026665 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f28a8590-2735-4b37-bfcd-b78b514ca133 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1510 microversion: 2.1 time: 0.238291 Nov 27 21:07:14.026665 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2864/5611] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:13 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:07:14.026920 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2748/5612] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:13 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:14.495161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:14.495950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:14.502970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:14.503462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:14.504238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:14.504676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:14.532971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:07:14.604623 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80fc97d0-8770-484a-905f-8ba1b1cc7adf tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "DELETE /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 204 len: 0 microversion: 2.1 time: 0.112894 Nov 27 21:07:14.605320 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2865/5613] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:07:14 2021] DELETE /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:07:14.614392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:14.614946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:14.621484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:14.621942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:14.622720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:14.623153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:14.756477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:14.764136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c7077ffd-228b-40ec-9533-e23143ff9896 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1503 microversion: 2.1 time: 0.153926 Nov 27 21:07:14.764720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2749/5614] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:14 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:14.846437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a6142ec-416b-4c3c-a77c-77a5a513c234 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:14.847509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a6142ec-416b-4c3c-a77c-77a5a513c234 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:14.853353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6142ec-416b-4c3c-a77c-77a5a513c234 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:14.853814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6142ec-416b-4c3c-a77c-77a5a513c234 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:14.854593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6142ec-416b-4c3c-a77c-77a5a513c234 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:14.855035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6142ec-416b-4c3c-a77c-77a5a513c234 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:14.896222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a6142ec-416b-4c3c-a77c-77a5a513c234 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 32646 microversion: 2.20 time: 0.053772 Nov 27 21:07:14.896881 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2866/5615] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:14 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:15.044213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:15.044828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:15.051847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.052302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:15.053082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.053527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:15.180425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:15.187731 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-156a0576-f73a-4900-871c-574d312f2fb7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1510 microversion: 2.1 time: 0.147171 Nov 27 21:07:15.188307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2750/5616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:15 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:15.782848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:15.784095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:15.792300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.792763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:15.793612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.794093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:15.908048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4699f682-b104-45e0-82dd-a21c1d8662c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:15.909537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4699f682-b104-45e0-82dd-a21c1d8662c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:15.916335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4699f682-b104-45e0-82dd-a21c1d8662c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.916794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4699f682-b104-45e0-82dd-a21c1d8662c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:15.917580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4699f682-b104-45e0-82dd-a21c1d8662c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.918020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4699f682-b104-45e0-82dd-a21c1d8662c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:15.930496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:15.938047 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a202c78d-0584-4f8c-b285-e0746f69d451 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1503 microversion: 2.1 time: 0.159659 Nov 27 21:07:15.938616 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2867/5617] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:15 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:15.979380 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4699f682-b104-45e0-82dd-a21c1d8662c9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 200 len: 40788 microversion: 2.20 time: 0.075016 Nov 27 21:07:15.980058 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2751/5618] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:15 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 40788 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:07:15.989920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ee90e3e4-5583-4765-9471-41db07f4b6e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:15.990488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ee90e3e4-5583-4765-9471-41db07f4b6e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:15.996946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee90e3e4-5583-4765-9471-41db07f4b6e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.997401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee90e3e4-5583-4765-9471-41db07f4b6e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:15.998190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee90e3e4-5583-4765-9471-41db07f4b6e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:15.998632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee90e3e4-5583-4765-9471-41db07f4b6e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:16.024518 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ee90e3e4-5583-4765-9471-41db07f4b6e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/ips" status: 200 len: 152 microversion: 2.20 time: 0.038374 Nov 27 21:07:16.025102 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2868/5619] 10.222.0.21 () {60 vars in 1288 bytes} [Sat Nov 27 21:07:15 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:07:16.206174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:16.206875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:16.214516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:16.215273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:16.216266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:16.216913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:16.434211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:16.443157 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c2765b92-d24e-4595-b82c-1c7c6b69ea44 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1510 microversion: 2.1 time: 0.241515 Nov 27 21:07:16.455559 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2752/5620] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:16 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:16.825637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-22e6ae07-6902-4acb-9fe8-bfb7428d44ea req-97806512-c6c8-4250-87bc-78943a8bd03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16495f29-b412-4fc8-8851-21f4471f7247", "name": "network-vif-deleted", "tag": "53013d13-d0f6-4cc7-82ad-5773aa2bbcfd"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:16.827214 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:16.827214 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:07:16.834198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-22e6ae07-6902-4acb-9fe8-bfb7428d44ea req-97806512-c6c8-4250-87bc-78943a8bd03a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:16.834648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-22e6ae07-6902-4acb-9fe8-bfb7428d44ea req-97806512-c6c8-4250-87bc-78943a8bd03a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:16.845721 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-22e6ae07-6902-4acb-9fe8-bfb7428d44ea req-97806512-c6c8-4250-87bc-78943a8bd03a service nova] Creating event network-vif-deleted:53013d13-d0f6-4cc7-82ad-5773aa2bbcfd for instance 16495f29-b412-4fc8-8851-21f4471f7247 on nch2-master-1 Nov 27 21:07:16.850580 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-22e6ae07-6902-4acb-9fe8-bfb7428d44ea req-97806512-c6c8-4250-87bc-78943a8bd03a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239007 Nov 27 21:07:16.851303 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2869/5621] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:07:16.954960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:16.955725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:16.963057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:16.963552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:16.964525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:16.965108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:17.006835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:17.007702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:17.008257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lazy-loading 'fault' on Instance uuid 16495f29-b412-4fc8-8851-21f4471f7247 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:07:17.063984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92ea56b41244a58e3a959f665431c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916d44620e3418a8916382d00618dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:17.073083 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bbf19baf-81fc-44a7-907b-6b5f5821d376 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 200 len: 1304 microversion: 2.1 time: 0.121789 Nov 27 21:07:17.073856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2753/5622] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:16 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:17.461529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:17.462224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:17.468530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:17.468921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:17.469704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:17.470146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:17.603307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:17.610732 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60533239-e31f-4bee-ada4-7ed9a1e73980 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1516 microversion: 2.1 time: 0.153811 Nov 27 21:07:17.611324 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2870/5623] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:17 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:17.979746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:17.980362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:17.987627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:17.988018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:17.988837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:17.989247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:18.014531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lazy-loading 'flavor' on Instance uuid 0b1a80e3-263a-4ff5-9417-defdda26f981 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:07:18.090890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:18.092253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] [instance: 16495f29-b412-4fc8-8851-21f4471f7247] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:18.099818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:18.100567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:18.101408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:18.101967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:18.116329 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] HTTP exception thrown: Instance 16495f29-b412-4fc8-8851-21f4471f7247 could not be found. Nov 27 21:07:18.117002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] Returning 404 to user: Instance 16495f29-b412-4fc8-8851-21f4471f7247 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:18.118035 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fe38348f-e63e-465c-a680-38084aea7990 tempest-VolumesActionsTest-24419802 tempest-VolumesActionsTest-24419802-project] 10.222.0.21 "GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247" status: 404 len: 111 microversion: 2.1 time: 0.032022 Nov 27 21:07:18.123862 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2871/5624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:18 2021] GET /compute/v2.1/servers/16495f29-b412-4fc8-8851-21f4471f7247 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:07:18.292881 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5504a17-3f29-4ae0-bf14-cff1e8ebe353 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 202 len: 0 microversion: 2.20 time: 0.316751 Nov 27 21:07:18.293528 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2754/5625] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:17 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:07:18.303222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:18.303956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:18.309976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:18.310430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:18.311356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:18.311778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:18.456653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:18.465503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:18.467367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:18.468770 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef47709e-6235-412d-81c9-03e03b731b4e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.170968 Nov 27 21:07:18.473391 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2872/5626] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:18 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:18.912551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:18.913250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:18.920058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:18.920512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:18.921300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:18.921736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:19.072414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:19.102141 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66548320-95c2-405f-bd1c-a9ec9b145d4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1516 microversion: 2.1 time: 0.193967 Nov 27 21:07:19.103122 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2755/5627] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:18 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:07:19.119754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80247849-0ed6-4731-864e-e9795296e543"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:19.121260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:19.128926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:19.129755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:19.130686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:19.131140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:19.464043 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f8e6cfa0-0303-4c05-a3e9-fe96306783c6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348159 Nov 27 21:07:19.476581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2873/5628] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:07:19 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:07:19.489057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:19.489759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:19.504176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:19.504695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:19.505548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:19.505995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:19.691196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:19.700143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:19.702656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:19.704467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9dab4e6-eb77-45c6-9db8-2843e3a03c60 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.220828 Nov 27 21:07:19.705131 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2756/5629] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:19 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:20.723762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:20.724549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:20.736880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:20.737346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:20.740664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:20.741123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:20.961197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:20.971885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:20.976407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:20.980728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a44d8a9-82b0-42d8-9a00-d369de9062d7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.261592 Nov 27 21:07:20.981657 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2874/5630] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:20 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:21.998864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:22.000874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:22.011245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:22.012913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:22.013977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:22.014635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:22.165667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:22.174508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:22.176051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:22.177224 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15470013-0ebd-4df2-a951-e5ca2c19e014 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.183294 Nov 27 21:07:22.177811 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2757/5631] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:21 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:22.824580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:22.826347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:22.834392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:22.835046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:22.836158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:22.836793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:22.869033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lazy-loading 'flavor' on Instance uuid 7896504e-013d-42df-9c95-1445b03b7e48 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:07:23.050759 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a8a1204-b1b6-4f99-91c4-e9b54067bd4d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action" status: 200 len: 32 microversion: 2.1 time: 0.224322 Nov 27 21:07:23.051556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2875/5632] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:07:22 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:07:23.062445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:23.063079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:23.070753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:23.071528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:23.072568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:23.073024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:23.206281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:23.209519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:23.219385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:23.219858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:23.221208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:23.221653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:23.369242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:23.382910 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d47070c9-668c-4ce8-b659-722d30569e6f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.325011 Nov 27 21:07:23.385242 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2758/5633] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:23 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:23.576840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:23.588340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:23.590215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:23.591903 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e75a013-7b12-4628-b28b-684a29841b92 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.390407 Nov 27 21:07:23.595207 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2876/5634] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:23 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:24.402365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:24.403720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:24.413601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:24.414499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:24.415701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:24.416491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:24.611623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:24.613171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:24.627950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:24.635882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:24.637030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:24.638192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:24.643282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:24.652207 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8c74f4e8-5514-4ae9-83f9-3fad7d652ef1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.254159 Nov 27 21:07:24.657359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2759/5635] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:24 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:24.843814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:24.852293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:24.854105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:24.855307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4401d08-eec1-49da-8816-c90098ba14da tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.249271 Nov 27 21:07:24.866587 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2877/5636] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:24 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:25.669520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:25.670444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:25.681897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:25.683372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:25.685261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:25.685715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:25.862028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:25.873689 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0a1e952b-a545-4c17-b03d-3be5ecddc9d6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.207345 Nov 27 21:07:25.874558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2760/5637] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:25 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:25.874817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:25.875595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:25.893123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:25.893774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:25.894766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:25.895633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:26.074686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:26.085421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:26.087657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:26.089048 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb1e80db-2b66-434d-81c7-dd3dac69986a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.219371 Nov 27 21:07:26.090203 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2878/5638] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:25 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:26.893123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:26.894579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:26.915430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:26.916398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:26.917782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:26.918894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:27.107573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:27.108370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:27.119608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:27.120084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:27.121138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:27.121584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:27.166556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:27.176148 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e49543d7-858f-4034-83f3-5f296ff1f3fd tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.288535 Nov 27 21:07:27.177700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2761/5639] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:26 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:27.309590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:27.320094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:27.322469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:27.324215 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b69911e0-a105-4403-abcd-b3576117d4e9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.220454 Nov 27 21:07:27.325032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2879/5640] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:27 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:28.195759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:28.198557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:28.215824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:28.220212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:28.221810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:28.222494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:28.345817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:28.347266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:28.356867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:28.357569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:28.359896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:28.360571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:28.414098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:28.427335 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-092553c1-07c8-4430-8105-39873451d91f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.234968 Nov 27 21:07:28.438015 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2762/5641] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:28 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:28.563278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:28.572836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:28.574355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:28.577716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f54d4d21-258a-423a-b234-2cfe91943c39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.238097 Nov 27 21:07:28.578284 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2880/5642] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:28 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:29.459439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:29.459439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:29.482941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:29.483756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:29.484830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:29.485281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:29.597638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:29.598265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:29.611619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:29.612082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:29.612891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:29.613339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:29.697709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:29.711342 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af6efb5d-efbd-480e-a510-3b9ae4004ef3 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.261526 Nov 27 21:07:29.712361 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2763/5643] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:29 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:29.823504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:29.837921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:29.840025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:29.841970 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1f7585a-00f8-458a-acd8-448f1df6c4e0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1742 microversion: 2.20 time: 0.249286 Nov 27 21:07:29.842711 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2881/5644] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:29 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1742 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:30.729332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:30.729943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:30.737883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:30.738906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:30.740261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:30.742239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:30.861092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:30.862350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:30.883744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:30.893124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:30.894338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:30.894973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:31.018416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:31.029469 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d42e0aae-8c3f-43d7-9f6e-a049cd3cdcf7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.303639 Nov 27 21:07:31.030171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2764/5645] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:30 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:31.122528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:31.145696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:31.150184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:31.151843 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-915d1472-0d4e-4d67-ab0c-924351a11bc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1742 microversion: 2.20 time: 0.295074 Nov 27 21:07:31.153023 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2882/5646] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:30 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1742 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:32.047268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:32.048906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:32.070959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:32.075508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:32.084283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:32.084817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:32.170714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:32.172493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:32.192154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:32.199711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:32.204069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:32.208168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:32.572178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:32.592432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:32.593934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:32.595156 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e296569f-a185-4579-a3f4-d3c1a6598b33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.428123 Nov 27 21:07:32.596946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2883/5647] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:32 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:32.608938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:32.610278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5d11316d-346c-4c87-a0c4-3bbacf6278d9 req-6025ddfc-0b43-4c84-bcf2-990969992249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1a80e3-263a-4ff5-9417-defdda26f981", "name": "network-vif-plugged", "status": "completed", "tag": "6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:32.612991 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:32.612991 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:07:32.624530 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-699619a9-175c-4a5c-b5ae-151d0af06f86 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.579726 Nov 27 21:07:32.628110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5d11316d-346c-4c87-a0c4-3bbacf6278d9 req-6025ddfc-0b43-4c84-bcf2-990969992249 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:32.628650 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2765/5648] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:32 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:32.629219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5d11316d-346c-4c87-a0c4-3bbacf6278d9 req-6025ddfc-0b43-4c84-bcf2-990969992249 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:32.644765 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5d11316d-346c-4c87-a0c4-3bbacf6278d9 req-6025ddfc-0b43-4c84-bcf2-990969992249 service nova] Creating event network-vif-plugged:6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9 for instance 0b1a80e3-263a-4ff5-9417-defdda26f981 on nch1-master-1 Nov 27 21:07:32.650653 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5d11316d-346c-4c87-a0c4-3bbacf6278d9 req-6025ddfc-0b43-4c84-bcf2-990969992249 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052395 Nov 27 21:07:32.655333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2884/5649] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:07:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:07:33.614926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:33.615588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:33.629390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:33.631703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:33.632924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:33.634707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:33.645429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:33.648050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:33.679689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:33.690847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:33.693610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:33.695546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:34.000255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:34.006422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:34.009685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:34.012434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:34.014242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78b4f007-25bc-4802-81dc-3e3cec48cbcb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.404120 Nov 27 21:07:34.025797 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2766/5650] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:33 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:34.026107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25d4c1a6-6243-43e3-815f-883002f867d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.381711 Nov 27 21:07:34.026107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2885/5651] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:33 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:35.039142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:35.041858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:35.042472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:35.044936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:35.065760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:35.066231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:35.067052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:35.067524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:35.068004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:35.069058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:35.070128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:35.070997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:35.330735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:35.345984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-171b5ad0-81be-4c15-b9df-6b3c3646dced tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.309822 Nov 27 21:07:35.346870 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2886/5652] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:35 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:35.635541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:35.643967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:35.657749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:35.659326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb15e874-55ea-4e1f-9bf5-3ec6c3c16dab tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.628458 Nov 27 21:07:35.660334 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2767/5653] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:35 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:36.365400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:36.366071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:36.380314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:36.380770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:36.381571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:36.382011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:36.678309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:36.679734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:36.706801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:36.710578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:36.711516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:36.712028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:37.009644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:37.023308 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05d242a0-3612-41da-9892-eb11ab98e3c1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.660783 Nov 27 21:07:37.037783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2887/5654] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:36 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:37.108758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:37.117103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:37.130172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:37.137765 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-41d4a42e-3810-468b-a8e1-f3fdba54b669 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.463192 Nov 27 21:07:37.143751 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2768/5655] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:36 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:38.044852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:38.045554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:38.057543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:38.058569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:38.069360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:38.069854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:38.162157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:38.163492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:38.174049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:38.177263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:38.180783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:38.182128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:38.416712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:38.431156 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45fae686-5b26-43db-ab93-d8f820b1884c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.390119 Nov 27 21:07:38.441720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2888/5656] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:38 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:38.629361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:38.644703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:38.653853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:38.655586 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a7e6fcd-4d8d-4de5-93b6-8110c5756c57 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.496998 Nov 27 21:07:38.659215 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2769/5657] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:38 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:39.450584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:39.452800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:39.464495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:39.466688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:39.471300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:39.473720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:39.679992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:39.681167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:39.706414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:39.719339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:39.720993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:39.721458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:40.112666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:40.127135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:40.129526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:40.131043 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-575f5f95-5784-49ce-9f4d-fe52e6a8e339 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.457278 Nov 27 21:07:40.134586 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2770/5658] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:39 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:40.153425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:40.166162 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d51b1d21-b03b-4661-a0fe-d25fb574c4b6 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.721384 Nov 27 21:07:40.178479 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2889/5659] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:39 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:41.151796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:41.153391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:41.177407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:41.179553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:41.181338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:41.182038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:41.184584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:41.185209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:41.199032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:41.207456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:41.208626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:41.209247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:41.527111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:41.538028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:41.546263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:41.549210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f4a5553-f98f-4acc-9579-84cddc05ce85 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.401702 Nov 27 21:07:41.550877 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2771/5660] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:41 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:41.673438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:41.690596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-584a6bda-97b4-4617-ade0-f59f480946f2 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1568 microversion: 2.1 time: 0.509820 Nov 27 21:07:41.695342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2890/5661] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:41 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1568 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:42.568081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:42.569361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:42.582982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:42.584983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:42.585977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:42.589561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:42.719216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:42.721100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:42.742831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:42.743732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:42.746218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:42.746750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:42.887214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:42.899414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:42.901494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:42.903053 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53e79bf8-d8f9-44da-a027-42aa65737752 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.339068 Nov 27 21:07:42.904262 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2772/5662] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:42 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:42.961461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:42.972056 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1fc8b885-d740-4da0-8866-a0711b883e84 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1548 microversion: 2.1 time: 0.263698 Nov 27 21:07:42.984687 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2891/5663] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:42 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1548 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:42.989820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:42.990326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:42.998971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.000724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:43.001900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.002514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:43.092786 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Cannot 'detach_volume' instance 7896504e-013d-42df-9c95-1445b03b7e48 while it is in vm_state rescued Nov 27 21:07:43.093600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 409 to user: Cannot 'detach_volume' instance 7896504e-013d-42df-9c95-1445b03b7e48 while it is in vm_state rescued {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:43.095182 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ed6fe09-9b92-4003-b02b-1d57f3721d5d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments/80247849-0ed6-4731-864e-e9795296e543" status: 409 len: 152 microversion: 2.1 time: 0.108678 Nov 27 21:07:43.100140 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2773/5664] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:07:42 2021] DELETE /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments/80247849-0ed6-4731-864e-e9795296e543 => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:07:43.110737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8a9f810-3050-4c64-b3fd-acd7860460d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:43.111326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8a9f810-3050-4c64-b3fd-acd7860460d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:43.126718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8a9f810-3050-4c64-b3fd-acd7860460d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.127601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8a9f810-3050-4c64-b3fd-acd7860460d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:43.128377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8a9f810-3050-4c64-b3fd-acd7860460d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.135376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8a9f810-3050-4c64-b3fd-acd7860460d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:43.274512 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8a9f810-3050-4c64-b3fd-acd7860460d9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action" status: 202 len: 0 microversion: 2.1 time: 0.172332 Nov 27 21:07:43.282013 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2892/5665] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:07:43 2021] POST /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:43.285732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:43.286355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:43.295065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.298753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:43.299837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.300549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:43.531493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:43.541337 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e885f99-a70a-4d92-9e58-231a8dc381b0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1556 microversion: 2.1 time: 0.259163 Nov 27 21:07:43.543800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2774/5666] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:43 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1556 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:43.923276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:43.925625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:43.948910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.950877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:43.956412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:43.957211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:44.345669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:44.354224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:44.356424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:44.357894 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5d24fc1-f178-4e58-9523-747bc04a46ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.439545 Nov 27 21:07:44.376043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2893/5667] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:43 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:44.561743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:44.562343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:44.571929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:44.572646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:44.573649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:44.574289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:44.739731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:44.754471 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5295f019-1064-48f3-9ebd-67fd0e5fabe0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1556 microversion: 2.1 time: 0.196261 Nov 27 21:07:44.764288 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2775/5668] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:44 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1556 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:45.383552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:45.385039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:45.393211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:45.393967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:45.394859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:45.395315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:45.701386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:45.712201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:45.723818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:45.725241 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e34b98f9-a3c6-4864-a1ae-e126a7a53310 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.345765 Nov 27 21:07:45.726157 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2894/5669] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:45 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:45.772733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:45.773469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:45.783598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:45.784336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:45.785326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:45.785996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:46.097016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:46.106458 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e761c9b9-6af0-4587-aae9-576bdd0771f0 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1556 microversion: 2.1 time: 0.337443 Nov 27 21:07:46.110466 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2776/5670] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:45 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1556 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:46.745529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:46.746996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:46.755061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:46.755837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:46.757682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:46.758638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:46.955638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:46.968643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:46.970733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:46.971915 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6ec2b746-4b4f-404d-9e7b-5eb5f2e4f49a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1737 microversion: 2.20 time: 0.230757 Nov 27 21:07:46.972541 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2895/5671] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:46 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:47.124819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:47.125487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:47.132964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:47.133428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:47.134720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:47.134828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:47.275861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:47.284540 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8b3df57-7664-4413-8d93-3feb86187098 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1562 microversion: 2.1 time: 0.163533 Nov 27 21:07:47.285122 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2777/5672] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:47 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:47.355058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:47.355584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:47.361484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:47.361942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:47.362734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:47.363176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:47.441697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lazy-loading 'services' on Instance uuid 7896504e-013d-42df-9c95-1445b03b7e48 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:07:47.513575 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df1bc79d-0663-46cd-9051-16aa48255665 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments/80247849-0ed6-4731-864e-e9795296e543" status: 202 len: 0 microversion: 2.1 time: 0.162070 Nov 27 21:07:47.514659 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2896/5673] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:07:47 2021] DELETE /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments/80247849-0ed6-4731-864e-e9795296e543 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:07:47.523818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1587e1f7-6495-4513-8f61-4a9bfc096d50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:47.524850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1587e1f7-6495-4513-8f61-4a9bfc096d50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:47.531475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1587e1f7-6495-4513-8f61-4a9bfc096d50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:47.533031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1587e1f7-6495-4513-8f61-4a9bfc096d50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:47.534285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1587e1f7-6495-4513-8f61-4a9bfc096d50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:47.534899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1587e1f7-6495-4513-8f61-4a9bfc096d50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:47.577136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1587e1f7-6495-4513-8f61-4a9bfc096d50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057560 Nov 27 21:07:47.578074 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2778/5674] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:07:47 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:07:47.991197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:47.992512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:48.003958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.004765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.006557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.007164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.165326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:48.178425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:48.181302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:48.182875 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68ec1beb-c42a-4345-b3e7-4895f0a38e59 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1719 microversion: 2.20 time: 0.196312 Nov 27 21:07:48.195997 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2897/5675] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:47 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:48.589433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc93b52e-e193-482d-af7a-f54e29583d2d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:48.590450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc93b52e-e193-482d-af7a-f54e29583d2d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:48.599586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc93b52e-e193-482d-af7a-f54e29583d2d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.600211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc93b52e-e193-482d-af7a-f54e29583d2d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.601190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc93b52e-e193-482d-af7a-f54e29583d2d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.601639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc93b52e-e193-482d-af7a-f54e29583d2d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.637019 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc93b52e-e193-482d-af7a-f54e29583d2d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051375 Nov 27 21:07:48.637935 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2779/5676] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:07:48 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:07:48.707684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:48.709082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:48.723884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.728067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.728934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.729369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.761827 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Cannot 'reboot' instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 while it is in vm_state rescued Nov 27 21:07:48.762431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 409 to user: Cannot 'reboot' instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 while it is in vm_state rescued {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:48.763353 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-115d8af7-e5f0-44f2-8272-483ef7674ff1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157/action" status: 409 len: 145 microversion: 2.1 time: 0.060843 Nov 27 21:07:48.764107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2898/5677] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:07:48 2021] POST /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157/action => generated 145 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:07:48.773976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:48.777047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:48.788095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.788966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.791639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:48.792552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:48.842916 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Cannot 'rebuild' instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 while it is in vm_state rescued Nov 27 21:07:48.843644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 409 to user: Cannot 'rebuild' instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 while it is in vm_state rescued {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:48.845174 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68b9b926-3ade-4d1a-8b43-3c68add687eb tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "POST /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157/action" status: 409 len: 146 microversion: 2.1 time: 0.075230 Nov 27 21:07:48.847083 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2780/5678] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:07:48 2021] POST /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157/action => generated 146 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:07:49.212766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:49.212766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:49.220398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:49.221212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:49.222081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:49.222804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:49.402800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:49.412642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:49.414240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:49.415695 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b861035e-1899-4f67-ae1b-ce9b44418d31 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1719 microversion: 2.20 time: 0.214818 Nov 27 21:07:49.416319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2899/5679] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:49 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:50.436858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:50.438657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:50.460025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:50.461287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:50.465025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:50.465189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e682228d-88e2-4b69-8fcd-85573aaaa181 req-7dc9e937-b9c5-4503-917f-a388ae8154b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1a80e3-263a-4ff5-9417-defdda26f981", "name": "network-vif-unplugged", "status": "completed", "tag": "6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:50.465687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:50.466917 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:50.466917 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:07:50.490758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e682228d-88e2-4b69-8fcd-85573aaaa181 req-7dc9e937-b9c5-4503-917f-a388ae8154b6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:50.491378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e682228d-88e2-4b69-8fcd-85573aaaa181 req-7dc9e937-b9c5-4503-917f-a388ae8154b6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:50.509688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_external_events [req-e682228d-88e2-4b69-8fcd-85573aaaa181 req-7dc9e937-b9c5-4503-917f-a388ae8154b6 service nova] Unable to find a host for instance 0b1a80e3-263a-4ff5-9417-defdda26f981. Dropping event network-vif-unplugged {{(pid=135680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 21:07:50.517124 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e682228d-88e2-4b69-8fcd-85573aaaa181 req-7dc9e937-b9c5-4503-917f-a388ae8154b6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055745 Nov 27 21:07:50.520493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2900/5680] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:07:50 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 21:07:50.742545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:50.757565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:50.760924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:50.763365 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0f1e1c2-964b-4543-aaf1-285443fd70fa tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1662 microversion: 2.20 time: 0.332804 Nov 27 21:07:50.764794 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2781/5681] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:50 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1662 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:50.784891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c6b074a2-5dcb-4489-a96e-f4c4da48e400 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4558af09-ac74-43cf-9df1-40c54ef24649"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:50.787051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c6b074a2-5dcb-4489-a96e-f4c4da48e400 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:50.797292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6b074a2-5dcb-4489-a96e-f4c4da48e400 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:50.801488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6b074a2-5dcb-4489-a96e-f4c4da48e400 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:50.802699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6b074a2-5dcb-4489-a96e-f4c4da48e400 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:50.805568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6b074a2-5dcb-4489-a96e-f4c4da48e400 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.223045 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c6b074a2-5dcb-4489-a96e-f4c4da48e400 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.443451 Nov 27 21:07:51.231339 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2901/5682] 10.222.0.21 () {62 vars in 1363 bytes} [Sat Nov 27 21:07:50 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments => generated 188 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:07:51.257975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:51.258479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:51.268284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.268738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.272071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.273218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.323972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:07:51.379576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-547ba77f-362d-4e20-88c0-b88b26a2c60f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:51.380469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-547ba77f-362d-4e20-88c0-b88b26a2c60f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:51.386820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-547ba77f-362d-4e20-88c0-b88b26a2c60f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.387567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-547ba77f-362d-4e20-88c0-b88b26a2c60f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.388566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-547ba77f-362d-4e20-88c0-b88b26a2c60f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.389180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-547ba77f-362d-4e20-88c0-b88b26a2c60f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.489674 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48a7ce92-d251-4345-93b2-d25d8f62e12d tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 204 len: 0 microversion: 2.1 time: 0.234870 Nov 27 21:07:51.491773 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2782/5683] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:07:51 2021] DELETE /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:07:51.508562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:51.509947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:51.518617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.521731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.524183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.524656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.733767 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-547ba77f-362d-4e20-88c0-b88b26a2c60f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action" status: 202 len: 0 microversion: 2.20 time: 0.364024 Nov 27 21:07:51.736501 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2902/5684] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:07:51 2021] POST /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:07:51.745595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:51.746201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:51.766787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.767280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.769678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:51.771611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:51.945828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:51.976559 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8bb2938f-d5eb-4f20-a873-2e59c8f4e09e tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1507 microversion: 2.1 time: 0.476459 Nov 27 21:07:51.977604 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2783/5685] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:51 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:52.063677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:52.080943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:52.086842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:52.092358 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-996ad1d6-edd5-4f2f-90f5-7ef12c9c7f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1748 microversion: 2.20 time: 0.350749 Nov 27 21:07:52.093026 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2903/5686] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:51 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1748 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:52.994624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:53.002387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:53.012165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:53.012875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:53.013675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:53.015105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:53.113484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:53.114228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:53.125431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:53.129340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:53.130362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:53.132052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:53.259945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:53.267739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11c48a93-b911-4a9f-a7cc-ab6bc9f1f50c tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1507 microversion: 2.1 time: 0.277622 Nov 27 21:07:53.273042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2784/5687] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:52 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:53.372940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:53.382199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:53.384854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:53.386456 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3efe2c6-cba3-4dc7-af77-a843b63c16e1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1750 microversion: 2.20 time: 0.277876 Nov 27 21:07:53.387616 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2904/5688] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:53 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1750 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:54.289924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:54.291129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:54.299308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:54.300443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:54.301480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:54.303618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:54.408110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:54.410190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:54.419996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:54.420754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:54.421844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:54.423078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:54.698001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:54.730942 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-970e7db1-93d8-4b04-83d8-d2c794f79c24 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 200 len: 1507 microversion: 2.1 time: 0.441001 Nov 27 21:07:54.737509 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2785/5689] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:54 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:54.765332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:54.780489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:54.783825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:54.786161 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73e0e66b-f667-4920-a923-52bff8cb673a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1750 microversion: 2.20 time: 0.384106 Nov 27 21:07:54.801046 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2905/5690] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:54 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1750 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:54.955188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a717107a-6abf-480f-a607-ab3a8dae9156 req-da67c834-5eee-43f4-89c9-bf069a492fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa59779-cb4a-4c93-9512-ba7c5570d157", "name": "network-vif-deleted", "tag": "cd5b57d3-f3a1-4ea3-8f34-be4de4c3781f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:07:54.957064 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:54.957064 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:07:54.971453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a717107a-6abf-480f-a607-ab3a8dae9156 req-da67c834-5eee-43f4-89c9-bf069a492fee service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:54.972679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a717107a-6abf-480f-a607-ab3a8dae9156 req-da67c834-5eee-43f4-89c9-bf069a492fee service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:54.987505 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a717107a-6abf-480f-a607-ab3a8dae9156 req-da67c834-5eee-43f4-89c9-bf069a492fee service nova] Creating event network-vif-deleted:cd5b57d3-f3a1-4ea3-8f34-be4de4c3781f for instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 on nch1-master-1 Nov 27 21:07:54.995437 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a717107a-6abf-480f-a607-ab3a8dae9156 req-da67c834-5eee-43f4-89c9-bf069a492fee service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048878 Nov 27 21:07:55.002088 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2786/5691] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:07:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:07:55.753868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:55.754485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 5fa59779-cb4a-4c93-9512-ba7c5570d157] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:55.771323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:55.772004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:55.774584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:55.775304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:55.790136 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 could not be found. Nov 27 21:07:55.790745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 404 to user: Instance 5fa59779-cb4a-4c93-9512-ba7c5570d157 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:07:55.791689 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc0c9c94-22c5-496b-a2ef-0df2cdedde9f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157" status: 404 len: 111 microversion: 2.1 time: 0.042925 Nov 27 21:07:55.792775 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2906/5692] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:55 2021] GET /compute/v2.1/servers/5fa59779-cb4a-4c93-9512-ba7c5570d157 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:07:55.806199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:55.806774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:55.808168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:55.809093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:55.816685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:55.817941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:55.818946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:55.819696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:55.827712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:55.828953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:55.829955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:55.830603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:55.889643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:07:56.023509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-00f60b8d-5509-47d8-9e53-b62ae27d8b61 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 204 len: 0 microversion: 2.1 time: 0.225046 Nov 27 21:07:56.024573 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2787/5693] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:07:55 2021] DELETE /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:07:56.037170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:56.038017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:56.045575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:56.046187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:56.047904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:56.048704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:56.064041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:56.076247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:56.079295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:56.081459 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da5ea567-a94e-49f8-96d4-19cd839d20ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.280259 Nov 27 21:07:56.082544 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2907/5694] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:55 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:56.445149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:56.455831 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be36b586-0e87-4404-a4d5-773de51e523f tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.425412 Nov 27 21:07:56.456591 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2788/5695] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:56 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:57.103549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:57.106031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:57.122212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:57.126233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:57.128785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:57.129897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:57.410651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:57.431485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:57.433443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:57.435963 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30503d96-927b-4687-8faa-ddcddbd49b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.338922 Nov 27 21:07:57.437559 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2908/5696] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:57 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:07:57.475656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:57.487852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:57.505144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:57.508542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:57.512480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:57.513174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:57.893044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:57.908109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49bf0bf7-252a-4904-92a2-8e50144e5ec9 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.436163 Nov 27 21:07:57.909501 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2789/5697] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:57 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:58.456460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:58.457633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:58.466034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:58.466523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:58.467364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:58.468226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:58.705195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:58.720941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:58.722890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:58.724310 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d594bfd-2c7f-4897-bb9c-243cbf0d45ee tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.272147 Nov 27 21:07:58.739038 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2909/5698] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:58 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:07:58.926350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:58.928773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:58.939684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:58.940490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:58.941737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:58.942410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:59.549387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:59.558263 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15bd92b2-869a-4db2-ba74-b71a0851a7a1 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.636152 Nov 27 21:07:59.561800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2790/5699] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:07:58 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:07:59.746600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:07:59.747159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:07:59.760479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:59.761285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:59.762309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:07:59.763141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:07:59.952511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:59.971586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:59.973110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:07:59.980946 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa0a7021-2e71-4882-b9c5-966bf6087b83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.240053 Nov 27 21:07:59.990139 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2910/5700] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:07:59 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:00.578226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:00.578852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:00.587606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:00.588059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:00.588954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:00.589389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:00.832036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:00.855463 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-52bc7e22-ebda-4fd8-8216-ccc3494fe4c7 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.284063 Nov 27 21:08:00.859507 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2791/5701] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:00 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:01.000713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:01.002191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:01.010367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:01.011129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:01.012362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:01.013179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:01.300677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:01.339227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:01.342404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:01.344721 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-693dd865-7e4e-437f-880e-7b0691c79f83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.348391 Nov 27 21:08:01.346022 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2911/5702] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:00 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:01.877464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:01.878276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:01.889084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:01.889544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:01.890354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:01.890893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:02.146376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b931665afff4f99b4804188e9ae1438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fcfaa0229934ca2881bd510e1a2aade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:02.152658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-170a9588-b3bc-45e5-bf08-b6a12b9927b6 req-08558779-5188-46aa-9fb5-4f046c0252f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7896504e-013d-42df-9c95-1445b03b7e48", "name": "network-vif-deleted", "tag": "b613c97a-4d90-417e-b201-5f479ccadf21"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:02.154869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa8d4fb8-079e-47fe-888d-6689477b7b50 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 200 len: 1522 microversion: 2.1 time: 0.282927 Nov 27 21:08:02.155509 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2792/5703] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:01 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:02.158714 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:02.158714 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:08:02.186753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-170a9588-b3bc-45e5-bf08-b6a12b9927b6 req-08558779-5188-46aa-9fb5-4f046c0252f3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:02.188677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-170a9588-b3bc-45e5-bf08-b6a12b9927b6 req-08558779-5188-46aa-9fb5-4f046c0252f3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:02.216990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-170a9588-b3bc-45e5-bf08-b6a12b9927b6 req-08558779-5188-46aa-9fb5-4f046c0252f3 service nova] Creating event network-vif-deleted:b613c97a-4d90-417e-b201-5f479ccadf21 for instance 7896504e-013d-42df-9c95-1445b03b7e48 on nch2-master-1 Nov 27 21:08:02.226146 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-170a9588-b3bc-45e5-bf08-b6a12b9927b6 req-08558779-5188-46aa-9fb5-4f046c0252f3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077138 Nov 27 21:08:02.227170 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2912/5704] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:02.368601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:02.369331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:02.376203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:02.376659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:02.377447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:02.377897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:02.569206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:02.579817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:02.584343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:02.586120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f948f10-4bbf-4c7f-b91b-7e8449790a75 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.220879 Nov 27 21:08:02.586697 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2793/5705] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:02 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:03.175112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:03.175893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] [instance: 7896504e-013d-42df-9c95-1445b03b7e48] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:03.182277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:03.195980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:03.197240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:03.197918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:03.212267 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] HTTP exception thrown: Instance 7896504e-013d-42df-9c95-1445b03b7e48 could not be found. Nov 27 21:08:03.212850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] Returning 404 to user: Instance 7896504e-013d-42df-9c95-1445b03b7e48 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:03.213685 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1556a06-d109-4b4c-9dd1-c9906ad98778 tempest-ServerRescueNegativeTestJSON-609742415 tempest-ServerRescueNegativeTestJSON-609742415-project] 10.222.0.21 "GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48" status: 404 len: 111 microversion: 2.1 time: 0.044900 Nov 27 21:08:03.214244 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2913/5706] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:03 2021] GET /compute/v2.1/servers/7896504e-013d-42df-9c95-1445b03b7e48 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:08:03.611478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:03.612073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:03.620523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:03.621259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:03.622250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:03.622849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:03.785405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:03.796433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:03.800477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:03.801940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8c8dc305-4d9f-46b7-9c93-d66e46eff3cc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.197449 Nov 27 21:08:03.814178 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2794/5707] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:03 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:04.832755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:04.833442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:04.840900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:04.841529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:04.842340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:04.842809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:05.054434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:05.063982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:05.065580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:05.091984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-370df455-0dd2-48fa-aa58-70e2761dcdad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.238869 Nov 27 21:08:05.094634 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2914/5708] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:04 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:06.112596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:06.113323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:06.125749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:06.131415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:06.135144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:06.136499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:06.580905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:06.607383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:06.609576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:06.610805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ffd0d14a-9bd8-4c67-a2f6-d343196ab023 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.503582 Nov 27 21:08:06.611919 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2795/5709] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:06 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:07.629775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:07.631209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:07.647952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:07.650168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:07.651480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:07.653120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:07.889470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:07.899755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:07.901496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:07.902703 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca1f3aae-00be-419c-9c3d-da7113bcbf12 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.276927 Nov 27 21:08:07.903336 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2915/5710] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:07 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:08.925560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:08.926413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:08.945194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:08.945889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:08.947093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:08.951560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:09.213837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:09.237857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:09.240687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:09.244721 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aafebf46-f8cb-4b1e-a60d-ec1de8cea48a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.326352 Nov 27 21:08:09.247593 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2796/5711] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:08 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:09.644389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1822517419", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "2feaefb8-3f7a-421e-9bcb-1af37c4138c1"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:09.699896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] validate_networks() for [('2feaefb8-3f7a-421e-9bcb-1af37c4138c1', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:08:10.263694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:10.264779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:10.278656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:10.279490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:10.280530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:10.281770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:10.509835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:08:10.510266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:08:10.510743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:08:10.511156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:08:10.511603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:08:10.522035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:10.522482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:10.523700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:10.524347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:10.554851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Getting quotas for project 9e71ba352bc24e6783f74563b7ccef73. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:10.560135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Getting quotas for user 58f9c80552ab428e81fd38ed6ed79a9c and project 9e71ba352bc24e6783f74563b7ccef73. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:10.573693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:08:10.576344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:08:10.578410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:10.587244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:10.588775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:10.589969 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-547964de-50fa-4437-862e-cd26175ebe39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.330128 Nov 27 21:08:10.590543 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2797/5712] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:10 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:10.652546 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8eb44a95-521f-4942-9303-3853e010b8f3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195780 Nov 27 21:08:10.653578 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2916/5713] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:08:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:08:10.663604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7bc1c555-b976-4192-9e4e-742a4bdfbec6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:10.664230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7bc1c555-b976-4192-9e4e-742a4bdfbec6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:10.742277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7bc1c555-b976-4192-9e4e-742a4bdfbec6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:10.753715 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7bc1c555-b976-4192-9e4e-742a4bdfbec6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1212 microversion: 2.1 time: 0.093630 Nov 27 21:08:10.754331 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2798/5714] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:10 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:11.610060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:11.611719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:11.620509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:11.621739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:11.622709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:11.623334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:11.770615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:11.773332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:11.797222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:11.797967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:11.802164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:11.802820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:11.847930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:11.857299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:11.870978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:11.872236 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2886ca09-c903-4489-9a19-434fafe1ed30 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.267131 Nov 27 21:08:11.883427 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2917/5715] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:11 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:11.978410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:11.996354 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff57ee44-6c55-4ed9-b8e0-484b5a3f4550 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1272 microversion: 2.1 time: 0.229709 Nov 27 21:08:12.007439 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2799/5716] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:11 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:12.895502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:12.896149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:12.904627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:12.905095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:12.905941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:12.906571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:13.014096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:13.014720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:13.026063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:13.026761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:13.027832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:13.028434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:13.295636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:13.326438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:13.327487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:13.331781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:13.336453 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b862db71-d7e4-4bc7-a5b2-30e7e261bb13 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.326098 Nov 27 21:08:13.346796 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2800/5717] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:13 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:13.347007 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c5d668fe-3a85-4fa6-957d-8c3e3fb77bdb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.447411 Nov 27 21:08:13.347007 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2918/5718] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:12 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:13.746587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-993c90f3-2cb3-4857-afcf-eb965658aa7b req-725eae04-fd76-43ce-926e-90f7ca45df5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b4e830-3d4a-4c27-9c08-00844558c13c", "tag": "e38da6ce-a6a3-4ee5-b87d-c9eb82116542"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:13.748435 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:13.748435 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:13.756282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-993c90f3-2cb3-4857-afcf-eb965658aa7b req-725eae04-fd76-43ce-926e-90f7ca45df5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:13.756723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-993c90f3-2cb3-4857-afcf-eb965658aa7b req-725eae04-fd76-43ce-926e-90f7ca45df5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:13.772060 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-993c90f3-2cb3-4857-afcf-eb965658aa7b req-725eae04-fd76-43ce-926e-90f7ca45df5e service nova] Creating event network-changed:e38da6ce-a6a3-4ee5-b87d-c9eb82116542 for instance 44b4e830-3d4a-4c27-9c08-00844558c13c on nch2-master-1 Nov 27 21:08:13.777500 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-993c90f3-2cb3-4857-afcf-eb965658aa7b req-725eae04-fd76-43ce-926e-90f7ca45df5e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034895 Nov 27 21:08:13.778309 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2801/5719] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:14.362233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:14.364746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:14.365448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:14.368538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:14.377427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:14.377884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:14.378688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:14.379651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:14.383364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:14.383825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:14.384620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:14.385062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:14.631554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:14.640601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:14.642127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:14.643404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9111c153-bcaf-431f-9f2a-53c186bbc16f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.286799 Nov 27 21:08:14.644000 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2802/5720] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:14 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:14.648861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2e697a14-d371-46d8-b9b3-3ee82db18078 req-9d7a95d6-1ba3-4a81-bfa8-e58954520a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1a80e3-263a-4ff5-9417-defdda26f981", "name": "network-vif-plugged", "status": "completed", "tag": "6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:14.650581 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:14.650581 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:14.658481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2e697a14-d371-46d8-b9b3-3ee82db18078 req-9d7a95d6-1ba3-4a81-bfa8-e58954520a6d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:14.659177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2e697a14-d371-46d8-b9b3-3ee82db18078 req-9d7a95d6-1ba3-4a81-bfa8-e58954520a6d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:14.670124 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2e697a14-d371-46d8-b9b3-3ee82db18078 req-9d7a95d6-1ba3-4a81-bfa8-e58954520a6d service nova] Creating event network-vif-plugged:6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9 for instance 0b1a80e3-263a-4ff5-9417-defdda26f981 on nch1-master-1 Nov 27 21:08:14.675906 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2e697a14-d371-46d8-b9b3-3ee82db18078 req-9d7a95d6-1ba3-4a81-bfa8-e58954520a6d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030514 Nov 27 21:08:14.677301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2803/5721] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:14.736901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:14.746697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd60f5a9-561c-4caf-ad23-5845a80e52e2 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.396263 Nov 27 21:08:14.767085 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2919/5722] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:14 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:15.663615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:15.665073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:15.671921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:15.672746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:15.673801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:15.674512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:15.769886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:15.770695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:15.784712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:15.785895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:15.786730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:15.787732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:15.902925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:15.913720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:15.915769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:15.921933 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe139ee5-9732-477d-9ab9-9606461472de tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.262935 Nov 27 21:08:15.922549 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2804/5723] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:15 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:16.463706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:16.471605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a08607a9-1192-4062-837d-2c0485464f0f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.706950 Nov 27 21:08:16.474931 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2920/5724] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:15 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:16.945746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:16.948499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:16.963540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:16.963966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:16.968447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:16.968911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:17.196402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:17.207700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:17.209622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:17.211208 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7d62838-2383-440c-9d01-b07428ff4c2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1806 microversion: 2.20 time: 0.274172 Nov 27 21:08:17.211955 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2805/5725] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:16 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:17.489559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:17.491039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:17.502928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:17.503744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:17.504916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:17.505587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:17.770954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:17.782787 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f81661f5-e824-47b8-b901-749f6ab10e14 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.296737 Nov 27 21:08:17.785307 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2921/5726] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:17 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:18.229618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:18.230244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:18.243606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:18.244069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:18.245459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:18.245902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:18.420747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:18.451154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:18.453952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:18.455358 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-504fcfe5-817b-43ae-bc46-28db756b9223 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1793 microversion: 2.20 time: 0.229388 Nov 27 21:08:18.472360 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2806/5727] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:18 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1793 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:18.810637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:18.811556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:18.824208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:18.825685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:18.826886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:18.832265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:19.096157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:19.106442 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba114e73-379b-472d-860f-1f34e403d47e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.307017 Nov 27 21:08:19.107370 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2922/5728] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:18 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:19.472811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8e0a482-44a7-4146-91a7-0d5ee15c46a3 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Action: 'create', calling method: .version_select at 0x7f15c6aa1a60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-467753751"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:19.500131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c8e0a482-44a7-4146-91a7-0d5ee15c46a3 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for project 49981e6330d04897a5b23f4ca0b9a934. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:19.506148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c8e0a482-44a7-4146-91a7-0d5ee15c46a3 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for user 8e803241af524277951e54959299c98e and project 49981e6330d04897a5b23f4ca0b9a934. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:19.822530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c8e0a482-44a7-4146-91a7-0d5ee15c46a3 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for project 49981e6330d04897a5b23f4ca0b9a934. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:19.827700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c8e0a482-44a7-4146-91a7-0d5ee15c46a3 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for user 8e803241af524277951e54959299c98e and project 49981e6330d04897a5b23f4ca0b9a934. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:19.844566 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8e0a482-44a7-4146-91a7-0d5ee15c46a3 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.605870 Nov 27 21:08:19.850677 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2807/5729] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:08:19 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:20.123633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:20.124840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:20.133293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:20.133818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:20.134973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:20.135571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:20.365394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:20.375904 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61880276-88a3-4a1d-89fb-2e8b61a262b5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.256416 Nov 27 21:08:20.376811 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2923/5730] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:20 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:21.011935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-151103593", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-467753751", "security_groups": [{"name": "tempest-secgroup-smoke-29767374"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "82b7458b-bb62-43f1-8459-dfaac22cfd80"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:21.127773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] validate_networks() for [('82b7458b-bb62-43f1-8459-dfaac22cfd80', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:08:21.247781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2c4c5789-02ac-4654-a282-0d556caf1da3 req-52d9a103-40e1-4cce-a0c8-228d64f9d665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b4e830-3d4a-4c27-9c08-00844558c13c", "name": "network-vif-plugged", "status": "completed", "tag": "e38da6ce-a6a3-4ee5-b87d-c9eb82116542"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:21.249912 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:21.249912 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:08:21.259194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2c4c5789-02ac-4654-a282-0d556caf1da3 req-52d9a103-40e1-4cce-a0c8-228d64f9d665 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:21.259940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2c4c5789-02ac-4654-a282-0d556caf1da3 req-52d9a103-40e1-4cce-a0c8-228d64f9d665 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:21.274142 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2c4c5789-02ac-4654-a282-0d556caf1da3 req-52d9a103-40e1-4cce-a0c8-228d64f9d665 service nova] Creating event network-vif-plugged:e38da6ce-a6a3-4ee5-b87d-c9eb82116542 for instance 44b4e830-3d4a-4c27-9c08-00844558c13c on nch2-master-1 Nov 27 21:08:21.279648 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2c4c5789-02ac-4654-a282-0d556caf1da3 req-52d9a103-40e1-4cce-a0c8-228d64f9d665 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036816 Nov 27 21:08:21.280441 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2924/5731] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:08:21.393033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:21.393833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:21.410150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:21.413940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:21.417485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:21.420056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:21.599434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for project 49981e6330d04897a5b23f4ca0b9a934. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:21.605116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:21.609175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for user 8e803241af524277951e54959299c98e and project 49981e6330d04897a5b23f4ca0b9a934. Resources: dict_keys(['metadata_items']) {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:21.615042 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5bd90815-a5f5-4141-a2ca-e926a0cc7942 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.225973 Nov 27 21:08:21.615715 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2925/5732] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:21 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:21.628456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:08:21.628970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:08:21.629796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:08:21.630450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:08:21.630935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:08:21.639833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:21.640213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:21.641256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:21.641708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:21.660564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for project 49981e6330d04897a5b23f4ca0b9a934. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:21.665932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Getting quotas for user 8e803241af524277951e54959299c98e and project 49981e6330d04897a5b23f4ca0b9a934. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:21.678705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:08:21.681143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:08:21.730422 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68838fff-98ff-4a81-9e08-f5ec124fbff4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.722138 Nov 27 21:08:21.731803 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2808/5733] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:08:21 2021] POST /compute/v2.1/servers => generated 404 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:08:21.742220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d36b0f2-9840-415e-a344-c2c000fe85aa tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:21.743177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d36b0f2-9840-415e-a344-c2c000fe85aa tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:21.813418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7d36b0f2-9840-415e-a344-c2c000fe85aa tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:21.820489 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d36b0f2-9840-415e-a344-c2c000fe85aa tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1301 microversion: 2.1 time: 0.082113 Nov 27 21:08:21.821047 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2926/5734] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:21 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:22.634436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:22.639773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:22.646910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:22.648800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:22.649843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:22.650386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:22.839462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:22.841990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:22.855845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:22.856569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:22.859682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:22.860467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:22.903631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:22.913139 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d21bb51-7414-4249-a4a1-18e47a05aad6 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1312 microversion: 2.1 time: 0.283691 Nov 27 21:08:22.913752 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2809/5735] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:22 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:22.957194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:22.965800 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-764fbd32-b60f-4232-b98d-442a28e76aff tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1371 microversion: 2.1 time: 0.130797 Nov 27 21:08:22.966999 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2927/5736] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:22 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:23.929769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:23.930569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:23.937897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:23.938283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:23.939080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:23.939627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:23.984208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:23.984831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:23.991709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:23.992170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:23.992971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:23.993417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.166241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:24.174513 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5dbd85d-6ebf-4fee-bf87-9a7225d59956 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1425 microversion: 2.1 time: 0.193945 Nov 27 21:08:24.175090 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2928/5737] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:23 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1425 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:24.193996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:24.202075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d07a0b4-894c-4760-a98a-77b773980943 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1496 microversion: 2.1 time: 0.275964 Nov 27 21:08:24.203162 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2810/5738] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:23 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:24.220222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c7e81700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.228877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.229422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.229915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:24.236375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.236831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.237623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.238063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.264120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.264621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.278920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.279414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.308719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:24.327401 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-377e0a42-fb1d-40a9-9ca3-63d24563f258 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-848087637" status: 201 len: 0 microversion: 2.26 time: 0.111895 Nov 27 21:08:24.332056 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2929/5739] 10.222.0.21 () {62 vars in 1376 bytes} [Sat Nov 27 21:08:24 2021] PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-848087637 => generated 0 bytes in 113 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 27 21:08:24.339373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-25487254-640e-4232-bcd1-3b012961f160 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c7fb9700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.350269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25487254-640e-4232-bcd1-3b012961f160 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.351567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25487254-640e-4232-bcd1-3b012961f160 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.359951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-c3e9a358-9535-4c87-be3a-306afebf3d36 req-efe0bc0d-8e39-4411-a8fa-24542e06bee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592ef09c-8fa3-4952-a2c1-8aa3bf414542", "tag": "016719dd-00d2-4489-a2b6-c05c7ea909ed"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:24.361881 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:24.361881 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:08:24.371128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c3e9a358-9535-4c87-be3a-306afebf3d36 req-efe0bc0d-8e39-4411-a8fa-24542e06bee5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.371905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c3e9a358-9535-4c87-be3a-306afebf3d36 req-efe0bc0d-8e39-4411-a8fa-24542e06bee5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.372135 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-25487254-640e-4232-bcd1-3b012961f160 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-848087637" status: 204 len: 0 microversion: 2.26 time: 0.038239 Nov 27 21:08:24.372983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2811/5740] 10.222.0.21 () {60 vars in 1357 bytes} [Sat Nov 27 21:08:24 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-848087637 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:24.384322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c6d37670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.388961 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-c3e9a358-9535-4c87-be3a-306afebf3d36 req-efe0bc0d-8e39-4411-a8fa-24542e06bee5 service nova] Creating event network-changed:016719dd-00d2-4489-a2b6-c05c7ea909ed for instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 on nch1-master-1 Nov 27 21:08:24.393916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-c3e9a358-9535-4c87-be3a-306afebf3d36 req-efe0bc0d-8e39-4411-a8fa-24542e06bee5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039056 Nov 27 21:08:24.395424 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2930/5741] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:24.396153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.397808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.398647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:24.405940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.406616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.407652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.409350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.434126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.434582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.456054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:24.477174 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12f3b53a-432e-47df-8276-996a694d91f1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 204 len: 0 microversion: 2.26 time: 0.097889 Nov 27 21:08:24.478019 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2812/5742] 10.222.0.21 () {60 vars in 1294 bytes} [Sat Nov 27 21:08:24 2021] DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:24.490364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-300cd5b2-cc3e-4d6f-ba4d-720e9976beb3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15d945dee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.500240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-300cd5b2-cc3e-4d6f-ba4d-720e9976beb3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.500697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-300cd5b2-cc3e-4d6f-ba4d-720e9976beb3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.510392 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-300cd5b2-cc3e-4d6f-ba4d-720e9976beb3 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 200 len: 12 microversion: 2.26 time: 0.025172 Nov 27 21:08:24.511026 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2931/5743] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 21:08:24 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:24.520601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15d4380820>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.529821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.530844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.532200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:24.538310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.538764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.539577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.540072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.567019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.567538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.579310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.579767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.604176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:24.620656 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d7f2f0c-cc15-4c1b-b4af-b6ab95b50d46 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-270835104" status: 201 len: 0 microversion: 2.26 time: 0.103822 Nov 27 21:08:24.625683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2813/5744] 10.222.0.21 () {62 vars in 1376 bytes} [Sat Nov 27 21:08:24 2021] PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-270835104 => generated 0 bytes in 105 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 27 21:08:24.630743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c15699a-c586-4b82-8eb2-9ad231044fc1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c7379c10>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.648574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c15699a-c586-4b82-8eb2-9ad231044fc1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.649040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c15699a-c586-4b82-8eb2-9ad231044fc1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.661609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c15699a-c586-4b82-8eb2-9ad231044fc1 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 200 len: 35 microversion: 2.26 time: 0.034601 Nov 27 21:08:24.663567 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2932/5745] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 21:08:24 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 35 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:24.673639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c6acad30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.682290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.682751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.683235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:24.689484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.689946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.690749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.691196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.714020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.714363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.738493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:24.753727 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5d17a43-149a-46ff-8427-7d9a755a5b7e tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-270835104" status: 204 len: 0 microversion: 2.26 time: 0.085119 Nov 27 21:08:24.754535 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2814/5746] 10.222.0.21 () {60 vars in 1360 bytes} [Sat Nov 27 21:08:24 2021] DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-270835104 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:24.762713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-843167a8-326a-4512-a302-7834cb6c4895 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c7f7d310>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.771987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-843167a8-326a-4512-a302-7834cb6c4895 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.772451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-843167a8-326a-4512-a302-7834cb6c4895 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.782264 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-843167a8-326a-4512-a302-7834cb6c4895 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 200 len: 12 microversion: 2.26 time: 0.023364 Nov 27 21:08:24.782894 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2933/5747] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 21:08:24 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:24.792695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15d94bd790>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.801854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.802304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.802782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:24.808843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.809292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.810126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.810542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.833837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.834282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.845469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:24.860149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75286d58-bf6f-4099-a103-192356b1b4a5 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 204 len: 0 microversion: 2.26 time: 0.071400 Nov 27 21:08:24.860781 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2815/5748] 10.222.0.21 () {60 vars in 1294 bytes} [Sat Nov 27 21:08:24 2021] DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:24.870565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c6e29ee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.880043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.880607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.881309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:24.887001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.887562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.888431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.888939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.912700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.913278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.923359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.923817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.947185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:24.964123 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e90498e5-da03-4acf-bffa-b5bf248eb52f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-1662271983" status: 201 len: 0 microversion: 2.26 time: 0.097564 Nov 27 21:08:24.969407 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2934/5749] 10.222.0.21 () {62 vars in 1379 bytes} [Sat Nov 27 21:08:24 2021] PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-1662271983 => generated 0 bytes in 99 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 27 21:08:24.977151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c787c1f0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:24.985664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.986120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.986596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:24.991779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.992237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:24.993012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:24.993458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.016610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.017069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.025721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.026183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.049625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:25.064200 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7db746ba-ff20-4366-b8b3-8d5287c3a663 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-121232498" status: 201 len: 0 microversion: 2.26 time: 0.091722 Nov 27 21:08:25.068711 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2816/5750] 10.222.0.21 () {62 vars in 1376 bytes} [Sat Nov 27 21:08:24 2021] PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-121232498 => generated 0 bytes in 93 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 27 21:08:25.074056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c6e29160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.083388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.084078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.084562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.089805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.090263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.091217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.091695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.113726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.114178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.127683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:25.142434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5da3789e-f6a0-482a-af31-ba98f782e073 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 204 len: 0 microversion: 2.26 time: 0.072341 Nov 27 21:08:25.143058 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2935/5751] 10.222.0.21 () {60 vars in 1294 bytes} [Sat Nov 27 21:08:25 2021] DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:25.151200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0667efb-b719-4a2c-b16a-caf6b08c56dd tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c6ad08b0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.161236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0667efb-b719-4a2c-b16a-caf6b08c56dd tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.161603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0667efb-b719-4a2c-b16a-caf6b08c56dd tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.171081 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0667efb-b719-4a2c-b16a-caf6b08c56dd tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 200 len: 12 microversion: 2.26 time: 0.023587 Nov 27 21:08:25.171767 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2817/5752] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 21:08:25 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:25.181264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15d9476dc0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.190400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.191064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.191614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.192238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.193132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.197188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.197624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.198396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.198828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.199617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.200076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.200862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.201330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.221800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.222161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.233995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:25.248555 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6728ee81-272e-4570-b789-1bc61cdaeec9 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 204 len: 0 microversion: 2.26 time: 0.071065 Nov 27 21:08:25.249730 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2936/5753] 10.222.0.21 () {60 vars in 1294 bytes} [Sat Nov 27 21:08:25 2021] DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:25.258626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c7e81f70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.267543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.268003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.268481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.273843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.274299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.275071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.275540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.298214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.298672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.309249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.309761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.333809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:25.351170 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a188efa4-64f9-40ee-a45b-99f3024cfe6c tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-180961400" status: 201 len: 0 microversion: 2.26 time: 0.096139 Nov 27 21:08:25.352028 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2937/5754] 10.222.0.21 () {62 vars in 1376 bytes} [Sat Nov 27 21:08:25 2021] PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-180961400 => generated 0 bytes in 97 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Nov 27 21:08:25.360930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c7b58af0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.369256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.369714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.370447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.376520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.377019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.377906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.378643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.402332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.402795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.411417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.411890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.417856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:25.426352 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-503e2ce6-8564-4410-9cd3-7f294d42439f tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1425 microversion: 2.1 time: 0.238008 Nov 27 21:08:25.427054 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2818/5755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:25 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1425 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:25.434629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:25.450401 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-049fb033-5a07-4534-b88c-2d7069890cad tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-1386853231" status: 201 len: 0 microversion: 2.26 time: 0.093381 Nov 27 21:08:25.455438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2938/5756] 10.222.0.21 () {62 vars in 1379 bytes} [Sat Nov 27 21:08:25 2021] PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags/tempest-tag-1386853231 => generated 0 bytes in 95 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 27 21:08:25.460826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Action: 'update_all', calling method: .version_select at 0x7f15c6aa6ee0>, body: {"tags": ["tempest-tag-108124936", "tempest-tag-1242281356"]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:25.469536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.469997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.470479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.476200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.476461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.477312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.477761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.501487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.501952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.520792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:25.535721 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd7b6253-3f8a-4faa-9e8c-0b9af443825f tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 200 len: 61 microversion: 2.26 time: 0.078826 Nov 27 21:08:25.536360 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2819/5757] 10.222.0.21 () {62 vars in 1311 bytes} [Sat Nov 27 21:08:25 2021] PUT /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 61 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:25.546535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df1e06c1-74c7-4245-a0d6-3c2a595a62ff tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c7e81940>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.554740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df1e06c1-74c7-4245-a0d6-3c2a595a62ff tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.555196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df1e06c1-74c7-4245-a0d6-3c2a595a62ff tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.565264 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df1e06c1-74c7-4245-a0d6-3c2a595a62ff tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 200 len: 61 microversion: 2.26 time: 0.023167 Nov 27 21:08:25.566017 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2939/5758] 10.222.0.21 () {60 vars in 1291 bytes} [Sat Nov 27 21:08:25 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 61 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:25.576006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '.version_select at 0x7f15c6aa9430>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.584005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.584462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.584937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.590053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.590503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.591286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.591731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.613222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.613673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.627522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lazy-loading 'flavor' on Instance uuid 44b4e830-3d4a-4c27-9c08-00844558c13c {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:25.642453 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f0df8635-1b9e-4560-a2cc-93b966e5f06d tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags" status: 204 len: 0 microversion: 2.26 time: 0.070279 Nov 27 21:08:25.643066 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2820/5759] 10.222.0.21 () {60 vars in 1294 bytes} [Sat Nov 27 21:08:25 2021] DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c/tags => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:25.652180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.652770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.658663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.659197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.660751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.661402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.691351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:08:25.769710 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0fbbe963-92a8-4f62-b56a-5799fdbb0052 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 204 len: 0 microversion: 2.1 time: 0.120895 Nov 27 21:08:25.770412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2940/5760] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:08:25 2021] DELETE /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:08:25.779767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:25.780423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:25.787235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.787739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.788542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:25.788990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:25.921293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:25.928675 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-79125226-a993-44df-8433-e2c0aaa4758b tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1502 microversion: 2.1 time: 0.153057 Nov 27 21:08:25.929248 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2821/5761] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:25 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:26.443960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:26.444690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:26.451573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:26.452517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:26.453298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:26.453739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:26.589485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:26.597540 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b9278506-f63f-488a-9a5c-608f9b283e04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1425 microversion: 2.1 time: 0.157700 Nov 27 21:08:26.598105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2941/5762] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:26 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1425 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:26.945501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:26.946105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:26.953491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:26.953943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:26.954714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:26.955149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:27.091745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58f9c80552ab428e81fd38ed6ed79a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e71ba352bc24e6783f74563b7ccef73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:27.099145 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf0ee58f-8659-4117-a370-ce7da56c63eb tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 200 len: 1502 microversion: 2.1 time: 0.157279 Nov 27 21:08:27.099752 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2822/5763] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:26 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:27.617951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:27.619145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:27.629134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:27.629668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:27.630961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:27.632690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:27.644157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c8d4e37f-6e7f-450f-a7f4-5956609259b0 req-3ac1d0b5-406a-4fa0-bb05-93bffa213a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b4e830-3d4a-4c27-9c08-00844558c13c", "name": "network-vif-deleted", "tag": "e38da6ce-a6a3-4ee5-b87d-c9eb82116542"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:27.646227 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:27.646227 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:27.662542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c8d4e37f-6e7f-450f-a7f4-5956609259b0 req-3ac1d0b5-406a-4fa0-bb05-93bffa213a12 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:27.663864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c8d4e37f-6e7f-450f-a7f4-5956609259b0 req-3ac1d0b5-406a-4fa0-bb05-93bffa213a12 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:27.691884 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c8d4e37f-6e7f-450f-a7f4-5956609259b0 req-3ac1d0b5-406a-4fa0-bb05-93bffa213a12 service nova] Creating event network-vif-deleted:e38da6ce-a6a3-4ee5-b87d-c9eb82116542 for instance 44b4e830-3d4a-4c27-9c08-00844558c13c on nch2-master-1 Nov 27 21:08:27.708210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c8d4e37f-6e7f-450f-a7f4-5956609259b0 req-3ac1d0b5-406a-4fa0-bb05-93bffa213a12 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063055 Nov 27 21:08:27.709221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2823/5764] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:27.809055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:27.816488 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-378261ad-4072-4f87-94e1-a3e7e8bd3e2b tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1425 microversion: 2.1 time: 0.203414 Nov 27 21:08:27.817070 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2942/5765] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:27 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1425 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:28.118027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:28.118815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] [instance: 44b4e830-3d4a-4c27-9c08-00844558c13c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:28.125246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:28.125703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:28.126487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:28.126926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:28.140658 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] HTTP exception thrown: Instance 44b4e830-3d4a-4c27-9c08-00844558c13c could not be found. Nov 27 21:08:28.141372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] Returning 404 to user: Instance 44b4e830-3d4a-4c27-9c08-00844558c13c could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:28.142202 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fca1c98d-38cf-47df-aad8-620dc65263e8 tempest-ServerTagsTestJSON-1062512863 tempest-ServerTagsTestJSON-1062512863-project] 10.222.0.21 "GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c" status: 404 len: 111 microversion: 2.1 time: 0.029320 Nov 27 21:08:28.142975 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2824/5766] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:28 2021] GET /compute/v2.1/servers/44b4e830-3d4a-4c27-9c08-00844558c13c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:08:28.834492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:28.835130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:28.842571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:28.843031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:28.843865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:28.844308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:28.990252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:28.998688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae4934d0-738c-44de-b333-6dd0cac096cc tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1425 microversion: 2.1 time: 0.169460 Nov 27 21:08:28.999928 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2943/5767] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:28 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1425 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:30.016532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:30.017272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:30.024856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:30.025370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:30.026176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:30.026798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:30.264866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:30.274003 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a6a8064-f128-41e0-b64c-0de1aba79cdb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1425 microversion: 2.1 time: 0.261869 Nov 27 21:08:30.280256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d1152203-7537-444d-9764-6a9c8cda1798 req-87bb7fb1-e297-4352-9ae0-4ffda113e489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592ef09c-8fa3-4952-a2c1-8aa3bf414542", "name": "network-vif-plugged", "status": "completed", "tag": "016719dd-00d2-4489-a2b6-c05c7ea909ed"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:30.283184 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:30.283184 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:08:30.284464 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2825/5768] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:30 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1425 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:30.292078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d1152203-7537-444d-9764-6a9c8cda1798 req-87bb7fb1-e297-4352-9ae0-4ffda113e489 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:30.292645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d1152203-7537-444d-9764-6a9c8cda1798 req-87bb7fb1-e297-4352-9ae0-4ffda113e489 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:30.305611 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d1152203-7537-444d-9764-6a9c8cda1798 req-87bb7fb1-e297-4352-9ae0-4ffda113e489 service nova] Creating event network-vif-plugged:016719dd-00d2-4489-a2b6-c05c7ea909ed for instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 on nch1-master-1 Nov 27 21:08:30.311226 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d1152203-7537-444d-9764-6a9c8cda1798 req-87bb7fb1-e297-4352-9ae0-4ffda113e489 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036635 Nov 27 21:08:30.312812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2944/5769] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:08:30.771461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1937206835", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:30.820816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:08:31.169625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:08:31.170213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:08:31.170565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:08:31.171220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:08:31.171667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:08:31.180383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.180835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.181748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.182126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.196845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:31.197438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:31.201670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:31.204153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.204611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.205394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.205842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.207343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:31.219474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:08:31.221821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:08:31.230563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:08:31.266657 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28464a28-7d6e-4393-9d83-60ffab69bb92 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609805 Nov 27 21:08:31.272551 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2826/5770] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:08:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:08:31.278261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47cc4742-9b57-4f2c-b7db-32f5ad0ba493 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:31.278932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47cc4742-9b57-4f2c-b7db-32f5ad0ba493 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:31.337996 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-91d564fa-c4ab-40ba-90bf-76bfdfa112b8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 204 len: 0 microversion: 2.32 time: 0.290772 Nov 27 21:08:31.339701 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2945/5771] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 21:08:31 2021] DELETE /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 27 21:08:31.346165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:31.346811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:31.352853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.353314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.354498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.354944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.359867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47cc4742-9b57-4f2c-b7db-32f5ad0ba493 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:31.367357 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47cc4742-9b57-4f2c-b7db-32f5ad0ba493 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1193 microversion: 2.1 time: 0.093785 Nov 27 21:08:31.367932 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2827/5772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:31 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:31.377382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:31.377382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:31.384661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.385115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.385928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:31.386364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:31.536949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:31.550861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89ee1e46-ff32-4db3-902e-30ff69e3b8cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1425 microversion: 2.1 time: 0.209088 Nov 27 21:08:31.556591 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2946/5773] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:31 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1425 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:31.631530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:31.645008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:31.646867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:31.648368 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6f41b58-1f86-4c61-9fa3-2c480253275e tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2956 microversion: 2.32 time: 0.279330 Nov 27 21:08:31.649333 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2828/5774] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:31 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2956 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:32.386812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:32.387445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:32.394630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.395076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:32.395891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.396323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:32.570720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:32.571478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:32.580091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.580626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:32.581340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.581781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:32.776512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:32.784261 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98942dcb-5664-4b06-a2aa-3508b35dae36 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1251 microversion: 2.1 time: 0.401065 Nov 27 21:08:32.784974 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2947/5775] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:32 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1251 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:32.789592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:32.790358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:32.797764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.799053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:32.800101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.800718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:32.874763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:32.883531 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-807a8ea3-fac0-466d-b74c-f2edb541ae7e tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1603 microversion: 2.1 time: 0.317212 Nov 27 21:08:32.884115 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2829/5776] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:32 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1603 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:32.900109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:32.900685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:32.906719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.907172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:32.908166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:32.908777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:33.098366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:33.107999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:33.110357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:33.111987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d119d403-a172-4a77-bd21-aa534c082cfe tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2956 microversion: 2.32 time: 0.325815 Nov 27 21:08:33.112673 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2948/5777] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:32 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2956 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:33.149751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:33.157652 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5bcc90b4-0008-4b85-91a6-42a411d67b04 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1603 microversion: 2.1 time: 0.261164 Nov 27 21:08:33.158883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2830/5778] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:32 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1603 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:33.174355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:33.174891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:33.180991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:33.181450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:33.182451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:33.182898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:33.366329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:33.380220 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cef5c0e7-f35a-4a17-8ca7-5934354361c4 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1603 microversion: 2.1 time: 0.209865 Nov 27 21:08:33.381581 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2949/5779] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:33 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1603 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:33.800624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:33.801240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:33.807990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:33.808650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:33.809650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:33.810261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:34.133816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:34.136521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:34.151706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:34.164094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:34.165477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:34.166913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:34.194430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:34.203321 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12130750-d211-4311-a361-d99ff83a3039 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.405582 Nov 27 21:08:34.205133 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2831/5780] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:33 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:34.217306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-87d03b95-b7f2-4f84-b84e-a76421af6a0c req-8fc7b3ac-8afb-476c-83de-853b1cc19a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af42a712-cb65-42f8-b073-c9aa8c778116", "tag": "c65eb439-cdbe-4239-9004-3a356e2f3c6f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:34.220746 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:34.220746 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:34.230671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-87d03b95-b7f2-4f84-b84e-a76421af6a0c req-8fc7b3ac-8afb-476c-83de-853b1cc19a0d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:34.231451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-87d03b95-b7f2-4f84-b84e-a76421af6a0c req-8fc7b3ac-8afb-476c-83de-853b1cc19a0d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:34.247342 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-87d03b95-b7f2-4f84-b84e-a76421af6a0c req-8fc7b3ac-8afb-476c-83de-853b1cc19a0d service nova] Creating event network-changed:c65eb439-cdbe-4239-9004-3a356e2f3c6f for instance af42a712-cb65-42f8-b073-c9aa8c778116 on nch2-master-1 Nov 27 21:08:34.255524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-87d03b95-b7f2-4f84-b84e-a76421af6a0c req-8fc7b3ac-8afb-476c-83de-853b1cc19a0d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047626 Nov 27 21:08:34.256627 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2832/5781] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:34.494903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:34.512342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:34.514493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:34.517056 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f14e7f9-f77f-482f-822c-c7b12efdd327 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2914 microversion: 2.32 time: 0.387789 Nov 27 21:08:34.531348 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2950/5782] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:34 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2914 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:08:35.067077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4680544e-6214-4a39-a6be-743cdfd99c71 req-14127067-77ca-49fa-a6ef-916261f0db99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "c24676eb-b68a-43ef-928f-8f5a3e6d3406"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:35.070198 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:35.070198 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:35.078299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4680544e-6214-4a39-a6be-743cdfd99c71 req-14127067-77ca-49fa-a6ef-916261f0db99 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:35.078915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4680544e-6214-4a39-a6be-743cdfd99c71 req-14127067-77ca-49fa-a6ef-916261f0db99 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:35.090890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4680544e-6214-4a39-a6be-743cdfd99c71 req-14127067-77ca-49fa-a6ef-916261f0db99 service nova] Creating event network-vif-deleted:c24676eb-b68a-43ef-928f-8f5a3e6d3406 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:35.097277 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4680544e-6214-4a39-a6be-743cdfd99c71 req-14127067-77ca-49fa-a6ef-916261f0db99 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Nov 27 21:08:35.097904 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2833/5783] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:35.220585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:35.221300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:35.228474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:35.228945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:35.229801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:35.230239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:35.379943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:35.388043 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6ecdf58-cc6f-4f4f-b48d-587083b3564f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.171729 Nov 27 21:08:35.388883 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2951/5784] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:35 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:35.544851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:35.545558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:35.552233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:35.552726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:35.553526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:35.553969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:36.190697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:36.201956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:36.204484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:36.205464 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f345aca6-58bf-4151-85d6-4f90f36f2eb4 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2753 microversion: 2.32 time: 0.665004 Nov 27 21:08:36.211303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2834/5785] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:35 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2753 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:36.254266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-96182704-47a1-4d45-a0ec-40d9b68900a8 req-b4243021-9ea5-411b-83b0-98cd96f63143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-unplugged", "status": "completed", "tag": "d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:36.255875 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:36.255875 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:08:36.268108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-96182704-47a1-4d45-a0ec-40d9b68900a8 req-b4243021-9ea5-411b-83b0-98cd96f63143 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:36.268604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-96182704-47a1-4d45-a0ec-40d9b68900a8 req-b4243021-9ea5-411b-83b0-98cd96f63143 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:36.289926 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-96182704-47a1-4d45-a0ec-40d9b68900a8 req-b4243021-9ea5-411b-83b0-98cd96f63143 service nova] Creating event network-vif-unplugged:d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:36.296361 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-96182704-47a1-4d45-a0ec-40d9b68900a8 req-b4243021-9ea5-411b-83b0-98cd96f63143 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045630 Nov 27 21:08:36.297438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2952/5786] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:36.406263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:36.406874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:36.413155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:36.413604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:36.414584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:36.415187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:36.866410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:36.874749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efd83d64-cc30-4a36-86b1-d48452d53088 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.472061 Nov 27 21:08:36.875349 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2835/5787] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:36 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:37.226463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:37.227090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:37.234777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:37.235227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:37.236436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:37.236436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:37.281614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2adbed8e-3d18-4e13-8638-04ee620ae45b req-71f699f3-19fa-4738-90a4-1708b3d80369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "cef2b0c3-7e85-49c6-a464-7f8486966ae7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:37.284143 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:37.284143 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:37.294082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2adbed8e-3d18-4e13-8638-04ee620ae45b req-71f699f3-19fa-4738-90a4-1708b3d80369 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:37.295139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2adbed8e-3d18-4e13-8638-04ee620ae45b req-71f699f3-19fa-4738-90a4-1708b3d80369 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:37.313962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2adbed8e-3d18-4e13-8638-04ee620ae45b req-71f699f3-19fa-4738-90a4-1708b3d80369 service nova] Creating event network-vif-deleted:cef2b0c3-7e85-49c6-a464-7f8486966ae7 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:37.321017 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2adbed8e-3d18-4e13-8638-04ee620ae45b req-71f699f3-19fa-4738-90a4-1708b3d80369 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043446 Nov 27 21:08:37.322169 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2836/5788] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:37.514071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:37.527179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:37.530517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:37.531960 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a20774cc-1f73-4546-9df5-ad7f20fcc55a tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2706 microversion: 2.32 time: 0.309646 Nov 27 21:08:37.532868 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2953/5789] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:37 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2706 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:37.892653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:37.893990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:37.903095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:37.904433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:37.905991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:37.906663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:38.148230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:38.156555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd7de3b4-fc36-43df-abcc-bc77004d3e59 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.268123 Nov 27 21:08:38.158817 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2837/5790] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:37 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:38.325543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8fa3d2fd-3b84-48d8-9c0b-115744dea827 req-56e2374a-b58b-4fea-bfde-ede7b2eaff9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-unplugged", "status": "completed", "tag": "f797bf4c-f839-40c9-aa3e-3edb0a159de8"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-unplugged", "status": "completed", "tag": "78e281c6-feff-4dc3-8b5f-015a2ed0fc39"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:38.328674 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:38.328674 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:08:38.352469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8fa3d2fd-3b84-48d8-9c0b-115744dea827 req-56e2374a-b58b-4fea-bfde-ede7b2eaff9f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:38.354473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8fa3d2fd-3b84-48d8-9c0b-115744dea827 req-56e2374a-b58b-4fea-bfde-ede7b2eaff9f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:38.377656 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8fa3d2fd-3b84-48d8-9c0b-115744dea827 req-56e2374a-b58b-4fea-bfde-ede7b2eaff9f service nova] Creating event network-vif-unplugged:f797bf4c-f839-40c9-aa3e-3edb0a159de8 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:38.378463 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8fa3d2fd-3b84-48d8-9c0b-115744dea827 req-56e2374a-b58b-4fea-bfde-ede7b2eaff9f service nova] Creating event network-vif-unplugged:78e281c6-feff-4dc3-8b5f-015a2ed0fc39 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:38.386095 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8fa3d2fd-3b84-48d8-9c0b-115744dea827 req-56e2374a-b58b-4fea-bfde-ede7b2eaff9f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.063876 Nov 27 21:08:38.388131 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2954/5791] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:38 2021] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:38.555707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:38.557134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:38.566883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:38.567653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:38.568698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:38.569369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:38.837569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:38.848023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:38.849968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:38.851180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-930625d4-fab6-4884-9796-52bef441f02c tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 2324 microversion: 2.32 time: 0.302497 Nov 27 21:08:38.851933 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2838/5792] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:38 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 2324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:39.175711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:39.176728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:39.185215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:39.185749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:39.187289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:39.187777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:39.343019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592ef09c-8fa3-4952-a2c1-8aa3bf414542", "tag": "016719dd-00d2-4489-a2b6-c05c7ea909ed"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "78e281c6-feff-4dc3-8b5f-015a2ed0fc39"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45"}, {"server_uuid": "bd06a931-046d-43fe-bcde-df2fc2cb0a30", "name": "network-vif-deleted", "tag": "f797bf4c-f839-40c9-aa3e-3edb0a159de8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:39.345149 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:39.345149 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:39.355698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:39.355910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:39.359570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:39.368728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-57b755dd-498e-450a-8fc1-cf9adc2df68d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.198456 Nov 27 21:08:39.374419 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2955/5793] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:39 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:39.383495 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] Creating event network-changed:016719dd-00d2-4489-a2b6-c05c7ea909ed for instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 on nch1-master-1 Nov 27 21:08:39.385093 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] Creating event network-vif-deleted:78e281c6-feff-4dc3-8b5f-015a2ed0fc39 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:39.385637 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] Creating event network-vif-deleted:d8df4dd9-ac96-46a1-8c31-3baa5c7f4a45 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:39.386346 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] Creating event network-vif-deleted:f797bf4c-f839-40c9-aa3e-3edb0a159de8 for instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 on nch1-master-1 Nov 27 21:08:39.394856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-6106595b-9e56-423b-a7c3-6f37e46f5477 req-a6f7fcfd-30d2-4282-b49e-28606d06b2a1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.060339 Nov 27 21:08:39.395515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2839/5794] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:39 2021] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:39.870025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:39.870677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:39.877025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:39.877508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:39.878288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:39.878724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:39.911217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:39.911702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:39.912153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lazy-loading 'fault' on Instance uuid bd06a931-046d-43fe-bcde-df2fc2cb0a30 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:39.950203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:39.959583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:39.961106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e7695cf8df749e9af62b1746e818ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03be159839446f2a47ca07f13bb552c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:39.962282 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0a2a51b-cc1d-4fc0-b702-af5d5cc8d7f6 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 200 len: 1609 microversion: 2.32 time: 0.096340 Nov 27 21:08:39.962971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2956/5795] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:39 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 1609 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:40.390411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:40.391221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:40.397921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:40.398405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:40.399246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:40.399703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:40.534860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:40.542184 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dbb22178-7e51-4642-aa50-71b0c9669dd4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.159989 Nov 27 21:08:40.542751 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2840/5796] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:40 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:40.981875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:40.982427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:40.989903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:40.990352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:40.991124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:40.991584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:41.005078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] HTTP exception thrown: Instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 could not be found. Nov 27 21:08:41.005656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Returning 404 to user: Instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:41.006468 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-96786357-0712-411e-914e-3308e0f69bc5 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 404 len: 111 microversion: 2.32 time: 0.028483 Nov 27 21:08:41.006990 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2957/5797] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:40 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:08:41.015590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f36211d-3314-4570-9c1e-8a3fc2e758d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '.version_select at 0x7f15c6a59ee0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:41.032682 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f36211d-3314-4570-9c1e-8a3fc2e758d7 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541549652" status: 204 len: 0 microversion: 2.32 time: 0.021218 Nov 27 21:08:41.033241 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2841/5798] 10.222.0.21 () {60 vars in 1258 bytes} [Sat Nov 27 21:08:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541549652 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:41.318233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e54e54f4-5d3c-4700-9fb7-8665f5ee4418 req-c9aa5b16-46a2-4c47-8ab1-572d71b4bd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af42a712-cb65-42f8-b073-c9aa8c778116", "name": "network-vif-plugged", "status": "completed", "tag": "c65eb439-cdbe-4239-9004-3a356e2f3c6f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:41.319933 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:41.319933 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:08:41.328110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e54e54f4-5d3c-4700-9fb7-8665f5ee4418 req-c9aa5b16-46a2-4c47-8ab1-572d71b4bd6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:41.328650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e54e54f4-5d3c-4700-9fb7-8665f5ee4418 req-c9aa5b16-46a2-4c47-8ab1-572d71b4bd6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:41.344427 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e54e54f4-5d3c-4700-9fb7-8665f5ee4418 req-c9aa5b16-46a2-4c47-8ab1-572d71b4bd6f service nova] Creating event network-vif-plugged:c65eb439-cdbe-4239-9004-3a356e2f3c6f for instance af42a712-cb65-42f8-b073-c9aa8c778116 on nch2-master-1 Nov 27 21:08:41.349597 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e54e54f4-5d3c-4700-9fb7-8665f5ee4418 req-c9aa5b16-46a2-4c47-8ab1-572d71b4bd6f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035410 Nov 27 21:08:41.350192 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2958/5799] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:41.559822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:41.560363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:41.567302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:41.567758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:41.568752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:41.569388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:41.711395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:41.719508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9d83be6-cec5-49fa-8d4e-e930deb7c1c9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.164346 Nov 27 21:08:41.720093 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2842/5800] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:41 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:42.738145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:42.738906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:42.746147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:42.746938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:42.748208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:42.748984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:42.945680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:42.955656 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08020fca-eee4-4ba6-8d37-cc64928e5a16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1293 microversion: 2.1 time: 0.222957 Nov 27 21:08:42.956815 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2959/5801] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:42 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1293 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:43.973221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:43.973839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:43.980653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:43.981113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:43.981932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:43.982378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:44.134151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:44.137108 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45c01eb7-2787-438e-bdc2-5cf1a08ceef9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1475 microversion: 2.1 time: 0.167625 Nov 27 21:08:44.141800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2843/5802] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:43 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1475 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:44.203206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-748283267", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:44.261247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:08:44.312052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:44.312930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:44.319278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:44.320887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:44.321708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:44.322157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:44.338794 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] HTTP exception thrown: Instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 could not be found. Nov 27 21:08:44.339435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Returning 404 to user: Instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:44.340282 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2aa7305b-2ccb-40d1-9baa-277833d69bb8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 404 len: 111 microversion: 2.1 time: 0.032019 Nov 27 21:08:44.340855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2844/5803] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:08:44 2021] DELETE /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:08:44.349203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:44.350048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] [instance: bd06a931-046d-43fe-bcde-df2fc2cb0a30] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:44.355772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:44.356347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:44.357133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:44.357574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:44.371272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] HTTP exception thrown: Instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 could not be found. Nov 27 21:08:44.371866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] Returning 404 to user: Instance bd06a931-046d-43fe-bcde-df2fc2cb0a30 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:44.372682 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f5462ef-7b24-4286-9952-4d8b77f586c8 tempest-TaggedBootDevicesTest-1441186917 tempest-TaggedBootDevicesTest-1441186917-project] 10.222.0.21 "GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30" status: 404 len: 111 microversion: 2.1 time: 0.027110 Nov 27 21:08:44.373222 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2845/5804] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:44 2021] GET /compute/v2.1/servers/bd06a931-046d-43fe-bcde-df2fc2cb0a30 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:08:44.657220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:08:44.657652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:08:44.658130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:08:44.658592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:08:44.659077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:08:44.668919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:44.669505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:44.670511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:44.671440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:44.692060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:44.697508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:44.711340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:08:44.713784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:08:44.761843 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af079cbb-c91a-4b07-8d5b-d0bc3590ef7f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562683 Nov 27 21:08:44.762712 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2960/5805] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:08:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:08:44.773545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fd51b6d-4b33-41aa-bb3e-8fced54ab7a9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:44.774125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fd51b6d-4b33-41aa-bb3e-8fced54ab7a9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:44.797532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fd51b6d-4b33-41aa-bb3e-8fced54ab7a9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:08:45.066089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.scheduler.client.report [None req-8fd51b6d-4b33-41aa-bb3e-8fced54ab7a9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Deleted allocations for instance 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f Nov 27 21:08:45.071955 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-8fd51b6d-4b33-41aa-bb3e-8fced54ab7a9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f] Instance Mapping does not exist while attempting local delete cleanup. Nov 27 21:08:45.072864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8fd51b6d-4b33-41aa-bb3e-8fced54ab7a9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f" status: 204 len: 0 microversion: 2.1 time: 0.302999 Nov 27 21:08:45.073570 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2846/5806] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:08:44 2021] DELETE /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:08:45.081603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1de1abcb-6b56-463e-b298-f4bd42a4190f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:45.082295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1de1abcb-6b56-463e-b298-f4bd42a4190f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:45.088391 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-1de1abcb-6b56-463e-b298-f4bd42a4190f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f could not be found. Nov 27 21:08:45.088979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1de1abcb-6b56-463e-b298-f4bd42a4190f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:45.089789 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1de1abcb-6b56-463e-b298-f4bd42a4190f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f" status: 404 len: 111 microversion: 2.1 time: 0.012034 Nov 27 21:08:45.090318 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2961/5807] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:45 2021] GET /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:08:45.142252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1482347773", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:45.197514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:08:45.564690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:08:45.565545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:08:45.565924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:08:45.566426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:08:45.566944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:08:45.576682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:45.577498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:45.578121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:45.578771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:45.598025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:45.603803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:45.620753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:08:45.623543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:08:45.669563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d08d6c2-7a4b-428e-99f9-fb6ca10376fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534594 Nov 27 21:08:45.675553 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2847/5808] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:08:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:08:45.680401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b3ec704-50ba-4dc3-9afa-1013a29232e3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:45.681070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b3ec704-50ba-4dc3-9afa-1013a29232e3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:45.735168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b3ec704-50ba-4dc3-9afa-1013a29232e3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:45.744891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b3ec704-50ba-4dc3-9afa-1013a29232e3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1221 microversion: 2.1 time: 0.067726 Nov 27 21:08:45.745373 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2962/5809] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:45 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:46.768606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:46.769367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:46.777939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:46.778402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:46.779198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:46.779693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:46.885309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:46.894375 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-420aaedd-b4f3-4293-95a8-d4bdec5dfa56 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1279 microversion: 2.1 time: 0.131501 Nov 27 21:08:46.895700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2848/5810] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:46 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:47.911812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:47.912422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:47.925920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:47.926597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:47.927636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:47.928713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:48.160558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-eeb3a97e-9141-48f9-8711-be1f6c7cd1ea req-d5bc3a39-d43e-4ce4-b1cd-54f074aee7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b33a307-15ed-43ab-8923-03775a9c4f27", "tag": "57a7f7e7-d7ad-4dc8-8d64-7c7d7cd57e18"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:48.163016 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:48.163016 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:48.185971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-eeb3a97e-9141-48f9-8711-be1f6c7cd1ea req-d5bc3a39-d43e-4ce4-b1cd-54f074aee7b0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:48.186670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-eeb3a97e-9141-48f9-8711-be1f6c7cd1ea req-d5bc3a39-d43e-4ce4-b1cd-54f074aee7b0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:48.198511 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-eeb3a97e-9141-48f9-8711-be1f6c7cd1ea req-d5bc3a39-d43e-4ce4-b1cd-54f074aee7b0 service nova] Creating event network-changed:57a7f7e7-d7ad-4dc8-8d64-7c7d7cd57e18 for instance 2b33a307-15ed-43ab-8923-03775a9c4f27 on nch1-master-1 Nov 27 21:08:48.204535 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-eeb3a97e-9141-48f9-8711-be1f6c7cd1ea req-d5bc3a39-d43e-4ce4-b1cd-54f074aee7b0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Nov 27 21:08:48.205144 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2849/5811] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:48.575588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:48.584001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9b6498b-fe8e-4d36-b066-fc6a7956007b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1321 microversion: 2.1 time: 0.675786 Nov 27 21:08:48.584846 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2963/5812] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:47 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:49.602475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:49.603162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:49.609264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:49.609710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:49.610480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:49.610913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:49.746141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:49.753440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c2d539bf-8f7d-4961-86f6-971c6ee42b93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1321 microversion: 2.1 time: 0.155873 Nov 27 21:08:49.754018 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2850/5813] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:49 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:50.292900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cc12bf2b-a315-425b-8981-521eb88447eb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:50.293563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cc12bf2b-a315-425b-8981-521eb88447eb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:50.304773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc12bf2b-a315-425b-8981-521eb88447eb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.305322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc12bf2b-a315-425b-8981-521eb88447eb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.306287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc12bf2b-a315-425b-8981-521eb88447eb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.306836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc12bf2b-a315-425b-8981-521eb88447eb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.353265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cc12bf2b-a315-425b-8981-521eb88447eb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments/4558af09-ac74-43cf-9df1-40c54ef24649" status: 200 len: 194 microversion: 2.20 time: 0.073705 Nov 27 21:08:50.359690 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2964/5814] 10.222.0.21 () {60 vars in 1453 bytes} [Sat Nov 27 21:08:50 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments/4558af09-ac74-43cf-9df1-40c54ef24649 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:08:50.424201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:50.424977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:50.431283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.431943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.432887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.433486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.530389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lazy-loading 'services' on Instance uuid 0b1a80e3-263a-4ff5-9417-defdda26f981 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:50.616733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4bb50cba-0402-424b-b091-7da0a2d3f51b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments/4558af09-ac74-43cf-9df1-40c54ef24649" status: 202 len: 0 microversion: 2.20 time: 0.198602 Nov 27 21:08:50.617988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2851/5815] 10.222.0.21 () {60 vars in 1456 bytes} [Sat Nov 27 21:08:50 2021] DELETE /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments/4558af09-ac74-43cf-9df1-40c54ef24649 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:08:50.630347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9f4a11f-f704-49da-bd89-e11fa8232b2c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:50.634108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9f4a11f-f704-49da-bd89-e11fa8232b2c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:50.642040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f4a11f-f704-49da-bd89-e11fa8232b2c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.642733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f4a11f-f704-49da-bd89-e11fa8232b2c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.643565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f4a11f-f704-49da-bd89-e11fa8232b2c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.644174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f4a11f-f704-49da-bd89-e11fa8232b2c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.679908 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9f4a11f-f704-49da-bd89-e11fa8232b2c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057226 Nov 27 21:08:50.680751 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2965/5816] 10.222.0.21 () {60 vars in 1342 bytes} [Sat Nov 27 21:08:50 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:08:50.771160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:50.771890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:50.778417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.778817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.780215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:50.780786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:50.934678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:50.943588 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6fa9c47e-5458-49d5-b2f4-aa4d8f26b752 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1321 microversion: 2.1 time: 0.176627 Nov 27 21:08:50.953248 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2852/5817] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:50 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:51.692261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bad854a7-eb1e-4d83-9e0b-023881ef433d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:51.693183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bad854a7-eb1e-4d83-9e0b-023881ef433d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:51.700552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bad854a7-eb1e-4d83-9e0b-023881ef433d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.701009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bad854a7-eb1e-4d83-9e0b-023881ef433d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:51.702462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bad854a7-eb1e-4d83-9e0b-023881ef433d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.702895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bad854a7-eb1e-4d83-9e0b-023881ef433d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:51.732140 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bad854a7-eb1e-4d83-9e0b-023881ef433d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043774 Nov 27 21:08:51.732739 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2966/5818] 10.222.0.21 () {60 vars in 1342 bytes} [Sat Nov 27 21:08:51 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:51.788931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:51.789553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:51.796483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.796930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:51.797699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.798128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:51.824494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:08:51.903777 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-117fad3c-a955-4e44-8d29-2d0f3bc38ae3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 204 len: 0 microversion: 2.20 time: 0.118139 Nov 27 21:08:51.904612 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2853/5819] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 21:08:51 2021] DELETE /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:51.912712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:51.913367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:51.919805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.920891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:51.921859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.922409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:51.962228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:51.962929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:51.969202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.969658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:51.970486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:51.970925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:52.114199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:52.122220 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-19ce3c1b-fb47-441d-8012-2398e0b13498 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1321 microversion: 2.1 time: 0.163856 Nov 27 21:08:52.122810 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2854/5820] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:51 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:52.339125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-07e04730-86ec-4997-ab7e-703607ac9968 req-7b9fe3a6-3b5a-467d-8ba6-b0edc8cfb1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b33a307-15ed-43ab-8923-03775a9c4f27", "name": "network-vif-plugged", "status": "completed", "tag": "57a7f7e7-d7ad-4dc8-8d64-7c7d7cd57e18"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:52.341257 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:52.341257 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:52.350457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-07e04730-86ec-4997-ab7e-703607ac9968 req-7b9fe3a6-3b5a-467d-8ba6-b0edc8cfb1fa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:52.351146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-07e04730-86ec-4997-ab7e-703607ac9968 req-7b9fe3a6-3b5a-467d-8ba6-b0edc8cfb1fa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:52.363078 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-07e04730-86ec-4997-ab7e-703607ac9968 req-7b9fe3a6-3b5a-467d-8ba6-b0edc8cfb1fa service nova] Creating event network-vif-plugged:57a7f7e7-d7ad-4dc8-8d64-7c7d7cd57e18 for instance 2b33a307-15ed-43ab-8923-03775a9c4f27 on nch1-master-1 Nov 27 21:08:52.368217 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-07e04730-86ec-4997-ab7e-703607ac9968 req-7b9fe3a6-3b5a-467d-8ba6-b0edc8cfb1fa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033567 Nov 27 21:08:52.369369 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2855/5821] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:52.455594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:52.464054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:52.466287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:52.468110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c03e0ba8-4cbb-4676-b52b-849a49ae5d4b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.559349 Nov 27 21:08:52.469398 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2967/5822] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:51 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:53.141840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:53.142448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:53.148467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:53.148932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:53.149717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:53.150343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:53.291230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:53.300366 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2666ade5-f03b-4f2c-8f18-17fddcdd41df tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1321 microversion: 2.1 time: 0.164179 Nov 27 21:08:53.300941 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2856/5823] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:53 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:53.487329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:53.488700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:53.496172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:53.496634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:53.497563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:53.498008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:53.752614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:53.761727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:53.763670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:53.765058 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e3518b0a-9a95-4069-bff5-76bc9d7d8907 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1721 microversion: 2.20 time: 0.281503 Nov 27 21:08:53.765765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2968/5824] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:53 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:54.317228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:54.317929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:54.325371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:54.326033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:54.327552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:54.328131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:54.662251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:54.672925 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9d36ef9-0302-4f46-9e98-5c0a9dc2df47 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1502 microversion: 2.1 time: 0.359169 Nov 27 21:08:54.673746 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2857/5825] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:54 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:54.692160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:54.693081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:54.702464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:54.703654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:54.705497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:54.706579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:54.784974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:54.785939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:54.792494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:54.793363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:54.794349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:54.794987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:54.900194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:54.911463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:54.913382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:54.916831 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-44685574-8db4-4e78-b7fc-501b571a996a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 200 len: 1654 microversion: 2.20 time: 0.134781 Nov 27 21:08:54.928863 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2858/5826] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:54 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:08:54.972449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d8299ab4-07b6-424f-a3f1-d6688216015f req-4e81bc2d-1ab1-4e6c-9449-a6f226f4e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1a80e3-263a-4ff5-9417-defdda26f981", "name": "network-vif-deleted", "tag": "6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:54.974910 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:54.974910 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:54.990641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d8299ab4-07b6-424f-a3f1-d6688216015f req-4e81bc2d-1ab1-4e6c-9449-a6f226f4e0e4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:54.991470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d8299ab4-07b6-424f-a3f1-d6688216015f req-4e81bc2d-1ab1-4e6c-9449-a6f226f4e0e4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:55.005655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d8299ab4-07b6-424f-a3f1-d6688216015f req-4e81bc2d-1ab1-4e6c-9449-a6f226f4e0e4 service nova] Creating event network-vif-deleted:6cab4853-1ac5-4ae0-b99c-8fa7c79f44b9 for instance 0b1a80e3-263a-4ff5-9417-defdda26f981 on nch1-master-1 Nov 27 21:08:55.011713 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d8299ab4-07b6-424f-a3f1-d6688216015f req-4e81bc2d-1ab1-4e6c-9449-a6f226f4e0e4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053705 Nov 27 21:08:55.017956 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2859/5827] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:55.078182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:55.087950 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-226b0db9-5e59-4eee-af6a-c5eab5aee153 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1502 microversion: 2.1 time: 0.402048 Nov 27 21:08:55.092737 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2969/5828] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:54 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:55.108062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:55.108988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:55.131589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:55.132907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:55.135427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:55.142236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:55.177391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:08:55.309937 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e0fdbe4-28f2-4fcc-9ce3-b92eadaac5b7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 204 len: 0 microversion: 2.1 time: 0.207416 Nov 27 21:08:55.314663 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2860/5829] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:08:55 2021] DELETE /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:08:55.319891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:55.320748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:55.327017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:55.327770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:55.328734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:55.329187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:55.539595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:55.550073 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7216ae0e-09e1-4ce0-b72a-5c7081e94e9b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1508 microversion: 2.1 time: 0.233505 Nov 27 21:08:55.561151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2970/5830] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:55 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:55.935408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:55.936669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:55.943759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:55.944212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:55.945003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:55.945440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:55.960048 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] HTTP exception thrown: Instance 0b1a80e3-263a-4ff5-9417-defdda26f981 could not be found. Nov 27 21:08:55.960645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Returning 404 to user: Instance 0b1a80e3-263a-4ff5-9417-defdda26f981 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:55.961469 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4bdebb73-30c5-44ab-a197-7d08cc8005a9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 404 len: 111 microversion: 2.20 time: 0.030314 Nov 27 21:08:55.962019 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2861/5831] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:08:55 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:08:55.970476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efe5d337-efd4-4965-8909-69cd4051e76b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '.version_select at 0x7f15d94864c0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:55.992128 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-efe5d337-efd4-4965-8909-69cd4051e76b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622378582" status: 204 len: 0 microversion: 2.20 time: 0.025370 Nov 27 21:08:55.992724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2971/5832] 10.222.0.21 () {60 vars in 1258 bytes} [Sat Nov 27 21:08:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622378582 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 27 21:08:56.568177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:56.568844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:56.575068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:56.575795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:56.576704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:56.577387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:56.735537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f6a98bb-fb27-4cac-9702-97a81e2664ed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'create', calling method: .version_select at 0x7f15d951a9d0>, body: {"keypair": {"name": "tempest-keypair-1578393137"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:56.754770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3f6a98bb-fb27-4cac-9702-97a81e2664ed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:56.760424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3f6a98bb-fb27-4cac-9702-97a81e2664ed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for user 67ee436ffe774a1eb71cdb910112c7eb and project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:56.768064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:56.776974 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64ec354e-08ab-4edc-99eb-2dc998be534e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1508 microversion: 2.1 time: 0.211985 Nov 27 21:08:56.778065 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2862/5833] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:56 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:57.069023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3f6a98bb-fb27-4cac-9702-97a81e2664ed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:57.074699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-3f6a98bb-fb27-4cac-9702-97a81e2664ed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for user 67ee436ffe774a1eb71cdb910112c7eb and project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:57.091019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f6a98bb-fb27-4cac-9702-97a81e2664ed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.360146 Nov 27 21:08:57.095416 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2972/5834] 10.222.0.21 () {62 vars in 1198 bytes} [Sat Nov 27 21:08:56 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 365 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:08:57.293322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7ab66619-cffd-4847-9488-dc9863d6681c req-45bb3f97-6aa0-42ce-8d78-0d9f4c639b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b33a307-15ed-43ab-8923-03775a9c4f27", "name": "network-vif-deleted", "tag": "57a7f7e7-d7ad-4dc8-8d64-7c7d7cd57e18"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:57.294953 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:08:57.294953 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:08:57.315740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7ab66619-cffd-4847-9488-dc9863d6681c req-45bb3f97-6aa0-42ce-8d78-0d9f4c639b5d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:57.316472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7ab66619-cffd-4847-9488-dc9863d6681c req-45bb3f97-6aa0-42ce-8d78-0d9f4c639b5d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:57.330271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7ab66619-cffd-4847-9488-dc9863d6681c req-45bb3f97-6aa0-42ce-8d78-0d9f4c639b5d service nova] Creating event network-vif-deleted:57a7f7e7-d7ad-4dc8-8d64-7c7d7cd57e18 for instance 2b33a307-15ed-43ab-8923-03775a9c4f27 on nch1-master-1 Nov 27 21:08:57.338222 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7ab66619-cffd-4847-9488-dc9863d6681c req-45bb3f97-6aa0-42ce-8d78-0d9f4c639b5d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047934 Nov 27 21:08:57.340105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2863/5835] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:08:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:57.795731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:57.796160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:57.803577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:57.804035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:57.804960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:57.805408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:57.868639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:57.869714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:57.869714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lazy-loading 'fault' on Instance uuid 2b33a307-15ed-43ab-8923-03775a9c4f27 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:08:57.917457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:08:57.928990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16f49f7c-d4e3-4e35-86f0-849f7f028aaf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 200 len: 1311 microversion: 2.1 time: 0.138228 Nov 27 21:08:57.929878 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2973/5836] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:57 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:08:58.948706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:58.949260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:08:58.956048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:58.956775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:58.958035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:08:58.958481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:08:58.979593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 2b33a307-15ed-43ab-8923-03775a9c4f27 could not be found. Nov 27 21:08:58.980193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 2b33a307-15ed-43ab-8923-03775a9c4f27 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:08:58.981035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1dbb347a-2913-4e0b-9753-5a7ea833ae8c tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 404 len: 111 microversion: 2.1 time: 0.037654 Nov 27 21:08:58.981596 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2864/5837] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:08:58 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:08:58.992338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c73ab8f-2407-41e4-b20c-30f37eb8cc70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: .version_select at 0x7f15d4637790>, body: {"keypair": {"name": "tempest-key-277808027"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:59.010296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5c73ab8f-2407-41e4-b20c-30f37eb8cc70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:59.016738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5c73ab8f-2407-41e4-b20c-30f37eb8cc70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:59.224169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5c73ab8f-2407-41e4-b20c-30f37eb8cc70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:08:59.230288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5c73ab8f-2407-41e4-b20c-30f37eb8cc70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:08:59.246939 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c73ab8f-2407-41e4-b20c-30f37eb8cc70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2296 microversion: 2.1 time: 0.258263 Nov 27 21:08:59.249080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2974/5838] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:08:58 2021] POST /compute/v2.1/os-keypairs => generated 2296 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:08:59.260171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7086b2dd-173b-405a-9cff-0641d87c6fb0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '.version_select at 0x7f15c6b3ca60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:08:59.263240 ncdv-master-1 devstack@n-api.service[135679]: WARNING oslo_db.sqlalchemy.utils [None req-7086b2dd-173b-405a-9cff-0641d87c6fb0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 27 21:08:59.270908 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7086b2dd-173b-405a-9cff-0641d87c6fb0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/os-keypairs" status: 200 len: 544 microversion: 2.1 time: 0.016432 Nov 27 21:08:59.271825 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2865/5839] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 21:08:59 2021] GET /compute/v2.1/os-keypairs => generated 544 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:08:59.392916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-687910354", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "key_name": "tempest-key-277808027", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:08:59.457903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:09:00.000271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-182121451", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e625b12a-b3fa-4ce9-b29c-1debf46798ed"}], "security_groups": [{"name": "tempest-securitygroup--911929656"}], "key_name": "tempest-keypair-1578393137", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:00.141522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] validate_networks() for [('e625b12a-b3fa-4ce9-b29c-1debf46798ed', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:09:00.294599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:09:00.295244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:09:00.295605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:09:00.296017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:09:00.296793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:09:00.306493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:00.307209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:00.308272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:00.308718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:00.329153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:00.335846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:00.354336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:09:00.357909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:09:00.418235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4410f7df-dd80-4f4b-9603-c76ff13af5f2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028720 Nov 27 21:09:00.419626 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2975/5840] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:08:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:09:00.430929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1f7a925-f426-49c1-afa4-69b061ecfc6d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:00.431871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1f7a925-f426-49c1-afa4-69b061ecfc6d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:00.515866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f1f7a925-f426-49c1-afa4-69b061ecfc6d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:00.524344 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1f7a925-f426-49c1-afa4-69b061ecfc6d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1227 microversion: 2.1 time: 0.097297 Nov 27 21:09:00.529551 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2976/5841] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:00 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1227 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:01.280510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:09:01.281050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:09:01.281567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:09:01.282059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:09:01.282537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:09:01.293675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:01.294490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:01.295435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:01.296285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:01.317745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:01.325463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Getting quotas for user 67ee436ffe774a1eb71cdb910112c7eb and project 4b756ba4e580446980b973ad0b42b9fe. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:01.339763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:09:01.342636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:09:01.406167 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0c3c1c79-bd21-4c79-8eac-70e502469548 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.410069 Nov 27 21:09:01.411689 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2866/5842] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 21:08:59 2021] POST /compute/v2.1/servers => generated 401 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 21:09:01.416823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03baa69c-6001-4623-bbff-9fa9ec69c28d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:01.418153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03baa69c-6001-4623-bbff-9fa9ec69c28d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:01.487717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03baa69c-6001-4623-bbff-9fa9ec69c28d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:01.499733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03baa69c-6001-4623-bbff-9fa9ec69c28d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:01.501584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03baa69c-6001-4623-bbff-9fa9ec69c28d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:01.503344 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03baa69c-6001-4623-bbff-9fa9ec69c28d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1281 microversion: 2.20 time: 0.090075 Nov 27 21:09:01.504729 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2977/5843] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:01 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:09:01.547642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:01.547642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:01.558315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:01.559006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:01.561003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:01.572758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:01.718062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:01.730019 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0526f11-e8b7-4ab7-9977-4269f194cba7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1287 microversion: 2.1 time: 0.187771 Nov 27 21:09:01.730862 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2867/5844] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:01 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:02.522300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:02.522833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:02.530359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:02.531001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:02.532026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:02.532732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:02.629730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:02.639955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:02.641534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:02.642885 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2116ce9b-a3b9-45e3-a4aa-7f7af86cf69b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1333 microversion: 2.20 time: 0.124744 Nov 27 21:09:02.648032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2978/5845] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:02 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1333 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:09:02.749597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:02.752985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:02.774444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:02.775130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:02.777051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:02.780397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:03.168019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:03.181522 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0b2f3b7-4c7f-4db0-8348-f4575b88719a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1327 microversion: 2.1 time: 0.436187 Nov 27 21:09:03.189418 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2868/5846] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:02 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1327 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:03.664746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:03.665423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:03.676775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:03.677513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:03.678557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:03.679224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:03.991459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:04.011951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:04.021511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:04.026479 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a413aab4-f061-47b4-9005-0bed66db616d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.365543 Nov 27 21:09:04.027959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2979/5847] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:03 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:04.175989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-dca6b3c9-31ff-4e5a-b3cd-5aa371c31cee req-ca81ea0d-ee18-416b-bed9-b0eac1278be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbdbdc2-32aa-43ad-a84e-8bfc71c774df", "tag": "83bff958-9bb0-4501-9714-e585a1134cb7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:04.178314 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:04.178314 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:04.191664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dca6b3c9-31ff-4e5a-b3cd-5aa371c31cee req-ca81ea0d-ee18-416b-bed9-b0eac1278be3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:04.192161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dca6b3c9-31ff-4e5a-b3cd-5aa371c31cee req-ca81ea0d-ee18-416b-bed9-b0eac1278be3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:04.215882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10f8cc00-90df-40d7-91ca-19bf6a39ac38 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'create', calling method: .version_select at 0x7f15c6afe940>, body: {"keypair": {"name": "tempest-keypair-344527965"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:04.229933 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-dca6b3c9-31ff-4e5a-b3cd-5aa371c31cee req-ca81ea0d-ee18-416b-bed9-b0eac1278be3 service nova] Creating event network-changed:83bff958-9bb0-4501-9714-e585a1134cb7 for instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df on nch1-master-1 Nov 27 21:09:04.236645 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-dca6b3c9-31ff-4e5a-b3cd-5aa371c31cee req-ca81ea0d-ee18-416b-bed9-b0eac1278be3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065205 Nov 27 21:09:04.238171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-10f8cc00-90df-40d7-91ca-19bf6a39ac38 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:04.241788 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2980/5848] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:09:04.255653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:04.257430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-10f8cc00-90df-40d7-91ca-19bf6a39ac38 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for user 43d9798c04074bc9ac45eb33bf3adb46 and project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:04.259587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:04.276055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:04.276435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:04.277230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:04.279587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:04.526574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-10f8cc00-90df-40d7-91ca-19bf6a39ac38 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:04.533914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-10f8cc00-90df-40d7-91ca-19bf6a39ac38 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for user 43d9798c04074bc9ac45eb33bf3adb46 and project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:04.555467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10f8cc00-90df-40d7-91ca-19bf6a39ac38 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.527187 Nov 27 21:09:04.562310 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2869/5849] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:09:04 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:04.620515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:04.631759 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b2b3753-a964-46d7-b2d8-57cca837d6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1327 microversion: 2.1 time: 0.387799 Nov 27 21:09:04.643277 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2981/5850] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:04 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1327 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:04.789544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1f9beb7d-2837-444d-b7c5-e92cb6e129b4 req-4aa2d5ea-27fe-414d-8743-043777e3e214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:04.791090 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:04.791090 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:09:04.809777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1f9beb7d-2837-444d-b7c5-e92cb6e129b4 req-4aa2d5ea-27fe-414d-8743-043777e3e214 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:04.811826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1f9beb7d-2837-444d-b7c5-e92cb6e129b4 req-4aa2d5ea-27fe-414d-8743-043777e3e214 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:04.853375 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1f9beb7d-2837-444d-b7c5-e92cb6e129b4 req-4aa2d5ea-27fe-414d-8743-043777e3e214 service nova] Creating event network-changed:9b807251-334b-4d12-8574-592e43e94490 for instance b8df0f80-255e-416b-b79a-4bed627485da on nch2-master-1 Nov 27 21:09:04.867131 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1f9beb7d-2837-444d-b7c5-e92cb6e129b4 req-4aa2d5ea-27fe-414d-8743-043777e3e214 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081900 Nov 27 21:09:04.867859 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2870/5851] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:05.048431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:05.049132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:05.058031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:05.059065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:05.060141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:05.060793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:05.651222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:05.651432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:05.652255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:05.660923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:05.662106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:05.662538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:05.665488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:05.665673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:05.667426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:05.669843 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dcbd9c62-bc50-4357-a896-131b590df557 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.627754 Nov 27 21:09:05.670402 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2982/5852] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:05 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:06.016392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:06.030116 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ab8d376-80c4-452f-83c7-aea39e5f2584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1327 microversion: 2.1 time: 0.384379 Nov 27 21:09:06.030712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2871/5853] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:05 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1327 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:06.688412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:06.689027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:06.696182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:06.696632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:06.697456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:06.697911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:06.865781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:06.874881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:06.876980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:06.878418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d015088-bf06-428d-81c5-28a9dc98f677 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.193813 Nov 27 21:09:06.892705 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2983/5854] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:06 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:07.048880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:07.050908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:07.057265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:07.057792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:07.058876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:07.059448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:07.134125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-835107629", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07546b02-5ee2-4818-98ab-2b9b50e1991f"}], "security_groups": [{"name": "tempest-securitygroup--1394110461"}], "key_name": "tempest-keypair-344527965", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:07.212043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:07.219813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f10774e-3b3f-4c0e-8aa4-5aed993f3584 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1327 microversion: 2.1 time: 0.177414 Nov 27 21:09:07.225584 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2872/5855] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:07 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:07.244331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] validate_networks() for [('07546b02-5ee2-4818-98ab-2b9b50e1991f', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:09:07.641018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:09:07.641447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:09:07.641920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:09:07.642329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:09:07.642738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:09:07.654940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:07.655443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:07.656431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:07.657040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:07.676202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:07.682229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for user 43d9798c04074bc9ac45eb33bf3adb46 and project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:07.697965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:09:07.700355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:09:07.745630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e330ee03-8216-4f5f-a975-5d0f9dfaf4f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.615929 Nov 27 21:09:07.746505 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2984/5856] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:09:07 2021] POST /compute/v2.1/servers => generated 409 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:09:07.756880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b69a1455-a669-4153-bb3c-2f7db3f7700a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:07.757525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b69a1455-a669-4153-bb3c-2f7db3f7700a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:07.811031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b69a1455-a669-4153-bb3c-2f7db3f7700a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:07.819779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b69a1455-a669-4153-bb3c-2f7db3f7700a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1237 microversion: 2.1 time: 0.066342 Nov 27 21:09:07.820377 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2873/5857] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:07 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:07.899103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:07.899777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:07.906624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:07.907085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:07.907914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:07.908357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:08.051389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:08.059548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:08.061184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:08.062290 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4328890-a60b-409f-9fb6-1f60456fe728 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.166925 Nov 27 21:09:08.062866 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2985/5858] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:07 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:08.237018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:08.237625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:08.245495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:08.245946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:08.246729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:08.247169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:08.390236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:08.397613 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46b08912-8158-4398-b413-d8090512690f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1327 microversion: 2.1 time: 0.164272 Nov 27 21:09:08.398193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2874/5859] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:08 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:08.465539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0595091d-996d-4b34-ad29-28b51f7fc392 req-8e1194cc-430e-428c-a3be-3cc8e47aa311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbdbdc2-32aa-43ad-a84e-8bfc71c774df", "name": "network-vif-plugged", "status": "completed", "tag": "83bff958-9bb0-4501-9714-e585a1134cb7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:08.467823 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:08.467823 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:08.476150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0595091d-996d-4b34-ad29-28b51f7fc392 req-8e1194cc-430e-428c-a3be-3cc8e47aa311 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:08.476710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0595091d-996d-4b34-ad29-28b51f7fc392 req-8e1194cc-430e-428c-a3be-3cc8e47aa311 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:08.488441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0595091d-996d-4b34-ad29-28b51f7fc392 req-8e1194cc-430e-428c-a3be-3cc8e47aa311 service nova] Creating event network-vif-plugged:83bff958-9bb0-4501-9714-e585a1134cb7 for instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df on nch1-master-1 Nov 27 21:09:08.493577 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0595091d-996d-4b34-ad29-28b51f7fc392 req-8e1194cc-430e-428c-a3be-3cc8e47aa311 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031686 Nov 27 21:09:08.494229 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2986/5860] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:08.836918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:08.837562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:08.843997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:08.844458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:08.845317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:08.845690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:08.954159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:08.961777 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d533cf7-5c26-4c28-93dc-5aa9efd3c799 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1297 microversion: 2.1 time: 0.128601 Nov 27 21:09:08.962496 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2875/5861] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:08 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:09.081320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:09.082015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:09.088352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:09.088836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:09.089652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:09.090111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:09.233111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:09.241120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:09.242616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:09.243743 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0c0a293b-5905-4ccc-8ab1-471cfddded7c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.167336 Nov 27 21:09:09.244308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2987/5862] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:09 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:09.415573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:09.416190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:09.429628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:09.430048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:09.430879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:09.431344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:09.974872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:09.979496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:09.980396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:09.982673 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3942007f-4143-4af8-a651-d412498b7fd7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1327 microversion: 2.1 time: 0.571084 Nov 27 21:09:09.991879 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2876/5863] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:09 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1327 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:09.996675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:09.997230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:09.998149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:09.998597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:10.129485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:10.136884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30390b48-73ba-4e86-a894-c8f190c2c272 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1363 microversion: 2.1 time: 0.161169 Nov 27 21:09:10.137660 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2988/5864] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:09 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:10.262069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:10.262701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:10.274858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:10.275538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:10.276150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:10.276598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:10.499782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ffb3b343-1cb1-41d4-9888-89c6cc160098 req-5b442010-a9e8-49ab-8688-77c21864d298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:10.502149 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:10.502149 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:10.509714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ffb3b343-1cb1-41d4-9888-89c6cc160098 req-5b442010-a9e8-49ab-8688-77c21864d298 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:10.510157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ffb3b343-1cb1-41d4-9888-89c6cc160098 req-5b442010-a9e8-49ab-8688-77c21864d298 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:10.530158 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ffb3b343-1cb1-41d4-9888-89c6cc160098 req-5b442010-a9e8-49ab-8688-77c21864d298 service nova] Creating event network-changed:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:09:10.535398 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ffb3b343-1cb1-41d4-9888-89c6cc160098 req-5b442010-a9e8-49ab-8688-77c21864d298 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039982 Nov 27 21:09:10.537209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:10.537727 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2989/5865] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:10.550167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:10.551941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:10.553069 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca40a08d-86a0-4bcc-bdd9-17541d767e06 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.295060 Nov 27 21:09:10.553629 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2877/5866] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:10 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:11.000178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:11.000785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:11.006912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.007397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.008185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.008623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.146728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:11.153479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:11.154631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:11.155555 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd7acbd0-9128-4f69-879f-ee94acf62e16 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1509 microversion: 2.1 time: 0.159444 Nov 27 21:09:11.156542 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2990/5867] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:10 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:11.160597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.161054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.162165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.162889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.173000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:11.173939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:11.180955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.181409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.182234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.182676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.315392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:11.325987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e217e5cc-6de1-4537-97ef-1c85907db8c0 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1509 microversion: 2.1 time: 0.157419 Nov 27 21:09:11.326583 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2991/5868] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:11 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:11.344813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:11.345315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:11.351569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.352021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.353009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.353624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.360456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:11.367985 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad35b00c-882a-4337-8a3d-2c96157d15ea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1363 microversion: 2.1 time: 0.217955 Nov 27 21:09:11.368595 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2878/5869] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:11 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:11.390094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:09:11.492930 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e264a244-4007-4303-a918-34937055ca62 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 204 len: 0 microversion: 2.1 time: 0.152413 Nov 27 21:09:11.494029 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2992/5870] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:09:11 2021] DELETE /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:09:11.502704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:11.503355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:11.510623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.510623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.511440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.511800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.534252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9c8c9fd4-2256-43c1-adbf-1e4f000bd141 req-d8d65e48-222f-48e9-b719-c7d73294a3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "name": "network-vif-plugged", "status": "completed", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:11.541618 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:11.541618 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:11.549672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9c8c9fd4-2256-43c1-adbf-1e4f000bd141 req-d8d65e48-222f-48e9-b719-c7d73294a3d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.550414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9c8c9fd4-2256-43c1-adbf-1e4f000bd141 req-d8d65e48-222f-48e9-b719-c7d73294a3d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.562639 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9c8c9fd4-2256-43c1-adbf-1e4f000bd141 req-d8d65e48-222f-48e9-b719-c7d73294a3d2 service nova] Creating event network-vif-plugged:9b807251-334b-4d12-8574-592e43e94490 for instance b8df0f80-255e-416b-b79a-4bed627485da on nch2-master-1 Nov 27 21:09:11.569746 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9c8c9fd4-2256-43c1-adbf-1e4f000bd141 req-d8d65e48-222f-48e9-b719-c7d73294a3d2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043380 Nov 27 21:09:11.570451 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2993/5871] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:11.577302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:11.578821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:11.585813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.586584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.588751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:11.589405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:11.686637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:11.694049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da7bcecf-f04e-4efb-a27f-6e9ed19de5ee tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1515 microversion: 2.1 time: 0.195576 Nov 27 21:09:11.694619 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2879/5872] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:11 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:11.793568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:11.801579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:11.803110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:11.804252 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b79caba5-43df-47cb-a37e-2c9fa5a6b875 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.232025 Nov 27 21:09:11.804825 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2994/5873] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:11 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:12.385333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:12.385948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:12.391955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:12.392414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:12.393203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:12.393647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:12.538034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:12.545897 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e645d4a4-9866-4167-8270-9bcbd0f553ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1363 microversion: 2.1 time: 0.164307 Nov 27 21:09:12.546463 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2880/5874] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:12 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:12.711709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:12.712316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:12.719805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:12.720252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:12.721030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:12.721465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:12.830870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:12.833632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:12.842426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:12.843396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:12.844762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:12.845311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:12.857906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:12.865584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97bacdb4-b9f3-4626-93fd-9e57256e239b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1515 microversion: 2.1 time: 0.157505 Nov 27 21:09:12.874369 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2995/5875] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:12 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:12.984071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:12.993392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:12.995151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:12.996545 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f18da6f-3bbd-41f0-a177-726f3babf1d9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1406 microversion: 2.20 time: 0.178174 Nov 27 21:09:12.997097 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2881/5876] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:12 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:09:13.522543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ed8d978e-1692-4ea0-bb64-47a1f8aeb392 req-a704ba87-1608-4884-a12e-f5f5f4ae73e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbdbdc2-32aa-43ad-a84e-8bfc71c774df", "name": "network-vif-deleted", "tag": "83bff958-9bb0-4501-9714-e585a1134cb7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:13.524114 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:13.524114 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:13.534426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ed8d978e-1692-4ea0-bb64-47a1f8aeb392 req-a704ba87-1608-4884-a12e-f5f5f4ae73e9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:13.535410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ed8d978e-1692-4ea0-bb64-47a1f8aeb392 req-a704ba87-1608-4884-a12e-f5f5f4ae73e9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:13.548111 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ed8d978e-1692-4ea0-bb64-47a1f8aeb392 req-a704ba87-1608-4884-a12e-f5f5f4ae73e9 service nova] Creating event network-vif-deleted:83bff958-9bb0-4501-9714-e585a1134cb7 for instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df on nch1-master-1 Nov 27 21:09:13.553285 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ed8d978e-1692-4ea0-bb64-47a1f8aeb392 req-a704ba87-1608-4884-a12e-f5f5f4ae73e9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 Nov 27 21:09:13.554245 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2996/5877] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:13.563445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:13.564063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:13.573763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:13.574225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:13.575026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:13.576374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:13.715525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:13.723581 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7495e0e-32e6-4297-b722-7cb6950870b6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1363 microversion: 2.1 time: 0.165239 Nov 27 21:09:13.724154 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2882/5878] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:13 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:13.883174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:13.883839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:13.890528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:13.890980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:13.891784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:13.892223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:13.923380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:13.923838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:13.924287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lazy-loading 'fault' on Instance uuid 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:09:13.965830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:13.973397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41ef385f-4d52-4e02-a10a-1b173c804c65 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 200 len: 1317 microversion: 2.1 time: 0.095202 Nov 27 21:09:13.973981 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2997/5879] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:13 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 1317 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:14.015093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:14.015769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:14.022952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.023451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.024253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.024705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.167556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:14.177447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:14.179040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:14.180270 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9ab07b5-89f2-41b0-b4fe-c21d3f22a906 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1598 microversion: 2.20 time: 0.169558 Nov 27 21:09:14.180837 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2883/5880] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:09:14 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:14.197875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-470cf560-cf79-44b0-a9a4-d27f332b170b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:14.198587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-470cf560-cf79-44b0-a9a4-d27f332b170b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:14.205000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-470cf560-cf79-44b0-a9a4-d27f332b170b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.205456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-470cf560-cf79-44b0-a9a4-d27f332b170b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.206236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-470cf560-cf79-44b0-a9a4-d27f332b170b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.206679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-470cf560-cf79-44b0-a9a4-d27f332b170b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.297669 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-470cf560-cf79-44b0-a9a4-d27f332b170b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103432 Nov 27 21:09:14.298409 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2998/5881] 10.222.0.21 () {60 vars in 1315 bytes} [Sat Nov 27 21:09:14 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:14.397177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f932a0bb-a661-4f46-ade6-00378b013675 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:14.397675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f932a0bb-a661-4f46-ade6-00378b013675 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:14.405267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f932a0bb-a661-4f46-ade6-00378b013675 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.405806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f932a0bb-a661-4f46-ade6-00378b013675 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.407025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f932a0bb-a661-4f46-ade6-00378b013675 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.407570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f932a0bb-a661-4f46-ade6-00378b013675 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.436920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f932a0bb-a661-4f46-ade6-00378b013675 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043451 Nov 27 21:09:14.437950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2884/5882] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 21:09:14 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:14.532011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e16faa8d-52dd-484a-bc88-3f89a2ed6feb req-e194d921-5a66-4c75-bc44-7460aaaa8584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-plugged", "status": "completed", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:14.533755 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:14.533755 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:14.541111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e16faa8d-52dd-484a-bc88-3f89a2ed6feb req-e194d921-5a66-4c75-bc44-7460aaaa8584 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.541563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e16faa8d-52dd-484a-bc88-3f89a2ed6feb req-e194d921-5a66-4c75-bc44-7460aaaa8584 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.556156 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e16faa8d-52dd-484a-bc88-3f89a2ed6feb req-e194d921-5a66-4c75-bc44-7460aaaa8584 service nova] Creating event network-vif-plugged:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:09:14.564100 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e16faa8d-52dd-484a-bc88-3f89a2ed6feb req-e194d921-5a66-4c75-bc44-7460aaaa8584 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035401 Nov 27 21:09:14.565054 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 2999/5883] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:14.740665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:14.741277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:14.748605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.749058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.749851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.750288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:14.889040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:14.897048 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b93b5b2f-46b0-436a-96a0-72ec1983276c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1363 microversion: 2.1 time: 0.159973 Nov 27 21:09:14.903087 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2885/5884] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:14 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:14.991324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:14.992370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:14.998926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:14.999417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.000206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.000649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.014774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df could not be found. Nov 27 21:09:15.015392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:09:15.016226 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3545663e-89a2-47fd-98b7-a4f3ffd871e4 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 404 len: 111 microversion: 2.1 time: 0.029919 Nov 27 21:09:15.016783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3000/5885] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:14 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:09:15.024780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-092ba51a-00ff-49dd-85a8-820740a8808e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '.version_select at 0x7f15c6ad03a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:15.043899 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-092ba51a-00ff-49dd-85a8-820740a8808e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-key-277808027" status: 202 len: 0 microversion: 2.1 time: 0.022700 Nov 27 21:09:15.044615 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2886/5886] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:09:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-key-277808027 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:15.092590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1294493560", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:15.145409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:09:15.548614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87575c5e-7cf3-4555-a87c-5140a3cfe425 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:15.550060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87575c5e-7cf3-4555-a87c-5140a3cfe425 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:15.556111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87575c5e-7cf3-4555-a87c-5140a3cfe425 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.556659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87575c5e-7cf3-4555-a87c-5140a3cfe425 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.557527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87575c5e-7cf3-4555-a87c-5140a3cfe425 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.558057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87575c5e-7cf3-4555-a87c-5140a3cfe425 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.599773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87575c5e-7cf3-4555-a87c-5140a3cfe425 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.055710 Nov 27 21:09:15.600632 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2887/5887] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:15 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:15.605412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c30003a6-b15d-466f-bfd6-7d1ecbc2d627 req-fa6f4d82-0349-4bad-aec4-671aeef0fb06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:15.607536 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:15.607536 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:09:15.615700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c30003a6-b15d-466f-bfd6-7d1ecbc2d627 req-fa6f4d82-0349-4bad-aec4-671aeef0fb06 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.616231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c30003a6-b15d-466f-bfd6-7d1ecbc2d627 req-fa6f4d82-0349-4bad-aec4-671aeef0fb06 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.627807 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c30003a6-b15d-466f-bfd6-7d1ecbc2d627 req-fa6f4d82-0349-4bad-aec4-671aeef0fb06 service nova] Creating event network-changed:9b807251-334b-4d12-8574-592e43e94490 for instance b8df0f80-255e-416b-b79a-4bed627485da on nch2-master-1 Nov 27 21:09:15.632713 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c30003a6-b15d-466f-bfd6-7d1ecbc2d627 req-fa6f4d82-0349-4bad-aec4-671aeef0fb06 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030908 Nov 27 21:09:15.633591 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2888/5888] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:15.707467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:09:15.708084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:09:15.708570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:09:15.708983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:09:15.709529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:09:15.719625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.720078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.720950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.721389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.738813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:15.744669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:15.757599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:09:15.760192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:09:15.821652 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05ab5e06-6ca4-44e1-91b3-0027131fa644 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733269 Nov 27 21:09:15.823131 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3001/5889] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:09:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:09:15.834510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72427454-f3b4-4886-ac63-de67cd8e2045 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:15.835816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-72427454-f3b4-4886-ac63-de67cd8e2045 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:15.909415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-72427454-f3b4-4886-ac63-de67cd8e2045 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:15.917626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:15.918378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:15.928899 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72427454-f3b4-4886-ac63-de67cd8e2045 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1209 microversion: 2.1 time: 0.098615 Nov 27 21:09:15.930809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.931558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2889/5890] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:15 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:15.932087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:15.932997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:15.933827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:16.456885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:16.468196 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21a5bec3-c0c2-4b88-a7d3-79ba39a9e969 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1363 microversion: 2.1 time: 0.556574 Nov 27 21:09:16.469421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3002/5891] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:15 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1363 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:16.610132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0fb40bed-c3cf-40a1-a4da-d84e6de23d65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:16.611745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0fb40bed-c3cf-40a1-a4da-d84e6de23d65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:16.620113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb40bed-c3cf-40a1-a4da-d84e6de23d65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:16.620889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb40bed-c3cf-40a1-a4da-d84e6de23d65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:16.621886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb40bed-c3cf-40a1-a4da-d84e6de23d65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:16.622874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb40bed-c3cf-40a1-a4da-d84e6de23d65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:16.668434 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0fb40bed-c3cf-40a1-a4da-d84e6de23d65 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.061404 Nov 27 21:09:16.669158 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2890/5892] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:16 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:16.949452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:16.950119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:16.958290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:16.958826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:16.960178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:16.960626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:17.033612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:17.043727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-afd2f391-70c9-43a5-b707-6eb20eebe744 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1269 microversion: 2.1 time: 0.098986 Nov 27 21:09:17.044358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3003/5893] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:16 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:17.487433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:17.488133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:17.498348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:17.498979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:17.499796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:17.500237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:17.679326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-deeffb50-76cb-4b0f-95de-77df8ef83872 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:17.680549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-deeffb50-76cb-4b0f-95de-77df8ef83872 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:17.686690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-deeffb50-76cb-4b0f-95de-77df8ef83872 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:17.687139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-deeffb50-76cb-4b0f-95de-77df8ef83872 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:17.687957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-deeffb50-76cb-4b0f-95de-77df8ef83872 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:17.688391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-deeffb50-76cb-4b0f-95de-77df8ef83872 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:17.730402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-deeffb50-76cb-4b0f-95de-77df8ef83872 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.054774 Nov 27 21:09:17.731140 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3004/5894] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:17 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:17.748203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:17.755842 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6a36741-0ed8-46d8-9ba4-62554af39d92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1550 microversion: 2.1 time: 0.273137 Nov 27 21:09:17.756413 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2891/5895] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:17 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1550 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:17.773252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c62f931-c369-48e4-b748-695e9a7dd26b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:17.773830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c62f931-c369-48e4-b748-695e9a7dd26b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:17.781321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c62f931-c369-48e4-b748-695e9a7dd26b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:17.781759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c62f931-c369-48e4-b748-695e9a7dd26b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:17.782536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c62f931-c369-48e4-b748-695e9a7dd26b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:17.782972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c62f931-c369-48e4-b748-695e9a7dd26b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:17.866372 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c62f931-c369-48e4-b748-695e9a7dd26b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097290 Nov 27 21:09:17.866977 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3005/5896] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:09:17 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:18.061526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:18.062197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:18.069862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.070324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.071131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.071614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.295405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:18.308260 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd042930-8077-40dd-b090-c03f9e982757 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1309 microversion: 2.1 time: 0.249856 Nov 27 21:09:18.309079 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2892/5897] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:18 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:18.391391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-db66650f-42b3-402d-9789-07e559938426 req-c494f152-9cc3-4d18-b116-d3c019d7289a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aaaa739-f790-4ad2-b74b-e1ff685f5c72", "tag": "3cebccf3-7178-4836-8f8c-41022c7e9c06"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:18.406257 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:18.406257 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:18.414384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-db66650f-42b3-402d-9789-07e559938426 req-c494f152-9cc3-4d18-b116-d3c019d7289a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.414857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-db66650f-42b3-402d-9789-07e559938426 req-c494f152-9cc3-4d18-b116-d3c019d7289a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.433289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-db66650f-42b3-402d-9789-07e559938426 req-c494f152-9cc3-4d18-b116-d3c019d7289a service nova] Creating event network-changed:3cebccf3-7178-4836-8f8c-41022c7e9c06 for instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 on nch1-master-1 Nov 27 21:09:18.438987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-db66650f-42b3-402d-9789-07e559938426 req-c494f152-9cc3-4d18-b116-d3c019d7289a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064326 Nov 27 21:09:18.440141 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3006/5898] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:18.742153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c181bdba-c203-4307-b021-589c05a21428 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:18.743298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c181bdba-c203-4307-b021-589c05a21428 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:18.751435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c181bdba-c203-4307-b021-589c05a21428 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.752151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c181bdba-c203-4307-b021-589c05a21428 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.752928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c181bdba-c203-4307-b021-589c05a21428 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.753478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c181bdba-c203-4307-b021-589c05a21428 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.791491 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c181bdba-c203-4307-b021-589c05a21428 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.052951 Nov 27 21:09:18.795756 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2893/5899] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:18 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:18.878642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-34a867d0-163f-4e4a-9b0e-c7db9a316246 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:18.879696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-34a867d0-163f-4e4a-9b0e-c7db9a316246 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:18.881012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-29e57afd-4477-4373-ace0-6350b0d24371 req-a16ac032-240a-4d97-8b5b-46ce727f22d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:18.882858 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:18.882858 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:09:18.888877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34a867d0-163f-4e4a-9b0e-c7db9a316246 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.889340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34a867d0-163f-4e4a-9b0e-c7db9a316246 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.890144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34a867d0-163f-4e4a-9b0e-c7db9a316246 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.890590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34a867d0-163f-4e4a-9b0e-c7db9a316246 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.891066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-29e57afd-4477-4373-ace0-6350b0d24371 req-a16ac032-240a-4d97-8b5b-46ce727f22d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:18.891543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-29e57afd-4477-4373-ace0-6350b0d24371 req-a16ac032-240a-4d97-8b5b-46ce727f22d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:18.903040 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-29e57afd-4477-4373-ace0-6350b0d24371 req-a16ac032-240a-4d97-8b5b-46ce727f22d2 service nova] Creating event network-changed:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:09:18.908335 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-29e57afd-4477-4373-ace0-6350b0d24371 req-a16ac032-240a-4d97-8b5b-46ce727f22d2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031171 Nov 27 21:09:18.909183 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2894/5900] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:09:18.950519 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-34a867d0-163f-4e4a-9b0e-c7db9a316246 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.076467 Nov 27 21:09:18.952989 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3007/5901] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:18 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:19.327438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:19.328445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:19.335276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:19.335977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:19.336779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:19.337394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:19.593280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:19.602840 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f3e29305-cbfa-46be-89fd-c77c19c65412 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1309 microversion: 2.1 time: 0.279410 Nov 27 21:09:19.612395 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2895/5902] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:19 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:19.803650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e405c957-f48c-4726-861a-8d9a8dce9b26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:19.804692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e405c957-f48c-4726-861a-8d9a8dce9b26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:19.812281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e405c957-f48c-4726-861a-8d9a8dce9b26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:19.812726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e405c957-f48c-4726-861a-8d9a8dce9b26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:19.813509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e405c957-f48c-4726-861a-8d9a8dce9b26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:19.813946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e405c957-f48c-4726-861a-8d9a8dce9b26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:19.853579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e405c957-f48c-4726-861a-8d9a8dce9b26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.053875 Nov 27 21:09:19.854231 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3008/5903] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:19 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:19.962084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f0df9831-2700-4443-bed9-c669ac04724b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:19.963159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f0df9831-2700-4443-bed9-c669ac04724b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:19.971057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df9831-2700-4443-bed9-c669ac04724b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:19.971591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df9831-2700-4443-bed9-c669ac04724b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:19.972397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df9831-2700-4443-bed9-c669ac04724b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:19.972846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0df9831-2700-4443-bed9-c669ac04724b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:20.014618 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f0df9831-2700-4443-bed9-c669ac04724b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.056046 Nov 27 21:09:20.017654 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2896/5904] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:19 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:20.619123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:20.620105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:20.627869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:20.628255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:20.629024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:20.629493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:20.761617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:20.769208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-efd67294-dedc-4d96-b6e4-0eff90e61ef7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1309 microversion: 2.1 time: 0.154124 Nov 27 21:09:20.769857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3009/5905] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:20 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:20.867604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b689d3f8-5642-4f18-9786-c188eb5eab2e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:20.868764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b689d3f8-5642-4f18-9786-c188eb5eab2e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:20.878190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b689d3f8-5642-4f18-9786-c188eb5eab2e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:20.878569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b689d3f8-5642-4f18-9786-c188eb5eab2e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:20.879398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b689d3f8-5642-4f18-9786-c188eb5eab2e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:20.879840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b689d3f8-5642-4f18-9786-c188eb5eab2e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:20.917622 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b689d3f8-5642-4f18-9786-c188eb5eab2e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.055239 Nov 27 21:09:20.918247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2897/5906] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:20 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:21.025666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a69ded7-c7fc-4acf-b98e-9a42b6af3d07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:21.026585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a69ded7-c7fc-4acf-b98e-9a42b6af3d07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:21.034643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a69ded7-c7fc-4acf-b98e-9a42b6af3d07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:21.035092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a69ded7-c7fc-4acf-b98e-9a42b6af3d07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:21.035891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a69ded7-c7fc-4acf-b98e-9a42b6af3d07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:21.036327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a69ded7-c7fc-4acf-b98e-9a42b6af3d07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:21.073084 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a69ded7-c7fc-4acf-b98e-9a42b6af3d07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.051316 Nov 27 21:09:21.073789 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3010/5907] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:21 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:21.786451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:21.787147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:21.794297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:21.794751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:21.795558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:21.795994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:21.930142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6700459a-33a3-4aec-8fc6-1abe894b8ba2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:21.931174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6700459a-33a3-4aec-8fc6-1abe894b8ba2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:21.931530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:21.938133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6700459a-33a3-4aec-8fc6-1abe894b8ba2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:21.938579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6700459a-33a3-4aec-8fc6-1abe894b8ba2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:21.939046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abea2ef6-d186-476b-a1c7-73f53ed1bbe1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1309 microversion: 2.1 time: 0.156836 Nov 27 21:09:21.939378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6700459a-33a3-4aec-8fc6-1abe894b8ba2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:21.939805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2898/5908] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:21 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:21.939954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6700459a-33a3-4aec-8fc6-1abe894b8ba2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:21.976603 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6700459a-33a3-4aec-8fc6-1abe894b8ba2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.050570 Nov 27 21:09:21.977233 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3011/5909] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:21 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:22.083879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a3df999-3c47-461d-95ae-7383c1e672b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:22.084805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a3df999-3c47-461d-95ae-7383c1e672b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:22.091856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3df999-3c47-461d-95ae-7383c1e672b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:22.092317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3df999-3c47-461d-95ae-7383c1e672b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:22.093098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3df999-3c47-461d-95ae-7383c1e672b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:22.093550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a3df999-3c47-461d-95ae-7383c1e672b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:22.132468 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a3df999-3c47-461d-95ae-7383c1e672b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.052197 Nov 27 21:09:22.133084 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2899/5910] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:22 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:22.678889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fb5b99b7-ae72-47df-9927-d6355deeaa4f req-7ba967bf-103f-4492-8260-8f95b14cc202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aaaa739-f790-4ad2-b74b-e1ff685f5c72", "name": "network-vif-plugged", "status": "completed", "tag": "3cebccf3-7178-4836-8f8c-41022c7e9c06"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:22.680410 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:22.680410 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:22.690530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fb5b99b7-ae72-47df-9927-d6355deeaa4f req-7ba967bf-103f-4492-8260-8f95b14cc202 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:22.690999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fb5b99b7-ae72-47df-9927-d6355deeaa4f req-7ba967bf-103f-4492-8260-8f95b14cc202 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:22.701272 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fb5b99b7-ae72-47df-9927-d6355deeaa4f req-7ba967bf-103f-4492-8260-8f95b14cc202 service nova] Creating event network-vif-plugged:3cebccf3-7178-4836-8f8c-41022c7e9c06 for instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 on nch1-master-1 Nov 27 21:09:22.705917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fb5b99b7-ae72-47df-9927-d6355deeaa4f req-7ba967bf-103f-4492-8260-8f95b14cc202 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031029 Nov 27 21:09:22.706505 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3012/5911] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:22.956799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:22.957417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:22.964710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:22.965181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:22.966499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:22.966942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:22.988564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97fdcfdd-dbf8-4c74-b376-cff3a48361d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:22.989600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97fdcfdd-dbf8-4c74-b376-cff3a48361d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:22.996598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fdcfdd-dbf8-4c74-b376-cff3a48361d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:22.997056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fdcfdd-dbf8-4c74-b376-cff3a48361d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:22.997843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fdcfdd-dbf8-4c74-b376-cff3a48361d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:22.998285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97fdcfdd-dbf8-4c74-b376-cff3a48361d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:23.035081 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97fdcfdd-dbf8-4c74-b376-cff3a48361d1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.050428 Nov 27 21:09:23.035772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3013/5912] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:22 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:23.099596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:23.107533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ea3f4ab-6530-4a66-bb61-b4abbcf24b61 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1309 microversion: 2.1 time: 0.154896 Nov 27 21:09:23.108104 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2900/5913] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:22 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:23.143572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3aa4a84-0dda-40f9-a85b-15ab61a6da0a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:23.144573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d3aa4a84-0dda-40f9-a85b-15ab61a6da0a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:23.151432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3aa4a84-0dda-40f9-a85b-15ab61a6da0a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:23.151886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3aa4a84-0dda-40f9-a85b-15ab61a6da0a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:23.152662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3aa4a84-0dda-40f9-a85b-15ab61a6da0a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:23.153594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3aa4a84-0dda-40f9-a85b-15ab61a6da0a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:23.193313 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3aa4a84-0dda-40f9-a85b-15ab61a6da0a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.053688 Nov 27 21:09:23.194080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3014/5914] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:23 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:24.045696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6079fc29-93be-4f03-9c96-828f3171befb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:24.046624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6079fc29-93be-4f03-9c96-828f3171befb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:24.054104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6079fc29-93be-4f03-9c96-828f3171befb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.054559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6079fc29-93be-4f03-9c96-828f3171befb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.055365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6079fc29-93be-4f03-9c96-828f3171befb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.055806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6079fc29-93be-4f03-9c96-828f3171befb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.091615 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6079fc29-93be-4f03-9c96-828f3171befb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.050211 Nov 27 21:09:24.092209 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2901/5915] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:24 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:24.124548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:24.125266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:24.132589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.133045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.133822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.134264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.204668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a68e419f-0465-4cca-b848-eae940682e9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:24.205706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a68e419f-0465-4cca-b848-eae940682e9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:24.212566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a68e419f-0465-4cca-b848-eae940682e9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.213022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a68e419f-0465-4cca-b848-eae940682e9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.213802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a68e419f-0465-4cca-b848-eae940682e9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.214248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a68e419f-0465-4cca-b848-eae940682e9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.255121 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a68e419f-0465-4cca-b848-eae940682e9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.054325 Nov 27 21:09:24.255785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2902/5916] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:24 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:09:24.266688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:24.274117 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5ccd61f-2267-4de2-9aea-76fd2b2befc8 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1490 microversion: 2.1 time: 0.154523 Nov 27 21:09:24.274688 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3015/5917] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:24 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1490 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:24.328040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1294493560", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:24.380178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:09:24.795596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:09:24.796050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:09:24.796527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:09:24.796939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:09:24.797353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:09:24.806849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.807330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.808154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:24.808592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:24.825960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:24.830898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:24.844901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:09:24.847368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:09:24.891559 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dac3342f-2a98-41ed-a489-3f75fad6affa tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567436 Nov 27 21:09:24.892210 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2903/5918] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:09:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:09:24.901893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41228400-8dd4-464b-b65c-4a6368af0317 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:24.902503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41228400-8dd4-464b-b65c-4a6368af0317 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:24.959039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41228400-8dd4-464b-b65c-4a6368af0317 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:24.967179 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41228400-8dd4-464b-b65c-4a6368af0317 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1209 microversion: 2.1 time: 0.068919 Nov 27 21:09:24.967781 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3016/5919] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:24 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1209 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:25.102922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3847f989-9e9d-4b87-832a-3f9509d75468 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:25.103954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3847f989-9e9d-4b87-832a-3f9509d75468 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:25.113573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3847f989-9e9d-4b87-832a-3f9509d75468 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:25.114030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3847f989-9e9d-4b87-832a-3f9509d75468 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:25.114825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3847f989-9e9d-4b87-832a-3f9509d75468 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:25.115285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3847f989-9e9d-4b87-832a-3f9509d75468 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:25.154957 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3847f989-9e9d-4b87-832a-3f9509d75468 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 14 microversion: 2.20 time: 0.056456 Nov 27 21:09:25.155899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2904/5920] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:25 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:25.266444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ffa00797-18a9-4aed-8638-af6b99ba2116 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:25.267409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ffa00797-18a9-4aed-8638-af6b99ba2116 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:25.274435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa00797-18a9-4aed-8638-af6b99ba2116 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:25.274892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa00797-18a9-4aed-8638-af6b99ba2116 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:25.275741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa00797-18a9-4aed-8638-af6b99ba2116 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:25.276213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa00797-18a9-4aed-8638-af6b99ba2116 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:25.315888 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ffa00797-18a9-4aed-8638-af6b99ba2116 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.053429 Nov 27 21:09:25.318924 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3017/5921] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:25 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:25.985501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:25.986129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:25.993362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:25.993821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:25.994885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:25.995351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:26.061883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:26.070141 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-deb560c5-6e75-4c9f-b042-5395308d01d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1269 microversion: 2.1 time: 0.089473 Nov 27 21:09:26.071091 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2905/5922] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:25 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:26.166358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-54667590-26cf-4b5f-9cdd-725246d42424 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:26.167401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-54667590-26cf-4b5f-9cdd-725246d42424 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:26.174953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54667590-26cf-4b5f-9cdd-725246d42424 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:26.175677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54667590-26cf-4b5f-9cdd-725246d42424 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:26.176390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54667590-26cf-4b5f-9cdd-725246d42424 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:26.176828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54667590-26cf-4b5f-9cdd-725246d42424 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:26.224697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-54667590-26cf-4b5f-9cdd-725246d42424 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 8207 microversion: 2.20 time: 0.062234 Nov 27 21:09:26.226136 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3018/5923] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:26 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 8207 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:09:26.326463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2268508c-dbb6-4ef4-b0b4-1dc6f2ebbf9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:26.327442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2268508c-dbb6-4ef4-b0b4-1dc6f2ebbf9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:26.334239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2268508c-dbb6-4ef4-b0b4-1dc6f2ebbf9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:26.334938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2268508c-dbb6-4ef4-b0b4-1dc6f2ebbf9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:26.335606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2268508c-dbb6-4ef4-b0b4-1dc6f2ebbf9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:26.336084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2268508c-dbb6-4ef4-b0b4-1dc6f2ebbf9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:26.375764 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2268508c-dbb6-4ef4-b0b4-1dc6f2ebbf9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.053303 Nov 27 21:09:26.378751 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2906/5924] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:26 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:27.089029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:27.090708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:27.098305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:27.099410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:27.100366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:27.100947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:27.236988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b8261a7-f412-4d66-9de5-4fdc8cef19db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:27.238011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b8261a7-f412-4d66-9de5-4fdc8cef19db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:27.245226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b8261a7-f412-4d66-9de5-4fdc8cef19db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:27.245690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b8261a7-f412-4d66-9de5-4fdc8cef19db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:27.246487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b8261a7-f412-4d66-9de5-4fdc8cef19db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:27.247514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b8261a7-f412-4d66-9de5-4fdc8cef19db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:27.295496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:27.302054 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b8261a7-f412-4d66-9de5-4fdc8cef19db tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 16401 microversion: 2.20 time: 0.069068 Nov 27 21:09:27.303053 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2907/5925] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:27 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 16401 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:27.304729 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e1d714f2-65a9-4409-9468-9b97ac553bfd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1309 microversion: 2.1 time: 0.220129 Nov 27 21:09:27.307507 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3019/5926] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:27 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:27.366408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f82d0a68-168f-458f-89cd-dd1c90c74884 req-303a7ce0-cbed-4ab9-8d0a-77456dbd78df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef7d071-5d70-464d-a1e3-8e0844b6efcd", "tag": "0da0019f-9627-48fb-9cfe-b9251e3872ff"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:27.368679 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:27.368679 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:09:27.378090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f82d0a68-168f-458f-89cd-dd1c90c74884 req-303a7ce0-cbed-4ab9-8d0a-77456dbd78df service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:27.378547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f82d0a68-168f-458f-89cd-dd1c90c74884 req-303a7ce0-cbed-4ab9-8d0a-77456dbd78df service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:27.393070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52f75008-963e-4622-941b-2498d05ef811 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:27.394095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52f75008-963e-4622-941b-2498d05ef811 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:27.396268 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f82d0a68-168f-458f-89cd-dd1c90c74884 req-303a7ce0-cbed-4ab9-8d0a-77456dbd78df service nova] Creating event network-changed:0da0019f-9627-48fb-9cfe-b9251e3872ff for instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd on nch2-master-1 Nov 27 21:09:27.401573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52f75008-963e-4622-941b-2498d05ef811 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:27.401980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f82d0a68-168f-458f-89cd-dd1c90c74884 req-303a7ce0-cbed-4ab9-8d0a-77456dbd78df service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040178 Nov 27 21:09:27.402619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52f75008-963e-4622-941b-2498d05ef811 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:27.403504 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2908/5927] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:27.404333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52f75008-963e-4622-941b-2498d05ef811 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:27.404974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52f75008-963e-4622-941b-2498d05ef811 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:27.451711 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52f75008-963e-4622-941b-2498d05ef811 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.062371 Nov 27 21:09:27.454750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3020/5928] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:27 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:28.314698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-051df00f-de65-4d35-b733-3dcb6706b7af tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:28.315749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-051df00f-de65-4d35-b733-3dcb6706b7af tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:28.322331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051df00f-de65-4d35-b733-3dcb6706b7af tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:28.322784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051df00f-de65-4d35-b733-3dcb6706b7af tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:28.323630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051df00f-de65-4d35-b733-3dcb6706b7af tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:28.324070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-051df00f-de65-4d35-b733-3dcb6706b7af tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:28.324200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:28.325359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:28.332752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:28.333207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:28.333992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:28.334433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:28.368884 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-051df00f-de65-4d35-b733-3dcb6706b7af tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 16401 microversion: 2.20 time: 0.058588 Nov 27 21:09:28.370318 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2909/5929] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:28 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 16401 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:28.462565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6bb3be3-8bb3-4b91-9ad1-406689e309af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:28.463613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6bb3be3-8bb3-4b91-9ad1-406689e309af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:28.470971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6bb3be3-8bb3-4b91-9ad1-406689e309af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:28.471465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6bb3be3-8bb3-4b91-9ad1-406689e309af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:28.472263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6bb3be3-8bb3-4b91-9ad1-406689e309af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:28.472733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6bb3be3-8bb3-4b91-9ad1-406689e309af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:28.473479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:28.481036 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d911d8cc-efc6-4c53-b6a3-fa97512c0b84 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1309 microversion: 2.1 time: 0.160788 Nov 27 21:09:28.481538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3021/5930] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:28 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:28.519332 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6bb3be3-8bb3-4b91-9ad1-406689e309af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 14 microversion: 2.1 time: 0.060783 Nov 27 21:09:28.519950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2910/5931] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:28 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:09:29.380562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-198b60c2-7087-464e-998e-6fc275929665 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:29.381394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-198b60c2-7087-464e-998e-6fc275929665 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:29.389246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-198b60c2-7087-464e-998e-6fc275929665 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:29.389693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-198b60c2-7087-464e-998e-6fc275929665 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:29.390464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-198b60c2-7087-464e-998e-6fc275929665 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:29.390895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-198b60c2-7087-464e-998e-6fc275929665 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:29.432492 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-198b60c2-7087-464e-998e-6fc275929665 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 16401 microversion: 2.20 time: 0.055589 Nov 27 21:09:29.433372 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3022/5932] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:29 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 16401 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:29.498399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:29.499090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:29.506500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:29.506951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:29.507751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:29.508185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:29.530906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac66e548-eb75-4d2d-bec1-6aaf02e474d7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:29.532083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac66e548-eb75-4d2d-bec1-6aaf02e474d7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:29.539045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac66e548-eb75-4d2d-bec1-6aaf02e474d7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:29.539527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac66e548-eb75-4d2d-bec1-6aaf02e474d7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:29.540307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac66e548-eb75-4d2d-bec1-6aaf02e474d7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:29.540747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac66e548-eb75-4d2d-bec1-6aaf02e474d7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:29.589037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac66e548-eb75-4d2d-bec1-6aaf02e474d7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 8205 microversion: 2.1 time: 0.062591 Nov 27 21:09:29.589904 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3023/5933] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:29 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 8205 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:29.642195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:29.649970 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebeb60f0-4a43-4e18-9507-98fcc8089481 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1309 microversion: 2.1 time: 0.155936 Nov 27 21:09:29.650518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2911/5934] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:29 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:30.443909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e38b3b70-9c72-4536-9b62-7481a4d2f530 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:30.444840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e38b3b70-9c72-4536-9b62-7481a4d2f530 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:30.452273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e38b3b70-9c72-4536-9b62-7481a4d2f530 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:30.452733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e38b3b70-9c72-4536-9b62-7481a4d2f530 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:30.453512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e38b3b70-9c72-4536-9b62-7481a4d2f530 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:30.453953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e38b3b70-9c72-4536-9b62-7481a4d2f530 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:30.490760 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e38b3b70-9c72-4536-9b62-7481a4d2f530 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 16401 microversion: 2.20 time: 0.051015 Nov 27 21:09:30.491417 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3024/5935] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:30 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 16401 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:30.601069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c6e11fc8-a3a2-4eb6-8825-7058b9e6e708 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:30.601999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c6e11fc8-a3a2-4eb6-8825-7058b9e6e708 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:30.610356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6e11fc8-a3a2-4eb6-8825-7058b9e6e708 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:30.610897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6e11fc8-a3a2-4eb6-8825-7058b9e6e708 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:30.611643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6e11fc8-a3a2-4eb6-8825-7058b9e6e708 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:30.612086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6e11fc8-a3a2-4eb6-8825-7058b9e6e708 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:30.658557 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c6e11fc8-a3a2-4eb6-8825-7058b9e6e708 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 16398 microversion: 2.1 time: 0.062044 Nov 27 21:09:30.659200 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2912/5936] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:30 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 16398 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:30.667389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:30.668092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:30.675658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:30.676169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:30.676944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:30.677383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:30.806060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:30.813736 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e692e3fd-0679-4c7c-9f07-18b51506be13 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1309 microversion: 2.1 time: 0.150360 Nov 27 21:09:30.814308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3025/5937] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:30 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1309 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:31.502981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46edd3d7-4367-46d7-ba24-c2cb5dcd1630 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:31.504084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46edd3d7-4367-46d7-ba24-c2cb5dcd1630 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:31.511085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46edd3d7-4367-46d7-ba24-c2cb5dcd1630 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:31.511599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46edd3d7-4367-46d7-ba24-c2cb5dcd1630 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:31.512343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46edd3d7-4367-46d7-ba24-c2cb5dcd1630 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:31.512786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46edd3d7-4367-46d7-ba24-c2cb5dcd1630 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:31.565302 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46edd3d7-4367-46d7-ba24-c2cb5dcd1630 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.066227 Nov 27 21:09:31.566174 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2913/5938] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:31 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:31.670373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b3918dc-df24-477f-b4ed-308fa57cf542 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:31.671269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b3918dc-df24-477f-b4ed-308fa57cf542 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:31.678849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3918dc-df24-477f-b4ed-308fa57cf542 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:31.679329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3918dc-df24-477f-b4ed-308fa57cf542 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:31.680131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3918dc-df24-477f-b4ed-308fa57cf542 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:31.680574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b3918dc-df24-477f-b4ed-308fa57cf542 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:31.720011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b3918dc-df24-477f-b4ed-308fa57cf542 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 16398 microversion: 2.1 time: 0.053760 Nov 27 21:09:31.720658 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3026/5939] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:31 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 16398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:31.830410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:31.831291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:31.841200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:31.841665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:31.842500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:31.842956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:31.984649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:31.992045 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e11f97f2-178b-4877-aa55-60d8bb1805d6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1309 microversion: 2.1 time: 0.165903 Nov 27 21:09:31.992621 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2914/5940] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:31 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:32.577797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c903367-6341-4b7f-9e9b-c837cfe941bb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:32.578826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c903367-6341-4b7f-9e9b-c837cfe941bb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:32.585803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c903367-6341-4b7f-9e9b-c837cfe941bb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:32.586257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c903367-6341-4b7f-9e9b-c837cfe941bb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:32.587068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c903367-6341-4b7f-9e9b-c837cfe941bb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:32.587530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c903367-6341-4b7f-9e9b-c837cfe941bb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:32.628405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c903367-6341-4b7f-9e9b-c837cfe941bb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055121 Nov 27 21:09:32.629037 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3027/5941] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:32 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:32.731188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f474e35d-4a0b-4834-95a3-c18d3e28bb7f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:32.732104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f474e35d-4a0b-4834-95a3-c18d3e28bb7f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:32.738463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f474e35d-4a0b-4834-95a3-c18d3e28bb7f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:32.738915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f474e35d-4a0b-4834-95a3-c18d3e28bb7f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:32.739719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f474e35d-4a0b-4834-95a3-c18d3e28bb7f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:32.740161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f474e35d-4a0b-4834-95a3-c18d3e28bb7f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:32.779718 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f474e35d-4a0b-4834-95a3-c18d3e28bb7f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 16398 microversion: 2.1 time: 0.052090 Nov 27 21:09:32.780340 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2915/5942] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:32 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 16398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:33.008869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:33.009556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:33.017443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:33.017896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:33.018668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:33.019098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:33.149787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:33.157630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b55edc9-4b6d-42a3-808b-b299077eb974 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1309 microversion: 2.1 time: 0.152855 Nov 27 21:09:33.158197 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3028/5943] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:33 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:33.580412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-490df534-166a-4037-b056-e65ff3a92020 req-fd0a733d-51f0-4924-8964-ab0b78c74872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef7d071-5d70-464d-a1e3-8e0844b6efcd", "name": "network-vif-plugged", "status": "completed", "tag": "0da0019f-9627-48fb-9cfe-b9251e3872ff"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:33.581915 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:33.581915 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:09:33.590557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-490df534-166a-4037-b056-e65ff3a92020 req-fd0a733d-51f0-4924-8964-ab0b78c74872 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:33.591016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-490df534-166a-4037-b056-e65ff3a92020 req-fd0a733d-51f0-4924-8964-ab0b78c74872 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:33.602442 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-490df534-166a-4037-b056-e65ff3a92020 req-fd0a733d-51f0-4924-8964-ab0b78c74872 service nova] Creating event network-vif-plugged:0da0019f-9627-48fb-9cfe-b9251e3872ff for instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd on nch2-master-1 Nov 27 21:09:33.607738 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-490df534-166a-4037-b056-e65ff3a92020 req-fd0a733d-51f0-4924-8964-ab0b78c74872 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 Nov 27 21:09:33.608588 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2916/5944] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:33.641075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5512e2c3-0526-4469-b4e3-133532d0b3a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:33.642015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5512e2c3-0526-4469-b4e3-133532d0b3a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:33.657830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5512e2c3-0526-4469-b4e3-133532d0b3a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:33.658289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5512e2c3-0526-4469-b4e3-133532d0b3a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:33.659151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5512e2c3-0526-4469-b4e3-133532d0b3a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:33.659622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5512e2c3-0526-4469-b4e3-133532d0b3a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:33.698944 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5512e2c3-0526-4469-b4e3-133532d0b3a3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.062430 Nov 27 21:09:33.699767 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3029/5945] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:33 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:33.791345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f78853c-5f42-4d63-8f05-afbe8101c08f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:33.792366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f78853c-5f42-4d63-8f05-afbe8101c08f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:33.798456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f78853c-5f42-4d63-8f05-afbe8101c08f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:33.798904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f78853c-5f42-4d63-8f05-afbe8101c08f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:33.799725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f78853c-5f42-4d63-8f05-afbe8101c08f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:33.800162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f78853c-5f42-4d63-8f05-afbe8101c08f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:33.840236 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f78853c-5f42-4d63-8f05-afbe8101c08f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 16398 microversion: 2.1 time: 0.053348 Nov 27 21:09:33.841066 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2917/5946] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:33 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 16398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:34.174327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:34.175058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:34.182437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:34.182896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:34.183715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:34.184167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:34.321884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:34.329868 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3886053-9906-4309-bb55-519a927e7826 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1309 microversion: 2.1 time: 0.159672 Nov 27 21:09:34.330437 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3030/5947] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:34 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:34.711175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca353b6d-69e8-428f-a222-dc9549f16713 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:34.712154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca353b6d-69e8-428f-a222-dc9549f16713 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:34.719499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca353b6d-69e8-428f-a222-dc9549f16713 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:34.719958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca353b6d-69e8-428f-a222-dc9549f16713 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:34.720744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca353b6d-69e8-428f-a222-dc9549f16713 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:34.721183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca353b6d-69e8-428f-a222-dc9549f16713 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:34.767891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca353b6d-69e8-428f-a222-dc9549f16713 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.060888 Nov 27 21:09:34.768513 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2918/5948] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:34 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:34.852076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-24de9001-b665-4979-95a2-77f5af2dcbff tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:34.852989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-24de9001-b665-4979-95a2-77f5af2dcbff tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:34.859899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24de9001-b665-4979-95a2-77f5af2dcbff tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:34.860341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24de9001-b665-4979-95a2-77f5af2dcbff tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:34.861112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24de9001-b665-4979-95a2-77f5af2dcbff tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:34.861547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24de9001-b665-4979-95a2-77f5af2dcbff tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:34.901670 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-24de9001-b665-4979-95a2-77f5af2dcbff tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 16398 microversion: 2.1 time: 0.053163 Nov 27 21:09:34.902533 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3031/5949] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:34 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 16398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:35.347009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:35.347744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:35.354772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.355231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.356037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.356478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.485607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:35.493412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe139327-77f4-4292-b85e-31dbdce23cdf tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1491 microversion: 2.1 time: 0.150477 Nov 27 21:09:35.493978 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2919/5950] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:35 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1491 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:35.510059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:35.510852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:35.518639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.519083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.519957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.520393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.653549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:35.661252 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b83d5036-a839-455a-8c64-250a58f971fc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1490 microversion: 2.1 time: 0.155253 Nov 27 21:09:35.661825 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3032/5951] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:35 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1490 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:35.676872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:35.677518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:35.683891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.684616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.685927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.686391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.779411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-edfdb240-00ae-461b-903c-8b888fe9be0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:35.780331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-edfdb240-00ae-461b-903c-8b888fe9be0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:35.786625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfdb240-00ae-461b-903c-8b888fe9be0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.787077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfdb240-00ae-461b-903c-8b888fe9be0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.787913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfdb240-00ae-461b-903c-8b888fe9be0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.788351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edfdb240-00ae-461b-903c-8b888fe9be0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.817459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:35.824882 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf88afbe-0549-4347-8c4f-ed0ee9845a93 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1491 microversion: 2.1 time: 0.151722 Nov 27 21:09:35.826108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2920/5952] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:35 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1491 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:35.839429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-edfdb240-00ae-461b-903c-8b888fe9be0b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.063769 Nov 27 21:09:35.840352 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3033/5953] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:35 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:35.841413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:35.841914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:35.847802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.848262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.849047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.849492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.874099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:09:35.914110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5089f92-c9b1-4385-ba4b-77e220f0dd3f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:35.915112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5089f92-c9b1-4385-ba4b-77e220f0dd3f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:35.922082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5089f92-c9b1-4385-ba4b-77e220f0dd3f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.922538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5089f92-c9b1-4385-ba4b-77e220f0dd3f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.923336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5089f92-c9b1-4385-ba4b-77e220f0dd3f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.923785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5089f92-c9b1-4385-ba4b-77e220f0dd3f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.951411 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a350325a-760e-4eae-a2da-09e3199a9845 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 204 len: 0 microversion: 2.1 time: 0.112507 Nov 27 21:09:35.952029 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2921/5954] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:09:35 2021] DELETE /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:09:35.960383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:35.961074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:35.966937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.967436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.968214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:35.968654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:35.980495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5089f92-c9b1-4385-ba4b-77e220f0dd3f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.070323 Nov 27 21:09:35.981441 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3034/5955] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:35 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:36.100960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:36.108810 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ea6f153-5cf1-4792-865b-a91b5cfe7961 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1497 microversion: 2.1 time: 0.152324 Nov 27 21:09:36.109385 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2922/5956] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:35 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:36.850523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d93bcd23-d74d-47ef-9c9f-75bc1b59cacd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:36.851559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d93bcd23-d74d-47ef-9c9f-75bc1b59cacd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:36.859336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d93bcd23-d74d-47ef-9c9f-75bc1b59cacd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:36.859799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d93bcd23-d74d-47ef-9c9f-75bc1b59cacd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:36.860627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d93bcd23-d74d-47ef-9c9f-75bc1b59cacd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:36.861065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d93bcd23-d74d-47ef-9c9f-75bc1b59cacd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:36.902221 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d93bcd23-d74d-47ef-9c9f-75bc1b59cacd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055701 Nov 27 21:09:36.902867 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3035/5957] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:36 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:36.991947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0833379-6794-40c9-9c23-b905d6ca416c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:36.992872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0833379-6794-40c9-9c23-b905d6ca416c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:36.999867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0833379-6794-40c9-9c23-b905d6ca416c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:37.000321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0833379-6794-40c9-9c23-b905d6ca416c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:37.001097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0833379-6794-40c9-9c23-b905d6ca416c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:37.001534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0833379-6794-40c9-9c23-b905d6ca416c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:37.039880 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0833379-6794-40c9-9c23-b905d6ca416c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.051442 Nov 27 21:09:37.040507 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2923/5958] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:36 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:37.126867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:37.127596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:37.134602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:37.135059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:37.135865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:37.136311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:37.268403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:37.276382 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6664e422-7a9b-4f5d-838b-1ad903bc0572 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1497 microversion: 2.1 time: 0.154123 Nov 27 21:09:37.276958 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3036/5959] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:37 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:37.923941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b30dd38-b4f7-47fe-a24b-18b3d64ac902 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:37.925348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0dc1a5da-db0d-43f6-bea3-f327a648f99c req-c0301ced-801d-425a-98d3-25f17e574ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef7d071-5d70-464d-a1e3-8e0844b6efcd", "name": "network-vif-deleted", "tag": "0da0019f-9627-48fb-9cfe-b9251e3872ff"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:37.926989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b30dd38-b4f7-47fe-a24b-18b3d64ac902 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:37.929548 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:37.929548 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:37.945136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b30dd38-b4f7-47fe-a24b-18b3d64ac902 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:37.946134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b30dd38-b4f7-47fe-a24b-18b3d64ac902 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:37.946402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b30dd38-b4f7-47fe-a24b-18b3d64ac902 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:37.946907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b30dd38-b4f7-47fe-a24b-18b3d64ac902 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:37.949073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0dc1a5da-db0d-43f6-bea3-f327a648f99c req-c0301ced-801d-425a-98d3-25f17e574ac2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:37.951548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0dc1a5da-db0d-43f6-bea3-f327a648f99c req-c0301ced-801d-425a-98d3-25f17e574ac2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:37.969430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0dc1a5da-db0d-43f6-bea3-f327a648f99c req-c0301ced-801d-425a-98d3-25f17e574ac2 service nova] Creating event network-vif-deleted:0da0019f-9627-48fb-9cfe-b9251e3872ff for instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd on nch2-master-1 Nov 27 21:09:37.979159 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0dc1a5da-db0d-43f6-bea3-f327a648f99c req-c0301ced-801d-425a-98d3-25f17e574ac2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061497 Nov 27 21:09:37.980554 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3037/5960] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:38.018910 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b30dd38-b4f7-47fe-a24b-18b3d64ac902 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.107453 Nov 27 21:09:38.019798 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2924/5961] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:37 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:38.052434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ead70491-707f-478e-bc15-85e7b5939ae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:38.053636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ead70491-707f-478e-bc15-85e7b5939ae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:38.061067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead70491-707f-478e-bc15-85e7b5939ae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:38.061523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead70491-707f-478e-bc15-85e7b5939ae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:38.062322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead70491-707f-478e-bc15-85e7b5939ae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:38.062761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead70491-707f-478e-bc15-85e7b5939ae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:38.101292 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ead70491-707f-478e-bc15-85e7b5939ae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.053375 Nov 27 21:09:38.102091 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3038/5962] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:38 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:38.293939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:38.294827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:38.301823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:38.302278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:38.303066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:38.303538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:38.336894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:38.337358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:38.337817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lazy-loading 'fault' on Instance uuid 4ef7d071-5d70-464d-a1e3-8e0844b6efcd {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:09:38.381402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:38.390589 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c630efd5-1401-4650-a227-65b4492a8938 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 200 len: 1299 microversion: 2.1 time: 0.100779 Nov 27 21:09:38.391201 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2925/5963] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:38 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:39.032666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b520f5a2-8e82-470b-accb-c6e9a0ddb43d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:39.033789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b520f5a2-8e82-470b-accb-c6e9a0ddb43d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:39.041729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b520f5a2-8e82-470b-accb-c6e9a0ddb43d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.042191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b520f5a2-8e82-470b-accb-c6e9a0ddb43d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.042982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b520f5a2-8e82-470b-accb-c6e9a0ddb43d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.043458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b520f5a2-8e82-470b-accb-c6e9a0ddb43d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.083850 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b520f5a2-8e82-470b-accb-c6e9a0ddb43d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055709 Nov 27 21:09:39.084441 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3039/5964] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:39 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:39.112024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47c9438f-2527-4f70-90e5-8ef964c1005d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:39.112987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47c9438f-2527-4f70-90e5-8ef964c1005d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:39.119965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c9438f-2527-4f70-90e5-8ef964c1005d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.120430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c9438f-2527-4f70-90e5-8ef964c1005d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.121214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c9438f-2527-4f70-90e5-8ef964c1005d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.121690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47c9438f-2527-4f70-90e5-8ef964c1005d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.161827 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47c9438f-2527-4f70-90e5-8ef964c1005d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.053392 Nov 27 21:09:39.162489 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2926/5965] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:39 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:39.410020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:39.410645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:39.417646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.418103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.418884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.419371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.433721 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd could not be found. Nov 27 21:09:39.434304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:09:39.435672 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52aa95b6-b2c3-4508-b7dd-080a2c5fe83f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 404 len: 111 microversion: 2.1 time: 0.029895 Nov 27 21:09:39.436218 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3040/5966] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:39 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:09:39.444909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:39.445506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:39.453204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.453662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.454463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.454897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.479385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:09:39.566590 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5749afd8-37f6-4748-b86c-eb2f37e135f7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 204 len: 0 microversion: 2.1 time: 0.125487 Nov 27 21:09:39.567175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2927/5967] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:09:39 2021] DELETE /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:09:39.575061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:39.576376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:39.582690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.583142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.583951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:39.584395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:39.714494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:39.721915 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7624b55e-f135-49b4-be6f-fdb163a53421 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1496 microversion: 2.1 time: 0.150553 Nov 27 21:09:39.722480 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3041/5968] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:39 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:40.096486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0c33d11-cf78-4af1-b93a-2e3550afe83f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:40.097507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a0c33d11-cf78-4af1-b93a-2e3550afe83f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:40.103903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c33d11-cf78-4af1-b93a-2e3550afe83f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:40.104360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c33d11-cf78-4af1-b93a-2e3550afe83f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:40.105142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c33d11-cf78-4af1-b93a-2e3550afe83f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:40.105585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c33d11-cf78-4af1-b93a-2e3550afe83f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:40.144770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0c33d11-cf78-4af1-b93a-2e3550afe83f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.052312 Nov 27 21:09:40.145415 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2928/5969] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:40 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:40.172824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eca1a347-209f-43d0-a4a8-c519c6114247 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:40.173845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eca1a347-209f-43d0-a4a8-c519c6114247 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:40.180665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca1a347-209f-43d0-a4a8-c519c6114247 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:40.181116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca1a347-209f-43d0-a4a8-c519c6114247 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:40.181893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca1a347-209f-43d0-a4a8-c519c6114247 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:40.182329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eca1a347-209f-43d0-a4a8-c519c6114247 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:40.222447 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eca1a347-209f-43d0-a4a8-c519c6114247 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.053162 Nov 27 21:09:40.223097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3042/5970] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:40 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:40.739539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:40.740161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:40.747958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:40.748412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:40.749198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:40.749638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:40.882076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:40.891329 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0100275-534f-495d-bd93-51ead317b15e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1496 microversion: 2.1 time: 0.155925 Nov 27 21:09:40.892022 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2929/5971] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:40 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:41.157550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1f0a63e-a8ea-4d32-87de-849a4670aa89 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:41.158581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b1f0a63e-a8ea-4d32-87de-849a4670aa89 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:41.165672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f0a63e-a8ea-4d32-87de-849a4670aa89 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.166121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f0a63e-a8ea-4d32-87de-849a4670aa89 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.166899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f0a63e-a8ea-4d32-87de-849a4670aa89 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.167368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1f0a63e-a8ea-4d32-87de-849a4670aa89 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.208751 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1f0a63e-a8ea-4d32-87de-849a4670aa89 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055761 Nov 27 21:09:41.209450 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3043/5972] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:41 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:41.234477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2567a0e8-7137-4af1-9b2f-3a044004620b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:41.235470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2567a0e8-7137-4af1-9b2f-3a044004620b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:41.245735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2567a0e8-7137-4af1-9b2f-3a044004620b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.246301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2567a0e8-7137-4af1-9b2f-3a044004620b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.247121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2567a0e8-7137-4af1-9b2f-3a044004620b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.247588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2567a0e8-7137-4af1-9b2f-3a044004620b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.286753 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2567a0e8-7137-4af1-9b2f-3a044004620b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.056467 Nov 27 21:09:41.287791 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2930/5973] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:41 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:41.560002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-19965dd7-a5bf-4e08-9067-d1ba2aa08268 req-18e8f8f4-8c90-4333-8623-7c20018c700a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aaaa739-f790-4ad2-b74b-e1ff685f5c72", "name": "network-vif-deleted", "tag": "3cebccf3-7178-4836-8f8c-41022c7e9c06"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:41.561789 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:41.561789 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:41.570981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-19965dd7-a5bf-4e08-9067-d1ba2aa08268 req-18e8f8f4-8c90-4333-8623-7c20018c700a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.571646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-19965dd7-a5bf-4e08-9067-d1ba2aa08268 req-18e8f8f4-8c90-4333-8623-7c20018c700a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.585614 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-19965dd7-a5bf-4e08-9067-d1ba2aa08268 req-18e8f8f4-8c90-4333-8623-7c20018c700a service nova] Creating event network-vif-deleted:3cebccf3-7178-4836-8f8c-41022c7e9c06 for instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 on nch1-master-1 Nov 27 21:09:41.590407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-19965dd7-a5bf-4e08-9067-d1ba2aa08268 req-18e8f8f4-8c90-4333-8623-7c20018c700a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037605 Nov 27 21:09:41.592170 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3044/5974] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:41.910303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:41.911005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:41.918092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.918545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.919359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.919804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.951523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:41.951982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:41.952437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lazy-loading 'fault' on Instance uuid 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:09:41.991987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:42.001208 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28fe721b-ad8e-4a81-9578-d35d3442d203 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 200 len: 1299 microversion: 2.1 time: 0.094949 Nov 27 21:09:42.002016 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2931/5975] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:41 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:42.222118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f44d781a-d541-4ca9-8e3a-61002d20b4d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:42.223098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f44d781a-d541-4ca9-8e3a-61002d20b4d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:42.229328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f44d781a-d541-4ca9-8e3a-61002d20b4d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:42.229769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f44d781a-d541-4ca9-8e3a-61002d20b4d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:42.230533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f44d781a-d541-4ca9-8e3a-61002d20b4d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:42.231205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f44d781a-d541-4ca9-8e3a-61002d20b4d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:42.272284 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f44d781a-d541-4ca9-8e3a-61002d20b4d3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055149 Nov 27 21:09:42.272905 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3045/5976] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:42 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:42.299022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-067a514d-cc1a-4720-a9b2-17d9d20ada0b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:42.299975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-067a514d-cc1a-4720-a9b2-17d9d20ada0b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:42.306674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-067a514d-cc1a-4720-a9b2-17d9d20ada0b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:42.307869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-067a514d-cc1a-4720-a9b2-17d9d20ada0b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:42.308779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-067a514d-cc1a-4720-a9b2-17d9d20ada0b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:42.309226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-067a514d-cc1a-4720-a9b2-17d9d20ada0b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:42.350132 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-067a514d-cc1a-4720-a9b2-17d9d20ada0b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.055936 Nov 27 21:09:42.351040 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2932/5977] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:42 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:43.019025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:43.019777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:43.026714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.027167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.028001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.028462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.042100 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 could not be found. Nov 27 21:09:43.042681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:09:43.043517 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f00609a4-5f1b-4276-93a5-e6735138a0d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 404 len: 111 microversion: 2.1 time: 0.028571 Nov 27 21:09:43.044561 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3046/5978] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:43 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:09:43.093173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-113790289", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:43.144731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:09:43.283926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f650ce28-f011-455e-a7b8-760309c312f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:43.284940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f650ce28-f011-455e-a7b8-760309c312f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:43.295474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f650ce28-f011-455e-a7b8-760309c312f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.296012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f650ce28-f011-455e-a7b8-760309c312f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.296882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f650ce28-f011-455e-a7b8-760309c312f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.297408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f650ce28-f011-455e-a7b8-760309c312f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.343327 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f650ce28-f011-455e-a7b8-760309c312f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.062876 Nov 27 21:09:43.343996 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3047/5979] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:43 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:43.362405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a62d80eb-c74a-48f7-a183-4db16d89f9aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:43.363427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a62d80eb-c74a-48f7-a183-4db16d89f9aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:43.370545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a62d80eb-c74a-48f7-a183-4db16d89f9aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.370999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a62d80eb-c74a-48f7-a183-4db16d89f9aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.371796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a62d80eb-c74a-48f7-a183-4db16d89f9aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.372235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a62d80eb-c74a-48f7-a183-4db16d89f9aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.412077 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a62d80eb-c74a-48f7-a183-4db16d89f9aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.053627 Nov 27 21:09:43.415751 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3048/5980] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:43 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:43.511552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:09:43.512032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:09:43.512450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:09:43.513366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:09:43.513783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:09:43.522586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.523038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.524088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:43.524537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:43.542191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:43.547155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:43.558947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:09:43.561404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:09:43.604972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bba07340-1ed5-4500-a7d2-273631b86693 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515801 Nov 27 21:09:43.605622 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2933/5981] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:09:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:09:43.615937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-479460bd-c47d-41d3-bce1-4a17b2449f89 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:43.616630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-479460bd-c47d-41d3-bce1-4a17b2449f89 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:43.670785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-479460bd-c47d-41d3-bce1-4a17b2449f89 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:43.678089 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-479460bd-c47d-41d3-bce1-4a17b2449f89 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1208 microversion: 2.1 time: 0.066193 Nov 27 21:09:43.678645 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3049/5982] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:43 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1208 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:44.355102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5c8f226-90f9-41f0-8e00-8f2849636687 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:44.356037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5c8f226-90f9-41f0-8e00-8f2849636687 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:44.363468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c8f226-90f9-41f0-8e00-8f2849636687 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:44.363919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c8f226-90f9-41f0-8e00-8f2849636687 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:44.364694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c8f226-90f9-41f0-8e00-8f2849636687 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:44.365133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c8f226-90f9-41f0-8e00-8f2849636687 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:44.405108 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5c8f226-90f9-41f0-8e00-8f2849636687 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.054425 Nov 27 21:09:44.406301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2934/5983] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:44 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:44.424102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-245d1f7c-0b27-4c86-a85c-fd6e037e0b1d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:44.425688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-245d1f7c-0b27-4c86-a85c-fd6e037e0b1d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:44.433045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1f7c-0b27-4c86-a85c-fd6e037e0b1d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:44.433497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1f7c-0b27-4c86-a85c-fd6e037e0b1d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:44.434404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1f7c-0b27-4c86-a85c-fd6e037e0b1d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:44.435377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-245d1f7c-0b27-4c86-a85c-fd6e037e0b1d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:44.480455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-245d1f7c-0b27-4c86-a85c-fd6e037e0b1d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.060081 Nov 27 21:09:44.481941 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3050/5984] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:44 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:44.695679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:44.696288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:44.705519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:44.705981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:44.706787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:44.707228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:44.773140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:44.782101 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea269e22-45a8-4279-99d5-bd8e1e2a9695 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1266 microversion: 2.1 time: 0.090620 Nov 27 21:09:44.782685 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2935/5985] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:44 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:45.418199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-18d1c6b7-7804-4c49-8266-cb8e4a51ab1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:45.419267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-18d1c6b7-7804-4c49-8266-cb8e4a51ab1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:45.431200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18d1c6b7-7804-4c49-8266-cb8e4a51ab1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:45.431888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18d1c6b7-7804-4c49-8266-cb8e4a51ab1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:45.432505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18d1c6b7-7804-4c49-8266-cb8e4a51ab1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:45.433238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18d1c6b7-7804-4c49-8266-cb8e4a51ab1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:45.478642 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-18d1c6b7-7804-4c49-8266-cb8e4a51ab1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.064349 Nov 27 21:09:45.479666 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3051/5986] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:45 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:45.491815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e33004ed-bb97-4358-8be4-39ab63779769 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:45.493403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e33004ed-bb97-4358-8be4-39ab63779769 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:45.500347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e33004ed-bb97-4358-8be4-39ab63779769 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:45.500819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e33004ed-bb97-4358-8be4-39ab63779769 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:45.501621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e33004ed-bb97-4358-8be4-39ab63779769 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:45.502068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e33004ed-bb97-4358-8be4-39ab63779769 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:45.547345 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e33004ed-bb97-4358-8be4-39ab63779769 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.058850 Nov 27 21:09:45.551017 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2936/5987] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:45 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:45.799973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:45.800608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:45.808052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:45.808510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:45.809300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:45.809749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:46.056356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:46.063746 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06b9aa1b-27ef-427b-91b9-84b7d3d69f76 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.267883 Nov 27 21:09:46.064506 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3052/5988] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:45 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:46.137070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-54e06623-8dfa-4d8d-b57a-27dd9a139fee req-f5676a03-2d46-4444-bb11-376f9643b3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e084ddda-4b13-4be9-8e94-cfa73ea95181", "tag": "1c3ae37b-95af-474c-9626-0f2fe55d3ff4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:46.140376 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:46.140376 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:09:46.150243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-54e06623-8dfa-4d8d-b57a-27dd9a139fee req-f5676a03-2d46-4444-bb11-376f9643b3a8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:46.150706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-54e06623-8dfa-4d8d-b57a-27dd9a139fee req-f5676a03-2d46-4444-bb11-376f9643b3a8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:46.165229 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-54e06623-8dfa-4d8d-b57a-27dd9a139fee req-f5676a03-2d46-4444-bb11-376f9643b3a8 service nova] Creating event network-changed:1c3ae37b-95af-474c-9626-0f2fe55d3ff4 for instance e084ddda-4b13-4be9-8e94-cfa73ea95181 on nch2-master-1 Nov 27 21:09:46.170461 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-54e06623-8dfa-4d8d-b57a-27dd9a139fee req-f5676a03-2d46-4444-bb11-376f9643b3a8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037345 Nov 27 21:09:46.171073 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2937/5989] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:09:46.491513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fcb5734-c0cf-4417-be5e-8190c5eeab35 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:46.492460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9fcb5734-c0cf-4417-be5e-8190c5eeab35 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:46.500909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fcb5734-c0cf-4417-be5e-8190c5eeab35 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:46.501367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fcb5734-c0cf-4417-be5e-8190c5eeab35 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:46.502153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fcb5734-c0cf-4417-be5e-8190c5eeab35 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:46.502594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fcb5734-c0cf-4417-be5e-8190c5eeab35 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:46.547965 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9fcb5734-c0cf-4417-be5e-8190c5eeab35 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.060129 Nov 27 21:09:46.548646 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3053/5990] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:46 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:46.558587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dfbe7c93-6e7a-4a54-80f2-eb7545fb0403 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:46.560208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dfbe7c93-6e7a-4a54-80f2-eb7545fb0403 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:46.567438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfbe7c93-6e7a-4a54-80f2-eb7545fb0403 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:46.567834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfbe7c93-6e7a-4a54-80f2-eb7545fb0403 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:46.568632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfbe7c93-6e7a-4a54-80f2-eb7545fb0403 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:46.569077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfbe7c93-6e7a-4a54-80f2-eb7545fb0403 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:46.609645 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dfbe7c93-6e7a-4a54-80f2-eb7545fb0403 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.054992 Nov 27 21:09:46.610521 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2938/5991] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:46 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:47.079826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:47.080515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:47.087355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:47.087799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:47.088572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:47.089004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:47.227232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:47.235273 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba8a8dae-b830-4ddc-9acb-dc90cb7279bc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.159487 Nov 27 21:09:47.235849 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3054/5992] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:47 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:47.559965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c49d1f43-cfc3-4289-b107-d1a3da55b5ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:47.561126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c49d1f43-cfc3-4289-b107-d1a3da55b5ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:47.568932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c49d1f43-cfc3-4289-b107-d1a3da55b5ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:47.569398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c49d1f43-cfc3-4289-b107-d1a3da55b5ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:47.570195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c49d1f43-cfc3-4289-b107-d1a3da55b5ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:47.570676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c49d1f43-cfc3-4289-b107-d1a3da55b5ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:47.612176 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c49d1f43-cfc3-4289-b107-d1a3da55b5ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.056366 Nov 27 21:09:47.612834 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2939/5993] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:47 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:47.622341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c2a38d6-944f-4d27-8c5c-36d4cfc010a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:47.623358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c2a38d6-944f-4d27-8c5c-36d4cfc010a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:47.630939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2a38d6-944f-4d27-8c5c-36d4cfc010a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:47.631429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2a38d6-944f-4d27-8c5c-36d4cfc010a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:47.632342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2a38d6-944f-4d27-8c5c-36d4cfc010a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:47.632788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c2a38d6-944f-4d27-8c5c-36d4cfc010a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:47.671827 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c2a38d6-944f-4d27-8c5c-36d4cfc010a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.053901 Nov 27 21:09:47.672589 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3055/5994] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:47 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:48.253115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:48.253820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:48.260936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:48.261398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:48.262183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:48.262631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:48.405272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:48.413833 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-773a9b0b-39f9-43f5-8d29-d8a3bcff1157 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.164862 Nov 27 21:09:48.414426 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2940/5995] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:48 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:48.624911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b616b6e-99a8-4fe9-8ad3-1588e49662b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:48.625914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b616b6e-99a8-4fe9-8ad3-1588e49662b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:48.632897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b616b6e-99a8-4fe9-8ad3-1588e49662b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:48.633344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b616b6e-99a8-4fe9-8ad3-1588e49662b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:48.634115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b616b6e-99a8-4fe9-8ad3-1588e49662b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:48.634550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b616b6e-99a8-4fe9-8ad3-1588e49662b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:48.674914 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b616b6e-99a8-4fe9-8ad3-1588e49662b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.054219 Nov 27 21:09:48.675832 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3056/5996] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:48 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:48.683961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b70b4de4-1d2b-4533-aa7c-1195c6f16651 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:48.684928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b70b4de4-1d2b-4533-aa7c-1195c6f16651 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:48.692727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70b4de4-1d2b-4533-aa7c-1195c6f16651 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:48.693191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70b4de4-1d2b-4533-aa7c-1195c6f16651 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:48.694012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70b4de4-1d2b-4533-aa7c-1195c6f16651 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:48.694880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70b4de4-1d2b-4533-aa7c-1195c6f16651 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:48.734567 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b70b4de4-1d2b-4533-aa7c-1195c6f16651 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 24569 microversion: 2.1 time: 0.054341 Nov 27 21:09:48.735285 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2941/5997] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:48 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 24569 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:49.431978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:49.432680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:49.440190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:49.440681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:49.441472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:49.441919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:49.580944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:49.588225 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca52af07-7982-4ac7-bfcc-03b160a3f5b3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.160562 Nov 27 21:09:49.588798 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3057/5998] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:49 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:49.687125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e5f4db1-abc4-40ab-a3a0-e6525bc6ee04 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:49.688287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e5f4db1-abc4-40ab-a3a0-e6525bc6ee04 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:49.695890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e5f4db1-abc4-40ab-a3a0-e6525bc6ee04 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:49.696353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e5f4db1-abc4-40ab-a3a0-e6525bc6ee04 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:49.697146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e5f4db1-abc4-40ab-a3a0-e6525bc6ee04 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:49.697624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e5f4db1-abc4-40ab-a3a0-e6525bc6ee04 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:49.739180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e5f4db1-abc4-40ab-a3a0-e6525bc6ee04 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.056808 Nov 27 21:09:49.740124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2942/5999] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:49 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:49.746023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a2f5340-3da5-4cff-a91c-ad4188bd7be9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:49.747656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a2f5340-3da5-4cff-a91c-ad4188bd7be9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:49.754941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a2f5340-3da5-4cff-a91c-ad4188bd7be9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:49.755431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a2f5340-3da5-4cff-a91c-ad4188bd7be9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:49.756203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a2f5340-3da5-4cff-a91c-ad4188bd7be9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:49.756644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a2f5340-3da5-4cff-a91c-ad4188bd7be9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:49.803673 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a2f5340-3da5-4cff-a91c-ad4188bd7be9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.061379 Nov 27 21:09:49.804293 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3058/6000] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:49 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:50.605469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:50.606179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:50.613344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:50.613836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:50.614626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:50.615075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:50.747928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:50.751570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a73476b-eaa3-4bb5-984e-4cea2ea01927 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:50.752578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a73476b-eaa3-4bb5-984e-4cea2ea01927 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:50.756071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f562ae4-2207-4294-ad25-16c32d978535 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.154623 Nov 27 21:09:50.757670 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2943/6001] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:50 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:50.759995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a73476b-eaa3-4bb5-984e-4cea2ea01927 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:50.760452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a73476b-eaa3-4bb5-984e-4cea2ea01927 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:50.761241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a73476b-eaa3-4bb5-984e-4cea2ea01927 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:50.761679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a73476b-eaa3-4bb5-984e-4cea2ea01927 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:50.802963 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a73476b-eaa3-4bb5-984e-4cea2ea01927 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.056216 Nov 27 21:09:50.806745 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3059/6002] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:50 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:50.815754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64b7eead-fcdd-4195-949c-771881fd2c9f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:50.816687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64b7eead-fcdd-4195-949c-771881fd2c9f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:50.822636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64b7eead-fcdd-4195-949c-771881fd2c9f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:50.823099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64b7eead-fcdd-4195-949c-771881fd2c9f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:50.823911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64b7eead-fcdd-4195-949c-771881fd2c9f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:50.824354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64b7eead-fcdd-4195-949c-771881fd2c9f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:50.864828 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64b7eead-fcdd-4195-949c-771881fd2c9f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.052674 Nov 27 21:09:50.865714 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2944/6003] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:50 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:51.774446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:51.775313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:51.783355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:51.783822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:51.784609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:51.785083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:51.814498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d2a297b-2075-48fe-893a-079f1cfeb2d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:51.815711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d2a297b-2075-48fe-893a-079f1cfeb2d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:51.823000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d2a297b-2075-48fe-893a-079f1cfeb2d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:51.823564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d2a297b-2075-48fe-893a-079f1cfeb2d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:51.824425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d2a297b-2075-48fe-893a-079f1cfeb2d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:51.825719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d2a297b-2075-48fe-893a-079f1cfeb2d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:51.879661 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d2a297b-2075-48fe-893a-079f1cfeb2d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.069132 Nov 27 21:09:51.883441 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2945/6004] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:51 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:51.885308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1addccfb-aff6-4d76-9844-6090174e5878 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:51.886305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1addccfb-aff6-4d76-9844-6090174e5878 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:51.894325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1addccfb-aff6-4d76-9844-6090174e5878 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:51.894783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1addccfb-aff6-4d76-9844-6090174e5878 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:51.895604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1addccfb-aff6-4d76-9844-6090174e5878 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:51.896055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1addccfb-aff6-4d76-9844-6090174e5878 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:51.920703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:51.928269 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1d9bdd01-a4d5-4d2e-828e-1dd81c31077b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.157954 Nov 27 21:09:51.928851 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3060/6005] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:51 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:51.937215 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1addccfb-aff6-4d76-9844-6090174e5878 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.055032 Nov 27 21:09:51.937868 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2946/6006] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:51 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:52.891666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-800c6ee7-4de0-4a31-bdfb-d34c8e26adcc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:52.892579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-800c6ee7-4de0-4a31-bdfb-d34c8e26adcc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:52.899336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-800c6ee7-4de0-4a31-bdfb-d34c8e26adcc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:52.899789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-800c6ee7-4de0-4a31-bdfb-d34c8e26adcc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:52.900557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-800c6ee7-4de0-4a31-bdfb-d34c8e26adcc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:52.900991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-800c6ee7-4de0-4a31-bdfb-d34c8e26adcc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:52.943014 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-800c6ee7-4de0-4a31-bdfb-d34c8e26adcc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055509 Nov 27 21:09:52.943694 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3061/6007] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:52 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:52.949483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a1eb5811-f0d2-415a-856c-57ea394274bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:52.951064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a1eb5811-f0d2-415a-856c-57ea394274bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:52.952197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:52.952902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:52.957922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1eb5811-f0d2-415a-856c-57ea394274bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:52.958380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1eb5811-f0d2-415a-856c-57ea394274bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:52.959167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1eb5811-f0d2-415a-856c-57ea394274bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:52.959700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a1eb5811-f0d2-415a-856c-57ea394274bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:52.961490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:52.961942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:52.962986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:52.964705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:53.002192 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a1eb5811-f0d2-415a-856c-57ea394274bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.056433 Nov 27 21:09:53.003083 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3062/6008] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:52 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:53.101743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:53.108983 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38d42400-3e11-447c-bb23-fde8417d5284 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.165596 Nov 27 21:09:53.109551 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2947/6009] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:52 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:53.785127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b91d461c-9590-43dc-8416-5804c2393ee8 req-d8d94f75-1ef1-432b-8dfe-308f7cdb182d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e084ddda-4b13-4be9-8e94-cfa73ea95181", "name": "network-vif-plugged", "status": "completed", "tag": "1c3ae37b-95af-474c-9626-0f2fe55d3ff4"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:53.786668 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:53.786668 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:09:53.795283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b91d461c-9590-43dc-8416-5804c2393ee8 req-d8d94f75-1ef1-432b-8dfe-308f7cdb182d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:53.795734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b91d461c-9590-43dc-8416-5804c2393ee8 req-d8d94f75-1ef1-432b-8dfe-308f7cdb182d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:53.808759 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b91d461c-9590-43dc-8416-5804c2393ee8 req-d8d94f75-1ef1-432b-8dfe-308f7cdb182d service nova] Creating event network-vif-plugged:1c3ae37b-95af-474c-9626-0f2fe55d3ff4 for instance e084ddda-4b13-4be9-8e94-cfa73ea95181 on nch2-master-1 Nov 27 21:09:53.813560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b91d461c-9590-43dc-8416-5804c2393ee8 req-d8d94f75-1ef1-432b-8dfe-308f7cdb182d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032512 Nov 27 21:09:53.814154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3063/6010] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:53.955328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca3f32c2-4774-44e7-bcfc-c82f8ea78b53 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:53.956266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca3f32c2-4774-44e7-bcfc-c82f8ea78b53 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:53.963940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca3f32c2-4774-44e7-bcfc-c82f8ea78b53 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:53.964381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca3f32c2-4774-44e7-bcfc-c82f8ea78b53 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:53.965657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca3f32c2-4774-44e7-bcfc-c82f8ea78b53 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:53.966104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca3f32c2-4774-44e7-bcfc-c82f8ea78b53 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:54.014876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7624ed15-74f4-4163-a93c-f73beceb2739 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:54.015914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7624ed15-74f4-4163-a93c-f73beceb2739 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:54.022015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624ed15-74f4-4163-a93c-f73beceb2739 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:54.022470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624ed15-74f4-4163-a93c-f73beceb2739 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:54.023239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624ed15-74f4-4163-a93c-f73beceb2739 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:54.023708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7624ed15-74f4-4163-a93c-f73beceb2739 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:54.065822 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7624ed15-74f4-4163-a93c-f73beceb2739 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.056422 Nov 27 21:09:54.066431 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3064/6011] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:54 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:54.125913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:54.126601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:54.133396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:54.133840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:54.134604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:54.135038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:54.205026 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca3f32c2-4774-44e7-bcfc-c82f8ea78b53 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.253341 Nov 27 21:09:54.206859 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2948/6012] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:53 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:54.273068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:54.281113 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98ec2216-abf3-441b-9db1-36bb00ab0e70 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1308 microversion: 2.1 time: 0.159054 Nov 27 21:09:54.281673 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3065/6013] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:54 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:55.078749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f34f45d4-026f-4465-a85e-94099d766925 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:55.079783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f34f45d4-026f-4465-a85e-94099d766925 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:55.087320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34f45d4-026f-4465-a85e-94099d766925 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.087786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34f45d4-026f-4465-a85e-94099d766925 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.088583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34f45d4-026f-4465-a85e-94099d766925 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.089029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34f45d4-026f-4465-a85e-94099d766925 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.128175 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f34f45d4-026f-4465-a85e-94099d766925 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.054225 Nov 27 21:09:55.128794 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2949/6014] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:55 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:55.216660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a734a55b-0665-480f-be18-730c67d49718 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:55.217568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a734a55b-0665-480f-be18-730c67d49718 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:55.227348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a734a55b-0665-480f-be18-730c67d49718 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.227845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a734a55b-0665-480f-be18-730c67d49718 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.228577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a734a55b-0665-480f-be18-730c67d49718 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.229008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a734a55b-0665-480f-be18-730c67d49718 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.270557 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a734a55b-0665-480f-be18-730c67d49718 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.057947 Nov 27 21:09:55.271211 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3066/6015] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:55 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:55.298860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:55.299588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:55.307923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.308375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.309166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.309606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.444392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:55.451868 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ba7e127-27ed-45dc-b836-e7c0cf8132de tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1489 microversion: 2.1 time: 0.157593 Nov 27 21:09:55.452435 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2950/6016] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:55 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1489 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:55.468887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df3016c4-7ba0-44fc-9257-d5467662ded3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:55.470134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-df3016c4-7ba0-44fc-9257-d5467662ded3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:55.476998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df3016c4-7ba0-44fc-9257-d5467662ded3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.477453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df3016c4-7ba0-44fc-9257-d5467662ded3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.478230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df3016c4-7ba0-44fc-9257-d5467662ded3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.478674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df3016c4-7ba0-44fc-9257-d5467662ded3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.542921 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df3016c4-7ba0-44fc-9257-d5467662ded3 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "PUT /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1084 microversion: 2.1 time: 0.078588 Nov 27 21:09:55.543563 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3067/6017] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:09:55 2021] PUT /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1084 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:55.556983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:55.557591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:55.563621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.564075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.564852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.565293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.694246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:55.702140 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f595d486-75ae-4990-b734-7d68d116d9cd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1510 microversion: 2.1 time: 0.148904 Nov 27 21:09:55.702710 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2951/6018] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:55 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:55.718138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:55.718740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:55.725080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.725521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.726285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.726719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.856117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:55.863512 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-67faa6eb-4db0-465f-b383-1a93721c4de2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1510 microversion: 2.1 time: 0.149626 Nov 27 21:09:55.864079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3068/6019] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:55 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:55.879719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:55.880212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:55.886496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.886944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.887750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:55.888778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:55.913038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:09:55.984785 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dfaf4a2a-11a3-4ded-a6af-8da2a5000fe6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 204 len: 0 microversion: 2.1 time: 0.108446 Nov 27 21:09:55.985373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2952/6020] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:09:55 2021] DELETE /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:09:55.993667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:55.994635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:56.001661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:56.002110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:56.002883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:56.003357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:56.138045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:56.140914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca697cc5-93f3-4836-beef-b84bbce216dd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:56.141930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca697cc5-93f3-4836-beef-b84bbce216dd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:56.146145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08f8900a-e1d0-4029-98d5-a16912831a35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1516 microversion: 2.1 time: 0.156241 Nov 27 21:09:56.146799 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3069/6021] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:55 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:56.148206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca697cc5-93f3-4836-beef-b84bbce216dd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:56.148663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca697cc5-93f3-4836-beef-b84bbce216dd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:56.149450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca697cc5-93f3-4836-beef-b84bbce216dd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:56.149885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca697cc5-93f3-4836-beef-b84bbce216dd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:56.195537 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca697cc5-93f3-4836-beef-b84bbce216dd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059101 Nov 27 21:09:56.196524 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2953/6022] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:56 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:56.281772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-22485c8a-7929-4438-89fc-e59493583983 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:56.282837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-22485c8a-7929-4438-89fc-e59493583983 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:56.289568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22485c8a-7929-4438-89fc-e59493583983 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:56.290021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22485c8a-7929-4438-89fc-e59493583983 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:56.290792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22485c8a-7929-4438-89fc-e59493583983 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:56.291229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22485c8a-7929-4438-89fc-e59493583983 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:56.330575 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-22485c8a-7929-4438-89fc-e59493583983 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.052380 Nov 27 21:09:56.331204 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3070/6023] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:56 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:09:57.164206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:57.165048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:57.172386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:57.172871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:57.173654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:57.174119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:57.207928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebc13650-7c94-4cae-b989-6a7f1897a02b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:57.208945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebc13650-7c94-4cae-b989-6a7f1897a02b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:57.215592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc13650-7c94-4cae-b989-6a7f1897a02b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:57.216052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc13650-7c94-4cae-b989-6a7f1897a02b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:57.217401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc13650-7c94-4cae-b989-6a7f1897a02b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:57.217871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebc13650-7c94-4cae-b989-6a7f1897a02b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:57.268797 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebc13650-7c94-4cae-b989-6a7f1897a02b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.064599 Nov 27 21:09:57.270136 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3071/6024] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:57 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:09:57.314782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:57.322299 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ceda3dde-447b-4ade-a6f5-adffcf61856a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1516 microversion: 2.1 time: 0.162136 Nov 27 21:09:57.322865 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2954/6025] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:57 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:09:57.344081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4633d6a7-0373-4712-aca8-a9d3cc4c11d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:57.345231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4633d6a7-0373-4712-aca8-a9d3cc4c11d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:57.352513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4633d6a7-0373-4712-aca8-a9d3cc4c11d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:57.352956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4633d6a7-0373-4712-aca8-a9d3cc4c11d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:57.353721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4633d6a7-0373-4712-aca8-a9d3cc4c11d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:57.354145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4633d6a7-0373-4712-aca8-a9d3cc4c11d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:57.396126 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4633d6a7-0373-4712-aca8-a9d3cc4c11d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.057216 Nov 27 21:09:57.396996 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3072/6026] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:57 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:57.960917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-24484ca1-b929-45b7-9514-1345ad77e20e req-45180c3f-474a-421f-b04e-3d0a3836b8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e084ddda-4b13-4be9-8e94-cfa73ea95181", "name": "network-vif-deleted", "tag": "1c3ae37b-95af-474c-9626-0f2fe55d3ff4"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:57.962555 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:09:57.962555 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:09:57.971024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-24484ca1-b929-45b7-9514-1345ad77e20e req-45180c3f-474a-421f-b04e-3d0a3836b8bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:57.971520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-24484ca1-b929-45b7-9514-1345ad77e20e req-45180c3f-474a-421f-b04e-3d0a3836b8bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:57.986482 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-24484ca1-b929-45b7-9514-1345ad77e20e req-45180c3f-474a-421f-b04e-3d0a3836b8bd service nova] Creating event network-vif-deleted:1c3ae37b-95af-474c-9626-0f2fe55d3ff4 for instance e084ddda-4b13-4be9-8e94-cfa73ea95181 on nch2-master-1 Nov 27 21:09:57.991567 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-24484ca1-b929-45b7-9514-1345ad77e20e req-45180c3f-474a-421f-b04e-3d0a3836b8bd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034791 Nov 27 21:09:57.995552 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2955/6027] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:09:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:09:58.282088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1dac5772-2beb-4b2b-b415-d7f6930623aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:58.283211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1dac5772-2beb-4b2b-b415-d7f6930623aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:58.290769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dac5772-2beb-4b2b-b415-d7f6930623aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:58.291220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dac5772-2beb-4b2b-b415-d7f6930623aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:58.292029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dac5772-2beb-4b2b-b415-d7f6930623aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:58.292467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dac5772-2beb-4b2b-b415-d7f6930623aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:58.339830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1dac5772-2beb-4b2b-b415-d7f6930623aa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.062368 Nov 27 21:09:58.340763 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3073/6028] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:58 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:58.343708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:58.344744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:58.351613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:58.352076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:58.352869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:58.353316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:58.387677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:58.388135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:58.388605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lazy-loading 'fault' on Instance uuid e084ddda-4b13-4be9-8e94-cfa73ea95181 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:09:58.409171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae810ef8-000d-41a0-abd6-d140d3cc5bf5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:58.410187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae810ef8-000d-41a0-abd6-d140d3cc5bf5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:58.417371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae810ef8-000d-41a0-abd6-d140d3cc5bf5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:58.417830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae810ef8-000d-41a0-abd6-d140d3cc5bf5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:58.418624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae810ef8-000d-41a0-abd6-d140d3cc5bf5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:58.419061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae810ef8-000d-41a0-abd6-d140d3cc5bf5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:58.432915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:09:58.440085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c165279-cd10-4a37-b401-75d959b2739f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 200 len: 1319 microversion: 2.1 time: 0.102679 Nov 27 21:09:58.440693 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2956/6029] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:58 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 1319 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:09:58.464614 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae810ef8-000d-41a0-abd6-d140d3cc5bf5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.059490 Nov 27 21:09:58.465497 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3074/6030] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:58 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:59.352025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54ac03e8-bc87-4747-8558-17d9242ae99d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:59.352987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54ac03e8-bc87-4747-8558-17d9242ae99d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:59.360415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54ac03e8-bc87-4747-8558-17d9242ae99d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.360934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54ac03e8-bc87-4747-8558-17d9242ae99d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.361732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54ac03e8-bc87-4747-8558-17d9242ae99d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.362179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54ac03e8-bc87-4747-8558-17d9242ae99d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.407026 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54ac03e8-bc87-4747-8558-17d9242ae99d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.058667 Nov 27 21:09:59.407983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2957/6031] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:09:59 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:09:59.457694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:09:59.458394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:59.465738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.466227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.467006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.467490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.477034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63b3caf3-0a66-4758-ba73-a2ac99329293 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:59.478034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63b3caf3-0a66-4758-ba73-a2ac99329293 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:09:59.482169 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance e084ddda-4b13-4be9-8e94-cfa73ea95181 could not be found. Nov 27 21:09:59.482756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance e084ddda-4b13-4be9-8e94-cfa73ea95181 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:09:59.483673 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79617bf5-bc8d-419b-a4ec-47d21e1cf89f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 404 len: 111 microversion: 2.1 time: 0.030116 Nov 27 21:09:59.494379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3075/6032] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:09:59 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:09:59.494558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63b3caf3-0a66-4758-ba73-a2ac99329293 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.494558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63b3caf3-0a66-4758-ba73-a2ac99329293 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.494558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63b3caf3-0a66-4758-ba73-a2ac99329293 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.494558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63b3caf3-0a66-4758-ba73-a2ac99329293 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.528307 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63b3caf3-0a66-4758-ba73-a2ac99329293 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055193 Nov 27 21:09:59.529104 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2958/6033] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:09:59 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:09:59.531542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1215829148", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "222dd9d8-01e1-49e7-9bb7-8028b20baa13"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:09:59.583414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] validate_networks() for [('222dd9d8-01e1-49e7-9bb7-8028b20baa13', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:09:59.935079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:09:59.935538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:09:59.936022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:09:59.936431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:09:59.936842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:09:59.945746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.946132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.947012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:09:59.947483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:09:59.964280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:09:59.969839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Getting quotas for user 0bdcce84821340f3ab7c663e137d09fc and project e50ca5bbf0334faa9bad45c847b7301c. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:09:59.982317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:09:59.984720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:10:00.028373 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a84325d6-79d5-444d-aebc-f265009425ff tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500634 Nov 27 21:10:00.029555 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3076/6034] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:09:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:10:00.039804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9499ab2-1f86-44b6-b283-a2636c83e3eb tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:00.040508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9499ab2-1f86-44b6-b283-a2636c83e3eb tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:00.094664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9499ab2-1f86-44b6-b283-a2636c83e3eb tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:00.101175 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9499ab2-1f86-44b6-b283-a2636c83e3eb tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1209 microversion: 2.1 time: 0.065319 Nov 27 21:10:00.101745 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2959/6035] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:00 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1209 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:00.418174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50e71dac-45f4-4ead-bb3c-459c0ae9f72d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:00.419147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-50e71dac-45f4-4ead-bb3c-459c0ae9f72d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:00.426116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50e71dac-45f4-4ead-bb3c-459c0ae9f72d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:00.426608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50e71dac-45f4-4ead-bb3c-459c0ae9f72d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:00.427453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50e71dac-45f4-4ead-bb3c-459c0ae9f72d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:00.427937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50e71dac-45f4-4ead-bb3c-459c0ae9f72d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:00.476277 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50e71dac-45f4-4ead-bb3c-459c0ae9f72d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.061721 Nov 27 21:10:00.476969 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3077/6036] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:00 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:00.539901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8c5ebc2-2818-4cd3-bdfd-dbec7231505d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:00.540831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8c5ebc2-2818-4cd3-bdfd-dbec7231505d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:00.548061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8c5ebc2-2818-4cd3-bdfd-dbec7231505d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:00.548492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8c5ebc2-2818-4cd3-bdfd-dbec7231505d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:00.549485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8c5ebc2-2818-4cd3-bdfd-dbec7231505d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:00.549976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8c5ebc2-2818-4cd3-bdfd-dbec7231505d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:00.592108 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8c5ebc2-2818-4cd3-bdfd-dbec7231505d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055809 Nov 27 21:10:00.593005 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2960/6037] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:00 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:01.120246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:01.120944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:01.127903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:01.128349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:01.129138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:01.129576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:01.211441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:01.219728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3215c383-ecf8-48c6-9311-4f34e46046b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1267 microversion: 2.1 time: 0.105262 Nov 27 21:10:01.220311 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3078/6038] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:01 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:01.490500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-727b9544-73eb-4b94-ad33-741d739d1a9a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:01.491784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-727b9544-73eb-4b94-ad33-741d739d1a9a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:01.500237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727b9544-73eb-4b94-ad33-741d739d1a9a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:01.501204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727b9544-73eb-4b94-ad33-741d739d1a9a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:01.502220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727b9544-73eb-4b94-ad33-741d739d1a9a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:01.502220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727b9544-73eb-4b94-ad33-741d739d1a9a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:01.559083 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-727b9544-73eb-4b94-ad33-741d739d1a9a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.073465 Nov 27 21:10:01.563645 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2961/6039] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:01 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:01.604077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf1c24dc-5c78-4053-84c5-9062b60fbb7b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:01.605742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf1c24dc-5c78-4053-84c5-9062b60fbb7b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:01.612691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf1c24dc-5c78-4053-84c5-9062b60fbb7b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:01.613290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf1c24dc-5c78-4053-84c5-9062b60fbb7b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:01.614325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf1c24dc-5c78-4053-84c5-9062b60fbb7b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:01.614850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf1c24dc-5c78-4053-84c5-9062b60fbb7b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:01.655633 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf1c24dc-5c78-4053-84c5-9062b60fbb7b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055148 Nov 27 21:10:01.656378 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3079/6040] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:01 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:02.182036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a241ef24-accd-4a88-8481-43e82fde2574 req-159cdf0b-186a-47ee-bb63-9294f67779b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8ada76-a85d-40d5-aedc-4323b4072dd2", "tag": "1c8af7c2-3583-40e3-882c-e5d19b2dce00"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:02.183998 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:10:02.183998 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:10:02.198939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a241ef24-accd-4a88-8481-43e82fde2574 req-159cdf0b-186a-47ee-bb63-9294f67779b2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:02.199709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a241ef24-accd-4a88-8481-43e82fde2574 req-159cdf0b-186a-47ee-bb63-9294f67779b2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:02.213216 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a241ef24-accd-4a88-8481-43e82fde2574 req-159cdf0b-186a-47ee-bb63-9294f67779b2 service nova] Creating event network-changed:1c8af7c2-3583-40e3-882c-e5d19b2dce00 for instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 on nch2-master-1 Nov 27 21:10:02.218773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a241ef24-accd-4a88-8481-43e82fde2574 req-159cdf0b-186a-47ee-bb63-9294f67779b2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041636 Nov 27 21:10:02.219397 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2962/6041] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:10:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:10:02.238242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:02.239137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:02.247323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:02.247938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:02.248790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:02.249301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:02.502738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:02.511090 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-38e8ca59-b0df-4faf-bbd4-65e4fa62fff9 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.277184 Nov 27 21:10:02.511703 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3080/6042] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:02 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:02.571761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7af22c45-b159-4671-97aa-f768094bc033 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:02.572784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7af22c45-b159-4671-97aa-f768094bc033 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:02.580268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7af22c45-b159-4671-97aa-f768094bc033 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:02.580731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7af22c45-b159-4671-97aa-f768094bc033 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:02.581524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7af22c45-b159-4671-97aa-f768094bc033 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:02.581974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7af22c45-b159-4671-97aa-f768094bc033 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:02.628350 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7af22c45-b159-4671-97aa-f768094bc033 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060598 Nov 27 21:10:02.629272 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2963/6043] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:02 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:02.667528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f56f8c7e-d6e6-4d02-b302-1e76f6ae9ddd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:02.668586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f56f8c7e-d6e6-4d02-b302-1e76f6ae9ddd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:02.676308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56f8c7e-d6e6-4d02-b302-1e76f6ae9ddd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:02.676767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56f8c7e-d6e6-4d02-b302-1e76f6ae9ddd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:02.677551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56f8c7e-d6e6-4d02-b302-1e76f6ae9ddd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:02.677991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f56f8c7e-d6e6-4d02-b302-1e76f6ae9ddd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:02.717401 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f56f8c7e-d6e6-4d02-b302-1e76f6ae9ddd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.053621 Nov 27 21:10:02.721044 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3081/6044] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:02 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:03.529538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:03.530245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:03.537444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:03.537911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:03.538702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:03.539154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:03.640920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0527951-04dd-453c-b32e-4c8a8206d731 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:03.641938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b0527951-04dd-453c-b32e-4c8a8206d731 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:03.649183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0527951-04dd-453c-b32e-4c8a8206d731 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:03.649640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0527951-04dd-453c-b32e-4c8a8206d731 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:03.650430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0527951-04dd-453c-b32e-4c8a8206d731 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:03.650876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0527951-04dd-453c-b32e-4c8a8206d731 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:03.677117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:03.685782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b155f83b-11c7-4776-9e95-701851380883 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.160836 Nov 27 21:10:03.686377 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2964/6045] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:03 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:03.696718 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0527951-04dd-453c-b32e-4c8a8206d731 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060476 Nov 27 21:10:03.697423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3082/6046] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:03 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:03.728578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6c2fbb6-bccf-494b-b950-9fa1d5f16cba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:03.729498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6c2fbb6-bccf-494b-b950-9fa1d5f16cba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:03.736081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6c2fbb6-bccf-494b-b950-9fa1d5f16cba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:03.736543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6c2fbb6-bccf-494b-b950-9fa1d5f16cba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:03.737321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6c2fbb6-bccf-494b-b950-9fa1d5f16cba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:03.737759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6c2fbb6-bccf-494b-b950-9fa1d5f16cba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:03.778521 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6c2fbb6-bccf-494b-b950-9fa1d5f16cba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.053521 Nov 27 21:10:03.779134 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2965/6047] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:03 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:04.702777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:04.703421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:04.709175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c4b36e3-b3f8-4ddc-896c-30e516605895 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:04.710194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c4b36e3-b3f8-4ddc-896c-30e516605895 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:04.710997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:04.711487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:04.712302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:04.712753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:04.717959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4b36e3-b3f8-4ddc-896c-30e516605895 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:04.718423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4b36e3-b3f8-4ddc-896c-30e516605895 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:04.719212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4b36e3-b3f8-4ddc-896c-30e516605895 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:04.719686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c4b36e3-b3f8-4ddc-896c-30e516605895 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:04.763529 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c4b36e3-b3f8-4ddc-896c-30e516605895 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.057672 Nov 27 21:10:04.764423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2966/6048] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:04 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:04.790441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b148f9ad-4317-41ee-94c6-bbd259f3decc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:04.791540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b148f9ad-4317-41ee-94c6-bbd259f3decc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:04.800909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b148f9ad-4317-41ee-94c6-bbd259f3decc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:04.801581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b148f9ad-4317-41ee-94c6-bbd259f3decc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:04.803002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b148f9ad-4317-41ee-94c6-bbd259f3decc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:04.803488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b148f9ad-4317-41ee-94c6-bbd259f3decc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:04.845482 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b148f9ad-4317-41ee-94c6-bbd259f3decc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.059011 Nov 27 21:10:04.846194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:04.846368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2967/6049] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:04 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:04.854312 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-544313d3-fca0-44c0-9a8e-9890f10e4b9f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.156136 Nov 27 21:10:04.854884 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3083/6050] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:04 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:05.774950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd0f1a03-dd57-4cd5-aabc-2946eaa97540 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:05.776006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd0f1a03-dd57-4cd5-aabc-2946eaa97540 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:05.783934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd0f1a03-dd57-4cd5-aabc-2946eaa97540 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:05.784396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd0f1a03-dd57-4cd5-aabc-2946eaa97540 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:05.785183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd0f1a03-dd57-4cd5-aabc-2946eaa97540 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:05.785627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd0f1a03-dd57-4cd5-aabc-2946eaa97540 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:05.834186 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd0f1a03-dd57-4cd5-aabc-2946eaa97540 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.063290 Nov 27 21:10:05.834832 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2968/6051] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:05 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:05.857664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db9674dc-4ebb-42b4-b2cb-5dcd798c7156 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:05.858583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db9674dc-4ebb-42b4-b2cb-5dcd798c7156 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:05.868444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db9674dc-4ebb-42b4-b2cb-5dcd798c7156 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:05.868890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db9674dc-4ebb-42b4-b2cb-5dcd798c7156 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:05.869912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db9674dc-4ebb-42b4-b2cb-5dcd798c7156 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:05.870346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db9674dc-4ebb-42b4-b2cb-5dcd798c7156 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:05.871698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:05.872431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:05.879388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:05.879849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:05.880639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:05.881084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:05.908835 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db9674dc-4ebb-42b4-b2cb-5dcd798c7156 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055378 Nov 27 21:10:05.909729 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3084/6052] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:05 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:06.011727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:06.019528 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-65f61065-8c90-436d-8f6f-6f985914da35 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.152071 Nov 27 21:10:06.020107 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2969/6053] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:05 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:06.846250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb425d28-4831-4036-bb59-66f2a22114e9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:06.847283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb425d28-4831-4036-bb59-66f2a22114e9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:06.854343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb425d28-4831-4036-bb59-66f2a22114e9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:06.854793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb425d28-4831-4036-bb59-66f2a22114e9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:06.855606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb425d28-4831-4036-bb59-66f2a22114e9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:06.856046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb425d28-4831-4036-bb59-66f2a22114e9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:06.902782 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb425d28-4831-4036-bb59-66f2a22114e9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060578 Nov 27 21:10:06.903475 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3085/6054] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:06 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:06.920865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-351f4771-6065-4b81-9997-54e1b414a0ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:06.921782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-351f4771-6065-4b81-9997-54e1b414a0ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:06.928800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f4771-6065-4b81-9997-54e1b414a0ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:06.929253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f4771-6065-4b81-9997-54e1b414a0ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:06.930027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f4771-6065-4b81-9997-54e1b414a0ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:06.930464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-351f4771-6065-4b81-9997-54e1b414a0ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:06.969422 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-351f4771-6065-4b81-9997-54e1b414a0ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.052775 Nov 27 21:10:06.970045 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2970/6055] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:06 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:07.037235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:07.037972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:07.044849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:07.045845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:07.046646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:07.047082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:07.181069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:07.188371 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9f9f0a4-33f3-4b52-9b77-fb94f98169fd tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.155164 Nov 27 21:10:07.188944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3086/6056] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:07 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:07.914537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-753a5419-e670-4d89-be55-06bb9a49707b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:07.915581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-753a5419-e670-4d89-be55-06bb9a49707b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:07.923509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-753a5419-e670-4d89-be55-06bb9a49707b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:07.924138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-753a5419-e670-4d89-be55-06bb9a49707b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:07.924744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-753a5419-e670-4d89-be55-06bb9a49707b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:07.925188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-753a5419-e670-4d89-be55-06bb9a49707b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:07.971430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-753a5419-e670-4d89-be55-06bb9a49707b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060777 Nov 27 21:10:07.972088 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2971/6057] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:07 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:07.981027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e47c29a-9605-460f-b173-1d38035cd093 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:07.981942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e47c29a-9605-460f-b173-1d38035cd093 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:07.990006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e47c29a-9605-460f-b173-1d38035cd093 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:07.990452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e47c29a-9605-460f-b173-1d38035cd093 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:07.991217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e47c29a-9605-460f-b173-1d38035cd093 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:07.991673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e47c29a-9605-460f-b173-1d38035cd093 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:08.031477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e47c29a-9605-460f-b173-1d38035cd093 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.054169 Nov 27 21:10:08.032098 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3087/6058] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:07 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:08.205958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:08.206575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:08.214351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:08.214813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:08.215747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:08.216062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:08.349926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:08.358181 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ba8b06a-5d92-4d12-baa9-056c8d643b40 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.156905 Nov 27 21:10:08.358777 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2972/6059] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:08 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:08.983970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b3040c4-2354-45fc-899f-a7ac09803f40 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:08.984989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b3040c4-2354-45fc-899f-a7ac09803f40 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:08.992521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3040c4-2354-45fc-899f-a7ac09803f40 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:08.992974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3040c4-2354-45fc-899f-a7ac09803f40 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:08.993757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3040c4-2354-45fc-899f-a7ac09803f40 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:08.994454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b3040c4-2354-45fc-899f-a7ac09803f40 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:09.041606 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b3040c4-2354-45fc-899f-a7ac09803f40 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.062065 Nov 27 21:10:09.042493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3088/6060] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:08 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:09.097831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05dfff1d-bc14-4bfd-b486-26a385872f97 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:09.098821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05dfff1d-bc14-4bfd-b486-26a385872f97 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:09.105639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05dfff1d-bc14-4bfd-b486-26a385872f97 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:09.106103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05dfff1d-bc14-4bfd-b486-26a385872f97 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:09.106890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05dfff1d-bc14-4bfd-b486-26a385872f97 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:09.107867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05dfff1d-bc14-4bfd-b486-26a385872f97 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:09.146921 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05dfff1d-bc14-4bfd-b486-26a385872f97 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.107560 Nov 27 21:10:09.147492 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2973/6061] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:09 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:09.375402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:09.375986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:09.382887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:09.383361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:09.384126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:09.384561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:09.514735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:09.523194 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-863f22af-cf35-4430-b39d-c4d87c617a21 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.151925 Nov 27 21:10:09.523814 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3089/6062] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:09 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:09.857452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3b4518e2-e74f-4ff1-8408-2f3148124994 req-1ce6db50-db2c-4a5d-ad85-73997a484824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8ada76-a85d-40d5-aedc-4323b4072dd2", "name": "network-vif-plugged", "status": "completed", "tag": "1c8af7c2-3583-40e3-882c-e5d19b2dce00"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:09.859062 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:10:09.859062 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:10:09.868577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3b4518e2-e74f-4ff1-8408-2f3148124994 req-1ce6db50-db2c-4a5d-ad85-73997a484824 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:09.869287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3b4518e2-e74f-4ff1-8408-2f3148124994 req-1ce6db50-db2c-4a5d-ad85-73997a484824 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:09.883779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3b4518e2-e74f-4ff1-8408-2f3148124994 req-1ce6db50-db2c-4a5d-ad85-73997a484824 service nova] Creating event network-vif-plugged:1c8af7c2-3583-40e3-882c-e5d19b2dce00 for instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 on nch2-master-1 Nov 27 21:10:09.888545 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3b4518e2-e74f-4ff1-8408-2f3148124994 req-1ce6db50-db2c-4a5d-ad85-73997a484824 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Nov 27 21:10:09.889781 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2974/6063] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:10:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:10:10.053590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e018ba02-10a4-4202-9ab5-4d254c6f8e53 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:10.054507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e018ba02-10a4-4202-9ab5-4d254c6f8e53 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:10.064842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e018ba02-10a4-4202-9ab5-4d254c6f8e53 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:10.065294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e018ba02-10a4-4202-9ab5-4d254c6f8e53 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:10.066067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e018ba02-10a4-4202-9ab5-4d254c6f8e53 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:10.066506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e018ba02-10a4-4202-9ab5-4d254c6f8e53 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:10.110061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e018ba02-10a4-4202-9ab5-4d254c6f8e53 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060024 Nov 27 21:10:10.110702 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3090/6064] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:10 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:10.158740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a96e99a0-230a-46ed-9351-a0b68810d94d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:10.159785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a96e99a0-230a-46ed-9351-a0b68810d94d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:10.166758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96e99a0-230a-46ed-9351-a0b68810d94d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:10.167215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96e99a0-230a-46ed-9351-a0b68810d94d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:10.168031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96e99a0-230a-46ed-9351-a0b68810d94d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:10.168478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a96e99a0-230a-46ed-9351-a0b68810d94d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:10.286818 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a96e99a0-230a-46ed-9351-a0b68810d94d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.131987 Nov 27 21:10:10.287691 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2975/6065] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:10 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:10.541016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:10.541631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:10.549344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:10.549800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:10.550587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:10.551063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:10.685567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:10.693464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f54a03c4-040e-4c56-bd16-996d1be24e3d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1309 microversion: 2.1 time: 0.156566 Nov 27 21:10:10.694038 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3091/6066] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:10 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:11.122432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-503e3f9a-e79b-49b9-9c7b-906827e5a1f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:11.123481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-503e3f9a-e79b-49b9-9c7b-906827e5a1f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:11.130481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e3f9a-e79b-49b9-9c7b-906827e5a1f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.130938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e3f9a-e79b-49b9-9c7b-906827e5a1f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.131754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e3f9a-e79b-49b9-9c7b-906827e5a1f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.132203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-503e3f9a-e79b-49b9-9c7b-906827e5a1f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.178363 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-503e3f9a-e79b-49b9-9c7b-906827e5a1f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060187 Nov 27 21:10:11.179010 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2976/6067] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:11 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:11.297970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1dd95077-8180-4750-9125-0abc7a61e857 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:11.298888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1dd95077-8180-4750-9125-0abc7a61e857 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:11.306352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dd95077-8180-4750-9125-0abc7a61e857 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.306804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dd95077-8180-4750-9125-0abc7a61e857 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.307598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dd95077-8180-4750-9125-0abc7a61e857 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.308028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1dd95077-8180-4750-9125-0abc7a61e857 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.346822 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1dd95077-8180-4750-9125-0abc7a61e857 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.052520 Nov 27 21:10:11.351342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3092/6068] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:11 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:11.710902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:11.711550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:11.718540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.718989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.719785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.720222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.853699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:11.861239 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c25491ac-3f29-46e8-920b-10aadd87bf52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1490 microversion: 2.1 time: 0.154519 Nov 27 21:10:11.861806 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2977/6069] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:11 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1490 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:11.878431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de68ec34-e906-495a-8ed7-577b82ef9ee5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-54461290"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:11.879693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de68ec34-e906-495a-8ed7-577b82ef9ee5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:11.886635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de68ec34-e906-495a-8ed7-577b82ef9ee5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.887082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de68ec34-e906-495a-8ed7-577b82ef9ee5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.887887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de68ec34-e906-495a-8ed7-577b82ef9ee5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.888323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de68ec34-e906-495a-8ed7-577b82ef9ee5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.950524 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de68ec34-e906-495a-8ed7-577b82ef9ee5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "PUT /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1073 microversion: 2.1 time: 0.076109 Nov 27 21:10:11.951758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3093/6070] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:10:11 2021] PUT /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1073 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:11.965114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:11.965666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:11.971586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.972033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:11.972801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:11.973237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.103024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:12.110430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29e34b9b-0570-4014-acf4-9f7a9b4ed11d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1499 microversion: 2.1 time: 0.149040 Nov 27 21:10:12.111010 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2978/6071] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:11 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1499 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:12.126811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:12.127454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:12.133793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.134242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.135016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.135486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.190205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13bebdc0-5fa0-4e2f-94c6-7c139cc63fc9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:12.191163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13bebdc0-5fa0-4e2f-94c6-7c139cc63fc9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:12.197306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13bebdc0-5fa0-4e2f-94c6-7c139cc63fc9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.197758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13bebdc0-5fa0-4e2f-94c6-7c139cc63fc9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.198544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13bebdc0-5fa0-4e2f-94c6-7c139cc63fc9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.198987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13bebdc0-5fa0-4e2f-94c6-7c139cc63fc9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.244349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13bebdc0-5fa0-4e2f-94c6-7c139cc63fc9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.057457 Nov 27 21:10:12.245017 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2979/6072] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:12 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:12.271394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:12.278884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-29467fca-c7ec-409e-92c0-2598bce8bdf7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1499 microversion: 2.1 time: 0.156297 Nov 27 21:10:12.280090 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3094/6073] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:12 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:12.296587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2eb7bcfb-7cea-4a46-8b4f-532e43e80fd6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:12.303515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2eb7bcfb-7cea-4a46-8b4f-532e43e80fd6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.303969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2eb7bcfb-7cea-4a46-8b4f-532e43e80fd6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.326921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2eb7bcfb-7cea-4a46-8b4f-532e43e80fd6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Going to try to stop instance {{(pid=135679) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 21:10:12.365353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c23844c-61b3-41ec-afca-2e71b9d48f54 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:12.366301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2c23844c-61b3-41ec-afca-2e71b9d48f54 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:12.372923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c23844c-61b3-41ec-afca-2e71b9d48f54 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.373450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c23844c-61b3-41ec-afca-2e71b9d48f54 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.374231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c23844c-61b3-41ec-afca-2e71b9d48f54 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.374703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c23844c-61b3-41ec-afca-2e71b9d48f54 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.379051 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2eb7bcfb-7cea-4a46-8b4f-532e43e80fd6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "POST /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.086932 Nov 27 21:10:12.379714 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2980/6074] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:12 2021] POST /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:12.388193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:12.388989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:12.396087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.396961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.397988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:12.398635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:12.425191 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2c23844c-61b3-41ec-afca-2e71b9d48f54 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.065434 Nov 27 21:10:12.426673 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3095/6075] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:12 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:12.539121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:12.547224 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-471f74c1-bf16-46c8-af5f-1dd5018499d7 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.163002 Nov 27 21:10:12.547828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2981/6076] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:12 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:13.256653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4d8a506-e7ba-4638-a981-92a0066da80b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:13.257652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4d8a506-e7ba-4638-a981-92a0066da80b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:13.265142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d8a506-e7ba-4638-a981-92a0066da80b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:13.265583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d8a506-e7ba-4638-a981-92a0066da80b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:13.266348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d8a506-e7ba-4638-a981-92a0066da80b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:13.266780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4d8a506-e7ba-4638-a981-92a0066da80b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:13.305188 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4d8a506-e7ba-4638-a981-92a0066da80b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.052446 Nov 27 21:10:13.306052 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3096/6077] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:13 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:13.437412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3deb7d8-4238-46be-8b81-ec6b129c919a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:13.438365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3deb7d8-4238-46be-8b81-ec6b129c919a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:13.445285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3deb7d8-4238-46be-8b81-ec6b129c919a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:13.445747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3deb7d8-4238-46be-8b81-ec6b129c919a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:13.446539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3deb7d8-4238-46be-8b81-ec6b129c919a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:13.446990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3deb7d8-4238-46be-8b81-ec6b129c919a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:13.485940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3deb7d8-4238-46be-8b81-ec6b129c919a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.052733 Nov 27 21:10:13.486782 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2982/6078] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:13 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:13.565613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:13.566305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:13.573623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:13.574077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:13.574870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:13.575333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:13.707788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:13.715219 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-94977053-cd41-4586-8e26-c79137e395f1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.153654 Nov 27 21:10:13.715815 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3097/6079] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:13 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:14.317865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-795065bc-3517-4f43-85e2-d1e9581140d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:14.318881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-795065bc-3517-4f43-85e2-d1e9581140d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:14.326004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-795065bc-3517-4f43-85e2-d1e9581140d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:14.326496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-795065bc-3517-4f43-85e2-d1e9581140d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:14.327305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-795065bc-3517-4f43-85e2-d1e9581140d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:14.327760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-795065bc-3517-4f43-85e2-d1e9581140d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:14.369220 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-795065bc-3517-4f43-85e2-d1e9581140d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.055095 Nov 27 21:10:14.370092 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2983/6080] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:14 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:14.497122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd588993-e5f0-42cd-a74e-e60d32f0feed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:14.498672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd588993-e5f0-42cd-a74e-e60d32f0feed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:14.504995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd588993-e5f0-42cd-a74e-e60d32f0feed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:14.505445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd588993-e5f0-42cd-a74e-e60d32f0feed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:14.506207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd588993-e5f0-42cd-a74e-e60d32f0feed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:14.506640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd588993-e5f0-42cd-a74e-e60d32f0feed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:14.544544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd588993-e5f0-42cd-a74e-e60d32f0feed tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.051488 Nov 27 21:10:14.545678 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3098/6081] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:14 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:14.733502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:14.734112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:14.741488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:14.741935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:14.742707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:14.743144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:14.872251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:14.880074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce4ecc27-7241-4692-936e-234cf14d6cac tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.151314 Nov 27 21:10:14.880644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2984/6082] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:14 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:15.381518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5e49e69-dd08-4088-ad03-8960c6195e4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:15.382522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5e49e69-dd08-4088-ad03-8960c6195e4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:15.390458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e49e69-dd08-4088-ad03-8960c6195e4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:15.390916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e49e69-dd08-4088-ad03-8960c6195e4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:15.391803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e49e69-dd08-4088-ad03-8960c6195e4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:15.392250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e49e69-dd08-4088-ad03-8960c6195e4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:15.433199 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5e49e69-dd08-4088-ad03-8960c6195e4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.055635 Nov 27 21:10:15.433855 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3099/6083] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:15 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:15.556495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2c520d9-5c11-4706-a97d-4feb85548305 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:15.557452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2c520d9-5c11-4706-a97d-4feb85548305 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:15.563935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2c520d9-5c11-4706-a97d-4feb85548305 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:15.564383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2c520d9-5c11-4706-a97d-4feb85548305 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:15.565165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2c520d9-5c11-4706-a97d-4feb85548305 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:15.565600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2c520d9-5c11-4706-a97d-4feb85548305 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:15.605069 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2c520d9-5c11-4706-a97d-4feb85548305 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.052181 Nov 27 21:10:15.605694 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2985/6084] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:15 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:15.897875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:15.898576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:15.906478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:15.906931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:15.907744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:15.908188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:16.040069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:16.048087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-74b5d667-24e2-4502-b31b-347e300d9b3b tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.154327 Nov 27 21:10:16.048666 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3100/6085] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:15 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:16.444842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-670f37c0-5469-44ad-a28e-7ecc23985d2f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:16.445860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-670f37c0-5469-44ad-a28e-7ecc23985d2f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:16.453555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f37c0-5469-44ad-a28e-7ecc23985d2f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:16.454012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f37c0-5469-44ad-a28e-7ecc23985d2f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:16.454799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f37c0-5469-44ad-a28e-7ecc23985d2f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:16.455241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-670f37c0-5469-44ad-a28e-7ecc23985d2f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:16.500226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-670f37c0-5469-44ad-a28e-7ecc23985d2f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059401 Nov 27 21:10:16.500856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2986/6086] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:16 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:16.617106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c34c29ee-4470-4201-8f6a-3fbe3d4cd7ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:16.618057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c34c29ee-4470-4201-8f6a-3fbe3d4cd7ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:16.626397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c34c29ee-4470-4201-8f6a-3fbe3d4cd7ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:16.626845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c34c29ee-4470-4201-8f6a-3fbe3d4cd7ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:16.627661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c34c29ee-4470-4201-8f6a-3fbe3d4cd7ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:16.628100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c34c29ee-4470-4201-8f6a-3fbe3d4cd7ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:16.669042 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c34c29ee-4470-4201-8f6a-3fbe3d4cd7ec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055593 Nov 27 21:10:16.670319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3101/6087] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:16 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:17.066260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:17.066957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:17.074347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:17.074800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:17.075644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:17.076459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:17.212830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:17.220661 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75f664f2-e6b3-413e-a4f4-5082a594e7af tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.159405 Nov 27 21:10:17.221233 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2987/6088] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:17 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:17.511838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d73e6ac-9593-4f6f-9a95-02668a8cd9a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:17.512877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d73e6ac-9593-4f6f-9a95-02668a8cd9a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:17.519968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d73e6ac-9593-4f6f-9a95-02668a8cd9a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:17.520424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d73e6ac-9593-4f6f-9a95-02668a8cd9a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:17.521233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d73e6ac-9593-4f6f-9a95-02668a8cd9a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:17.521671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d73e6ac-9593-4f6f-9a95-02668a8cd9a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:17.566211 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d73e6ac-9593-4f6f-9a95-02668a8cd9a4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.058429 Nov 27 21:10:17.566889 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3102/6089] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:17 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:17.681430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-51c7afbf-c4d2-43b5-8b73-7c2134cec046 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:17.682387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-51c7afbf-c4d2-43b5-8b73-7c2134cec046 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:17.692440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c7afbf-c4d2-43b5-8b73-7c2134cec046 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:17.692900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c7afbf-c4d2-43b5-8b73-7c2134cec046 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:17.693687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c7afbf-c4d2-43b5-8b73-7c2134cec046 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:17.694137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51c7afbf-c4d2-43b5-8b73-7c2134cec046 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:17.734090 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-51c7afbf-c4d2-43b5-8b73-7c2134cec046 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.055584 Nov 27 21:10:17.734622 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2988/6090] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:17 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:18.238005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:18.238692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:18.245915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:18.246359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:18.247122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:18.247583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:18.381360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:18.388655 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa009d0c-14c6-42fc-a161-68e97012edb5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.154940 Nov 27 21:10:18.389215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3103/6091] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:18 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:18.578054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d1550a0-8cdc-4670-807d-22feb5127def tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:18.579068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d1550a0-8cdc-4670-807d-22feb5127def tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:18.586171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d1550a0-8cdc-4670-807d-22feb5127def tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:18.586630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d1550a0-8cdc-4670-807d-22feb5127def tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:18.587445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d1550a0-8cdc-4670-807d-22feb5127def tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:18.587888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d1550a0-8cdc-4670-807d-22feb5127def tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:18.630280 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d1550a0-8cdc-4670-807d-22feb5127def tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.056783 Nov 27 21:10:18.630894 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2989/6092] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:18 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:18.745808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0f95015-7836-415e-ac0e-600ee2fdebce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:18.746713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0f95015-7836-415e-ac0e-600ee2fdebce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:18.753675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f95015-7836-415e-ac0e-600ee2fdebce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:18.754122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f95015-7836-415e-ac0e-600ee2fdebce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:18.754885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f95015-7836-415e-ac0e-600ee2fdebce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:18.755347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f95015-7836-415e-ac0e-600ee2fdebce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:18.793152 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0f95015-7836-415e-ac0e-600ee2fdebce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.051213 Nov 27 21:10:18.793835 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3104/6093] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:18 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:19.407185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:19.407906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:19.415276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:19.415740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:19.416520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:19.416962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:19.550227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:19.557895 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29311ea9-4a56-41ea-ad4b-20c4e807e0d5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.155300 Nov 27 21:10:19.558464 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2990/6094] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:19 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:19.643130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9654c2a2-2374-4c64-bbff-5c761138229b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:19.644168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9654c2a2-2374-4c64-bbff-5c761138229b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:19.651476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9654c2a2-2374-4c64-bbff-5c761138229b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:19.651926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9654c2a2-2374-4c64-bbff-5c761138229b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:19.652695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9654c2a2-2374-4c64-bbff-5c761138229b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:19.653127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9654c2a2-2374-4c64-bbff-5c761138229b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:19.697429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9654c2a2-2374-4c64-bbff-5c761138229b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.058721 Nov 27 21:10:19.698042 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3105/6095] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:19 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:19.805147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a9d1114-c9ce-4cab-843b-7aac682ec83e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:19.806074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a9d1114-c9ce-4cab-843b-7aac682ec83e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:19.812976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9d1114-c9ce-4cab-843b-7aac682ec83e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:19.813427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9d1114-c9ce-4cab-843b-7aac682ec83e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:19.814209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9d1114-c9ce-4cab-843b-7aac682ec83e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:19.814647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a9d1114-c9ce-4cab-843b-7aac682ec83e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:19.855006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a9d1114-c9ce-4cab-843b-7aac682ec83e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 24572 microversion: 2.20 time: 0.053479 Nov 27 21:10:19.855657 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2991/6096] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:19 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:20.575308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:20.576013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:20.583267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:20.583743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:20.584527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:20.584987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:20.709664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-88a429a1-13fe-434e-a60a-d0e101c924c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:20.710589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-88a429a1-13fe-434e-a60a-d0e101c924c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:20.717139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:20.718576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88a429a1-13fe-434e-a60a-d0e101c924c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:20.719012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88a429a1-13fe-434e-a60a-d0e101c924c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:20.719856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88a429a1-13fe-434e-a60a-d0e101c924c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:20.720293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-88a429a1-13fe-434e-a60a-d0e101c924c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:20.725353 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1fdacf3-3478-4cea-94d0-d508c6d68823 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.154135 Nov 27 21:10:20.726061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3106/6097] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:20 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:20.771470 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-88a429a1-13fe-434e-a60a-d0e101c924c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.065813 Nov 27 21:10:20.772313 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2992/6098] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:20 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:20.866509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-139e33d9-b79c-484a-9360-0305c1856f82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:20.867476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-139e33d9-b79c-484a-9360-0305c1856f82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:20.874879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-139e33d9-b79c-484a-9360-0305c1856f82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:20.875385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-139e33d9-b79c-484a-9360-0305c1856f82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:20.876154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-139e33d9-b79c-484a-9360-0305c1856f82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:20.876599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-139e33d9-b79c-484a-9360-0305c1856f82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:20.931470 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-139e33d9-b79c-484a-9360-0305c1856f82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.068702 Nov 27 21:10:20.932118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3107/6099] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:20 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:21.743321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:21.744216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:21.752052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:21.752502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:21.753277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:21.753712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:21.783160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a18359ba-c944-4a48-bebe-8986c5fbd4d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:21.784194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a18359ba-c944-4a48-bebe-8986c5fbd4d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:21.791731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a18359ba-c944-4a48-bebe-8986c5fbd4d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:21.792190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a18359ba-c944-4a48-bebe-8986c5fbd4d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:21.792979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a18359ba-c944-4a48-bebe-8986c5fbd4d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:21.793525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a18359ba-c944-4a48-bebe-8986c5fbd4d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:21.835476 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a18359ba-c944-4a48-bebe-8986c5fbd4d3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.055967 Nov 27 21:10:21.836156 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3108/6100] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:21 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:21.886388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:21.894475 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1bbb647f-2bbd-49f5-9bac-b7c52d92ba8a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.155364 Nov 27 21:10:21.895044 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2993/6101] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:21 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:21.943507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de762198-c068-43fc-8452-a33ace813cdd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:21.944517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de762198-c068-43fc-8452-a33ace813cdd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:21.952489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de762198-c068-43fc-8452-a33ace813cdd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:21.952940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de762198-c068-43fc-8452-a33ace813cdd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:21.953719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de762198-c068-43fc-8452-a33ace813cdd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:21.954158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de762198-c068-43fc-8452-a33ace813cdd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:21.998006 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de762198-c068-43fc-8452-a33ace813cdd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.058392 Nov 27 21:10:21.998571 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3109/6102] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:21 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:22.847486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5cd708a5-99ec-4694-a344-63ce463de106 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:22.848478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5cd708a5-99ec-4694-a344-63ce463de106 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:22.859187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cd708a5-99ec-4694-a344-63ce463de106 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:22.859681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cd708a5-99ec-4694-a344-63ce463de106 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:22.860476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cd708a5-99ec-4694-a344-63ce463de106 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:22.860925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5cd708a5-99ec-4694-a344-63ce463de106 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:22.906221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5cd708a5-99ec-4694-a344-63ce463de106 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.062475 Nov 27 21:10:22.907163 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2994/6103] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:22 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:22.912707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:22.913435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:22.921433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:22.921891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:22.922676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:22.923119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:23.010111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-03ab223d-167d-4f00-ad28-a3cf883ed470 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:23.011121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-03ab223d-167d-4f00-ad28-a3cf883ed470 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:23.018282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ab223d-167d-4f00-ad28-a3cf883ed470 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:23.018736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ab223d-167d-4f00-ad28-a3cf883ed470 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:23.019567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ab223d-167d-4f00-ad28-a3cf883ed470 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:23.020013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ab223d-167d-4f00-ad28-a3cf883ed470 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:23.056007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:23.063402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16de2076-2f29-493b-9005-22d410d2addc tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.154676 Nov 27 21:10:23.063975 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3110/6104] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:22 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:23.069913 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-03ab223d-167d-4f00-ad28-a3cf883ed470 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.063691 Nov 27 21:10:23.070662 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2995/6105] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:23 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:23.917750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4108b1ba-ea8d-44b0-b9f6-9ecbeb451e87 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:23.918669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4108b1ba-ea8d-44b0-b9f6-9ecbeb451e87 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:23.926715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4108b1ba-ea8d-44b0-b9f6-9ecbeb451e87 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:23.927166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4108b1ba-ea8d-44b0-b9f6-9ecbeb451e87 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:23.927973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4108b1ba-ea8d-44b0-b9f6-9ecbeb451e87 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:23.928406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4108b1ba-ea8d-44b0-b9f6-9ecbeb451e87 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:23.973431 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4108b1ba-ea8d-44b0-b9f6-9ecbeb451e87 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059233 Nov 27 21:10:23.974081 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3111/6106] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:23 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:24.081126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:24.081829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:24.085867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-62efc05f-3662-4db9-b712-6f6bcf968b2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:24.086881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-62efc05f-3662-4db9-b712-6f6bcf968b2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:24.089366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:24.089811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:24.090605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:24.091045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:24.094698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62efc05f-3662-4db9-b712-6f6bcf968b2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:24.095163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62efc05f-3662-4db9-b712-6f6bcf968b2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:24.095983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62efc05f-3662-4db9-b712-6f6bcf968b2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:24.096430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62efc05f-3662-4db9-b712-6f6bcf968b2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:24.145928 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-62efc05f-3662-4db9-b712-6f6bcf968b2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.063945 Nov 27 21:10:24.146803 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3112/6107] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:24 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:24.235641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:24.243035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6fe65d66-4b91-4701-941e-cdd25a4bb1fe tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.166500 Nov 27 21:10:24.243644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2996/6108] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:24 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:24.986047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d76f130-8c99-439c-a00e-ebfe860c0423 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:24.987052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8d76f130-8c99-439c-a00e-ebfe860c0423 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:24.994645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d76f130-8c99-439c-a00e-ebfe860c0423 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:24.995096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d76f130-8c99-439c-a00e-ebfe860c0423 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:24.995899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d76f130-8c99-439c-a00e-ebfe860c0423 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:24.996339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d76f130-8c99-439c-a00e-ebfe860c0423 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:25.043522 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d76f130-8c99-439c-a00e-ebfe860c0423 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.061908 Nov 27 21:10:25.044183 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3113/6109] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:24 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:25.157712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-747fc548-6483-4aa2-bd29-f196cac6cdb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:25.158686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-747fc548-6483-4aa2-bd29-f196cac6cdb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:25.165509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-747fc548-6483-4aa2-bd29-f196cac6cdb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:25.165965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-747fc548-6483-4aa2-bd29-f196cac6cdb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:25.166751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-747fc548-6483-4aa2-bd29-f196cac6cdb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:25.167196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-747fc548-6483-4aa2-bd29-f196cac6cdb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:25.206896 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-747fc548-6483-4aa2-bd29-f196cac6cdb8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.053408 Nov 27 21:10:25.207834 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2997/6110] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:25 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:25.261468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:25.262274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:25.269269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:25.269723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:25.270494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:25.270924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:25.404786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:25.412864 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4db73f92-83c2-4341-97d7-3671749b6216 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.155555 Nov 27 21:10:25.413794 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3114/6111] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:25 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:26.056198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b5b4145-e926-41fc-862e-6139e1e6fa1a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:26.057217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b5b4145-e926-41fc-862e-6139e1e6fa1a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:26.064868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5b4145-e926-41fc-862e-6139e1e6fa1a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:26.065336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5b4145-e926-41fc-862e-6139e1e6fa1a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:26.066127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5b4145-e926-41fc-862e-6139e1e6fa1a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:26.066576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5b4145-e926-41fc-862e-6139e1e6fa1a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:26.112172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b5b4145-e926-41fc-862e-6139e1e6fa1a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059997 Nov 27 21:10:26.112836 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2998/6112] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:26 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:26.218507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5deb05e4-01a9-47e4-9459-ee1eeafb86ce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:26.219490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5deb05e4-01a9-47e4-9459-ee1eeafb86ce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:26.226139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5deb05e4-01a9-47e4-9459-ee1eeafb86ce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:26.226586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5deb05e4-01a9-47e4-9459-ee1eeafb86ce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:26.227373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5deb05e4-01a9-47e4-9459-ee1eeafb86ce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:26.227808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5deb05e4-01a9-47e4-9459-ee1eeafb86ce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:26.270450 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5deb05e4-01a9-47e4-9459-ee1eeafb86ce tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055443 Nov 27 21:10:26.271091 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3115/6113] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:26 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:26.430385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:26.431014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:26.439198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:26.439686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:26.440483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:26.440936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:26.568829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:26.576705 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d88f7dc5-6aa5-4d3c-96f8-4cf904a5e1b1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.150529 Nov 27 21:10:26.577287 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 2999/6114] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:26 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:27.123759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a121a6f7-65e0-4eac-9c5f-775536ccf419 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:27.124757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a121a6f7-65e0-4eac-9c5f-775536ccf419 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:27.131713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a121a6f7-65e0-4eac-9c5f-775536ccf419 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:27.132165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a121a6f7-65e0-4eac-9c5f-775536ccf419 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:27.132940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a121a6f7-65e0-4eac-9c5f-775536ccf419 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:27.133380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a121a6f7-65e0-4eac-9c5f-775536ccf419 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:27.178690 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a121a6f7-65e0-4eac-9c5f-775536ccf419 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.058941 Nov 27 21:10:27.179336 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3116/6115] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:27 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:27.282667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6af58337-2fbf-4508-aa19-d0c2f8819864 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:27.283623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6af58337-2fbf-4508-aa19-d0c2f8819864 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:27.289999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af58337-2fbf-4508-aa19-d0c2f8819864 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:27.290448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af58337-2fbf-4508-aa19-d0c2f8819864 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:27.291222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af58337-2fbf-4508-aa19-d0c2f8819864 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:27.291682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af58337-2fbf-4508-aa19-d0c2f8819864 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:27.334819 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6af58337-2fbf-4508-aa19-d0c2f8819864 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.056390 Nov 27 21:10:27.335504 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3000/6116] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:27 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:27.593879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:27.594591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:27.601902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:27.602350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:27.603121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:27.603595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:27.731941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:27.741558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5340bee4-598a-46c4-9c19-5141283ca936 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.151688 Nov 27 21:10:27.742145 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3117/6117] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:27 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:28.190675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89156502-995e-46c1-a11f-ab0dba83a83b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:28.191883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89156502-995e-46c1-a11f-ab0dba83a83b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:28.199206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89156502-995e-46c1-a11f-ab0dba83a83b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:28.199687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89156502-995e-46c1-a11f-ab0dba83a83b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:28.200469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89156502-995e-46c1-a11f-ab0dba83a83b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:28.200913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89156502-995e-46c1-a11f-ab0dba83a83b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:28.246046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89156502-995e-46c1-a11f-ab0dba83a83b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059304 Nov 27 21:10:28.246700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3001/6118] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:28 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:28.348130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-692208c8-76f4-48b1-8040-551a03a57d46 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:28.349073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-692208c8-76f4-48b1-8040-551a03a57d46 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:28.355888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-692208c8-76f4-48b1-8040-551a03a57d46 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:28.356330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-692208c8-76f4-48b1-8040-551a03a57d46 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:28.357097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-692208c8-76f4-48b1-8040-551a03a57d46 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:28.357530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-692208c8-76f4-48b1-8040-551a03a57d46 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:28.399208 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-692208c8-76f4-48b1-8040-551a03a57d46 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055105 Nov 27 21:10:28.399891 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3118/6119] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:28 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:28.759988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:28.760690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:28.768274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:28.768727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:28.769517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:28.769957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:28.902511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:28.909858 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86709884-8e7f-4a65-b63e-bde8e53b1298 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.153966 Nov 27 21:10:28.910427 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3002/6120] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:28 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:29.258097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b1377b1-cda0-4fbb-97f0-12b667d0eac5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:29.259200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b1377b1-cda0-4fbb-97f0-12b667d0eac5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:29.267468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b1377b1-cda0-4fbb-97f0-12b667d0eac5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:29.267923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b1377b1-cda0-4fbb-97f0-12b667d0eac5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:29.268706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b1377b1-cda0-4fbb-97f0-12b667d0eac5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:29.269149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b1377b1-cda0-4fbb-97f0-12b667d0eac5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:29.313940 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b1377b1-cda0-4fbb-97f0-12b667d0eac5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059866 Nov 27 21:10:29.315308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3119/6121] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:29 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:29.410755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0f8912c-912a-46b2-98a1-d1b53c2c1821 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:29.411719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0f8912c-912a-46b2-98a1-d1b53c2c1821 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:29.419275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f8912c-912a-46b2-98a1-d1b53c2c1821 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:29.419740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f8912c-912a-46b2-98a1-d1b53c2c1821 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:29.421046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f8912c-912a-46b2-98a1-d1b53c2c1821 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:29.421494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0f8912c-912a-46b2-98a1-d1b53c2c1821 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:29.462092 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0f8912c-912a-46b2-98a1-d1b53c2c1821 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.054965 Nov 27 21:10:29.462736 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3003/6122] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:29 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:29.926925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:29.927591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:29.934525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:29.934974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:29.935790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:29.936263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:30.068282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:30.076146 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-94c6e2e2-d57a-48cd-9864-0c274d9c07ab tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.153457 Nov 27 21:10:30.077219 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3120/6123] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:29 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:30.327465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81981b84-6bf8-4598-807a-c7eeca972cb1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:30.328519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81981b84-6bf8-4598-807a-c7eeca972cb1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:30.336121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81981b84-6bf8-4598-807a-c7eeca972cb1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:30.336581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81981b84-6bf8-4598-807a-c7eeca972cb1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:30.337436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81981b84-6bf8-4598-807a-c7eeca972cb1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:30.337885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81981b84-6bf8-4598-807a-c7eeca972cb1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:30.378431 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81981b84-6bf8-4598-807a-c7eeca972cb1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.055633 Nov 27 21:10:30.379330 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3004/6124] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:30 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:30.473713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27351fcc-d73a-4754-a504-4b2398eae1f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:30.474644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27351fcc-d73a-4754-a504-4b2398eae1f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:30.482136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27351fcc-d73a-4754-a504-4b2398eae1f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:30.482588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27351fcc-d73a-4754-a504-4b2398eae1f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:30.483390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27351fcc-d73a-4754-a504-4b2398eae1f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:30.483832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27351fcc-d73a-4754-a504-4b2398eae1f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:30.525147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27351fcc-d73a-4754-a504-4b2398eae1f1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055082 Nov 27 21:10:30.525783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3121/6125] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:30 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:31.094821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:31.095586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:31.103492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:31.103963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:31.104768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:31.105218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:31.235699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:31.243597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-127cad4b-7be8-4841-bc27-808ae11f7dc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.153316 Nov 27 21:10:31.244426 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3005/6126] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:31 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:31.391204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06b9b65d-6d70-4e24-abe6-10ac2b37c25f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:31.392151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06b9b65d-6d70-4e24-abe6-10ac2b37c25f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:31.399056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9b65d-6d70-4e24-abe6-10ac2b37c25f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:31.399574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9b65d-6d70-4e24-abe6-10ac2b37c25f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:31.400352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9b65d-6d70-4e24-abe6-10ac2b37c25f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:31.400793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06b9b65d-6d70-4e24-abe6-10ac2b37c25f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:31.447809 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06b9b65d-6d70-4e24-abe6-10ac2b37c25f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.061089 Nov 27 21:10:31.448349 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3122/6127] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:31 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:31.536759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a33647b2-64b4-489c-af68-23e02840d7fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:31.537672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a33647b2-64b4-489c-af68-23e02840d7fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:31.547862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33647b2-64b4-489c-af68-23e02840d7fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:31.548316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33647b2-64b4-489c-af68-23e02840d7fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:31.549088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33647b2-64b4-489c-af68-23e02840d7fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:31.549521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a33647b2-64b4-489c-af68-23e02840d7fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:31.588089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a33647b2-64b4-489c-af68-23e02840d7fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.054979 Nov 27 21:10:31.589077 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3006/6128] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:31 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:32.261330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:32.262054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:32.270073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:32.270525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:32.271338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:32.271780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:32.459807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-965c6e13-eabb-4f7b-8d30-04ea4a3b8f73 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:32.460854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-965c6e13-eabb-4f7b-8d30-04ea4a3b8f73 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:32.462005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:32.468846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-965c6e13-eabb-4f7b-8d30-04ea4a3b8f73 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:32.469307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-965c6e13-eabb-4f7b-8d30-04ea4a3b8f73 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:32.470109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-965c6e13-eabb-4f7b-8d30-04ea4a3b8f73 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:32.470307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a6c53cc1-9991-435f-9138-0606588ad7d2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.213073 Nov 27 21:10:32.470558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-965c6e13-eabb-4f7b-8d30-04ea4a3b8f73 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:32.470885 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3123/6129] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:32 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:32.517579 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-965c6e13-eabb-4f7b-8d30-04ea4a3b8f73 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.061705 Nov 27 21:10:32.518134 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3007/6130] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:32 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:32.599991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e1d40cc-9fd2-45f3-9a9a-8d5939de5220 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:32.600911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e1d40cc-9fd2-45f3-9a9a-8d5939de5220 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:32.607203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e1d40cc-9fd2-45f3-9a9a-8d5939de5220 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:32.607714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e1d40cc-9fd2-45f3-9a9a-8d5939de5220 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:32.608483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e1d40cc-9fd2-45f3-9a9a-8d5939de5220 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:32.608924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e1d40cc-9fd2-45f3-9a9a-8d5939de5220 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:32.652739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e1d40cc-9fd2-45f3-9a9a-8d5939de5220 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.056336 Nov 27 21:10:32.653371 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3124/6131] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:32 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:33.488307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:33.489009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:33.496676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:33.497130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:33.497937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:33.498382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:33.530165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c55ede8-0631-49ea-8b98-e9a4fceb9796 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:33.531197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c55ede8-0631-49ea-8b98-e9a4fceb9796 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:33.538658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c55ede8-0631-49ea-8b98-e9a4fceb9796 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:33.539109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c55ede8-0631-49ea-8b98-e9a4fceb9796 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:33.539938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c55ede8-0631-49ea-8b98-e9a4fceb9796 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:33.540378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c55ede8-0631-49ea-8b98-e9a4fceb9796 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:33.587104 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c55ede8-0631-49ea-8b98-e9a4fceb9796 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.061504 Nov 27 21:10:33.588009 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3125/6132] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:33 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:33.629573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:33.637569 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9883e5fa-85f2-4592-8dec-d9c30f817198 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.153332 Nov 27 21:10:33.638109 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3008/6133] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:33 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:33.664842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-544fe103-b3a3-4149-9d12-5e421fb3eaea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:33.665842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-544fe103-b3a3-4149-9d12-5e421fb3eaea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:33.673357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544fe103-b3a3-4149-9d12-5e421fb3eaea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:33.673811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544fe103-b3a3-4149-9d12-5e421fb3eaea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:33.674582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544fe103-b3a3-4149-9d12-5e421fb3eaea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:33.675023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-544fe103-b3a3-4149-9d12-5e421fb3eaea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:33.714203 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-544fe103-b3a3-4149-9d12-5e421fb3eaea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.053222 Nov 27 21:10:33.714752 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3126/6134] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:33 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:34.597969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4262afdb-3392-41a3-984e-2d47cebdc700 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:34.598829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4262afdb-3392-41a3-984e-2d47cebdc700 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:34.606457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4262afdb-3392-41a3-984e-2d47cebdc700 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:34.606917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4262afdb-3392-41a3-984e-2d47cebdc700 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:34.608227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4262afdb-3392-41a3-984e-2d47cebdc700 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:34.608677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4262afdb-3392-41a3-984e-2d47cebdc700 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:34.650504 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4262afdb-3392-41a3-984e-2d47cebdc700 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.056156 Nov 27 21:10:34.651300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3009/6135] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:34 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:34.654490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:34.655177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:34.662507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:34.662952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:34.663747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:34.664178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:34.726681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f2e5297-97cb-44c7-ba50-fb6c1392e7a5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:34.727823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f2e5297-97cb-44c7-ba50-fb6c1392e7a5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:34.735349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f2e5297-97cb-44c7-ba50-fb6c1392e7a5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:34.735816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f2e5297-97cb-44c7-ba50-fb6c1392e7a5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:34.736618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f2e5297-97cb-44c7-ba50-fb6c1392e7a5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:34.737068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f2e5297-97cb-44c7-ba50-fb6c1392e7a5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:34.777758 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f2e5297-97cb-44c7-ba50-fb6c1392e7a5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055178 Nov 27 21:10:34.779276 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3010/6136] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:34 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:34.793698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:34.802125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c621d10b-595c-4895-b6ef-2bce7b9eb081 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.151936 Nov 27 21:10:34.802694 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3127/6137] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:34 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:35.662417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-79c7157c-5c42-4800-9ae9-4b4f3588e5e7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:35.663466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-79c7157c-5c42-4800-9ae9-4b4f3588e5e7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:35.671556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79c7157c-5c42-4800-9ae9-4b4f3588e5e7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:35.672011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79c7157c-5c42-4800-9ae9-4b4f3588e5e7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:35.672798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79c7157c-5c42-4800-9ae9-4b4f3588e5e7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:35.673242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79c7157c-5c42-4800-9ae9-4b4f3588e5e7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:35.718940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-79c7157c-5c42-4800-9ae9-4b4f3588e5e7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060430 Nov 27 21:10:35.719529 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3011/6138] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:35 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:35.789792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6285124c-e5f8-4622-8aa0-0b2b75114371 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:35.790718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6285124c-e5f8-4622-8aa0-0b2b75114371 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:35.798179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6285124c-e5f8-4622-8aa0-0b2b75114371 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:35.798635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6285124c-e5f8-4622-8aa0-0b2b75114371 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:35.799458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6285124c-e5f8-4622-8aa0-0b2b75114371 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:35.799911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6285124c-e5f8-4622-8aa0-0b2b75114371 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:35.819375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:35.820081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:35.827087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:35.827578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:35.828368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:35.828810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:35.839678 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6285124c-e5f8-4622-8aa0-0b2b75114371 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.053439 Nov 27 21:10:35.840547 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3128/6139] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:35 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:35.965911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:35.973946 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-935dc999-8ee0-43ae-92bf-70ea8a310bf6 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.158629 Nov 27 21:10:35.974460 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3012/6140] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:35 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:36.730527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8fc30583-70d6-45c2-b674-639ece3bb9a3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:36.731506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8fc30583-70d6-45c2-b674-639ece3bb9a3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:36.738990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc30583-70d6-45c2-b674-639ece3bb9a3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:36.739481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc30583-70d6-45c2-b674-639ece3bb9a3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:36.740257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc30583-70d6-45c2-b674-639ece3bb9a3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:36.740694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fc30583-70d6-45c2-b674-639ece3bb9a3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:36.785877 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8fc30583-70d6-45c2-b674-639ece3bb9a3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059429 Nov 27 21:10:36.786498 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3129/6141] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:36 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:36.851953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8be59fcf-ba3d-4925-9917-a62c7bec0f81 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:36.852913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8be59fcf-ba3d-4925-9917-a62c7bec0f81 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:36.860868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8be59fcf-ba3d-4925-9917-a62c7bec0f81 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:36.861318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8be59fcf-ba3d-4925-9917-a62c7bec0f81 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:36.862094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8be59fcf-ba3d-4925-9917-a62c7bec0f81 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:36.862527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8be59fcf-ba3d-4925-9917-a62c7bec0f81 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:36.901559 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8be59fcf-ba3d-4925-9917-a62c7bec0f81 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.053295 Nov 27 21:10:36.902601 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3013/6142] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:36 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:36.991485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:36.992100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:37.000455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:37.000903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:37.001678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:37.002119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:37.136464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:37.143829 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d7e8c9c-9163-4a47-bebc-2d2aa3c99bc1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1509 microversion: 2.1 time: 0.156546 Nov 27 21:10:37.144408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3130/6143] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:36 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:37.797675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2e0fac3f-4188-40d2-a1e9-bafa34e12581 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:37.798724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2e0fac3f-4188-40d2-a1e9-bafa34e12581 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:37.805778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e0fac3f-4188-40d2-a1e9-bafa34e12581 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:37.806260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e0fac3f-4188-40d2-a1e9-bafa34e12581 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:37.807042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e0fac3f-4188-40d2-a1e9-bafa34e12581 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:37.807520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e0fac3f-4188-40d2-a1e9-bafa34e12581 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:37.851471 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2e0fac3f-4188-40d2-a1e9-bafa34e12581 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.057742 Nov 27 21:10:37.852153 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3014/6144] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:37 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:37.913746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd5d2ebe-349b-4985-b6e0-f8f97e83aa68 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:37.914698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd5d2ebe-349b-4985-b6e0-f8f97e83aa68 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:37.921054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd5d2ebe-349b-4985-b6e0-f8f97e83aa68 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:37.921504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd5d2ebe-349b-4985-b6e0-f8f97e83aa68 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:37.922278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd5d2ebe-349b-4985-b6e0-f8f97e83aa68 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:37.922716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd5d2ebe-349b-4985-b6e0-f8f97e83aa68 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:37.964806 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd5d2ebe-349b-4985-b6e0-f8f97e83aa68 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.054656 Nov 27 21:10:37.965443 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3131/6145] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:37 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:38.161417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:38.162025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.169672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.170617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.171434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.171875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.310430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:38.318519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-347c876f-3cab-44cf-9556-1e1ab12ede1a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1486 microversion: 2.1 time: 0.161345 Nov 27 21:10:38.319094 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3015/6146] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:38 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1486 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:38.335208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27b344db-398a-4364-ac3b-7da0c8dde706 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-856760239"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:38.336526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27b344db-398a-4364-ac3b-7da0c8dde706 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.344003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27b344db-398a-4364-ac3b-7da0c8dde706 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.344457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27b344db-398a-4364-ac3b-7da0c8dde706 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.345242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27b344db-398a-4364-ac3b-7da0c8dde706 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.345674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27b344db-398a-4364-ac3b-7da0c8dde706 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.409288 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27b344db-398a-4364-ac3b-7da0c8dde706 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "PUT /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1060 microversion: 2.1 time: 0.078113 Nov 27 21:10:38.409935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3132/6147] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:10:38 2021] PUT /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1060 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:38.424135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:38.424687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.431963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.432426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.433227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.433669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.571585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:38.579091 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1ccedd8b-a982-42b0-8c0c-8ea96ae9cb68 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1487 microversion: 2.1 time: 0.159158 Nov 27 21:10:38.579697 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3016/6148] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:38 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1487 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:38.595435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:38.596032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.602349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.602799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.603605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.604038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.738027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:38.745873 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-935d91f2-5cef-4cd4-9ac1-f3e2a0c35387 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1487 microversion: 2.1 time: 0.154690 Nov 27 21:10:38.746459 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3133/6149] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:38 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1487 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:38.761503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:38.761999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.768541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.768995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.769783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.770222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.795839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:10:38.863565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40ac07d5-5823-4916-ae3a-de2248391edd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:38.864492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40ac07d5-5823-4916-ae3a-de2248391edd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.871040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ac07d5-5823-4916-ae3a-de2248391edd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.871526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ac07d5-5823-4916-ae3a-de2248391edd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.872349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ac07d5-5823-4916-ae3a-de2248391edd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.872793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ac07d5-5823-4916-ae3a-de2248391edd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.875050 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a35d6dc4-084d-4d35-8283-b2c8f032d30f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 204 len: 0 microversion: 2.1 time: 0.116867 Nov 27 21:10:38.876277 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3017/6150] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:38 2021] DELETE /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:10:38.884457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:38.885164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.891752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.892241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.893098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.893543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.923053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40ac07d5-5823-4916-ae3a-de2248391edd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.062962 Nov 27 21:10:38.923982 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3134/6151] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:38 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:38.976588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e198c873-0783-45a1-917f-d03df0b5af14 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:38.977666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e198c873-0783-45a1-917f-d03df0b5af14 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:38.984854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e198c873-0783-45a1-917f-d03df0b5af14 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.985313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e198c873-0783-45a1-917f-d03df0b5af14 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:38.986096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e198c873-0783-45a1-917f-d03df0b5af14 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:38.986541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e198c873-0783-45a1-917f-d03df0b5af14 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:39.028088 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e198c873-0783-45a1-917f-d03df0b5af14 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055338 Nov 27 21:10:39.028751 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3135/6152] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:38 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:39.090998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:39.100158 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0b7a866-c966-4258-82ba-3a007d7bc709 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1493 microversion: 2.1 time: 0.219704 Nov 27 21:10:39.100933 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3018/6153] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:38 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1493 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:39.935177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f50d333-62ef-412d-a61f-57ab7a7b3211 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:39.936821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f50d333-62ef-412d-a61f-57ab7a7b3211 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:39.944244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f50d333-62ef-412d-a61f-57ab7a7b3211 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:39.944696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f50d333-62ef-412d-a61f-57ab7a7b3211 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:39.945477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f50d333-62ef-412d-a61f-57ab7a7b3211 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:39.945915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f50d333-62ef-412d-a61f-57ab7a7b3211 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:39.990792 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f50d333-62ef-412d-a61f-57ab7a7b3211 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.059624 Nov 27 21:10:39.991460 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3136/6154] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:39 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:40.040348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-680f7ae5-9ec4-43a5-853b-18d95e4112e7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:40.041283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-680f7ae5-9ec4-43a5-853b-18d95e4112e7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:40.048800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680f7ae5-9ec4-43a5-853b-18d95e4112e7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:40.049259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680f7ae5-9ec4-43a5-853b-18d95e4112e7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:40.050083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680f7ae5-9ec4-43a5-853b-18d95e4112e7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:40.050526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680f7ae5-9ec4-43a5-853b-18d95e4112e7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:40.089790 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-680f7ae5-9ec4-43a5-853b-18d95e4112e7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.053077 Nov 27 21:10:40.090414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3019/6155] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:40 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:40.117740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:40.118432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:40.125696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:40.126142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:40.126931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:40.127453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:40.290605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:40.298714 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1bcbe196-1229-41d8-a2fb-52a7e0e9bdd2 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 200 len: 1493 microversion: 2.1 time: 0.185013 Nov 27 21:10:40.299311 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3137/6156] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:40 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 1493 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:40.730243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8832c676-4948-459c-b156-d0e71a2c2516 req-6ae1042a-742b-490d-a525-fb6b2e72c39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8ada76-a85d-40d5-aedc-4323b4072dd2", "name": "network-vif-deleted", "tag": "1c8af7c2-3583-40e3-882c-e5d19b2dce00"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:40.732871 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:10:40.732871 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:10:40.742008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8832c676-4948-459c-b156-d0e71a2c2516 req-6ae1042a-742b-490d-a525-fb6b2e72c39b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:40.742477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8832c676-4948-459c-b156-d0e71a2c2516 req-6ae1042a-742b-490d-a525-fb6b2e72c39b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:40.756431 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8832c676-4948-459c-b156-d0e71a2c2516 req-6ae1042a-742b-490d-a525-fb6b2e72c39b service nova] Creating event network-vif-deleted:1c8af7c2-3583-40e3-882c-e5d19b2dce00 for instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 on nch2-master-1 Nov 27 21:10:40.762234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8832c676-4948-459c-b156-d0e71a2c2516 req-6ae1042a-742b-490d-a525-fb6b2e72c39b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037520 Nov 27 21:10:40.766180 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3020/6157] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:10:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:10:41.002706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-267975c2-f68c-4e96-97ab-4401d58f054b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:41.003569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-267975c2-f68c-4e96-97ab-4401d58f054b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.010346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-267975c2-f68c-4e96-97ab-4401d58f054b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.010799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-267975c2-f68c-4e96-97ab-4401d58f054b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.011629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-267975c2-f68c-4e96-97ab-4401d58f054b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.012072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-267975c2-f68c-4e96-97ab-4401d58f054b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.052024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-267975c2-f68c-4e96-97ab-4401d58f054b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.052922 Nov 27 21:10:41.052901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3138/6158] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:40 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:41.103322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d75edd09-fcf7-43a6-bbdf-38a880d14c6c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:41.104361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d75edd09-fcf7-43a6-bbdf-38a880d14c6c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.112424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75edd09-fcf7-43a6-bbdf-38a880d14c6c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.113007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75edd09-fcf7-43a6-bbdf-38a880d14c6c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.114960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75edd09-fcf7-43a6-bbdf-38a880d14c6c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.115465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75edd09-fcf7-43a6-bbdf-38a880d14c6c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.159075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d75edd09-fcf7-43a6-bbdf-38a880d14c6c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.060544 Nov 27 21:10:41.163077 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3021/6159] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:41 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:41.316546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.317350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.324718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.325169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.325981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.326912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.341351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 could not be found. Nov 27 21:10:41.342690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.343529 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d1d99e7-7ac8-4182-997e-7d71bdad3b0d tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 404 len: 111 microversion: 2.1 time: 0.031130 Nov 27 21:10:41.344202 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3139/6160] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.359928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.360523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.367533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.367990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.369228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.369672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.383900 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 could not be found. Nov 27 21:10:41.384520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.385347 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5df1190e-bccf-4b9d-8205-95c12a353cec tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 404 len: 111 microversion: 2.1 time: 0.029551 Nov 27 21:10:41.385897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3022/6161] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.394069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.394704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4f8ada76-a85d-40d5-aedc-4323b4072dd2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.400978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.401422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.402191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.402624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.417819 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 could not be found. Nov 27 21:10:41.418449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 4f8ada76-a85d-40d5-aedc-4323b4072dd2 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.419353 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8b98cdc-a550-4c3f-9a02-df4857c1b6b5 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2" status: 404 len: 111 microversion: 2.1 time: 0.028863 Nov 27 21:10:41.420344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3140/6162] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/4f8ada76-a85d-40d5-aedc-4323b4072dd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.428013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.428587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.435504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.435959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.436769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.437209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.451653 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance e084ddda-4b13-4be9-8e94-cfa73ea95181 could not be found. Nov 27 21:10:41.452388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance e084ddda-4b13-4be9-8e94-cfa73ea95181 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.453223 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90c539aa-a9fb-4d73-9617-4985ffc0ab52 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 404 len: 111 microversion: 2.1 time: 0.028926 Nov 27 21:10:41.453772 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3023/6163] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.461752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.462356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: e084ddda-4b13-4be9-8e94-cfa73ea95181] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.469265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.469715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.470481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.470913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.484632 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance e084ddda-4b13-4be9-8e94-cfa73ea95181 could not be found. Nov 27 21:10:41.485214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance e084ddda-4b13-4be9-8e94-cfa73ea95181 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.486030 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7aaafd16-e92e-4050-ada1-16c7c939810e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181" status: 404 len: 111 microversion: 2.1 time: 0.028035 Nov 27 21:10:41.486578 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3141/6164] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/e084ddda-4b13-4be9-8e94-cfa73ea95181 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.494754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.495273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.502497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.502953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.503895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.504369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.518344 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd could not be found. Nov 27 21:10:41.518949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.519819 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc67f0fc-30c4-4b52-9fd1-6468120451e1 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 404 len: 111 microversion: 2.1 time: 0.029158 Nov 27 21:10:41.520559 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3024/6165] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.528532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.529067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 4ef7d071-5d70-464d-a1e3-8e0844b6efcd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.535849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.536295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.537062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.537500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.551299 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd could not be found. Nov 27 21:10:41.551889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 4ef7d071-5d70-464d-a1e3-8e0844b6efcd could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.552704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0c513f0a-8cd8-470d-95eb-0ace2a75b55e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd" status: 404 len: 111 microversion: 2.1 time: 0.027961 Nov 27 21:10:41.553247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3142/6166] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/4ef7d071-5d70-464d-a1e3-8e0844b6efcd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.561254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.561787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.568855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.568965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.569753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.576046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.592503 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 could not be found. Nov 27 21:10:41.593103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.593938 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc560de5-0571-4609-b413-9cef9f236761 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 404 len: 111 microversion: 2.1 time: 0.036542 Nov 27 21:10:41.594496 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3025/6167] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:10:41.602218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.602958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 1aaaa739-f790-4ad2-b74b-e1ff685f5c72] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.609619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.610071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.610854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.611321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.625271 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 could not be found. Nov 27 21:10:41.625862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 1aaaa739-f790-4ad2-b74b-e1ff685f5c72 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.626716 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfc38785-80dd-445f-a717-aa96dca24224 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72" status: 404 len: 111 microversion: 2.1 time: 0.028163 Nov 27 21:10:41.627278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3143/6168] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/1aaaa739-f790-4ad2-b74b-e1ff685f5c72 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.634977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.635506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.641577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.642031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.642838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.643277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.657596 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df could not be found. Nov 27 21:10:41.658198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.659031 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1e75054e-4756-4af5-9ad4-e6791d60246e tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 404 len: 111 microversion: 2.1 time: 0.027806 Nov 27 21:10:41.659628 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3026/6169] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:10:41.667792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.668431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.675736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.676191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.676986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.677428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.692139 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df could not be found. Nov 27 21:10:41.692753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 3dbdbdc2-32aa-43ad-a84e-8bfc71c774df could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.694183 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-081b458d-a954-49bf-9bd7-40e2b2c41751 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df" status: 404 len: 111 microversion: 2.1 time: 0.030102 Nov 27 21:10:41.694759 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3144/6170] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/3dbdbdc2-32aa-43ad-a84e-8bfc71c774df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.702616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.703108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.710080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.710526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.711353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.711794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.725540 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 2b33a307-15ed-43ab-8923-03775a9c4f27 could not be found. Nov 27 21:10:41.726115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 2b33a307-15ed-43ab-8923-03775a9c4f27 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.726955 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-548c5983-c75b-47c8-8571-ae05f295510f tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 404 len: 111 microversion: 2.1 time: 0.028099 Nov 27 21:10:41.727526 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3027/6171] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.735915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.736530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 2b33a307-15ed-43ab-8923-03775a9c4f27] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.742687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.743277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.744430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.744859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.758024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 2b33a307-15ed-43ab-8923-03775a9c4f27 could not be found. Nov 27 21:10:41.758644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 2b33a307-15ed-43ab-8923-03775a9c4f27 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.759500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a9c666c-7188-43b7-a19d-fef0b7e0e473 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27" status: 404 len: 111 microversion: 2.1 time: 0.028009 Nov 27 21:10:41.760023 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3145/6172] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/2b33a307-15ed-43ab-8923-03775a9c4f27 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:41.767583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abf53451-c5b2-4fae-a12c-88b0265c0221 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.768505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abf53451-c5b2-4fae-a12c-88b0265c0221 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.773771 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-abf53451-c5b2-4fae-a12c-88b0265c0221 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f could not be found. Nov 27 21:10:41.774343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abf53451-c5b2-4fae-a12c-88b0265c0221 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.775129 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abf53451-c5b2-4fae-a12c-88b0265c0221 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f" status: 404 len: 111 microversion: 2.1 time: 0.011173 Nov 27 21:10:41.775683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3028/6173] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:10:41.783322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4513532-d7a0-42c1-a9df-211004488272 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.783918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4513532-d7a0-42c1-a9df-211004488272 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.789101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b4513532-d7a0-42c1-a9df-211004488272 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f could not be found. Nov 27 21:10:41.789674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4513532-d7a0-42c1-a9df-211004488272 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance 9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:41.790471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4513532-d7a0-42c1-a9df-211004488272 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f" status: 404 len: 111 microversion: 2.1 time: 0.011252 Nov 27 21:10:41.790970 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3146/6174] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/9f058f6d-1e79-45e0-a1a7-bee75a1ccb3f => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:10:41.798598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.799086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.806857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.807327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.808098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.808537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.832363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:10:41.906281 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2c822c7-7bd8-458d-8b9d-b543f2f29239 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "DELETE /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 204 len: 0 microversion: 2.1 time: 0.111371 Nov 27 21:10:41.906884 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3029/6175] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:10:41 2021] DELETE /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:10:41.915493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:41.916090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:41.923483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.923929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:41.924701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:41.925136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:42.064584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dcb440db-8966-46b4-b67e-fea2e458d582 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:42.065738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dcb440db-8966-46b4-b67e-fea2e458d582 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:42.073573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcb440db-8966-46b4-b67e-fea2e458d582 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:42.074029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcb440db-8966-46b4-b67e-fea2e458d582 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:42.074826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcb440db-8966-46b4-b67e-fea2e458d582 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:42.075280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcb440db-8966-46b4-b67e-fea2e458d582 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:42.134188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dcb440db-8966-46b4-b67e-fea2e458d582 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.073537 Nov 27 21:10:42.138467 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3030/6176] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:42 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:42.171065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-69e2e2db-604d-48f8-a271-c9c9be287d5f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:42.172123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-69e2e2db-604d-48f8-a271-c9c9be287d5f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:42.179246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69e2e2db-604d-48f8-a271-c9c9be287d5f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:42.179723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69e2e2db-604d-48f8-a271-c9c9be287d5f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:42.180522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69e2e2db-604d-48f8-a271-c9c9be287d5f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:42.180961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-69e2e2db-604d-48f8-a271-c9c9be287d5f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:42.224564 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-69e2e2db-604d-48f8-a271-c9c9be287d5f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.057559 Nov 27 21:10:42.225657 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3031/6177] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:42 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:42.368820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:42.376652 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a702eba-313a-4246-a5f0-50204027da98 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1481 microversion: 2.1 time: 0.464828 Nov 27 21:10:42.377203 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3147/6178] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:41 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1481 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:43.146660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0894f93f-7e69-48f0-8818-510706140c55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:43.147688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0894f93f-7e69-48f0-8818-510706140c55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:43.155516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0894f93f-7e69-48f0-8818-510706140c55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:43.155972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0894f93f-7e69-48f0-8818-510706140c55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:43.156765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0894f93f-7e69-48f0-8818-510706140c55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:43.157203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0894f93f-7e69-48f0-8818-510706140c55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:43.204071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0894f93f-7e69-48f0-8818-510706140c55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.061217 Nov 27 21:10:43.205227 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3032/6179] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:43 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:43.236495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5296af8d-169b-4f3b-94dc-289a6c456452 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:43.237423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5296af8d-169b-4f3b-94dc-289a6c456452 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:43.244426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5296af8d-169b-4f3b-94dc-289a6c456452 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:43.244881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5296af8d-169b-4f3b-94dc-289a6c456452 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:43.245744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5296af8d-169b-4f3b-94dc-289a6c456452 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:43.246194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5296af8d-169b-4f3b-94dc-289a6c456452 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:43.286306 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5296af8d-169b-4f3b-94dc-289a6c456452 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.053876 Nov 27 21:10:43.286947 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3148/6180] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:43 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:43.394195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:43.394900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:43.402008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:43.402407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:43.403198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:43.403674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:43.537549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdcce84821340f3ab7c663e137d09fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50ca5bbf0334faa9bad45c847b7301c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:43.545457 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8021a495-c50c-4e43-9db8-77778bd6179a tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 200 len: 1481 microversion: 2.1 time: 0.155290 Nov 27 21:10:43.546041 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3033/6181] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:43 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 1481 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:10:43.861283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4b246f98-2d67-4b49-ab93-58f16d6acbc1 req-0bb6ae95-751d-49a2-a458-c414471eeefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af42a712-cb65-42f8-b073-c9aa8c778116", "name": "network-vif-deleted", "tag": "c65eb439-cdbe-4239-9004-3a356e2f3c6f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:43.863224 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:10:43.863224 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:10:43.873341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4b246f98-2d67-4b49-ab93-58f16d6acbc1 req-0bb6ae95-751d-49a2-a458-c414471eeefa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:43.873796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4b246f98-2d67-4b49-ab93-58f16d6acbc1 req-0bb6ae95-751d-49a2-a458-c414471eeefa service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:43.888040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4b246f98-2d67-4b49-ab93-58f16d6acbc1 req-0bb6ae95-751d-49a2-a458-c414471eeefa service nova] Creating event network-vif-deleted:c65eb439-cdbe-4239-9004-3a356e2f3c6f for instance af42a712-cb65-42f8-b073-c9aa8c778116 on nch2-master-1 Nov 27 21:10:43.895141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4b246f98-2d67-4b49-ab93-58f16d6acbc1 req-0bb6ae95-751d-49a2-a458-c414471eeefa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036872 Nov 27 21:10:43.895798 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3149/6182] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:10:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:10:44.215412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23245f3d-0e8e-402f-b1fb-3f812cd99e55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:44.216401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23245f3d-0e8e-402f-b1fb-3f812cd99e55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:44.223885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23245f3d-0e8e-402f-b1fb-3f812cd99e55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:44.224345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23245f3d-0e8e-402f-b1fb-3f812cd99e55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:44.225800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23245f3d-0e8e-402f-b1fb-3f812cd99e55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:44.226591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23245f3d-0e8e-402f-b1fb-3f812cd99e55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:44.274376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23245f3d-0e8e-402f-b1fb-3f812cd99e55 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.062393 Nov 27 21:10:44.275375 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3034/6183] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:44 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:44.298974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e0a103c-265d-4c79-9c3a-1a7a4252f779 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:44.300080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e0a103c-265d-4c79-9c3a-1a7a4252f779 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:44.307275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0a103c-265d-4c79-9c3a-1a7a4252f779 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:44.307735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0a103c-265d-4c79-9c3a-1a7a4252f779 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:44.308595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0a103c-265d-4c79-9c3a-1a7a4252f779 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:44.309075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0a103c-265d-4c79-9c3a-1a7a4252f779 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:44.350364 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e0a103c-265d-4c79-9c3a-1a7a4252f779 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055708 Nov 27 21:10:44.351184 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3150/6184] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:44 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:44.562974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:44.563714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] [instance: af42a712-cb65-42f8-b073-c9aa8c778116] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:44.570732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:44.571188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:44.572001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:44.572443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:44.589791 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] HTTP exception thrown: Instance af42a712-cb65-42f8-b073-c9aa8c778116 could not be found. Nov 27 21:10:44.590389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] Returning 404 to user: Instance af42a712-cb65-42f8-b073-c9aa8c778116 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:44.591225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e676a8bb-8092-4652-8972-059dbbcc0c24 tempest-ServersTestJSON-904910598 tempest-ServersTestJSON-904910598-project] 10.222.0.21 "GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116" status: 404 len: 111 microversion: 2.1 time: 0.032833 Nov 27 21:10:44.591856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3035/6185] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:44 2021] GET /compute/v2.1/servers/af42a712-cb65-42f8-b073-c9aa8c778116 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:45.286633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-634957d1-ac5c-4c1e-a9fc-d324426097cc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:45.287817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-634957d1-ac5c-4c1e-a9fc-d324426097cc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:45.295556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634957d1-ac5c-4c1e-a9fc-d324426097cc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:45.296011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634957d1-ac5c-4c1e-a9fc-d324426097cc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:45.296796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634957d1-ac5c-4c1e-a9fc-d324426097cc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:45.297236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634957d1-ac5c-4c1e-a9fc-d324426097cc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:45.345289 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-634957d1-ac5c-4c1e-a9fc-d324426097cc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.062377 Nov 27 21:10:45.349731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3151/6186] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:45 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:45.363817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f44ff98-4ecf-49f8-ab9a-5ac2ca64ff32 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:45.365088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f44ff98-4ecf-49f8-ab9a-5ac2ca64ff32 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:45.373042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f44ff98-4ecf-49f8-ab9a-5ac2ca64ff32 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:45.373497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f44ff98-4ecf-49f8-ab9a-5ac2ca64ff32 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:45.374393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f44ff98-4ecf-49f8-ab9a-5ac2ca64ff32 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:45.375014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f44ff98-4ecf-49f8-ab9a-5ac2ca64ff32 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:45.415599 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f44ff98-4ecf-49f8-ab9a-5ac2ca64ff32 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.056446 Nov 27 21:10:45.416472 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3036/6187] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:45 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:46.153957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Action: 'create', calling method: .version_select at 0x7f15c759dca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-982702587", "metadata": {"Type": "work"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:46.357756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-519c19fe-b9ad-4337-b678-1ed26c9549f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:46.358801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-519c19fe-b9ad-4337-b678-1ed26c9549f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:46.366153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-519c19fe-b9ad-4337-b678-1ed26c9549f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:46.366817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-519c19fe-b9ad-4337-b678-1ed26c9549f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:46.367544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-519c19fe-b9ad-4337-b678-1ed26c9549f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:46.368006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-519c19fe-b9ad-4337-b678-1ed26c9549f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:46.423463 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-519c19fe-b9ad-4337-b678-1ed26c9549f2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.067601 Nov 27 21:10:46.424999 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3037/6188] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:46 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:46.435943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5dc3c63c-e181-41da-9dfc-89ace9ed92f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:46.437269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5dc3c63c-e181-41da-9dfc-89ace9ed92f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:46.451245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dc3c63c-e181-41da-9dfc-89ace9ed92f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:46.451245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dc3c63c-e181-41da-9dfc-89ace9ed92f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:46.451245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dc3c63c-e181-41da-9dfc-89ace9ed92f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:46.451245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5dc3c63c-e181-41da-9dfc-89ace9ed92f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:46.459074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c7dc89ad-1bf2-44a1-95ec-e6f815a60bf6 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.417605 Nov 27 21:10:46.459762 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3152/6189] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:10:46 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 27 21:10:46.470425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17e70c42-93fa-4f0d-97e1-03abca6b1059 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Calling method '.version_select at 0x7f15c75bba60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:46.502283 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5dc3c63c-e181-41da-9dfc-89ace9ed92f2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.075087 Nov 27 21:10:46.503503 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3038/6190] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:46 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:46.523841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17e70c42-93fa-4f0d-97e1-03abca6b1059 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1" status: 200 len: 345 microversion: 2.1 time: 0.057136 Nov 27 21:10:46.524421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3153/6191] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:10:46 2021] GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:10:47.435112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-82988808-439d-4e39-b6b2-ae28c1fe1f24 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:47.436142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-82988808-439d-4e39-b6b2-ae28c1fe1f24 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:47.443527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82988808-439d-4e39-b6b2-ae28c1fe1f24 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:47.443977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82988808-439d-4e39-b6b2-ae28c1fe1f24 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:47.444760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82988808-439d-4e39-b6b2-ae28c1fe1f24 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:47.445200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82988808-439d-4e39-b6b2-ae28c1fe1f24 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:47.489652 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-82988808-439d-4e39-b6b2-ae28c1fe1f24 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.058494 Nov 27 21:10:47.490299 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3039/6192] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:47 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:47.515212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae28bb0c-7d6d-4685-8155-fa06fbe26542 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:47.516332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae28bb0c-7d6d-4685-8155-fa06fbe26542 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:47.523512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae28bb0c-7d6d-4685-8155-fa06fbe26542 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:47.523968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae28bb0c-7d6d-4685-8155-fa06fbe26542 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:47.524742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae28bb0c-7d6d-4685-8155-fa06fbe26542 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:47.525177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae28bb0c-7d6d-4685-8155-fa06fbe26542 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:47.536395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de5f9d6b-729b-412c-a5f5-15d52880d6a2 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Calling method '.version_select at 0x7f15c727ea60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:47.565709 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae28bb0c-7d6d-4685-8155-fa06fbe26542 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055428 Nov 27 21:10:47.566410 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3154/6193] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:47 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:47.584652 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de5f9d6b-729b-412c-a5f5-15d52880d6a2 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1" status: 200 len: 346 microversion: 2.1 time: 0.052135 Nov 27 21:10:47.585220 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3040/6194] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:10:47 2021] GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:10:47.596234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-77f2028f-704f-4232-bf6f-508e1e5123fa tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Calling method '.version_select at 0x7f15c7d08160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:47.643347 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-77f2028f-704f-4232-bf6f-508e1e5123fa tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1" status: 200 len: 346 microversion: 2.1 time: 0.050916 Nov 27 21:10:47.644079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3155/6195] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:10:47 2021] GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:10:47.655810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9a74bb6-a4a3-42e6-8f41-543694335e6e tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Calling method '.version_select at 0x7f15c6b1c4c0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:47.715115 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9a74bb6-a4a3-42e6-8f41-543694335e6e tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1" status: 202 len: 0 microversion: 2.1 time: 0.063354 Nov 27 21:10:47.719058 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3041/6196] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:10:47 2021] DELETE /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:47.726799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efc1e8d4-8633-461e-9a14-29c999bb0b40 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Calling method '.version_select at 0x7f15c773d3a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:47.784581 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-efc1e8d4-8633-461e-9a14-29c999bb0b40 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1" status: 200 len: 345 microversion: 2.1 time: 0.064456 Nov 27 21:10:47.785852 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3156/6197] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:10:47 2021] GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:10:48.502320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7448f5ca-4845-4bfe-b9ad-dbe257821cc0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:48.503410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7448f5ca-4845-4bfe-b9ad-dbe257821cc0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:48.510214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7448f5ca-4845-4bfe-b9ad-dbe257821cc0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:48.510655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7448f5ca-4845-4bfe-b9ad-dbe257821cc0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:48.511467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7448f5ca-4845-4bfe-b9ad-dbe257821cc0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:48.511911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7448f5ca-4845-4bfe-b9ad-dbe257821cc0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:48.556536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7448f5ca-4845-4bfe-b9ad-dbe257821cc0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.058639 Nov 27 21:10:48.557202 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3042/6198] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:48 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:48.577514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78a883fd-8659-4535-92be-68da2fc0e979 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:48.578555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78a883fd-8659-4535-92be-68da2fc0e979 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:48.584924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a883fd-8659-4535-92be-68da2fc0e979 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:48.585382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a883fd-8659-4535-92be-68da2fc0e979 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:48.586166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a883fd-8659-4535-92be-68da2fc0e979 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:48.586609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a883fd-8659-4535-92be-68da2fc0e979 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:48.625148 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78a883fd-8659-4535-92be-68da2fc0e979 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.052028 Nov 27 21:10:48.625802 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3157/6199] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:48 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:48.797846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ada45f61-577a-43d5-a2a5-08f8df89d058 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Calling method '.version_select at 0x7f15c6ccd310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:48.824427 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ada45f61-577a-43d5-a2a5-08f8df89d058 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] HTTP exception thrown: Volume d976cf21-2639-422c-9b3a-768bad8b3bb1 could not be found. Nov 27 21:10:48.825026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ada45f61-577a-43d5-a2a5-08f8df89d058 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] Returning 404 to user: Volume d976cf21-2639-422c-9b3a-768bad8b3bb1 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:10:48.826380 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ada45f61-577a-43d5-a2a5-08f8df89d058 tempest-VolumesGetTestJSON-2006914169 tempest-VolumesGetTestJSON-2006914169-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1" status: 404 len: 109 microversion: 2.1 time: 0.032491 Nov 27 21:10:48.826911 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3043/6200] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:10:48 2021] GET /compute/v2.1/os-volumes/d976cf21-2639-422c-9b3a-768bad8b3bb1 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:10:49.568694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f37c7fec-5d3a-48cd-b8d7-d7f3dac5bb27 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:49.569767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f37c7fec-5d3a-48cd-b8d7-d7f3dac5bb27 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:49.577044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f37c7fec-5d3a-48cd-b8d7-d7f3dac5bb27 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:49.577496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f37c7fec-5d3a-48cd-b8d7-d7f3dac5bb27 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:49.578283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f37c7fec-5d3a-48cd-b8d7-d7f3dac5bb27 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:49.578828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f37c7fec-5d3a-48cd-b8d7-d7f3dac5bb27 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:49.633922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f37c7fec-5d3a-48cd-b8d7-d7f3dac5bb27 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.068967 Nov 27 21:10:49.634407 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3158/6201] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:49 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:49.639961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd25957f-bc7f-4024-9fc0-1a965cc1e216 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:49.641187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd25957f-bc7f-4024-9fc0-1a965cc1e216 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:49.651105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd25957f-bc7f-4024-9fc0-1a965cc1e216 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:49.651684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd25957f-bc7f-4024-9fc0-1a965cc1e216 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:49.652561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd25957f-bc7f-4024-9fc0-1a965cc1e216 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:49.653077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd25957f-bc7f-4024-9fc0-1a965cc1e216 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:49.695945 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd25957f-bc7f-4024-9fc0-1a965cc1e216 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.060431 Nov 27 21:10:49.696601 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3044/6202] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:49 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:50.646251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9556758-f90b-4178-ab94-0b469c6aca5a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:50.647274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9556758-f90b-4178-ab94-0b469c6aca5a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:50.656324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9556758-f90b-4178-ab94-0b469c6aca5a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:50.656846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9556758-f90b-4178-ab94-0b469c6aca5a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:50.657745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9556758-f90b-4178-ab94-0b469c6aca5a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:50.658247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9556758-f90b-4178-ab94-0b469c6aca5a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:50.709515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c7867438-efc1-4c0b-92ac-3bba1f6b3165 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:50.710676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7867438-efc1-4c0b-92ac-3bba1f6b3165 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:50.716920 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9556758-f90b-4178-ab94-0b469c6aca5a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.073978 Nov 27 21:10:50.718355 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3159/6203] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:50 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:50.720731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7867438-efc1-4c0b-92ac-3bba1f6b3165 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:50.721190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7867438-efc1-4c0b-92ac-3bba1f6b3165 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:50.722138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7867438-efc1-4c0b-92ac-3bba1f6b3165 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:50.722641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7867438-efc1-4c0b-92ac-3bba1f6b3165 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:50.765430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c7867438-efc1-4c0b-92ac-3bba1f6b3165 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.061303 Nov 27 21:10:50.767380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3045/6204] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:50 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:51.729524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c8dbf196-033b-4cb1-8bcb-dcf511e9823f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:51.730287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c8dbf196-033b-4cb1-8bcb-dcf511e9823f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:51.737656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8dbf196-033b-4cb1-8bcb-dcf511e9823f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:51.738116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8dbf196-033b-4cb1-8bcb-dcf511e9823f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:51.738894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8dbf196-033b-4cb1-8bcb-dcf511e9823f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:51.739359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8dbf196-033b-4cb1-8bcb-dcf511e9823f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:51.778660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33327f6b-78a3-47fb-b7b1-bc41803e94f7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:51.780910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33327f6b-78a3-47fb-b7b1-bc41803e94f7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:51.781647 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c8dbf196-033b-4cb1-8bcb-dcf511e9823f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.056205 Nov 27 21:10:51.782312 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3160/6205] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:51 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:51.788691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33327f6b-78a3-47fb-b7b1-bc41803e94f7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:51.789149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33327f6b-78a3-47fb-b7b1-bc41803e94f7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:51.789959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33327f6b-78a3-47fb-b7b1-bc41803e94f7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:51.790403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33327f6b-78a3-47fb-b7b1-bc41803e94f7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:51.831849 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33327f6b-78a3-47fb-b7b1-bc41803e94f7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.057308 Nov 27 21:10:51.835906 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3046/6206] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:51 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:52.793427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16bb2bd3-d616-4f6a-892a-d819e97da68f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:52.794495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16bb2bd3-d616-4f6a-892a-d819e97da68f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:52.801993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16bb2bd3-d616-4f6a-892a-d819e97da68f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:52.802448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16bb2bd3-d616-4f6a-892a-d819e97da68f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:52.803235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16bb2bd3-d616-4f6a-892a-d819e97da68f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:52.803705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16bb2bd3-d616-4f6a-892a-d819e97da68f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:52.844092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97a00e31-385f-488d-845d-e4089f673189 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:52.845103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-97a00e31-385f-488d-845d-e4089f673189 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:52.849991 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16bb2bd3-d616-4f6a-892a-d819e97da68f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.060377 Nov 27 21:10:52.851339 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3161/6207] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:52 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:52.852590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97a00e31-385f-488d-845d-e4089f673189 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:52.853051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97a00e31-385f-488d-845d-e4089f673189 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:52.853854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97a00e31-385f-488d-845d-e4089f673189 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:52.854294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97a00e31-385f-488d-845d-e4089f673189 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:52.896180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97a00e31-385f-488d-845d-e4089f673189 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.056060 Nov 27 21:10:52.897137 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3047/6208] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:52 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:53.862938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9deda47b-2963-42f5-9d43-7ae9f248798e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:53.864061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9deda47b-2963-42f5-9d43-7ae9f248798e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:53.871849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9deda47b-2963-42f5-9d43-7ae9f248798e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:53.872329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9deda47b-2963-42f5-9d43-7ae9f248798e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:53.873184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9deda47b-2963-42f5-9d43-7ae9f248798e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:53.873564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9deda47b-2963-42f5-9d43-7ae9f248798e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:53.909494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-451bdb93-4f89-4a5f-9f86-1f1df9d991a1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:53.910585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-451bdb93-4f89-4a5f-9f86-1f1df9d991a1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:53.917654 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9deda47b-2963-42f5-9d43-7ae9f248798e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.058363 Nov 27 21:10:53.917928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-451bdb93-4f89-4a5f-9f86-1f1df9d991a1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:53.918570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-451bdb93-4f89-4a5f-9f86-1f1df9d991a1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:53.918733 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3162/6209] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:53 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:53.920570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-451bdb93-4f89-4a5f-9f86-1f1df9d991a1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:53.921025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-451bdb93-4f89-4a5f-9f86-1f1df9d991a1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:53.962046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-451bdb93-4f89-4a5f-9f86-1f1df9d991a1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.056638 Nov 27 21:10:53.962897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3048/6210] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:53 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:54.930313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fefcd073-d63a-4d42-8e65-e42e1e76dc72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:54.931338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fefcd073-d63a-4d42-8e65-e42e1e76dc72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:54.939086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fefcd073-d63a-4d42-8e65-e42e1e76dc72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:54.939632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fefcd073-d63a-4d42-8e65-e42e1e76dc72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:54.940326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fefcd073-d63a-4d42-8e65-e42e1e76dc72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:54.940760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fefcd073-d63a-4d42-8e65-e42e1e76dc72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:54.974832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea4ae749-acdb-46ea-844d-79c928a5978a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:54.976130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ea4ae749-acdb-46ea-844d-79c928a5978a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:54.982720 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fefcd073-d63a-4d42-8e65-e42e1e76dc72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.055728 Nov 27 21:10:54.984352 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3163/6211] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:54 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:54.984480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea4ae749-acdb-46ea-844d-79c928a5978a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:54.984864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea4ae749-acdb-46ea-844d-79c928a5978a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:54.985864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea4ae749-acdb-46ea-844d-79c928a5978a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:54.986310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea4ae749-acdb-46ea-844d-79c928a5978a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:55.029194 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea4ae749-acdb-46ea-844d-79c928a5978a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.058259 Nov 27 21:10:55.030117 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3049/6212] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:54 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:55.997838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d12630b0-ef17-4614-9a18-ecdd5b138351 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:55.999356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d12630b0-ef17-4614-9a18-ecdd5b138351 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:56.007225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d12630b0-ef17-4614-9a18-ecdd5b138351 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:56.007708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d12630b0-ef17-4614-9a18-ecdd5b138351 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:56.008487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d12630b0-ef17-4614-9a18-ecdd5b138351 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:56.008921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d12630b0-ef17-4614-9a18-ecdd5b138351 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:56.042403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b57704d3-037b-4d5a-b94d-7d9e2d41ba39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:56.043376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b57704d3-037b-4d5a-b94d-7d9e2d41ba39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:56.051154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b57704d3-037b-4d5a-b94d-7d9e2d41ba39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:56.051763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b57704d3-037b-4d5a-b94d-7d9e2d41ba39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:56.052760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b57704d3-037b-4d5a-b94d-7d9e2d41ba39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:56.053204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b57704d3-037b-4d5a-b94d-7d9e2d41ba39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:56.055827 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d12630b0-ef17-4614-9a18-ecdd5b138351 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.064578 Nov 27 21:10:56.060004 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3164/6213] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:55 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:56.103423 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b57704d3-037b-4d5a-b94d-7d9e2d41ba39 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.065232 Nov 27 21:10:56.104296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3050/6214] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:56 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:10:57.068144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e125f9ff-cdcc-4cec-b6ce-f0d82e2d9435 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:57.069142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e125f9ff-cdcc-4cec-b6ce-f0d82e2d9435 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:57.076934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e125f9ff-cdcc-4cec-b6ce-f0d82e2d9435 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:57.077413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e125f9ff-cdcc-4cec-b6ce-f0d82e2d9435 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:57.078185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e125f9ff-cdcc-4cec-b6ce-f0d82e2d9435 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:57.078618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e125f9ff-cdcc-4cec-b6ce-f0d82e2d9435 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:57.116214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1cd05fe1-0a29-4474-b658-4e65f5cfd8b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:57.117877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1cd05fe1-0a29-4474-b658-4e65f5cfd8b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:57.121163 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e125f9ff-cdcc-4cec-b6ce-f0d82e2d9435 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 32645 microversion: 2.1 time: 0.056811 Nov 27 21:10:57.122168 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3165/6215] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:57 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 32645 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:10:57.129131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cd05fe1-0a29-4474-b658-4e65f5cfd8b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:57.129607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cd05fe1-0a29-4474-b658-4e65f5cfd8b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:57.130394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cd05fe1-0a29-4474-b658-4e65f5cfd8b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:57.130830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cd05fe1-0a29-4474-b658-4e65f5cfd8b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:57.173601 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1cd05fe1-0a29-4474-b658-4e65f5cfd8b1 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.061809 Nov 27 21:10:57.175153 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3051/6216] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:57 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:58.133046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58ba6aaf-90fc-4f28-8846-e488867a7f35 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:58.134082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-58ba6aaf-90fc-4f28-8846-e488867a7f35 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:58.142052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58ba6aaf-90fc-4f28-8846-e488867a7f35 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.142509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58ba6aaf-90fc-4f28-8846-e488867a7f35 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.143329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58ba6aaf-90fc-4f28-8846-e488867a7f35 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.143769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58ba6aaf-90fc-4f28-8846-e488867a7f35 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.187134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a23f8ac-330c-4030-a497-6f29161aa939 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:58.188325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a23f8ac-330c-4030-a497-6f29161aa939 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:58.196615 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58ba6aaf-90fc-4f28-8846-e488867a7f35 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 40798 microversion: 2.1 time: 0.067745 Nov 27 21:10:58.197225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3166/6217] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:58 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 40798 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:10:58.206633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a23f8ac-330c-4030-a497-6f29161aa939 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.207188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a23f8ac-330c-4030-a497-6f29161aa939 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.208193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a23f8ac-330c-4030-a497-6f29161aa939 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.208688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a23f8ac-330c-4030-a497-6f29161aa939 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.209399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:10:58.210101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:58.217318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.217764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.218576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.219024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.256023 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a23f8ac-330c-4030-a497-6f29161aa939 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.073303 Nov 27 21:10:58.261716 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3052/6218] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:58 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:10:58.357669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:10:58.365209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2fb83fbb-35b4-4af3-8cbb-b71021d9455c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.160012 Nov 27 21:10:58.365984 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3167/6219] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:10:58 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:10:58.382790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cbefd6c5-9391-4586-8a34-a9047d289cd8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2073721252"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:58.384359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cbefd6c5-9391-4586-8a34-a9047d289cd8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:58.392112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbefd6c5-9391-4586-8a34-a9047d289cd8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.392576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbefd6c5-9391-4586-8a34-a9047d289cd8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.393394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbefd6c5-9391-4586-8a34-a9047d289cd8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:58.393828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbefd6c5-9391-4586-8a34-a9047d289cd8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:58.684484 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cbefd6c5-9391-4586-8a34-a9047d289cd8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.305553 Nov 27 21:10:58.685238 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3053/6220] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:10:58 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 27 21:10:59.269499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ecbf4cda-5883-497f-9c84-f80abf9faa82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:10:59.270477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ecbf4cda-5883-497f-9c84-f80abf9faa82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:10:59.278414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecbf4cda-5883-497f-9c84-f80abf9faa82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:59.278954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecbf4cda-5883-497f-9c84-f80abf9faa82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:59.280440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecbf4cda-5883-497f-9c84-f80abf9faa82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:10:59.281145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecbf4cda-5883-497f-9c84-f80abf9faa82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:10:59.323279 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ecbf4cda-5883-497f-9c84-f80abf9faa82 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.057346 Nov 27 21:10:59.324053 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3168/6221] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:10:59 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:00.336712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23179eb9-66f4-43bf-bb8c-8f7c4e7bf48d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:00.337626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23179eb9-66f4-43bf-bb8c-8f7c4e7bf48d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:00.344332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23179eb9-66f4-43bf-bb8c-8f7c4e7bf48d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:00.344819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23179eb9-66f4-43bf-bb8c-8f7c4e7bf48d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:00.345647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23179eb9-66f4-43bf-bb8c-8f7c4e7bf48d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:00.346155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23179eb9-66f4-43bf-bb8c-8f7c4e7bf48d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:00.387818 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23179eb9-66f4-43bf-bb8c-8f7c4e7bf48d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.055918 Nov 27 21:11:00.388467 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3054/6222] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:00 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:01.399482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08e0ff15-898f-4a96-97e9-3ea97f2dec11 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:01.400522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08e0ff15-898f-4a96-97e9-3ea97f2dec11 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:01.408363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08e0ff15-898f-4a96-97e9-3ea97f2dec11 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:01.408819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08e0ff15-898f-4a96-97e9-3ea97f2dec11 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:01.409601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08e0ff15-898f-4a96-97e9-3ea97f2dec11 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:01.410041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08e0ff15-898f-4a96-97e9-3ea97f2dec11 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:01.450110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08e0ff15-898f-4a96-97e9-3ea97f2dec11 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.054657 Nov 27 21:11:01.452192 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3169/6223] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:01 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:02.464046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8736d7c-2488-40b4-b4a6-b2c3f2ac08ac tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:02.465723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8736d7c-2488-40b4-b4a6-b2c3f2ac08ac tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:02.473104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8736d7c-2488-40b4-b4a6-b2c3f2ac08ac tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:02.473775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8736d7c-2488-40b4-b4a6-b2c3f2ac08ac tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:02.474775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8736d7c-2488-40b4-b4a6-b2c3f2ac08ac tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:02.475422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8736d7c-2488-40b4-b4a6-b2c3f2ac08ac tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:02.521716 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8736d7c-2488-40b4-b4a6-b2c3f2ac08ac tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.062271 Nov 27 21:11:02.522791 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3055/6224] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:02 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:03.539017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b321db6c-1842-4b5d-8a30-e5de255de621 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:03.540889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b321db6c-1842-4b5d-8a30-e5de255de621 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:03.549719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b321db6c-1842-4b5d-8a30-e5de255de621 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:03.550461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b321db6c-1842-4b5d-8a30-e5de255de621 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:03.551510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b321db6c-1842-4b5d-8a30-e5de255de621 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:03.552254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b321db6c-1842-4b5d-8a30-e5de255de621 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:03.612307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b321db6c-1842-4b5d-8a30-e5de255de621 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.081878 Nov 27 21:11:03.616379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3170/6225] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:03 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:04.633152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2fdb32e5-4758-4940-b518-aeb46fd072ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:04.634881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2fdb32e5-4758-4940-b518-aeb46fd072ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:04.644499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fdb32e5-4758-4940-b518-aeb46fd072ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:04.645177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fdb32e5-4758-4940-b518-aeb46fd072ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:04.646383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fdb32e5-4758-4940-b518-aeb46fd072ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:04.647595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2fdb32e5-4758-4940-b518-aeb46fd072ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:04.697575 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2fdb32e5-4758-4940-b518-aeb46fd072ef tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.071831 Nov 27 21:11:04.699053 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3056/6226] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:04 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:11:05.173385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0ae50e3f-7265-46db-beb1-18d3dda8bae8 req-b7b70507-dabc-4a30-8cd6-ad472b11b16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-plugged", "status": "completed", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:05.177283 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:11:05.177283 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:11:05.196465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0ae50e3f-7265-46db-beb1-18d3dda8bae8 req-b7b70507-dabc-4a30-8cd6-ad472b11b16a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:05.197159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0ae50e3f-7265-46db-beb1-18d3dda8bae8 req-b7b70507-dabc-4a30-8cd6-ad472b11b16a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:05.214840 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0ae50e3f-7265-46db-beb1-18d3dda8bae8 req-b7b70507-dabc-4a30-8cd6-ad472b11b16a service nova] Creating event network-vif-plugged:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:11:05.221635 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0ae50e3f-7265-46db-beb1-18d3dda8bae8 req-b7b70507-dabc-4a30-8cd6-ad472b11b16a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053504 Nov 27 21:11:05.223217 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3171/6227] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:11:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:11:05.715922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9be77923-00e4-4a34-bfab-9e97c3456f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:05.718363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9be77923-00e4-4a34-bfab-9e97c3456f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:05.729892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9be77923-00e4-4a34-bfab-9e97c3456f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:05.730702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9be77923-00e4-4a34-bfab-9e97c3456f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:05.732936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9be77923-00e4-4a34-bfab-9e97c3456f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:05.733591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9be77923-00e4-4a34-bfab-9e97c3456f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:05.776727 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9be77923-00e4-4a34-bfab-9e97c3456f4a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.068244 Nov 27 21:11:05.777509 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3057/6228] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:05 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:06.791216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7884af26-a444-401b-bab1-2fe114189bec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:06.798246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7884af26-a444-401b-bab1-2fe114189bec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:06.805513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7884af26-a444-401b-bab1-2fe114189bec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:06.806758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7884af26-a444-401b-bab1-2fe114189bec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:06.807951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7884af26-a444-401b-bab1-2fe114189bec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:06.808583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7884af26-a444-401b-bab1-2fe114189bec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:06.871867 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7884af26-a444-401b-bab1-2fe114189bec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.085830 Nov 27 21:11:06.876968 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3172/6229] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:06 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:07.884281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99b9a216-8bd2-4d01-9e41-dc13398990e4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:07.885290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99b9a216-8bd2-4d01-9e41-dc13398990e4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:07.893513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b9a216-8bd2-4d01-9e41-dc13398990e4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:07.894225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b9a216-8bd2-4d01-9e41-dc13398990e4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:07.895182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b9a216-8bd2-4d01-9e41-dc13398990e4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:07.895832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b9a216-8bd2-4d01-9e41-dc13398990e4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:07.940214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99b9a216-8bd2-4d01-9e41-dc13398990e4 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.059842 Nov 27 21:11:07.940886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3058/6230] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:07 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:08.955158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-933fe370-8ca7-47b3-bfa6-833748b422fb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:08.957343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-933fe370-8ca7-47b3-bfa6-833748b422fb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:08.965190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933fe370-8ca7-47b3-bfa6-833748b422fb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:08.965921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933fe370-8ca7-47b3-bfa6-833748b422fb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:08.967609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933fe370-8ca7-47b3-bfa6-833748b422fb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:08.968216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-933fe370-8ca7-47b3-bfa6-833748b422fb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:09.022594 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-933fe370-8ca7-47b3-bfa6-833748b422fb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.072107 Nov 27 21:11:09.026196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3173/6231] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:08 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:11:10.039810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02ab7eb7-b8c9-4c91-a205-dfe1ca5e0ad2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:10.041385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02ab7eb7-b8c9-4c91-a205-dfe1ca5e0ad2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:10.053512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ab7eb7-b8c9-4c91-a205-dfe1ca5e0ad2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:10.053974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ab7eb7-b8c9-4c91-a205-dfe1ca5e0ad2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:10.054780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ab7eb7-b8c9-4c91-a205-dfe1ca5e0ad2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:10.055227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02ab7eb7-b8c9-4c91-a205-dfe1ca5e0ad2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:10.103937 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02ab7eb7-b8c9-4c91-a205-dfe1ca5e0ad2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.068889 Nov 27 21:11:10.105160 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3059/6232] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:10 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:11:11.117912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20d1296c-ed1b-4fd6-a99b-fe4199f0ba2a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:11.119273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20d1296c-ed1b-4fd6-a99b-fe4199f0ba2a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:11.130823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20d1296c-ed1b-4fd6-a99b-fe4199f0ba2a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:11.131694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20d1296c-ed1b-4fd6-a99b-fe4199f0ba2a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:11.132855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20d1296c-ed1b-4fd6-a99b-fe4199f0ba2a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:11.133869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20d1296c-ed1b-4fd6-a99b-fe4199f0ba2a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:11.178729 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20d1296c-ed1b-4fd6-a99b-fe4199f0ba2a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.066507 Nov 27 21:11:11.180827 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3174/6233] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:11 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:12.193790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8990c742-6ae9-4a8a-9308-f473d4fe5eea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:12.195294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8990c742-6ae9-4a8a-9308-f473d4fe5eea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:12.203048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8990c742-6ae9-4a8a-9308-f473d4fe5eea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:12.203643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8990c742-6ae9-4a8a-9308-f473d4fe5eea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:12.204718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8990c742-6ae9-4a8a-9308-f473d4fe5eea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:12.205352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8990c742-6ae9-4a8a-9308-f473d4fe5eea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:12.250514 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8990c742-6ae9-4a8a-9308-f473d4fe5eea tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.062200 Nov 27 21:11:12.251556 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3060/6234] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:12 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:13.119776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:13.120658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:13.128382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:13.128833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:13.129814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:13.130443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:13.262877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91e0370a-f958-49d5-aac7-d3fac6d5ecc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:13.265720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91e0370a-f958-49d5-aac7-d3fac6d5ecc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:13.270890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:13.275080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91e0370a-f958-49d5-aac7-d3fac6d5ecc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:13.275583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91e0370a-f958-49d5-aac7-d3fac6d5ecc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:13.276398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91e0370a-f958-49d5-aac7-d3fac6d5ecc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:13.277071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91e0370a-f958-49d5-aac7-d3fac6d5ecc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:13.279403 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b171bc23-c8f0-4d4d-852f-41b0a8f2f240 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.163909 Nov 27 21:11:13.280301 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3175/6235] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:13 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:13.296164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0480b977-0571-40db-ab3c-304c52181428 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-647564525"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:13.297284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0480b977-0571-40db-ab3c-304c52181428 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:13.304311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0480b977-0571-40db-ab3c-304c52181428 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:13.304895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0480b977-0571-40db-ab3c-304c52181428 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:13.305812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0480b977-0571-40db-ab3c-304c52181428 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:13.306265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0480b977-0571-40db-ab3c-304c52181428 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:13.323673 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91e0370a-f958-49d5-aac7-d3fac6d5ecc5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.064837 Nov 27 21:11:13.324250 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3061/6236] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:13 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:11:13.588214 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0480b977-0571-40db-ab3c-304c52181428 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.295593 Nov 27 21:11:13.591278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3176/6237] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:11:13 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Nov 27 21:11:14.336738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c59288c-6b26-4bfe-8911-ebfdc0835a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:14.337808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c59288c-6b26-4bfe-8911-ebfdc0835a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:14.345748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c59288c-6b26-4bfe-8911-ebfdc0835a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:14.346207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c59288c-6b26-4bfe-8911-ebfdc0835a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:14.346997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c59288c-6b26-4bfe-8911-ebfdc0835a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:14.347470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c59288c-6b26-4bfe-8911-ebfdc0835a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:14.390142 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c59288c-6b26-4bfe-8911-ebfdc0835a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.057472 Nov 27 21:11:14.394263 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3062/6238] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:14 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:15.144736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-27dc891d-2edb-4c45-8266-27f67a51003e req-03145c5a-eea5-409d-b1ee-e78f8040e413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-unplugged", "status": "completed", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:15.146668 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:11:15.146668 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:11:15.156753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-27dc891d-2edb-4c45-8266-27f67a51003e req-03145c5a-eea5-409d-b1ee-e78f8040e413 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:15.157206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-27dc891d-2edb-4c45-8266-27f67a51003e req-03145c5a-eea5-409d-b1ee-e78f8040e413 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:15.168798 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-27dc891d-2edb-4c45-8266-27f67a51003e req-03145c5a-eea5-409d-b1ee-e78f8040e413 service nova] Creating event network-vif-unplugged:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:11:15.174392 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-27dc891d-2edb-4c45-8266-27f67a51003e req-03145c5a-eea5-409d-b1ee-e78f8040e413 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036857 Nov 27 21:11:15.175438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3177/6239] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:11:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:11:15.402562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d219d64b-675e-4fa1-bfee-8bf8acf4ac24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:15.403592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d219d64b-675e-4fa1-bfee-8bf8acf4ac24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:15.410876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d219d64b-675e-4fa1-bfee-8bf8acf4ac24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:15.411350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d219d64b-675e-4fa1-bfee-8bf8acf4ac24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:15.412132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d219d64b-675e-4fa1-bfee-8bf8acf4ac24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:15.412569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d219d64b-675e-4fa1-bfee-8bf8acf4ac24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:15.455778 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d219d64b-675e-4fa1-bfee-8bf8acf4ac24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.057062 Nov 27 21:11:15.456681 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3063/6240] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:15 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:16.469533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f7cd7aa8-3167-4480-aa3f-12406853577f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:16.470539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7cd7aa8-3167-4480-aa3f-12406853577f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:16.476666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7cd7aa8-3167-4480-aa3f-12406853577f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:16.477209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7cd7aa8-3167-4480-aa3f-12406853577f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:16.477999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7cd7aa8-3167-4480-aa3f-12406853577f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:16.478438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7cd7aa8-3167-4480-aa3f-12406853577f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:16.518301 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f7cd7aa8-3167-4480-aa3f-12406853577f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.054046 Nov 27 21:11:16.519113 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3178/6241] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:16 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:17.530797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5c20030e-54d6-4a45-a3ca-c7f75ab5c64e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:17.532710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5c20030e-54d6-4a45-a3ca-c7f75ab5c64e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:17.542072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c20030e-54d6-4a45-a3ca-c7f75ab5c64e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:17.545890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c20030e-54d6-4a45-a3ca-c7f75ab5c64e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:17.546910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c20030e-54d6-4a45-a3ca-c7f75ab5c64e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:17.548488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c20030e-54d6-4a45-a3ca-c7f75ab5c64e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:17.616135 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5c20030e-54d6-4a45-a3ca-c7f75ab5c64e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.089470 Nov 27 21:11:17.617419 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3064/6242] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:17 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:18.630373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f3a7f6ec-df1a-47dc-a50c-e2e12e775cc6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:18.631333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f3a7f6ec-df1a-47dc-a50c-e2e12e775cc6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:18.641910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3a7f6ec-df1a-47dc-a50c-e2e12e775cc6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:18.642643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3a7f6ec-df1a-47dc-a50c-e2e12e775cc6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:18.643652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3a7f6ec-df1a-47dc-a50c-e2e12e775cc6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:18.644249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3a7f6ec-df1a-47dc-a50c-e2e12e775cc6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:18.704266 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f3a7f6ec-df1a-47dc-a50c-e2e12e775cc6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.077627 Nov 27 21:11:18.709768 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3179/6243] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:18 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:19.374852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8f3cdecf-e23b-4036-8ac4-7b9115c0627a req-5960583e-2b34-4f92-bce1-6d60909fbb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-plugged", "status": "completed", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:19.377142 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:11:19.377142 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:11:19.399714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8f3cdecf-e23b-4036-8ac4-7b9115c0627a req-5960583e-2b34-4f92-bce1-6d60909fbb59 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:19.400154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8f3cdecf-e23b-4036-8ac4-7b9115c0627a req-5960583e-2b34-4f92-bce1-6d60909fbb59 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:19.429476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8f3cdecf-e23b-4036-8ac4-7b9115c0627a req-5960583e-2b34-4f92-bce1-6d60909fbb59 service nova] Creating event network-vif-plugged:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:11:19.440935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8f3cdecf-e23b-4036-8ac4-7b9115c0627a req-5960583e-2b34-4f92-bce1-6d60909fbb59 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070430 Nov 27 21:11:19.445617 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3065/6244] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:11:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:11:19.719740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a48bfdde-3618-430d-b7bc-465ff6f84ca7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:19.721447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a48bfdde-3618-430d-b7bc-465ff6f84ca7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:19.739384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a48bfdde-3618-430d-b7bc-465ff6f84ca7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:19.741153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a48bfdde-3618-430d-b7bc-465ff6f84ca7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:19.741966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a48bfdde-3618-430d-b7bc-465ff6f84ca7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:19.744257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a48bfdde-3618-430d-b7bc-465ff6f84ca7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:19.823320 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a48bfdde-3618-430d-b7bc-465ff6f84ca7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.109881 Nov 27 21:11:19.827639 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3180/6245] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:19 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:20.835870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2409f406-cb2e-4874-8f70-8c4d31adbd41 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:20.837537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2409f406-cb2e-4874-8f70-8c4d31adbd41 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:20.850906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2409f406-cb2e-4874-8f70-8c4d31adbd41 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:20.851697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2409f406-cb2e-4874-8f70-8c4d31adbd41 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:20.852672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2409f406-cb2e-4874-8f70-8c4d31adbd41 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:20.853592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2409f406-cb2e-4874-8f70-8c4d31adbd41 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:20.897292 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2409f406-cb2e-4874-8f70-8c4d31adbd41 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.065408 Nov 27 21:11:20.898287 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3066/6246] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:20 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:21.911921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70b0096e-f2f7-48e7-8308-74b013035e1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:21.913167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70b0096e-f2f7-48e7-8308-74b013035e1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:21.930891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70b0096e-f2f7-48e7-8308-74b013035e1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:21.933554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70b0096e-f2f7-48e7-8308-74b013035e1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:21.937644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70b0096e-f2f7-48e7-8308-74b013035e1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:21.938429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70b0096e-f2f7-48e7-8308-74b013035e1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:22.028561 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70b0096e-f2f7-48e7-8308-74b013035e1c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.121960 Nov 27 21:11:22.030478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3181/6247] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:21 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:23.042956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0674fb61-d298-49f4-86b4-4977d7e80ee3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:23.045169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0674fb61-d298-49f4-86b4-4977d7e80ee3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:23.058914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0674fb61-d298-49f4-86b4-4977d7e80ee3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:23.059741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0674fb61-d298-49f4-86b4-4977d7e80ee3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:23.060738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0674fb61-d298-49f4-86b4-4977d7e80ee3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:23.061610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0674fb61-d298-49f4-86b4-4977d7e80ee3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:23.109097 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0674fb61-d298-49f4-86b4-4977d7e80ee3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.070451 Nov 27 21:11:23.110651 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3067/6248] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:23 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:24.122815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35fd1b52-0932-4d73-879d-92ce6fdc517f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:24.125370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35fd1b52-0932-4d73-879d-92ce6fdc517f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:24.145375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35fd1b52-0932-4d73-879d-92ce6fdc517f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:24.145534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35fd1b52-0932-4d73-879d-92ce6fdc517f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:24.147934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35fd1b52-0932-4d73-879d-92ce6fdc517f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:24.150420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35fd1b52-0932-4d73-879d-92ce6fdc517f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:24.246717 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35fd1b52-0932-4d73-879d-92ce6fdc517f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.128694 Nov 27 21:11:24.270459 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3182/6249] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:24 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:25.279638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f98e9d69-bf5a-4874-a306-200477e77803 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:25.280859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f98e9d69-bf5a-4874-a306-200477e77803 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:25.297841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f98e9d69-bf5a-4874-a306-200477e77803 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:25.298496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f98e9d69-bf5a-4874-a306-200477e77803 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:25.300149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f98e9d69-bf5a-4874-a306-200477e77803 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:25.301460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f98e9d69-bf5a-4874-a306-200477e77803 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:25.363235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f98e9d69-bf5a-4874-a306-200477e77803 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.088281 Nov 27 21:11:25.364222 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3068/6250] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:25 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:26.379199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b3059c3-2480-43d0-9664-7d6d57c4cdf0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:26.381135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b3059c3-2480-43d0-9664-7d6d57c4cdf0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:26.391467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b3059c3-2480-43d0-9664-7d6d57c4cdf0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:26.392158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b3059c3-2480-43d0-9664-7d6d57c4cdf0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:26.393287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b3059c3-2480-43d0-9664-7d6d57c4cdf0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:26.393989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b3059c3-2480-43d0-9664-7d6d57c4cdf0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:26.443757 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b3059c3-2480-43d0-9664-7d6d57c4cdf0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.071770 Nov 27 21:11:26.445220 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3183/6251] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:26 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:27.456570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9156a4a8-4807-4cc4-89ee-7c6e9ccf6004 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:27.457607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9156a4a8-4807-4cc4-89ee-7c6e9ccf6004 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:27.476429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9156a4a8-4807-4cc4-89ee-7c6e9ccf6004 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:27.477090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9156a4a8-4807-4cc4-89ee-7c6e9ccf6004 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:27.478088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9156a4a8-4807-4cc4-89ee-7c6e9ccf6004 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:27.478698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9156a4a8-4807-4cc4-89ee-7c6e9ccf6004 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:27.529846 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9156a4a8-4807-4cc4-89ee-7c6e9ccf6004 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.077198 Nov 27 21:11:27.530914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3069/6252] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:27 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:28.543492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1387a70f-7726-4e04-8ade-80c7e8d8dfd2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:28.545347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1387a70f-7726-4e04-8ade-80c7e8d8dfd2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:28.553016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1387a70f-7726-4e04-8ade-80c7e8d8dfd2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:28.553468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1387a70f-7726-4e04-8ade-80c7e8d8dfd2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:28.554254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1387a70f-7726-4e04-8ade-80c7e8d8dfd2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:28.554839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1387a70f-7726-4e04-8ade-80c7e8d8dfd2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:28.598251 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1387a70f-7726-4e04-8ade-80c7e8d8dfd2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.060345 Nov 27 21:11:28.598915 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3184/6253] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:28 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:29.146809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:29.147564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:29.155137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.155624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.156416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.156867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.366852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:29.377254 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e498d031-7416-4c24-80a1-39b6a2e2fd97 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.234434 Nov 27 21:11:29.388954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3070/6254] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:29 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:29.394829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0dbb586b-52d9-4bee-b99d-0b0c527d2164 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1737838840"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:29.396027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0dbb586b-52d9-4bee-b99d-0b0c527d2164 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:29.404377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dbb586b-52d9-4bee-b99d-0b0c527d2164 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.404829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dbb586b-52d9-4bee-b99d-0b0c527d2164 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.406139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dbb586b-52d9-4bee-b99d-0b0c527d2164 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.406755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dbb586b-52d9-4bee-b99d-0b0c527d2164 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.610992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da38e7fd-3b14-4bb4-893e-dddfd0af71a7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:29.611982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da38e7fd-3b14-4bb4-893e-dddfd0af71a7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:29.621968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da38e7fd-3b14-4bb4-893e-dddfd0af71a7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.622443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da38e7fd-3b14-4bb4-893e-dddfd0af71a7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.623286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da38e7fd-3b14-4bb4-893e-dddfd0af71a7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.623738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da38e7fd-3b14-4bb4-893e-dddfd0af71a7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.688207 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da38e7fd-3b14-4bb4-893e-dddfd0af71a7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.081863 Nov 27 21:11:29.689623 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3071/6255] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:29 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:29.773080 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0dbb586b-52d9-4bee-b99d-0b0c527d2164 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.382274 Nov 27 21:11:29.774868 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3185/6256] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:11:29 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 27 21:11:29.790626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:29.791431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:29.799688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.800391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.801304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:29.801833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:29.975656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:29.983799 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-52d1cc04-71d7-4e82-8803-c290a056ec4c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.203688 Nov 27 21:11:29.984637 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3072/6257] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:29 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:30.702304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5457123e-1a38-431e-961c-a3a54b50a797 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:30.703486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5457123e-1a38-431e-961c-a3a54b50a797 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:30.711941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5457123e-1a38-431e-961c-a3a54b50a797 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:30.711941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5457123e-1a38-431e-961c-a3a54b50a797 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:30.711941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5457123e-1a38-431e-961c-a3a54b50a797 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:30.711941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5457123e-1a38-431e-961c-a3a54b50a797 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:30.758916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5457123e-1a38-431e-961c-a3a54b50a797 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.062031 Nov 27 21:11:30.763486 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3186/6258] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:30 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:31.002058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:31.002665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:31.009588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:31.010049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:31.010848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:31.011328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:31.157694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:31.165413 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cefef248-85b5-42f7-a394-9bbb7ee72e33 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.166985 Nov 27 21:11:31.166267 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3073/6259] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:30 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:31.530355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-769f96b1-73af-41af-8467-5caf17135823 req-2e087d7c-7938-4e45-a68c-153f7caa6081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-unplugged", "status": "completed", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:31.531878 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:11:31.531878 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:11:31.539030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-769f96b1-73af-41af-8467-5caf17135823 req-2e087d7c-7938-4e45-a68c-153f7caa6081 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:31.539752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-769f96b1-73af-41af-8467-5caf17135823 req-2e087d7c-7938-4e45-a68c-153f7caa6081 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:31.550625 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-769f96b1-73af-41af-8467-5caf17135823 req-2e087d7c-7938-4e45-a68c-153f7caa6081 service nova] Creating event network-vif-unplugged:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:11:31.556737 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-769f96b1-73af-41af-8467-5caf17135823 req-2e087d7c-7938-4e45-a68c-153f7caa6081 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171589 Nov 27 21:11:31.557347 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3187/6260] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:11:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:11:31.772226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7ab9bb0-0255-4e66-bfd9-70d3e35f8423 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:31.773166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7ab9bb0-0255-4e66-bfd9-70d3e35f8423 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:31.781324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7ab9bb0-0255-4e66-bfd9-70d3e35f8423 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:31.782029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7ab9bb0-0255-4e66-bfd9-70d3e35f8423 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:31.782826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7ab9bb0-0255-4e66-bfd9-70d3e35f8423 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:31.783282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7ab9bb0-0255-4e66-bfd9-70d3e35f8423 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:31.827010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7ab9bb0-0255-4e66-bfd9-70d3e35f8423 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.058486 Nov 27 21:11:31.827947 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3074/6261] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:31 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:32.185595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:32.186295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:32.192877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:32.193236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:32.193955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:32.194413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:32.345950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:32.354265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d93d02c-ba78-4488-b077-eb48016b1257 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1687 microversion: 2.1 time: 0.173688 Nov 27 21:11:32.355347 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3188/6262] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:32 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:32.839695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebf4b18b-0a19-406e-bcd9-828163ea4d1d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:32.841079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebf4b18b-0a19-406e-bcd9-828163ea4d1d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:32.849091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebf4b18b-0a19-406e-bcd9-828163ea4d1d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:32.849657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebf4b18b-0a19-406e-bcd9-828163ea4d1d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:32.850532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebf4b18b-0a19-406e-bcd9-828163ea4d1d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:32.851210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebf4b18b-0a19-406e-bcd9-828163ea4d1d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:32.897042 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebf4b18b-0a19-406e-bcd9-828163ea4d1d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.062221 Nov 27 21:11:32.897738 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3075/6263] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:32 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:33.387377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:33.388558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:33.396274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:33.396730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:33.397531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:33.397973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:33.706861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:33.716002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a47171d7-3de2-4a17-a88d-ef4d561106f3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.340917 Nov 27 21:11:33.717233 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3189/6264] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:33 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:33.910884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e86d99fe-839b-46ab-ac2c-2b5a4297a086 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:33.913155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e86d99fe-839b-46ab-ac2c-2b5a4297a086 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:33.924339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e86d99fe-839b-46ab-ac2c-2b5a4297a086 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:33.925527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e86d99fe-839b-46ab-ac2c-2b5a4297a086 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:33.927022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e86d99fe-839b-46ab-ac2c-2b5a4297a086 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:33.927896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e86d99fe-839b-46ab-ac2c-2b5a4297a086 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:34.013221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e86d99fe-839b-46ab-ac2c-2b5a4297a086 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.106171 Nov 27 21:11:34.018223 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3076/6265] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:33 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:34.733548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:34.734175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:34.750453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:34.750910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:34.751744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:34.752185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:34.988813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:35.006838 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2da4b1f9-a16a-4e0e-8410-fd53ab4da30e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.272138 Nov 27 21:11:35.007537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3190/6266] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:34 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:35.027183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-76f342bf-67d4-4270-9acf-dd326bc4f851 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:35.028290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-76f342bf-67d4-4270-9acf-dd326bc4f851 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:35.043740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76f342bf-67d4-4270-9acf-dd326bc4f851 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:35.044539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76f342bf-67d4-4270-9acf-dd326bc4f851 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:35.050445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76f342bf-67d4-4270-9acf-dd326bc4f851 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:35.051380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76f342bf-67d4-4270-9acf-dd326bc4f851 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:35.116206 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-76f342bf-67d4-4270-9acf-dd326bc4f851 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.093059 Nov 27 21:11:35.122772 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3077/6267] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:35 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:35.545106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3da9b22a-b810-4649-bf2c-6d0845f6c0dd req-1a31aa3d-4887-470a-8c0d-c3598a8be828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-plugged", "status": "completed", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:35.546861 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:11:35.546861 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:11:35.560872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3da9b22a-b810-4649-bf2c-6d0845f6c0dd req-1a31aa3d-4887-470a-8c0d-c3598a8be828 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:35.562155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3da9b22a-b810-4649-bf2c-6d0845f6c0dd req-1a31aa3d-4887-470a-8c0d-c3598a8be828 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:35.591000 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3da9b22a-b810-4649-bf2c-6d0845f6c0dd req-1a31aa3d-4887-470a-8c0d-c3598a8be828 service nova] Creating event network-vif-plugged:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:11:35.607720 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3da9b22a-b810-4649-bf2c-6d0845f6c0dd req-1a31aa3d-4887-470a-8c0d-c3598a8be828 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066919 Nov 27 21:11:35.609309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3191/6268] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:11:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:11:36.038407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:36.039902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:36.048839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:36.049623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:36.050596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:36.051203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:36.136197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c7483116-d111-481f-a1d2-5721e09d46ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:36.137906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c7483116-d111-481f-a1d2-5721e09d46ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:36.150614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7483116-d111-481f-a1d2-5721e09d46ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:36.151088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7483116-d111-481f-a1d2-5721e09d46ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:36.152000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7483116-d111-481f-a1d2-5721e09d46ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:36.155945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7483116-d111-481f-a1d2-5721e09d46ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:36.228455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c7483116-d111-481f-a1d2-5721e09d46ba tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.101336 Nov 27 21:11:36.233496 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3192/6269] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:36 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:36.343006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:36.357467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8d523484-b729-44ea-b5d0-633fc931d44a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.335690 Nov 27 21:11:36.359061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3078/6270] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:36 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:37.257056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35e89221-3881-4451-9049-26ee9c3ce772 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:37.260372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35e89221-3881-4451-9049-26ee9c3ce772 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:37.272508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e89221-3881-4451-9049-26ee9c3ce772 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:37.273395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e89221-3881-4451-9049-26ee9c3ce772 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:37.274672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e89221-3881-4451-9049-26ee9c3ce772 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:37.275572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e89221-3881-4451-9049-26ee9c3ce772 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:37.353684 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35e89221-3881-4451-9049-26ee9c3ce772 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.111832 Nov 27 21:11:37.359545 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3193/6271] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:37 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:37.375911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:37.376638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:37.390091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:37.394127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:37.395053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:37.396022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:37.780208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:37.789008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d9932c5-d34c-472e-9ce6-b0f94e876173 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.418480 Nov 27 21:11:37.789690 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3079/6272] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:37 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:38.368443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6cc6165f-b9b3-4622-957b-564fc00ed1e5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:38.369564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6cc6165f-b9b3-4622-957b-564fc00ed1e5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:38.384264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc6165f-b9b3-4622-957b-564fc00ed1e5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:38.390009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc6165f-b9b3-4622-957b-564fc00ed1e5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:38.391515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc6165f-b9b3-4622-957b-564fc00ed1e5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:38.392468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6cc6165f-b9b3-4622-957b-564fc00ed1e5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:38.458862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6cc6165f-b9b3-4622-957b-564fc00ed1e5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.095055 Nov 27 21:11:38.461880 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3194/6273] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:38 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:38.807615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:38.809114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:38.824059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:38.827017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:38.833023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:38.833477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:39.145486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:39.163737 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce533a6e-ecb9-4032-b1f7-ecae6eeb05d8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.360400 Nov 27 21:11:39.165774 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3080/6274] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:38 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:39.470751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52271679-924c-40dc-b526-0d226b8f9232 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:39.472362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52271679-924c-40dc-b526-0d226b8f9232 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:39.479853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52271679-924c-40dc-b526-0d226b8f9232 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:39.480602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52271679-924c-40dc-b526-0d226b8f9232 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:39.481575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52271679-924c-40dc-b526-0d226b8f9232 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:39.482182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52271679-924c-40dc-b526-0d226b8f9232 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:39.555020 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52271679-924c-40dc-b526-0d226b8f9232 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.086964 Nov 27 21:11:39.559774 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3195/6275] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:39 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:40.185705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:40.186948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:40.200366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:40.201049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:40.202076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:40.204336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:40.410137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:40.419036 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56029ba3-4665-4410-a769-6800e33931b4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.238636 Nov 27 21:11:40.422791 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3081/6276] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:40 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:40.568329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e671c9d1-822c-4558-b501-e9154d21cb66 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:40.569328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e671c9d1-822c-4558-b501-e9154d21cb66 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:40.583839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e671c9d1-822c-4558-b501-e9154d21cb66 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:40.584386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e671c9d1-822c-4558-b501-e9154d21cb66 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:40.587892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e671c9d1-822c-4558-b501-e9154d21cb66 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:40.588429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e671c9d1-822c-4558-b501-e9154d21cb66 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:40.661281 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e671c9d1-822c-4558-b501-e9154d21cb66 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.097057 Nov 27 21:11:40.664915 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3196/6277] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:40 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:11:41.448864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:41.451089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:41.458874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:41.459627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:41.461110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:41.461698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:41.674821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec68e4a5-8e9b-461a-bad8-215851ebc49e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:41.676773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ec68e4a5-8e9b-461a-bad8-215851ebc49e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:41.701700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec68e4a5-8e9b-461a-bad8-215851ebc49e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:41.702152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec68e4a5-8e9b-461a-bad8-215851ebc49e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:41.702957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec68e4a5-8e9b-461a-bad8-215851ebc49e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:41.703431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec68e4a5-8e9b-461a-bad8-215851ebc49e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:41.738867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:41.749602 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed272917-e88e-4dc0-9454-b4968828cc9b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.313483 Nov 27 21:11:41.752108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3082/6278] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:41 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:41.799433 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec68e4a5-8e9b-461a-bad8-215851ebc49e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.128496 Nov 27 21:11:41.804126 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3197/6279] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:41 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:42.772567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:42.773936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:42.783714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:42.784570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:42.785771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:42.786439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:42.814535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fdc39bee-17bf-4cd6-9141-8772382ea0a6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:42.816312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fdc39bee-17bf-4cd6-9141-8772382ea0a6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:42.845684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdc39bee-17bf-4cd6-9141-8772382ea0a6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:42.848678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdc39bee-17bf-4cd6-9141-8772382ea0a6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:42.850506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdc39bee-17bf-4cd6-9141-8772382ea0a6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:42.855123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdc39bee-17bf-4cd6-9141-8772382ea0a6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:42.929119 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fdc39bee-17bf-4cd6-9141-8772382ea0a6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.120431 Nov 27 21:11:42.931120 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3198/6280] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:42 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:43.228874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:43.237298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-457b27a0-5886-484c-a119-2916f3db25ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.472003 Nov 27 21:11:43.237882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3083/6281] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:42 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:43.943344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b7d356b3-6631-40a1-8369-3c517d75a1b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:43.945031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b7d356b3-6631-40a1-8369-3c517d75a1b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:43.953614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7d356b3-6631-40a1-8369-3c517d75a1b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:43.954360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7d356b3-6631-40a1-8369-3c517d75a1b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:43.956114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7d356b3-6631-40a1-8369-3c517d75a1b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:43.956556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b7d356b3-6631-40a1-8369-3c517d75a1b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:44.006265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b7d356b3-6631-40a1-8369-3c517d75a1b0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.067505 Nov 27 21:11:44.011364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3199/6282] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:43 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:44.256347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:44.257638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:44.274094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:44.274543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:44.275394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:44.279940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:44.607019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:44.625470 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7728e8ca-0330-4766-abbc-8d5f8cfd773f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.374278 Nov 27 21:11:44.626764 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3084/6283] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:44 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:45.018879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ae7675c-62d2-40c9-99e2-897855954693 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:45.019928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9ae7675c-62d2-40c9-99e2-897855954693 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:45.032337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ae7675c-62d2-40c9-99e2-897855954693 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:45.032796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ae7675c-62d2-40c9-99e2-897855954693 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:45.033606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ae7675c-62d2-40c9-99e2-897855954693 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:45.034389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ae7675c-62d2-40c9-99e2-897855954693 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:45.119516 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ae7675c-62d2-40c9-99e2-897855954693 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.104616 Nov 27 21:11:45.120946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3200/6284] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:45 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:45.645381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:45.646921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:45.665722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:45.666556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:45.667777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:45.668475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:46.046903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:46.062707 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc527773-9e0a-46e3-aeb6-1b704b809f32 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1682 microversion: 2.1 time: 0.418047 Nov 27 21:11:46.065236 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3085/6285] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:45 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:46.132479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3575c997-25cb-4a18-b719-db6578d489d2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:46.133741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3575c997-25cb-4a18-b719-db6578d489d2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:46.159649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3575c997-25cb-4a18-b719-db6578d489d2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:46.161683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3575c997-25cb-4a18-b719-db6578d489d2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:46.162635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3575c997-25cb-4a18-b719-db6578d489d2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:46.163362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3575c997-25cb-4a18-b719-db6578d489d2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:46.208084 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3575c997-25cb-4a18-b719-db6578d489d2 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.079617 Nov 27 21:11:46.213040 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3201/6286] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:46 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:47.087627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:47.088256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:47.095020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:47.095737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:47.096546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:47.096992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:47.230937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-40ab76db-f562-4d5d-b52b-6393267e2a10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:47.233665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-40ab76db-f562-4d5d-b52b-6393267e2a10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:47.247346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ab76db-f562-4d5d-b52b-6393267e2a10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:47.248940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ab76db-f562-4d5d-b52b-6393267e2a10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:47.250049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ab76db-f562-4d5d-b52b-6393267e2a10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:47.250660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-40ab76db-f562-4d5d-b52b-6393267e2a10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:47.317804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-40ab76db-f562-4d5d-b52b-6393267e2a10 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 32649 microversion: 2.20 time: 0.093833 Nov 27 21:11:47.319747 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3202/6287] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:47 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 32649 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:47.373934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:47.389468 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45a21fd2-a36f-4d9d-b0a1-4dcd99b79296 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.302755 Nov 27 21:11:47.390100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3086/6288] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:47 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:48.330959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2636f1c5-2668-4e32-a268-6abe76eee3fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:48.332179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2636f1c5-2668-4e32-a268-6abe76eee3fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:48.343631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2636f1c5-2668-4e32-a268-6abe76eee3fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:48.344088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2636f1c5-2668-4e32-a268-6abe76eee3fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:48.344892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2636f1c5-2668-4e32-a268-6abe76eee3fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:48.345334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2636f1c5-2668-4e32-a268-6abe76eee3fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:48.411577 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2636f1c5-2668-4e32-a268-6abe76eee3fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 200 len: 40799 microversion: 2.20 time: 0.084612 Nov 27 21:11:48.412574 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3203/6289] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:48 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 40799 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:48.423508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc568ccd-2b55-47c9-8c89-7ceb523d7ab3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:48.424153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc568ccd-2b55-47c9-8c89-7ceb523d7ab3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:48.435539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc568ccd-2b55-47c9-8c89-7ceb523d7ab3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:48.436100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc568ccd-2b55-47c9-8c89-7ceb523d7ab3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:48.437187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc568ccd-2b55-47c9-8c89-7ceb523d7ab3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:48.437864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc568ccd-2b55-47c9-8c89-7ceb523d7ab3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:48.468154 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc568ccd-2b55-47c9-8c89-7ceb523d7ab3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/ips" status: 200 len: 152 microversion: 2.20 time: 0.048632 Nov 27 21:11:48.469296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3087/6290] 10.222.0.21 () {60 vars in 1288 bytes} [Sat Nov 27 21:11:48 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:11:48.564179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:48.565165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:48.580459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:48.580915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:48.583818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:48.584932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:48.781041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:48.792159 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5b6a585-fed4-457c-a548-6f85c8b303de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.233556 Nov 27 21:11:48.793319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3204/6291] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:48 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:49.486362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-76ee5199-f13b-4dc0-a673-ad828f6f722b req-c4084803-4388-4ed0-a124-867d12dd303e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-unplugged", "status": "completed", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:49.487954 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:11:49.487954 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:11:49.506235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-76ee5199-f13b-4dc0-a673-ad828f6f722b req-c4084803-4388-4ed0-a124-867d12dd303e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:49.507373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-76ee5199-f13b-4dc0-a673-ad828f6f722b req-c4084803-4388-4ed0-a124-867d12dd303e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:49.530799 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-76ee5199-f13b-4dc0-a673-ad828f6f722b req-c4084803-4388-4ed0-a124-867d12dd303e service nova] Creating event network-vif-unplugged:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:11:49.539561 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-76ee5199-f13b-4dc0-a673-ad828f6f722b req-c4084803-4388-4ed0-a124-867d12dd303e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056719 Nov 27 21:11:49.540648 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3088/6292] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:11:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:11:50.030435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:50.031137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:50.038702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.039160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.039993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.040439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.286779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:50.296564 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b513054-bcd3-4c07-b82b-af7df8ac016a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.271145 Nov 27 21:11:50.300469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3205/6293] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:50 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:50.317281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-79d23eb4-4126-4519-9836-88018611180e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:50.318697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-79d23eb4-4126-4519-9836-88018611180e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:50.327522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79d23eb4-4126-4519-9836-88018611180e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.327985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79d23eb4-4126-4519-9836-88018611180e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.329206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79d23eb4-4126-4519-9836-88018611180e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.330402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79d23eb4-4126-4519-9836-88018611180e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.417210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-79d23eb4-4126-4519-9836-88018611180e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.103866 Nov 27 21:11:50.419312 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3089/6294] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:11:50 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:11:50.427498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:50.428660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:50.436572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.437426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.438339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.438703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.636072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:50.645717 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27c81d91-2be6-45d5-ba19-61e2119dc201 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1671 microversion: 2.1 time: 0.221903 Nov 27 21:11:50.647431 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3206/6295] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:50 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:50.717843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:50.719092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:50.726604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.727069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.727901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:50.728340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:50.764810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lazy-loading 'flavor' on Instance uuid b8df0f80-255e-416b-b79a-4bed627485da {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:11:51.033448 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0b4799c-162e-4740-a2cd-0cbd0636bd95 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 202 len: 0 microversion: 2.20 time: 0.320851 Nov 27 21:11:51.034108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3090/6296] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:11:50 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:11:51.042747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:51.043387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:51.051241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:51.051886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:51.052879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:51.053321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:51.203479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:51.213685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:51.216695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:51.217911 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b4d3f79-e480-430e-91f5-240af9452738 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.179262 Nov 27 21:11:51.218473 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3207/6297] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:51 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:11:51.665435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:51.666446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:51.673290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:51.673843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:51.674700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:51.675215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:51.969558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:51.989543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1af9eda6-6ae9-4974-87da-4f05cf41c91c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1671 microversion: 2.1 time: 0.328697 Nov 27 21:11:51.990339 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3091/6298] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:51 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1671 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:52.239983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:52.240687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:52.250585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:52.251352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:52.283232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:52.289519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:52.471207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:52.479690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:52.481497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:52.482882 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4b7999b-6a2f-4b9f-8394-fea7023ce202 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.247561 Nov 27 21:11:52.483487 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3208/6299] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:52 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:11:53.008479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:53.009100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:53.016154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.016608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.017592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.018044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.219339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:53.227185 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a1609325-f3ae-4867-88a4-4168ea45223d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.222356 Nov 27 21:11:53.227786 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3092/6300] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:53 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:53.245311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d8e7cee-3752-4385-aaff-cc52c7e8fc54 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:53.246321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d8e7cee-3752-4385-aaff-cc52c7e8fc54 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:53.259730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d8e7cee-3752-4385-aaff-cc52c7e8fc54 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.260704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d8e7cee-3752-4385-aaff-cc52c7e8fc54 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.262278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d8e7cee-3752-4385-aaff-cc52c7e8fc54 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.262975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d8e7cee-3752-4385-aaff-cc52c7e8fc54 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.317677 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d8e7cee-3752-4385-aaff-cc52c7e8fc54 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 322 microversion: 2.1 time: 0.076041 Nov 27 21:11:53.319814 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3209/6301] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:11:53 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 322 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:11:53.328436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:53.329088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:53.341375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.342098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.343148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.345578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.503820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:53.508880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:53.509580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:53.512670 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8b99282-266c-43f0-848e-4f14da7e61f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.189037 Nov 27 21:11:53.513924 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3093/6302] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:53 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:11:53.517637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.518093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.518948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.519591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.531281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:53.532239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:53.538405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.538858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.539678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:53.540286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:53.701296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:53.710004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-08e18f2e-a714-465d-87f1-cd5f0fb4547b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.182536 Nov 27 21:11:53.710887 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3094/6303] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:53 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:11:53.830490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2071753257", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "07546b02-5ee2-4818-98ab-2b9b50e1991f"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:53.830737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:53.839771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:53.841547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:53.842939 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cb562e19-a4b6-4b9b-9af6-0fb1d73603f8 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.344419 Nov 27 21:11:53.843737 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3210/6304] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:53 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:11:53.905676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] validate_networks() for [('07546b02-5ee2-4818-98ab-2b9b50e1991f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:11:54.462893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:11:54.463588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:11:54.463799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:11:54.464930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:11:54.465517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:11:54.481659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:54.482693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:54.483727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:54.484336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:54.507075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:11:54.513257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for user 43d9798c04074bc9ac45eb33bf3adb46 and project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:11:54.528635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:11:54.531337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:11:54.582698 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f40b774a-f1bc-4089-b1ad-b92183c75197 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755940 Nov 27 21:11:54.583766 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3095/6305] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:11:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:11:54.594539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-702f2672-28e7-482c-bf14-6d2a69550260 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:54.595869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-702f2672-28e7-482c-bf14-6d2a69550260 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:54.746490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-702f2672-28e7-482c-bf14-6d2a69550260 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:54.754384 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-702f2672-28e7-482c-bf14-6d2a69550260 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1215 microversion: 2.1 time: 0.163670 Nov 27 21:11:54.766130 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3211/6306] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:54 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:54.861998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:54.862723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:54.871040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:54.871641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:54.872526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:54.873274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:55.024226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:55.034279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:55.037026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:55.038950 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d121eacb-1bb9-4873-9b9b-2cd176df1e83 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.181187 Nov 27 21:11:55.039552 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3096/6307] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:54 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:11:55.772292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:55.773545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:55.780881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:55.781334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:55.782125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:55.782559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:55.888053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:55.895511 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8cc82a5-9599-4c42-a3d5-e39885a3912e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1273 microversion: 2.1 time: 0.126800 Nov 27 21:11:55.896081 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3212/6308] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:55 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:56.057134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:56.058012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:56.065926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:56.066439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:56.067168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:56.067633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:56.217083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:56.226750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:56.230293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:56.231614 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc01ab0a-2506-44a6-82fa-e9052d1b6274 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.178237 Nov 27 21:11:56.232273 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3097/6309] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:56 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:11:56.913274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:56.913831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:56.923535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:56.924278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:56.925933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:56.926606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:57.178431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:57.201872 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d61a1e5e-8b8c-485b-b54e-339e8a198549 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1315 microversion: 2.1 time: 0.290538 Nov 27 21:11:57.204491 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3213/6310] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:56 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:57.250615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:57.251421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:57.267741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:57.268332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:57.269196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:57.269664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:57.658245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8a4906f5-e74f-4519-8770-45f338bf598e req-8b2abd24-1f3a-43a0-ac09-58e628c5f2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb1c8da-f09b-43a2-9846-c52c9f98a646", "tag": "6a0db82d-42af-4626-865e-04c5b42fc108"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:11:57.660211 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:11:57.660211 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:11:57.678527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8a4906f5-e74f-4519-8770-45f338bf598e req-8b2abd24-1f3a-43a0-ac09-58e628c5f2d4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:57.678883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8a4906f5-e74f-4519-8770-45f338bf598e req-8b2abd24-1f3a-43a0-ac09-58e628c5f2d4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:57.697020 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8a4906f5-e74f-4519-8770-45f338bf598e req-8b2abd24-1f3a-43a0-ac09-58e628c5f2d4 service nova] Creating event network-changed:6a0db82d-42af-4626-865e-04c5b42fc108 for instance ffb1c8da-f09b-43a2-9846-c52c9f98a646 on nch2-master-1 Nov 27 21:11:57.710309 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8a4906f5-e74f-4519-8770-45f338bf598e req-8b2abd24-1f3a-43a0-ac09-58e628c5f2d4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057630 Nov 27 21:11:57.710924 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3214/6311] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:11:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:11:57.712594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:57.721165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:57.722691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:57.731098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33c5b5d8-72da-4831-a3ad-85c14a8077dd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.484296 Nov 27 21:11:57.733832 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3098/6312] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:57 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:11:58.233072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:58.233779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:58.249816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:58.250535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:58.252679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:58.265829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:58.489393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:58.498115 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a6262bf1-855c-427b-9745-4f1f380e1400 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1315 microversion: 2.1 time: 0.276852 Nov 27 21:11:58.498724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3215/6313] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:58 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:58.751959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:58.753342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:58.761412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:58.761959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:58.762991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:58.763698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:58.916210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:58.925734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:58.927664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:58.929406 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a8e73b9b-fc16-4956-9af8-0a995f79f870 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.181234 Nov 27 21:11:58.940210 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3099/6314] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:58 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:11:59.515941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:59.516708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:59.523552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:59.523979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:59.524775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:59.525215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:59.765769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:11:59.774373 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6339d24-6a5c-4619-872d-13480437b320 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1315 microversion: 2.1 time: 0.262330 Nov 27 21:11:59.775121 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3216/6315] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:11:59 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:11:59.949723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:11:59.950475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:11:59.957798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:59.958276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:11:59.959280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:11:59.959956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:00.223881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:00.233439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:00.235481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:00.236980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71a118b6-cfa7-4604-a145-60885522af5a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.293302 Nov 27 21:12:00.237873 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3100/6316] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:11:59 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:00.792823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:00.793485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:00.800948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:00.801408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:00.802416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:00.803030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:00.954376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:00.962400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f4c7116c-16fb-4e25-b7af-671b1546936c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1315 microversion: 2.1 time: 0.173783 Nov 27 21:12:00.963135 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3217/6317] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:00 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:01.256600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:01.257214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:01.264205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:01.264604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:01.265397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:01.265868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:01.525136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:01.533365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:01.534868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:01.536071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8821d0d-a3b4-484c-b2cf-1295f61e5b96 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.283267 Nov 27 21:12:01.536643 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3101/6318] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:01 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:01.980106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:01.980841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:01.991216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:01.992088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:01.993415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:01.994242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:02.153774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:02.162128 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6e459eb-f2b2-4751-8654-36fcc6aa1286 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1315 microversion: 2.1 time: 0.186769 Nov 27 21:12:02.162717 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3218/6319] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:01 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:02.553863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:02.554735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:02.562672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:02.563214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:02.564111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:02.564729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:02.767115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:02.779773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:02.781925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:02.783107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a74bf464-8f5c-451e-81ac-9db6df44865c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.233069 Nov 27 21:12:02.784267 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3102/6320] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:02 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:03.178618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:03.179590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:03.186872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:03.187507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:03.188408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:03.189126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:03.790431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:03.801739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f9fdca5-800e-4d58-8f98-b9a601e7e6c6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1315 microversion: 2.1 time: 0.626695 Nov 27 21:12:03.802364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:03.803049 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3219/6321] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:03 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:03.804216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:03.820740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:03.821422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:03.823311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:03.823991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:04.006415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:04.015525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:04.017180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:04.018390 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2cc2e4a-4c81-4de5-aa38-5878e5d9c8ad tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.220376 Nov 27 21:12:04.019927 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3103/6322] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:03 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:04.554450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-08185e55-88b3-4d7e-9a6f-d1238f84f0f2 req-3acf2941-be05-4283-bcf7-46450420cf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb1c8da-f09b-43a2-9846-c52c9f98a646", "name": "network-vif-plugged", "status": "completed", "tag": "6a0db82d-42af-4626-865e-04c5b42fc108"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:04.556479 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:12:04.556479 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:12:04.569129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-08185e55-88b3-4d7e-9a6f-d1238f84f0f2 req-3acf2941-be05-4283-bcf7-46450420cf78 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:04.571526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-08185e55-88b3-4d7e-9a6f-d1238f84f0f2 req-3acf2941-be05-4283-bcf7-46450420cf78 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:04.591100 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-08185e55-88b3-4d7e-9a6f-d1238f84f0f2 req-3acf2941-be05-4283-bcf7-46450420cf78 service nova] Creating event network-vif-plugged:6a0db82d-42af-4626-865e-04c5b42fc108 for instance ffb1c8da-f09b-43a2-9846-c52c9f98a646 on nch2-master-1 Nov 27 21:12:04.597287 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-08185e55-88b3-4d7e-9a6f-d1238f84f0f2 req-3acf2941-be05-4283-bcf7-46450420cf78 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047184 Nov 27 21:12:04.598892 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3220/6323] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:12:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:12:04.822238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:04.822871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:04.832009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:04.832898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:04.833878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:04.834687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:05.037865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:05.038765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:05.045532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:05.045987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:05.046773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:05.047216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:05.096580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:05.103964 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-368d5922-730d-4c6f-8ace-7ff1af73db0f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1315 microversion: 2.1 time: 0.285803 Nov 27 21:12:05.105541 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3104/6324] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:04 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:05.180780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:05.188855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:05.190363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:05.191560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58753f7c-bd1f-48e1-a744-e7087b56487e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.157835 Nov 27 21:12:05.192119 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3221/6325] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:05 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:06.122325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:06.123090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:06.130737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:06.131364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:06.134636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:06.135363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:06.218449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:06.219058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:06.227998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:06.228686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:06.229697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:06.230294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:06.334739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:06.342949 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ff54d24-9a59-4f59-960a-504a06948ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1501 microversion: 2.1 time: 0.226103 Nov 27 21:12:06.344146 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3105/6326] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:06 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:06.359998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0937f404-00a3-4fe6-b913-b19f3bbcd8ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:06.367149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0937f404-00a3-4fe6-b913-b19f3bbcd8ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:06.368249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0937f404-00a3-4fe6-b913-b19f3bbcd8ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:06.401665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0937f404-00a3-4fe6-b913-b19f3bbcd8ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Going to try to stop instance {{(pid=135679) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 21:12:06.456484 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0937f404-00a3-4fe6-b913-b19f3bbcd8ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646/action" status: 202 len: 0 microversion: 2.1 time: 0.099397 Nov 27 21:12:06.457450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3106/6327] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:12:06 2021] POST /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:12:06.467495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:06.468280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:06.474004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:06.476087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:06.476757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:06.477819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:06.478690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:06.489698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:06.492206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:06.493900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d1e4100-0acb-4cd1-9f3d-f2a2d3182c09 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.287797 Nov 27 21:12:06.494472 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3222/6328] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:06 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:06.566932 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:12:06.567161 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:12:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:12:06.650195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:06.657713 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1162dd2-8502-48b2-9824-c3280b996a4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.195975 Nov 27 21:12:06.658447 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3107/6329] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:06 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:12:07.513584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:07.514479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:07.521417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:07.521976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:07.522870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:07.523440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:07.674735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:07.675997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:07.683644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:07.684096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:07.685087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:07.685701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:07.763659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:07.773369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:07.775612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:07.779934 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05fed13b-8938-4ad7-90b6-dc350df9a40e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1744 microversion: 2.20 time: 0.270190 Nov 27 21:12:07.781024 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3223/6330] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:07 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1744 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:07.852549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:07.862224 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e421e138-fe35-4a34-b43e-abe651039ea4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.191086 Nov 27 21:12:07.863112 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3108/6331] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:07 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:08.797988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:08.798575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:08.805928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:08.806492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:08.807997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:08.808692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:08.881622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:08.883066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:08.894300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:08.895062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:08.896175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:08.896616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:09.070950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:09.081869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58a4ae2d-fef4-4620-98c6-295c16a9f6db tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.203979 Nov 27 21:12:09.082572 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3109/6332] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:08 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:09.090785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:09.098943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:09.100622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:09.102126 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-455ba85e-c2d1-41c2-9053-df6801e72744 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1744 microversion: 2.20 time: 0.308064 Nov 27 21:12:09.103129 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3224/6333] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:08 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1744 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:10.099365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:10.100124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:10.107815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:10.108500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:10.109353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:10.110013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:10.123243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:10.123879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:10.130449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:10.130827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:10.131632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:10.132063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:10.291228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:10.299611 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0fb000ca-df9d-4b67-85c2-103a07ac8ffd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.203773 Nov 27 21:12:10.300057 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3110/6334] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:10 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:10.381617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:10.391211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:10.393144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:10.394580 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6b1c982-ae24-4b76-a9c7-ac02a4ff3d2b tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1744 microversion: 2.20 time: 0.274988 Nov 27 21:12:10.395345 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3225/6335] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:10 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1744 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:10.679539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8cbf912b-9dec-40f6-bffa-1a5c846c9cfe req-c7aa3919-83f4-4648-8321-c9a9d987ce10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "name": "network-vif-plugged", "status": "completed", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:10.681356 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:12:10.681356 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:12:10.689302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8cbf912b-9dec-40f6-bffa-1a5c846c9cfe req-c7aa3919-83f4-4648-8321-c9a9d987ce10 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:10.689824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8cbf912b-9dec-40f6-bffa-1a5c846c9cfe req-c7aa3919-83f4-4648-8321-c9a9d987ce10 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:10.702795 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8cbf912b-9dec-40f6-bffa-1a5c846c9cfe req-c7aa3919-83f4-4648-8321-c9a9d987ce10 service nova] Creating event network-vif-plugged:9b807251-334b-4d12-8574-592e43e94490 for instance b8df0f80-255e-416b-b79a-4bed627485da on nch2-master-1 Nov 27 21:12:10.708134 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8cbf912b-9dec-40f6-bffa-1a5c846c9cfe req-c7aa3919-83f4-4648-8321-c9a9d987ce10 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Nov 27 21:12:10.709407 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3111/6336] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:12:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:12:11.316873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:11.317802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:11.326799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:11.327439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:11.328483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:11.329032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:11.415198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:11.416291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:11.425410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:11.425988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:11.426931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:11.427778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:11.587787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:11.599781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:11.602003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:11.603617 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de2bfcdb-5fa4-4b98-8caa-e632e2cfa2c0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1744 microversion: 2.20 time: 0.192771 Nov 27 21:12:11.604723 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3112/6337] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:11 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:11.647621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:11.656317 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-413c3321-e003-46c1-a008-d9a00881045b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.343181 Nov 27 21:12:11.657488 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3226/6338] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:11 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:12.622222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:12.623015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:12.630064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:12.630656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:12.631594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:12.632270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:12.673858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:12.674557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:12.683726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:12.684705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:12.685703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:12.686325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:12.824525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:12.833101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:12.834976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:12.836664 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4c98cc0f-52ad-445e-8fc8-db4a36bddc73 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1744 microversion: 2.20 time: 0.218523 Nov 27 21:12:12.837414 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3113/6339] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:12 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:12.950319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:12.958658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5089cdba-5674-4241-97b9-f12840ceb087 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.288577 Nov 27 21:12:12.960050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3227/6340] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:12 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:12:13.856798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:13.857740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:13.871484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:13.874331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:13.881669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:13.882179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:13.977601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:13.978933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:13.986237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:13.986701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:13.987576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:13.993723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:14.228593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:14.234970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:14.238115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:14.239655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:14.240829 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10197701-ec8b-4e2e-a1dc-ea808e28fffc tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.388616 Nov 27 21:12:14.245800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3114/6341] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:13 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:14.248275 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-557bc817-5d93-4668-b673-c4afc4d38b3d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.274794 Nov 27 21:12:14.249114 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3228/6342] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:13 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:15.271708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:15.272571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:15.277654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:15.278502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:15.281536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:15.281991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:15.282779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:15.293187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:15.294316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:15.295061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:15.297556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:15.298274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:15.552348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:15.567055 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cf475fa-a632-48ac-88aa-36fafc6b205a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.292091 Nov 27 21:12:15.570824 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3229/6343] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:15 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:15.654744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:15.664343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:15.666106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:15.667858 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1959e452-76bb-4e56-8ef3-450b1c00045c tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.400396 Nov 27 21:12:15.668938 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3115/6344] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:15 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:16.586251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:16.586874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:16.605677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:16.607448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:16.617976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:16.618626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:16.686027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:16.686637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:16.695569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:16.696224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:16.697226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:16.698404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:16.817766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:16.827583 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b57bbeee-9f44-485a-b610-adac968a1ccf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.244648 Nov 27 21:12:16.832988 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3230/6345] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:16 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:17.005033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:17.017770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:17.020030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:17.022414 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8029ac3e-a835-4d13-8e57-75e6670ac129 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.340448 Nov 27 21:12:17.027060 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3116/6346] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:16 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:17.849680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:17.850357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:17.869150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:17.870552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:17.871669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:17.872342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:18.040721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:18.044083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:18.045120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:18.051009 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f79dcc91-8a86-44e5-a8cb-6fa490e75127 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.203533 Nov 27 21:12:18.061324 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3231/6347] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:17 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:18.062179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:18.063809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:18.064742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:18.065281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:18.438386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:18.457696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:18.459941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:18.461239 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-552b7e64-7a10-44ce-a7b0-fd9863598802 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.421727 Nov 27 21:12:18.468935 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3117/6348] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:18 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:19.069655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:19.070197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:19.077957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:19.078696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:19.079514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:19.079948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:19.260605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:19.273162 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06724174-ab09-4949-9412-99eafaf98f02 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.207800 Nov 27 21:12:19.274342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3232/6349] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:19 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:19.480521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:19.484632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:19.494966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:19.495452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:19.498467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:19.499191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:19.921938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:19.931141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:19.932720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:19.933913 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-404917b6-7f12-448b-b50b-d7c653152c08 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.457409 Nov 27 21:12:19.934481 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3118/6350] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:19 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:20.290875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:20.292031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:20.306268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:20.307424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:20.310135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:20.310825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:20.601909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:20.623641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-01a04448-1801-4d3b-8a3a-f3780bea7845 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.336099 Nov 27 21:12:20.625001 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3233/6351] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:20 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:20.953199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:20.967709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:20.975539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:20.976711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:20.977602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:20.978054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:21.235476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:21.251641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:21.255489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:21.258206 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-03cf1756-ffa0-4e71-99db-5bdfeb359c64 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.308798 Nov 27 21:12:21.261472 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3119/6352] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:20 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:21.641122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:21.641805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:21.653655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:21.654177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:21.655117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:21.656908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:21.941161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:21.955891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf5215c8-67eb-4516-956d-658624d2b779 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.318350 Nov 27 21:12:21.958228 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3234/6353] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:21 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:22.281925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:22.282845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:22.314444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:22.314942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:22.315806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:22.316256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:22.552098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:22.568936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:22.577485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:22.578720 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efbf967d-0061-4f0c-8966-a89fe9768aec tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.303173 Nov 27 21:12:22.582980 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3120/6354] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:22 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:22.979985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:22.980964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:22.997016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:22.997478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:22.998288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:22.998735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:23.207538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:23.224729 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d448e67-91d1-4979-bc92-88c0face9725 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.253118 Nov 27 21:12:23.226427 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3235/6355] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:22 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:23.599928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:23.601198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:23.609245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:23.610033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:23.611040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:23.611680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:23.845055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:23.861468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:23.863086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:23.870469 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-507ae3ec-c7d7-4e10-add0-0a6d4f560b24 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.277433 Nov 27 21:12:23.884596 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3121/6356] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:23 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:24.247029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:24.248339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:24.256299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:24.256840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:24.258059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:24.258838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:24.458237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:24.467683 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2601ce56-7f51-4a36-9a0c-04a10a9879c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.226829 Nov 27 21:12:24.475782 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3236/6357] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:24 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:24.891618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:24.893165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:24.908241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:24.909013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:24.910076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:24.910512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:25.449716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:25.464278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:25.465781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:25.466986 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f150303-6822-4c04-935a-918047ce2e1a tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.579101 Nov 27 21:12:25.480142 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3122/6358] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:24 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:25.485130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:25.485820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:25.493442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:25.494004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:25.495394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:25.496036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:25.726665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:25.738718 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c50881c3-fb58-424d-85f0-fc76f7a04f13 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.257063 Nov 27 21:12:25.749350 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3237/6359] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:25 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:26.489598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:26.490222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:26.498491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:26.498957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:26.499796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:26.500245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:26.647176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:26.656249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:26.657771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:26.659098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d952a24-1f0f-4da4-bafc-dc16da733775 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1739 microversion: 2.20 time: 0.173291 Nov 27 21:12:26.670721 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3123/6360] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:26 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:26.756631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:26.757241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:26.764244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:26.764699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:26.765488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:26.765928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:27.007315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:27.039523 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8cd7b594-564d-4e4a-8475-bb22c86f9a67 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.286374 Nov 27 21:12:27.040666 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3238/6361] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:26 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:27.680078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:27.680714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:27.693221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:27.693676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:27.694582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:27.695032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:27.938351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:27.946779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:27.948360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:27.949898 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31dac57b-c2ea-4804-a5a6-b1416776f98d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1721 microversion: 2.20 time: 0.275882 Nov 27 21:12:27.961675 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3124/6362] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:27 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:28.058072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:28.058699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:28.066485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:28.067330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:28.068385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:28.069056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:28.214988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:28.223953 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c894922d-d17a-4899-9ec9-bf30c9490390 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.169819 Nov 27 21:12:28.225185 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3239/6363] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:28 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:28.969353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:28.969986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:28.976592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:28.977055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:28.978008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:28.978444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:29.111602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:29.122342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:29.124492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:29.125967 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-828ba17e-34ee-442b-b242-bc21081d34d0 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1721 microversion: 2.20 time: 0.160985 Nov 27 21:12:29.127049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3125/6364] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:28 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:29.241992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:29.242914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:29.250428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:29.250792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:29.251615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:29.252463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:29.820727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:29.830655 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15648aa8-2b3f-4c0a-bee0-54d838f3a167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.592523 Nov 27 21:12:29.831236 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3240/6365] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:29 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:30.145736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:30.146329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:30.153479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.153948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.154767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.155218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.308915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:30.319986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:30.322852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:30.324435 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8ee0560-1316-47b2-9948-232464d25c7e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1664 microversion: 2.20 time: 0.182580 Nov 27 21:12:30.325261 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3126/6366] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:30 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1664 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:30.343126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1381cde0-20b4-4434-b066-506a20692f34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a366b83-a0ec-42b7-98c0-e632fe54a2ac"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:30.345153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1381cde0-20b4-4434-b066-506a20692f34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:30.352189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1381cde0-20b4-4434-b066-506a20692f34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.352878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1381cde0-20b4-4434-b066-506a20692f34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.354076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1381cde0-20b4-4434-b066-506a20692f34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.354802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1381cde0-20b4-4434-b066-506a20692f34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.647058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-74c4640b-b9cc-4938-b184-2bf0c81e7984 req-7f31d9c7-889a-422c-a131-df8635d3cd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "name": "network-vif-unplugged", "status": "completed", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:30.648586 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:12:30.648586 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:12:30.660703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-74c4640b-b9cc-4938-b184-2bf0c81e7984 req-7f31d9c7-889a-422c-a131-df8635d3cd32 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.663761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-74c4640b-b9cc-4938-b184-2bf0c81e7984 req-7f31d9c7-889a-422c-a131-df8635d3cd32 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.688471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_external_events [req-74c4640b-b9cc-4938-b184-2bf0c81e7984 req-7f31d9c7-889a-422c-a131-df8635d3cd32 service nova] Unable to find a host for instance b8df0f80-255e-416b-b79a-4bed627485da. Dropping event network-vif-unplugged {{(pid=135679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 21:12:30.692198 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-74c4640b-b9cc-4938-b184-2bf0c81e7984 req-7f31d9c7-889a-422c-a131-df8635d3cd32 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048997 Nov 27 21:12:30.695408 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3127/6367] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:12:30 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 27 21:12:30.741209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1381cde0-20b4-4434-b066-506a20692f34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.401733 Nov 27 21:12:30.742133 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3241/6368] 10.222.0.21 () {62 vars in 1363 bytes} [Sat Nov 27 21:12:30 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-volume_attachments => generated 188 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:12:30.849080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:30.850142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:30.859757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.860569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.861589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.862634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.901986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:30.902495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:30.909205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.909673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:30.910475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:30.921679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:31.045811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:31.058922 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-59fed82b-814e-4230-b071-2584f14e9730 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.213738 Nov 27 21:12:31.059563 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3128/6369] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:30 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:31.186504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b11b9b1b-4b84-4181-bc28-f0bb66651e29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-volume_attachments/5a366b83-a0ec-42b7-98c0-e632fe54a2ac" status: 202 len: 0 microversion: 2.20 time: 0.288707 Nov 27 21:12:31.187240 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3242/6370] 10.222.0.21 () {60 vars in 1456 bytes} [Sat Nov 27 21:12:30 2021] DELETE /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-volume_attachments/5a366b83-a0ec-42b7-98c0-e632fe54a2ac => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:12:31.247239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7fd01ddd-548d-49af-9829-14519d5e8e33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:31.247867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7fd01ddd-548d-49af-9829-14519d5e8e33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:31.255879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fd01ddd-548d-49af-9829-14519d5e8e33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:31.256462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fd01ddd-548d-49af-9829-14519d5e8e33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:31.257365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fd01ddd-548d-49af-9829-14519d5e8e33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:31.257935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7fd01ddd-548d-49af-9829-14519d5e8e33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:31.341740 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7fd01ddd-548d-49af-9829-14519d5e8e33 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action" status: 202 len: 0 microversion: 2.20 time: 0.099320 Nov 27 21:12:31.345293 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3129/6371] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:12:31 2021] POST /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:12:31.350278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:31.350880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:31.359013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:31.359501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:31.360472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:31.360902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:31.642930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:31.659987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:31.662375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:31.664041 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f90fd86-fb5b-455f-907b-a546f95fe644 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1672 microversion: 2.20 time: 0.317462 Nov 27 21:12:31.665024 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3243/6372] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:31 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1672 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:32.076504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:32.077523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:32.084037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:32.084684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:32.085834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:32.086437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:32.257600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:32.266186 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2593cd26-c1d5-4af1-8608-18ef18dd1976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.193706 Nov 27 21:12:32.266899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3130/6373] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:32 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:32.682104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:32.683241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:32.691014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:32.691790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:32.692761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:32.694441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:32.904094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:32.912492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:32.914150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:32.915504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6d7bbb0-77be-4ebd-8846-6eb1aa2a5eae tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.237461 Nov 27 21:12:32.916150 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3244/6374] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:32 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:33.284274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:33.284894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:33.297581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:33.298048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:33.298855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:33.299333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:33.587085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:33.595710 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32b81b63-2d1c-438f-b950-136639a7021a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.315116 Nov 27 21:12:33.596498 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3131/6375] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:33 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:12:33.885080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4bc681d5-b8ee-4fa4-a6c5-dc4c6bc12a1c req-8a45c051-f957-4898-ab96-a304adee8eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:33.886813 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:12:33.886813 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:12:33.897249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4bc681d5-b8ee-4fa4-a6c5-dc4c6bc12a1c req-8a45c051-f957-4898-ab96-a304adee8eef service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:33.897695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4bc681d5-b8ee-4fa4-a6c5-dc4c6bc12a1c req-8a45c051-f957-4898-ab96-a304adee8eef service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:33.930816 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4bc681d5-b8ee-4fa4-a6c5-dc4c6bc12a1c req-8a45c051-f957-4898-ab96-a304adee8eef service nova] Creating event network-changed:9b807251-334b-4d12-8574-592e43e94490 for instance b8df0f80-255e-416b-b79a-4bed627485da on nch1-master-1 Nov 27 21:12:33.935113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:33.936358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:33.947519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:33.948086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:33.948853 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4bc681d5-b8ee-4fa4-a6c5-dc4c6bc12a1c req-8a45c051-f957-4898-ab96-a304adee8eef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177596 Nov 27 21:12:33.949666 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3245/6376] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:12:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:12:33.952462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:33.953190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:34.248118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:34.260440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:34.263344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:34.264780 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe2f20e9-7a66-4dc9-9580-cbc03e8f2a29 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.334504 Nov 27 21:12:34.275753 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3132/6377] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:33 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:34.613152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:34.614096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:34.632029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:34.632783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:34.633774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:34.635388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:34.926577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:34.937246 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59de3908-2112-45df-9f24-3ff61c98ecaa tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.328178 Nov 27 21:12:34.937918 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3246/6378] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:34 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:35.283534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:35.284517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:35.295384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:35.297677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:35.300325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:35.301715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:35.631934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:35.653387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:35.656936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:35.658676 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cee12dfb-96b9-4b04-ae7c-5dfdcda1cc9f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.379225 Nov 27 21:12:35.673991 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3133/6379] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:35 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:35.954640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:35.956809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:35.965634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:35.967209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:35.968296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:35.968989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:36.215572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:36.223864 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5bc7b1ef-be94-4759-929b-7e4741666695 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1511 microversion: 2.1 time: 0.273336 Nov 27 21:12:36.224561 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3247/6380] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:35 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:36.681092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:36.682460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:36.693053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:36.694116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:36.695529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:36.696042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:36.898935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:36.909365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:36.911377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:36.913082 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a162cab1-a289-41a4-96d6-aae47752b1f5 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.236138 Nov 27 21:12:36.914301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3134/6381] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:36 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:37.243595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:37.244938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:37.254717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:37.255566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:37.256964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:37.257799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:37.506021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:37.515411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-171d8641-5320-463b-a9b4-4e9435e6f959 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1488 microversion: 2.1 time: 0.276871 Nov 27 21:12:37.516421 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3248/6382] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:37 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1488 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:37.532426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55438a7b-f748-4967-9df3-657c5b90c6f0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:37.533705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55438a7b-f748-4967-9df3-657c5b90c6f0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:37.540856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55438a7b-f748-4967-9df3-657c5b90c6f0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:37.541578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55438a7b-f748-4967-9df3-657c5b90c6f0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:37.542964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55438a7b-f748-4967-9df3-657c5b90c6f0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:37.543668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55438a7b-f748-4967-9df3-657c5b90c6f0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:37.932215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:37.932839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:37.958625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:37.959062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:37.960371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:37.960822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:38.209659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:38.236067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:38.240098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:38.242410 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e930ae5-5333-4081-9d7e-5be617ebed58 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.314156 Nov 27 21:12:38.259882 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3249/6383] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:37 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:39.269707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:39.270398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:39.278311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:39.279040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:39.280104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:39.280785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:39.601665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:39.614392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:39.616518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:39.618188 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a9b4d8c-b18d-49aa-a456-1cbb3ad3f32f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.351712 Nov 27 21:12:39.618792 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3250/6384] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:39 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:40.636976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:40.638574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:40.653866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:40.654702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:40.655778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:40.656455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:40.912362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:40.922476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:40.924022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:40.925187 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99f2fce0-4a41-413f-885d-541b7f7e4bfe tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.292062 Nov 27 21:12:40.925748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3251/6385] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:40 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:41.945438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:41.946171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:41.955543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:41.956239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:41.957029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:41.957649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:42.191193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:42.201473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:42.214280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:42.219773 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0e7baace-a20c-40eb-9cd3-4450cd50e51f tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.278152 Nov 27 21:12:42.233657 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3252/6386] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:41 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:43.241165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:43.242943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:43.250994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:43.251703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:43.252832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:43.253481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:43.451852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:43.460378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:43.463133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:43.464356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86510bec-f241-499b-947b-6206aa36ddd7 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.227774 Nov 27 21:12:43.464977 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3253/6387] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:43 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:44.485388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:44.486080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:44.494917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:44.495793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:44.496861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:44.497626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:44.663961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:44.675866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:44.677364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:44.679862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fe98ba4c-1254-4f10-b392-4931617532fd tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.198403 Nov 27 21:12:44.686006 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3254/6388] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:44 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:45.704360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:45.704360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:45.710901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:45.711441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:45.713045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:45.713668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:45.967738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:45.978171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:45.980361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:45.981743 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80529c1a-fd79-400a-9fe4-d38736a1ee21 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.282390 Nov 27 21:12:45.982514 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3255/6389] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:45 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:12:46.214934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55438a7b-f748-4967-9df3-657c5b90c6f0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 200 len: 152 microversion: 2.1 time: 8.686022 Nov 27 21:12:46.215964 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3135/6390] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:12:37 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 152 bytes in 8688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:12:46.225725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:46.226411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:46.234003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:46.234499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:46.235360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:46.236066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:46.517107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:46.525707 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed0f824a-0f0a-4ea5-8b26-2676376cf660 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.304684 Nov 27 21:12:46.526629 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3256/6391] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:46 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:12:46.554261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:46.556400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:46.569294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:46.571676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:46.572900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:46.577617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:46.755352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:46.765009 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2af968e0-c00f-4064-a10e-8a8890d95177 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.215939 Nov 27 21:12:46.765602 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3136/6392] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:46 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:46.823635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2051672174", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "07546b02-5ee2-4818-98ab-2b9b50e1991f"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:46.893859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] validate_networks() for [('07546b02-5ee2-4818-98ab-2b9b50e1991f', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:12:47.001952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:47.002573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:47.010850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:47.011698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:47.013076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:47.013668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:47.166763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:47.189579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:47.191387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:47.194132 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7c148ed-2f58-48c2-82ce-a7cfad183974 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.196518 Nov 27 21:12:47.194865 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3137/6393] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:46 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:47.602591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:12:47.603015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:12:47.603536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:12:47.604123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:12:47.605330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:12:47.615311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:47.616003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:47.616992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:47.618642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:47.638864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:12:47.646822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for user 43d9798c04074bc9ac45eb33bf3adb46 and project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:12:47.661755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:12:47.664444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:12:47.720508 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae2dd5f3-68cd-4816-8082-fcb6ff6c583f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901512 Nov 27 21:12:47.732401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-36fc3bac-8be2-453d-8553-f70b413e3345 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:47.733668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-36fc3bac-8be2-453d-8553-f70b413e3345 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:47.736610 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3257/6394] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:12:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:12:47.837134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-36fc3bac-8be2-453d-8553-f70b413e3345 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:47.851705 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-36fc3bac-8be2-453d-8553-f70b413e3345 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1215 microversion: 2.1 time: 0.123605 Nov 27 21:12:47.857521 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3138/6395] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:47 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:48.213421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:48.214116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:48.221419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:48.222217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:48.223201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:48.224006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:48.454677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:48.475899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:48.483203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:48.486024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-251da95d-bcfc-441e-b2a2-6871b8c133cb tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.277242 Nov 27 21:12:48.489412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3258/6396] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:48 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:48.876120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:48.876834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:48.889304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:48.890099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:48.891371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:48.892034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:49.005472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:49.015839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f31afd31-ba12-4b4f-b5b7-0ad7326f0167 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1275 microversion: 2.1 time: 0.143602 Nov 27 21:12:49.019959 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3139/6397] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:48 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:49.513174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:49.514478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:49.525231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:49.527348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:49.528462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:49.529069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:49.803196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:49.812361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:49.813903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:49.815087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8b83d7d-fc0f-4f89-ae25-5104781494c6 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.310935 Nov 27 21:12:49.815896 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3259/6398] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:49 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:50.038722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:50.040139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:50.061001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:50.062068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:50.072328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:50.072847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:50.351758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:50.360492 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3bb68430-3257-4bd8-85e4-6342458eebd4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.327653 Nov 27 21:12:50.361688 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3140/6399] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:50 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:50.833735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:50.834980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:50.843336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:50.845327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:50.846361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:50.846973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:51.177465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:51.186853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:51.188517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:51.189973 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a88fa0e-cbf9-4b0f-ada6-e3299672a50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.359921 Nov 27 21:12:51.202011 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3260/6400] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:50 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:51.380244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:51.381005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:51.388276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:51.389296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:51.393825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:51.394313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:51.496471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8288d195-cb05-4f18-877b-bcc5b79915c1 req-4c627dd8-ffa3-4474-8995-999c7dcc15da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877ad4f6-8ac7-4a05-ae90-009106aa4152", "tag": "d011b6d6-2042-4252-a9db-f8cef93c7678"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:51.498642 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:12:51.498642 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:12:51.519105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8288d195-cb05-4f18-877b-bcc5b79915c1 req-4c627dd8-ffa3-4474-8995-999c7dcc15da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:51.519593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8288d195-cb05-4f18-877b-bcc5b79915c1 req-4c627dd8-ffa3-4474-8995-999c7dcc15da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:51.548646 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8288d195-cb05-4f18-877b-bcc5b79915c1 req-4c627dd8-ffa3-4474-8995-999c7dcc15da service nova] Creating event network-changed:d011b6d6-2042-4252-a9db-f8cef93c7678 for instance 877ad4f6-8ac7-4a05-ae90-009106aa4152 on nch2-master-1 Nov 27 21:12:51.557032 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8288d195-cb05-4f18-877b-bcc5b79915c1 req-4c627dd8-ffa3-4474-8995-999c7dcc15da service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240323 Nov 27 21:12:51.558639 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3141/6401] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:12:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:12:51.662745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4bd882d3-5f34-48fb-98d7-a3233472e233 req-3daa9f0e-2d68-48a7-9fa3-64412302d567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "name": "network-vif-plugged", "status": "completed", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:51.664380 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:12:51.664380 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:12:51.674842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4bd882d3-5f34-48fb-98d7-a3233472e233 req-3daa9f0e-2d68-48a7-9fa3-64412302d567 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:51.675563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4bd882d3-5f34-48fb-98d7-a3233472e233 req-3daa9f0e-2d68-48a7-9fa3-64412302d567 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:51.697071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4bd882d3-5f34-48fb-98d7-a3233472e233 req-3daa9f0e-2d68-48a7-9fa3-64412302d567 service nova] Creating event network-vif-plugged:9b807251-334b-4d12-8574-592e43e94490 for instance b8df0f80-255e-416b-b79a-4bed627485da on nch1-master-1 Nov 27 21:12:51.702964 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4bd882d3-5f34-48fb-98d7-a3233472e233 req-3daa9f0e-2d68-48a7-9fa3-64412302d567 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045507 Nov 27 21:12:51.704693 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3142/6402] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:12:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:12:51.779660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:51.788012 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0c783cd-65fc-4f2e-af5b-8bbe11c5e64b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.412342 Nov 27 21:12:51.798435 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3261/6403] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:51 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:52.209377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:52.210651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:52.217782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:52.218537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:52.219581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:52.220480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:52.708575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:52.727985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:52.729823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:52.731072 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b77962bf-8fd4-4c59-88c5-7e156db66935 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.526259 Nov 27 21:12:52.735328 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3143/6404] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:52 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:52.807327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:52.808605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:52.816638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:52.817085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:52.817870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:52.818299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:53.036945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:53.046999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43f70e26-de82-43db-8d85-0affd00bb7de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.245625 Nov 27 21:12:53.047826 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3262/6405] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:52 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:12:53.757921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:53.760630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:53.771005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:53.773685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:53.776157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:53.777210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:53.950919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:53.971362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:53.973392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:53.977010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1e04c3de-7798-4af6-95d4-ec6873eb338d tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1730 microversion: 2.20 time: 0.229440 Nov 27 21:12:53.993849 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3144/6406] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:53 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:54.064478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:54.066456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:54.081831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:54.082119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:54.082939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:54.083462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:54.346899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:54.358306 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc6b504e-7c6c-4642-a298-6ed3b4354939 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.297291 Nov 27 21:12:54.358676 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3263/6407] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:54 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:54.998334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:54.998953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:55.006123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:55.006591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:55.007574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:55.008857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:55.157452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:55.166906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:55.168577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:55.170111 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dff786af-6366-4426-9d21-0a00711b6919 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1717 microversion: 2.20 time: 0.175528 Nov 27 21:12:55.170764 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3145/6408] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:12:54 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:12:55.375693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:55.376912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:55.384864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:55.385316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:55.386123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:55.386565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:55.575997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:55.585415 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a3e1f483-4850-40d7-b0ad-87f58f7c7abc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.213447 Nov 27 21:12:55.586308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3264/6409] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:55 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:56.601836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:56.603040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:56.610085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:56.610542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:56.611552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:56.611990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:56.759849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:56.771498 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9da98ec-f39f-4f91-9766-7879b6c9c823 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.167849 Nov 27 21:12:56.771498 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3146/6410] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:56 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:57.783453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:57.784167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:57.791148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:57.791631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:57.792426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:57.792898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:57.959444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:57.967174 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-93b614cd-d077-4d25-9f77-470ed4dbecdc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.187303 Nov 27 21:12:57.967922 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3265/6411] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:57 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:12:58.729240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-63bfc172-29f2-4c60-b302-68a047bb75cc req-e5fba3b2-28d8-4de5-81d2-06badf514269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877ad4f6-8ac7-4a05-ae90-009106aa4152", "name": "network-vif-plugged", "status": "completed", "tag": "d011b6d6-2042-4252-a9db-f8cef93c7678"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:12:58.731425 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:12:58.731425 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:12:58.739363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-63bfc172-29f2-4c60-b302-68a047bb75cc req-e5fba3b2-28d8-4de5-81d2-06badf514269 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:58.740031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-63bfc172-29f2-4c60-b302-68a047bb75cc req-e5fba3b2-28d8-4de5-81d2-06badf514269 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:58.754384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-63bfc172-29f2-4c60-b302-68a047bb75cc req-e5fba3b2-28d8-4de5-81d2-06badf514269 service nova] Creating event network-vif-plugged:d011b6d6-2042-4252-a9db-f8cef93c7678 for instance 877ad4f6-8ac7-4a05-ae90-009106aa4152 on nch2-master-1 Nov 27 21:12:58.759460 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-63bfc172-29f2-4c60-b302-68a047bb75cc req-e5fba3b2-28d8-4de5-81d2-06badf514269 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034306 Nov 27 21:12:58.760430 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3147/6412] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:12:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:12:58.983978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:12:58.984591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:12:58.991219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:58.991710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:58.992775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:12:58.993216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:12:59.152862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:12:59.160352 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf82b87a-7f98-4401-b52d-54e937cf31be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1315 microversion: 2.1 time: 0.180073 Nov 27 21:12:59.160937 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3266/6413] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:12:58 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:00.184909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:00.186357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:00.194109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:00.194674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:00.195612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:00.196152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:00.341957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:00.350659 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c3079eb-d097-4991-9060-b265c3896f7c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1501 microversion: 2.1 time: 0.175417 Nov 27 21:13:00.351385 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3148/6414] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:00 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:00.367760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db997f45-488c-4d00-a80f-bd33cf23180a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:00.368747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db997f45-488c-4d00-a80f-bd33cf23180a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:00.375489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db997f45-488c-4d00-a80f-bd33cf23180a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:00.375949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db997f45-488c-4d00-a80f-bd33cf23180a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:00.376742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db997f45-488c-4d00-a80f-bd33cf23180a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:00.377183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db997f45-488c-4d00-a80f-bd33cf23180a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:00.414614 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db997f45-488c-4d00-a80f-bd33cf23180a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.050560 Nov 27 21:13:00.418202 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3267/6415] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:00 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:01.425740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e882781-8df2-4861-b8f7-e8e3f7ac9c85 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:01.426803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e882781-8df2-4861-b8f7-e8e3f7ac9c85 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:01.433945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e882781-8df2-4861-b8f7-e8e3f7ac9c85 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:01.434478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e882781-8df2-4861-b8f7-e8e3f7ac9c85 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:01.435312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e882781-8df2-4861-b8f7-e8e3f7ac9c85 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:01.435771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e882781-8df2-4861-b8f7-e8e3f7ac9c85 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:01.482866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e882781-8df2-4861-b8f7-e8e3f7ac9c85 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.060706 Nov 27 21:13:01.486135 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3149/6416] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:01 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:02.495940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03717b8c-8918-4071-8a50-8d8555913de5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:02.498140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03717b8c-8918-4071-8a50-8d8555913de5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:02.506185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03717b8c-8918-4071-8a50-8d8555913de5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:02.506637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03717b8c-8918-4071-8a50-8d8555913de5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:02.507949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03717b8c-8918-4071-8a50-8d8555913de5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:02.508572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03717b8c-8918-4071-8a50-8d8555913de5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:02.550678 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03717b8c-8918-4071-8a50-8d8555913de5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.060103 Nov 27 21:13:02.551340 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3268/6417] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:02 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:03.562640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7aab23a1-ed49-4574-a9e8-f3890a094b45 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:03.563751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7aab23a1-ed49-4574-a9e8-f3890a094b45 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:03.571464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7aab23a1-ed49-4574-a9e8-f3890a094b45 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:03.571991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7aab23a1-ed49-4574-a9e8-f3890a094b45 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:03.572862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7aab23a1-ed49-4574-a9e8-f3890a094b45 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:03.573367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7aab23a1-ed49-4574-a9e8-f3890a094b45 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:03.611008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7aab23a1-ed49-4574-a9e8-f3890a094b45 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.052868 Nov 27 21:13:03.611686 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3150/6418] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:03 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:04.624617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bff49a8-e7f9-42f6-a061-2e6837431594 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:04.625981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0bff49a8-e7f9-42f6-a061-2e6837431594 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:04.633893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bff49a8-e7f9-42f6-a061-2e6837431594 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:04.634349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bff49a8-e7f9-42f6-a061-2e6837431594 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:04.635399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bff49a8-e7f9-42f6-a061-2e6837431594 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:04.636009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bff49a8-e7f9-42f6-a061-2e6837431594 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:04.676879 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bff49a8-e7f9-42f6-a061-2e6837431594 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.057897 Nov 27 21:13:04.677668 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3269/6419] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:04 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:05.689196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22e41077-fb1b-47f5-a225-54ca6889ff4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:05.690437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22e41077-fb1b-47f5-a225-54ca6889ff4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:05.698988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e41077-fb1b-47f5-a225-54ca6889ff4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:05.699600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e41077-fb1b-47f5-a225-54ca6889ff4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:05.700521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e41077-fb1b-47f5-a225-54ca6889ff4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:05.701176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22e41077-fb1b-47f5-a225-54ca6889ff4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:05.741609 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22e41077-fb1b-47f5-a225-54ca6889ff4f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.055835 Nov 27 21:13:05.749921 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3151/6420] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:05 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:06.754172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd141111-51a7-4eea-accb-93641013338b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:06.755187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd141111-51a7-4eea-accb-93641013338b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:06.762521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd141111-51a7-4eea-accb-93641013338b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:06.762973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd141111-51a7-4eea-accb-93641013338b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:06.763780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd141111-51a7-4eea-accb-93641013338b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:06.764219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd141111-51a7-4eea-accb-93641013338b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:06.800357 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd141111-51a7-4eea-accb-93641013338b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.050091 Nov 27 21:13:06.802429 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3270/6421] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:06 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:07.811467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2e4208a-c57a-450c-8890-489c8cc0f3af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:07.812413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2e4208a-c57a-450c-8890-489c8cc0f3af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:07.821052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2e4208a-c57a-450c-8890-489c8cc0f3af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:07.821517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2e4208a-c57a-450c-8890-489c8cc0f3af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:07.822323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2e4208a-c57a-450c-8890-489c8cc0f3af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:07.822968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2e4208a-c57a-450c-8890-489c8cc0f3af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:07.864438 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2e4208a-c57a-450c-8890-489c8cc0f3af tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.057019 Nov 27 21:13:07.865083 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3152/6422] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:07 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:08.877334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f9258be-2515-4a78-b3a3-c2936f701d66 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:08.878403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f9258be-2515-4a78-b3a3-c2936f701d66 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:08.886317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f9258be-2515-4a78-b3a3-c2936f701d66 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:08.886767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f9258be-2515-4a78-b3a3-c2936f701d66 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:08.887585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f9258be-2515-4a78-b3a3-c2936f701d66 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:08.888025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f9258be-2515-4a78-b3a3-c2936f701d66 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:08.925102 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f9258be-2515-4a78-b3a3-c2936f701d66 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.052077 Nov 27 21:13:08.925737 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3271/6423] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:08 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:09.936461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c5f03b46-92cd-41f1-8b39-8f711292be77 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:09.937475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c5f03b46-92cd-41f1-8b39-8f711292be77 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:09.944862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5f03b46-92cd-41f1-8b39-8f711292be77 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:09.945816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5f03b46-92cd-41f1-8b39-8f711292be77 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:09.946605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5f03b46-92cd-41f1-8b39-8f711292be77 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:09.947054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5f03b46-92cd-41f1-8b39-8f711292be77 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:09.984509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c5f03b46-92cd-41f1-8b39-8f711292be77 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.052015 Nov 27 21:13:09.985047 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3153/6424] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:09 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:10.996054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4531d5c1-ff45-4cea-a67c-5ea2334a6162 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:10.997295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4531d5c1-ff45-4cea-a67c-5ea2334a6162 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:11.005760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4531d5c1-ff45-4cea-a67c-5ea2334a6162 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:11.006624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4531d5c1-ff45-4cea-a67c-5ea2334a6162 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:11.007471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4531d5c1-ff45-4cea-a67c-5ea2334a6162 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:11.008040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4531d5c1-ff45-4cea-a67c-5ea2334a6162 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:11.055824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4531d5c1-ff45-4cea-a67c-5ea2334a6162 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.064727 Nov 27 21:13:11.056923 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3272/6425] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:10 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:12.071957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-354a2c00-2ef7-476c-9899-787c19b1dff4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:12.071957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-354a2c00-2ef7-476c-9899-787c19b1dff4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:12.075488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-354a2c00-2ef7-476c-9899-787c19b1dff4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:12.075955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-354a2c00-2ef7-476c-9899-787c19b1dff4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:12.077198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-354a2c00-2ef7-476c-9899-787c19b1dff4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:12.077198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-354a2c00-2ef7-476c-9899-787c19b1dff4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:12.115071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-354a2c00-2ef7-476c-9899-787c19b1dff4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 14 microversion: 2.1 time: 0.051745 Nov 27 21:13:12.115842 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3154/6426] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:12 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:13:13.126365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94e7e582-5fab-4f85-a1a1-d136826b6ff1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:13.127396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-94e7e582-5fab-4f85-a1a1-d136826b6ff1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:13.135389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94e7e582-5fab-4f85-a1a1-d136826b6ff1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.135841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94e7e582-5fab-4f85-a1a1-d136826b6ff1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.136612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94e7e582-5fab-4f85-a1a1-d136826b6ff1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.137048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94e7e582-5fab-4f85-a1a1-d136826b6ff1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.183225 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-94e7e582-5fab-4f85-a1a1-d136826b6ff1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action" status: 200 len: 8206 microversion: 2.1 time: 0.060807 Nov 27 21:13:13.184037 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3273/6427] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:13 2021] POST /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152/action => generated 8206 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:13.193364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:13.194004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:13.202175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.202629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.203439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.203884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.339267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:13.346730 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4766a560-60bd-4569-9bcc-0c157b29cab4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.157515 Nov 27 21:13:13.347327 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3155/6428] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:13 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:13.366696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:13.368233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:13.375742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.376262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.377209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.377679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.520598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:13.528521 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-371131b4-e026-4812-b271-7847f48f3608 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.166176 Nov 27 21:13:13.529093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3274/6429] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:13 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:13.544988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:13.545554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:13.553541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.554222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.555608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.556052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.598264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Locking {{(pid=135679) lock /opt/stack/nova/nova/compute/api.py:4624}} Nov 27 21:13:13.648094 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b25c67d-63e5-4854-a454-3380ae75efcb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.106792 Nov 27 21:13:13.651650 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3156/6430] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:13 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:13:13.657546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:13.658318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:13.666197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.666645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.667489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.667925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.805055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:13.812420 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28130e07-c32a-4d2f-b477-6096b0d6a392 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.159463 Nov 27 21:13:13.812986 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3275/6431] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:13 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:13.828509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f868214f-07b3-4f5a-9293-5274a8f14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:13.835044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f868214f-07b3-4f5a-9293-5274a8f14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.835527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f868214f-07b3-4f5a-9293-5274a8f14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.858700 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f868214f-07b3-4f5a-9293-5274a8f14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] HTTP exception thrown: Instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 is locked Nov 27 21:13:13.859317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f868214f-07b3-4f5a-9293-5274a8f14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Returning 409 to user: Instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 is locked {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:13.860149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f868214f-07b3-4f5a-9293-5274a8f14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 409 len: 107 microversion: 2.1 time: 0.035399 Nov 27 21:13:13.860692 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3157/6432] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:13 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 107 bytes in 36 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:13:13.869001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:13.869537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:13.876318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.876777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.877576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.877992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:13.925538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Unlocking {{(pid=135680) unlock /opt/stack/nova/nova/compute/api.py:4653}} Nov 27 21:13:13.975194 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a6dbe6f-cd79-4fd8-a7e6-6b33dfa49457 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.109954 Nov 27 21:13:13.975965 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3276/6433] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:13 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:13:13.984842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab2f8d25-c5e4-4c98-9eeb-58bd4b54d6f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:13.990791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab2f8d25-c5e4-4c98-9eeb-58bd4b54d6f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:13.991280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab2f8d25-c5e4-4c98-9eeb-58bd4b54d6f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:14.013248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab2f8d25-c5e4-4c98-9eeb-58bd4b54d6f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Going to try to stop instance {{(pid=135679) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 21:13:14.054209 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab2f8d25-c5e4-4c98-9eeb-58bd4b54d6f6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.073210 Nov 27 21:13:14.054831 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3158/6434] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:13 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:13:14.063662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:14.064360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:14.070497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:14.071035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:14.071822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:14.072271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:14.204666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:14.212649 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6930c84-1150-449f-b8dd-a676c5284f92 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.153621 Nov 27 21:13:14.213225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3277/6435] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:14 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:15.231950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:15.232564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:15.238674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:15.239136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:15.239943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:15.240390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:15.371997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:15.379779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-958e364f-d85a-425b-9e66-0a63c3869561 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.153270 Nov 27 21:13:15.380359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3159/6436] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:15 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:16.396894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:16.397445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:16.404227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:16.404680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:16.405454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:16.405890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:16.542941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:16.550334 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d3149948-934a-419c-a7bd-7f621fd127d4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.157210 Nov 27 21:13:16.550911 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3278/6437] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:16 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:17.567916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:17.568524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:17.575988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:17.576437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:17.577211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:17.577647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:17.704488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:17.711808 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bee4cb2b-77da-4ebf-9d64-b3f685b49b07 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.147580 Nov 27 21:13:17.712384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3160/6438] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:17 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:17.937422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:17.937940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:17.944562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:17.945007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:17.945828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:17.946260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:17.971505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:13:18.056609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a610b1fb-aecf-409c-9e38-049e3053e2f5 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "DELETE /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 204 len: 0 microversion: 2.1 time: 0.122534 Nov 27 21:13:18.057351 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3279/6439] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:13:17 2021] DELETE /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:13:18.064954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:18.065577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:18.072359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:18.073216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:18.074319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:18.075001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:18.210542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:18.218052 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e19d6b7e-3fc6-4212-a6fa-baf5a9634886 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1728 microversion: 2.1 time: 0.156675 Nov 27 21:13:18.218562 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3161/6440] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:18 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:18.729310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:18.730001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:18.736029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:18.736475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:18.737234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:18.737668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:18.866311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:18.873896 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-54eed91d-b975-4201-bd8e-118da9c9656f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.148643 Nov 27 21:13:18.874464 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3280/6441] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:18 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:19.235888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:19.236616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:19.244483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:19.244939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:19.245727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:19.246169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:19.392400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:19.400807 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab4d966a-d8e8-45d4-b17f-a84ef76a6ec9 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1728 microversion: 2.1 time: 0.168682 Nov 27 21:13:19.401425 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3162/6442] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:19 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:19.891774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:19.893036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:19.901883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:19.902388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:19.903213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:19.903752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:20.152147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:20.159509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-133726f9-0a84-4d7a-a8dc-331827fa275c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.272039 Nov 27 21:13:20.160087 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3281/6443] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:19 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:20.418846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:20.419576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:20.426793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:20.427267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:20.428340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:20.428784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:20.501698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e803241af524277951e54959299c98e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49981e6330d04897a5b23f4ca0b9a934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:20.511855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ce72fdb-c90b-4504-92b8-ca9493d985df tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 200 len: 1662 microversion: 2.1 time: 0.097166 Nov 27 21:13:20.512440 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3163/6444] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:20 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 1662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:20.687383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-210bd5c5-bf2c-4089-9bce-cd25cae49c0e req-76039a60-3301-46d8-a193-67b82ee21be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592ef09c-8fa3-4952-a2c1-8aa3bf414542", "name": "network-vif-deleted", "tag": "016719dd-00d2-4489-a2b6-c05c7ea909ed"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:20.689233 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:13:20.689233 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:13:20.699193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-210bd5c5-bf2c-4089-9bce-cd25cae49c0e req-76039a60-3301-46d8-a193-67b82ee21be3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:20.699906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-210bd5c5-bf2c-4089-9bce-cd25cae49c0e req-76039a60-3301-46d8-a193-67b82ee21be3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:20.714506 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-210bd5c5-bf2c-4089-9bce-cd25cae49c0e req-76039a60-3301-46d8-a193-67b82ee21be3 service nova] Creating event network-vif-deleted:016719dd-00d2-4489-a2b6-c05c7ea909ed for instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 on nch1-master-1 Nov 27 21:13:20.720195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-210bd5c5-bf2c-4089-9bce-cd25cae49c0e req-76039a60-3301-46d8-a193-67b82ee21be3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036747 Nov 27 21:13:20.720802 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3282/6445] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:13:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:13:21.178640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:21.179391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:21.186763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:21.187358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:21.188435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:21.188987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:21.328407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:21.336122 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-563eb99a-902e-4373-9a4c-587104513f3c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.161950 Nov 27 21:13:21.336637 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3164/6446] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:21 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:21.531029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:21.531787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:21.539067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:21.539634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:21.540508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:21.541019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:21.554903 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] HTTP exception thrown: Instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 could not be found. Nov 27 21:13:21.555530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Returning 404 to user: Instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:21.556905 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f77b35b6-127f-4b24-9722-2f264f7634cb tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 404 len: 111 microversion: 2.1 time: 0.030860 Nov 27 21:13:21.560697 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3283/6447] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:21 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:13:22.071187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:22.071752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:22.078056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:22.078502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:22.079361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:22.079804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:22.093424 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] HTTP exception thrown: Instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 could not be found. Nov 27 21:13:22.094006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Returning 404 to user: Instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:22.094814 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-162aa79a-3b82-40f9-a8aa-9bcc60baf5c0 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "DELETE /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 404 len: 111 microversion: 2.1 time: 0.027521 Nov 27 21:13:22.095353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3165/6448] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:13:22 2021] DELETE /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:13:22.103936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:22.104546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] [instance: 592ef09c-8fa3-4952-a2c1-8aa3bf414542] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:22.110313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:22.110761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:22.111554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:22.111989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:22.125231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] HTTP exception thrown: Instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 could not be found. Nov 27 21:13:22.125802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Returning 404 to user: Instance 592ef09c-8fa3-4952-a2c1-8aa3bf414542 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:22.126604 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f86f725c-869a-421c-aefc-af44b31d7d85 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542" status: 404 len: 111 microversion: 2.1 time: 0.027173 Nov 27 21:13:22.127121 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3284/6449] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:22 2021] GET /compute/v2.1/servers/592ef09c-8fa3-4952-a2c1-8aa3bf414542 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:13:22.284690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-01f2a14c-eff5-43c3-bb61-654302909752 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] Calling method '.version_select at 0x7f15c7c7ed30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:22.305027 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-01f2a14c-eff5-43c3-bb61-654302909752 tempest-TestServerBasicOps-2031923136 tempest-TestServerBasicOps-2031923136-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-467753751" status: 202 len: 0 microversion: 2.1 time: 0.024174 Nov 27 21:13:22.305606 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3166/6450] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:13:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-467753751 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:13:22.353187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:22.353795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:22.359861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:22.360315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:22.361093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:22.361532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:22.507875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:22.515817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-461ef29a-5117-4621-84be-bdbcff5ad984 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.166305 Nov 27 21:13:22.516377 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3285/6451] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:22 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:23.532697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:23.533324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:23.541731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:23.542189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:23.543010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:23.543483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:23.741586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:23.749696 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3bf02901-9231-4352-9e8c-b020a2c0e504 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.220715 Nov 27 21:13:23.750262 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3167/6452] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:23 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:24.767170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:24.768716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:24.776487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:24.777112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:24.778255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:24.778894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:24.979910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:24.991405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e87a1c6e-6d9c-455d-8292-3ab68de7925e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1656 microversion: 2.1 time: 0.227762 Nov 27 21:13:25.003559 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3286/6453] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:24 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1656 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:25.010687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e80cffa3-78b5-413b-bcb8-52cd37c980e4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:25.018129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e80cffa3-78b5-413b-bcb8-52cd37c980e4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:25.018710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e80cffa3-78b5-413b-bcb8-52cd37c980e4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:25.042989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e80cffa3-78b5-413b-bcb8-52cd37c980e4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Going to try to start instance {{(pid=135679) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 27 21:13:25.086926 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e80cffa3-78b5-413b-bcb8-52cd37c980e4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.081138 Nov 27 21:13:25.088188 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3168/6454] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:25 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:13:25.097039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:25.097655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:25.105540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:25.111934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:25.113007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:25.113601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:25.462004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:25.470982 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4e91d94e-7f8d-4237-a15a-2d73f3a9b2d5 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1665 microversion: 2.1 time: 0.377554 Nov 27 21:13:25.481718 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3287/6455] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:25 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1665 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:13:26.488941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:26.490319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:26.499403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:26.507393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:26.510298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:26.511387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:26.675828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:26.686769 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28fbbc42-f9b3-44aa-9575-eccd94b0ca72 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1665 microversion: 2.1 time: 0.201391 Nov 27 21:13:26.687398 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3169/6456] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:26 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1665 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:27.705416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:27.706160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:27.713249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:27.713940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:27.714770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:27.715213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:27.878263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77892039-8892-45a7-936f-3098ec143a34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:27.879958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77892039-8892-45a7-936f-3098ec143a34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:27.887873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77892039-8892-45a7-936f-3098ec143a34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:27.889175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77892039-8892-45a7-936f-3098ec143a34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:27.890182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77892039-8892-45a7-936f-3098ec143a34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:27.890790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77892039-8892-45a7-936f-3098ec143a34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:27.922941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:27.929333 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77892039-8892-45a7-936f-3098ec143a34 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054926 Nov 27 21:13:27.930064 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3170/6457] 10.222.0.21 () {60 vars in 1342 bytes} [Sat Nov 27 21:13:27 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:13:27.934342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a05ba467-745f-455a-9e74-4fc953a39c01 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.232810 Nov 27 21:13:27.935423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3288/6458] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:27 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:27.952680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:27.953345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:27.959724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:27.960173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:27.961146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:27.961788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.002259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:28.002767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:28.019661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.020587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.021592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.022191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.056813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:13:28.151584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6324a2f1-bfa0-4aec-85db-e70087ab701e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 204 len: 0 microversion: 2.20 time: 0.152555 Nov 27 21:13:28.152987 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3289/6459] 10.222.0.21 () {60 vars in 1279 bytes} [Sat Nov 27 21:13:27 2021] DELETE /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:13:28.162900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:28.163794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:28.170511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.170978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.171808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.172272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.282041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:28.290596 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-704e8d46-b397-42c0-bd59-934d8db52e7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.343346 Nov 27 21:13:28.291183 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3171/6460] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:27 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:28.308520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:28.309359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:28.316234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.316987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.317989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.318648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.349684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:28.358746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:28.360954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:28.362086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-58cfd2ed-e5c4-424a-968a-c1bc859f77f9 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.203991 Nov 27 21:13:28.362950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3290/6461] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:13:28 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:13:28.373668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Unlocking {{(pid=135679) unlock /opt/stack/nova/nova/compute/api.py:4653}} Nov 27 21:13:28.438622 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15749040-15b7-412d-8059-ebf39aadeb64 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.135033 Nov 27 21:13:28.439695 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3172/6462] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:28 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:13:28.451900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:28.452582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:28.459085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.459575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.460351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.460783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.612253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:28.620465 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46bd8f64-055e-4017-a84d-b762d3f69a86 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.172906 Nov 27 21:13:28.621043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3291/6463] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:28 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:28.646428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf346c41-886e-4c53-baa8-dabf63e168eb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:28.646428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf346c41-886e-4c53-baa8-dabf63e168eb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:28.647560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf346c41-886e-4c53-baa8-dabf63e168eb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.648015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf346c41-886e-4c53-baa8-dabf63e168eb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.648802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf346c41-886e-4c53-baa8-dabf63e168eb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.649244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf346c41-886e-4c53-baa8-dabf63e168eb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.734695 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf346c41-886e-4c53-baa8-dabf63e168eb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.097808 Nov 27 21:13:28.738324 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3173/6464] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:28 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:13:28.743694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:28.744303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:28.751432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.751858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.752963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:28.753260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:28.905619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:28.916238 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddfb8767-38e9-4798-a208-5df3172c4057 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1674 microversion: 2.1 time: 0.176570 Nov 27 21:13:28.917034 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3292/6465] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:28 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:13:29.382754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:29.385033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:29.392248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:29.392933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:29.393728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:29.394162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:29.595552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:29.603594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:29.605214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:29.606381 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de88d2ea-80f5-402e-8028-c9c5fa8b4a51 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.228292 Nov 27 21:13:29.606984 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3174/6466] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:13:29 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:13:29.934585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:29.936232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:29.946523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:29.947337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:29.948834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:29.949409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:30.417609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:30.424925 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e545ac7d-2f49-4ca5-b0ed-fa818fbcf848 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1654 microversion: 2.1 time: 0.494840 Nov 27 21:13:30.425575 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3293/6467] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:29 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1654 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:30.442580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c134d25-65e4-4774-934e-18241def2c8c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:30.443665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c134d25-65e4-4774-934e-18241def2c8c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:30.451659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c134d25-65e4-4774-934e-18241def2c8c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:30.451887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c134d25-65e4-4774-934e-18241def2c8c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:30.452762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c134d25-65e4-4774-934e-18241def2c8c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:30.453280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c134d25-65e4-4774-934e-18241def2c8c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:30.523485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c134d25-65e4-4774-934e-18241def2c8c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.084798 Nov 27 21:13:30.525334 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3175/6468] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:13:30 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:13:30.534472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:30.535280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:30.542551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:30.543071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:30.544117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:30.544726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:30.626483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:30.627235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:30.634855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:30.635537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:30.636798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:30.637423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:30.904588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:30.927794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:30.939118 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0e1a9f03-3ac2-4917-a41d-865569d64300 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1661 microversion: 2.1 time: 0.410044 Nov 27 21:13:30.941200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:30.941476 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3294/6469] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:30 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1661 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:13:30.943230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ee436ffe774a1eb71cdb910112c7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b756ba4e580446980b973ad0b42b9fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:30.944736 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2339291a-8388-4e1b-916b-0ffd23854a26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 200 len: 1723 microversion: 2.20 time: 0.323115 Nov 27 21:13:30.945899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3176/6470] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:13:30 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:13:31.176905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1c9c4785-b79e-4e02-bbbb-e25d52d79068 req-9afd807c-564a-4082-bb71-ab85db37da06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8df0f80-255e-416b-b79a-4bed627485da", "name": "network-vif-deleted", "tag": "9b807251-334b-4d12-8574-592e43e94490"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:31.178916 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:13:31.178916 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:13:31.189323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1c9c4785-b79e-4e02-bbbb-e25d52d79068 req-9afd807c-564a-4082-bb71-ab85db37da06 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:31.190251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1c9c4785-b79e-4e02-bbbb-e25d52d79068 req-9afd807c-564a-4082-bb71-ab85db37da06 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:31.208079 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1c9c4785-b79e-4e02-bbbb-e25d52d79068 req-9afd807c-564a-4082-bb71-ab85db37da06 service nova] Creating event network-vif-deleted:9b807251-334b-4d12-8574-592e43e94490 for instance b8df0f80-255e-416b-b79a-4bed627485da on nch1-master-1 Nov 27 21:13:31.219817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1c9c4785-b79e-4e02-bbbb-e25d52d79068 req-9afd807c-564a-4082-bb71-ab85db37da06 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046186 Nov 27 21:13:31.223150 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3295/6471] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:13:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:13:31.958047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:31.958631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:31.965765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:31.966231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:31.967137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:31.967505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:31.968680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:31.970098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:31.977716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:31.978438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:31.979876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:31.981451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:32.003786 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] HTTP exception thrown: Instance b8df0f80-255e-416b-b79a-4bed627485da could not be found. Nov 27 21:13:32.004769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Returning 404 to user: Instance b8df0f80-255e-416b-b79a-4bed627485da could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:32.006419 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60e27583-87bd-41d0-9a30-13110a7f3c26 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 404 len: 111 microversion: 2.20 time: 0.046094 Nov 27 21:13:32.007268 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3296/6472] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:13:31 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:13:32.020934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6666ce67-d97a-491c-8453-5ef07c75b50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '.version_select at 0x7f15c7426160>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:32.053344 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6666ce67-d97a-491c-8453-5ef07c75b50e tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578393137" status: 204 len: 0 microversion: 2.20 time: 0.037825 Nov 27 21:13:32.054251 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3297/6473] 10.222.0.21 () {60 vars in 1261 bytes} [Sat Nov 27 21:13:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578393137 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 21:13:32.127811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:32.137559 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b194f0fb-178e-434d-a5cb-1e5664ac0414 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.183520 Nov 27 21:13:32.138818 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3177/6474] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:31 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:32.155284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:32.155901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:32.163042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:32.163680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:32.167485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:32.172060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:32.402851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:32.413141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-822401bd-7d25-4cce-a1e2-feef660ff073 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.261608 Nov 27 21:13:32.414576 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3298/6475] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:32 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:32.432223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:32.432784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:32.442580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:32.443435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:32.444455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:32.445221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:32.700960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:32.717783 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e2d6c2de-9d4e-47d9-858c-9cf8f8568ef3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.288808 Nov 27 21:13:32.730816 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3178/6476] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:32 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:32.736225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:32.736851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:32.747047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:32.747533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:32.748745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:32.749268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:32.972783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:32.984053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02d3813c-b852-48f7-8c62-1cc02d9e2a37 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.251937 Nov 27 21:13:32.985197 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3299/6477] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:32 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:34.549048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:34.549713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:34.557350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:34.557953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:34.559337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:34.559704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:34.578644 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] HTTP exception thrown: Instance b8df0f80-255e-416b-b79a-4bed627485da could not be found. Nov 27 21:13:34.579672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Returning 404 to user: Instance b8df0f80-255e-416b-b79a-4bed627485da could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:34.580744 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a1baad1b-14ad-4acf-b339-3b17640b5776 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 404 len: 111 microversion: 2.1 time: 0.035460 Nov 27 21:13:34.581896 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3179/6478] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:13:34 2021] DELETE /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:13:34.589512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:34.590827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: b8df0f80-255e-416b-b79a-4bed627485da] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:34.598696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:34.599311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:34.600180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:34.600698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:34.616580 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] HTTP exception thrown: Instance b8df0f80-255e-416b-b79a-4bed627485da could not be found. Nov 27 21:13:34.617439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Returning 404 to user: Instance b8df0f80-255e-416b-b79a-4bed627485da could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:34.618939 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2c5d093-ffb7-4193-af35-59224307b755 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da" status: 404 len: 111 microversion: 2.1 time: 0.033120 Nov 27 21:13:34.619876 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3300/6479] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:34 2021] GET /compute/v2.1/servers/b8df0f80-255e-416b-b79a-4bed627485da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:13:35.795086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:35.795773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:35.812056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:35.812777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:35.813591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:35.814203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:35.835852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] HTTP exception thrown: Instance 0b1a80e3-263a-4ff5-9417-defdda26f981 could not be found. Nov 27 21:13:35.838030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Returning 404 to user: Instance 0b1a80e3-263a-4ff5-9417-defdda26f981 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:35.840034 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-638dc934-0b4d-4ada-b1e8-92ce1a17dc71 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 404 len: 111 microversion: 2.1 time: 0.048473 Nov 27 21:13:35.840788 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3180/6480] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:13:35 2021] DELETE /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:13:35.848842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:35.849772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] [instance: 0b1a80e3-263a-4ff5-9417-defdda26f981] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:35.856702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:35.857374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:35.858360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:35.860214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:35.876746 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] HTTP exception thrown: Instance 0b1a80e3-263a-4ff5-9417-defdda26f981 could not be found. Nov 27 21:13:35.877346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] Returning 404 to user: Instance 0b1a80e3-263a-4ff5-9417-defdda26f981 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:13:35.878307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-024f9f14-8c0a-4a3f-b341-b618d96cf0b3 tempest-AttachVolumeShelveTestJSON-1238752384 tempest-AttachVolumeShelveTestJSON-1238752384-project] 10.222.0.21 "GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981" status: 404 len: 111 microversion: 2.1 time: 0.033231 Nov 27 21:13:35.878960 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3301/6481] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:35 2021] GET /compute/v2.1/servers/0b1a80e3-263a-4ff5-9417-defdda26f981 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:13:48.885270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f33f9980-fe03-46b2-a104-58d54e94e498 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:48.886167 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:13:48.886167 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:13:48.887849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f33f9980-fe03-46b2-a104-58d54e94e498 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:48.888313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f33f9980-fe03-46b2-a104-58d54e94e498 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:48.889361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f33f9980-fe03-46b2-a104-58d54e94e498 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:48.889820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f33f9980-fe03-46b2-a104-58d54e94e498 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:49.000186 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f33f9980-fe03-46b2-a104-58d54e94e498 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.478033 Nov 27 21:13:49.005988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3181/6482] 10.222.0.21 () {58 vars in 1184 bytes} [Sat Nov 27 21:13:48 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:13:49.344974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-664710787", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "2e4ea973-7dde-45f6-abff-33395836d24d"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:49.517200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] validate_networks() for [('2e4ea973-7dde-45f6-abff-33395836d24d', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:13:50.676425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:13:50.677059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:13:50.677296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:13:50.677693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:13:50.678096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:13:50.702837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:50.703641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:50.704468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:50.705431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:50.754029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Getting quotas for project 0aefc004229844399f063a911bcc05b7. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:13:50.760199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Getting quotas for user 68af5d383d4149a89a0f87bdb735ccea and project 0aefc004229844399f063a911bcc05b7. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:13:50.788121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:13:50.791596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:13:50.910112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-338d0d2c-414f-4864-8650-2294172f5d73 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567977 Nov 27 21:13:50.914048 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3302/6483] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:13:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:13:50.925652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72575e4e-a366-41b9-b6b6-be44c05c9bcb tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:50.927205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-72575e4e-a366-41b9-b6b6-be44c05c9bcb tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:51.083572 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72575e4e-a366-41b9-b6b6-be44c05c9bcb tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1328 microversion: 2.1 time: 0.162867 Nov 27 21:13:51.085184 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3182/6484] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:50 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:13:51.721146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47da2827-2c90-4ce7-9d55-ae808cc41dec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'create', calling method: .version_select at 0x7f15c6da8430>, body: {"keypair": {"name": "tempest-keypair-197777019"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:51.740488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-47da2827-2c90-4ce7-9d55-ae808cc41dec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:13:51.751450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-47da2827-2c90-4ce7-9d55-ae808cc41dec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for user b771da0354414b239da0cad505f8ffe6 and project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:13:51.964235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-47da2827-2c90-4ce7-9d55-ae808cc41dec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:13:51.970743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-47da2827-2c90-4ce7-9d55-ae808cc41dec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for user b771da0354414b239da0cad505f8ffe6 and project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:13:52.003318 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47da2827-2c90-4ce7-9d55-ae808cc41dec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.389746 Nov 27 21:13:52.011454 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3303/6485] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:13:51 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:52.102318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24f92253-8ad0-4ad9-8412-5596291eff57 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:52.104698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24f92253-8ad0-4ad9-8412-5596291eff57 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:52.116195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24f92253-8ad0-4ad9-8412-5596291eff57 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:52.131422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24f92253-8ad0-4ad9-8412-5596291eff57 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:52.137370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24f92253-8ad0-4ad9-8412-5596291eff57 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:52.139899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24f92253-8ad0-4ad9-8412-5596291eff57 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:52.321517 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24f92253-8ad0-4ad9-8412-5596291eff57 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1337 microversion: 2.1 time: 0.220311 Nov 27 21:13:52.329721 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3183/6486] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:52 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1337 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:53.347390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1fa0e92-8cf7-47d9-8afb-795d3450e618 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:53.348119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1fa0e92-8cf7-47d9-8afb-795d3450e618 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:53.366147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fa0e92-8cf7-47d9-8afb-795d3450e618 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:53.366666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fa0e92-8cf7-47d9-8afb-795d3450e618 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:53.368336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fa0e92-8cf7-47d9-8afb-795d3450e618 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:53.368784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1fa0e92-8cf7-47d9-8afb-795d3450e618 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:53.488205 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1fa0e92-8cf7-47d9-8afb-795d3450e618 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1421 microversion: 2.1 time: 0.146584 Nov 27 21:13:53.493081 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3304/6487] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:53 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1421 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:54.513615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a038925c-97c3-48a7-b0d7-efd8f161a3ee tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:54.518911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-975450294", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e43d78-90bf-4d39-8500-de9af3c92506"}], "security_groups": [{"name": "tempest-securitygroup--1567873917"}], "key_name": "tempest-keypair-197777019", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:54.519932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a038925c-97c3-48a7-b0d7-efd8f161a3ee tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:54.547558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a038925c-97c3-48a7-b0d7-efd8f161a3ee tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:54.549930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a038925c-97c3-48a7-b0d7-efd8f161a3ee tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:54.558516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a038925c-97c3-48a7-b0d7-efd8f161a3ee tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:54.559179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a038925c-97c3-48a7-b0d7-efd8f161a3ee tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:54.834115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] validate_networks() for [('34e43d78-90bf-4d39-8500-de9af3c92506', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:13:55.377050 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a038925c-97c3-48a7-b0d7-efd8f161a3ee tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.869111 Nov 27 21:13:55.378445 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3184/6488] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:54 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:55.387509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-dd19d145-0cd6-4523-95fb-d6a4318dfdb8 req-cbe835f4-dd5e-4c94-9007-cfff40834382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220f6fbb-3bb8-47d4-b236-d9a44eae1763", "tag": "f6ebcc5d-3925-48c7-b526-8c48a5a5db44"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:55.389507 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:13:55.389507 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:13:55.399644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dd19d145-0cd6-4523-95fb-d6a4318dfdb8 req-cbe835f4-dd5e-4c94-9007-cfff40834382 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:55.400296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dd19d145-0cd6-4523-95fb-d6a4318dfdb8 req-cbe835f4-dd5e-4c94-9007-cfff40834382 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:55.415168 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-dd19d145-0cd6-4523-95fb-d6a4318dfdb8 req-cbe835f4-dd5e-4c94-9007-cfff40834382 service nova] Creating event network-changed:f6ebcc5d-3925-48c7-b526-8c48a5a5db44 for instance 220f6fbb-3bb8-47d4-b236-d9a44eae1763 on nch2-master-1 Nov 27 21:13:55.423499 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-dd19d145-0cd6-4523-95fb-d6a4318dfdb8 req-cbe835f4-dd5e-4c94-9007-cfff40834382 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040863 Nov 27 21:13:55.426698 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3185/6489] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:13:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:13:55.617579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:13:55.619399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:13:55.619983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:13:55.620510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:13:55.621016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:13:55.630333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:55.631126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:55.632187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:55.633393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:55.652935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for project 219be90852c0481aaad9862d1a485102. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:13:55.658880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for user b771da0354414b239da0cad505f8ffe6 and project 219be90852c0481aaad9862d1a485102. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:13:55.673349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:13:55.675644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:13:55.725958 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0547f2e-189c-41d1-a665-48df09ed4cec tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.214178 Nov 27 21:13:55.726664 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3305/6490] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:13:54 2021] POST /compute/v2.1/servers => generated 402 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:13:55.737010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6891acc4-61cf-433d-9429-1e2afeb47a97 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:55.738354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6891acc4-61cf-433d-9429-1e2afeb47a97 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:55.841149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6891acc4-61cf-433d-9429-1e2afeb47a97 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:55.849376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6891acc4-61cf-433d-9429-1e2afeb47a97 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1236 microversion: 2.1 time: 0.116361 Nov 27 21:13:55.850450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3186/6491] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:55 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1236 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:56.394668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-588b7a32-c672-493b-9277-a37a064e4545 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:56.395323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-588b7a32-c672-493b-9277-a37a064e4545 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:56.401339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-588b7a32-c672-493b-9277-a37a064e4545 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:56.401786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-588b7a32-c672-493b-9277-a37a064e4545 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:56.402675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-588b7a32-c672-493b-9277-a37a064e4545 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:56.403110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-588b7a32-c672-493b-9277-a37a064e4545 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:56.544960 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-588b7a32-c672-493b-9277-a37a064e4545 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.154120 Nov 27 21:13:56.545525 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3306/6492] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:56 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:56.868444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:56.869072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:56.878603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:56.879079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:56.879919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:56.880521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:56.944530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:56.952999 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a7063b83-c632-4bcf-9e2d-3a046135ff70 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1294 microversion: 2.1 time: 0.089262 Nov 27 21:13:56.953801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3187/6493] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:56 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:13:57.562030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ed3f653-3e59-47e6-b30c-73aec782a0e7 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:57.563276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ed3f653-3e59-47e6-b30c-73aec782a0e7 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:57.574796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ed3f653-3e59-47e6-b30c-73aec782a0e7 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:57.575274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ed3f653-3e59-47e6-b30c-73aec782a0e7 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:57.582412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ed3f653-3e59-47e6-b30c-73aec782a0e7 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:57.583103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ed3f653-3e59-47e6-b30c-73aec782a0e7 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:57.855596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ed3f653-3e59-47e6-b30c-73aec782a0e7 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.297326 Nov 27 21:13:57.856354 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3307/6494] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:57 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:57.971338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:57.971952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:57.982464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:57.983032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:57.984377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:57.985599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:58.140067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:58.147943 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f0ba788-7629-4e2d-825f-1305478e573a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.180200 Nov 27 21:13:58.149028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3188/6495] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:57 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:58.235225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ebe602a1-ed27-4104-afd0-8bef4efdf295 req-6c18f2a1-6321-46f2-a0a6-f1f27e3c2527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16595aec-62b0-4a81-8923-9071b7521bfe", "tag": "a9f6773f-b4a1-41a8-9921-b5b340ba2efd"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:13:58.244405 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:13:58.244405 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:13:58.255783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ebe602a1-ed27-4104-afd0-8bef4efdf295 req-6c18f2a1-6321-46f2-a0a6-f1f27e3c2527 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:58.256309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ebe602a1-ed27-4104-afd0-8bef4efdf295 req-6c18f2a1-6321-46f2-a0a6-f1f27e3c2527 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:58.272726 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ebe602a1-ed27-4104-afd0-8bef4efdf295 req-6c18f2a1-6321-46f2-a0a6-f1f27e3c2527 service nova] Creating event network-changed:a9f6773f-b4a1-41a8-9921-b5b340ba2efd for instance 16595aec-62b0-4a81-8923-9071b7521bfe on nch1-master-1 Nov 27 21:13:58.280147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ebe602a1-ed27-4104-afd0-8bef4efdf295 req-6c18f2a1-6321-46f2-a0a6-f1f27e3c2527 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054788 Nov 27 21:13:58.283689 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3308/6496] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:13:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:13:58.873838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a09076e-f81d-48c9-b038-871dceda054e tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:58.874486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a09076e-f81d-48c9-b038-871dceda054e tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:58.881279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a09076e-f81d-48c9-b038-871dceda054e tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:58.881738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a09076e-f81d-48c9-b038-871dceda054e tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:58.883081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a09076e-f81d-48c9-b038-871dceda054e tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:58.883555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a09076e-f81d-48c9-b038-871dceda054e tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:59.031136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a09076e-f81d-48c9-b038-871dceda054e tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.160700 Nov 27 21:13:59.032325 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3189/6497] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:58 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:13:59.166277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:13:59.167660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:13:59.174895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:59.175389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:59.176198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:13:59.176627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:13:59.427097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:13:59.437887 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-36378db9-4a9a-473e-a543-3ad58254acdf tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.275980 Nov 27 21:13:59.449758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3309/6498] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:13:59 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:00.048433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9683a21c-5408-4a93-9b04-38130194fe64 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:00.049049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9683a21c-5408-4a93-9b04-38130194fe64 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:00.056834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9683a21c-5408-4a93-9b04-38130194fe64 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:00.057296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9683a21c-5408-4a93-9b04-38130194fe64 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:00.058097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9683a21c-5408-4a93-9b04-38130194fe64 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:00.058546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9683a21c-5408-4a93-9b04-38130194fe64 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:00.187741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9683a21c-5408-4a93-9b04-38130194fe64 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.142798 Nov 27 21:14:00.188349 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3190/6499] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:00 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:00.455558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:00.456230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:00.463479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:00.463934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:00.464960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:00.465403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:00.606845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:00.614708 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af1ae634-d450-48d4-ae60-67a1f8b22399 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.162775 Nov 27 21:14:00.615333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3310/6500] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:00 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:01.204330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d123f74f-d7b6-46df-86ab-19263633a141 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:01.204954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d123f74f-d7b6-46df-86ab-19263633a141 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:01.212293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d123f74f-d7b6-46df-86ab-19263633a141 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:01.212753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d123f74f-d7b6-46df-86ab-19263633a141 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:01.213545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d123f74f-d7b6-46df-86ab-19263633a141 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:01.213998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d123f74f-d7b6-46df-86ab-19263633a141 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:01.357698 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d123f74f-d7b6-46df-86ab-19263633a141 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.156971 Nov 27 21:14:01.358624 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3191/6501] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:01 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:01.632957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:01.633603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:01.640518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:01.640971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:01.641753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:01.642189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:01.779463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:01.787219 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-411db0f3-a1b1-4312-aa06-d02f5fde054a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.158433 Nov 27 21:14:01.787842 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3311/6502] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:01 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:02.375793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aeb223d3-f64f-4064-8a8d-15c8e68efba5 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:02.376595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aeb223d3-f64f-4064-8a8d-15c8e68efba5 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:02.384362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb223d3-f64f-4064-8a8d-15c8e68efba5 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:02.384979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb223d3-f64f-4064-8a8d-15c8e68efba5 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:02.385934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb223d3-f64f-4064-8a8d-15c8e68efba5 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:02.386585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aeb223d3-f64f-4064-8a8d-15c8e68efba5 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:02.525749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aeb223d3-f64f-4064-8a8d-15c8e68efba5 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.153799 Nov 27 21:14:02.526327 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3192/6503] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:02 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:02.804291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:02.804891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:02.811741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:02.812188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:02.812962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:02.813397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:02.945918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:02.954255 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f6287bf-026f-44a0-ad69-63824a120834 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.153543 Nov 27 21:14:02.954759 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3312/6504] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:02 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:03.082621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f4f28cb0-c5ee-40e3-8407-2fdd1e558d16 req-5d8df3c5-2fcc-4a16-901d-7ea3680a50c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220f6fbb-3bb8-47d4-b236-d9a44eae1763", "name": "network-vif-plugged", "status": "completed", "tag": "f6ebcc5d-3925-48c7-b526-8c48a5a5db44"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:03.084238 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:03.084238 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:03.092643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f4f28cb0-c5ee-40e3-8407-2fdd1e558d16 req-5d8df3c5-2fcc-4a16-901d-7ea3680a50c5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.093156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f4f28cb0-c5ee-40e3-8407-2fdd1e558d16 req-5d8df3c5-2fcc-4a16-901d-7ea3680a50c5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.106733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f4f28cb0-c5ee-40e3-8407-2fdd1e558d16 req-5d8df3c5-2fcc-4a16-901d-7ea3680a50c5 service nova] Creating event network-vif-plugged:f6ebcc5d-3925-48c7-b526-8c48a5a5db44 for instance 220f6fbb-3bb8-47d4-b236-d9a44eae1763 on nch2-master-1 Nov 27 21:14:03.111654 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f4f28cb0-c5ee-40e3-8407-2fdd1e558d16 req-5d8df3c5-2fcc-4a16-901d-7ea3680a50c5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032630 Nov 27 21:14:03.112245 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3193/6505] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:03.534338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17cc647f-7e68-4e07-b612-40b2e299cb91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:03.535317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17cc647f-7e68-4e07-b612-40b2e299cb91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:03.541746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17cc647f-7e68-4e07-b612-40b2e299cb91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.542139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17cc647f-7e68-4e07-b612-40b2e299cb91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.542842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e4cb648f-755b-410c-98e7-01ea2ea1ef18 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:03.543352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17cc647f-7e68-4e07-b612-40b2e299cb91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.543469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17cc647f-7e68-4e07-b612-40b2e299cb91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.543582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e4cb648f-755b-410c-98e7-01ea2ea1ef18 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:03.549725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4cb648f-755b-410c-98e7-01ea2ea1ef18 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.550186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4cb648f-755b-410c-98e7-01ea2ea1ef18 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.550977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4cb648f-755b-410c-98e7-01ea2ea1ef18 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.551534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4cb648f-755b-410c-98e7-01ea2ea1ef18 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.619686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17cc647f-7e68-4e07-b612-40b2e299cb91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.088816 Nov 27 21:14:03.622672 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3313/6506] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:03 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:14:03.636791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:03.638741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:03.646852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.647527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.648877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.649425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.731078 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e4cb648f-755b-410c-98e7-01ea2ea1ef18 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1463 microversion: 2.1 time: 0.192976 Nov 27 21:14:03.733794 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3194/6507] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:03 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:03.971927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:03.972642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:03.979299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.979764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.980550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:03.980987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:03.985636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:03.994999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e74236a4-6aea-499a-99f8-bd1cf658a470 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1671 microversion: 2.1 time: 0.370190 Nov 27 21:14:04.002241 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3314/6508] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:03 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1671 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:04.113129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:04.120954 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9725b52b-91fd-4fa3-9e59-99cfa638abb6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.152766 Nov 27 21:14:04.121521 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3195/6509] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:03 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:14:04.750999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-817924e7-00bc-4a67-adb0-6d9a64c88609 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:04.751621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-817924e7-00bc-4a67-adb0-6d9a64c88609 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:04.757980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817924e7-00bc-4a67-adb0-6d9a64c88609 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:04.758429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817924e7-00bc-4a67-adb0-6d9a64c88609 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:04.759974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817924e7-00bc-4a67-adb0-6d9a64c88609 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:04.760419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-817924e7-00bc-4a67-adb0-6d9a64c88609 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:04.894860 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-817924e7-00bc-4a67-adb0-6d9a64c88609 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1648 microversion: 2.1 time: 0.147663 Nov 27 21:14:04.895452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3315/6510] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:04 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1648 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:04.911529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8008802-67ff-4ebb-80bd-365f52647e40 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:04.912362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8008802-67ff-4ebb-80bd-365f52647e40 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:04.919180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8008802-67ff-4ebb-80bd-365f52647e40 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:04.919687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8008802-67ff-4ebb-80bd-365f52647e40 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:04.920481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8008802-67ff-4ebb-80bd-365f52647e40 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:04.920968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8008802-67ff-4ebb-80bd-365f52647e40 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.013806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:05.014558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:05.020418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.020907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.021694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.022131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.046690 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8008802-67ff-4ebb-80bd-365f52647e40 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1648 microversion: 2.1 time: 0.139050 Nov 27 21:14:05.047322 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3196/6511] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:04 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1648 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:14:05.063043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c40391b-ebfe-4e04-af99-4c5e36b15e47 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:05.063719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c40391b-ebfe-4e04-af99-4c5e36b15e47 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:05.070175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c40391b-ebfe-4e04-af99-4c5e36b15e47 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.070637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c40391b-ebfe-4e04-af99-4c5e36b15e47 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.071489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c40391b-ebfe-4e04-af99-4c5e36b15e47 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.071978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c40391b-ebfe-4e04-af99-4c5e36b15e47 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.211297 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c40391b-ebfe-4e04-af99-4c5e36b15e47 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1648 microversion: 2.1 time: 0.151948 Nov 27 21:14:05.211897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3197/6512] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:05 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1648 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:14:05.223589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8ba11f60-c948-4934-bf8c-2e691b0d90d8 req-1f7e0d91-4855-48d6-b513-9be056b605d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16595aec-62b0-4a81-8923-9071b7521bfe", "name": "network-vif-plugged", "status": "completed", "tag": "a9f6773f-b4a1-41a8-9921-b5b340ba2efd"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:05.223589 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:05.223589 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:05.225320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8ba11f60-c948-4934-bf8c-2e691b0d90d8 req-1f7e0d91-4855-48d6-b513-9be056b605d4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.225773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8ba11f60-c948-4934-bf8c-2e691b0d90d8 req-1f7e0d91-4855-48d6-b513-9be056b605d4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.242193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8ba11f60-c948-4934-bf8c-2e691b0d90d8 req-1f7e0d91-4855-48d6-b513-9be056b605d4 service nova] Creating event network-vif-plugged:a9f6773f-b4a1-41a8-9921-b5b340ba2efd for instance 16595aec-62b0-4a81-8923-9071b7521bfe on nch1-master-1 Nov 27 21:14:05.247982 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8ba11f60-c948-4934-bf8c-2e691b0d90d8 req-1f7e0d91-4855-48d6-b513-9be056b605d4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Nov 27 21:14:05.248593 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3198/6513] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:05.254261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:05.254808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:05.264203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.265146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.267306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.267988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.413179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:05.420971 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bcd2f801-71d8-4009-8361-9ba9b486bc7b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.170894 Nov 27 21:14:05.421806 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3199/6514] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:05 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:05.426486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-715829711", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "2e4ea973-7dde-45f6-abff-33395836d24d"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:05.455047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:05.464791 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3a129d4b-1cee-4481-942a-e76e59125670 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.455247 Nov 27 21:14:05.465459 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3316/6515] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:05 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:14:05.495569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] validate_networks() for [('2e4ea973-7dde-45f6-abff-33395836d24d', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:14:05.904542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:14:05.904976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:14:05.905650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:14:05.906106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:14:05.906527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:14:05.915414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.916024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.916698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:05.917145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:05.934715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Getting quotas for project 0aefc004229844399f063a911bcc05b7. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:14:05.939828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Getting quotas for user 68af5d383d4149a89a0f87bdb735ccea and project 0aefc004229844399f063a911bcc05b7. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:14:05.954330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:14:05.957773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:14:06.003196 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5553c87a-41dc-41a4-a20f-0424bb1ae19f tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580186 Nov 27 21:14:06.003991 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3200/6516] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:14:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:14:06.014224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-239666d1-353b-41ca-832c-0266a709316b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:06.014838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-239666d1-353b-41ca-832c-0266a709316b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:06.077409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-239666d1-353b-41ca-832c-0266a709316b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1328 microversion: 2.1 time: 0.066776 Nov 27 21:14:06.077968 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3317/6517] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:06 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1328 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:06.438597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:06.439291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:06.447861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:06.448004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:06.451899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:06.452544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:06.632711 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:06.642531 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd5a259e-5d4c-447d-994c-868d4e39d15d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1362 microversion: 2.1 time: 0.208403 Nov 27 21:14:06.643126 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3201/6518] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:06 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:07.094099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dd8fbfae-da7f-4f76-809c-dc885bb0902d tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:07.095524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dd8fbfae-da7f-4f76-809c-dc885bb0902d tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:07.104784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd8fbfae-da7f-4f76-809c-dc885bb0902d tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:07.105169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd8fbfae-da7f-4f76-809c-dc885bb0902d tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:07.106190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd8fbfae-da7f-4f76-809c-dc885bb0902d tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:07.106813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dd8fbfae-da7f-4f76-809c-dc885bb0902d tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:07.205557 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dd8fbfae-da7f-4f76-809c-dc885bb0902d tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1421 microversion: 2.1 time: 0.115385 Nov 27 21:14:07.206124 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3318/6519] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:07 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:07.661030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:07.661666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:07.670348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:07.670768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:07.672252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:07.672889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:07.841265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:07.849447 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-347e5102-dd04-443c-ba69-688a5aa43cf6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1547 microversion: 2.1 time: 0.192525 Nov 27 21:14:07.860444 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3202/6520] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:07 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1547 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:07.868712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3a26e0d7-6498-4443-9543-bceafb70553b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:07.869209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3a26e0d7-6498-4443-9543-bceafb70553b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:07.876020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a26e0d7-6498-4443-9543-bceafb70553b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:07.876473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a26e0d7-6498-4443-9543-bceafb70553b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:07.877528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a26e0d7-6498-4443-9543-bceafb70553b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:07.877971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a26e0d7-6498-4443-9543-bceafb70553b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:07.987483 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3a26e0d7-6498-4443-9543-bceafb70553b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122658 Nov 27 21:14:07.988066 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3319/6521] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:14:07 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:08.226232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4050bd54-996b-4327-931f-66f97c529ba1 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:08.227312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4050bd54-996b-4327-931f-66f97c529ba1 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:08.234591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4050bd54-996b-4327-931f-66f97c529ba1 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:08.234970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4050bd54-996b-4327-931f-66f97c529ba1 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:08.235807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4050bd54-996b-4327-931f-66f97c529ba1 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:08.236448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4050bd54-996b-4327-931f-66f97c529ba1 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:08.346745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-67fb7657-1a86-44f1-9e89-b4985b040053 req-0c2c4180-4970-4144-90fc-df361815b856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccbc172-5d2c-408f-84e6-b376d7090dc7", "tag": "ad92505a-21a0-4d32-9f3c-516124e33076"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:08.348390 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:08.348390 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:14:08.365520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-67fb7657-1a86-44f1-9e89-b4985b040053 req-0c2c4180-4970-4144-90fc-df361815b856 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:08.365974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-67fb7657-1a86-44f1-9e89-b4985b040053 req-0c2c4180-4970-4144-90fc-df361815b856 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:08.391358 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-67fb7657-1a86-44f1-9e89-b4985b040053 req-0c2c4180-4970-4144-90fc-df361815b856 service nova] Creating event network-changed:ad92505a-21a0-4d32-9f3c-516124e33076 for instance fccbc172-5d2c-408f-84e6-b376d7090dc7 on nch1-master-1 Nov 27 21:14:08.396452 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-67fb7657-1a86-44f1-9e89-b4985b040053 req-0c2c4180-4970-4144-90fc-df361815b856 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054735 Nov 27 21:14:08.397254 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3320/6522] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:14:08.536940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4050bd54-996b-4327-931f-66f97c529ba1 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1463 microversion: 2.1 time: 0.313867 Nov 27 21:14:08.537746 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3203/6523] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:08 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1463 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:09.187400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c36a04c1-272c-4fad-8706-72de3a01ffe3 req-db234f59-0e29-4c3c-bb33-512e1824a0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16595aec-62b0-4a81-8923-9071b7521bfe", "tag": "a9f6773f-b4a1-41a8-9921-b5b340ba2efd"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:09.188985 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:09.188985 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:09.193431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6479fbf7-2388-4efe-ac40-52d0c717d2ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:09.194482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6479fbf7-2388-4efe-ac40-52d0c717d2ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:09.207559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6479fbf7-2388-4efe-ac40-52d0c717d2ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:09.208251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6479fbf7-2388-4efe-ac40-52d0c717d2ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:09.209258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6479fbf7-2388-4efe-ac40-52d0c717d2ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:09.209870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6479fbf7-2388-4efe-ac40-52d0c717d2ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:09.215393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c36a04c1-272c-4fad-8706-72de3a01ffe3 req-db234f59-0e29-4c3c-bb33-512e1824a0c4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:09.216023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c36a04c1-272c-4fad-8706-72de3a01ffe3 req-db234f59-0e29-4c3c-bb33-512e1824a0c4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:09.238549 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c36a04c1-272c-4fad-8706-72de3a01ffe3 req-db234f59-0e29-4c3c-bb33-512e1824a0c4 service nova] Creating event network-changed:a9f6773f-b4a1-41a8-9921-b5b340ba2efd for instance 16595aec-62b0-4a81-8923-9071b7521bfe on nch1-master-1 Nov 27 21:14:09.245775 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c36a04c1-272c-4fad-8706-72de3a01ffe3 req-db234f59-0e29-4c3c-bb33-512e1824a0c4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061827 Nov 27 21:14:09.249493 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3204/6524] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:14:09.281237 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6479fbf7-2388-4efe-ac40-52d0c717d2ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.101152 Nov 27 21:14:09.282998 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3321/6525] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:09 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:09.557020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13e27efd-c93d-4062-8f98-be69aac4f5e9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:09.557987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13e27efd-c93d-4062-8f98-be69aac4f5e9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:09.565206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e27efd-c93d-4062-8f98-be69aac4f5e9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:09.565891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e27efd-c93d-4062-8f98-be69aac4f5e9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:09.567188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e27efd-c93d-4062-8f98-be69aac4f5e9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:09.568357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13e27efd-c93d-4062-8f98-be69aac4f5e9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:09.777996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13e27efd-c93d-4062-8f98-be69aac4f5e9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1463 microversion: 2.1 time: 0.226948 Nov 27 21:14:09.778587 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3205/6526] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:09 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:10.299521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-309996c3-9de6-4209-b2da-ddac64afcf1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:10.300759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-309996c3-9de6-4209-b2da-ddac64afcf1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:10.315637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309996c3-9de6-4209-b2da-ddac64afcf1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:10.316354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309996c3-9de6-4209-b2da-ddac64afcf1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:10.318483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309996c3-9de6-4209-b2da-ddac64afcf1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:10.319280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-309996c3-9de6-4209-b2da-ddac64afcf1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:10.366441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-309996c3-9de6-4209-b2da-ddac64afcf1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.073295 Nov 27 21:14:10.367935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3322/6527] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:10 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:10.794456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a5d942cb-3bfb-4192-ba05-464c18ed9650 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:10.795147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a5d942cb-3bfb-4192-ba05-464c18ed9650 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:10.802819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5d942cb-3bfb-4192-ba05-464c18ed9650 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:10.803306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5d942cb-3bfb-4192-ba05-464c18ed9650 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:10.804123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5d942cb-3bfb-4192-ba05-464c18ed9650 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:10.804703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a5d942cb-3bfb-4192-ba05-464c18ed9650 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:10.934585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a5d942cb-3bfb-4192-ba05-464c18ed9650 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1463 microversion: 2.1 time: 0.144336 Nov 27 21:14:10.935279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3206/6528] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:10 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:11.378388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b281649c-2e95-4fb4-bc93-a406c67d84e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:11.379424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b281649c-2e95-4fb4-bc93-a406c67d84e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:11.387811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b281649c-2e95-4fb4-bc93-a406c67d84e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:11.388251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b281649c-2e95-4fb4-bc93-a406c67d84e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:11.389040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b281649c-2e95-4fb4-bc93-a406c67d84e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:11.389483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b281649c-2e95-4fb4-bc93-a406c67d84e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:11.437841 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b281649c-2e95-4fb4-bc93-a406c67d84e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.063336 Nov 27 21:14:11.438470 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3323/6529] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:11 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:11.952824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-03ddc718-1c79-45e9-a082-5f4db4134b76 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:11.954206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-03ddc718-1c79-45e9-a082-5f4db4134b76 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:11.962225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ddc718-1c79-45e9-a082-5f4db4134b76 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:11.962675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ddc718-1c79-45e9-a082-5f4db4134b76 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:11.963493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ddc718-1c79-45e9-a082-5f4db4134b76 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:11.964031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03ddc718-1c79-45e9-a082-5f4db4134b76 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:12.128449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-03ddc718-1c79-45e9-a082-5f4db4134b76 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1463 microversion: 2.1 time: 0.181236 Nov 27 21:14:12.129148 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3207/6530] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:11 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:12.449189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cdaedb1d-c22f-4b31-886c-23686628e0d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:12.450210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cdaedb1d-c22f-4b31-886c-23686628e0d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:12.457812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdaedb1d-c22f-4b31-886c-23686628e0d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:12.458270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdaedb1d-c22f-4b31-886c-23686628e0d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:12.459056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdaedb1d-c22f-4b31-886c-23686628e0d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:12.459530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdaedb1d-c22f-4b31-886c-23686628e0d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:12.503981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cdaedb1d-c22f-4b31-886c-23686628e0d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.058707 Nov 27 21:14:12.504636 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3324/6531] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:12 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:13.146135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce163e48-2e92-445e-ace6-d909fb60f148 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:13.146906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce163e48-2e92-445e-ace6-d909fb60f148 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:13.154333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce163e48-2e92-445e-ace6-d909fb60f148 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:13.154803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce163e48-2e92-445e-ace6-d909fb60f148 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:13.155621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce163e48-2e92-445e-ace6-d909fb60f148 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:13.156180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce163e48-2e92-445e-ace6-d909fb60f148 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:13.280807 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce163e48-2e92-445e-ace6-d909fb60f148 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1463 microversion: 2.1 time: 0.138984 Nov 27 21:14:13.281319 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3208/6532] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:13 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:13.515727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-19dffa52-b7d2-4c3e-8126-d6eb95261fe2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:13.516840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-19dffa52-b7d2-4c3e-8126-d6eb95261fe2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:13.524247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19dffa52-b7d2-4c3e-8126-d6eb95261fe2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:13.524709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19dffa52-b7d2-4c3e-8126-d6eb95261fe2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:13.525501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19dffa52-b7d2-4c3e-8126-d6eb95261fe2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:13.525941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-19dffa52-b7d2-4c3e-8126-d6eb95261fe2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:13.564002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-19dffa52-b7d2-4c3e-8126-d6eb95261fe2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.052258 Nov 27 21:14:13.564748 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3325/6533] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:13 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:13.840256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-007afdef-1fd1-4e58-b28c-af5aaed3a5a2 req-a6284ce5-1007-4ac9-86d7-c6c1c409a800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccbc172-5d2c-408f-84e6-b376d7090dc7", "name": "network-vif-plugged", "status": "completed", "tag": "ad92505a-21a0-4d32-9f3c-516124e33076"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:13.841817 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:13.841817 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:13.848657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-007afdef-1fd1-4e58-b28c-af5aaed3a5a2 req-a6284ce5-1007-4ac9-86d7-c6c1c409a800 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:13.849101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-007afdef-1fd1-4e58-b28c-af5aaed3a5a2 req-a6284ce5-1007-4ac9-86d7-c6c1c409a800 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:13.861067 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-007afdef-1fd1-4e58-b28c-af5aaed3a5a2 req-a6284ce5-1007-4ac9-86d7-c6c1c409a800 service nova] Creating event network-vif-plugged:ad92505a-21a0-4d32-9f3c-516124e33076 for instance fccbc172-5d2c-408f-84e6-b376d7090dc7 on nch1-master-1 Nov 27 21:14:13.865834 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-007afdef-1fd1-4e58-b28c-af5aaed3a5a2 req-a6284ce5-1007-4ac9-86d7-c6c1c409a800 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029800 Nov 27 21:14:13.866437 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3209/6534] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:14.297770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-012c72e7-02fb-42ec-b70b-ef286c88cc2b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:14.298527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-012c72e7-02fb-42ec-b70b-ef286c88cc2b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:14.305418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012c72e7-02fb-42ec-b70b-ef286c88cc2b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:14.305934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012c72e7-02fb-42ec-b70b-ef286c88cc2b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:14.306720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012c72e7-02fb-42ec-b70b-ef286c88cc2b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:14.307160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012c72e7-02fb-42ec-b70b-ef286c88cc2b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:14.445587 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-012c72e7-02fb-42ec-b70b-ef286c88cc2b tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1463 microversion: 2.1 time: 0.151808 Nov 27 21:14:14.446215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3326/6535] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:14 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:14.576093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-362fc684-7d3d-498a-8da4-2211ab29388f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:14.577090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-362fc684-7d3d-498a-8da4-2211ab29388f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:14.583678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-362fc684-7d3d-498a-8da4-2211ab29388f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:14.584138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-362fc684-7d3d-498a-8da4-2211ab29388f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:14.585428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-362fc684-7d3d-498a-8da4-2211ab29388f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:14.585748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-362fc684-7d3d-498a-8da4-2211ab29388f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:14.624958 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-362fc684-7d3d-498a-8da4-2211ab29388f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.053583 Nov 27 21:14:14.625808 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3210/6536] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:14 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:15.463056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e1fc6d85-dd24-4092-b085-61a2adc647c4 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:15.463747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e1fc6d85-dd24-4092-b085-61a2adc647c4 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:15.470488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1fc6d85-dd24-4092-b085-61a2adc647c4 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.470938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1fc6d85-dd24-4092-b085-61a2adc647c4 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.471738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1fc6d85-dd24-4092-b085-61a2adc647c4 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.472173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e1fc6d85-dd24-4092-b085-61a2adc647c4 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.593170 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e1fc6d85-dd24-4092-b085-61a2adc647c4 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1648 microversion: 2.1 time: 0.133786 Nov 27 21:14:15.593731 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3327/6537] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:15 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1648 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:15.610195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b34e05f6-f666-4eb7-b8a6-e57d08cbdeab tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:15.610898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b34e05f6-f666-4eb7-b8a6-e57d08cbdeab tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:15.619069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34e05f6-f666-4eb7-b8a6-e57d08cbdeab tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.619564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34e05f6-f666-4eb7-b8a6-e57d08cbdeab tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.620345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34e05f6-f666-4eb7-b8a6-e57d08cbdeab tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.620787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b34e05f6-f666-4eb7-b8a6-e57d08cbdeab tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.635600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e199750e-76a0-4faa-a4ed-fb40c9f2c731 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:15.636515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e199750e-76a0-4faa-a4ed-fb40c9f2c731 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:15.642247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e199750e-76a0-4faa-a4ed-fb40c9f2c731 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.642702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e199750e-76a0-4faa-a4ed-fb40c9f2c731 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.643502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e199750e-76a0-4faa-a4ed-fb40c9f2c731 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.643942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e199750e-76a0-4faa-a4ed-fb40c9f2c731 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.686187 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e199750e-76a0-4faa-a4ed-fb40c9f2c731 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.053987 Nov 27 21:14:15.687287 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3328/6538] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:15 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:14:15.750744 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b34e05f6-f666-4eb7-b8a6-e57d08cbdeab tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1648 microversion: 2.1 time: 0.144319 Nov 27 21:14:15.751453 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3211/6539] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:15 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1648 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:15.769810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73d3e94c-bf3e-41af-9f10-c445eb21a728 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:15.769977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73d3e94c-bf3e-41af-9f10-c445eb21a728 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:15.777453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73d3e94c-bf3e-41af-9f10-c445eb21a728 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.778141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73d3e94c-bf3e-41af-9f10-c445eb21a728 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.779069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73d3e94c-bf3e-41af-9f10-c445eb21a728 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.779547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73d3e94c-bf3e-41af-9f10-c445eb21a728 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.915698 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73d3e94c-bf3e-41af-9f10-c445eb21a728 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1648 microversion: 2.1 time: 0.151013 Nov 27 21:14:15.916265 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3329/6540] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:15 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1648 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:15.931429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:15.931934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:15.938226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.938678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.939495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:15.939935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:15.965382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:14:16.049934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53d59bed-6451-4c41-a67e-9239d4167540 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "DELETE /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 204 len: 0 microversion: 2.1 time: 0.121830 Nov 27 21:14:16.050648 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3212/6541] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:14:15 2021] DELETE /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:14:16.058558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-13cb083c-298c-4572-9fda-9d5dd4d5ec89 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:16.059514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-13cb083c-298c-4572-9fda-9d5dd4d5ec89 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:16.066072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13cb083c-298c-4572-9fda-9d5dd4d5ec89 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:16.066520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13cb083c-298c-4572-9fda-9d5dd4d5ec89 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:16.067546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13cb083c-298c-4572-9fda-9d5dd4d5ec89 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:16.067991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13cb083c-298c-4572-9fda-9d5dd4d5ec89 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:16.207824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-13cb083c-298c-4572-9fda-9d5dd4d5ec89 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1654 microversion: 2.1 time: 0.152769 Nov 27 21:14:16.208392 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3330/6542] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:16 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:16.698207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98ad2409-1d05-41d6-87e7-8bff73ee615a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:16.699111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98ad2409-1d05-41d6-87e7-8bff73ee615a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:16.706600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98ad2409-1d05-41d6-87e7-8bff73ee615a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:16.707057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98ad2409-1d05-41d6-87e7-8bff73ee615a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:16.707878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98ad2409-1d05-41d6-87e7-8bff73ee615a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:16.708350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98ad2409-1d05-41d6-87e7-8bff73ee615a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:16.748935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98ad2409-1d05-41d6-87e7-8bff73ee615a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.055443 Nov 27 21:14:16.749548 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3213/6543] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:16 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:17.224876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-36eac01a-2cc7-4f66-ae3b-e0caec9e0b0a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:17.225446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36eac01a-2cc7-4f66-ae3b-e0caec9e0b0a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:17.233327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36eac01a-2cc7-4f66-ae3b-e0caec9e0b0a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:17.233821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36eac01a-2cc7-4f66-ae3b-e0caec9e0b0a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:17.234811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36eac01a-2cc7-4f66-ae3b-e0caec9e0b0a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:17.235279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36eac01a-2cc7-4f66-ae3b-e0caec9e0b0a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:17.369946 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-36eac01a-2cc7-4f66-ae3b-e0caec9e0b0a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1654 microversion: 2.1 time: 0.149110 Nov 27 21:14:17.370550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3331/6544] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:17 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:17.760934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c63527d0-545a-4a25-a244-20934b7601fc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:17.762034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c63527d0-545a-4a25-a244-20934b7601fc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:17.769451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63527d0-545a-4a25-a244-20934b7601fc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:17.769905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63527d0-545a-4a25-a244-20934b7601fc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:17.770691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63527d0-545a-4a25-a244-20934b7601fc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:17.771127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c63527d0-545a-4a25-a244-20934b7601fc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:17.811316 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c63527d0-545a-4a25-a244-20934b7601fc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.054858 Nov 27 21:14:17.814949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3214/6545] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:17 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:18.159012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4bfbfd98-a453-410d-92df-825be12f14aa req-6286b0dd-6010-4680-9275-13c8a6b348d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccbc172-5d2c-408f-84e6-b376d7090dc7", "name": "network-vif-deleted", "tag": "ad92505a-21a0-4d32-9f3c-516124e33076"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:18.161166 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:18.161166 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:14:18.179196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4bfbfd98-a453-410d-92df-825be12f14aa req-6286b0dd-6010-4680-9275-13c8a6b348d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:18.180039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4bfbfd98-a453-410d-92df-825be12f14aa req-6286b0dd-6010-4680-9275-13c8a6b348d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:18.201541 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4bfbfd98-a453-410d-92df-825be12f14aa req-6286b0dd-6010-4680-9275-13c8a6b348d2 service nova] Creating event network-vif-deleted:ad92505a-21a0-4d32-9f3c-516124e33076 for instance fccbc172-5d2c-408f-84e6-b376d7090dc7 on nch1-master-1 Nov 27 21:14:18.208559 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4bfbfd98-a453-410d-92df-825be12f14aa req-6286b0dd-6010-4680-9275-13c8a6b348d2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052769 Nov 27 21:14:18.209950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3332/6546] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:18.388350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:18.389114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:18.397092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:18.397907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:18.398785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:18.399369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:18.431674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:18.432280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:18.432845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lazy-loading 'fault' on Instance uuid fccbc172-5d2c-408f-84e6-b376d7090dc7 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:14:18.482881 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c30c2b8-065d-4d03-98e4-3ab7aea19f07 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 200 len: 1453 microversion: 2.1 time: 0.100139 Nov 27 21:14:18.483949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3215/6547] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:18 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:18.822732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-825f8e88-b416-4c39-8245-cfba0034457d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:18.823754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-825f8e88-b416-4c39-8245-cfba0034457d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:18.829851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-825f8e88-b416-4c39-8245-cfba0034457d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:18.830300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-825f8e88-b416-4c39-8245-cfba0034457d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:18.831071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-825f8e88-b416-4c39-8245-cfba0034457d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:18.831539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-825f8e88-b416-4c39-8245-cfba0034457d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:18.873988 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-825f8e88-b416-4c39-8245-cfba0034457d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 14 microversion: 2.1 time: 0.055202 Nov 27 21:14:18.874797 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3333/6548] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:18 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:14:19.502012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:19.502535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: fccbc172-5d2c-408f-84e6-b376d7090dc7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:19.509804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.510268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.511062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.511538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.527053 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] HTTP exception thrown: Instance fccbc172-5d2c-408f-84e6-b376d7090dc7 could not be found. Nov 27 21:14:19.528128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Returning 404 to user: Instance fccbc172-5d2c-408f-84e6-b376d7090dc7 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:14:19.529590 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21e6c112-6ce4-49e8-836a-312dc3bf0cf9 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7" status: 404 len: 111 microversion: 2.1 time: 0.031117 Nov 27 21:14:19.530364 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3216/6549] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:19 2021] GET /compute/v2.1/servers/fccbc172-5d2c-408f-84e6-b376d7090dc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:14:19.538994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:19.539618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:19.546742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.547299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.548190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.548692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.573730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:14:19.651171 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-879f1b19-86e5-42b4-ac85-b7ba3164094a tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "DELETE /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 204 len: 0 microversion: 2.1 time: 0.115965 Nov 27 21:14:19.651894 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3334/6550] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:14:19 2021] DELETE /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:14:19.660406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a7b69d4f-fe10-4ba9-b090-b00db3b1cb14 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:19.661017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a7b69d4f-fe10-4ba9-b090-b00db3b1cb14 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:19.667583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7b69d4f-fe10-4ba9-b090-b00db3b1cb14 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.668034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7b69d4f-fe10-4ba9-b090-b00db3b1cb14 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.668814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7b69d4f-fe10-4ba9-b090-b00db3b1cb14 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.669246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7b69d4f-fe10-4ba9-b090-b00db3b1cb14 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.857100 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a7b69d4f-fe10-4ba9-b090-b00db3b1cb14 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1654 microversion: 2.1 time: 0.200539 Nov 27 21:14:19.857688 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3217/6551] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:19 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1654 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:19.885364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-76a76776-58ab-477d-a5ca-70ed5c253327 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:19.886435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-76a76776-58ab-477d-a5ca-70ed5c253327 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:19.893919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76a76776-58ab-477d-a5ca-70ed5c253327 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.894412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76a76776-58ab-477d-a5ca-70ed5c253327 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.895203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76a76776-58ab-477d-a5ca-70ed5c253327 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:19.895682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76a76776-58ab-477d-a5ca-70ed5c253327 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:19.952024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-76a76776-58ab-477d-a5ca-70ed5c253327 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 8206 microversion: 2.1 time: 0.070664 Nov 27 21:14:19.952929 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3335/6552] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:19 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 8206 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:20.873537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a835e9a-e25e-4f78-a6d1-ac974beb63fa tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:20.874197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a835e9a-e25e-4f78-a6d1-ac974beb63fa tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:20.880973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a835e9a-e25e-4f78-a6d1-ac974beb63fa tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:20.881362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a835e9a-e25e-4f78-a6d1-ac974beb63fa tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:20.882157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a835e9a-e25e-4f78-a6d1-ac974beb63fa tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:20.882604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a835e9a-e25e-4f78-a6d1-ac974beb63fa tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:20.964951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5995d5ce-57ea-46c4-ad58-0a39dde33443 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:20.966211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5995d5ce-57ea-46c4-ad58-0a39dde33443 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:20.974080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5995d5ce-57ea-46c4-ad58-0a39dde33443 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:20.974607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5995d5ce-57ea-46c4-ad58-0a39dde33443 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:20.975509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5995d5ce-57ea-46c4-ad58-0a39dde33443 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:20.976025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5995d5ce-57ea-46c4-ad58-0a39dde33443 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:21.017969 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a835e9a-e25e-4f78-a6d1-ac974beb63fa tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1654 microversion: 2.1 time: 0.147977 Nov 27 21:14:21.018842 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3218/6553] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:20 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:21.028439 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5995d5ce-57ea-46c4-ad58-0a39dde33443 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 16398 microversion: 2.1 time: 0.066675 Nov 27 21:14:21.032102 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3336/6554] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:20 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 16398 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:21.395525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad9784e5-7bae-4759-95ef-83c1ae92f949 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: .version_select at 0x7f15d94d5160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-976170150"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:21.409339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ad9784e5-7bae-4759-95ef-83c1ae92f949 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:14:21.414279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ad9784e5-7bae-4759-95ef-83c1ae92f949 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:14:21.714176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ad9784e5-7bae-4759-95ef-83c1ae92f949 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:14:21.719224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-ad9784e5-7bae-4759-95ef-83c1ae92f949 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:14:21.734834 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad9784e5-7bae-4759-95ef-83c1ae92f949 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.646323 Nov 27 21:14:21.740318 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3219/6555] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:14:21 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:21.815379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cee3cae1-6747-436f-8419-eefd1653ba56 req-2973a146-90a1-41ff-b808-8248e7e04f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220f6fbb-3bb8-47d4-b236-d9a44eae1763", "name": "network-vif-deleted", "tag": "f6ebcc5d-3925-48c7-b526-8c48a5a5db44"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:21.817086 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:21.817086 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:14:21.826419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cee3cae1-6747-436f-8419-eefd1653ba56 req-2973a146-90a1-41ff-b808-8248e7e04f05 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:21.827202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cee3cae1-6747-436f-8419-eefd1653ba56 req-2973a146-90a1-41ff-b808-8248e7e04f05 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:21.841457 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cee3cae1-6747-436f-8419-eefd1653ba56 req-2973a146-90a1-41ff-b808-8248e7e04f05 service nova] Creating event network-vif-deleted:f6ebcc5d-3925-48c7-b526-8c48a5a5db44 for instance 220f6fbb-3bb8-47d4-b236-d9a44eae1763 on nch2-master-1 Nov 27 21:14:21.847578 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cee3cae1-6747-436f-8419-eefd1653ba56 req-2973a146-90a1-41ff-b808-8248e7e04f05 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037929 Nov 27 21:14:21.848515 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3337/6556] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:22.036604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:22.037221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:22.042535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88d05ff1-e18c-44ee-a5c5-452a6a53b16a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:22.044249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88d05ff1-e18c-44ee-a5c5-452a6a53b16a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:22.047112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:22.047697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:22.048558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:22.049518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:22.050654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d05ff1-e18c-44ee-a5c5-452a6a53b16a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:22.051117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d05ff1-e18c-44ee-a5c5-452a6a53b16a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:22.052191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d05ff1-e18c-44ee-a5c5-452a6a53b16a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:22.052691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d05ff1-e18c-44ee-a5c5-452a6a53b16a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:22.083210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:22.083613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:22.084179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lazy-loading 'fault' on Instance uuid 220f6fbb-3bb8-47d4-b236-d9a44eae1763 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:14:22.100161 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88d05ff1-e18c-44ee-a5c5-452a6a53b16a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 16398 microversion: 2.1 time: 0.064092 Nov 27 21:14:22.100822 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3338/6557] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:22 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 16398 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:22.136996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a239d28-48f6-49b5-b45a-8f25f8f4f6a2 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 200 len: 1453 microversion: 2.1 time: 0.104246 Nov 27 21:14:22.137578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3220/6558] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:22 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:23.113130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4eaee6a1-bcff-4abf-b26d-f54c14b6ee2a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:23.114208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4eaee6a1-bcff-4abf-b26d-f54c14b6ee2a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:23.121990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eaee6a1-bcff-4abf-b26d-f54c14b6ee2a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:23.122510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eaee6a1-bcff-4abf-b26d-f54c14b6ee2a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:23.123377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eaee6a1-bcff-4abf-b26d-f54c14b6ee2a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:23.123899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eaee6a1-bcff-4abf-b26d-f54c14b6ee2a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:23.153841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:23.154505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] [instance: 220f6fbb-3bb8-47d4-b236-d9a44eae1763] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:23.161877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:23.162335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:23.163145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:23.163647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:23.165714 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4eaee6a1-bcff-4abf-b26d-f54c14b6ee2a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 16398 microversion: 2.1 time: 0.055872 Nov 27 21:14:23.166854 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3339/6559] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:23 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 16398 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:23.179723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] HTTP exception thrown: Instance 220f6fbb-3bb8-47d4-b236-d9a44eae1763 could not be found. Nov 27 21:14:23.181720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] Returning 404 to user: Instance 220f6fbb-3bb8-47d4-b236-d9a44eae1763 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:14:23.182563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7d7fcd4-8d59-4541-9dc2-b671a1220555 tempest-TestServerMultinode-627294735 tempest-TestServerMultinode-627294735-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763" status: 404 len: 111 microversion: 2.1 time: 0.032600 Nov 27 21:14:23.183121 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3221/6560] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:23 2021] GET /compute/v2.1/servers/220f6fbb-3bb8-47d4-b236-d9a44eae1763 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:14:24.177953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-464795f7-7933-423e-b2c9-73c148f7363a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:24.179790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-464795f7-7933-423e-b2c9-73c148f7363a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:24.190810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-464795f7-7933-423e-b2c9-73c148f7363a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:24.191703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-464795f7-7933-423e-b2c9-73c148f7363a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:24.192593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-464795f7-7933-423e-b2c9-73c148f7363a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:24.193279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-464795f7-7933-423e-b2c9-73c148f7363a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:24.237075 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-464795f7-7933-423e-b2c9-73c148f7363a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 16398 microversion: 2.1 time: 0.063126 Nov 27 21:14:24.238516 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3340/6561] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:24 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 16398 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:25.262983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7c301d25-4092-4790-85ac-9a68e80aada7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:25.264750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7c301d25-4092-4790-85ac-9a68e80aada7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:25.273610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c301d25-4092-4790-85ac-9a68e80aada7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:25.275049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c301d25-4092-4790-85ac-9a68e80aada7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:25.276110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c301d25-4092-4790-85ac-9a68e80aada7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:25.276763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7c301d25-4092-4790-85ac-9a68e80aada7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:25.333059 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7c301d25-4092-4790-85ac-9a68e80aada7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.087609 Nov 27 21:14:25.335099 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3222/6562] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:25 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:26.368000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f97a9551-60a1-489c-84cc-3dde9b12c6ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:26.369735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f97a9551-60a1-489c-84cc-3dde9b12c6ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:26.394906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f97a9551-60a1-489c-84cc-3dde9b12c6ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:26.395472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f97a9551-60a1-489c-84cc-3dde9b12c6ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:26.399519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f97a9551-60a1-489c-84cc-3dde9b12c6ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:26.401905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f97a9551-60a1-489c-84cc-3dde9b12c6ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:26.501414 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f97a9551-60a1-489c-84cc-3dde9b12c6ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.157782 Nov 27 21:14:26.502099 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3341/6563] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:26 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:27.516082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb3b5408-3282-41be-9d04-2a4e5da12920 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:27.519345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb3b5408-3282-41be-9d04-2a4e5da12920 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:27.528990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb3b5408-3282-41be-9d04-2a4e5da12920 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:27.529829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb3b5408-3282-41be-9d04-2a4e5da12920 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:27.531441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb3b5408-3282-41be-9d04-2a4e5da12920 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:27.532142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb3b5408-3282-41be-9d04-2a4e5da12920 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:27.583515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb3b5408-3282-41be-9d04-2a4e5da12920 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.073931 Nov 27 21:14:27.584458 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3223/6564] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:27 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:28.554120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1191058538", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "a4b376cb-8e19-49db-9b64-e37cc05f1c33"}], "key_name": "tempest-TestNetworkAdvancedServerOps-976170150", "security_groups": [{"name": "tempest-secgroup-smoke-1362154697"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:28.595554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3fe76c2d-261f-4fa3-8dab-c159a8fe5a5a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:28.596580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3fe76c2d-261f-4fa3-8dab-c159a8fe5a5a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:28.607219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fe76c2d-261f-4fa3-8dab-c159a8fe5a5a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:28.608018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fe76c2d-261f-4fa3-8dab-c159a8fe5a5a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:28.609006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fe76c2d-261f-4fa3-8dab-c159a8fe5a5a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:28.609630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3fe76c2d-261f-4fa3-8dab-c159a8fe5a5a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:28.663872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3fe76c2d-261f-4fa3-8dab-c159a8fe5a5a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.072120 Nov 27 21:14:28.665499 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3224/6565] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:28 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:28.701357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] validate_networks() for [('a4b376cb-8e19-49db-9b64-e37cc05f1c33', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:14:29.240478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:14:29.240816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:14:29.241299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:14:29.241972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:14:29.242426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:14:29.252824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:29.253278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:29.254101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:29.254697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:29.277704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:14:29.283351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:14:29.302777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:14:29.305708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:14:29.400668 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1efdca17-682f-4a92-b25d-e4e61d16a045 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.850001 Nov 27 21:14:29.415216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-867dd20f-0fd5-4778-b68f-0f0c4731eef5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:29.419673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-867dd20f-0fd5-4778-b68f-0f0c4731eef5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:29.422903 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3342/6566] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:14:28 2021] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:14:29.619586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-867dd20f-0fd5-4778-b68f-0f0c4731eef5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:29.626940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-867dd20f-0fd5-4778-b68f-0f0c4731eef5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1266 microversion: 2.1 time: 0.215732 Nov 27 21:14:29.635959 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3225/6567] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:29 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:29.677084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a6e4859-90a2-429f-8c0c-3dc72fa8a0d0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:29.678342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a6e4859-90a2-429f-8c0c-3dc72fa8a0d0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:29.692918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6e4859-90a2-429f-8c0c-3dc72fa8a0d0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:29.693374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6e4859-90a2-429f-8c0c-3dc72fa8a0d0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:29.694194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6e4859-90a2-429f-8c0c-3dc72fa8a0d0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:29.694639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6e4859-90a2-429f-8c0c-3dc72fa8a0d0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:29.770317 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a6e4859-90a2-429f-8c0c-3dc72fa8a0d0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.097641 Nov 27 21:14:29.771534 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3343/6568] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:29 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:30.653676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:30.654978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:30.668767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:30.669221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:30.670025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:30.670461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:30.754380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:30.763190 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-157d7cfc-3fb1-4267-9c22-a8af42c8b6a6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1318 microversion: 2.1 time: 0.115138 Nov 27 21:14:30.766782 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3226/6569] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:30 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1318 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:30.783107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a82bf46b-38a2-4ad6-9d75-cbf8b89c2f6d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:30.784407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a82bf46b-38a2-4ad6-9d75-cbf8b89c2f6d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:30.795230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a82bf46b-38a2-4ad6-9d75-cbf8b89c2f6d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:30.795438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a82bf46b-38a2-4ad6-9d75-cbf8b89c2f6d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:30.796946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a82bf46b-38a2-4ad6-9d75-cbf8b89c2f6d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:30.797577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a82bf46b-38a2-4ad6-9d75-cbf8b89c2f6d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:30.861612 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a82bf46b-38a2-4ad6-9d75-cbf8b89c2f6d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.082386 Nov 27 21:14:30.862562 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3344/6570] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:30 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:31.780372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:31.781632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:31.793857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:31.794727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:31.807138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:31.807742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:31.875037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3058bba9-0130-4eea-8ad5-99b455cb993e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:31.876282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3058bba9-0130-4eea-8ad5-99b455cb993e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:31.892736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3058bba9-0130-4eea-8ad5-99b455cb993e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:31.893271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3058bba9-0130-4eea-8ad5-99b455cb993e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:31.894169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3058bba9-0130-4eea-8ad5-99b455cb993e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:31.894691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3058bba9-0130-4eea-8ad5-99b455cb993e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:31.932223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:31.946052 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7bc04fcd-72a0-456f-964f-4ef5ca3db7de tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1324 microversion: 2.1 time: 0.168406 Nov 27 21:14:31.947360 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3227/6571] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:31 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:31.952967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3058bba9-0130-4eea-8ad5-99b455cb993e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.082244 Nov 27 21:14:31.954271 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3345/6572] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:31 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:32.938211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-437953c2-2293-4d3e-b2e8-91472165272b req-2ff9b8ff-9ee7-4723-8b80-19e3cee13d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:32.941258 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:32.941258 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:32.952440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-437953c2-2293-4d3e-b2e8-91472165272b req-2ff9b8ff-9ee7-4723-8b80-19e3cee13d77 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:32.956819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-437953c2-2293-4d3e-b2e8-91472165272b req-2ff9b8ff-9ee7-4723-8b80-19e3cee13d77 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:32.969137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:32.973293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:33.004119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:33.004585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:33.009683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:33.009844 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-437953c2-2293-4d3e-b2e8-91472165272b req-2ff9b8ff-9ee7-4723-8b80-19e3cee13d77 service nova] Creating event network-changed:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch2-master-1 Nov 27 21:14:33.010837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:33.024616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-437953c2-2293-4d3e-b2e8-91472165272b req-2ff9b8ff-9ee7-4723-8b80-19e3cee13d77 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099948 Nov 27 21:14:33.025263 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3228/6573] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:33.056760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1a3ea710-7ec9-4f21-95ba-4b9f80e41512 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:33.071676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1a3ea710-7ec9-4f21-95ba-4b9f80e41512 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:33.098442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a3ea710-7ec9-4f21-95ba-4b9f80e41512 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:33.102757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a3ea710-7ec9-4f21-95ba-4b9f80e41512 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:33.108669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a3ea710-7ec9-4f21-95ba-4b9f80e41512 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:33.109422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1a3ea710-7ec9-4f21-95ba-4b9f80e41512 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:33.191041 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1a3ea710-7ec9-4f21-95ba-4b9f80e41512 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.156813 Nov 27 21:14:33.192119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3229/6574] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:33 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:33.300032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:33.310571 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-948acd9a-f994-4b6c-9b64-477395265021 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1392 microversion: 2.1 time: 0.348220 Nov 27 21:14:33.312707 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3346/6575] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:32 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:34.203566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d273b84f-2e57-4034-bf97-c12e5bfe1ff4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:34.204747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d273b84f-2e57-4034-bf97-c12e5bfe1ff4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:34.212692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d273b84f-2e57-4034-bf97-c12e5bfe1ff4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:34.213090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d273b84f-2e57-4034-bf97-c12e5bfe1ff4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:34.213875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d273b84f-2e57-4034-bf97-c12e5bfe1ff4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:34.214344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d273b84f-2e57-4034-bf97-c12e5bfe1ff4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:34.257660 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d273b84f-2e57-4034-bf97-c12e5bfe1ff4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.058078 Nov 27 21:14:34.259030 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3230/6576] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:34 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:34.329331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:34.329940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:34.337311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:34.337766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:34.338547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:34.338986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:34.481278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:34.488688 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-239c9367-aabe-4e9f-817a-e6b990b1def7 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1392 microversion: 2.1 time: 0.163131 Nov 27 21:14:34.489260 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3347/6577] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:34 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:35.270230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb4c9f11-400b-4b8b-9c45-f38ad5779ecc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:35.271227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb4c9f11-400b-4b8b-9c45-f38ad5779ecc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:35.278538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4c9f11-400b-4b8b-9c45-f38ad5779ecc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:35.278981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4c9f11-400b-4b8b-9c45-f38ad5779ecc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:35.279784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4c9f11-400b-4b8b-9c45-f38ad5779ecc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:35.280219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4c9f11-400b-4b8b-9c45-f38ad5779ecc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:35.323176 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb4c9f11-400b-4b8b-9c45-f38ad5779ecc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.056925 Nov 27 21:14:35.323894 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3231/6578] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:35 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:35.504652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:35.505295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:35.512147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:35.512574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:35.513361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:35.513806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:35.646071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:35.653924 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9247bbf-6f49-471a-af38-2e857b377a97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1392 microversion: 2.1 time: 0.153069 Nov 27 21:14:35.654495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3348/6579] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:35 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:36.334517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-077ff55a-8707-47ec-96b3-1fa3ebde6f2c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:36.335484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-077ff55a-8707-47ec-96b3-1fa3ebde6f2c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:36.342840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-077ff55a-8707-47ec-96b3-1fa3ebde6f2c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:36.343326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-077ff55a-8707-47ec-96b3-1fa3ebde6f2c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:36.344109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-077ff55a-8707-47ec-96b3-1fa3ebde6f2c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:36.344555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-077ff55a-8707-47ec-96b3-1fa3ebde6f2c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:36.386019 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-077ff55a-8707-47ec-96b3-1fa3ebde6f2c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.055479 Nov 27 21:14:36.386744 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3232/6580] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:36 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:36.670945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:36.671564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:36.678333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:36.678791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:36.680017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:36.680459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:36.812093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:36.819829 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c91c45f-79a3-44d3-a469-0aaaba0e9dc6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1392 microversion: 2.1 time: 0.152640 Nov 27 21:14:36.820397 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3349/6581] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:36 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:37.398664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b985be54-afa6-4f59-b50e-a27e438887a3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:37.399629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b985be54-afa6-4f59-b50e-a27e438887a3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:37.407586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b985be54-afa6-4f59-b50e-a27e438887a3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:37.408042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b985be54-afa6-4f59-b50e-a27e438887a3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:37.408826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b985be54-afa6-4f59-b50e-a27e438887a3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:37.409274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b985be54-afa6-4f59-b50e-a27e438887a3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:37.448856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b985be54-afa6-4f59-b50e-a27e438887a3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.054246 Nov 27 21:14:37.449510 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3233/6582] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:37 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:37.836668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:37.837388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:37.844946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:37.845499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:37.846368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:37.846886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:37.986017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:37.993605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1cc1933e-12f6-4eda-ac91-5e5596ac4e5d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1392 microversion: 2.1 time: 0.160722 Nov 27 21:14:37.994170 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3350/6583] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:37 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:38.460653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af845bf6-9068-4010-912b-68c70764f748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:38.461657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af845bf6-9068-4010-912b-68c70764f748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:38.469498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af845bf6-9068-4010-912b-68c70764f748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:38.469947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af845bf6-9068-4010-912b-68c70764f748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:38.470727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af845bf6-9068-4010-912b-68c70764f748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:38.471160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af845bf6-9068-4010-912b-68c70764f748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:38.513982 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af845bf6-9068-4010-912b-68c70764f748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 24564 microversion: 2.1 time: 0.057246 Nov 27 21:14:38.514644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3234/6584] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:38 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 24564 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:39.011429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:39.012038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:39.018710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:39.019167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:39.019980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:39.020450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:39.167982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:39.175395 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb090569-e43f-47da-83a4-e5dc9b5efdcd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1392 microversion: 2.1 time: 0.168180 Nov 27 21:14:39.175976 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3351/6585] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:39 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:39.262484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ee3b425e-1eb0-4f54-971e-f104ee10f7c7 req-10b1180a-7374-479c-a842-703341b265f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "name": "network-vif-plugged", "status": "completed", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:39.264138 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:39.264138 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:39.273213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ee3b425e-1eb0-4f54-971e-f104ee10f7c7 req-10b1180a-7374-479c-a842-703341b265f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:39.273670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ee3b425e-1eb0-4f54-971e-f104ee10f7c7 req-10b1180a-7374-479c-a842-703341b265f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:39.284859 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ee3b425e-1eb0-4f54-971e-f104ee10f7c7 req-10b1180a-7374-479c-a842-703341b265f8 service nova] Creating event network-vif-plugged:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch2-master-1 Nov 27 21:14:39.289799 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ee3b425e-1eb0-4f54-971e-f104ee10f7c7 req-10b1180a-7374-479c-a842-703341b265f8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032056 Nov 27 21:14:39.290395 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3235/6586] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:14:39.524582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bd483af-e25b-42f9-9ec3-fa826f805906 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:39.525505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0bd483af-e25b-42f9-9ec3-fa826f805906 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:39.531619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bd483af-e25b-42f9-9ec3-fa826f805906 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:39.532081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bd483af-e25b-42f9-9ec3-fa826f805906 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:39.532867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bd483af-e25b-42f9-9ec3-fa826f805906 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:39.533316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bd483af-e25b-42f9-9ec3-fa826f805906 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:39.589015 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bd483af-e25b-42f9-9ec3-fa826f805906 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.067904 Nov 27 21:14:39.589579 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3352/6587] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:39 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:40.194102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:40.194804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:40.201061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.201520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.202313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.202764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.308183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:40.308885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:40.316186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.316642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.317607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.317973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.343240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:40.351343 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-141fbecb-afd9-4bdd-8fa8-ad79c8230a0c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1392 microversion: 2.1 time: 0.162065 Nov 27 21:14:40.351949 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3236/6588] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:40 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:40.449724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:40.457527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a503e8ff-efbf-4f26-96c5-dabfaa82c3c2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.153486 Nov 27 21:14:40.458107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3353/6589] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:40 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:14:40.475429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:40.476065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:40.482433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.482889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.483694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.484138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.600787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79931438-0c51-48ed-90b6-51a874f7c72d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:40.601860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-79931438-0c51-48ed-90b6-51a874f7c72d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:40.608423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79931438-0c51-48ed-90b6-51a874f7c72d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.608885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79931438-0c51-48ed-90b6-51a874f7c72d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.609679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79931438-0c51-48ed-90b6-51a874f7c72d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:40.610122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79931438-0c51-48ed-90b6-51a874f7c72d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:40.612560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:40.620723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f75b4ad-9d71-44d4-ac21-36ad3c11fd4e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.148940 Nov 27 21:14:40.621390 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3237/6590] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:40 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:40.652436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79931438-0c51-48ed-90b6-51a874f7c72d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.055205 Nov 27 21:14:40.653387 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3354/6591] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:40 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:40.720866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1807710677", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "07546b02-5ee2-4818-98ab-2b9b50e1991f"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:40.778523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] validate_networks() for [('07546b02-5ee2-4818-98ab-2b9b50e1991f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:14:41.239816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:14:41.240426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:14:41.240708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:14:41.241123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:14:41.241808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:14:41.251336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.251799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.252623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.253070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.270246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:14:41.275555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for user 43d9798c04074bc9ac45eb33bf3adb46 and project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:14:41.287843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:14:41.290191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:14:41.334699 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1737becd-3f05-4562-978a-ca1bfa293f44 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617273 Nov 27 21:14:41.335307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3238/6592] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:14:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:14:41.346043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-64a9dd13-8bb9-4cdc-a826-2ddf11bac734 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:41.346742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-64a9dd13-8bb9-4cdc-a826-2ddf11bac734 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:41.368409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:41.369021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:41.381601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.382054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.382843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.383298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.403939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-64a9dd13-8bb9-4cdc-a826-2ddf11bac734 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:41.410938 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-64a9dd13-8bb9-4cdc-a826-2ddf11bac734 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1215 microversion: 2.1 time: 0.068912 Nov 27 21:14:41.412180 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3355/6593] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:41 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:41.526366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:41.533902 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a9a37036-cf7e-4b9d-b368-5767df155338 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1564 microversion: 2.1 time: 0.169516 Nov 27 21:14:41.534485 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3239/6594] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:41 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:14:41.552020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:41.552663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:41.559455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.559916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.560702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.561903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.664142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8265b0f-2041-41fe-9d23-2fd815e2f602 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:41.665231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8265b0f-2041-41fe-9d23-2fd815e2f602 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:41.672091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8265b0f-2041-41fe-9d23-2fd815e2f602 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.672803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8265b0f-2041-41fe-9d23-2fd815e2f602 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.673459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8265b0f-2041-41fe-9d23-2fd815e2f602 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:41.674452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8265b0f-2041-41fe-9d23-2fd815e2f602 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:41.707212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:41.715718 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ffa27c02-4f90-4224-a277-5d8385e088d1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1564 microversion: 2.1 time: 0.167496 Nov 27 21:14:41.716482 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3356/6595] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:41 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:14:41.723070 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8265b0f-2041-41fe-9d23-2fd815e2f602 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.061873 Nov 27 21:14:41.723309 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3240/6596] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:41 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:42.428704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:42.430047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:42.438558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:42.439347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:42.440325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:42.440931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:42.549855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:42.558867 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb0f423c-8509-4b60-912f-a249d482799a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1273 microversion: 2.1 time: 0.133649 Nov 27 21:14:42.560063 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3357/6597] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:42 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:42.734796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b4eee203-2ea8-4d5d-904a-7ea389b67850 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:42.736738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b4eee203-2ea8-4d5d-904a-7ea389b67850 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:42.744843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4eee203-2ea8-4d5d-904a-7ea389b67850 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:42.745298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4eee203-2ea8-4d5d-904a-7ea389b67850 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:42.746279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4eee203-2ea8-4d5d-904a-7ea389b67850 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:42.746721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4eee203-2ea8-4d5d-904a-7ea389b67850 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:42.793516 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b4eee203-2ea8-4d5d-904a-7ea389b67850 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.062538 Nov 27 21:14:42.794777 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3241/6598] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:42 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:43.576183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:43.577504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:43.584487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:43.585284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:43.586294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:43.586845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:43.805819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5499c18a-a362-4430-9d1a-31639d01afc2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:43.807419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5499c18a-a362-4430-9d1a-31639d01afc2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:43.817606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5499c18a-a362-4430-9d1a-31639d01afc2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:43.818371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5499c18a-a362-4430-9d1a-31639d01afc2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:43.819758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:43.820471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5499c18a-a362-4430-9d1a-31639d01afc2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:43.821103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5499c18a-a362-4430-9d1a-31639d01afc2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:43.840980 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27ef7dd8-ce91-4d8f-9e6b-8babb88cd42f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1315 microversion: 2.1 time: 0.268928 Nov 27 21:14:43.841595 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3358/6599] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:43 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:43.859771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:43.860940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:43.868298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:43.869608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:43.870607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:43.872306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:43.891667 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5499c18a-a362-4430-9d1a-31639d01afc2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.089452 Nov 27 21:14:43.896646 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3242/6600] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:43 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:43.903819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-46798e66-c601-45ba-8ac9-0ba516faad1f req-86e7f462-cdeb-4049-b930-ccf458a8d518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:43.905612 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:43.905612 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:43.914927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-46798e66-c601-45ba-8ac9-0ba516faad1f req-86e7f462-cdeb-4049-b930-ccf458a8d518 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:43.915636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-46798e66-c601-45ba-8ac9-0ba516faad1f req-86e7f462-cdeb-4049-b930-ccf458a8d518 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:43.928266 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-46798e66-c601-45ba-8ac9-0ba516faad1f req-86e7f462-cdeb-4049-b930-ccf458a8d518 service nova] Creating event network-changed:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch2-master-1 Nov 27 21:14:43.934703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-46798e66-c601-45ba-8ac9-0ba516faad1f req-86e7f462-cdeb-4049-b930-ccf458a8d518 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036405 Nov 27 21:14:43.945124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3243/6601] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:44.136824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:44.151171 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e86669cd-4411-4436-8cd5-819b02d959c9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1564 microversion: 2.1 time: 0.308515 Nov 27 21:14:44.151821 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3359/6602] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:43 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1564 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:44.267628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0a0f891d-45d1-4e45-882c-74d1b2154f42 req-d6ea129f-34ae-46a3-acce-9cb895ee9236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0446f61-5d4c-4be1-b88b-6de72908e1ae", "tag": "87cc65d3-0cc8-424f-8e8b-25a6a7a19ede"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:44.270756 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:44.270756 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:44.314765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0a0f891d-45d1-4e45-882c-74d1b2154f42 req-d6ea129f-34ae-46a3-acce-9cb895ee9236 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:44.320439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0a0f891d-45d1-4e45-882c-74d1b2154f42 req-d6ea129f-34ae-46a3-acce-9cb895ee9236 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:44.335711 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0a0f891d-45d1-4e45-882c-74d1b2154f42 req-d6ea129f-34ae-46a3-acce-9cb895ee9236 service nova] Creating event network-changed:87cc65d3-0cc8-424f-8e8b-25a6a7a19ede for instance e0446f61-5d4c-4be1-b88b-6de72908e1ae on nch1-master-1 Nov 27 21:14:44.346406 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0a0f891d-45d1-4e45-882c-74d1b2154f42 req-d6ea129f-34ae-46a3-acce-9cb895ee9236 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096157 Nov 27 21:14:44.347660 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3244/6603] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:44.857866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:44.858479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:44.867010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:44.867787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:44.868771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:44.871437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:44.905059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49e1b12f-3cb0-4cfe-b0da-86e4f5724729 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:44.906059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49e1b12f-3cb0-4cfe-b0da-86e4f5724729 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:44.915627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49e1b12f-3cb0-4cfe-b0da-86e4f5724729 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:44.917399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49e1b12f-3cb0-4cfe-b0da-86e4f5724729 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:44.918671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49e1b12f-3cb0-4cfe-b0da-86e4f5724729 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:44.919320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49e1b12f-3cb0-4cfe-b0da-86e4f5724729 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:44.980480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49e1b12f-3cb0-4cfe-b0da-86e4f5724729 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.078451 Nov 27 21:14:44.987341 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3245/6604] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:44 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:45.069104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:45.078230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1490519b-4cab-49f6-9f86-d87023e4a408 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1315 microversion: 2.1 time: 0.223931 Nov 27 21:14:45.088716 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3360/6605] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:44 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:45.994109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fcffffd5-e0e8-4b30-ac66-897809527cbe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:45.995112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fcffffd5-e0e8-4b30-ac66-897809527cbe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:46.003797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fcffffd5-e0e8-4b30-ac66-897809527cbe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:46.006461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fcffffd5-e0e8-4b30-ac66-897809527cbe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:46.007477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fcffffd5-e0e8-4b30-ac66-897809527cbe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:46.008045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fcffffd5-e0e8-4b30-ac66-897809527cbe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:46.053433 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fcffffd5-e0e8-4b30-ac66-897809527cbe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.063540 Nov 27 21:14:46.054301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3246/6606] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:45 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:46.095961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:46.096569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:46.103192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:46.104305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:46.105082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:46.105518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:46.235792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:46.243422 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-91282eb9-79d9-4de1-9954-d2fcb4037e91 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1315 microversion: 2.1 time: 0.151142 Nov 27 21:14:46.243993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3361/6607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:46 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:47.065753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71499a67-249f-442e-90d7-d84b369cbaf1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:47.066698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71499a67-249f-442e-90d7-d84b369cbaf1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:47.074601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71499a67-249f-442e-90d7-d84b369cbaf1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:47.075057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71499a67-249f-442e-90d7-d84b369cbaf1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:47.075870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71499a67-249f-442e-90d7-d84b369cbaf1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:47.076306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71499a67-249f-442e-90d7-d84b369cbaf1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:47.120712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71499a67-249f-442e-90d7-d84b369cbaf1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.059005 Nov 27 21:14:47.121326 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3247/6608] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:47 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:47.260734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:47.261335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:47.268102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:47.268557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:47.269337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:47.269780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:47.401109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:47.408400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72d00966-400d-4d9b-a260-d7f5b5c763e2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1315 microversion: 2.1 time: 0.151951 Nov 27 21:14:47.408972 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3362/6609] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:47 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:48.132421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efffe32f-bf31-4d87-b6a0-f231cd96e249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:48.133342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efffe32f-bf31-4d87-b6a0-f231cd96e249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:48.142824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efffe32f-bf31-4d87-b6a0-f231cd96e249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:48.143293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efffe32f-bf31-4d87-b6a0-f231cd96e249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:48.144073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efffe32f-bf31-4d87-b6a0-f231cd96e249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:48.144510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efffe32f-bf31-4d87-b6a0-f231cd96e249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:48.186234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efffe32f-bf31-4d87-b6a0-f231cd96e249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.057844 Nov 27 21:14:48.186869 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3248/6610] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:48 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:48.425190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:48.425792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:48.433449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:48.433939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:48.434734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:48.435180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:48.569295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:48.576705 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-478ba1ca-01a5-4c03-9ef3-b1bfb057ae56 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1315 microversion: 2.1 time: 0.155213 Nov 27 21:14:48.577275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3363/6611] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:48 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:49.199112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8538775-cd20-443b-9a2f-0eefdae88364 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:49.200078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8538775-cd20-443b-9a2f-0eefdae88364 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:49.207417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8538775-cd20-443b-9a2f-0eefdae88364 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:49.207872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8538775-cd20-443b-9a2f-0eefdae88364 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:49.208680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8538775-cd20-443b-9a2f-0eefdae88364 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:49.209122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8538775-cd20-443b-9a2f-0eefdae88364 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:49.253536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8538775-cd20-443b-9a2f-0eefdae88364 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.058959 Nov 27 21:14:49.254182 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3249/6612] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:49 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:49.594048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:49.594659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:49.601546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:49.602002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:49.602780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:49.603923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:49.730752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:49.738060 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1001525-f653-445a-b478-cbabdd19f773 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1315 microversion: 2.1 time: 0.147735 Nov 27 21:14:49.738619 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3364/6613] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:49 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:49.945416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ff27a456-53c3-4e98-8a1e-c999b2f14fa9 req-e51a59d3-10a5-4f00-a24a-74b6f723b6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0446f61-5d4c-4be1-b88b-6de72908e1ae", "name": "network-vif-plugged", "status": "completed", "tag": "87cc65d3-0cc8-424f-8e8b-25a6a7a19ede"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:49.948047 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:49.948047 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:49.956793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ff27a456-53c3-4e98-8a1e-c999b2f14fa9 req-e51a59d3-10a5-4f00-a24a-74b6f723b6ff service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:49.957248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ff27a456-53c3-4e98-8a1e-c999b2f14fa9 req-e51a59d3-10a5-4f00-a24a-74b6f723b6ff service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:49.968973 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ff27a456-53c3-4e98-8a1e-c999b2f14fa9 req-e51a59d3-10a5-4f00-a24a-74b6f723b6ff service nova] Creating event network-vif-plugged:87cc65d3-0cc8-424f-8e8b-25a6a7a19ede for instance e0446f61-5d4c-4be1-b88b-6de72908e1ae on nch1-master-1 Nov 27 21:14:49.973737 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ff27a456-53c3-4e98-8a1e-c999b2f14fa9 req-e51a59d3-10a5-4f00-a24a-74b6f723b6ff service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Nov 27 21:14:49.974335 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3250/6614] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:14:50.265199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-784d2295-9a43-4f60-9319-78f6a75c506c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:50.266174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-784d2295-9a43-4f60-9319-78f6a75c506c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:50.272127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-784d2295-9a43-4f60-9319-78f6a75c506c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:50.272578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-784d2295-9a43-4f60-9319-78f6a75c506c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:50.273359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-784d2295-9a43-4f60-9319-78f6a75c506c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:50.273835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-784d2295-9a43-4f60-9319-78f6a75c506c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:50.390634 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-784d2295-9a43-4f60-9319-78f6a75c506c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.129111 Nov 27 21:14:50.391300 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3365/6615] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:50 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:50.756527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:50.757219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:50.763977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:50.764430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:50.765204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:50.765638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:50.897490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:50.905451 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f121312-7f11-435d-b0c5-d5520470d4c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1315 microversion: 2.1 time: 0.153883 Nov 27 21:14:50.906026 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3251/6616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:50 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:51.403173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-760ecff4-dc69-42e1-a0df-52d06f2a309e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:51.404167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-760ecff4-dc69-42e1-a0df-52d06f2a309e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:51.411511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760ecff4-dc69-42e1-a0df-52d06f2a309e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:51.411963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760ecff4-dc69-42e1-a0df-52d06f2a309e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:51.412740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760ecff4-dc69-42e1-a0df-52d06f2a309e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:51.413182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-760ecff4-dc69-42e1-a0df-52d06f2a309e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:51.453630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-760ecff4-dc69-42e1-a0df-52d06f2a309e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.055064 Nov 27 21:14:51.457897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3366/6617] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:51 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:51.922776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:51.923400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:51.929920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:51.930404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:51.931177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:51.931643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.066223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:52.074956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47dcc9e8-41b6-47c6-bc49-44d0b04dfc63 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1502 microversion: 2.1 time: 0.156141 Nov 27 21:14:52.075573 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3252/6618] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:51 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:52.091830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:52.092464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:52.099371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:52.099860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.100650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:52.101099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.233033 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.security_group_api [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Removing security group 1e19d168-ea97-4e90-ac61-2db689f0ad61 from port 87cc65d3-0cc8-424f-8e8b-25a6a7a19ede Nov 27 21:14:52.464589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebdeb9c5-5a1f-478c-bf0b-549595e6d585 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:52.465732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebdeb9c5-5a1f-478c-bf0b-549595e6d585 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:52.472117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdeb9c5-5a1f-478c-bf0b-549595e6d585 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:52.472605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdeb9c5-5a1f-478c-bf0b-549595e6d585 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.473412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdeb9c5-5a1f-478c-bf0b-549595e6d585 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:52.473854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebdeb9c5-5a1f-478c-bf0b-549595e6d585 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.519465 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebdeb9c5-5a1f-478c-bf0b-549595e6d585 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.058355 Nov 27 21:14:52.520368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3253/6619] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:52 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:52.876046 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7740b3c-a22b-4a8c-a273-8e348ff0d00d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae/action" status: 202 len: 0 microversion: 2.1 time: 0.788302 Nov 27 21:14:52.879723 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3367/6620] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:52 2021] POST /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:14:52.884345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:52.884956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:52.885212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-67240cba-3eb9-4d2d-9ae7-f281d2fdee5f req-d1d55f71-be9d-4eb0-90c8-0e93cd8c6121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0446f61-5d4c-4be1-b88b-6de72908e1ae", "tag": "87cc65d3-0cc8-424f-8e8b-25a6a7a19ede"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:52.886681 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:52.886681 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:52.892127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:52.892862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.893946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:52.894542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.898798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-67240cba-3eb9-4d2d-9ae7-f281d2fdee5f req-d1d55f71-be9d-4eb0-90c8-0e93cd8c6121 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:52.899738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-67240cba-3eb9-4d2d-9ae7-f281d2fdee5f req-d1d55f71-be9d-4eb0-90c8-0e93cd8c6121 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:52.923449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-67240cba-3eb9-4d2d-9ae7-f281d2fdee5f req-d1d55f71-be9d-4eb0-90c8-0e93cd8c6121 service nova] Creating event network-changed:87cc65d3-0cc8-424f-8e8b-25a6a7a19ede for instance e0446f61-5d4c-4be1-b88b-6de72908e1ae on nch1-master-1 Nov 27 21:14:52.928395 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-67240cba-3eb9-4d2d-9ae7-f281d2fdee5f req-d1d55f71-be9d-4eb0-90c8-0e93cd8c6121 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047136 Nov 27 21:14:52.928993 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3254/6621] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:14:52.994740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:53.002741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8de444dc-2f02-4161-a386-7cc2c5fde9de tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1460 microversion: 2.1 time: 0.121924 Nov 27 21:14:53.003378 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3368/6622] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:52 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1460 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:53.021008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:53.021706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:53.029277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.029741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.030547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.030987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.259935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:53.268359 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d8bc4bad-e6af-4ea0-acfe-5dde9a2a473f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.252292 Nov 27 21:14:53.273451 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3255/6623] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:53 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:53.287985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:53.288629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:53.294682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.295141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.295943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.296378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.429073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:53.437521 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3836a607-866c-4142-b5f7-7b4d267ee480 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.154051 Nov 27 21:14:53.438100 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3369/6624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:53 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:53.497992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-464981902", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "07546b02-5ee2-4818-98ab-2b9b50e1991f"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:53.531347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e21048c4-f166-4847-8dfd-e0507d6a8a5c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:53.532337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e21048c4-f166-4847-8dfd-e0507d6a8a5c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:53.539295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e21048c4-f166-4847-8dfd-e0507d6a8a5c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.539756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e21048c4-f166-4847-8dfd-e0507d6a8a5c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.540616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e21048c4-f166-4847-8dfd-e0507d6a8a5c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.540990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e21048c4-f166-4847-8dfd-e0507d6a8a5c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.557583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] validate_networks() for [('07546b02-5ee2-4818-98ab-2b9b50e1991f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:14:53.582063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e21048c4-f166-4847-8dfd-e0507d6a8a5c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054397 Nov 27 21:14:53.585987 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3370/6625] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:53 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:14:53.927214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:14:53.927777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:14:53.928148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:14:53.928587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:14:53.929000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:14:53.938925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.939421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.940244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:53.940690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:53.957053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:14:53.962073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Getting quotas for user 43d9798c04074bc9ac45eb33bf3adb46 and project 4c38c1fb709545fbb6279c9ee1dafe5d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:14:53.973888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:14:53.976206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:14:54.019456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8046fafa-feae-4c68-ba01-43b467bee6bd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525545 Nov 27 21:14:54.020114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3256/6626] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:14:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:14:54.030342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9cf89958-7866-431b-9625-f276a76b97d1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:54.031042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9cf89958-7866-431b-9625-f276a76b97d1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:54.091200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9cf89958-7866-431b-9625-f276a76b97d1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:54.097898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9cf89958-7866-431b-9625-f276a76b97d1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1214 microversion: 2.1 time: 0.071569 Nov 27 21:14:54.098460 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3371/6627] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:54 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:54.595436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-edd89808-408c-4d48-9a47-c6d04e7fc606 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:54.596360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-edd89808-408c-4d48-9a47-c6d04e7fc606 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:54.603438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edd89808-408c-4d48-9a47-c6d04e7fc606 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:54.603924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edd89808-408c-4d48-9a47-c6d04e7fc606 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:54.604712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edd89808-408c-4d48-9a47-c6d04e7fc606 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:54.605214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edd89808-408c-4d48-9a47-c6d04e7fc606 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:54.644560 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-edd89808-408c-4d48-9a47-c6d04e7fc606 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.053643 Nov 27 21:14:54.645434 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3257/6628] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:54 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:55.114581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:55.115203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:55.122971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:55.123487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:55.124277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:55.124724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:55.189138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:55.196598 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8cf1ea95-1edf-41ba-b663-49961422e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1272 microversion: 2.1 time: 0.085707 Nov 27 21:14:55.197178 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3372/6629] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:55 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:55.657038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-80676a30-41fb-40b2-8d7b-690a70b0a392 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:55.658052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-80676a30-41fb-40b2-8d7b-690a70b0a392 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:55.677557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80676a30-41fb-40b2-8d7b-690a70b0a392 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:55.678330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80676a30-41fb-40b2-8d7b-690a70b0a392 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:55.679399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80676a30-41fb-40b2-8d7b-690a70b0a392 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:55.680019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80676a30-41fb-40b2-8d7b-690a70b0a392 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:55.757599 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-80676a30-41fb-40b2-8d7b-690a70b0a392 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.104418 Nov 27 21:14:55.758661 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3258/6630] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:55 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:56.214797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:56.215437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:56.222275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:56.222728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:56.223612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:56.224110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:56.320794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9d614470-4bc6-4900-a7e9-790303553eee req-b663894c-cda9-40cf-be2b-48e811f64585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39761e22-d490-4fea-87d9-f679bc40025e", "tag": "79a3d451-a9af-4258-9271-6b22d95b6cb8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:56.323899 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:14:56.323899 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:14:56.338854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9d614470-4bc6-4900-a7e9-790303553eee req-b663894c-cda9-40cf-be2b-48e811f64585 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:56.339642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9d614470-4bc6-4900-a7e9-790303553eee req-b663894c-cda9-40cf-be2b-48e811f64585 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:56.356375 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9d614470-4bc6-4900-a7e9-790303553eee req-b663894c-cda9-40cf-be2b-48e811f64585 service nova] Creating event network-changed:79a3d451-a9af-4258-9271-6b22d95b6cb8 for instance 39761e22-d490-4fea-87d9-f679bc40025e on nch2-master-1 Nov 27 21:14:56.365938 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9d614470-4bc6-4900-a7e9-790303553eee req-b663894c-cda9-40cf-be2b-48e811f64585 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060336 Nov 27 21:14:56.367436 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3259/6631] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:14:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:14:56.399482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:56.408011 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a10d59eb-5781-4abb-b75b-f65fec0a61f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1314 microversion: 2.1 time: 0.197332 Nov 27 21:14:56.408880 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3373/6632] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:56 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:56.768877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-94f2601c-a4a2-48c2-ac56-2d1cdac3dcb7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:56.770499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-94f2601c-a4a2-48c2-ac56-2d1cdac3dcb7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:56.777595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f2601c-a4a2-48c2-ac56-2d1cdac3dcb7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:56.778046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f2601c-a4a2-48c2-ac56-2d1cdac3dcb7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:56.778834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f2601c-a4a2-48c2-ac56-2d1cdac3dcb7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:56.779283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-94f2601c-a4a2-48c2-ac56-2d1cdac3dcb7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:56.822416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-94f2601c-a4a2-48c2-ac56-2d1cdac3dcb7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.057516 Nov 27 21:14:56.823733 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3260/6633] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:56 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:57.425165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:57.425766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:57.432632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:57.433081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:57.433858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:57.434292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:57.562250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:57.569570 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ee063e7b-e5ed-45fb-9924-448f15a14c71 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1314 microversion: 2.1 time: 0.148090 Nov 27 21:14:57.570129 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3374/6634] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:57 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:57.836109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e34e943-5b74-43c7-9fa5-a791b8de5ee5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:57.837038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e34e943-5b74-43c7-9fa5-a791b8de5ee5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:57.844750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e34e943-5b74-43c7-9fa5-a791b8de5ee5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:57.845203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e34e943-5b74-43c7-9fa5-a791b8de5ee5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:57.845989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e34e943-5b74-43c7-9fa5-a791b8de5ee5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:57.846432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e34e943-5b74-43c7-9fa5-a791b8de5ee5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:57.887623 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e34e943-5b74-43c7-9fa5-a791b8de5ee5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.056801 Nov 27 21:14:57.888281 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3261/6635] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:57 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:58.586846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:58.587492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:58.594726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:58.595181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:58.595992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:58.596435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:58.726682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:58.734627 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c20a9e80-de00-41f2-8521-62b9210c57c3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1314 microversion: 2.1 time: 0.151510 Nov 27 21:14:58.735194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3375/6636] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:58 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:58.898924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b52a5376-9d78-4197-908c-5b83936522f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:58.899955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b52a5376-9d78-4197-908c-5b83936522f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:58.908015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b52a5376-9d78-4197-908c-5b83936522f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:58.914752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b52a5376-9d78-4197-908c-5b83936522f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:58.915582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b52a5376-9d78-4197-908c-5b83936522f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:58.916062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b52a5376-9d78-4197-908c-5b83936522f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:58.956717 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b52a5376-9d78-4197-908c-5b83936522f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.061705 Nov 27 21:14:58.957625 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3262/6637] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:58 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:14:59.751806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:14:59.752382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:59.759131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:59.759639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:59.760430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:59.760870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:59.889316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:14:59.896650 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9059ba5f-3f0e-4ab1-86a3-c723c0e8bcbe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1314 microversion: 2.1 time: 0.148653 Nov 27 21:14:59.897221 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3376/6638] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:14:59 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:14:59.968940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f058b0a4-0fb7-44b8-a614-4b99f207e446 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:14:59.969941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f058b0a4-0fb7-44b8-a614-4b99f207e446 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:14:59.977265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f058b0a4-0fb7-44b8-a614-4b99f207e446 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:59.977714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f058b0a4-0fb7-44b8-a614-4b99f207e446 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:14:59.978983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f058b0a4-0fb7-44b8-a614-4b99f207e446 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:14:59.979449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f058b0a4-0fb7-44b8-a614-4b99f207e446 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:00.020231 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f058b0a4-0fb7-44b8-a614-4b99f207e446 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.055377 Nov 27 21:15:00.020852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3263/6639] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:14:59 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:00.913147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:00.913756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:00.920488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:00.920927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:00.921701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:00.922140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:01.032375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6da8fb05-570a-4af9-9b47-21b02a88824d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:01.033543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6da8fb05-570a-4af9-9b47-21b02a88824d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:01.041296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6da8fb05-570a-4af9-9b47-21b02a88824d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:01.041905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6da8fb05-570a-4af9-9b47-21b02a88824d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:01.042772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6da8fb05-570a-4af9-9b47-21b02a88824d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:01.043213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6da8fb05-570a-4af9-9b47-21b02a88824d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:01.065030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:01.073176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-add69ef2-e1d8-44fe-afae-db76c088a445 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1314 microversion: 2.1 time: 0.163640 Nov 27 21:15:01.073766 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3377/6640] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:00 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:01.084444 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6da8fb05-570a-4af9-9b47-21b02a88824d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.056201 Nov 27 21:15:01.085102 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3264/6641] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:01 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:01.319140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-bcbcfa7f-094b-4732-88c7-4c65844a4b81 req-6fdf49bf-c799-480c-aac7-a80cbd993d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39761e22-d490-4fea-87d9-f679bc40025e", "name": "network-vif-plugged", "status": "completed", "tag": "79a3d451-a9af-4258-9271-6b22d95b6cb8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:01.320676 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:01.320676 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:15:01.328522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bcbcfa7f-094b-4732-88c7-4c65844a4b81 req-6fdf49bf-c799-480c-aac7-a80cbd993d6e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:01.328982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bcbcfa7f-094b-4732-88c7-4c65844a4b81 req-6fdf49bf-c799-480c-aac7-a80cbd993d6e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:01.340496 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-bcbcfa7f-094b-4732-88c7-4c65844a4b81 req-6fdf49bf-c799-480c-aac7-a80cbd993d6e service nova] Creating event network-vif-plugged:79a3d451-a9af-4258-9271-6b22d95b6cb8 for instance 39761e22-d490-4fea-87d9-f679bc40025e on nch2-master-1 Nov 27 21:15:01.346355 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-bcbcfa7f-094b-4732-88c7-4c65844a4b81 req-6fdf49bf-c799-480c-aac7-a80cbd993d6e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030576 Nov 27 21:15:01.346946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3378/6642] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:15:02.091280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:02.092012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:02.095865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f2d75fa1-abf2-4adc-9f09-2c97bd9b513b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:02.096867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f2d75fa1-abf2-4adc-9f09-2c97bd9b513b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:02.099541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:02.099998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:02.100795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:02.101245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:02.103717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d75fa1-abf2-4adc-9f09-2c97bd9b513b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:02.104224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d75fa1-abf2-4adc-9f09-2c97bd9b513b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:02.105006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d75fa1-abf2-4adc-9f09-2c97bd9b513b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:02.105450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2d75fa1-abf2-4adc-9f09-2c97bd9b513b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:02.145724 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f2d75fa1-abf2-4adc-9f09-2c97bd9b513b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.053672 Nov 27 21:15:02.146615 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3379/6643] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:02 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:02.237378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:02.245125 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11209092-fc00-4bdf-b52f-04f991e40865 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1314 microversion: 2.1 time: 0.158519 Nov 27 21:15:02.245705 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3265/6644] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:02 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:03.158305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b901ce91-8ae3-4f9e-9806-78a38ffa8c8e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:03.159280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b901ce91-8ae3-4f9e-9806-78a38ffa8c8e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:03.167270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b901ce91-8ae3-4f9e-9806-78a38ffa8c8e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.167740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b901ce91-8ae3-4f9e-9806-78a38ffa8c8e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.168529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b901ce91-8ae3-4f9e-9806-78a38ffa8c8e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.168973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b901ce91-8ae3-4f9e-9806-78a38ffa8c8e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.208684 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b901ce91-8ae3-4f9e-9806-78a38ffa8c8e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054412 Nov 27 21:15:03.209309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3380/6645] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:03 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:03.261831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:03.262494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:03.270173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.270622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.271430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.271902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.406680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:03.414268 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f700ccda-7151-4d63-beda-ed1be1fa2a51 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1500 microversion: 2.1 time: 0.156208 Nov 27 21:15:03.414788 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3266/6646] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:03 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:03.431508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7894ef66-4248-456d-983b-8b25083b1bf1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:03.432140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7894ef66-4248-456d-983b-8b25083b1bf1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:03.439069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7894ef66-4248-456d-983b-8b25083b1bf1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.439558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7894ef66-4248-456d-983b-8b25083b1bf1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.440343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7894ef66-4248-456d-983b-8b25083b1bf1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.440795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7894ef66-4248-456d-983b-8b25083b1bf1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.506509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7894ef66-4248-456d-983b-8b25083b1bf1 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e/action" status: 202 len: 0 microversion: 2.1 time: 0.078903 Nov 27 21:15:03.507161 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3381/6647] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:03 2021] POST /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:03.515648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:03.516262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:03.522669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.523164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.524030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:03.524466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:03.657556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:03.665616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-25dd051e-4a92-4718-bd83-de9f088fc00b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1505 microversion: 2.1 time: 0.153625 Nov 27 21:15:03.666143 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3267/6648] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:03 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:04.221733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-344b4573-fe25-4905-937b-f60f3b5efeee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:04.222722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-344b4573-fe25-4905-937b-f60f3b5efeee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:04.229368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-344b4573-fe25-4905-937b-f60f3b5efeee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:04.229815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-344b4573-fe25-4905-937b-f60f3b5efeee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:04.230578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-344b4573-fe25-4905-937b-f60f3b5efeee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:04.231010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-344b4573-fe25-4905-937b-f60f3b5efeee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:04.270891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-344b4573-fe25-4905-937b-f60f3b5efeee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.053967 Nov 27 21:15:04.271961 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3382/6649] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:04 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:04.683297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:04.683907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:04.690716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:04.691169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:04.691988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:04.692429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:04.820755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:04.828130 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7b50ad6-8f65-49b6-897d-abd1919fcd8b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1485 microversion: 2.1 time: 0.149195 Nov 27 21:15:04.828695 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3268/6650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:04 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1485 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:04.845382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:04.846007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:04.852885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:04.853341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:04.854728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:04.855169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:04.880484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lazy-loading 'flavor' on Instance uuid 39761e22-d490-4fea-87d9-f679bc40025e {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:15:05.138610 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d8fb124-019a-4bd0-977a-1020b78fc890 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e/action" status: 202 len: 0 microversion: 2.1 time: 0.297147 Nov 27 21:15:05.139239 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3383/6651] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:04 2021] POST /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:05.148190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:05.148830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:05.155706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:05.156202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:05.157154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:05.157635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:05.284066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d2f8caf-0bb3-48c2-9cc9-9b8cf9de16d5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:05.285797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d2f8caf-0bb3-48c2-9cc9-9b8cf9de16d5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:05.290521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:05.292784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d2f8caf-0bb3-48c2-9cc9-9b8cf9de16d5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:05.293255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d2f8caf-0bb3-48c2-9cc9-9b8cf9de16d5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:05.294033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d2f8caf-0bb3-48c2-9cc9-9b8cf9de16d5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:05.294474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d2f8caf-0bb3-48c2-9cc9-9b8cf9de16d5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:05.297985 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f863cc2b-a64f-4453-873c-b63fd71ee0f7 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1491 microversion: 2.1 time: 0.154584 Nov 27 21:15:05.298564 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3269/6652] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:05 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1491 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:05.334129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d2f8caf-0bb3-48c2-9cc9-9b8cf9de16d5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054960 Nov 27 21:15:05.334768 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3384/6653] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:05 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:06.315227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:06.315860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:06.322587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:06.323044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:06.323856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:06.324294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:06.346317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bd68bd9d-b8d7-4f62-871e-308867b31e23 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:06.347352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bd68bd9d-b8d7-4f62-871e-308867b31e23 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:06.355623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd68bd9d-b8d7-4f62-871e-308867b31e23 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:06.356089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd68bd9d-b8d7-4f62-871e-308867b31e23 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:06.356892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd68bd9d-b8d7-4f62-871e-308867b31e23 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:06.357339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bd68bd9d-b8d7-4f62-871e-308867b31e23 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:06.397868 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bd68bd9d-b8d7-4f62-871e-308867b31e23 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.055385 Nov 27 21:15:06.398530 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3385/6654] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:06 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:06.466700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:06.474094 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6eb20100-e408-4458-a7a5-5cf323af93fe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1491 microversion: 2.1 time: 0.162616 Nov 27 21:15:06.474696 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3270/6655] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:06 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1491 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:07.410719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f538831-3e60-48a7-b76e-a46e6130a49c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:07.411816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f538831-3e60-48a7-b76e-a46e6130a49c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:07.419962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f538831-3e60-48a7-b76e-a46e6130a49c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:07.420411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f538831-3e60-48a7-b76e-a46e6130a49c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:07.421197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f538831-3e60-48a7-b76e-a46e6130a49c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:07.421667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f538831-3e60-48a7-b76e-a46e6130a49c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:07.466091 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f538831-3e60-48a7-b76e-a46e6130a49c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.059373 Nov 27 21:15:07.470045 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3386/6656] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:07 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:07.492156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:07.492834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:07.500275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:07.500736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:07.501522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:07.502100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:07.634058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:07.641515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fadee9db-aa29-44e2-b3db-88f65d7f343e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1512 microversion: 2.1 time: 0.153955 Nov 27 21:15:07.642097 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3271/6657] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:07 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:08.478323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a1a304f-7552-43bc-b719-fe6614150fa7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:08.479401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a1a304f-7552-43bc-b719-fe6614150fa7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:08.486776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a1a304f-7552-43bc-b719-fe6614150fa7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:08.487231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a1a304f-7552-43bc-b719-fe6614150fa7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:08.488038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a1a304f-7552-43bc-b719-fe6614150fa7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:08.488481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a1a304f-7552-43bc-b719-fe6614150fa7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:08.529198 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a1a304f-7552-43bc-b719-fe6614150fa7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054868 Nov 27 21:15:08.530001 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3387/6658] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:08 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:08.659820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:08.660436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:08.667738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:08.668194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:08.668976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:08.669429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:08.802150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:08.810177 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77b59564-cb6e-4721-b1f1-239447ac50be tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1512 microversion: 2.1 time: 0.154068 Nov 27 21:15:08.810750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3272/6659] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:08 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:09.326163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0d9eabc7-fd79-4467-ae05-8664861090d8 req-41bf4cbb-bd37-4385-97d7-343ea359f328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39761e22-d490-4fea-87d9-f679bc40025e", "name": "network-vif-plugged", "status": "completed", "tag": "79a3d451-a9af-4258-9271-6b22d95b6cb8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:09.327682 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:09.327682 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:15:09.337185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0d9eabc7-fd79-4467-ae05-8664861090d8 req-41bf4cbb-bd37-4385-97d7-343ea359f328 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:09.337633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0d9eabc7-fd79-4467-ae05-8664861090d8 req-41bf4cbb-bd37-4385-97d7-343ea359f328 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:09.351653 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0d9eabc7-fd79-4467-ae05-8664861090d8 req-41bf4cbb-bd37-4385-97d7-343ea359f328 service nova] Creating event network-vif-plugged:79a3d451-a9af-4258-9271-6b22d95b6cb8 for instance 39761e22-d490-4fea-87d9-f679bc40025e on nch2-master-1 Nov 27 21:15:09.357397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0d9eabc7-fd79-4467-ae05-8664861090d8 req-41bf4cbb-bd37-4385-97d7-343ea359f328 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035213 Nov 27 21:15:09.357996 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3388/6660] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:15:09.540753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d2f0aae-37fc-42fb-a9df-e5d9a569db44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:09.541801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d2f0aae-37fc-42fb-a9df-e5d9a569db44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:09.547750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d2f0aae-37fc-42fb-a9df-e5d9a569db44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:09.548437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d2f0aae-37fc-42fb-a9df-e5d9a569db44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:09.548975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d2f0aae-37fc-42fb-a9df-e5d9a569db44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:09.549416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d2f0aae-37fc-42fb-a9df-e5d9a569db44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:09.593069 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d2f0aae-37fc-42fb-a9df-e5d9a569db44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.055863 Nov 27 21:15:09.593737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3273/6661] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:09 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:09.828400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:09.829102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:09.836063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:09.836517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:09.837296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:09.837738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:09.966378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:09.973805 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa0bca2f-2a8a-411e-9c95-9b1875ae0dfb tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1512 microversion: 2.1 time: 0.149480 Nov 27 21:15:09.974374 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3389/6662] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:09 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:10.605956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-727d29c6-ff87-4b2a-90a1-b252c5003249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:10.606949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-727d29c6-ff87-4b2a-90a1-b252c5003249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:10.614316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727d29c6-ff87-4b2a-90a1-b252c5003249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:10.614776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727d29c6-ff87-4b2a-90a1-b252c5003249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:10.615594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727d29c6-ff87-4b2a-90a1-b252c5003249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:10.616300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-727d29c6-ff87-4b2a-90a1-b252c5003249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:10.655190 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-727d29c6-ff87-4b2a-90a1-b252c5003249 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.053858 Nov 27 21:15:10.655845 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3274/6663] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:10 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:10.990117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:10.990684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:10.997855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:10.998314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:10.999101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:10.999571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:11.132425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:11.140394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb181f6a-b50d-4b52-a5e7-0d38fb336c59 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1512 microversion: 2.1 time: 0.154058 Nov 27 21:15:11.141537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3390/6664] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:10 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:11.667349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d20f5ad-0c3d-42ab-b60e-843ce4ceeb2f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:11.668593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d20f5ad-0c3d-42ab-b60e-843ce4ceeb2f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:11.676156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d20f5ad-0c3d-42ab-b60e-843ce4ceeb2f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:11.676610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d20f5ad-0c3d-42ab-b60e-843ce4ceeb2f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:11.677394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d20f5ad-0c3d-42ab-b60e-843ce4ceeb2f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:11.677876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d20f5ad-0c3d-42ab-b60e-843ce4ceeb2f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:11.732877 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d20f5ad-0c3d-42ab-b60e-843ce4ceeb2f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.068004 Nov 27 21:15:11.733614 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3275/6665] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:11 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:12.157593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:12.158635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:12.165544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:12.167044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:12.167932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:12.168464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:12.319090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:12.330455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c359705-8485-41ad-9a31-145dede7e45d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.176556 Nov 27 21:15:12.332123 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3391/6666] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:12 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:12.746360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6cf8875c-85fd-45cc-ac6f-26bb02b6380f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:12.748074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6cf8875c-85fd-45cc-ac6f-26bb02b6380f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:12.756258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cf8875c-85fd-45cc-ac6f-26bb02b6380f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:12.757036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cf8875c-85fd-45cc-ac6f-26bb02b6380f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:12.758101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cf8875c-85fd-45cc-ac6f-26bb02b6380f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:12.759125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6cf8875c-85fd-45cc-ac6f-26bb02b6380f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:12.804593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6cf8875c-85fd-45cc-ac6f-26bb02b6380f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.063053 Nov 27 21:15:12.805748 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3276/6667] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:12 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:13.349626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:13.351051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:13.358742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:13.359758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:13.360952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:13.361726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:13.497147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:13.505052 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44c3be04-5335-439e-be54-470b15a07e43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.159561 Nov 27 21:15:13.505618 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3392/6668] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:13 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:13.817503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58072c7b-caf9-4c19-b14b-fb5df4dbd639 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:13.818520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-58072c7b-caf9-4c19-b14b-fb5df4dbd639 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:13.825937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58072c7b-caf9-4c19-b14b-fb5df4dbd639 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:13.826448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58072c7b-caf9-4c19-b14b-fb5df4dbd639 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:13.827180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58072c7b-caf9-4c19-b14b-fb5df4dbd639 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:13.827744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58072c7b-caf9-4c19-b14b-fb5df4dbd639 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:13.870348 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58072c7b-caf9-4c19-b14b-fb5df4dbd639 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.056780 Nov 27 21:15:13.872592 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3277/6669] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:13 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:14.523763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:14.524584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:14.532756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:14.533193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:14.534011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:14.534450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:14.729695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:14.740769 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a77d52c6-0dc1-4a18-b04d-667b672a18e3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.221730 Nov 27 21:15:14.741806 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3393/6670] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:14 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:14.882275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f931c63b-499f-49ec-8f16-149e8b42ac32 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:14.884020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f931c63b-499f-49ec-8f16-149e8b42ac32 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:14.892386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f931c63b-499f-49ec-8f16-149e8b42ac32 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:14.893166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f931c63b-499f-49ec-8f16-149e8b42ac32 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:14.894191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f931c63b-499f-49ec-8f16-149e8b42ac32 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:14.894639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f931c63b-499f-49ec-8f16-149e8b42ac32 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:14.939756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f931c63b-499f-49ec-8f16-149e8b42ac32 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.061303 Nov 27 21:15:14.940577 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3278/6671] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:14 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:15.759067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:15.760351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:15.767013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:15.767490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:15.768279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:15.768897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:15.916343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:15.923819 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d09be31-0114-419a-82be-3cded7a91133 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.169734 Nov 27 21:15:15.924407 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3394/6672] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:15 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:15.952868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68af3576-4048-4851-91a5-227abc20da86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:15.954615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68af3576-4048-4851-91a5-227abc20da86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:15.961915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68af3576-4048-4851-91a5-227abc20da86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:15.962367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68af3576-4048-4851-91a5-227abc20da86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:15.963402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68af3576-4048-4851-91a5-227abc20da86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:15.963877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68af3576-4048-4851-91a5-227abc20da86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:16.015852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68af3576-4048-4851-91a5-227abc20da86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.067249 Nov 27 21:15:16.016798 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3279/6673] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:15 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:16.943279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:16.943279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:16.950178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:16.950899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:16.951932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:16.952372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:17.029401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-391afdc5-1da7-48aa-a857-ccd3c0ecc7ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:17.031569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-391afdc5-1da7-48aa-a857-ccd3c0ecc7ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:17.039659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-391afdc5-1da7-48aa-a857-ccd3c0ecc7ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:17.041242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-391afdc5-1da7-48aa-a857-ccd3c0ecc7ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:17.042387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-391afdc5-1da7-48aa-a857-ccd3c0ecc7ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:17.043052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-391afdc5-1da7-48aa-a857-ccd3c0ecc7ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:17.093606 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-391afdc5-1da7-48aa-a857-ccd3c0ecc7ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.068539 Nov 27 21:15:17.095042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3280/6674] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:17 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:17.103409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:17.111496 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e0537d6-4bc4-445a-8576-7b9e4e902e2b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.173761 Nov 27 21:15:17.122403 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3395/6675] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:16 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:18.106457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-224b82f8-846d-40db-b6ec-028777625db6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:18.107496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-224b82f8-846d-40db-b6ec-028777625db6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:18.116410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224b82f8-846d-40db-b6ec-028777625db6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:18.117209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224b82f8-846d-40db-b6ec-028777625db6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:18.118091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224b82f8-846d-40db-b6ec-028777625db6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:18.118621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-224b82f8-846d-40db-b6ec-028777625db6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:18.129891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:18.131319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:18.143596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:18.144747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:18.146092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:18.146736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:18.169768 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-224b82f8-846d-40db-b6ec-028777625db6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.067906 Nov 27 21:15:18.171088 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3281/6676] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:18 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:18.302229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:18.310422 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d541fa1f-b680-435c-916d-4420506dc787 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.184562 Nov 27 21:15:18.311182 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3396/6677] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:18 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:19.181846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bfa355f5-439c-4ad9-952c-5bd20f404e9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:19.183671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bfa355f5-439c-4ad9-952c-5bd20f404e9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:19.191540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfa355f5-439c-4ad9-952c-5bd20f404e9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:19.192110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfa355f5-439c-4ad9-952c-5bd20f404e9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:19.193191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfa355f5-439c-4ad9-952c-5bd20f404e9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:19.193893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfa355f5-439c-4ad9-952c-5bd20f404e9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:19.243228 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bfa355f5-439c-4ad9-952c-5bd20f404e9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.065614 Nov 27 21:15:19.243924 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3282/6678] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:19 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:19.327841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:19.328450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:19.336332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:19.337216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:19.338246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:19.338731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:19.485877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:19.499956 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b745067-bb55-4778-802c-3f5cec5aae7d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.171063 Nov 27 21:15:19.509935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3397/6679] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:19 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:19.581552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0848596b-13d9-42cc-ac4a-37096cddea86 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:19.582771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0848596b-13d9-42cc-ac4a-37096cddea86 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:19.589907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0848596b-13d9-42cc-ac4a-37096cddea86 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:19.590484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0848596b-13d9-42cc-ac4a-37096cddea86 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:19.591518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0848596b-13d9-42cc-ac4a-37096cddea86 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:19.591963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0848596b-13d9-42cc-ac4a-37096cddea86 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:19.648143 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0848596b-13d9-42cc-ac4a-37096cddea86 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action" status: 200 len: 24567 microversion: 2.1 time: 0.072822 Nov 27 21:15:19.649412 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3283/6680] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:19 2021] POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:20.255726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8eb21024-643a-4af0-a846-d19e4e76932b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:20.258288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8eb21024-643a-4af0-a846-d19e4e76932b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:20.265182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb21024-643a-4af0-a846-d19e4e76932b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:20.265639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb21024-643a-4af0-a846-d19e4e76932b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:20.266457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb21024-643a-4af0-a846-d19e4e76932b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:20.266888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8eb21024-643a-4af0-a846-d19e4e76932b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:20.320097 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8eb21024-643a-4af0-a846-d19e4e76932b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.067853 Nov 27 21:15:20.320869 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3398/6681] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:20 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:20.518556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:20.519278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:20.527154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:20.527424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:20.528277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:20.528776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:20.662422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:20.671496 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1ec2a7f-8a52-40b0-9e35-6720c93d78c4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1507 microversion: 2.1 time: 0.157181 Nov 27 21:15:20.672069 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3284/6682] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:20 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:21.332651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-82382bf4-5be4-4172-81bd-71faea08002d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:21.333650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-82382bf4-5be4-4172-81bd-71faea08002d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:21.340954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82382bf4-5be4-4172-81bd-71faea08002d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:21.341401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82382bf4-5be4-4172-81bd-71faea08002d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:21.342179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82382bf4-5be4-4172-81bd-71faea08002d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:21.342612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82382bf4-5be4-4172-81bd-71faea08002d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:21.392499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-82382bf4-5be4-4172-81bd-71faea08002d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.063571 Nov 27 21:15:21.396533 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3399/6683] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:21 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:21.688928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:21.689611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:21.695940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:21.696399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:21.697186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:21.697651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:22.227067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:22.234736 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-19d257b3-56b5-45c5-83ad-f0dfddc86ddc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1504 microversion: 2.1 time: 0.549567 Nov 27 21:15:22.235406 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3285/6684] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:21 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:22.405558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e11645a-ae65-487b-ab14-8914294d6415 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:22.406487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e11645a-ae65-487b-ab14-8914294d6415 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:22.413863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e11645a-ae65-487b-ab14-8914294d6415 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:22.414314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e11645a-ae65-487b-ab14-8914294d6415 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:22.415098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e11645a-ae65-487b-ab14-8914294d6415 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:22.415569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e11645a-ae65-487b-ab14-8914294d6415 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:22.466183 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e11645a-ae65-487b-ab14-8914294d6415 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.065256 Nov 27 21:15:22.466871 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3400/6685] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:22 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:23.252547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:23.253108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:23.260060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:23.260520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:23.261313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:23.261789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:23.395737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:23.403763 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54d4d745-abec-4957-8457-ec666d11c6ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1504 microversion: 2.1 time: 0.155155 Nov 27 21:15:23.404348 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3286/6686] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:23 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:23.478432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c775e04-e101-484b-bac6-31077f8e18ab tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:23.479586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c775e04-e101-484b-bac6-31077f8e18ab tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:23.486861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c775e04-e101-484b-bac6-31077f8e18ab tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:23.487330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c775e04-e101-484b-bac6-31077f8e18ab tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:23.488104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c775e04-e101-484b-bac6-31077f8e18ab tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:23.488539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c775e04-e101-484b-bac6-31077f8e18ab tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:23.538083 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c775e04-e101-484b-bac6-31077f8e18ab tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.063682 Nov 27 21:15:23.538758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3401/6687] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:23 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:24.421861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:24.422505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:24.429216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.429674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.430460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.430896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.550722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29a8b455-dcef-4da3-bff8-7648ce8628eb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:24.551859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29a8b455-dcef-4da3-bff8-7648ce8628eb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:24.560693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29a8b455-dcef-4da3-bff8-7648ce8628eb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.561144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29a8b455-dcef-4da3-bff8-7648ce8628eb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.561932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29a8b455-dcef-4da3-bff8-7648ce8628eb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.562365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29a8b455-dcef-4da3-bff8-7648ce8628eb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.562879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:24.570435 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78f339ee-a92d-485b-9e7b-eb9f391b8cfe tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 200 len: 1447 microversion: 2.1 time: 0.152785 Nov 27 21:15:24.571015 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3287/6688] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:24 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:24.586521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:24.587139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:24.593035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.593493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.594283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.594728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.607290 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-29a8b455-dcef-4da3-bff8-7648ce8628eb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.060691 Nov 27 21:15:24.608186 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3402/6689] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:24 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:24.724978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:24.732906 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ea40230-a84e-487e-95bb-de51fce7e992 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.149923 Nov 27 21:15:24.733513 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3288/6690] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:24 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:24.754879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:24.755602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:24.762658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.763111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.763916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.764358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.899827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:24.907740 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e003046-b640-4712-b05d-31fde9c823c8 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.156974 Nov 27 21:15:24.908311 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3403/6691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:24 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:24.925694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bdf4a231-0118-457a-bfb7-97b4d6a0a472 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:24.931599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bdf4a231-0118-457a-bfb7-97b4d6a0a472 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:24.932050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bdf4a231-0118-457a-bfb7-97b4d6a0a472 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:24.953454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bdf4a231-0118-457a-bfb7-97b4d6a0a472 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Going to try to stop instance {{(pid=135679) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 21:15:24.994924 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bdf4a231-0118-457a-bfb7-97b4d6a0a472 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.072787 Nov 27 21:15:24.995639 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3289/6692] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:24 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:25.003457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:25.004074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:25.010116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:25.010582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:25.011409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:25.011846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:25.142088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:25.149409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e5448f5-7874-4a30-bf40-c92353f692ae tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.149672 Nov 27 21:15:25.149987 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3404/6693] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:24 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:25.409729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cfd2a587-68bc-49fe-9247-df546eca9740 req-0a705a0c-5963-4002-936c-6f517a80652f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39761e22-d490-4fea-87d9-f679bc40025e", "name": "network-vif-unplugged", "status": "completed", "tag": "79a3d451-a9af-4258-9271-6b22d95b6cb8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:25.411218 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:25.411218 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:15:25.421126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cfd2a587-68bc-49fe-9247-df546eca9740 req-0a705a0c-5963-4002-936c-6f517a80652f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:25.421569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cfd2a587-68bc-49fe-9247-df546eca9740 req-0a705a0c-5963-4002-936c-6f517a80652f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:25.433793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_external_events [req-cfd2a587-68bc-49fe-9247-df546eca9740 req-0a705a0c-5963-4002-936c-6f517a80652f service nova] Unable to find a host for instance 39761e22-d490-4fea-87d9-f679bc40025e. Dropping event network-vif-unplugged {{(pid=135679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 21:15:25.434681 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cfd2a587-68bc-49fe-9247-df546eca9740 req-0a705a0c-5963-4002-936c-6f517a80652f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029227 Nov 27 21:15:25.435299 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3290/6694] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 21:15:25.618185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05eff317-c0d5-4f8f-bfba-824e0a267b9d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:25.619047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05eff317-c0d5-4f8f-bfba-824e0a267b9d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:25.625968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05eff317-c0d5-4f8f-bfba-824e0a267b9d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:25.626426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05eff317-c0d5-4f8f-bfba-824e0a267b9d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:25.627204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05eff317-c0d5-4f8f-bfba-824e0a267b9d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:25.627677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05eff317-c0d5-4f8f-bfba-824e0a267b9d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:25.667334 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05eff317-c0d5-4f8f-bfba-824e0a267b9d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.052366 Nov 27 21:15:25.667956 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3405/6695] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:25 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:26.167169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:26.167966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:26.174049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:26.174505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:26.175314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:26.175764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:26.307829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:26.315126 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc755bbc-341a-4016-b154-2dd564675976 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.151765 Nov 27 21:15:26.315747 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3291/6696] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:26 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:26.679372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6068a6c0-8c9a-4aa9-8c69-b2e1bf1a3155 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:26.680313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6068a6c0-8c9a-4aa9-8c69-b2e1bf1a3155 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:26.687738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6068a6c0-8c9a-4aa9-8c69-b2e1bf1a3155 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:26.688200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6068a6c0-8c9a-4aa9-8c69-b2e1bf1a3155 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:26.688981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6068a6c0-8c9a-4aa9-8c69-b2e1bf1a3155 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:26.689426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6068a6c0-8c9a-4aa9-8c69-b2e1bf1a3155 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:26.728690 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6068a6c0-8c9a-4aa9-8c69-b2e1bf1a3155 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.053326 Nov 27 21:15:26.729308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3406/6697] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:26 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:27.332941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:27.333554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:27.340774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:27.341221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:27.341991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:27.342425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:27.475045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:27.482585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2d819b5-0397-4993-ada1-9db45fde740b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.153360 Nov 27 21:15:27.483164 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3292/6698] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:27 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:27.741085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-706c2087-ac95-4161-91ef-a07b4f4bd8ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:27.742030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-706c2087-ac95-4161-91ef-a07b4f4bd8ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:27.749339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-706c2087-ac95-4161-91ef-a07b4f4bd8ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:27.749788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-706c2087-ac95-4161-91ef-a07b4f4bd8ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:27.750592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-706c2087-ac95-4161-91ef-a07b4f4bd8ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:27.751029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-706c2087-ac95-4161-91ef-a07b4f4bd8ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:27.793919 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-706c2087-ac95-4161-91ef-a07b4f4bd8ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.057117 Nov 27 21:15:27.794546 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3407/6699] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:27 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:28.500791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:28.501442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:28.508248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:28.508706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:28.509489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:28.509933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:28.641824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:28.649071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b62e4ff-7127-48b0-b525-44397bc2df83 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.151956 Nov 27 21:15:28.649642 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3293/6700] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:28 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:28.805994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60fdead5-b470-451b-9f42-0df21f34717c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:28.807002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60fdead5-b470-451b-9f42-0df21f34717c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:28.814282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60fdead5-b470-451b-9f42-0df21f34717c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:28.814732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60fdead5-b470-451b-9f42-0df21f34717c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:28.815533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60fdead5-b470-451b-9f42-0df21f34717c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:28.815969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60fdead5-b470-451b-9f42-0df21f34717c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:28.860061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60fdead5-b470-451b-9f42-0df21f34717c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.058043 Nov 27 21:15:28.860921 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3408/6701] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:28 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:29.667157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:29.667749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:29.674668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:29.675124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:29.675945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:29.676387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:29.802291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:29.810440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0a96e0ec-4d12-49a8-a9dd-4147101585b2 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.147658 Nov 27 21:15:29.811014 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3294/6702] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:29 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:29.872578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-846410cf-1196-40a6-87f5-cb0d2542e55a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:29.873597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-846410cf-1196-40a6-87f5-cb0d2542e55a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:29.880880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-846410cf-1196-40a6-87f5-cb0d2542e55a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:29.881334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-846410cf-1196-40a6-87f5-cb0d2542e55a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:29.882171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-846410cf-1196-40a6-87f5-cb0d2542e55a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:29.882647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-846410cf-1196-40a6-87f5-cb0d2542e55a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:29.923836 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-846410cf-1196-40a6-87f5-cb0d2542e55a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.055758 Nov 27 21:15:29.924410 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3409/6703] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:29 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:30.828178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:30.828768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:30.835561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:30.836015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:30.836790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:30.837227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:30.936481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0fb9e89-8e3f-4bb0-802a-dcfd98070ed2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:30.937468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b0fb9e89-8e3f-4bb0-802a-dcfd98070ed2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:30.944800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0fb9e89-8e3f-4bb0-802a-dcfd98070ed2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:30.945248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0fb9e89-8e3f-4bb0-802a-dcfd98070ed2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:30.946032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0fb9e89-8e3f-4bb0-802a-dcfd98070ed2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:30.946464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0fb9e89-8e3f-4bb0-802a-dcfd98070ed2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:30.970181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:30.978302 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0573b07-3e1c-4dc8-bb75-d5abeeda4738 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.153869 Nov 27 21:15:30.978876 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3295/6704] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:30 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:30.993190 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0fb9e89-8e3f-4bb0-802a-dcfd98070ed2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.061147 Nov 27 21:15:30.993846 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3410/6705] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:30 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:31.996239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:31.996839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:32.003672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:32.004123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:32.004900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:32.005338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:32.005712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86994b68-2c58-40a1-afea-187bcec09383 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:32.006731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86994b68-2c58-40a1-afea-187bcec09383 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:32.014048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86994b68-2c58-40a1-afea-187bcec09383 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:32.014510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86994b68-2c58-40a1-afea-187bcec09383 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:32.015329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86994b68-2c58-40a1-afea-187bcec09383 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:32.015783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86994b68-2c58-40a1-afea-187bcec09383 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:32.061293 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86994b68-2c58-40a1-afea-187bcec09383 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.059487 Nov 27 21:15:32.062263 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3411/6706] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:32 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:32.134252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:32.141536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a71657c2-ec9c-4978-928f-27686ca0bf05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.149570 Nov 27 21:15:32.142112 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3296/6707] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:31 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:33.073617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f470aac-aa57-4fce-90a7-42c6e5aaa67d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:33.074618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f470aac-aa57-4fce-90a7-42c6e5aaa67d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:33.081907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f470aac-aa57-4fce-90a7-42c6e5aaa67d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:33.082358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f470aac-aa57-4fce-90a7-42c6e5aaa67d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:33.083123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f470aac-aa57-4fce-90a7-42c6e5aaa67d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:33.083584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f470aac-aa57-4fce-90a7-42c6e5aaa67d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:33.123081 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f470aac-aa57-4fce-90a7-42c6e5aaa67d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.053439 Nov 27 21:15:33.123678 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3412/6708] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:33 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:33.157510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:33.158122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:33.164874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:33.165324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:33.166763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:33.167229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:33.298582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:33.305936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe1c57b6-e564-4e94-a216-67a8f8c2ef3a tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.152062 Nov 27 21:15:33.306547 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3297/6709] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:33 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:34.135818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16254238-1001-426b-be5f-b3a33159f1e2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:34.136830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16254238-1001-426b-be5f-b3a33159f1e2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:34.144246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16254238-1001-426b-be5f-b3a33159f1e2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:34.144703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16254238-1001-426b-be5f-b3a33159f1e2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:34.145483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16254238-1001-426b-be5f-b3a33159f1e2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:34.145922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16254238-1001-426b-be5f-b3a33159f1e2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:34.193333 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16254238-1001-426b-be5f-b3a33159f1e2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.062065 Nov 27 21:15:34.194144 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3413/6710] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:34 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:34.322874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:34.323531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:34.330461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:34.330947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:34.331759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:34.332202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:34.470338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:34.477943 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-514ea5fd-efb7-494e-b3f1-f3446c918ea9 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1679 microversion: 2.1 time: 0.158783 Nov 27 21:15:34.479019 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3298/6711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:34 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:35.205595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8550abfa-9c62-4e94-8ecb-3d06b1dce94f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:35.206549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8550abfa-9c62-4e94-8ecb-3d06b1dce94f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:35.214486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8550abfa-9c62-4e94-8ecb-3d06b1dce94f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:35.214937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8550abfa-9c62-4e94-8ecb-3d06b1dce94f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:35.215747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8550abfa-9c62-4e94-8ecb-3d06b1dce94f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:35.216188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8550abfa-9c62-4e94-8ecb-3d06b1dce94f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:35.258287 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8550abfa-9c62-4e94-8ecb-3d06b1dce94f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.056742 Nov 27 21:15:35.259060 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3414/6712] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:35 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:35.496289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:35.496816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:35.503562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:35.504012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:35.504784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:35.505219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:35.632107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:35.639998 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bae22013-1f06-4406-9887-8250187055cf tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1656 microversion: 2.1 time: 0.147951 Nov 27 21:15:35.640575 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3299/6713] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:35 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:35.656896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d74624fa-a8d6-40c6-a042-4c29833dea9d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:35.663902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d74624fa-a8d6-40c6-a042-4c29833dea9d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:35.664364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d74624fa-a8d6-40c6-a042-4c29833dea9d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:35.688284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d74624fa-a8d6-40c6-a042-4c29833dea9d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Going to try to start instance {{(pid=135680) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 27 21:15:35.728819 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d74624fa-a8d6-40c6-a042-4c29833dea9d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.075423 Nov 27 21:15:35.729828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3415/6714] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:35 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:35.738701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:35.739357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:35.746218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:35.746679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:35.747967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:35.748666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:35.965158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:35.972492 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c962b008-fcc2-4bc2-8d98-8bc07ea7d237 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1665 microversion: 2.1 time: 0.238491 Nov 27 21:15:35.973065 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3300/6715] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:35 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1665 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:36.271070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cb254d1d-b21d-4c04-962e-979a7960723a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:36.272216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cb254d1d-b21d-4c04-962e-979a7960723a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:36.279562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb254d1d-b21d-4c04-962e-979a7960723a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:36.280014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb254d1d-b21d-4c04-962e-979a7960723a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:36.280791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb254d1d-b21d-4c04-962e-979a7960723a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:36.281224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cb254d1d-b21d-4c04-962e-979a7960723a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:36.323538 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cb254d1d-b21d-4c04-962e-979a7960723a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.056380 Nov 27 21:15:36.327556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3416/6716] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:36 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:36.989871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:36.990462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:36.998031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:36.998492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:36.999298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:36.999748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.129078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:37.137063 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf1498df-7a46-4000-bcc4-802087384e75 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.151050 Nov 27 21:15:37.137642 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3301/6717] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:36 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:37.153771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:37.154480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:37.161481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.161940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.162724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.163172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.334998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f0a67dd-5537-4f64-b7a8-bc294d2b9d59 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:37.335977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f0a67dd-5537-4f64-b7a8-bc294d2b9d59 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:37.341847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f0a67dd-5537-4f64-b7a8-bc294d2b9d59 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.342304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f0a67dd-5537-4f64-b7a8-bc294d2b9d59 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.343081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f0a67dd-5537-4f64-b7a8-bc294d2b9d59 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.343610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f0a67dd-5537-4f64-b7a8-bc294d2b9d59 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.385795 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f0a67dd-5537-4f64-b7a8-bc294d2b9d59 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054252 Nov 27 21:15:37.386503 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3302/6718] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:37 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:37.434105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:37.441500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd155435-1851-4df9-a9b3-c936dfc149c0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.291780 Nov 27 21:15:37.442060 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3417/6719] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:37 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:37.459424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:37.460127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:37.467309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.467758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.468552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.468991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.599077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:37.607575 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-087153aa-2952-4b39-a8c8-da19b1fd30b3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.152214 Nov 27 21:15:37.608143 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3303/6720] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:37 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:37.624499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:37.625038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:37.631613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.632072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.632858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.633308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.657999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lazy-loading 'flavor' on Instance uuid ebad628d-89ef-4b2f-b8d7-dbd9df565533 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:15:37.722561 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea2664c9-d5df-4625-bf9d-dc36f3d5d072 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.101673 Nov 27 21:15:37.723236 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3418/6721] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:37 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:37.731563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:37.732183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:37.738283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.738738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.739586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:37.740066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:37.882514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:37.890035 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0fc9621-afb2-4222-8dbb-29e833f689fd tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1677 microversion: 2.1 time: 0.162633 Nov 27 21:15:37.890644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3304/6722] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:37 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:38.399794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c2c235c-85cf-4b65-8b31-7051de6b0680 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:38.400800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c2c235c-85cf-4b65-8b31-7051de6b0680 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:38.407025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c2c235c-85cf-4b65-8b31-7051de6b0680 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:38.407540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c2c235c-85cf-4b65-8b31-7051de6b0680 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:38.408333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c2c235c-85cf-4b65-8b31-7051de6b0680 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:38.408767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c2c235c-85cf-4b65-8b31-7051de6b0680 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:38.454468 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c2c235c-85cf-4b65-8b31-7051de6b0680 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.059797 Nov 27 21:15:38.455140 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3419/6723] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:38 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:38.907132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:38.907823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:38.914758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:38.915208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:38.916011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:38.916448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:39.046119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:39.053439 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a24d3ec-d6a5-43a3-8021-8dd75122843c tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1660 microversion: 2.1 time: 0.149971 Nov 27 21:15:39.054001 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3305/6724] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:38 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1660 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:39.070691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2aed7c69-4cf9-4e6e-9d28-14c863a27880 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:39.071335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2aed7c69-4cf9-4e6e-9d28-14c863a27880 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:39.078806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2aed7c69-4cf9-4e6e-9d28-14c863a27880 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:39.079268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2aed7c69-4cf9-4e6e-9d28-14c863a27880 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:39.080043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2aed7c69-4cf9-4e6e-9d28-14c863a27880 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:39.080476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2aed7c69-4cf9-4e6e-9d28-14c863a27880 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:39.147849 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2aed7c69-4cf9-4e6e-9d28-14c863a27880 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action" status: 202 len: 0 microversion: 2.1 time: 0.080836 Nov 27 21:15:39.148448 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3420/6725] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:39 2021] POST /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:39.157422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:39.158102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:39.164167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:39.164622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:39.165440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:39.166054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:39.429896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:39.438151 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b5531c7-5e97-47ab-b0aa-871d7acdb9ed tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1666 microversion: 2.1 time: 0.285397 Nov 27 21:15:39.439047 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3306/6726] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:39 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1666 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:39.467201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15e91e98-6485-4cd7-9eda-39bee4f7d818 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:39.468228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15e91e98-6485-4cd7-9eda-39bee4f7d818 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:39.474259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15e91e98-6485-4cd7-9eda-39bee4f7d818 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:39.474706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15e91e98-6485-4cd7-9eda-39bee4f7d818 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:39.475514 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15e91e98-6485-4cd7-9eda-39bee4f7d818 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:39.475953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15e91e98-6485-4cd7-9eda-39bee4f7d818 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:39.532854 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15e91e98-6485-4cd7-9eda-39bee4f7d818 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.070293 Nov 27 21:15:39.533509 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3421/6727] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:39 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:40.455002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:40.455647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:40.462270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:40.463281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:40.464084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:40.464529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:40.545211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eed42c50-5686-4462-bf11-a53b3cbafe0c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:40.546154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eed42c50-5686-4462-bf11-a53b3cbafe0c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:40.553474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed42c50-5686-4462-bf11-a53b3cbafe0c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:40.553923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed42c50-5686-4462-bf11-a53b3cbafe0c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:40.554705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed42c50-5686-4462-bf11-a53b3cbafe0c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:40.555140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed42c50-5686-4462-bf11-a53b3cbafe0c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:40.595313 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eed42c50-5686-4462-bf11-a53b3cbafe0c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054120 Nov 27 21:15:40.599315 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3422/6728] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:40 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:40.607768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:40.615069 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-421981a6-c878-42f7-be30-d98192a3a0ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1666 microversion: 2.1 time: 0.164038 Nov 27 21:15:40.615918 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3307/6729] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:40 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:41.608116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89249fcc-1663-4aa5-9a31-2c70b5ee4302 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:41.609127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89249fcc-1663-4aa5-9a31-2c70b5ee4302 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:41.616743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89249fcc-1663-4aa5-9a31-2c70b5ee4302 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.617227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89249fcc-1663-4aa5-9a31-2c70b5ee4302 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.618007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89249fcc-1663-4aa5-9a31-2c70b5ee4302 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.618448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89249fcc-1663-4aa5-9a31-2c70b5ee4302 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.632275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:41.632928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:41.639693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.640154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.640946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.641391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.660623 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89249fcc-1663-4aa5-9a31-2c70b5ee4302 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.057116 Nov 27 21:15:41.661272 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3423/6730] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:41 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:41.773675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:41.781583 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ebab9d2-384a-4746-92e4-88b561b8be79 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.153000 Nov 27 21:15:41.782164 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3308/6731] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:41 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:41.798191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:41.798897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:41.805786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.806272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.807054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.807522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.936398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:41.944236 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f3de7d5e-dccf-4ac6-b2e0-51b53f10872d tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1669 microversion: 2.1 time: 0.150092 Nov 27 21:15:41.944809 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3424/6732] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:41 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:41.961427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:41.961931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:41.968440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.968892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.969665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:41.970097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:41.994139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:15:42.000235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Working on deleting snapshot af4acb50-de47-4a10-981f-cf44bcf444d0 from shelved instance... Nov 27 21:15:42.421158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Doing local delete in cell fd0553d0-e88d-4bc7-b202-511b681a6bf5(cell1) {{(pid=135679) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 27 21:15:42.421973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:42.422428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:42.422854 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 27 21:15:42.426838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] deallocate_for_instance() {{(pid=135679) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 27 21:15:42.673186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c0ce0b7-d08d-4bef-96ec-5eb8f75b8bd0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:42.674118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c0ce0b7-d08d-4bef-96ec-5eb8f75b8bd0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:42.681677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c0ce0b7-d08d-4bef-96ec-5eb8f75b8bd0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:42.682144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c0ce0b7-d08d-4bef-96ec-5eb8f75b8bd0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:42.683515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c0ce0b7-d08d-4bef-96ec-5eb8f75b8bd0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:42.683964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1c0ce0b7-d08d-4bef-96ec-5eb8f75b8bd0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:42.723566 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c0ce0b7-d08d-4bef-96ec-5eb8f75b8bd0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054248 Nov 27 21:15:42.727658 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3425/6733] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:42 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:42.897447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1f3c1ed9-4b02-446f-8ac2-4227f8374ed2 req-1c02fa01-3528-42af-aa68-dba3064d5ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39761e22-d490-4fea-87d9-f679bc40025e", "name": "network-vif-deleted", "tag": "79a3d451-a9af-4258-9271-6b22d95b6cb8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:42.899486 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:42.899486 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:15:42.903780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Updating instance_info_cache with network_info: [] {{(pid=135679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 27 21:15:42.909015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1f3c1ed9-4b02-446f-8ac2-4227f8374ed2 req-1c02fa01-3528-42af-aa68-dba3064d5ebd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:42.909712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1f3c1ed9-4b02-446f-8ac2-4227f8374ed2 req-1c02fa01-3528-42af-aa68-dba3064d5ebd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:42.923848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.compute.server_external_events [req-1f3c1ed9-4b02-446f-8ac2-4227f8374ed2 req-1c02fa01-3528-42af-aa68-dba3064d5ebd service nova] Unable to find a host for instance 39761e22-d490-4fea-87d9-f679bc40025e. Dropping event network-vif-deleted {{(pid=135680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 21:15:42.925236 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1f3c1ed9-4b02-446f-8ac2-4227f8374ed2 req-1c02fa01-3528-42af-aa68-dba3064d5ebd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032129 Nov 27 21:15:42.926025 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3426/6734] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 27 21:15:43.211804 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3e7378e-aee9-43d0-b08b-2d37455a0350 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "DELETE /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 204 len: 0 microversion: 2.1 time: 1.253746 Nov 27 21:15:43.212302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3309/6735] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:15:41 2021] DELETE /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 0 bytes in 1255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:15:43.220638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:43.221370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 39761e22-d490-4fea-87d9-f679bc40025e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:43.227747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.228199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.228977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.229451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.243352 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] HTTP exception thrown: Instance 39761e22-d490-4fea-87d9-f679bc40025e could not be found. Nov 27 21:15:43.243934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Returning 404 to user: Instance 39761e22-d490-4fea-87d9-f679bc40025e could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:15:43.244772 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2cfabfad-7d43-46fb-a8e8-03f5888d0729 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e" status: 404 len: 111 microversion: 2.1 time: 0.027883 Nov 27 21:15:43.245297 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3427/6736] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:43 2021] GET /compute/v2.1/servers/39761e22-d490-4fea-87d9-f679bc40025e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:15:43.253197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:43.253704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:43.259723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.260179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.261466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.261909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.286445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:15:43.363667 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-894b70a6-ffb6-4ccb-b6f3-12958600b3a6 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 204 len: 0 microversion: 2.1 time: 0.113447 Nov 27 21:15:43.364247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3310/6737] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:15:43 2021] DELETE /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:15:43.373200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:43.373801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:43.380112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.380557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.381355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.381790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.466229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:43.473605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72f7f5ef-080b-4bae-8f8b-b579da0716ba tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1466 microversion: 2.1 time: 0.104217 Nov 27 21:15:43.474166 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3428/6738] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:43 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1466 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:43.735935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d203dde9-68a9-40a3-ac92-36520849a96d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:43.736982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d203dde9-68a9-40a3-ac92-36520849a96d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:43.744051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d203dde9-68a9-40a3-ac92-36520849a96d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.744510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d203dde9-68a9-40a3-ac92-36520849a96d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.745296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d203dde9-68a9-40a3-ac92-36520849a96d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:43.745739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d203dde9-68a9-40a3-ac92-36520849a96d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:43.786106 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d203dde9-68a9-40a3-ac92-36520849a96d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054151 Nov 27 21:15:43.786755 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3311/6739] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:43 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:44.491460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:44.492071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:44.498922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:44.499491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:44.500339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:44.500785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:44.586451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:44.594884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15bac9c3-5b63-4c73-873b-9435630eca05 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1466 microversion: 2.1 time: 0.107403 Nov 27 21:15:44.595480 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3429/6740] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:44 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1466 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:44.800312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-197a94ca-175f-4586-90ad-4880f01df3ac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:44.801343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-197a94ca-175f-4586-90ad-4880f01df3ac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:44.808596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197a94ca-175f-4586-90ad-4880f01df3ac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:44.809046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197a94ca-175f-4586-90ad-4880f01df3ac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:44.809818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197a94ca-175f-4586-90ad-4880f01df3ac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:44.810252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197a94ca-175f-4586-90ad-4880f01df3ac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:44.849071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-197a94ca-175f-4586-90ad-4880f01df3ac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054505 Nov 27 21:15:44.849700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3312/6741] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:44 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:45.320183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-64946960-dccf-474c-a64e-adf085e28301 req-dc034c29-f487-480f-947f-97533270b6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0446f61-5d4c-4be1-b88b-6de72908e1ae", "name": "network-vif-deleted", "tag": "87cc65d3-0cc8-424f-8e8b-25a6a7a19ede"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:45.322440 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:45.322440 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:15:45.333620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-64946960-dccf-474c-a64e-adf085e28301 req-dc034c29-f487-480f-947f-97533270b6b4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:45.334219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-64946960-dccf-474c-a64e-adf085e28301 req-dc034c29-f487-480f-947f-97533270b6b4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:45.348995 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-64946960-dccf-474c-a64e-adf085e28301 req-dc034c29-f487-480f-947f-97533270b6b4 service nova] Creating event network-vif-deleted:87cc65d3-0cc8-424f-8e8b-25a6a7a19ede for instance e0446f61-5d4c-4be1-b88b-6de72908e1ae on nch1-master-1 Nov 27 21:15:45.356024 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-64946960-dccf-474c-a64e-adf085e28301 req-dc034c29-f487-480f-947f-97533270b6b4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039465 Nov 27 21:15:45.357512 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3430/6742] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:15:45.612248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:45.612867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:45.620437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:45.620895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:45.621807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:45.622945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:45.654228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:45.654672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:45.655121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lazy-loading 'fault' on Instance uuid e0446f61-5d4c-4be1-b88b-6de72908e1ae {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:15:45.697847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:45.705338 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47698ad0-3ce0-4b0c-b7fb-f997ea7fcae4 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 200 len: 1305 microversion: 2.1 time: 0.097350 Nov 27 21:15:45.705905 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3313/6743] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:45 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:45.861621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce5b414b-eb9e-4afb-9339-b0a4b1913bac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:45.862783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce5b414b-eb9e-4afb-9339-b0a4b1913bac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:45.871123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce5b414b-eb9e-4afb-9339-b0a4b1913bac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:45.871597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce5b414b-eb9e-4afb-9339-b0a4b1913bac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:45.872883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce5b414b-eb9e-4afb-9339-b0a4b1913bac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:45.873314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce5b414b-eb9e-4afb-9339-b0a4b1913bac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:45.919658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce5b414b-eb9e-4afb-9339-b0a4b1913bac tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.063145 Nov 27 21:15:45.920497 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3431/6744] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:45 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:46.722381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:46.722955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: e0446f61-5d4c-4be1-b88b-6de72908e1ae] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:46.729622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.730079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.730859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.731334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.745358 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] HTTP exception thrown: Instance e0446f61-5d4c-4be1-b88b-6de72908e1ae could not be found. Nov 27 21:15:46.745949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Returning 404 to user: Instance e0446f61-5d4c-4be1-b88b-6de72908e1ae could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:15:46.746804 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b0a4059-1a8d-4272-b746-f5440de5f203 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae" status: 404 len: 111 microversion: 2.1 time: 0.028316 Nov 27 21:15:46.747525 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3314/6745] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:46 2021] GET /compute/v2.1/servers/e0446f61-5d4c-4be1-b88b-6de72908e1ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:15:46.755605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:46.756188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:46.763296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.763746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.764517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.764947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.790102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:15:46.867691 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28e56529-40a6-4d4c-b9e1-9963b0397eea tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "DELETE /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 204 len: 0 microversion: 2.1 time: 0.115468 Nov 27 21:15:46.868706 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3432/6746] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:15:46 2021] DELETE /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:15:46.876657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:46.877269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:46.883597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.884042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.884814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.885247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.933043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d525a0b6-e6cc-43f4-94af-b57f77d4ae12 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:46.934046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d525a0b6-e6cc-43f4-94af-b57f77d4ae12 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:46.941714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d525a0b6-e6cc-43f4-94af-b57f77d4ae12 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.942166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d525a0b6-e6cc-43f4-94af-b57f77d4ae12 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.942946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d525a0b6-e6cc-43f4-94af-b57f77d4ae12 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:46.943413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d525a0b6-e6cc-43f4-94af-b57f77d4ae12 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:46.983559 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d525a0b6-e6cc-43f4-94af-b57f77d4ae12 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.054127 Nov 27 21:15:46.984249 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3433/6747] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:46 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:15:47.017647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:47.025208 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-44aa501c-e166-461b-9de7-ced10ab0db57 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1507 microversion: 2.1 time: 0.152242 Nov 27 21:15:47.025925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3315/6748] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:46 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:47.996820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b2d5be58-927c-4d66-bf29-f01f9a715620 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:47.998380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b2d5be58-927c-4d66-bf29-f01f9a715620 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:48.005761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2d5be58-927c-4d66-bf29-f01f9a715620 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:48.006208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2d5be58-927c-4d66-bf29-f01f9a715620 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:48.006983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2d5be58-927c-4d66-bf29-f01f9a715620 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:48.007446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b2d5be58-927c-4d66-bf29-f01f9a715620 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:48.043407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:48.044043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:48.049899 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b2d5be58-927c-4d66-bf29-f01f9a715620 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 32634 microversion: 2.1 time: 0.057158 Nov 27 21:15:48.050765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3434/6749] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:47 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 32634 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:48.051713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:48.052315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:48.053165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:48.053739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:48.194197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:48.202175 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63ee5f8a-908f-43c2-a053-dcff16bd777f tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1507 microversion: 2.1 time: 0.162371 Nov 27 21:15:48.202740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3316/6750] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:48 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:49.051314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-100d5b79-2c4c-4091-b983-3d7afee440af req-3384d4bc-2065-4964-a3b4-bb1b9299d9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877ad4f6-8ac7-4a05-ae90-009106aa4152", "name": "network-vif-deleted", "tag": "d011b6d6-2042-4252-a9db-f8cef93c7678"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:49.053510 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:49.053510 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:15:49.064477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7e2bd10-d38c-474a-8af8-fda725ddcba8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:49.066125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7e2bd10-d38c-474a-8af8-fda725ddcba8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:49.066468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-100d5b79-2c4c-4091-b983-3d7afee440af req-3384d4bc-2065-4964-a3b4-bb1b9299d9ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.067133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-100d5b79-2c4c-4091-b983-3d7afee440af req-3384d4bc-2065-4964-a3b4-bb1b9299d9ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.073963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7e2bd10-d38c-474a-8af8-fda725ddcba8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.074939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7e2bd10-d38c-474a-8af8-fda725ddcba8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.076348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7e2bd10-d38c-474a-8af8-fda725ddcba8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.076788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7e2bd10-d38c-474a-8af8-fda725ddcba8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.084537 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-100d5b79-2c4c-4091-b983-3d7afee440af req-3384d4bc-2065-4964-a3b4-bb1b9299d9ab service nova] Creating event network-vif-deleted:d011b6d6-2042-4252-a9db-f8cef93c7678 for instance 877ad4f6-8ac7-4a05-ae90-009106aa4152 on nch2-master-1 Nov 27 21:15:49.092087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-100d5b79-2c4c-4091-b983-3d7afee440af req-3384d4bc-2065-4964-a3b4-bb1b9299d9ab service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045312 Nov 27 21:15:49.093789 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3435/6751] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:15:49.142591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7e2bd10-d38c-474a-8af8-fda725ddcba8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 200 len: 40791 microversion: 2.1 time: 0.084973 Nov 27 21:15:49.143769 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3317/6752] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:49 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 40791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:49.156548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9baa6fc5-5e9b-449e-a7ab-508f91f42537 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:49.157136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9baa6fc5-5e9b-449e-a7ab-508f91f42537 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:49.165193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9baa6fc5-5e9b-449e-a7ab-508f91f42537 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.165644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9baa6fc5-5e9b-449e-a7ab-508f91f42537 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.166456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9baa6fc5-5e9b-449e-a7ab-508f91f42537 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.166893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9baa6fc5-5e9b-449e-a7ab-508f91f42537 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.190781 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9baa6fc5-5e9b-449e-a7ab-508f91f42537 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/ips" status: 200 len: 145 microversion: 2.1 time: 0.038665 Nov 27 21:15:49.191380 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3436/6753] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:15:49 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:15:49.219942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:49.220590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:49.227600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.228053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.228833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.229275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.260145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:49.260598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:49.261046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lazy-loading 'fault' on Instance uuid 877ad4f6-8ac7-4a05-ae90-009106aa4152 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:15:49.301421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:49.308923 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb481008-bd2f-40d2-bcdd-5585fc66dd9e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 200 len: 1305 microversion: 2.1 time: 0.093993 Nov 27 21:15:49.309530 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3318/6754] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:49 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:50.325818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:50.326378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: 877ad4f6-8ac7-4a05-ae90-009106aa4152] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:50.333120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:50.333603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:50.334419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:50.334856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:50.351758 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] HTTP exception thrown: Instance 877ad4f6-8ac7-4a05-ae90-009106aa4152 could not be found. Nov 27 21:15:50.352359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Returning 404 to user: Instance 877ad4f6-8ac7-4a05-ae90-009106aa4152 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:15:50.353293 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f404be96-2e4a-4997-883c-915b5462cab3 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152" status: 404 len: 111 microversion: 2.1 time: 0.031376 Nov 27 21:15:50.353841 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3437/6755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:50 2021] GET /compute/v2.1/servers/877ad4f6-8ac7-4a05-ae90-009106aa4152 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:15:50.362380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:50.362974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:50.370030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:50.370515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:50.371333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:50.371806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:50.396427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:15:50.472667 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f67bd796-4c09-47b9-a36c-18042ad1a200 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 204 len: 0 microversion: 2.1 time: 0.113724 Nov 27 21:15:50.473415 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3319/6756] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:15:50 2021] DELETE /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:15:50.482175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:50.482819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:50.489179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:50.489628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:50.490412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:50.491108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:50.627114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:50.634654 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cbacbf20-1559-48f6-aae8-67945135a93e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1494 microversion: 2.1 time: 0.156688 Nov 27 21:15:50.635225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3438/6757] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:50 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:51.108122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62a70256-eb0c-4887-87f1-84cf766abe3c"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:51.109552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:51.116270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:51.116724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:51.117521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:51.117959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:51.344210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b70706f7-e04c-42d6-a8d0-d1f62cb23388 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241212 Nov 27 21:15:51.344817 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3320/6758] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:15:51 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:15:51.651983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:51.652529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:51.660015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:51.660469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:51.661243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:51.661679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:51.796978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:51.805103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ce8ca07-61e4-4bcc-a5cb-1762995bb242 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 200 len: 1494 microversion: 2.1 time: 0.156925 Nov 27 21:15:51.806335 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3439/6759] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:51 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 1494 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:52.242121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0b6c28f5-9dde-4be0-a508-d85a9a7d4640 req-9ed459bf-6efb-46d0-aba2-56298b494346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb1c8da-f09b-43a2-9846-c52c9f98a646", "name": "network-vif-deleted", "tag": "6a0db82d-42af-4626-865e-04c5b42fc108"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:52.243573 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:52.243573 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:15:52.252126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0b6c28f5-9dde-4be0-a508-d85a9a7d4640 req-9ed459bf-6efb-46d0-aba2-56298b494346 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:52.252581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0b6c28f5-9dde-4be0-a508-d85a9a7d4640 req-9ed459bf-6efb-46d0-aba2-56298b494346 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:52.264039 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0b6c28f5-9dde-4be0-a508-d85a9a7d4640 req-9ed459bf-6efb-46d0-aba2-56298b494346 service nova] Creating event network-vif-deleted:6a0db82d-42af-4626-865e-04c5b42fc108 for instance ffb1c8da-f09b-43a2-9846-c52c9f98a646 on nch2-master-1 Nov 27 21:15:52.268890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0b6c28f5-9dde-4be0-a508-d85a9a7d4640 req-9ed459bf-6efb-46d0-aba2-56298b494346 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032277 Nov 27 21:15:52.269844 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3321/6760] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:15:52.822970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:52.823608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ffb1c8da-f09b-43a2-9846-c52c9f98a646] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:52.830887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:52.831436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:52.832157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:52.832597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:52.846543 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] HTTP exception thrown: Instance ffb1c8da-f09b-43a2-9846-c52c9f98a646 could not be found. Nov 27 21:15:52.847239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Returning 404 to user: Instance ffb1c8da-f09b-43a2-9846-c52c9f98a646 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:15:52.848126 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfb2e15d-dca8-47b8-8141-e8eadef910bc tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646" status: 404 len: 111 microversion: 2.1 time: 0.028886 Nov 27 21:15:52.848640 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3440/6761] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:52 2021] GET /compute/v2.1/servers/ffb1c8da-f09b-43a2-9846-c52c9f98a646 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:15:52.857810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:52.858396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:52.864577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:52.865029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:52.866061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:52.866502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:52.893083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:15:52.962641 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ef77c76-dec6-4dc8-82ee-1f19a022ae43 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 204 len: 0 microversion: 2.1 time: 0.109051 Nov 27 21:15:52.963227 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3322/6762] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:15:52 2021] DELETE /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:15:52.971909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:52.972513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:52.978460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:52.978921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:52.979737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:52.980179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:53.116988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:53.124428 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23fb99bc-0e98-443e-b4c2-69a37bf76570 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1675 microversion: 2.1 time: 0.156250 Nov 27 21:15:53.125079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3441/6763] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:52 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:54.141993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:54.142695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:54.149548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:54.150001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:54.150782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:54.151227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:54.280548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:54.288573 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b4b53ff5-7fb4-4586-a27f-07f010c0c9ad tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1675 microversion: 2.1 time: 0.150678 Nov 27 21:15:54.289154 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3323/6764] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:54 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:54.607870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fbc148dd-0b3a-408e-a988-24310fc2581f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:54.614673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbc148dd-0b3a-408e-a988-24310fc2581f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:54.615126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbc148dd-0b3a-408e-a988-24310fc2581f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:54.637133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fbc148dd-0b3a-408e-a988-24310fc2581f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Going to try to stop instance {{(pid=135680) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 21:15:54.676982 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fbc148dd-0b3a-408e-a988-24310fc2581f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 202 len: 0 microversion: 2.1 time: 0.072669 Nov 27 21:15:54.677787 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3442/6765] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:54 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:54.686560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:54.687180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:54.693577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:54.694090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:54.694830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:54.695632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:54.832250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:54.840063 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-76df7c71-9dd4-45e8-bbbd-97019811f0e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.158297 Nov 27 21:15:54.840631 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3324/6766] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:54 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:55.306817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:55.307541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:55.314265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:55.314759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:55.315571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:55.316014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:55.448216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:55.455883 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fe538ba-61da-4d17-a2bf-0dd1687d4312 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1675 microversion: 2.1 time: 0.153132 Nov 27 21:15:55.456462 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3443/6767] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:55 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:55.856792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:55.857401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:55.864179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:55.864716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:55.865809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:55.866309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:56.063089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:56.072002 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-903052b4-3d38-450d-b5af-84b2c9484d39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.218573 Nov 27 21:15:56.072962 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3325/6768] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:55 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:56.473960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:56.474602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:56.481713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:56.482816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:56.483643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:56.484079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:56.547112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d9798c04074bc9ac45eb33bf3adb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38c1fb709545fbb6279c9ee1dafe5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:56.555221 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c6acd8b-34a2-4675-a01c-da98ad7b895e tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 200 len: 1607 microversion: 2.1 time: 0.085008 Nov 27 21:15:56.556010 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3444/6769] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:56 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:56.773097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-bcc8b3aa-ae34-48a6-b937-b184f430a101 req-e714ae29-8e7a-4a4e-8c3c-4388b7a03875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebad628d-89ef-4b2f-b8d7-dbd9df565533", "name": "network-vif-deleted", "tag": "e5bdfed0-fc9f-4b10-be5e-edcd12274506"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:56.775127 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:15:56.775127 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:15:56.784015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bcc8b3aa-ae34-48a6-b937-b184f430a101 req-e714ae29-8e7a-4a4e-8c3c-4388b7a03875 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:56.784633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bcc8b3aa-ae34-48a6-b937-b184f430a101 req-e714ae29-8e7a-4a4e-8c3c-4388b7a03875 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:56.796478 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-bcc8b3aa-ae34-48a6-b937-b184f430a101 req-e714ae29-8e7a-4a4e-8c3c-4388b7a03875 service nova] Creating event network-vif-deleted:e5bdfed0-fc9f-4b10-be5e-edcd12274506 for instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 on nch1-master-1 Nov 27 21:15:56.803244 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-bcc8b3aa-ae34-48a6-b937-b184f430a101 req-e714ae29-8e7a-4a4e-8c3c-4388b7a03875 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033388 Nov 27 21:15:56.804211 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3326/6770] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:15:57.089718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:57.090332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:57.096214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:57.096667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:57.097446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:57.097888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:57.244842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:57.254761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-48c28e9e-1b2e-44ba-89a2-b719e2060379 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.168694 Nov 27 21:15:57.255666 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3445/6771] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:57 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:57.572574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:57.573967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] [instance: ebad628d-89ef-4b2f-b8d7-dbd9df565533] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:57.582334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:57.583104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:57.584149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:57.584798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:57.599453 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] HTTP exception thrown: Instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 could not be found. Nov 27 21:15:57.599968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Returning 404 to user: Instance ebad628d-89ef-4b2f-b8d7-dbd9df565533 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:15:57.600812 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b428893f-9c6d-47dc-be2e-2691eec025a0 tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533" status: 404 len: 111 microversion: 2.1 time: 0.032205 Nov 27 21:15:57.604784 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3327/6772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:57 2021] GET /compute/v2.1/servers/ebad628d-89ef-4b2f-b8d7-dbd9df565533 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:15:57.610245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-794bed14-1a19-4c43-b926-63b111d44e7b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] Calling method '.version_select at 0x7f15c73cadc0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:57.634839 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-794bed14-1a19-4c43-b926-63b111d44e7b tempest-ServerActionsTestJSON-379595437 tempest-ServerActionsTestJSON-379595437-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344527965" status: 202 len: 0 microversion: 2.1 time: 0.028707 Nov 27 21:15:57.638580 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3446/6773] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 21:15:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344527965 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:58.272435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:58.273046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:58.279669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:58.280348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:58.281335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:58.281781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:58.399331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0c02118-0062-4466-870e-128deb850949 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:58.400206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0c02118-0062-4466-870e-128deb850949 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:58.407326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c02118-0062-4466-870e-128deb850949 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:58.407791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c02118-0062-4466-870e-128deb850949 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:58.408589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c02118-0062-4466-870e-128deb850949 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:58.409042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0c02118-0062-4466-870e-128deb850949 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:58.466152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:58.474815 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc30002b-ba21-419f-a0e7-fdd2a401a0c6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.206034 Nov 27 21:15:58.475620 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3328/6774] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:58 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:58.804908 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0c02118-0062-4466-870e-128deb850949 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1833 microversion: 2.1 time: 0.409307 Nov 27 21:15:58.806190 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3447/6775] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:58 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1833 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:58.822134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:58.822834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:58.830434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:58.831003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:58.832029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:58.832707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:58.973829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:58.981249 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31edf8ed-ebc9-4026-84e1-600d80b97c94 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1682 microversion: 2.1 time: 0.162984 Nov 27 21:15:58.981861 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3329/6776] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:58 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:15:59.073225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b1648c3-d913-4a82-b418-31a6800acea2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:59.074207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5b1648c3-d913-4a82-b418-31a6800acea2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:59.080175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1648c3-d913-4a82-b418-31a6800acea2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.080633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1648c3-d913-4a82-b418-31a6800acea2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.081422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1648c3-d913-4a82-b418-31a6800acea2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.081866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b1648c3-d913-4a82-b418-31a6800acea2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.138511 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b1648c3-d913-4a82-b418-31a6800acea2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action" status: 200 len: 32639 microversion: 2.1 time: 0.068764 Nov 27 21:15:59.142833 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3448/6777] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:59 2021] POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action => generated 32639 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:15:59.308557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:15:59.309254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:59.315229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.315709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.316487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.316927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.355798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd7f39669871844cf88f46f072f46fe15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414235e15cdd46bfad72cceefb31d6f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:59.356396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] flavor_id is None. Assuming migration. {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 27 21:15:59.356865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:15:59.492454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:59.493161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:59.502400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.503038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.503861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.504299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.647972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c495ca44-1138-4be5-ac8b-83d78f1058c9 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action" status: 202 len: 0 microversion: 2.1 time: 0.343117 Nov 27 21:15:59.649199 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3330/6778] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:15:59 2021] POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:15:59.660057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:15:59.661121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:15:59.668390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.668855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.669691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:15:59.670135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:15:59.814097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:59.824775 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-005bd91a-012d-4790-9cb1-f84ab88ed879 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.336588 Nov 27 21:15:59.835658 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3449/6779] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:59 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:15:59.862451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:15:59.870279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb7fa06a-fbe8-406b-aac6-07f64aeaede0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1691 microversion: 2.1 time: 0.216446 Nov 27 21:15:59.871185 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3331/6780] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:15:59 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1691 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:00.842354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:00.842986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:00.850546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:00.851218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:00.852253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:00.852877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:00.889462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:00.890795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:00.910073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:00.910743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:00.911787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:00.912662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:01.053798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:01.062648 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8cea38b1-9cbc-4e6a-95c3-3203b141bbe0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.224453 Nov 27 21:16:01.063237 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3450/6781] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:00 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:01.320931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:01.328960 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5c9499f-6562-46d1-9d19-02c9b321495f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1691 microversion: 2.1 time: 0.444235 Nov 27 21:16:01.329541 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3332/6782] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:00 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1691 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:02.080192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:02.080713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:02.087388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:02.087787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:02.088589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:02.089031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:02.274643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:02.284624 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a46fe501-46e5-4b8a-9ff3-98a8dce6b87f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.208183 Nov 27 21:16:02.285662 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3451/6783] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:02 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:02.346312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:02.347239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:02.354472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:02.355006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:02.355918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:02.356426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:02.524756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:02.532201 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10e5395f-b3ec-4c91-bcbf-eff00763080d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.189660 Nov 27 21:16:02.533118 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3333/6784] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:02 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:03.301601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:03.302239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:03.309175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:03.309631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:03.310421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:03.310877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:03.450654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:03.458486 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-981fe827-278e-40e7-b374-28bf75592268 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.160572 Nov 27 21:16:03.459210 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3452/6785] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:03 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:03.550018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:03.550734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:03.557608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:03.558085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:03.559045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:03.559528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:03.818093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:03.825919 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa07fc23-1d34-427a-9db2-69380e3352a2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.279443 Nov 27 21:16:03.826515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3334/6786] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:03 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:04.426523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1763399404", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "800a0b47-434e-4eaf-b649-afd860a1c0af"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:04.476307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:04.476587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:04.485008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:04.486284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:04.488071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] validate_networks() for [('800a0b47-434e-4eaf-b649-afd860a1c0af', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:16:04.490096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:04.491076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:04.622003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:04.630404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf0bf9d2-8702-476a-b0df-62f5b90b22d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1722 microversion: 2.1 time: 0.158405 Nov 27 21:16:04.630981 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3335/6787] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:04 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:04.831182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:16:04.831647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:16:04.832125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:16:04.832537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:16:04.832950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:16:04.842751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:04.843199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:04.843381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:04.843890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:04.844056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:04.844496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:04.849941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:04.850510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:04.852028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:04.852173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:04.861523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Getting quotas for project 69498babf76b4a11b6e2c434cacd824d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:16:04.866851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Getting quotas for user 71e3a17892634c79a907df7413c02684 and project 69498babf76b4a11b6e2c434cacd824d. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:16:04.878841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:16:04.881213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:16:04.925779 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8fb36141-25f9-4c3c-b4c3-f3003b94c908 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622911 Nov 27 21:16:04.931344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3453/6788] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:16:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:16:04.936046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6120316b-8f73-49ee-aa04-bae934fdae77 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:04.936735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6120316b-8f73-49ee-aa04-bae934fdae77 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:05.001962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6120316b-8f73-49ee-aa04-bae934fdae77 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:05.018077 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6120316b-8f73-49ee-aa04-bae934fdae77 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1224 microversion: 2.1 time: 0.085396 Nov 27 21:16:05.018828 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3454/6789] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:04 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:05.020793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:05.031134 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5d7f61e-01e4-45cd-8bf1-9dd0db7fa04c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.191878 Nov 27 21:16:05.032288 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3336/6790] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:04 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:05.647903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:05.648446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:05.656179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:05.656636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:05.657417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:05.657859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:05.791409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:05.799827 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d41403f2-dc9d-4cbc-8572-81d5918b5e90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1699 microversion: 2.1 time: 0.155805 Nov 27 21:16:05.800439 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3455/6791] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:05 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:05.816994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2e3d7703-f6aa-46bd-b13e-e47d073939ba tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:05.823608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e3d7703-f6aa-46bd-b13e-e47d073939ba tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:05.824065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e3d7703-f6aa-46bd-b13e-e47d073939ba tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:05.847628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2e3d7703-f6aa-46bd-b13e-e47d073939ba tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Going to try to start instance {{(pid=135679) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 27 21:16:05.890989 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2e3d7703-f6aa-46bd-b13e-e47d073939ba tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 202 len: 0 microversion: 2.1 time: 0.077495 Nov 27 21:16:05.895510 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3337/6792] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:16:05 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:16:05.900393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:05.900933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:05.915384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:05.916247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:05.917034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:05.917512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:06.035982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:06.036688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:06.042867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:06.044044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:06.045672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:06.046126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:06.065201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:06.077169 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4c3bc1e-13da-47cf-b645-0d074aa5d867 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1708 microversion: 2.1 time: 0.180178 Nov 27 21:16:06.077885 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3456/6793] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:05 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:06.082990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:06.083704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:06.089939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:06.090466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:06.091825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:06.092495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:06.132282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:06.139948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a6f70f6d-4411-4a18-8fb6-ca4306cba859 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1282 microversion: 2.1 time: 0.107942 Nov 27 21:16:06.146458 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3338/6794] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:06 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:06.230942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:06.241235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b05bb58-2942-47dd-a559-4eb45cfe316c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.162164 Nov 27 21:16:06.241818 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3457/6795] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:06 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:07.095138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:07.095806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:07.103125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:07.103606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:07.104406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:07.104840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:07.157780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:07.158631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:07.165775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:07.166226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:07.167076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:07.167575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:07.307970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:07.316369 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ae12ffb-5065-4f7d-ac94-f834e3bac26f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1324 microversion: 2.1 time: 0.163086 Nov 27 21:16:07.317046 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3458/6796] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:07 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:07.326746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:07.326746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:07.329591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:07.330119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:07.331096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:07.331756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:07.399966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:07.410962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c29d5d11-be78-4e53-ab84-a09acca08095 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1708 microversion: 2.1 time: 0.319994 Nov 27 21:16:07.411648 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3339/6797] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:07 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1708 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:07.470691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:07.478393 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5fad8aaa-6e3b-4e10-ab06-7beef84ddb82 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.160184 Nov 27 21:16:07.479095 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3459/6798] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:07 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:07.919988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a7ecf75f-cf54-4027-8c6a-8658df159f76 req-1d92e955-9a58-45c7-9810-203a39293364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29575d48-3645-484e-a126-06772c6ce6b9", "tag": "c1b48c8c-2fa9-4e62-b0d0-294f3234637c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:07.921777 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:07.921777 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:16:07.930060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a7ecf75f-cf54-4027-8c6a-8658df159f76 req-1d92e955-9a58-45c7-9810-203a39293364 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:07.930525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a7ecf75f-cf54-4027-8c6a-8658df159f76 req-1d92e955-9a58-45c7-9810-203a39293364 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:07.943074 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a7ecf75f-cf54-4027-8c6a-8658df159f76 req-1d92e955-9a58-45c7-9810-203a39293364 service nova] Creating event network-changed:c1b48c8c-2fa9-4e62-b0d0-294f3234637c for instance 29575d48-3645-484e-a126-06772c6ce6b9 on nch2-master-1 Nov 27 21:16:07.947362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a7ecf75f-cf54-4027-8c6a-8658df159f76 req-1d92e955-9a58-45c7-9810-203a39293364 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031552 Nov 27 21:16:07.947973 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3340/6799] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:16:08.334487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:08.335130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:08.342687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:08.343150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:08.343994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:08.344428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:08.435025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:08.435938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:08.447888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:08.448666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:08.449927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:08.451207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:08.496557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:08.504031 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70cdfb83-fa2d-4469-8c40-4f63a8ea34fe tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1324 microversion: 2.1 time: 0.174006 Nov 27 21:16:08.506455 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3460/6800] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:08 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1324 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:08.511161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:08.511829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:08.517880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:08.518329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:08.519103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:08.519577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:08.651855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:08.660102 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f89e0b2-8c3f-408b-aa76-4df6aa8174ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.152388 Nov 27 21:16:08.660685 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3461/6801] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:08 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:08.682232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:08.690043 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c0cf0f4-f2c1-4f18-8ab3-a114b5a2968a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1712 microversion: 2.1 time: 0.265573 Nov 27 21:16:08.690720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3341/6802] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:08 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1712 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:09.520947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:09.521559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:09.528379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:09.528829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:09.529606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:09.530041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:09.662450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:09.670386 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d42e883b-32b0-4ae4-89d5-48d6dc4fdb84 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1324 microversion: 2.1 time: 0.153310 Nov 27 21:16:09.670971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3462/6803] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:09 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:09.676036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:09.676742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:09.683392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:09.683839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:09.684647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:09.685081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:09.826579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:09.833845 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f34e391e-c1f5-4f4d-aa3c-7448d76a3e84 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.161410 Nov 27 21:16:09.834413 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3342/6804] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:09 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:10.687938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:10.688476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:10.695234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:10.695714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:10.696497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:10.696934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:10.838606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:10.845910 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5ec98ed-c7a7-4f03-b72a-ed5e3c85e8a2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1324 microversion: 2.1 time: 0.162281 Nov 27 21:16:10.847096 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3463/6805] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:10 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:10.851205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:10.852056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:10.859479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:10.859938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:10.860729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:10.861172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:10.993329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:11.001272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f4c758a-d299-4fdb-901b-597fa2a4d641 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.153822 Nov 27 21:16:11.001873 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3343/6806] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:10 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:11.863207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:11.863834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:11.870724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:11.871166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:11.872066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:11.872499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:12.002012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:12.009363 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6dab12fd-6937-4221-ba9c-cb9eae16da35 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1324 microversion: 2.1 time: 0.149896 Nov 27 21:16:12.009932 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3464/6807] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:11 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1324 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:12.018299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:12.018900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:12.025661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:12.026108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:12.026879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:12.027343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:12.165930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:12.173470 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b6d14c5-4eea-45fd-ba5d-69c2816f8ca0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.158798 Nov 27 21:16:12.174058 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3344/6808] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:12 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:13.026745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:13.027417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:13.034671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:13.035130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:13.035953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:13.036399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:13.167761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:13.175190 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef6f0349-c1e7-4583-ac5e-3b95bb9cb35e tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1324 microversion: 2.1 time: 0.152217 Nov 27 21:16:13.175803 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3465/6809] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:13 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1324 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:13.190229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:13.190834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:13.197603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:13.198050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:13.198814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:13.199244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:13.332376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:13.339603 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ec5910ae-c831-4d95-842c-d04bcaef6355 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1696 microversion: 2.1 time: 0.152974 Nov 27 21:16:13.340166 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3345/6810] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:13 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:13.741461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3d9a35ec-c566-4355-9819-d2acd2dd1174 req-c25d44ce-60c9-4420-ad65-4363e9fcc839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29575d48-3645-484e-a126-06772c6ce6b9", "name": "network-vif-plugged", "status": "completed", "tag": "c1b48c8c-2fa9-4e62-b0d0-294f3234637c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:13.743155 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:13.743155 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:16:13.750793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3d9a35ec-c566-4355-9819-d2acd2dd1174 req-c25d44ce-60c9-4420-ad65-4363e9fcc839 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:13.751240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3d9a35ec-c566-4355-9819-d2acd2dd1174 req-c25d44ce-60c9-4420-ad65-4363e9fcc839 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:13.763823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3d9a35ec-c566-4355-9819-d2acd2dd1174 req-c25d44ce-60c9-4420-ad65-4363e9fcc839 service nova] Creating event network-vif-plugged:c1b48c8c-2fa9-4e62-b0d0-294f3234637c for instance 29575d48-3645-484e-a126-06772c6ce6b9 on nch2-master-1 Nov 27 21:16:13.768769 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3d9a35ec-c566-4355-9819-d2acd2dd1174 req-c25d44ce-60c9-4420-ad65-4363e9fcc839 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031430 Nov 27 21:16:13.769614 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3466/6811] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:16:14.193661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:14.194292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:14.201707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:14.202161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:14.202949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:14.203416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:14.358566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:14.362607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:14.366230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:14.366675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:14.367485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:14.367924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:14.433851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:14.449820 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a1174b5-5806-428e-a55b-708eba5fb38f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1324 microversion: 2.1 time: 0.261000 Nov 27 21:16:14.451830 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3346/6812] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:14 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:14.515401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:14.523040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4eea4a4d-906d-46d5-a204-0af81f959057 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1695 microversion: 2.1 time: 0.169740 Nov 27 21:16:14.523643 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3467/6813] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:14 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:14.703486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e1d590f5-39ab-4d92-8343-f97f5f6106c2 req-c9ecb148-6bc5-4985-b570-f06c1b335601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "name": "network-vif-unplugged", "status": "completed", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:14.705092 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:14.705092 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:16:14.712110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e1d590f5-39ab-4d92-8343-f97f5f6106c2 req-c9ecb148-6bc5-4985-b570-f06c1b335601 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:14.712595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e1d590f5-39ab-4d92-8343-f97f5f6106c2 req-c9ecb148-6bc5-4985-b570-f06c1b335601 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:14.724305 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e1d590f5-39ab-4d92-8343-f97f5f6106c2 req-c9ecb148-6bc5-4985-b570-f06c1b335601 service nova] Creating event network-vif-unplugged:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch1-master-1 Nov 27 21:16:14.729699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-e1d590f5-39ab-4d92-8343-f97f5f6106c2 req-c9ecb148-6bc5-4985-b570-f06c1b335601 service nova] Instance 7a3ca514-a455-494c-ad10-dfd3f9404896 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:16:14.740915 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e1d590f5-39ab-4d92-8343-f97f5f6106c2 req-c9ecb148-6bc5-4985-b570-f06c1b335601 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040873 Nov 27 21:16:14.741550 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3347/6814] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:16:15.468593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:15.469268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:15.476052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:15.476507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:15.477295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:15.477741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:15.542082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:15.542774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:15.548908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:15.549359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:15.550147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:15.550581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:15.612347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:15.619936 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f0ffecb5-4544-4052-82d0-a699b5ef2f57 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1519 microversion: 2.1 time: 0.155672 Nov 27 21:16:15.620512 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3468/6815] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:15 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:15.702193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a1ce857-8f00-4b39-a70e-664053c3fca2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1959947251", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "800a0b47-434e-4eaf-b649-afd860a1c0af"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:15.704043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a1ce857-8f00-4b39-a70e-664053c3fca2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:15.704933 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a1ce857-8f00-4b39-a70e-664053c3fca2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.007327 Nov 27 21:16:15.710612 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3469/6816] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:16:15 2021] POST /compute/v2.1/servers => generated 175 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 27 21:16:15.716626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e5287b5-ebf2-41be-b11e-caea021cd677 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:15.717127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e5287b5-ebf2-41be-b11e-caea021cd677 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 372ce2e0-16f4-4462-a149-abb97181b9df] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:15.727935 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-9e5287b5-ebf2-41be-b11e-caea021cd677 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] HTTP exception thrown: Instance 372ce2e0-16f4-4462-a149-abb97181b9df could not be found. Nov 27 21:16:15.728521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e5287b5-ebf2-41be-b11e-caea021cd677 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 404 to user: Instance 372ce2e0-16f4-4462-a149-abb97181b9df could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:15.729348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e5287b5-ebf2-41be-b11e-caea021cd677 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/372ce2e0-16f4-4462-a149-abb97181b9df/metadata" status: 404 len: 111 microversion: 2.1 time: 0.017039 Nov 27 21:16:15.729901 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3470/6817] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 21:16:15 2021] GET /compute/v2.1/servers/372ce2e0-16f4-4462-a149-abb97181b9df/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:16:15.758247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:15.766622 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee6f351e-cdcf-464a-8308-49ec061eee3a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1695 microversion: 2.1 time: 0.229302 Nov 27 21:16:15.767524 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3348/6818] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:15 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1695 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:15.778038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a14c87c1-ea7c-49c1-945c-7f4192d7fe54 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1480527260", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "800a0b47-434e-4eaf-b649-afd860a1c0af"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:15.779490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a14c87c1-ea7c-49c1-945c-7f4192d7fe54 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:15.780286 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a14c87c1-ea7c-49c1-945c-7f4192d7fe54 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.006075 Nov 27 21:16:15.780808 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3471/6819] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:16:15 2021] POST /compute/v2.1/servers => generated 687 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:16:15.831363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38f50b7b-0b8f-4b06-9b71-60a060a7e903 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-490875578", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "800a0b47-434e-4eaf-b649-afd860a1c0af"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:15.832803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38f50b7b-0b8f-4b06-9b71-60a060a7e903 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:15.833637 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38f50b7b-0b8f-4b06-9b71-60a060a7e903 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.006066 Nov 27 21:16:15.839200 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3349/6820] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:16:15 2021] POST /compute/v2.1/servers => generated 689 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:16:15.878784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c568538-d8c3-4652-bd2a-81f868bc6f34 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-56499647", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "800a0b47-434e-4eaf-b649-afd860a1c0af"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:15.880256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c568538-d8c3-4652-bd2a-81f868bc6f34 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:15.881055 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c568538-d8c3-4652-bd2a-81f868bc6f34 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.006240 Nov 27 21:16:15.881683 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3472/6821] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:16:15 2021] POST /compute/v2.1/servers => generated 1197 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 27 21:16:15.925638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8c30968-94c3-4ad2-893a-93b055255054 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-811732968", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "800a0b47-434e-4eaf-b649-afd860a1c0af"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:15.927024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8c30968-94c3-4ad2-893a-93b055255054 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:15.927883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8c30968-94c3-4ad2-893a-93b055255054 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.006111 Nov 27 21:16:15.928399 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3350/6822] 10.222.0.21 () {60 vars in 1147 bytes} [Sat Nov 27 21:16:15 2021] POST /compute/v2.1/servers => generated 2221 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 27 21:16:15.938981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16bbcc4e-75af-468a-8a3f-4e1e816325d2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:15.939494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16bbcc4e-75af-468a-8a3f-4e1e816325d2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 207a42f5-a583-4190-976f-c0e8eaacc13e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:15.944807 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-16bbcc4e-75af-468a-8a3f-4e1e816325d2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] HTTP exception thrown: Instance 207a42f5-a583-4190-976f-c0e8eaacc13e could not be found. Nov 27 21:16:15.945376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16bbcc4e-75af-468a-8a3f-4e1e816325d2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 404 to user: Instance 207a42f5-a583-4190-976f-c0e8eaacc13e could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:15.946165 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16bbcc4e-75af-468a-8a3f-4e1e816325d2 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/207a42f5-a583-4190-976f-c0e8eaacc13e/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.012322 Nov 27 21:16:15.946665 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3473/6823] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 21:16:15 2021] GET /compute/v2.1/servers/207a42f5-a583-4190-976f-c0e8eaacc13e/metadata/test2 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:16:15.960734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:15.962925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:15.967266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:15.967864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:15.968644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:15.969085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:15.992697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:16:16.071620 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-172ead1c-6358-4605-8fdb-eb93cc111663 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "DELETE /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 204 len: 0 microversion: 2.1 time: 0.114669 Nov 27 21:16:16.072524 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3351/6824] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:16:15 2021] DELETE /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:16:16.081958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:16.082563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:16.088405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:16.088849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:16.089620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:16.090056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:16.218247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:16.225641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ad78f3f-e7c7-4a10-a58d-68a6ba5c852a tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1525 microversion: 2.1 time: 0.148664 Nov 27 21:16:16.226218 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3474/6825] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:16 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:16.759482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-72dd0c56-0acd-4fbb-a988-50787e9ed3c6 req-8e5b1714-00c3-4691-af60-d47937a0f215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:16.760951 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:16.760951 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:16:16.768570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-72dd0c56-0acd-4fbb-a988-50787e9ed3c6 req-8e5b1714-00c3-4691-af60-d47937a0f215 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:16.769017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-72dd0c56-0acd-4fbb-a988-50787e9ed3c6 req-8e5b1714-00c3-4691-af60-d47937a0f215 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:16.780810 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-72dd0c56-0acd-4fbb-a988-50787e9ed3c6 req-8e5b1714-00c3-4691-af60-d47937a0f215 service nova] Creating event network-changed:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch1-master-1 Nov 27 21:16:16.784753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:16.785921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:16.786070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-72dd0c56-0acd-4fbb-a988-50787e9ed3c6 req-8e5b1714-00c3-4691-af60-d47937a0f215 service nova] Instance 7a3ca514-a455-494c-ad10-dfd3f9404896 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:16:16.792284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:16.792739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:16.793595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:16.794674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:16.797331 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-72dd0c56-0acd-4fbb-a988-50787e9ed3c6 req-8e5b1714-00c3-4691-af60-d47937a0f215 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041839 Nov 27 21:16:16.798137 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3352/6826] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:16:16.939264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:16.946922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-96fa96f7-aa5f-4f92-bec1-0ee75154d221 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1693 microversion: 2.1 time: 0.165898 Nov 27 21:16:16.947524 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3475/6827] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:16 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:17.244202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:17.244932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:17.251005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:17.251558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:17.252454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:17.252845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:17.560734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3a17892634c79a907df7413c02684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69498babf76b4a11b6e2c434cacd824d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:17.568554 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6aa83d6a-1c99-41ab-bcb1-4403cc9adb6f tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 200 len: 1525 microversion: 2.1 time: 0.328843 Nov 27 21:16:17.575371 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3353/6828] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:17 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 1525 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:17.965400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:17.966082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:17.973423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:17.973928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:17.974758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:17.975397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.011755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4d323499-6896-40ed-a8c8-5526ae18d301 req-90ecdc2c-fd18-47d9-a9a5-7a4ee31e1f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29575d48-3645-484e-a126-06772c6ce6b9", "name": "network-vif-deleted", "tag": "c1b48c8c-2fa9-4e62-b0d0-294f3234637c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:18.014766 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:18.014766 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:16:18.034124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4d323499-6896-40ed-a8c8-5526ae18d301 req-90ecdc2c-fd18-47d9-a9a5-7a4ee31e1f38 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:18.037212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4d323499-6896-40ed-a8c8-5526ae18d301 req-90ecdc2c-fd18-47d9-a9a5-7a4ee31e1f38 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.056905 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4d323499-6896-40ed-a8c8-5526ae18d301 req-90ecdc2c-fd18-47d9-a9a5-7a4ee31e1f38 service nova] Creating event network-vif-deleted:c1b48c8c-2fa9-4e62-b0d0-294f3234637c for instance 29575d48-3645-484e-a126-06772c6ce6b9 on nch2-master-1 Nov 27 21:16:18.063395 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4d323499-6896-40ed-a8c8-5526ae18d301 req-90ecdc2c-fd18-47d9-a9a5-7a4ee31e1f38 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054953 Nov 27 21:16:18.064656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3354/6829] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:16:18.155414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:18.162859 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c31f14b3-4523-4ebf-b4ed-f642ceaf2f74 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1690 microversion: 2.1 time: 0.201664 Nov 27 21:16:18.163455 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3476/6830] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:17 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:18.179469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-50252b1c-a66a-49f4-9ad0-21adaf0db669 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:18.180088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-50252b1c-a66a-49f4-9ad0-21adaf0db669 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:18.186691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50252b1c-a66a-49f4-9ad0-21adaf0db669 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:18.187141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50252b1c-a66a-49f4-9ad0-21adaf0db669 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.188017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50252b1c-a66a-49f4-9ad0-21adaf0db669 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:18.188456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-50252b1c-a66a-49f4-9ad0-21adaf0db669 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.246993 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-50252b1c-a66a-49f4-9ad0-21adaf0db669 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action" status: 204 len: 0 microversion: 2.1 time: 0.070952 Nov 27 21:16:18.248229 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3355/6831] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:16:18 2021] POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:16:18.256810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:18.257416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:18.264240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:18.264740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.265636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:18.266278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.431941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:18.443112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-96b94ab2-7725-41a8-a277-b2dbc376b83b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1690 microversion: 2.1 time: 0.190312 Nov 27 21:16:18.444275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3477/6832] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:18 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:18.586353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:18.587053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] [instance: 29575d48-3645-484e-a126-06772c6ce6b9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:18.593680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:18.594216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.595016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:18.595490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:18.609747 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] HTTP exception thrown: Instance 29575d48-3645-484e-a126-06772c6ce6b9 could not be found. Nov 27 21:16:18.610376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] Returning 404 to user: Instance 29575d48-3645-484e-a126-06772c6ce6b9 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:18.611211 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-518e24d7-ad1e-4d74-95ad-7f54234ad720 tempest-ServerMetadataNegativeTestJSON-1696416399 tempest-ServerMetadataNegativeTestJSON-1696416399-project] 10.222.0.21 "GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9" status: 404 len: 111 microversion: 2.1 time: 0.028989 Nov 27 21:16:18.611796 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3356/6833] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:18 2021] GET /compute/v2.1/servers/29575d48-3645-484e-a126-06772c6ce6b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:16:19.460625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:19.461345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:19.468257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:19.468780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:19.469563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:19.470025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:19.613370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:19.628949 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-096ec071-ecea-4892-b20e-ae30dff616b5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1690 microversion: 2.1 time: 0.171854 Nov 27 21:16:19.630164 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3478/6834] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:19 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:20.401076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-59670c17-ecb2-48c6-8a4d-035db01cb985 req-e5219710-95f4-4186-948e-079a4bb50974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "name": "network-vif-plugged", "status": "completed", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:20.402618 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:20.402618 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:16:20.414627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-59670c17-ecb2-48c6-8a4d-035db01cb985 req-e5219710-95f4-4186-948e-079a4bb50974 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:20.415099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-59670c17-ecb2-48c6-8a4d-035db01cb985 req-e5219710-95f4-4186-948e-079a4bb50974 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:20.450254 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-59670c17-ecb2-48c6-8a4d-035db01cb985 req-e5219710-95f4-4186-948e-079a4bb50974 service nova] Creating event network-vif-plugged:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch1-master-1 Nov 27 21:16:20.455712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-59670c17-ecb2-48c6-8a4d-035db01cb985 req-e5219710-95f4-4186-948e-079a4bb50974 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058107 Nov 27 21:16:20.456566 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3357/6835] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:16:20.581872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-115811143", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": "none"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:20.632289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:16:20.632708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:16:20.633170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:16:20.633606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:16:20.634016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:16:20.642847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:20.643329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:20.644173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:20.644612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:20.648188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:20.648874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:20.655176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:20.655664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:20.656441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:20.656877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:20.661200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Getting quotas for project 038952e512e24ad48321d19c3748ea74. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:16:20.666478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Getting quotas for user f566d48105db4beeac8d39a5a03519a6 and project 038952e512e24ad48321d19c3748ea74. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:16:20.679746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:16:20.682095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:16:20.737647 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ed56b64-b8e9-4738-b0a9-e877d32ba18c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.289119 Nov 27 21:16:20.738636 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3479/6836] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 21:16:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 21:16:20.748871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d29a281b-41c5-409f-90fa-6621e92194b6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:20.749575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d29a281b-41c5-409f-90fa-6621e92194b6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:20.803026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:20.808133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d29a281b-41c5-409f-90fa-6621e92194b6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:20.814103 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15ace2ec-85ed-4ee5-9117-39c107f234da tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1682 microversion: 2.1 time: 0.169740 Nov 27 21:16:20.814888 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3358/6837] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:20 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:20.816462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d29a281b-41c5-409f-90fa-6621e92194b6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:20.817983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d29a281b-41c5-409f-90fa-6621e92194b6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:20.819127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d29a281b-41c5-409f-90fa-6621e92194b6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2" status: 200 len: 1277 microversion: 2.47 time: 0.074505 Nov 27 21:16:20.820020 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3480/6838] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:20 2021] GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2 => generated 1277 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:16:20.940496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1726443018", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": "none"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:20.992409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:16:20.992839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:16:20.993440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:16:20.993751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:16:20.994119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:16:21.003813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:21.004263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:21.005082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:21.005521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:21.022687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Getting quotas for project 038952e512e24ad48321d19c3748ea74. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:16:21.029483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Getting quotas for user f566d48105db4beeac8d39a5a03519a6 and project 038952e512e24ad48321d19c3748ea74. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:16:21.044037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:16:21.046374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:16:21.095139 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-44cda059-3f75-4ab2-b760-8c371660c867 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.158220 Nov 27 21:16:21.095852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3359/6839] 10.222.0.21 () {62 vars in 1187 bytes} [Sat Nov 27 21:16:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 160 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 21:16:21.107160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dea1ab04-747b-4631-97c7-df033f682319 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:21.109245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dea1ab04-747b-4631-97c7-df033f682319 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:21.162124 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dea1ab04-747b-4631-97c7-df033f682319 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "PUT /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 992 microversion: 2.47 time: 0.060124 Nov 27 21:16:21.163960 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3481/6840] 10.222.0.21 () {62 vars in 1296 bytes} [Sat Nov 27 21:16:21 2021] PUT /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 992 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:16:21.177874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f94aba7-aaa4-4c58-88cf-5394bd69b9e5 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:21.178699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f94aba7-aaa4-4c58-88cf-5394bd69b9e5 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:21.241651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9f94aba7-aaa4-4c58-88cf-5394bd69b9e5 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:21.249962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9f94aba7-aaa4-4c58-88cf-5394bd69b9e5 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:21.252522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9f94aba7-aaa4-4c58-88cf-5394bd69b9e5 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:21.254741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f94aba7-aaa4-4c58-88cf-5394bd69b9e5 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1278 microversion: 2.47 time: 0.079976 Nov 27 21:16:21.255331 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3360/6841] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:21 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:22.273830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:22.274429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:22.283614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:22.284067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:22.284846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:22.285286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:22.346089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:22.354568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:22.356804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:22.358149 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8de26ab-dab4-45e6-a564-d9009f76befb tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1336 microversion: 2.47 time: 0.088109 Nov 27 21:16:22.358831 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3482/6842] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:22 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1336 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:23.378234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:23.378849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:23.386141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:23.386591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:23.389652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:23.390088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:23.452180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:23.459942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:23.461457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:23.462583 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6006a098-0876-4221-a75c-5949ef9c6b48 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1336 microversion: 2.47 time: 0.088580 Nov 27 21:16:23.463132 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3361/6843] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:23 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1336 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:16:24.481523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:24.482137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:24.489274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:24.489736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:24.490789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:24.491232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:24.552954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:24.560847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:24.562353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:24.563497 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37531404-717b-432a-8a65-69b3a822949f tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1336 microversion: 2.47 time: 0.086001 Nov 27 21:16:24.564061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3483/6844] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:24 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1336 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:25.582918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:25.583593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:25.590547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:25.591029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:25.591847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:25.592287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:25.654159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:25.661990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:25.663522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:25.664634 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73af417b-4db1-466f-a6d9-4d9728331577 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1336 microversion: 2.47 time: 0.085706 Nov 27 21:16:25.665198 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3362/6845] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:25 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1336 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:26.684473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:26.685064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:26.691918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.692366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:26.693143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.693580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:26.757429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:26.765226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:26.766741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:26.767916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92ceaa3e-d783-469a-b686-839f9957dc1a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1357 microversion: 2.47 time: 0.087814 Nov 27 21:16:26.768473 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3484/6846] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:26 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1357 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:26.785934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:26.787412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:26.794538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.794988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:26.795791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.796231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:26.872042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:16:26.872465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:16:26.872932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:16:26.873334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:16:26.873768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:16:26.930443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:26.936970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.937418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:26.938299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.938737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:26.968641 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6adc5d5a-e407-4b14-a904-ff90ea71c097 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "POST /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8/action" status: 202 len: 1079 microversion: 2.47 time: 0.186404 Nov 27 21:16:26.969440 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3363/6847] 10.222.0.21 () {62 vars in 1318 bytes} [Sat Nov 27 21:16:26 2021] POST /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8/action => generated 1079 bytes in 188 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 27 21:16:26.984245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:26.985120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:26.991239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.991728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:26.992504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:26.992982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:27.058693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:27.066907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:27.069230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:27.070424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-321d6e65-8c10-4817-8eec-754f9f8083c2 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.090456 Nov 27 21:16:27.070982 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3485/6848] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:26 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:28.088736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:28.089353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:28.096142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:28.096595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:28.097372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:28.097810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:28.162275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:28.170556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:28.172084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:28.173232 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fb83abb5-4d3c-4317-92c2-62d03a303ece tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.088252 Nov 27 21:16:28.173849 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3364/6849] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:28 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:29.192463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:29.193048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:29.200471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:29.200918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:29.201700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:29.202139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:29.263215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:29.271044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:29.272578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:29.273730 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-026ec789-3bbf-4fbc-9e40-5adb689cd1a4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.085125 Nov 27 21:16:29.274287 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3486/6850] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:29 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:30.292494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:30.293744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:30.300428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:30.300873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:30.301986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:30.302423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:30.363237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:30.371873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:30.373623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:30.374765 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a77a37b-a826-408f-8424-a63bc913f85a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.086346 Nov 27 21:16:30.375353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3365/6851] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:30 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:31.393519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:31.394120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:31.401051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:31.401504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:31.402785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:31.403224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:31.467942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:31.475865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:31.477359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:31.478517 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5efe146-a080-4dd4-9dd5-43675e219db0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.088773 Nov 27 21:16:31.479083 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3487/6852] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:31 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:32.497796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:32.498834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:32.507211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:32.507715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:32.508549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:32.508984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:32.570612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:32.578921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:32.580436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:32.581654 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e3fb8254-09e0-4f00-91e3-311d34a57086 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087744 Nov 27 21:16:32.582210 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3366/6853] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:32 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:33.600434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:33.601043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:33.608407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:33.608861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:33.609640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:33.610081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:33.674054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:33.681864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:33.683424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:33.684572 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bbbc791e-e453-4785-b6cf-473a34aa90be tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087962 Nov 27 21:16:33.685131 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3488/6854] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:33 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:34.703934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:34.704512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:34.711204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:34.711682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:34.712469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:34.712912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:34.776510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:34.784441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:34.785929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:34.787066 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-26178c57-da39-4e51-8573-3b9b96aa980c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087597 Nov 27 21:16:34.787658 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3367/6855] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:34 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:35.805709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:35.806312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:35.813182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:35.813627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:35.814397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:35.814858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:35.877153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:35.884875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:35.886879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:35.888045 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f35100c-12dd-4beb-9bdd-87f0a274ce7d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.086098 Nov 27 21:16:35.888598 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3489/6856] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:35 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:36.906920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:36.907561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:36.914314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:36.914766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:36.915583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:36.916022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:36.979411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:36.988037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:36.989546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:36.991020 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-075774b6-c4c0-4fb1-a42e-8b48c09044b9 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.088279 Nov 27 21:16:36.991648 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3368/6857] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:36 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:38.009771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:38.010385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:38.017309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:38.017767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:38.018546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:38.018989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:38.079739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:38.087531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:38.089039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:38.090200 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b7ce9eb-87b4-4a03-929c-744e73641313 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.084177 Nov 27 21:16:38.090807 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3490/6858] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:38 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:39.108319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:39.108957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:39.115914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:39.116366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:39.117134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:39.117573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:39.178288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:39.186604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:39.188126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:39.189267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90cd4b87-56bb-4494-b1d7-e95a2b6db924 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.084661 Nov 27 21:16:39.189830 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3369/6859] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:39 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:40.209352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:40.209959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:40.217315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:40.217769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:40.218554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:40.219002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:40.282666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:40.290602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:40.292136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:40.293295 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-56dbd41a-e5a8-4208-a1b2-a89a993d8ff4 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087863 Nov 27 21:16:40.293891 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3491/6860] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:40 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:41.311572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:41.312163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:41.318803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:41.319243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:41.320035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:41.320465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:41.384798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:41.392516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:41.394031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:41.395173 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a100096e-ccb6-448f-9c3d-4a52b9054548 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087414 Nov 27 21:16:41.395855 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3370/6861] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:41 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:42.415446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:42.416051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:42.423376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:42.423845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:42.424628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:42.425068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:42.486326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:42.494694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:42.496403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:42.498188 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c6d8adb5-b5aa-46df-a1eb-55c9d81d532a tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.086648 Nov 27 21:16:42.498778 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3492/6862] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:42 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:43.481636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:43.482157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:43.488859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:43.489308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:43.490340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:43.490775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:43.517663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:43.518310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:43.526358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:43.526808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:43.527620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:43.528162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:43.566660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lazy-loading 'services' on Instance uuid 16595aec-62b0-4a81-8923-9071b7521bfe {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:16:43.594173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:43.602004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:43.603533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:43.604721 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1465812a-915d-43d2-9d7b-451f23b9a922 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.090793 Nov 27 21:16:43.605280 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3493/6863] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:43 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:16:43.634315 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ab53577-04f5-4a09-815e-fa2f1b5d0e4e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-volume_attachments/62a70256-eb0c-4887-87f1-84cf766abe3c" status: 202 len: 0 microversion: 2.1 time: 0.156247 Nov 27 21:16:43.634934 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3371/6864] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:16:43 2021] DELETE /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-volume_attachments/62a70256-eb0c-4887-87f1-84cf766abe3c => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:16:44.624355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:44.624937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:44.631741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:44.632194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:44.632975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:44.633413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:44.701500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:44.709372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:44.710949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:44.712155 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf4f770c-e378-475d-b573-8f66c8b8f6ad tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.091707 Nov 27 21:16:44.712727 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3494/6865] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:44 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:44.744284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64395254-aa49-4cf8-820d-03a982c9cc68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:44.750607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64395254-aa49-4cf8-820d-03a982c9cc68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:44.751056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64395254-aa49-4cf8-820d-03a982c9cc68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:44.772869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64395254-aa49-4cf8-820d-03a982c9cc68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Going to try to stop instance {{(pid=135679) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 21:16:44.813243 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64395254-aa49-4cf8-820d-03a982c9cc68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 202 len: 0 microversion: 2.1 time: 0.073911 Nov 27 21:16:44.813850 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3372/6866] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:16:44 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:16:44.821765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:44.822376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:44.828882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:44.829309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:44.830134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:44.830580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:44.961806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:44.969298 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0e21a7e9-351b-434c-a1a8-75137b20f15b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.151287 Nov 27 21:16:44.969866 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3495/6867] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:44 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:45.015412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e15e706-5be4-43ad-8279-e60fcd792809 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:45.016483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e15e706-5be4-43ad-8279-e60fcd792809 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:45.022650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e15e706-5be4-43ad-8279-e60fcd792809 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:45.023106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e15e706-5be4-43ad-8279-e60fcd792809 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:45.023985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e15e706-5be4-43ad-8279-e60fcd792809 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:45.024424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e15e706-5be4-43ad-8279-e60fcd792809 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:45.075023 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e15e706-5be4-43ad-8279-e60fcd792809 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action" status: 200 len: 24575 microversion: 2.1 time: 0.064128 Nov 27 21:16:45.081982 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3373/6868] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:16:45 2021] POST /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896/action => generated 24575 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:16:45.732393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:45.732952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:45.739823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:45.740531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:45.741320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:45.741763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:45.803358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:45.811278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:45.812800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:45.813964 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a892470f-01b7-4183-8238-1462d8cb32e7 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.086107 Nov 27 21:16:45.814534 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3496/6869] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:45 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:45.986936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:45.987584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:45.995096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:45.995568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:45.996345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:45.996778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:46.142993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:46.150779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a7fb6855-4d6f-4f24-9e48-8abd32a9ca0b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.167987 Nov 27 21:16:46.151372 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3374/6870] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:45 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:46.832601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:46.833230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:46.840004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:46.840456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:46.841229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:46.841664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:46.906312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:46.914059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:46.915578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:46.916719 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de663e29-23e3-4000-b5b8-19a992928555 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087921 Nov 27 21:16:46.917276 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3497/6871] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:46 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:47.169882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:47.170441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:47.177098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:47.177541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:47.178315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:47.178753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:47.307274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:47.314795 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48cd46c0-7cd2-42fe-b88d-86b8a0096f2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.149253 Nov 27 21:16:47.315400 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3375/6872] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:47 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:47.936210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:47.936806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:47.943612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:47.944064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:47.944848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:47.945288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:48.008114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:48.016528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:48.018064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:48.019218 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-324fccab-835f-4e8f-92a0-d5f4918c59cc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087396 Nov 27 21:16:48.019801 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3498/6873] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:47 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:48.331708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:48.332349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:48.339604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:48.340055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:48.340830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:48.341264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:48.477903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:48.485758 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d90333b1-eaef-4bd3-8a32-8e91f5e404de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.157680 Nov 27 21:16:48.486328 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3376/6874] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:48 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:49.037884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:49.038502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:49.045159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:49.045617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:49.046429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:49.046899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:49.108595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:49.116794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:49.118310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:49.119496 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-638d3802-ce8f-4c18-a60e-09efe0a5f72c tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.085376 Nov 27 21:16:49.120064 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3499/6875] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:49 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:49.503229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:49.503874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:49.510531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:49.510987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:49.511870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:49.512973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:49.639104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:49.646430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d3125a2-8447-4095-8d8c-7962b0ee1694 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.146927 Nov 27 21:16:49.647007 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3377/6876] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:49 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:50.138754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:50.139378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:50.146314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:50.146768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:50.147588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:50.148031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:50.211681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:50.219537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:50.221053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:50.222203 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cc296d9c-881b-4965-9d38-0052cf1c2d2d tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.087910 Nov 27 21:16:50.222762 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3500/6877] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:50 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:50.663470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:50.664110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:50.673340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:50.673832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:50.674630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:50.675066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:50.801681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:50.809614 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-155c4b4b-7dfb-43e6-aca7-a28346b36c93 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.149245 Nov 27 21:16:50.810239 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3378/6878] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:50 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:51.241160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:51.241788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:51.247372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-202b4aba-92ec-42cd-98c8-751bed761dd6 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:51.247986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-202b4aba-92ec-42cd-98c8-751bed761dd6 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:51.248482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:51.248934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:51.249717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:51.250155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:51.253806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-202b4aba-92ec-42cd-98c8-751bed761dd6 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:51.254256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-202b4aba-92ec-42cd-98c8-751bed761dd6 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:51.255034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-202b4aba-92ec-42cd-98c8-751bed761dd6 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:51.255500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-202b4aba-92ec-42cd-98c8-751bed761dd6 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:51.312768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:51.320633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:51.322136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:51.323328 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a96e0b11-328b-4e76-b65c-cf1d86e535aa tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.086289 Nov 27 21:16:51.324103 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3501/6879] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:51 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:51.384486 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-202b4aba-92ec-42cd-98c8-751bed761dd6 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1833 microversion: 2.1 time: 0.140730 Nov 27 21:16:51.385056 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3379/6880] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:51 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1833 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:16:51.826376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:51.827022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:51.833126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:51.833582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:51.834368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:51.834813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:51.974021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:51.982898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f70b199-b381-4990-916e-f9c623395d0f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.160784 Nov 27 21:16:51.983509 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3502/6881] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:51 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:52.252218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:52.253413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:52.254772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-23359331-789c-4218-b7d7-75a9ee354e7e req-2b6648db-d3e1-4405-b39b-1202279e5733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:52.256553 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:52.256553 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:16:52.260072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:52.260521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:52.261297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:52.261799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:52.264751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-23359331-789c-4218-b7d7-75a9ee354e7e req-2b6648db-d3e1-4405-b39b-1202279e5733 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:52.274258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-23359331-789c-4218-b7d7-75a9ee354e7e req-2b6648db-d3e1-4405-b39b-1202279e5733 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:52.287696 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-23359331-789c-4218-b7d7-75a9ee354e7e req-2b6648db-d3e1-4405-b39b-1202279e5733 service nova] Creating event network-changed:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch1-master-1 Nov 27 21:16:52.290643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:16:52.308132 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-23359331-789c-4218-b7d7-75a9ee354e7e req-2b6648db-d3e1-4405-b39b-1202279e5733 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057151 Nov 27 21:16:52.308804 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3503/6882] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:16:52.352202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:52.353194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:52.379876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:52.380245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:52.381082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:52.381539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:52.391565 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-09145f79-773d-4fed-ac13-73fb3d308c33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 204 len: 0 microversion: 2.1 time: 0.142564 Nov 27 21:16:52.392312 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3380/6883] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:16:52 2021] DELETE /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:16:52.404992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:52.405947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:52.413157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:52.413699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:52.414660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:52.415175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:52.462078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:52.470335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:52.471989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:52.473231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1248aeb-ede9-48cf-8c64-899d64200ebc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.134375 Nov 27 21:16:52.473717 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3504/6884] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:52 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:16:52.669642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:52.677105 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7280f22c-d255-4e8f-8e61-215ded5cb940 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1688 microversion: 2.1 time: 0.279745 Nov 27 21:16:52.687280 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3381/6885] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:52 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1688 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:53.001400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:53.002007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:53.008093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:53.008786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:53.009716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:53.010030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:53.145109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:53.153640 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-663d8b23-1b1a-4214-9304-14933ead929c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.155882 Nov 27 21:16:53.154225 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3505/6886] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:52 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:53.493094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:53.493831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:53.500883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:53.501360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:53.502131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:53.502564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:53.567596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:53.575804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:53.577283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:53.578414 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5a7f0c37-67ae-49e2-a14f-b867e6d6b4e6 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1366 microversion: 2.47 time: 0.089637 Nov 27 21:16:53.578976 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3382/6887] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:53 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:53.696086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:53.697033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:53.704270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:53.704817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:53.705661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:53.706177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:53.845988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:53.853381 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6932ffb1-ed30-499b-a5b1-e76f64cb93ed tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1570 microversion: 2.1 time: 0.161038 Nov 27 21:16:53.853954 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3506/6888] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:53 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:54.170217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:54.170825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:54.176740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.177189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.177996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.178491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.367416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:54.381329 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad40c14e-c506-4b51-b7c8-b9b863ca5c29 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1676 microversion: 2.1 time: 0.214684 Nov 27 21:16:54.382112 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3383/6889] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:54 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:54.460867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9e1b7f3c-555c-4105-b39b-87297c803049 req-e75fbd5e-5c13-41a7-9a54-b5ce8c629247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a3ca514-a455-494c-ad10-dfd3f9404896", "name": "network-vif-deleted", "tag": "96518edd-82d2-476c-a100-d0051b6efd10"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:54.462486 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:54.462486 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:16:54.469640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9e1b7f3c-555c-4105-b39b-87297c803049 req-e75fbd5e-5c13-41a7-9a54-b5ce8c629247 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.470129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9e1b7f3c-555c-4105-b39b-87297c803049 req-e75fbd5e-5c13-41a7-9a54-b5ce8c629247 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.481595 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9e1b7f3c-555c-4105-b39b-87297c803049 req-e75fbd5e-5c13-41a7-9a54-b5ce8c629247 service nova] Creating event network-vif-deleted:96518edd-82d2-476c-a100-d0051b6efd10 for instance 7a3ca514-a455-494c-ad10-dfd3f9404896 on nch1-master-1 Nov 27 21:16:54.487008 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9e1b7f3c-555c-4105-b39b-87297c803049 req-e75fbd5e-5c13-41a7-9a54-b5ce8c629247 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029869 Nov 27 21:16:54.487648 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3507/6890] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:16:54.597003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:54.597575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:54.604207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.604654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.605967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.608393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.675014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:54.682684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:54.684253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:54.685384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-01001c29-2659-4262-a4e5-8e25273d9242 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1372 microversion: 2.47 time: 0.092167 Nov 27 21:16:54.685937 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3384/6891] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:54 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:54.870151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:54.870843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:54.880138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.880806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.881793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.882300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.917854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:54.918852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:54.919369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lazy-loading 'fault' on Instance uuid 7a3ca514-a455-494c-ad10-dfd3f9404896 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:16:54.960312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:54.968256 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c5a8802-94aa-4361-8f8e-4fcc030d0316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 200 len: 1356 microversion: 2.1 time: 0.101947 Nov 27 21:16:54.968831 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3508/6892] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:54 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:55.398121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:55.398728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:55.404847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.405304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.406084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.406525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.534096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:55.541335 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13c32913-093e-4cc6-9987-952c34df15d8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1653 microversion: 2.1 time: 0.146888 Nov 27 21:16:55.541914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3385/6893] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:55 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:55.557413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80ebcc0c-c1bd-417e-a9eb-b17d11ffe777 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:16:55.563889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80ebcc0c-c1bd-417e-a9eb-b17d11ffe777 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.564345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80ebcc0c-c1bd-417e-a9eb-b17d11ffe777 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.586526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80ebcc0c-c1bd-417e-a9eb-b17d11ffe777 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Going to try to start instance {{(pid=135680) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 27 21:16:55.626741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80ebcc0c-c1bd-417e-a9eb-b17d11ffe777 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action" status: 202 len: 0 microversion: 2.1 time: 0.072891 Nov 27 21:16:55.630243 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3509/6894] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:16:55 2021] POST /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:16:55.635264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:55.636461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:55.643761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.644263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.645152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.645703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.705740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:55.706725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:55.712751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.713204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.713991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.714435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.779894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:55.787858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:55.789362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:55.790536 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-046c7c6a-968b-4c3c-ba36-84cc524c5296 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1372 microversion: 2.47 time: 0.089152 Nov 27 21:16:55.791205 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3510/6895] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:55 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 21:16:55.861935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:55.869544 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62022305-5c7f-4be3-b4bd-160a047c08ef tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1662 microversion: 2.1 time: 0.238010 Nov 27 21:16:55.870119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3386/6896] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:55 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1662 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:55.985263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:55.985860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 7a3ca514-a455-494c-ad10-dfd3f9404896] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:55.992912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.993363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:55.994158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:55.994582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:56.008497 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] HTTP exception thrown: Instance 7a3ca514-a455-494c-ad10-dfd3f9404896 could not be found. Nov 27 21:16:56.009084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Returning 404 to user: Instance 7a3ca514-a455-494c-ad10-dfd3f9404896 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:16:56.009911 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-757026ec-edab-4f74-b7c0-adb4291300ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896" status: 404 len: 111 microversion: 2.1 time: 0.028453 Nov 27 21:16:56.010597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3511/6897] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:55 2021] GET /compute/v2.1/servers/7a3ca514-a455-494c-ad10-dfd3f9404896 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:16:56.810278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:56.810893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:56.819153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:56.820147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:56.821211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:56.821925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:56.887872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:56.888488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:56.896270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:56.896717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:56.900010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:56.900472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:56.901478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:56.912380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:56.914725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:56.916172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0457dc8-75fa-488b-9bec-c36805755338 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1372 microversion: 2.47 time: 0.110219 Nov 27 21:16:56.927466 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3387/6898] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:56 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:57.277021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:57.286082 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5db48797-fae4-4937-ad0e-13052845c94c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1666 microversion: 2.1 time: 0.402131 Nov 27 21:16:57.286772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3512/6899] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:56 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1666 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:57.936086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:57.936838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:57.943639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:57.944388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:57.945394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:57.946054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.017756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.026079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.028557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.030033 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1873806-78a8-4c04-afa9-029d3dfa4833 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1357 microversion: 2.47 time: 0.098018 Nov 27 21:16:58.030837 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3388/6900] 10.222.0.21 () {60 vars in 1276 bytes} [Sat Nov 27 21:16:57 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1357 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:58.049461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:58.052714 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:16:58.052714 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:16:58.053857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.054699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Searching by: {'deleted': False, 'project_id': '038952e512e24ad48321d19c3748ea74'} {{(pid=135680) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:16:58.061277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:58.061725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.062558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:58.063067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.196972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.multi_cell_list [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=135680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 21:16:58.278513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.285666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:58.286113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.297277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.298776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.334890 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0114e1bf-21b0-4f5b-bd5c-24274ae01126 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.290140 Nov 27 21:16:58.335740 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3513/6901] 10.222.0.21 () {60 vars in 1186 bytes} [Sat Nov 27 21:16:58 2021] GET /compute/v2.1/servers/detail => generated 2706 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 21:16:58.367678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:58.368524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:58.375762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:58.376300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.377167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:58.378458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.413817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:16:58.503813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9c1ccb6e-2a34-4f97-8a45-dd4db41cff1e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 204 len: 0 microversion: 2.1 time: 0.139997 Nov 27 21:16:58.504879 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3389/6902] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:16:58 2021] DELETE /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:16:58.514519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:58.515127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:58.524903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:58.525836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.527724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:58.528763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:58.603293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:58.611455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b58b97e8-8660-4455-87fa-575a48a1137e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1297 microversion: 2.1 time: 0.102116 Nov 27 21:16:58.612254 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3514/6903] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:58 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:59.629852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:59.630551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:16:59.637464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:59.637905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:59.639126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:16:59.639589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:16:59.706734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:16:59.714569 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad9309a5-de6b-4629-b337-60b9771a73b0 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1297 microversion: 2.1 time: 0.088808 Nov 27 21:16:59.715157 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3390/6904] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:16:59 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:16:59.967336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4cdce66-9979-4fd8-ade0-ceb8dc5323ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '.version_select at 0x7f15c73bfb80>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:16:59.987918 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4cdce66-9979-4fd8-ade0-ceb8dc5323ef tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-976170150" status: 202 len: 0 microversion: 2.1 time: 0.024719 Nov 27 21:16:59.989022 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3515/6905] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 21:16:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-976170150 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:17:00.013185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a7b32417-1292-40b9-a55d-e0edade808b2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: .version_select at 0x7f15d94bdd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2076682201"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:00.032378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a7b32417-1292-40b9-a55d-e0edade808b2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:17:00.038411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a7b32417-1292-40b9-a55d-e0edade808b2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:17:00.207771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a7b32417-1292-40b9-a55d-e0edade808b2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:17:00.212483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a7b32417-1292-40b9-a55d-e0edade808b2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:17:00.226783 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a7b32417-1292-40b9-a55d-e0edade808b2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.217374 Nov 27 21:17:00.227422 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3391/6906] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:17:00 2021] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:00.743297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:00.743940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:00.751536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:00.752707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:00.753782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:00.754317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:00.793863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:00.794318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:00.794771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lazy-loading 'fault' on Instance uuid 65d8bb5a-9bea-44c4-9462-b5aba2d954c8 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:17:00.838689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:00.845567 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e0669f7-17f4-4505-957f-4f1f388c15dc tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 200 len: 1302 microversion: 2.1 time: 0.116286 Nov 27 21:17:00.846144 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3516/6907] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:00 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:01.864299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:01.865208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 65d8bb5a-9bea-44c4-9462-b5aba2d954c8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:01.871167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:01.871670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:01.872457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:01.872900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:01.886078 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] HTTP exception thrown: Instance 65d8bb5a-9bea-44c4-9462-b5aba2d954c8 could not be found. Nov 27 21:17:01.887174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Returning 404 to user: Instance 65d8bb5a-9bea-44c4-9462-b5aba2d954c8 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:17:01.888114 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0226af93-c26c-4009-a601-3d53e5a6c9c3 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8" status: 404 len: 111 microversion: 2.1 time: 0.028704 Nov 27 21:17:01.888668 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3392/6908] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:01 2021] GET /compute/v2.1/servers/65d8bb5a-9bea-44c4-9462-b5aba2d954c8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:17:01.896704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:01.897238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:01.904648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:01.905103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:01.905907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:01.906340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:01.930283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:17:02.009356 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-93429d4f-15c6-45bb-b487-daed13626b40 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "DELETE /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2" status: 204 len: 0 microversion: 2.1 time: 0.116119 Nov 27 21:17:02.010804 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3517/6909] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:17:01 2021] DELETE /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:17:02.019691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:02.020313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:02.026309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:02.027738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:02.028759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:02.029210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:02.139225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:02.152839 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da149bb8-b0d6-4c31-a016-55079b9cb56b tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2" status: 200 len: 1296 microversion: 2.1 time: 0.137144 Nov 27 21:17:02.153434 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3393/6910] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:02 2021] GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2 => generated 1296 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:17:03.171360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:03.172739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:03.179712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:03.180384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:03.181382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:03.182000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:03.274515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:03.283353 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1631eba2-c1e2-4f19-abec-fc86565d812e tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2" status: 200 len: 1296 microversion: 2.1 time: 0.116732 Nov 27 21:17:03.284264 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3518/6911] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:03 2021] GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:04.303162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:04.305014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:04.313831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:04.314289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:04.315307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:04.315759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:04.390545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:04.392444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:04.393245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lazy-loading 'fault' on Instance uuid 04571647-1598-4a57-bac3-200071d1d6c2 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:17:04.521382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f566d48105db4beeac8d39a5a03519a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038952e512e24ad48321d19c3748ea74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:04.530285 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-246f96e7-abd8-45e5-bc9b-a4ebac41d9d8 tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2" status: 200 len: 1301 microversion: 2.1 time: 0.233130 Nov 27 21:17:04.539994 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3394/6912] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:04 2021] GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2 => generated 1301 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:05.547929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:05.548703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] [instance: 04571647-1598-4a57-bac3-200071d1d6c2] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:05.555829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:05.556585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:05.557625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:05.558793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:05.573782 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] HTTP exception thrown: Instance 04571647-1598-4a57-bac3-200071d1d6c2 could not be found. Nov 27 21:17:05.574785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] Returning 404 to user: Instance 04571647-1598-4a57-bac3-200071d1d6c2 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:17:05.575883 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5b838d6-5fb8-40ca-b385-4497061d02df tempest-ServerShowV247Test-1665135929 tempest-ServerShowV247Test-1665135929-project] 10.222.0.21 "GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2" status: 404 len: 111 microversion: 2.1 time: 0.031683 Nov 27 21:17:05.576694 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3519/6913] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:05 2021] GET /compute/v2.1/servers/04571647-1598-4a57-bac3-200071d1d6c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:17:05.789674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1839956106", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "81dad434-c37b-4895-b071-f5ff7392879d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2076682201", "security_groups": [{"name": "tempest-secgroup-smoke-1486301140"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:05.910865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] validate_networks() for [('81dad434-c37b-4895-b071-f5ff7392879d', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:17:06.420389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:17:06.420824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:17:06.421360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:17:06.421782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:17:06.422191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:17:06.434599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:06.435061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:06.435926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:06.436366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:06.457100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:17:06.465678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:17:06.482653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:17:06.486716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:17:06.552914 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55883f04-e978-4de6-937e-7ae100fd61fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767334 Nov 27 21:17:06.554209 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3395/6914] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:17:05 2021] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:17:06.564683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af23788e-537e-4250-b78d-4a5730fd7973 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:06.565922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af23788e-537e-4250-b78d-4a5730fd7973 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:06.664656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-af23788e-537e-4250-b78d-4a5730fd7973 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:06.680394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af23788e-537e-4250-b78d-4a5730fd7973 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1267 microversion: 2.1 time: 0.119582 Nov 27 21:17:06.681025 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3520/6915] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:06 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:07.430038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f54d953-e0e8-410a-9444-5fb7af26b79e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Calling method '.version_select at 0x7f15c6aa1f70>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:07.502992 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f54d953-e0e8-410a-9444-5fb7af26b79e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.220186 Nov 27 21:17:07.503600 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3396/6916] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:17:07 2021] GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9/defaults => generated 371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:07.514355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b25b69be-b272-4339-8136-4515a79ca79f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Calling method '.version_select at 0x7f15c7d4a3a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:07.596846 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b25b69be-b272-4339-8136-4515a79ca79f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9" status: 200 len: 371 microversion: 2.1 time: 0.086645 Nov 27 21:17:07.599382 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3521/6917] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 21:17:07 2021] GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:17:07.609955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86658670-25c0-431d-8b08-4e870778fdc2 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Calling method '.version_select at 0x7f15c6aa1d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:07.697254 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86658670-25c0-431d-8b08-4e870778fdc2 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.087531 Nov 27 21:17:07.698307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3397/6918] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:17:07 2021] GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9/defaults => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:07.706467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:07.707415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:07.710987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a71bd1d-952a-4720-aaa4-5bff3ec93eae tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Calling method '.version_select at 0x7f15c696e670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:07.714270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:07.715173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:07.717110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:07.717778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:07.790399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:07.800291 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97f3f679-51c9-42f2-a392-ffe049399d25 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1319 microversion: 2.1 time: 0.106449 Nov 27 21:17:07.801119 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3522/6919] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:07 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:17:07.821994 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a71bd1d-952a-4720-aaa4-5bff3ec93eae tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9" status: 200 len: 371 microversion: 2.1 time: 0.114517 Nov 27 21:17:07.822945 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3398/6920] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 21:17:07 2021] GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9 => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:17:07.833704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9249cd06-ced4-4adb-bfac-6f4396d7edeb tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Calling method '.version_select at 0x7f15c7d4a700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:07.958005 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9249cd06-ced4-4adb-bfac-6f4396d7edeb tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9?user_id=b6e9f466ac0b47a9ab5bf3ff28dff193" status: 200 len: 371 microversion: 2.1 time: 0.128614 Nov 27 21:17:07.965020 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3523/6921] 10.222.0.21 () {58 vars in 1322 bytes} [Sat Nov 27 21:17:07 2021] GET /compute/v2.1/os-quota-sets/a19f996909444bfeb728afa8e59b8de9?user_id=b6e9f466ac0b47a9ab5bf3ff28dff193 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:08.818809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:08.820695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:08.831745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:08.832576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:08.834553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:08.835575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:09.584263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:09.593476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-428ed034-9111-468e-88e0-fc56783ca2ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.779142 Nov 27 21:17:09.603954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3399/6922] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:08 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:09.931610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8f4da9d9-8455-4059-9ef8-a821839346c4 req-7b080720-b975-45cf-8bde-d8905eefa126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:09.933500 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:09.933500 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:17:09.943646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8f4da9d9-8455-4059-9ef8-a821839346c4 req-7b080720-b975-45cf-8bde-d8905eefa126 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:09.944536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8f4da9d9-8455-4059-9ef8-a821839346c4 req-7b080720-b975-45cf-8bde-d8905eefa126 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:09.957488 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8f4da9d9-8455-4059-9ef8-a821839346c4 req-7b080720-b975-45cf-8bde-d8905eefa126 service nova] Creating event network-changed:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:17:09.966670 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8f4da9d9-8455-4059-9ef8-a821839346c4 req-7b080720-b975-45cf-8bde-d8905eefa126 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034797 Nov 27 21:17:09.966670 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3524/6923] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:17:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:10.111591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Action: 'create', calling method: .version_select at 0x7f15c6aa1d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1266800954"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:10.417918 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a7c8f4dd-b2e4-4a00-b35b-2ba78239b933 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.447702 Nov 27 21:17:10.419502 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3400/6924] 10.222.0.21 () {60 vars in 1154 bytes} [Sat Nov 27 21:17:09 2021] POST /compute/v2.1/os-volumes => generated 338 bytes in 450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 27 21:17:10.431281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-825e933a-883b-4264-bf66-318873564455 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c7508ee0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:10.484717 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-825e933a-883b-4264-bf66-318873564455 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491" status: 200 len: 338 microversion: 2.1 time: 0.057926 Nov 27 21:17:10.486122 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3525/6925] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:17:10 2021] GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491 => generated 338 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:10.612445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:10.613187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:10.620531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:10.621032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:10.622178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:10.622665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:10.831194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:10.840482 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9242a18-c078-4290-994b-41ee5fd1b5d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.232235 Nov 27 21:17:10.849814 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3401/6926] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:10 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:11.497883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ff2ec92-b346-4edb-bd70-6561f8125168 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c7c9fd30>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:11.543499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ff2ec92-b346-4edb-bd70-6561f8125168 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491" status: 200 len: 339 microversion: 2.1 time: 0.050143 Nov 27 21:17:11.544067 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3526/6927] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:17:11 2021] GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491 => generated 339 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:11.554903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9dd1b6d4-e2e4-49dc-bc44-fd81d1e91419 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Action: 'create', calling method: .version_select at 0x7f15c692ff70>, body: {"snapshot": {"volume_id": "3efbf41a-878d-4a5c-a608-be90f8428491", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1414207613"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:11.692623 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9dd1b6d4-e2e4-49dc-bc44-fd81d1e91419 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.141273 Nov 27 21:17:11.693216 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3402/6928] 10.222.0.21 () {60 vars in 1161 bytes} [Sat Nov 27 21:17:11 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:11.706616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23610dfd-f61a-416e-8fee-caaf724ce392 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15d94e63a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:11.743129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23610dfd-f61a-416e-8fee-caaf724ce392 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb" status: 200 len: 287 microversion: 2.1 time: 0.042876 Nov 27 21:17:11.743747 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3527/6929] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:11 2021] GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:11.753177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b33a4983-f891-406c-af74-c0daa36b08ff tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c69125e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:11.784649 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b33a4983-f891-406c-af74-c0daa36b08ff tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034986 Nov 27 21:17:11.785360 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3403/6930] 10.222.0.21 () {58 vars in 1139 bytes} [Sat Nov 27 21:17:11 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:11.795407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4628c160-051c-4504-9d6a-7cb9aadae864 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c77e9820>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:11.823100 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4628c160-051c-4504-9d6a-7cb9aadae864 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb" status: 200 len: 287 microversion: 2.1 time: 0.031354 Nov 27 21:17:11.824327 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3528/6931] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:11 2021] GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:17:11.857110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:11.857719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:11.863879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:11.864338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:11.865369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:11.865809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:11.995688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:12.003149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe26a2d2-1bcd-4fc5-9fdb-6f27a7a627a1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.149666 Nov 27 21:17:12.003807 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3404/6932] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:11 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:12.836234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f01709c9-f594-4ffa-ae78-e2b89075c1fa tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c7b7a280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:12.865670 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f01709c9-f594-4ffa-ae78-e2b89075c1fa tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb" status: 200 len: 288 microversion: 2.1 time: 0.033870 Nov 27 21:17:12.866224 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3529/6933] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:12 2021] GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:12.876074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc53ad40-ef34-4519-a814-ed12ec9c58fd tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c69145e0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:12.932298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc53ad40-ef34-4519-a814-ed12ec9c58fd tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "DELETE /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb" status: 202 len: 0 microversion: 2.1 time: 0.059805 Nov 27 21:17:12.932930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3405/6934] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:17:12 2021] DELETE /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:17:12.941225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ea984cd-562a-4f4f-81e1-481db31e37ee tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15d4317f70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:12.972351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ea984cd-562a-4f4f-81e1-481db31e37ee tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb" status: 200 len: 287 microversion: 2.1 time: 0.035088 Nov 27 21:17:12.972921 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3530/6935] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:12 2021] GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:13.023613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:13.024323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:13.031655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:13.032105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:13.032884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:13.033318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:13.169187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:13.176832 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3dae4ab-5ba4-498d-8619-96614e269d46 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.157110 Nov 27 21:17:13.177409 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3406/6936] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:13 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:13.984915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0eb5054a-cd0e-4017-83b3-e1f388d622fb tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c75ab790>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:14.009245 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0eb5054a-cd0e-4017-83b3-e1f388d622fb tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] HTTP exception thrown: Snapshot d4f831cb-43a4-413a-85f7-56d466a9b1cb could not be found. Nov 27 21:17:14.009834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0eb5054a-cd0e-4017-83b3-e1f388d622fb tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Returning 404 to user: Snapshot d4f831cb-43a4-413a-85f7-56d466a9b1cb could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:17:14.010648 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0eb5054a-cd0e-4017-83b3-e1f388d622fb tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb" status: 404 len: 111 microversion: 2.1 time: 0.030312 Nov 27 21:17:14.011944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3531/6937] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:13 2021] GET /compute/v2.1/os-snapshots/d4f831cb-43a4-413a-85f7-56d466a9b1cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:17:14.019784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c939a9a-8fec-462c-a333-8a9a23b01da9 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c68c7a60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:14.079911 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c939a9a-8fec-462c-a333-8a9a23b01da9 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491" status: 202 len: 0 microversion: 2.1 time: 0.063419 Nov 27 21:17:14.082632 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3407/6938] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:14 2021] DELETE /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:17:14.091057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-09854c2c-34e9-4a0e-8f4e-b20b8ef8cc7c tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c77e9ca0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:14.146145 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-09854c2c-34e9-4a0e-8f4e-b20b8ef8cc7c tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491" status: 200 len: 338 microversion: 2.1 time: 0.059768 Nov 27 21:17:14.146716 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3532/6939] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:17:14 2021] GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491 => generated 338 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:14.193770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:14.194422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:14.204166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:14.204630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:14.205424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:14.205863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:14.357293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:14.364536 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-14dbfe4b-7ad3-4cfc-b390-08dca0a20687 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.174499 Nov 27 21:17:14.365367 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3408/6940] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:14 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:15.161227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a3f7ae25-28ba-41d1-8117-2872e4653d13 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15d449e700>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:15.189142 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a3f7ae25-28ba-41d1-8117-2872e4653d13 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] HTTP exception thrown: Volume 3efbf41a-878d-4a5c-a608-be90f8428491 could not be found. Nov 27 21:17:15.189753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a3f7ae25-28ba-41d1-8117-2872e4653d13 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Returning 404 to user: Volume 3efbf41a-878d-4a5c-a608-be90f8428491 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:17:15.190612 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a3f7ae25-28ba-41d1-8117-2872e4653d13 tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491" status: 404 len: 109 microversion: 2.1 time: 0.033981 Nov 27 21:17:15.191155 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3533/6941] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:17:15 2021] GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:17:15.201202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bcdbebd0-8bc3-4fb5-9b2b-e9414b6707ca tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c6912310>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:15.227972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-bcdbebd0-8bc3-4fb5-9b2b-e9414b6707ca tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] HTTP exception thrown: Volume 3efbf41a-878d-4a5c-a608-be90f8428491 could not be found. Nov 27 21:17:15.228564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bcdbebd0-8bc3-4fb5-9b2b-e9414b6707ca tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Returning 404 to user: Volume 3efbf41a-878d-4a5c-a608-be90f8428491 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:17:15.229432 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bcdbebd0-8bc3-4fb5-9b2b-e9414b6707ca tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491" status: 404 len: 109 microversion: 2.1 time: 0.032523 Nov 27 21:17:15.230038 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3409/6942] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:15 2021] DELETE /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:17:15.237798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4f18899-99e7-4239-843a-c8f0b7c882cf tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Calling method '.version_select at 0x7f15c7508280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:15.267649 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b4f18899-99e7-4239-843a-c8f0b7c882cf tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] HTTP exception thrown: Volume 3efbf41a-878d-4a5c-a608-be90f8428491 could not be found. Nov 27 21:17:15.268242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4f18899-99e7-4239-843a-c8f0b7c882cf tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] Returning 404 to user: Volume 3efbf41a-878d-4a5c-a608-be90f8428491 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:17:15.269051 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4f18899-99e7-4239-843a-c8f0b7c882cf tempest-VolumesSnapshotsTestJSON-139434804 tempest-VolumesSnapshotsTestJSON-139434804-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491" status: 404 len: 109 microversion: 2.1 time: 0.034976 Nov 27 21:17:15.269576 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3534/6943] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:17:15 2021] GET /compute/v2.1/os-volumes/3efbf41a-878d-4a5c-a608-be90f8428491 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:17:15.382438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:15.383141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:15.389564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:15.390020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:15.390797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:15.391233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:15.529662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:15.537033 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1233c8f1-3f08-4efe-860a-981b98f02fa2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.159029 Nov 27 21:17:15.537700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3410/6944] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:15 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:16.284316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-66252569-3e4d-4cf0-b89d-4b026b628865 req-90ded46e-76f3-4bc8-a54a-c931a73a6d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "name": "network-vif-plugged", "status": "completed", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:16.286144 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:16.286144 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:17:16.294290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-66252569-3e4d-4cf0-b89d-4b026b628865 req-90ded46e-76f3-4bc8-a54a-c931a73a6d3d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:16.294726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-66252569-3e4d-4cf0-b89d-4b026b628865 req-90ded46e-76f3-4bc8-a54a-c931a73a6d3d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:16.305674 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-66252569-3e4d-4cf0-b89d-4b026b628865 req-90ded46e-76f3-4bc8-a54a-c931a73a6d3d service nova] Creating event network-vif-plugged:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:17:16.311294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-66252569-3e4d-4cf0-b89d-4b026b628865 req-90ded46e-76f3-4bc8-a54a-c931a73a6d3d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228656 Nov 27 21:17:16.311886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3535/6945] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:17:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:16.553774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:16.554376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:16.561029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:16.561474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:16.562241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:16.562671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:16.703561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:16.709890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-296c3322-50e0-4464-8954-695161c12023 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.159813 Nov 27 21:17:16.710456 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3411/6946] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:16 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:17.732012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:17.732718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:17.740081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:17.741028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:17.741853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:17.742306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:17.890330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:17.900418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2c89808b-4e9d-4fbb-b680-2c130f9f5e3e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1393 microversion: 2.1 time: 0.173750 Nov 27 21:17:17.902112 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3536/6947] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:17 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:18.918363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:18.918991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:18.925967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:18.926427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:18.927681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:18.928133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:19.061853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:19.070516 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6dae5bba-ca04-4772-a903-b0be460ee38a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1565 microversion: 2.1 time: 0.156359 Nov 27 21:17:19.071086 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3412/6948] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:18 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:19.086812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:19.087455 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:19.095012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:19.095515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:19.096357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:19.096785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:19.236138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:19.245037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5acb2c28-36ec-425a-96e5-c1b511437d3b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1565 microversion: 2.1 time: 0.161780 Nov 27 21:17:19.245633 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3537/6949] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:19 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:20.938347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:20.939566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:20.944473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-808aef53-b8ba-4c41-bc42-fbc9f037e2cb req-5eba20cd-1eac-4c43-96cc-830d2076215c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:20.946033 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:20.946033 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:17:20.967021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:20.969238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:20.970050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:20.970493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:20.974790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-808aef53-b8ba-4c41-bc42-fbc9f037e2cb req-5eba20cd-1eac-4c43-96cc-830d2076215c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:20.975506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-808aef53-b8ba-4c41-bc42-fbc9f037e2cb req-5eba20cd-1eac-4c43-96cc-830d2076215c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:20.989573 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-808aef53-b8ba-4c41-bc42-fbc9f037e2cb req-5eba20cd-1eac-4c43-96cc-830d2076215c service nova] Creating event network-changed:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:17:21.003871 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-808aef53-b8ba-4c41-bc42-fbc9f037e2cb req-5eba20cd-1eac-4c43-96cc-830d2076215c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062737 Nov 27 21:17:21.004797 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3538/6950] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:21.279850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:21.290379 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f68a1f9-6ac2-44e2-b64c-5bfaf049e694 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1565 microversion: 2.1 time: 0.355633 Nov 27 21:17:21.291047 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3413/6951] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:20 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1565 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:30.249148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37b612da-8ab2-4aa5-bc6d-d73396869ed8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:30.250230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37b612da-8ab2-4aa5-bc6d-d73396869ed8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:30.256595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37b612da-8ab2-4aa5-bc6d-d73396869ed8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:30.257051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37b612da-8ab2-4aa5-bc6d-d73396869ed8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:30.257839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37b612da-8ab2-4aa5-bc6d-d73396869ed8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:30.258280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37b612da-8ab2-4aa5-bc6d-d73396869ed8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:30.288314 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37b612da-8ab2-4aa5-bc6d-d73396869ed8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044835 Nov 27 21:17:30.288892 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3539/6952] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:17:30 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:30.348628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:30.349190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:30.355497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:30.355951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:30.356876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:30.357143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:30.384702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:17:30.469883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a235c15a-5aa1-4967-9660-7fd8e2eb1f92 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 204 len: 0 microversion: 2.1 time: 0.124735 Nov 27 21:17:30.470402 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3414/6953] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:17:30 2021] DELETE /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:17:30.480935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:30.482014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:30.490462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:30.490984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:30.491870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:30.492308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:30.710858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:30.718388 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-372a88a3-74b3-47ed-b957-670286ac9d8c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1672 microversion: 2.1 time: 0.243771 Nov 27 21:17:30.718971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3540/6954] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:30 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:17:31.736647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:31.737349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:31.744312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:31.744789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:31.745559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:31.745998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:31.879605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:31.887544 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a26fe968-e157-4138-a8ea-08c15e207fd2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1672 microversion: 2.1 time: 0.154851 Nov 27 21:17:31.888120 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3415/6955] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:31 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:32.905473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:32.906254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:32.915146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:32.916037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:32.916974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:32.918264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:33.066595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:33.075813 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da6de5f7-4711-4c4a-b37e-22633210707c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1672 microversion: 2.1 time: 0.174514 Nov 27 21:17:33.076628 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3541/6956] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:32 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:33.757864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-49fe1c70-d71a-436c-a122-707a1a6de9e2 req-8fd468be-4c8a-4c6c-8836-8db6c2f72a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16595aec-62b0-4a81-8923-9071b7521bfe", "name": "network-vif-deleted", "tag": "a9f6773f-b4a1-41a8-9921-b5b340ba2efd"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:33.760830 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:33.760830 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:17:33.769805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-49fe1c70-d71a-436c-a122-707a1a6de9e2 req-8fd468be-4c8a-4c6c-8836-8db6c2f72a81 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:33.770598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-49fe1c70-d71a-436c-a122-707a1a6de9e2 req-8fd468be-4c8a-4c6c-8836-8db6c2f72a81 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:33.783483 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-49fe1c70-d71a-436c-a122-707a1a6de9e2 req-8fd468be-4c8a-4c6c-8836-8db6c2f72a81 service nova] Creating event network-vif-deleted:a9f6773f-b4a1-41a8-9921-b5b340ba2efd for instance 16595aec-62b0-4a81-8923-9071b7521bfe on nch1-master-1 Nov 27 21:17:33.788444 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-49fe1c70-d71a-436c-a122-707a1a6de9e2 req-8fd468be-4c8a-4c6c-8836-8db6c2f72a81 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242993 Nov 27 21:17:33.793401 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3416/6957] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:34.093845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:34.094453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:34.106777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:34.107547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:34.108630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:34.109308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:34.163451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:34.164033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:34.164553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lazy-loading 'fault' on Instance uuid 16595aec-62b0-4a81-8923-9071b7521bfe {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:17:34.212734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:34.220023 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cbe5d6fd-90b5-4d15-8453-a0845eaac96e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 200 len: 1326 microversion: 2.1 time: 0.129834 Nov 27 21:17:34.220700 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3542/6958] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:34 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 1326 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:17:35.239312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:35.240482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:35.246591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:35.247099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:35.247913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:35.248357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:35.262029 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] HTTP exception thrown: Instance 16595aec-62b0-4a81-8923-9071b7521bfe could not be found. Nov 27 21:17:35.262629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Returning 404 to user: Instance 16595aec-62b0-4a81-8923-9071b7521bfe could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:17:35.263498 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2cd5931-c016-41c7-a776-2654a3820543 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 404 len: 111 microversion: 2.1 time: 0.029159 Nov 27 21:17:35.264049 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3417/6959] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:35 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:17:35.272987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16534fda-384d-4ac4-9615-84b96ff5cf3a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '.version_select at 0x7f15d94e63a0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:35.294276 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16534fda-384d-4ac4-9615-84b96ff5cf3a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-197777019" status: 202 len: 0 microversion: 2.1 time: 0.025621 Nov 27 21:17:35.294957 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3543/6960] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 21:17:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-197777019 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:17:35.988780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99016369-8bc7-4003-8a39-4d68a19a1e39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'create', calling method: .version_select at 0x7f15c694c3a0>, body: {"keypair": {"name": "tempest-keypair-174928718"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:36.004241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-99016369-8bc7-4003-8a39-4d68a19a1e39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:17:36.009100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-99016369-8bc7-4003-8a39-4d68a19a1e39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for user b771da0354414b239da0cad505f8ffe6 and project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:17:36.147801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-99016369-8bc7-4003-8a39-4d68a19a1e39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:17:36.153213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-99016369-8bc7-4003-8a39-4d68a19a1e39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for user b771da0354414b239da0cad505f8ffe6 and project 219be90852c0481aaad9862d1a485102. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:17:36.166928 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99016369-8bc7-4003-8a39-4d68a19a1e39 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.181845 Nov 27 21:17:36.167558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3418/6961] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:17:35 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:38.055158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1856171921", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34e43d78-90bf-4d39-8500-de9af3c92506"}], "security_groups": [{"name": "tempest-securitygroup--775461896"}], "key_name": "tempest-keypair-174928718", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:38.180012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] validate_networks() for [('34e43d78-90bf-4d39-8500-de9af3c92506', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:17:38.593703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:17:38.594299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:17:38.594826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:17:38.595403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:17:38.595832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:17:38.606265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:38.606846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:38.607932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:38.608485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:38.626861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for project 219be90852c0481aaad9862d1a485102. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:17:38.632218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Getting quotas for user b771da0354414b239da0cad505f8ffe6 and project 219be90852c0481aaad9862d1a485102. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:17:38.645882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:17:38.648287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:17:38.698211 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65112da5-5d9e-4575-8ac5-88dcc793bb86 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.647045 Nov 27 21:17:38.699812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3544/6962] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:17:38 2021] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:17:38.721600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07e69aab-66db-4069-8108-38ca89e15afb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:38.722344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07e69aab-66db-4069-8108-38ca89e15afb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:38.798454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-07e69aab-66db-4069-8108-38ca89e15afb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:38.807362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07e69aab-66db-4069-8108-38ca89e15afb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1237 microversion: 2.1 time: 0.101422 Nov 27 21:17:38.809619 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3419/6963] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:38 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:39.827904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:39.829465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:39.843984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:39.844988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:39.847079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:39.847676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:39.924739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:39.936689 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07557621-1cd1-432c-bf99-948aef68b371 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1297 microversion: 2.1 time: 0.114620 Nov 27 21:17:39.937808 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3545/6964] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:39 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:17:40.956112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:40.956928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:40.968807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:40.969257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:40.970072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:40.970517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:41.396586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:41.409302 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3cd7dd1c-3eeb-4af4-ba4c-a6ff260a405d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1362 microversion: 2.1 time: 0.457932 Nov 27 21:17:41.410092 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3420/6965] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:40 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:41.807096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-145b17b2-18c0-45ec-b129-10a9dfb6a8c6 req-cc070bb5-920f-49b1-8ed6-c98967e0c1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4756739-b69b-486b-bcb3-faf9e9748ad9", "tag": "b7a3b32c-565f-4c0c-a9ae-31669d910917"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:41.811481 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:41.811481 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:17:41.829911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-145b17b2-18c0-45ec-b129-10a9dfb6a8c6 req-cc070bb5-920f-49b1-8ed6-c98967e0c1a6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:41.831103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-145b17b2-18c0-45ec-b129-10a9dfb6a8c6 req-cc070bb5-920f-49b1-8ed6-c98967e0c1a6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:41.844156 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-145b17b2-18c0-45ec-b129-10a9dfb6a8c6 req-cc070bb5-920f-49b1-8ed6-c98967e0c1a6 service nova] Creating event network-changed:b7a3b32c-565f-4c0c-a9ae-31669d910917 for instance d4756739-b69b-486b-bcb3-faf9e9748ad9 on nch1-master-1 Nov 27 21:17:41.850671 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-145b17b2-18c0-45ec-b129-10a9dfb6a8c6 req-cc070bb5-920f-49b1-8ed6-c98967e0c1a6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047665 Nov 27 21:17:41.851997 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3546/6966] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:17:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:42.427128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:42.428861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:42.437595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:42.438286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:42.439421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:42.439866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:42.667400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:42.676929 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4c1c38f3-5bee-4827-9761-423d0036fa42 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1362 microversion: 2.1 time: 0.253544 Nov 27 21:17:42.677712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3421/6967] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:42 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:43.694711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:43.695436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:43.702060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:43.702517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:43.703323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:43.703765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:43.844182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:43.851551 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41b5ca4b-27f5-4364-bb1e-4f2ff1912df3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1362 microversion: 2.1 time: 0.161670 Nov 27 21:17:43.852244 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3547/6968] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:43 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:44.870458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:44.870458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:44.878380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:44.878840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:44.879697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:44.880145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:45.146172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:45.154229 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0c2011b4-03e2-4487-861b-183a2b601931 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1362 microversion: 2.1 time: 0.288104 Nov 27 21:17:45.154960 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3422/6969] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:44 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:46.171282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:46.171850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:46.178887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:46.179634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:46.180824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:46.181275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:46.410826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:46.418223 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-006bf68a-51ca-4f6f-8a69-749265402d15 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1362 microversion: 2.1 time: 0.250732 Nov 27 21:17:46.418874 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3548/6970] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:46 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:46.908578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3abdcf98-e937-4197-bfbf-3a4adc4891d9 req-7204922f-1813-463c-b54e-4e9e74109ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4756739-b69b-486b-bcb3-faf9e9748ad9", "name": "network-vif-plugged", "status": "completed", "tag": "b7a3b32c-565f-4c0c-a9ae-31669d910917"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:46.911296 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:46.911296 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:17:46.935093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3abdcf98-e937-4197-bfbf-3a4adc4891d9 req-7204922f-1813-463c-b54e-4e9e74109ebd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:46.935971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3abdcf98-e937-4197-bfbf-3a4adc4891d9 req-7204922f-1813-463c-b54e-4e9e74109ebd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:46.958838 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3abdcf98-e937-4197-bfbf-3a4adc4891d9 req-7204922f-1813-463c-b54e-4e9e74109ebd service nova] Creating event network-vif-plugged:b7a3b32c-565f-4c0c-a9ae-31669d910917 for instance d4756739-b69b-486b-bcb3-faf9e9748ad9 on nch1-master-1 Nov 27 21:17:46.966640 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3abdcf98-e937-4197-bfbf-3a4adc4891d9 req-7204922f-1813-463c-b54e-4e9e74109ebd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063177 Nov 27 21:17:46.967392 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3423/6971] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:17:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:47.435658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:47.436411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:47.444164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:47.444618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:47.445415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:47.445844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:47.600095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:47.608144 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6be658d5-52b5-43e0-9b62-6bd82c287b7e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1362 microversion: 2.1 time: 0.176835 Nov 27 21:17:47.608724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3549/6972] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:47 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:17:48.627499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:48.628324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:48.635167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:48.635840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:48.636892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:48.637340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:49.049239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:17:49.057411 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-52f95f71-4909-4504-9595-f44d562782ad tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1547 microversion: 2.1 time: 0.435033 Nov 27 21:17:49.058005 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3424/6973] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:48 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1547 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:17:49.074481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e8500f3d-f7aa-4d90-a5ed-21c8525617e4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:17:49.075668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e8500f3d-f7aa-4d90-a5ed-21c8525617e4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:49.082484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8500f3d-f7aa-4d90-a5ed-21c8525617e4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:49.083034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8500f3d-f7aa-4d90-a5ed-21c8525617e4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:49.083944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8500f3d-f7aa-4d90-a5ed-21c8525617e4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:49.084459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e8500f3d-f7aa-4d90-a5ed-21c8525617e4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:49.326252 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e8500f3d-f7aa-4d90-a5ed-21c8525617e4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255738 Nov 27 21:17:49.326931 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3550/6974] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:17:49 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:50.659594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8588f6f9-b511-4a22-b904-89edd1a4a0dc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:50.661368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8588f6f9-b511-4a22-b904-89edd1a4a0dc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:50.672357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4fe414bc-3a4a-43fe-b45a-6bbb34902dcd req-d6d21f89-94b7-4cb0-ac91-a4acd004890e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4756739-b69b-486b-bcb3-faf9e9748ad9", "tag": "b7a3b32c-565f-4c0c-a9ae-31669d910917"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:50.674600 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:50.674600 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:17:50.690706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588f6f9-b511-4a22-b904-89edd1a4a0dc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:50.691934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588f6f9-b511-4a22-b904-89edd1a4a0dc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:50.696155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4fe414bc-3a4a-43fe-b45a-6bbb34902dcd req-d6d21f89-94b7-4cb0-ac91-a4acd004890e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:50.696666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588f6f9-b511-4a22-b904-89edd1a4a0dc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:50.697336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8588f6f9-b511-4a22-b904-89edd1a4a0dc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:50.699176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4fe414bc-3a4a-43fe-b45a-6bbb34902dcd req-d6d21f89-94b7-4cb0-ac91-a4acd004890e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:50.732308 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4fe414bc-3a4a-43fe-b45a-6bbb34902dcd req-d6d21f89-94b7-4cb0-ac91-a4acd004890e service nova] Creating event network-changed:b7a3b32c-565f-4c0c-a9ae-31669d910917 for instance d4756739-b69b-486b-bcb3-faf9e9748ad9 on nch1-master-1 Nov 27 21:17:50.746177 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4fe414bc-3a4a-43fe-b45a-6bbb34902dcd req-d6d21f89-94b7-4cb0-ac91-a4acd004890e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077779 Nov 27 21:17:50.749565 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3551/6975] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:17:50.772267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8588f6f9-b511-4a22-b904-89edd1a4a0dc tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.117020 Nov 27 21:17:50.776176 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3425/6976] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:50 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:51.784901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9fa1b33a-feab-4260-a959-3e2ad6e7ea83 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:51.786106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9fa1b33a-feab-4260-a959-3e2ad6e7ea83 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:51.796280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fa1b33a-feab-4260-a959-3e2ad6e7ea83 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:51.797050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fa1b33a-feab-4260-a959-3e2ad6e7ea83 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:51.798794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fa1b33a-feab-4260-a959-3e2ad6e7ea83 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:51.799579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9fa1b33a-feab-4260-a959-3e2ad6e7ea83 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:51.854556 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9fa1b33a-feab-4260-a959-3e2ad6e7ea83 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.073711 Nov 27 21:17:51.856859 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3552/6977] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:51 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:52.589302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-651094d3-2138-46d0-9aa8-ca4f440f4eea tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:52.592136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-651094d3-2138-46d0-9aa8-ca4f440f4eea tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:52.602479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-651094d3-2138-46d0-9aa8-ca4f440f4eea tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:52.604285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-651094d3-2138-46d0-9aa8-ca4f440f4eea tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:52.606827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-651094d3-2138-46d0-9aa8-ca4f440f4eea tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:52.607537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-651094d3-2138-46d0-9aa8-ca4f440f4eea tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:52.664876 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-651094d3-2138-46d0-9aa8-ca4f440f4eea tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action" status: 200 len: 24568 microversion: 2.1 time: 0.080025 Nov 27 21:17:52.665884 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3426/6978] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:52 2021] POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action => generated 24568 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:17:52.870245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-799aba54-12a5-4a89-8a84-4033923001ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:52.871535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-799aba54-12a5-4a89-8a84-4033923001ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:52.879496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799aba54-12a5-4a89-8a84-4033923001ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:52.884237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799aba54-12a5-4a89-8a84-4033923001ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:52.885242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799aba54-12a5-4a89-8a84-4033923001ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:52.885552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-799aba54-12a5-4a89-8a84-4033923001ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:52.937768 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-799aba54-12a5-4a89-8a84-4033923001ae tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.071415 Nov 27 21:17:52.941032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3553/6979] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:52 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:17:53.949441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a5b5c40-be5f-4551-815a-6d1103ff2f60 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:53.952230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a5b5c40-be5f-4551-815a-6d1103ff2f60 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:53.960515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a5b5c40-be5f-4551-815a-6d1103ff2f60 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:53.963120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a5b5c40-be5f-4551-815a-6d1103ff2f60 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:53.964271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a5b5c40-be5f-4551-815a-6d1103ff2f60 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:53.964890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a5b5c40-be5f-4551-815a-6d1103ff2f60 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:54.015803 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a5b5c40-be5f-4551-815a-6d1103ff2f60 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.070144 Nov 27 21:17:54.019447 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3427/6980] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:53 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:55.026821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9ae9b5b-3846-4031-8070-5d021186d1e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:55.027904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9ae9b5b-3846-4031-8070-5d021186d1e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:55.036260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9ae9b5b-3846-4031-8070-5d021186d1e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:55.036713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9ae9b5b-3846-4031-8070-5d021186d1e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:55.037511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9ae9b5b-3846-4031-8070-5d021186d1e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:55.037948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9ae9b5b-3846-4031-8070-5d021186d1e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:55.123789 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9ae9b5b-3846-4031-8070-5d021186d1e9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.098605 Nov 27 21:17:55.128866 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3554/6981] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:55 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:56.134463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be410b90-a18e-49d1-a850-a797a930b09e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:56.135411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be410b90-a18e-49d1-a850-a797a930b09e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:56.143275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be410b90-a18e-49d1-a850-a797a930b09e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:56.143743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be410b90-a18e-49d1-a850-a797a930b09e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:56.144536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be410b90-a18e-49d1-a850-a797a930b09e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:56.144993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be410b90-a18e-49d1-a850-a797a930b09e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:56.182461 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be410b90-a18e-49d1-a850-a797a930b09e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.051983 Nov 27 21:17:56.183084 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3428/6982] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:56 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:57.193812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fb7f309a-6fab-4650-8184-1ff08b2687ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:57.194771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fb7f309a-6fab-4650-8184-1ff08b2687ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:57.202314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb7f309a-6fab-4650-8184-1ff08b2687ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:57.202768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb7f309a-6fab-4650-8184-1ff08b2687ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:57.203571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb7f309a-6fab-4650-8184-1ff08b2687ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:57.204009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fb7f309a-6fab-4650-8184-1ff08b2687ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:57.242617 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fb7f309a-6fab-4650-8184-1ff08b2687ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.052901 Nov 27 21:17:57.245866 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3555/6983] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:57 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:58.254449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b83d3ee-51bf-48cc-bfda-f93dfa944554 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:58.255585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b83d3ee-51bf-48cc-bfda-f93dfa944554 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:58.263615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b83d3ee-51bf-48cc-bfda-f93dfa944554 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:58.264771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b83d3ee-51bf-48cc-bfda-f93dfa944554 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:58.265586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b83d3ee-51bf-48cc-bfda-f93dfa944554 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:58.266034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b83d3ee-51bf-48cc-bfda-f93dfa944554 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:58.317414 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b83d3ee-51bf-48cc-bfda-f93dfa944554 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.067337 Nov 27 21:17:58.318682 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3429/6984] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:58 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:17:59.329469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-469cf1ec-170a-4ba7-9682-896298ee2cf0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:17:59.330478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-469cf1ec-170a-4ba7-9682-896298ee2cf0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:17:59.337743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-469cf1ec-170a-4ba7-9682-896298ee2cf0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:59.338222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-469cf1ec-170a-4ba7-9682-896298ee2cf0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:59.338999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-469cf1ec-170a-4ba7-9682-896298ee2cf0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:17:59.339463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-469cf1ec-170a-4ba7-9682-896298ee2cf0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:17:59.378232 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-469cf1ec-170a-4ba7-9682-896298ee2cf0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.052720 Nov 27 21:17:59.379007 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3556/6985] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:17:59 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:18:00.389742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5332a716-9003-4890-b137-e8c825503c26 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:00.390911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5332a716-9003-4890-b137-e8c825503c26 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:00.400674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5332a716-9003-4890-b137-e8c825503c26 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:00.401022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5332a716-9003-4890-b137-e8c825503c26 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:00.401826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5332a716-9003-4890-b137-e8c825503c26 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:00.402396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5332a716-9003-4890-b137-e8c825503c26 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:00.448221 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5332a716-9003-4890-b137-e8c825503c26 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 14 microversion: 2.1 time: 0.062481 Nov 27 21:18:00.450043 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3430/6986] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:00 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:18:01.460063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-66b81e32-d984-42bf-8891-302905471f44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:01.461100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-66b81e32-d984-42bf-8891-302905471f44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:01.469145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66b81e32-d984-42bf-8891-302905471f44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:01.469598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66b81e32-d984-42bf-8891-302905471f44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:01.470388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66b81e32-d984-42bf-8891-302905471f44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:01.470828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66b81e32-d984-42bf-8891-302905471f44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:01.522675 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-66b81e32-d984-42bf-8891-302905471f44 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 8205 microversion: 2.1 time: 0.066826 Nov 27 21:18:01.524147 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3557/6987] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:01 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 8205 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:02.534566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a6cfd3d7-406d-42e8-b340-d29c68714bc1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:02.535609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a6cfd3d7-406d-42e8-b340-d29c68714bc1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:02.543383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6cfd3d7-406d-42e8-b340-d29c68714bc1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:02.543850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6cfd3d7-406d-42e8-b340-d29c68714bc1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:02.544645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6cfd3d7-406d-42e8-b340-d29c68714bc1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:02.545087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6cfd3d7-406d-42e8-b340-d29c68714bc1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:02.599235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a6cfd3d7-406d-42e8-b340-d29c68714bc1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 16395 microversion: 2.1 time: 0.068543 Nov 27 21:18:02.600114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3431/6988] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:02 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 16395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:03.611204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59e479df-3dbf-42ce-853a-3862d8088def tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:03.612448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59e479df-3dbf-42ce-853a-3862d8088def tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:03.620138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59e479df-3dbf-42ce-853a-3862d8088def tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:03.620595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59e479df-3dbf-42ce-853a-3862d8088def tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:03.621380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59e479df-3dbf-42ce-853a-3862d8088def tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:03.621818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59e479df-3dbf-42ce-853a-3862d8088def tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:03.663640 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59e479df-3dbf-42ce-853a-3862d8088def tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 16395 microversion: 2.1 time: 0.056353 Nov 27 21:18:03.667198 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3558/6989] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:03 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 16395 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:04.677203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05ba49fb-8ac8-4935-a2e8-3d6ccc84044d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:04.678205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05ba49fb-8ac8-4935-a2e8-3d6ccc84044d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:04.685599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05ba49fb-8ac8-4935-a2e8-3d6ccc84044d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:04.686159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05ba49fb-8ac8-4935-a2e8-3d6ccc84044d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:04.687083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05ba49fb-8ac8-4935-a2e8-3d6ccc84044d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:04.687601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05ba49fb-8ac8-4935-a2e8-3d6ccc84044d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:04.726392 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05ba49fb-8ac8-4935-a2e8-3d6ccc84044d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 16395 microversion: 2.1 time: 0.055116 Nov 27 21:18:04.727215 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3432/6990] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:04 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 16395 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:05.738438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30352522-65ad-4524-9a54-b4c087aee232 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:05.740044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30352522-65ad-4524-9a54-b4c087aee232 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:05.748018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30352522-65ad-4524-9a54-b4c087aee232 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:05.748473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30352522-65ad-4524-9a54-b4c087aee232 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:05.749305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30352522-65ad-4524-9a54-b4c087aee232 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:05.749781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30352522-65ad-4524-9a54-b4c087aee232 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:05.792112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30352522-65ad-4524-9a54-b4c087aee232 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 16395 microversion: 2.1 time: 0.057734 Nov 27 21:18:05.795910 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3559/6991] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:05 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 16395 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:06.804196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3107423d-afd1-46c5-90b9-d20dd12a0855 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:06.805209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3107423d-afd1-46c5-90b9-d20dd12a0855 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:06.812618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3107423d-afd1-46c5-90b9-d20dd12a0855 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:06.813083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3107423d-afd1-46c5-90b9-d20dd12a0855 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:06.813887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3107423d-afd1-46c5-90b9-d20dd12a0855 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:06.814414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3107423d-afd1-46c5-90b9-d20dd12a0855 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:06.852611 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3107423d-afd1-46c5-90b9-d20dd12a0855 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 16395 microversion: 2.1 time: 0.052347 Nov 27 21:18:06.854413 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3433/6992] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:06 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 16395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:07.866269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-edc32324-be3d-4be5-b054-5bf6e9cdd015 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:07.867379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-edc32324-be3d-4be5-b054-5bf6e9cdd015 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:07.875427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edc32324-be3d-4be5-b054-5bf6e9cdd015 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:07.876045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edc32324-be3d-4be5-b054-5bf6e9cdd015 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:07.876794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edc32324-be3d-4be5-b054-5bf6e9cdd015 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:07.877229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-edc32324-be3d-4be5-b054-5bf6e9cdd015 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:07.926348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-edc32324-be3d-4be5-b054-5bf6e9cdd015 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.064670 Nov 27 21:18:07.927551 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3560/6993] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:07 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:08.938855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7a18b4f-030c-4d06-b66e-30f01c0af0f2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:08.939894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7a18b4f-030c-4d06-b66e-30f01c0af0f2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:08.947201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a18b4f-030c-4d06-b66e-30f01c0af0f2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:08.947926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a18b4f-030c-4d06-b66e-30f01c0af0f2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:08.949370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a18b4f-030c-4d06-b66e-30f01c0af0f2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:08.949823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7a18b4f-030c-4d06-b66e-30f01c0af0f2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:08.990875 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7a18b4f-030c-4d06-b66e-30f01c0af0f2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.055895 Nov 27 21:18:08.991761 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3434/6994] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:08 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:10.002450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-50547967-d8a7-4009-bf27-857e03cca21d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:10.003611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-50547967-d8a7-4009-bf27-857e03cca21d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:10.010855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50547967-d8a7-4009-bf27-857e03cca21d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:10.011914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50547967-d8a7-4009-bf27-857e03cca21d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:10.012694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50547967-d8a7-4009-bf27-857e03cca21d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:10.013129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-50547967-d8a7-4009-bf27-857e03cca21d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:10.053200 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-50547967-d8a7-4009-bf27-857e03cca21d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.054659 Nov 27 21:18:10.057053 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3561/6995] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:09 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:11.065611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e64f6202-3667-4516-94c4-81a01eab9af5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:11.066625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e64f6202-3667-4516-94c4-81a01eab9af5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:11.075423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e64f6202-3667-4516-94c4-81a01eab9af5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:11.075881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e64f6202-3667-4516-94c4-81a01eab9af5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:11.076675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e64f6202-3667-4516-94c4-81a01eab9af5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:11.077144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e64f6202-3667-4516-94c4-81a01eab9af5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:11.122155 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e64f6202-3667-4516-94c4-81a01eab9af5 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.060651 Nov 27 21:18:11.124526 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3435/6996] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:11 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:12.134989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-447a8dca-fcf9-42da-93e0-da8535bd3faa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:12.136151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-447a8dca-fcf9-42da-93e0-da8535bd3faa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:12.143829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-447a8dca-fcf9-42da-93e0-da8535bd3faa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:12.144332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-447a8dca-fcf9-42da-93e0-da8535bd3faa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:12.145154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-447a8dca-fcf9-42da-93e0-da8535bd3faa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:12.145660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-447a8dca-fcf9-42da-93e0-da8535bd3faa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:12.185461 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-447a8dca-fcf9-42da-93e0-da8535bd3faa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.055071 Nov 27 21:18:12.189577 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3562/6997] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:12 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:13.197285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a80f2422-331a-4c2d-9d75-057d75852986 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:13.198287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a80f2422-331a-4c2d-9d75-057d75852986 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:13.206217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a80f2422-331a-4c2d-9d75-057d75852986 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:13.206668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a80f2422-331a-4c2d-9d75-057d75852986 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:13.207474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a80f2422-331a-4c2d-9d75-057d75852986 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:13.207913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a80f2422-331a-4c2d-9d75-057d75852986 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:13.249890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a80f2422-331a-4c2d-9d75-057d75852986 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.056584 Nov 27 21:18:13.250545 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3436/6998] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:13 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:14.261805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5dd7ecdb-6193-4403-b5dc-7dcb6e00bb9b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:14.262803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5dd7ecdb-6193-4403-b5dc-7dcb6e00bb9b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:14.269923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dd7ecdb-6193-4403-b5dc-7dcb6e00bb9b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:14.270374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dd7ecdb-6193-4403-b5dc-7dcb6e00bb9b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:14.271152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dd7ecdb-6193-4403-b5dc-7dcb6e00bb9b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:14.271614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5dd7ecdb-6193-4403-b5dc-7dcb6e00bb9b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:14.316306 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5dd7ecdb-6193-4403-b5dc-7dcb6e00bb9b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.058489 Nov 27 21:18:14.317137 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3563/6999] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:14 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:15.328399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b871343-8835-4d8a-958a-02ac2a5fbd87 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:15.329532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b871343-8835-4d8a-958a-02ac2a5fbd87 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:15.336960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b871343-8835-4d8a-958a-02ac2a5fbd87 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:15.337769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b871343-8835-4d8a-958a-02ac2a5fbd87 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:15.338597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b871343-8835-4d8a-958a-02ac2a5fbd87 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:15.339319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b871343-8835-4d8a-958a-02ac2a5fbd87 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:15.381244 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b871343-8835-4d8a-958a-02ac2a5fbd87 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.056663 Nov 27 21:18:15.382081 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3437/7000] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:15 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:16.393679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b315485f-ab40-4ec0-a563-5e8d0e17b0b3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:16.394688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b315485f-ab40-4ec0-a563-5e8d0e17b0b3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:16.402523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b315485f-ab40-4ec0-a563-5e8d0e17b0b3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:16.403089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b315485f-ab40-4ec0-a563-5e8d0e17b0b3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:16.403932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b315485f-ab40-4ec0-a563-5e8d0e17b0b3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:16.404377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b315485f-ab40-4ec0-a563-5e8d0e17b0b3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:16.447588 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b315485f-ab40-4ec0-a563-5e8d0e17b0b3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.057831 Nov 27 21:18:16.448267 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3564/7001] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:16 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:17.460284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63aeeb1a-b6a1-4a60-baad-f821271f7200 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:17.461315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63aeeb1a-b6a1-4a60-baad-f821271f7200 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:17.468946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63aeeb1a-b6a1-4a60-baad-f821271f7200 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:17.469399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63aeeb1a-b6a1-4a60-baad-f821271f7200 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:17.470183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63aeeb1a-b6a1-4a60-baad-f821271f7200 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:17.470624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63aeeb1a-b6a1-4a60-baad-f821271f7200 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:17.510518 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63aeeb1a-b6a1-4a60-baad-f821271f7200 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.054177 Nov 27 21:18:17.511151 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3438/7002] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:17 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:18.522623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00c9a8b7-3b65-476d-a89b-bf2a94b84cc4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:18.523680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00c9a8b7-3b65-476d-a89b-bf2a94b84cc4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:18.531280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c9a8b7-3b65-476d-a89b-bf2a94b84cc4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:18.531735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c9a8b7-3b65-476d-a89b-bf2a94b84cc4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:18.532523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c9a8b7-3b65-476d-a89b-bf2a94b84cc4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:18.532961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00c9a8b7-3b65-476d-a89b-bf2a94b84cc4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:18.572783 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00c9a8b7-3b65-476d-a89b-bf2a94b84cc4 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.054303 Nov 27 21:18:18.573966 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3565/7003] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:18 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:19.585677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e41f9e49-6dac-4d22-9e48-4fce237df3f9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:19.586692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e41f9e49-6dac-4d22-9e48-4fce237df3f9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:19.594416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e41f9e49-6dac-4d22-9e48-4fce237df3f9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:19.594868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e41f9e49-6dac-4d22-9e48-4fce237df3f9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:19.595714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e41f9e49-6dac-4d22-9e48-4fce237df3f9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:19.596151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e41f9e49-6dac-4d22-9e48-4fce237df3f9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:19.634774 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e41f9e49-6dac-4d22-9e48-4fce237df3f9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.053259 Nov 27 21:18:19.636316 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3439/7004] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:19 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:20.646611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ba5e4d9-1f05-4676-b512-cdaf036bb615 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:20.647667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ba5e4d9-1f05-4676-b512-cdaf036bb615 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:20.654891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ba5e4d9-1f05-4676-b512-cdaf036bb615 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:20.655385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ba5e4d9-1f05-4676-b512-cdaf036bb615 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:20.656154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ba5e4d9-1f05-4676-b512-cdaf036bb615 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:20.656619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ba5e4d9-1f05-4676-b512-cdaf036bb615 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:20.695826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ba5e4d9-1f05-4676-b512-cdaf036bb615 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 24563 microversion: 2.1 time: 0.053261 Nov 27 21:18:20.696442 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3566/7005] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:20 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 24563 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:21.707772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0a13ca42-9fd7-4254-a44d-1610305828b0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:21.708792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0a13ca42-9fd7-4254-a44d-1610305828b0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:21.716397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a13ca42-9fd7-4254-a44d-1610305828b0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:21.716859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a13ca42-9fd7-4254-a44d-1610305828b0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:21.717656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a13ca42-9fd7-4254-a44d-1610305828b0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:21.718101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a13ca42-9fd7-4254-a44d-1610305828b0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:21.770318 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0a13ca42-9fd7-4254-a44d-1610305828b0 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.066441 Nov 27 21:18:21.771065 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3440/7006] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:21 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:22.783091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87189640-a29d-403c-a9de-d3d30871d3db tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:22.784145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-87189640-a29d-403c-a9de-d3d30871d3db tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:22.791460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87189640-a29d-403c-a9de-d3d30871d3db tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:22.792421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87189640-a29d-403c-a9de-d3d30871d3db tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:22.793218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87189640-a29d-403c-a9de-d3d30871d3db tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:22.793660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87189640-a29d-403c-a9de-d3d30871d3db tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:22.841857 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87189640-a29d-403c-a9de-d3d30871d3db tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.058253 Nov 27 21:18:22.841857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3567/7007] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:22 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:23.046821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40b515d8-d1b5-49e1-904d-59baff7f615c tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:23.047579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40b515d8-d1b5-49e1-904d-59baff7f615c tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:23.054870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b515d8-d1b5-49e1-904d-59baff7f615c tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.055554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b515d8-d1b5-49e1-904d-59baff7f615c tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.056351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b515d8-d1b5-49e1-904d-59baff7f615c tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.056794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b515d8-d1b5-49e1-904d-59baff7f615c tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.219525 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40b515d8-d1b5-49e1-904d-59baff7f615c tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1834 microversion: 2.1 time: 0.176694 Nov 27 21:18:23.220106 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3441/7008] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:23 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1834 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:23.236912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:23.237758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:23.245592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.246050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.246836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.247302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.389198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:23.397141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-54bb46ae-50d2-4632-8d9b-d76f5f0809d5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1683 microversion: 2.1 time: 0.164238 Nov 27 21:18:23.398221 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3568/7009] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:23 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:23.499064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e061c86-0adb-45a2-9ebb-557c29fdf079 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:23.500246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e061c86-0adb-45a2-9ebb-557c29fdf079 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:23.506839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e061c86-0adb-45a2-9ebb-557c29fdf079 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.507330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e061c86-0adb-45a2-9ebb-557c29fdf079 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.508113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e061c86-0adb-45a2-9ebb-557c29fdf079 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.508607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e061c86-0adb-45a2-9ebb-557c29fdf079 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.563132 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e061c86-0adb-45a2-9ebb-557c29fdf079 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action" status: 200 len: 32635 microversion: 2.1 time: 0.067683 Nov 27 21:18:23.571519 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3442/7010] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:23 2021] POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action => generated 32635 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:23.763709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:23.764279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:23.770427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.771100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.771910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.772364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.811795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd7f39669871844cf88f46f072f46fe15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414235e15cdd46bfad72cceefb31d6f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:23.812475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] flavor_id is None. Assuming migration. {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 27 21:18:23.812976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:18:23.849332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-829c84d7-8331-4c05-97ab-d3396e77427b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:23.850324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-829c84d7-8331-4c05-97ab-d3396e77427b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:23.857601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-829c84d7-8331-4c05-97ab-d3396e77427b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.858060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-829c84d7-8331-4c05-97ab-d3396e77427b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.858843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-829c84d7-8331-4c05-97ab-d3396e77427b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:23.859307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-829c84d7-8331-4c05-97ab-d3396e77427b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:23.901694 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-829c84d7-8331-4c05-97ab-d3396e77427b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.056229 Nov 27 21:18:23.902851 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3443/7011] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:23 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:24.047659 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5837760d-7f37-4868-99a1-0684ee65bb41 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action" status: 202 len: 0 microversion: 2.1 time: 0.288280 Nov 27 21:18:24.048451 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3569/7012] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:23 2021] POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:18:24.056764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:24.058180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:24.065812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:24.066326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:24.067151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:24.067620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:24.212999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:24.220519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7adad6ef-4e13-4609-9d4c-6a34a38772ba tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1692 microversion: 2.1 time: 0.167896 Nov 27 21:18:24.231041 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3444/7013] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:24 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:18:24.913606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f55a7858-729c-4f8b-801b-0bf4242c8748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:24.914826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f55a7858-729c-4f8b-801b-0bf4242c8748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:24.923650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f55a7858-729c-4f8b-801b-0bf4242c8748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:24.924045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f55a7858-729c-4f8b-801b-0bf4242c8748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:24.924958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f55a7858-729c-4f8b-801b-0bf4242c8748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:24.925395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f55a7858-729c-4f8b-801b-0bf4242c8748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:24.987218 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f55a7858-729c-4f8b-801b-0bf4242c8748 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.077148 Nov 27 21:18:24.988656 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3570/7014] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:24 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:25.238203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:25.238789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:25.245945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:25.246407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:25.247204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:25.247699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:25.379225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:25.387165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee499040-c37e-4944-bc64-151de2514abe tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1692 microversion: 2.1 time: 0.152844 Nov 27 21:18:25.387768 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3445/7015] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:25 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:26.002784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73a03b70-2534-401d-88fe-435c5f7a78fb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:26.004425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73a03b70-2534-401d-88fe-435c5f7a78fb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:26.027835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73a03b70-2534-401d-88fe-435c5f7a78fb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:26.028302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73a03b70-2534-401d-88fe-435c5f7a78fb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:26.029128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73a03b70-2534-401d-88fe-435c5f7a78fb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:26.029683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73a03b70-2534-401d-88fe-435c5f7a78fb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:26.084857 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73a03b70-2534-401d-88fe-435c5f7a78fb tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.086900 Nov 27 21:18:26.086190 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3571/7016] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:25 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:26.407569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:26.408394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:26.418118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:26.418576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:26.420109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:26.420565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:26.561171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:26.568501 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff3beb0b-b82b-4d3c-9681-4bcd2d3ebd40 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.167731 Nov 27 21:18:26.569085 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3446/7017] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:26 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:27.097704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-990e0813-dc92-45a2-aabe-493dfd5afb7f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:27.098703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-990e0813-dc92-45a2-aabe-493dfd5afb7f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:27.105953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-990e0813-dc92-45a2-aabe-493dfd5afb7f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:27.106400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-990e0813-dc92-45a2-aabe-493dfd5afb7f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:27.107174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-990e0813-dc92-45a2-aabe-493dfd5afb7f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:27.107639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-990e0813-dc92-45a2-aabe-493dfd5afb7f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:27.147216 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-990e0813-dc92-45a2-aabe-493dfd5afb7f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.053253 Nov 27 21:18:27.147918 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3572/7018] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:27 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:27.585733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:27.586342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:27.594006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:27.594556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:27.595443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:27.595881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:27.759977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:27.769518 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c293f92a-aa9a-49e2-972f-b884f1cf5667 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.187379 Nov 27 21:18:27.770587 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3447/7019] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:27 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:28.159655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4bed7577-345a-4ce6-a3cc-71c881db6244 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:28.160864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4bed7577-345a-4ce6-a3cc-71c881db6244 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:28.169058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bed7577-345a-4ce6-a3cc-71c881db6244 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:28.169530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bed7577-345a-4ce6-a3cc-71c881db6244 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:28.170319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bed7577-345a-4ce6-a3cc-71c881db6244 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:28.170762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bed7577-345a-4ce6-a3cc-71c881db6244 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:28.217667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4bed7577-345a-4ce6-a3cc-71c881db6244 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.061932 Nov 27 21:18:28.221402 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3573/7020] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:28 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:28.789424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:28.790075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:28.796880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:28.797345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:28.798145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:28.798597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:28.943564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:28.951830 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1c3e6131-6a05-408d-8e87-3c1dc6e1f0bf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.166151 Nov 27 21:18:28.952417 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3448/7021] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:28 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:29.230504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-719ae571-2a6c-41a1-9f99-365e47527d00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:29.231761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-719ae571-2a6c-41a1-9f99-365e47527d00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:29.239890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719ae571-2a6c-41a1-9f99-365e47527d00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:29.240347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719ae571-2a6c-41a1-9f99-365e47527d00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:29.241137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719ae571-2a6c-41a1-9f99-365e47527d00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:29.242353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-719ae571-2a6c-41a1-9f99-365e47527d00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:29.298898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-719ae571-2a6c-41a1-9f99-365e47527d00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.072257 Nov 27 21:18:29.299622 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3574/7022] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:29 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:29.969895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:29.970502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:29.977178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:29.977632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:29.978406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:29.978851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:30.109215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:30.116860 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0655d419-f95e-41b7-8944-c76ccf58e46b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.150640 Nov 27 21:18:30.117450 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3449/7023] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:29 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:30.316708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f12934e-ee8e-4154-9846-fa5af98ba718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:30.317785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f12934e-ee8e-4154-9846-fa5af98ba718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:30.325116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f12934e-ee8e-4154-9846-fa5af98ba718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:30.325575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f12934e-ee8e-4154-9846-fa5af98ba718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:30.326363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f12934e-ee8e-4154-9846-fa5af98ba718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:30.326805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f12934e-ee8e-4154-9846-fa5af98ba718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:30.375061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f12934e-ee8e-4154-9846-fa5af98ba718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062235 Nov 27 21:18:30.376163 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3575/7024] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:30 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:31.133887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:31.134412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:31.141151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:31.141611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:31.142395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:31.142839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:31.282588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:31.290476 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-adce8f31-7d22-4bb8-b9af-a419267729e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.160415 Nov 27 21:18:31.291055 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3450/7025] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:31 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:31.387929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6d170bc-69f0-4351-8b7b-50965a6be2f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:31.389116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6d170bc-69f0-4351-8b7b-50965a6be2f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:31.396751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d170bc-69f0-4351-8b7b-50965a6be2f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:31.397207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d170bc-69f0-4351-8b7b-50965a6be2f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:31.397989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d170bc-69f0-4351-8b7b-50965a6be2f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:31.398435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6d170bc-69f0-4351-8b7b-50965a6be2f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:31.447275 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6d170bc-69f0-4351-8b7b-50965a6be2f3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.064126 Nov 27 21:18:31.447928 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3576/7026] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:31 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:32.308656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:32.309595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:32.318279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:32.319542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:32.320712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:32.321491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:32.455906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:32.458358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6dedfddb-ad73-45a3-b911-6d7b4780cf07 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:32.459369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6dedfddb-ad73-45a3-b911-6d7b4780cf07 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:32.464271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2ce5589-a116-4874-bc68-130adaa3eb1e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.159353 Nov 27 21:18:32.464897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3451/7027] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:32 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:32.468295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dedfddb-ad73-45a3-b911-6d7b4780cf07 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:32.468742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dedfddb-ad73-45a3-b911-6d7b4780cf07 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:32.469515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dedfddb-ad73-45a3-b911-6d7b4780cf07 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:32.469952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dedfddb-ad73-45a3-b911-6d7b4780cf07 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:32.515278 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6dedfddb-ad73-45a3-b911-6d7b4780cf07 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.060781 Nov 27 21:18:32.516072 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3577/7028] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:32 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:33.481502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:33.482109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:33.489246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:33.489643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:33.490465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:33.490902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:33.527972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ee3a7aa-07d8-489e-b3df-463dc65f330b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:33.529075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8ee3a7aa-07d8-489e-b3df-463dc65f330b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:33.536650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee3a7aa-07d8-489e-b3df-463dc65f330b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:33.537191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee3a7aa-07d8-489e-b3df-463dc65f330b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:33.538059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee3a7aa-07d8-489e-b3df-463dc65f330b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:33.538572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ee3a7aa-07d8-489e-b3df-463dc65f330b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:33.589305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ee3a7aa-07d8-489e-b3df-463dc65f330b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.065909 Nov 27 21:18:33.590755 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3578/7029] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:33 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:33.625929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:33.633690 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c5ee5d5f-56bd-46cf-9468-89d5385bb75b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.156536 Nov 27 21:18:33.634275 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3452/7030] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:33 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:34.601708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-679e5fe7-84fa-433c-b1b5-a680717a23f6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:34.602929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-679e5fe7-84fa-433c-b1b5-a680717a23f6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:34.610610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679e5fe7-84fa-433c-b1b5-a680717a23f6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:34.611063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679e5fe7-84fa-433c-b1b5-a680717a23f6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:34.611866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679e5fe7-84fa-433c-b1b5-a680717a23f6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:34.612306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-679e5fe7-84fa-433c-b1b5-a680717a23f6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:34.651418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:34.652217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:34.655338 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-679e5fe7-84fa-433c-b1b5-a680717a23f6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.057571 Nov 27 21:18:34.658577 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3579/7031] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:34 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:34.659151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:34.659643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:34.660444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:34.660896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:34.800573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:34.811552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30aa9f0c-20f4-4e5e-b07b-aa67969d3604 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.163781 Nov 27 21:18:34.812144 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3453/7032] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:34 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:18:35.667960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6555ce72-dc0a-4535-a9ea-9492234cf41c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:35.668975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6555ce72-dc0a-4535-a9ea-9492234cf41c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:35.676309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6555ce72-dc0a-4535-a9ea-9492234cf41c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:35.676770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6555ce72-dc0a-4535-a9ea-9492234cf41c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:35.677584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6555ce72-dc0a-4535-a9ea-9492234cf41c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:35.678026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6555ce72-dc0a-4535-a9ea-9492234cf41c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:35.722795 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6555ce72-dc0a-4535-a9ea-9492234cf41c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.059354 Nov 27 21:18:35.723443 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3580/7033] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:35 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:35.828601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:35.829201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:35.836006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:35.836470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:35.837254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:35.837697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:35.974693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:35.984089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-45b4dc84-2200-4410-ae34-f9e7ba6e2bb0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.159273 Nov 27 21:18:35.984687 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3454/7034] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:35 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:36.735211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a74bf3c-8d58-4d74-81f0-a8162d15e9ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:36.736285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a74bf3c-8d58-4d74-81f0-a8162d15e9ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:36.744071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a74bf3c-8d58-4d74-81f0-a8162d15e9ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:36.744532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a74bf3c-8d58-4d74-81f0-a8162d15e9ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:36.745316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a74bf3c-8d58-4d74-81f0-a8162d15e9ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:36.745789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a74bf3c-8d58-4d74-81f0-a8162d15e9ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:36.795569 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a74bf3c-8d58-4d74-81f0-a8162d15e9ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.064170 Nov 27 21:18:36.796282 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3581/7035] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:36 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:37.007956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:37.008585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:37.017912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:37.018714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:37.019575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:37.020030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:37.154200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:37.161665 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d28c192f-0116-43e3-ac96-f01b798d821f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1697 microversion: 2.1 time: 0.163956 Nov 27 21:18:37.162244 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3455/7036] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:36 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:37.808357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-56367246-227d-4f1f-bfe7-612ff7a1c22f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:37.809500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56367246-227d-4f1f-bfe7-612ff7a1c22f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:37.816737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56367246-227d-4f1f-bfe7-612ff7a1c22f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:37.817196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56367246-227d-4f1f-bfe7-612ff7a1c22f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:37.817985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56367246-227d-4f1f-bfe7-612ff7a1c22f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:37.818430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56367246-227d-4f1f-bfe7-612ff7a1c22f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:37.866637 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-56367246-227d-4f1f-bfe7-612ff7a1c22f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062577 Nov 27 21:18:37.870495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3582/7037] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:37 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:38.177766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:38.178383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:38.185100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:38.185554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:38.186337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:38.186787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:38.470997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:38.480249 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-824b8278-f033-4ad4-8ec0-5b734c6401bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1696 microversion: 2.1 time: 0.306136 Nov 27 21:18:38.480838 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3456/7038] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:38 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1696 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:38.594081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9db7edd9-b289-48e1-a21a-625a5e541a80 req-de42aca5-a604-4ede-a9b2-2b381fc52845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "name": "network-vif-unplugged", "status": "completed", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:38.595779 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:18:38.595779 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:18:38.604674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9db7edd9-b289-48e1-a21a-625a5e541a80 req-de42aca5-a604-4ede-a9b2-2b381fc52845 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:38.605133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9db7edd9-b289-48e1-a21a-625a5e541a80 req-de42aca5-a604-4ede-a9b2-2b381fc52845 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:38.617202 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9db7edd9-b289-48e1-a21a-625a5e541a80 req-de42aca5-a604-4ede-a9b2-2b381fc52845 service nova] Creating event network-vif-unplugged:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch1-master-1 Nov 27 21:18:38.623458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-9db7edd9-b289-48e1-a21a-625a5e541a80 req-de42aca5-a604-4ede-a9b2-2b381fc52845 service nova] Instance 574a2a9f-412b-42f2-a43d-6d67068c3561 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:18:38.634727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9db7edd9-b289-48e1-a21a-625a5e541a80 req-de42aca5-a604-4ede-a9b2-2b381fc52845 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044769 Nov 27 21:18:38.635687 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3583/7039] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:18:38.880666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bc3a1feb-3521-47be-b762-30ac9af88de1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:38.881605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bc3a1feb-3521-47be-b762-30ac9af88de1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:38.888538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc3a1feb-3521-47be-b762-30ac9af88de1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:38.889004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc3a1feb-3521-47be-b762-30ac9af88de1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:38.890216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc3a1feb-3521-47be-b762-30ac9af88de1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:38.891182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bc3a1feb-3521-47be-b762-30ac9af88de1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:38.939463 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bc3a1feb-3521-47be-b762-30ac9af88de1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062291 Nov 27 21:18:38.940053 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3457/7040] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:38 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:39.499613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:39.500241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:39.506472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:39.506923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:39.507732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:39.508171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:39.663051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:39.672085 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fabd56cf-adeb-481d-9e5a-4be4ba6f436c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1696 microversion: 2.1 time: 0.177515 Nov 27 21:18:39.672668 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3584/7041] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:39 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:39.954116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9886d79-f914-4899-bf7d-9a51c21adba9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:39.955139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9886d79-f914-4899-bf7d-9a51c21adba9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:39.963871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9886d79-f914-4899-bf7d-9a51c21adba9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:39.964335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9886d79-f914-4899-bf7d-9a51c21adba9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:39.965149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9886d79-f914-4899-bf7d-9a51c21adba9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:39.965625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9886d79-f914-4899-bf7d-9a51c21adba9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:40.015702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9886d79-f914-4899-bf7d-9a51c21adba9 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.065440 Nov 27 21:18:40.016360 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3458/7042] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:39 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:40.650114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d25630fb-5726-4a3d-a88c-99ead0d27bc2 req-a569e787-3d68-4f89-b4fe-135ad7e9aa9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:40.652243 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:18:40.652243 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:18:40.659987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d25630fb-5726-4a3d-a88c-99ead0d27bc2 req-a569e787-3d68-4f89-b4fe-135ad7e9aa9a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:40.660436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d25630fb-5726-4a3d-a88c-99ead0d27bc2 req-a569e787-3d68-4f89-b4fe-135ad7e9aa9a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:40.672429 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d25630fb-5726-4a3d-a88c-99ead0d27bc2 req-a569e787-3d68-4f89-b4fe-135ad7e9aa9a service nova] Creating event network-changed:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch1-master-1 Nov 27 21:18:40.677629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-d25630fb-5726-4a3d-a88c-99ead0d27bc2 req-a569e787-3d68-4f89-b4fe-135ad7e9aa9a service nova] Instance 574a2a9f-412b-42f2-a43d-6d67068c3561 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:18:40.688040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d25630fb-5726-4a3d-a88c-99ead0d27bc2 req-a569e787-3d68-4f89-b4fe-135ad7e9aa9a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041549 Nov 27 21:18:40.689276 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3585/7043] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:18:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:18:40.689415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:40.690152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:40.697900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:40.698360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:40.699158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:40.699627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:41.028660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8553d552-2b71-4dba-8b4b-620b70502f9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:41.030065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8553d552-2b71-4dba-8b4b-620b70502f9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:41.042600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8553d552-2b71-4dba-8b4b-620b70502f9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:41.043063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8553d552-2b71-4dba-8b4b-620b70502f9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:41.044184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8553d552-2b71-4dba-8b4b-620b70502f9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:41.046211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8553d552-2b71-4dba-8b4b-620b70502f9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:41.090739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8553d552-2b71-4dba-8b4b-620b70502f9e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.067149 Nov 27 21:18:41.092323 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3586/7044] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:41 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:41.294986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:41.303773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6c222f12-dac5-4ea3-acdf-4b6d9471e4ff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1694 microversion: 2.1 time: 0.618234 Nov 27 21:18:41.304528 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3459/7045] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:40 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1694 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:18:42.102797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f3c4d93-9d75-4695-8ea1-ed0f6c01363e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:42.103890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f3c4d93-9d75-4695-8ea1-ed0f6c01363e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:42.111285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f3c4d93-9d75-4695-8ea1-ed0f6c01363e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.111803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f3c4d93-9d75-4695-8ea1-ed0f6c01363e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.112605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f3c4d93-9d75-4695-8ea1-ed0f6c01363e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.113029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f3c4d93-9d75-4695-8ea1-ed0f6c01363e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.153918 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f3c4d93-9d75-4695-8ea1-ed0f6c01363e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.055121 Nov 27 21:18:42.154548 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3587/7046] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:42 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:42.322588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:42.323233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:42.329958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.330421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.331195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.331660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.478260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:42.486726 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a279ab22-4508-4e9e-8784-72bd1f6d4360 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1691 microversion: 2.1 time: 0.168285 Nov 27 21:18:42.487338 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3460/7047] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:42 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:42.504094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c85e971-05bf-4d99-89ca-0b599ac273eb tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:42.504739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c85e971-05bf-4d99-89ca-0b599ac273eb tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:42.513003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c85e971-05bf-4d99-89ca-0b599ac273eb tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.513384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c85e971-05bf-4d99-89ca-0b599ac273eb tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.514173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c85e971-05bf-4d99-89ca-0b599ac273eb tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.514614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c85e971-05bf-4d99-89ca-0b599ac273eb tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.637697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c85e971-05bf-4d99-89ca-0b599ac273eb tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action" status: 202 len: 0 microversion: 2.1 time: 0.137653 Nov 27 21:18:42.638355 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3588/7048] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:42 2021] POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:18:42.646570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:42.647216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:42.656384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.657088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.658671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:42.659653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:42.895073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:42.902917 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40065eb8-4b90-4eed-897e-c0898a33d2dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1690 microversion: 2.1 time: 0.260432 Nov 27 21:18:42.903534 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3461/7049] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:42 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1690 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:43.166079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-62b94186-cc4f-4ef5-ae92-90e693fa33ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:43.167233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-62b94186-cc4f-4ef5-ae92-90e693fa33ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:43.174055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62b94186-cc4f-4ef5-ae92-90e693fa33ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:43.174525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62b94186-cc4f-4ef5-ae92-90e693fa33ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:43.175322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62b94186-cc4f-4ef5-ae92-90e693fa33ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:43.175766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62b94186-cc4f-4ef5-ae92-90e693fa33ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:43.218164 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-62b94186-cc4f-4ef5-ae92-90e693fa33ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.056370 Nov 27 21:18:43.222372 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3589/7050] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:43 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:43.920732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:43.921309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:43.928136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:43.928589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:43.929371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:43.929814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:44.062923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:44.070703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48f12ef4-2654-48cb-80f3-023a9abb13a4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1690 microversion: 2.1 time: 0.153744 Nov 27 21:18:44.071315 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3462/7051] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:43 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:44.232641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b95489cb-0540-4ed4-b00d-be6180d5190c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:44.233623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b95489cb-0540-4ed4-b00d-be6180d5190c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:44.241560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b95489cb-0540-4ed4-b00d-be6180d5190c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:44.242055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b95489cb-0540-4ed4-b00d-be6180d5190c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:44.242887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b95489cb-0540-4ed4-b00d-be6180d5190c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:44.243402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b95489cb-0540-4ed4-b00d-be6180d5190c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:44.283998 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b95489cb-0540-4ed4-b00d-be6180d5190c tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.057154 Nov 27 21:18:44.284633 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3590/7052] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:44 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:45.074577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a46a056f-00e4-4e13-b109-53cdb1fa0c51 req-958d58d7-c218-41c4-a25b-5c515db11c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "name": "network-vif-plugged", "status": "completed", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:45.076286 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:18:45.076286 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:18:45.085253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a46a056f-00e4-4e13-b109-53cdb1fa0c51 req-958d58d7-c218-41c4-a25b-5c515db11c35 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:45.086051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a46a056f-00e4-4e13-b109-53cdb1fa0c51 req-958d58d7-c218-41c4-a25b-5c515db11c35 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:45.090072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:45.091761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:45.099459 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a46a056f-00e4-4e13-b109-53cdb1fa0c51 req-958d58d7-c218-41c4-a25b-5c515db11c35 service nova] Creating event network-vif-plugged:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch1-master-1 Nov 27 21:18:45.100437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:45.101274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:45.102989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:45.104228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:45.106134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-a46a056f-00e4-4e13-b109-53cdb1fa0c51 req-958d58d7-c218-41c4-a25b-5c515db11c35 service nova] Instance 574a2a9f-412b-42f2-a43d-6d67068c3561 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:18:45.119741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a46a056f-00e4-4e13-b109-53cdb1fa0c51 req-958d58d7-c218-41c4-a25b-5c515db11c35 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049380 Nov 27 21:18:45.120392 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3463/7053] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:18:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:18:45.262721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:45.273067 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d902678b-c327-4f69-959e-003682f9c60e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1690 microversion: 2.1 time: 0.188377 Nov 27 21:18:45.273981 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3591/7054] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:45 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:45.297556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b05a7fc8-b596-407e-ad08-97440f7c70b1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:45.298584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b05a7fc8-b596-407e-ad08-97440f7c70b1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:45.313420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b05a7fc8-b596-407e-ad08-97440f7c70b1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:45.314610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b05a7fc8-b596-407e-ad08-97440f7c70b1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:45.314719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b05a7fc8-b596-407e-ad08-97440f7c70b1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:45.315188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b05a7fc8-b596-407e-ad08-97440f7c70b1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:45.380972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b05a7fc8-b596-407e-ad08-97440f7c70b1 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.088895 Nov 27 21:18:45.382878 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3464/7055] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:45 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:46.024268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7ae3af20-73e6-411d-a8db-d2aca0ef3c8e req-b4a46c91-3086-4d5f-a36f-1af9dca8c92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "name": "network-vif-unplugged", "status": "completed", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:46.027613 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:18:46.027613 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:18:46.037457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7ae3af20-73e6-411d-a8db-d2aca0ef3c8e req-b4a46c91-3086-4d5f-a36f-1af9dca8c92e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:46.037905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7ae3af20-73e6-411d-a8db-d2aca0ef3c8e req-b4a46c91-3086-4d5f-a36f-1af9dca8c92e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:46.050987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7ae3af20-73e6-411d-a8db-d2aca0ef3c8e req-b4a46c91-3086-4d5f-a36f-1af9dca8c92e service nova] Creating event network-vif-unplugged:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:18:46.056873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-7ae3af20-73e6-411d-a8db-d2aca0ef3c8e req-b4a46c91-3086-4d5f-a36f-1af9dca8c92e service nova] Instance 574a2a9f-412b-42f2-a43d-6d67068c3561 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:18:46.095312 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7ae3af20-73e6-411d-a8db-d2aca0ef3c8e req-b4a46c91-3086-4d5f-a36f-1af9dca8c92e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072994 Nov 27 21:18:46.096788 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3592/7056] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:18:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:18:46.297210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:46.297938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:46.311550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:46.313027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:46.314975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:46.315956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:46.395657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d48641d1-9355-4ac6-8809-57e75dc9cfd3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:46.397281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d48641d1-9355-4ac6-8809-57e75dc9cfd3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:46.408173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d48641d1-9355-4ac6-8809-57e75dc9cfd3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:46.409039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d48641d1-9355-4ac6-8809-57e75dc9cfd3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:46.410086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d48641d1-9355-4ac6-8809-57e75dc9cfd3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:46.410605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d48641d1-9355-4ac6-8809-57e75dc9cfd3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:46.472931 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d48641d1-9355-4ac6-8809-57e75dc9cfd3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.082102 Nov 27 21:18:46.473601 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3593/7057] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:46 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:46.548075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:46.555912 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11608be6-4fa9-46e9-a66b-b75f8fbba8ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1690 microversion: 2.1 time: 0.265341 Nov 27 21:18:46.557110 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3465/7058] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:46 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1690 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:47.485859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-31b636b9-ed5a-47ec-830b-e6a352a35cf7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:47.486972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-31b636b9-ed5a-47ec-830b-e6a352a35cf7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:47.494692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31b636b9-ed5a-47ec-830b-e6a352a35cf7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:47.495150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31b636b9-ed5a-47ec-830b-e6a352a35cf7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:47.495965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31b636b9-ed5a-47ec-830b-e6a352a35cf7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:47.496408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-31b636b9-ed5a-47ec-830b-e6a352a35cf7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:47.544370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-31b636b9-ed5a-47ec-830b-e6a352a35cf7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062422 Nov 27 21:18:47.548408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3594/7059] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:47 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:47.573294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:47.574005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:47.580931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:47.581407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:47.582301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:47.582854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:47.788669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:47.796605 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-836ae2bb-5786-4022-a829-7de84126ceee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1690 microversion: 2.1 time: 0.227614 Nov 27 21:18:47.797185 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3466/7060] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:47 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:48.111147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e9d6f20f-003a-40c6-927a-fa2e08f9141d req-4dbf5d0f-2c91-4e04-b4d3-ba8412a12a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:48.112677 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:18:48.112677 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:18:48.121162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e9d6f20f-003a-40c6-927a-fa2e08f9141d req-4dbf5d0f-2c91-4e04-b4d3-ba8412a12a71 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:48.121599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e9d6f20f-003a-40c6-927a-fa2e08f9141d req-4dbf5d0f-2c91-4e04-b4d3-ba8412a12a71 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:48.135125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e9d6f20f-003a-40c6-927a-fa2e08f9141d req-4dbf5d0f-2c91-4e04-b4d3-ba8412a12a71 service nova] Creating event network-changed:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:18:48.140551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-e9d6f20f-003a-40c6-927a-fa2e08f9141d req-4dbf5d0f-2c91-4e04-b4d3-ba8412a12a71 service nova] Instance 574a2a9f-412b-42f2-a43d-6d67068c3561 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:18:48.151801 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e9d6f20f-003a-40c6-927a-fa2e08f9141d req-4dbf5d0f-2c91-4e04-b4d3-ba8412a12a71 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044673 Nov 27 21:18:48.152658 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3595/7061] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:18:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:18:48.557535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2f2bce7a-8927-45fb-8295-04ee74457b71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:48.558841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2f2bce7a-8927-45fb-8295-04ee74457b71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:48.576916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f2bce7a-8927-45fb-8295-04ee74457b71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:48.578906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f2bce7a-8927-45fb-8295-04ee74457b71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:48.581655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f2bce7a-8927-45fb-8295-04ee74457b71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:48.582574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f2bce7a-8927-45fb-8295-04ee74457b71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:48.633294 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2f2bce7a-8927-45fb-8295-04ee74457b71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.080386 Nov 27 21:18:48.634111 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3467/7062] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:48 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:48.816651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:48.818140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:48.833731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:48.834696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:48.836136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:48.837833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:49.041028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:49.065225 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-359dd76b-20ca-4414-b315-e813774f4071 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1690 microversion: 2.1 time: 0.254138 Nov 27 21:18:49.065807 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3596/7063] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:48 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:49.646112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55b1cfb9-834f-4ea4-b656-ed42c8892c68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:49.647147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55b1cfb9-834f-4ea4-b656-ed42c8892c68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:49.654556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55b1cfb9-834f-4ea4-b656-ed42c8892c68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:49.655014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55b1cfb9-834f-4ea4-b656-ed42c8892c68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:49.655841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55b1cfb9-834f-4ea4-b656-ed42c8892c68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:49.656288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55b1cfb9-834f-4ea4-b656-ed42c8892c68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:49.704912 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55b1cfb9-834f-4ea4-b656-ed42c8892c68 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062629 Nov 27 21:18:49.705688 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3468/7064] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:49 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:50.082370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:50.082984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:50.090759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:50.091215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:50.092038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:50.092481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:50.256474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:50.264892 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a7b1aa0-3356-4b3a-970a-e8f75bd51321 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1690 microversion: 2.1 time: 0.186309 Nov 27 21:18:50.265474 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3597/7065] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:50 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:50.717109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d75ec7a0-04c7-47f8-89d6-0121cb4e3eaa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:50.718760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d75ec7a0-04c7-47f8-89d6-0121cb4e3eaa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:50.726559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75ec7a0-04c7-47f8-89d6-0121cb4e3eaa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:50.727010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75ec7a0-04c7-47f8-89d6-0121cb4e3eaa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:50.728474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75ec7a0-04c7-47f8-89d6-0121cb4e3eaa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:50.728943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d75ec7a0-04c7-47f8-89d6-0121cb4e3eaa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:50.773723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d75ec7a0-04c7-47f8-89d6-0121cb4e3eaa tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.060580 Nov 27 21:18:50.774510 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3469/7066] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:50 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:51.281881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:18:51.282809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:51.293854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:51.293854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:51.293854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:51.293854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:51.430128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:18:51.439222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81ca8315-713b-45ce-8cc8-15abcea15720 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1683 microversion: 2.1 time: 0.161235 Nov 27 21:18:51.439827 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3598/7067] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:18:51 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:18:51.786723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-330626da-31ef-4a9d-9bdd-b613fab62c90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:51.787786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-330626da-31ef-4a9d-9bdd-b613fab62c90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:51.795394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330626da-31ef-4a9d-9bdd-b613fab62c90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:51.795859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330626da-31ef-4a9d-9bdd-b613fab62c90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:51.796644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330626da-31ef-4a9d-9bdd-b613fab62c90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:51.797087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330626da-31ef-4a9d-9bdd-b613fab62c90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:51.838591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-330626da-31ef-4a9d-9bdd-b613fab62c90 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.056027 Nov 27 21:18:51.839513 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3470/7068] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:51 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:52.494815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a3fa495a-aa83-4750-bc64-7373770afcf5 req-cebd16b4-a936-4f88-86ca-558c78960b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "name": "network-vif-plugged", "status": "completed", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:52.497170 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:18:52.497170 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:18:52.507439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a3fa495a-aa83-4750-bc64-7373770afcf5 req-cebd16b4-a936-4f88-86ca-558c78960b69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:52.507885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a3fa495a-aa83-4750-bc64-7373770afcf5 req-cebd16b4-a936-4f88-86ca-558c78960b69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:52.522005 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a3fa495a-aa83-4750-bc64-7373770afcf5 req-cebd16b4-a936-4f88-86ca-558c78960b69 service nova] Creating event network-vif-plugged:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:18:52.528725 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a3fa495a-aa83-4750-bc64-7373770afcf5 req-cebd16b4-a936-4f88-86ca-558c78960b69 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039029 Nov 27 21:18:52.529450 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3599/7069] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:18:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:18:53.012613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5848193c-5766-44f9-bd85-b28c3d6354ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:53.013629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5848193c-5766-44f9-bd85-b28c3d6354ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:53.019836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5848193c-5766-44f9-bd85-b28c3d6354ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:53.020300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5848193c-5766-44f9-bd85-b28c3d6354ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:53.021120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5848193c-5766-44f9-bd85-b28c3d6354ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:53.021570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5848193c-5766-44f9-bd85-b28c3d6354ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:53.065503 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5848193c-5766-44f9-bd85-b28c3d6354ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.218933 Nov 27 21:18:53.066037 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3471/7070] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:52 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:54.078880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d057d58a-5e65-45da-a12d-c10f362616d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:54.080009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d057d58a-5e65-45da-a12d-c10f362616d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:54.086007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d057d58a-5e65-45da-a12d-c10f362616d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:54.086454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d057d58a-5e65-45da-a12d-c10f362616d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:54.087223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d057d58a-5e65-45da-a12d-c10f362616d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:54.087685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d057d58a-5e65-45da-a12d-c10f362616d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:54.131542 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d057d58a-5e65-45da-a12d-c10f362616d2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.057261 Nov 27 21:18:54.132389 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3600/7071] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:54 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:55.144106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bcd5886f-bbad-4c23-88bb-85f9167d0b4f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:55.145148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bcd5886f-bbad-4c23-88bb-85f9167d0b4f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:55.153192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd5886f-bbad-4c23-88bb-85f9167d0b4f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:55.153649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd5886f-bbad-4c23-88bb-85f9167d0b4f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:55.154439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd5886f-bbad-4c23-88bb-85f9167d0b4f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:55.154884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcd5886f-bbad-4c23-88bb-85f9167d0b4f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:55.202630 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bcd5886f-bbad-4c23-88bb-85f9167d0b4f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062429 Nov 27 21:18:55.203750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3472/7072] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:55 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:56.216137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d106109-08cd-41ff-92eb-50991c73b2e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:56.217542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d106109-08cd-41ff-92eb-50991c73b2e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:56.226105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d106109-08cd-41ff-92eb-50991c73b2e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:56.226664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d106109-08cd-41ff-92eb-50991c73b2e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:56.228346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d106109-08cd-41ff-92eb-50991c73b2e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:56.228880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d106109-08cd-41ff-92eb-50991c73b2e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:56.271097 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d106109-08cd-41ff-92eb-50991c73b2e8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.060097 Nov 27 21:18:56.271862 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3601/7073] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:56 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:57.284324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8b8368f3-9cdc-4844-90d9-7b2a8bb6a780 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:57.285652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8b8368f3-9cdc-4844-90d9-7b2a8bb6a780 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:57.293840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b8368f3-9cdc-4844-90d9-7b2a8bb6a780 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:57.294322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b8368f3-9cdc-4844-90d9-7b2a8bb6a780 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:57.295118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b8368f3-9cdc-4844-90d9-7b2a8bb6a780 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:57.295597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b8368f3-9cdc-4844-90d9-7b2a8bb6a780 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:57.336455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8b8368f3-9cdc-4844-90d9-7b2a8bb6a780 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.056003 Nov 27 21:18:57.340484 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3473/7074] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:57 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:18:58.348904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08d3e533-132e-4402-9681-c6444b6e5c2b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:58.350027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08d3e533-132e-4402-9681-c6444b6e5c2b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:58.357575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08d3e533-132e-4402-9681-c6444b6e5c2b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:58.358031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08d3e533-132e-4402-9681-c6444b6e5c2b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:58.358857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08d3e533-132e-4402-9681-c6444b6e5c2b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:58.359334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08d3e533-132e-4402-9681-c6444b6e5c2b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:58.407110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08d3e533-132e-4402-9681-c6444b6e5c2b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062161 Nov 27 21:18:58.408039 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3602/7075] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:58 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:18:59.420268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b830cda0-637c-4c9b-b103-ad078b58219e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:18:59.421489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b830cda0-637c-4c9b-b103-ad078b58219e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:18:59.437182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b830cda0-637c-4c9b-b103-ad078b58219e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:59.437759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b830cda0-637c-4c9b-b103-ad078b58219e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:59.438774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b830cda0-637c-4c9b-b103-ad078b58219e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:18:59.439477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b830cda0-637c-4c9b-b103-ad078b58219e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:18:59.488880 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b830cda0-637c-4c9b-b103-ad078b58219e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.073131 Nov 27 21:18:59.490387 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3474/7076] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:18:59 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:00.501227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ba9d8ce-bc22-444e-94bc-ff2387ae1718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:00.502319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ba9d8ce-bc22-444e-94bc-ff2387ae1718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:00.509779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ba9d8ce-bc22-444e-94bc-ff2387ae1718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:00.510235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ba9d8ce-bc22-444e-94bc-ff2387ae1718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:00.510990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ba9d8ce-bc22-444e-94bc-ff2387ae1718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:00.511454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ba9d8ce-bc22-444e-94bc-ff2387ae1718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:00.563970 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ba9d8ce-bc22-444e-94bc-ff2387ae1718 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.066545 Nov 27 21:19:00.564827 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3603/7077] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:00 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:01.576500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ac40618-7816-4970-a156-f13198f882df tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:01.577561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ac40618-7816-4970-a156-f13198f882df tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:01.584893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ac40618-7816-4970-a156-f13198f882df tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:01.585345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ac40618-7816-4970-a156-f13198f882df tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:01.586432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ac40618-7816-4970-a156-f13198f882df tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:01.587434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ac40618-7816-4970-a156-f13198f882df tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:01.640782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ac40618-7816-4970-a156-f13198f882df tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.068523 Nov 27 21:19:01.641440 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3475/7078] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:01 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:02.653959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11cfe510-42f1-4c0f-a835-bb5479604d5d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:02.654997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-11cfe510-42f1-4c0f-a835-bb5479604d5d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:02.662411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11cfe510-42f1-4c0f-a835-bb5479604d5d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:02.662861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11cfe510-42f1-4c0f-a835-bb5479604d5d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:02.663668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11cfe510-42f1-4c0f-a835-bb5479604d5d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:02.664104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11cfe510-42f1-4c0f-a835-bb5479604d5d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:02.709494 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-11cfe510-42f1-4c0f-a835-bb5479604d5d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.059527 Nov 27 21:19:02.710044 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3604/7079] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:02 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:03.720915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ff43858-c5e2-49eb-8141-77e342c74614 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:03.721852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ff43858-c5e2-49eb-8141-77e342c74614 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:03.729837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ff43858-c5e2-49eb-8141-77e342c74614 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:03.730296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ff43858-c5e2-49eb-8141-77e342c74614 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:03.731083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ff43858-c5e2-49eb-8141-77e342c74614 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:03.731529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ff43858-c5e2-49eb-8141-77e342c74614 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:03.777465 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ff43858-c5e2-49eb-8141-77e342c74614 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.060640 Nov 27 21:19:03.778150 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3476/7080] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:03 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:04.790103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68329eac-871d-4177-a96a-808009bdeda2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:04.791289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68329eac-871d-4177-a96a-808009bdeda2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:04.798753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68329eac-871d-4177-a96a-808009bdeda2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:04.799213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68329eac-871d-4177-a96a-808009bdeda2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:04.800041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68329eac-871d-4177-a96a-808009bdeda2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:04.800511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68329eac-871d-4177-a96a-808009bdeda2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:04.845124 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68329eac-871d-4177-a96a-808009bdeda2 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.059421 Nov 27 21:19:04.846611 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3605/7081] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:04 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:05.858309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f556f67-0ce5-4477-9785-cf9b28c81676 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:05.859528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f556f67-0ce5-4477-9785-cf9b28c81676 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:05.868707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f556f67-0ce5-4477-9785-cf9b28c81676 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:05.869350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f556f67-0ce5-4477-9785-cf9b28c81676 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:05.870210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f556f67-0ce5-4477-9785-cf9b28c81676 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:05.870664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f556f67-0ce5-4477-9785-cf9b28c81676 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:05.923451 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f556f67-0ce5-4477-9785-cf9b28c81676 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.069242 Nov 27 21:19:05.926028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3477/7082] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:05 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:06.938865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb559b08-5c6a-43f8-b4cc-f9f404c8dad3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:06.939986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb559b08-5c6a-43f8-b4cc-f9f404c8dad3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:06.949240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb559b08-5c6a-43f8-b4cc-f9f404c8dad3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:06.949691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb559b08-5c6a-43f8-b4cc-f9f404c8dad3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:06.950479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb559b08-5c6a-43f8-b4cc-f9f404c8dad3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:06.950920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb559b08-5c6a-43f8-b4cc-f9f404c8dad3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:07.002397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb559b08-5c6a-43f8-b4cc-f9f404c8dad3 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.068613 Nov 27 21:19:07.007071 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3606/7083] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:06 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:08.018538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cd5b1c4a-f62d-4c1b-ae41-591b6a3f1109 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:08.019646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cd5b1c4a-f62d-4c1b-ae41-591b6a3f1109 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:08.027493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd5b1c4a-f62d-4c1b-ae41-591b6a3f1109 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:08.027988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd5b1c4a-f62d-4c1b-ae41-591b6a3f1109 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:08.028825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd5b1c4a-f62d-4c1b-ae41-591b6a3f1109 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:08.029289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cd5b1c4a-f62d-4c1b-ae41-591b6a3f1109 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:08.084062 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cd5b1c4a-f62d-4c1b-ae41-591b6a3f1109 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.069879 Nov 27 21:19:08.084778 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3478/7084] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:08 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:19:09.097153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2259822c-acef-458e-8cce-be18dd6b6e89 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:09.098203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2259822c-acef-458e-8cce-be18dd6b6e89 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:09.106712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2259822c-acef-458e-8cce-be18dd6b6e89 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:09.107164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2259822c-acef-458e-8cce-be18dd6b6e89 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:09.107973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2259822c-acef-458e-8cce-be18dd6b6e89 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:09.108406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2259822c-acef-458e-8cce-be18dd6b6e89 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:09.165676 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2259822c-acef-458e-8cce-be18dd6b6e89 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.071916 Nov 27 21:19:09.166358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3607/7085] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:09 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:19:10.178983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28df5ccc-2aee-4a2c-9f3e-a0129f2a4486 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:10.180065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28df5ccc-2aee-4a2c-9f3e-a0129f2a4486 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:10.187967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28df5ccc-2aee-4a2c-9f3e-a0129f2a4486 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:10.188419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28df5ccc-2aee-4a2c-9f3e-a0129f2a4486 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:10.189221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28df5ccc-2aee-4a2c-9f3e-a0129f2a4486 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:10.189695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28df5ccc-2aee-4a2c-9f3e-a0129f2a4486 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:10.244805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28df5ccc-2aee-4a2c-9f3e-a0129f2a4486 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.069823 Nov 27 21:19:10.248856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3479/7086] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:10 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:11.257404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab8244d5-ad8a-4058-9302-5957f28f521a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:11.258448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab8244d5-ad8a-4058-9302-5957f28f521a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:11.266025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8244d5-ad8a-4058-9302-5957f28f521a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:11.266474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8244d5-ad8a-4058-9302-5957f28f521a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:11.267285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8244d5-ad8a-4058-9302-5957f28f521a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:11.267724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8244d5-ad8a-4058-9302-5957f28f521a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:11.318857 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab8244d5-ad8a-4058-9302-5957f28f521a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.065368 Nov 27 21:19:11.323106 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3608/7087] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:11 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:12.332511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd423bab-be9a-4831-9ee4-c9bc99e6db53 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:12.333775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd423bab-be9a-4831-9ee4-c9bc99e6db53 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:12.342525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd423bab-be9a-4831-9ee4-c9bc99e6db53 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:12.343130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd423bab-be9a-4831-9ee4-c9bc99e6db53 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:12.344162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd423bab-be9a-4831-9ee4-c9bc99e6db53 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:12.344737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd423bab-be9a-4831-9ee4-c9bc99e6db53 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:12.404064 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd423bab-be9a-4831-9ee4-c9bc99e6db53 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.076653 Nov 27 21:19:12.405165 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3480/7088] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:12 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:13.423109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61770c14-a62f-4815-9a5e-13c2fd0eac00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:13.424910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61770c14-a62f-4815-9a5e-13c2fd0eac00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:13.442206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61770c14-a62f-4815-9a5e-13c2fd0eac00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:13.442668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61770c14-a62f-4815-9a5e-13c2fd0eac00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:13.443498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61770c14-a62f-4815-9a5e-13c2fd0eac00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:13.443941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61770c14-a62f-4815-9a5e-13c2fd0eac00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:13.491294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61770c14-a62f-4815-9a5e-13c2fd0eac00 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.078644 Nov 27 21:19:13.491924 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3609/7089] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:13 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:14.503525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f56da566-3959-44fb-8b65-07ecfc974ca8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:14.504524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f56da566-3959-44fb-8b65-07ecfc974ca8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:14.512279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f56da566-3959-44fb-8b65-07ecfc974ca8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:14.512765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f56da566-3959-44fb-8b65-07ecfc974ca8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:14.513682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f56da566-3959-44fb-8b65-07ecfc974ca8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:14.514155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f56da566-3959-44fb-8b65-07ecfc974ca8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:14.563223 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f56da566-3959-44fb-8b65-07ecfc974ca8 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.063544 Nov 27 21:19:14.563913 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3481/7090] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:14 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:14.572222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1845389039", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "ebffb26f-bc13-421f-ad40-7f30998bc7a9"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:14.629075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] validate_networks() for [('ebffb26f-bc13-421f-ad40-7f30998bc7a9', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:19:15.032067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:19:15.032488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:19:15.032989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:19:15.033418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:19:15.033827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:19:15.043971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:15.044423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:15.045230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:15.045667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:15.061851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Getting quotas for project 05afa0d2a44144078e3fa7d820a95510. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:19:15.066947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Getting quotas for user 6e49ff29764540ae95d8b9d0f9d4fbfa and project 05afa0d2a44144078e3fa7d820a95510. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:19:15.078815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:19:15.081264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:19:15.125105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6f2b6a6-2899-4ad4-8dd8-f70c6503d8ef tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556889 Nov 27 21:19:15.125760 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3610/7091] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:19:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:19:15.136000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6aa20f2-a4dc-4fb0-95fa-af2921eba6bd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:15.136704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6aa20f2-a4dc-4fb0-95fa-af2921eba6bd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:15.197447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f6aa20f2-a4dc-4fb0-95fa-af2921eba6bd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:15.208973 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6aa20f2-a4dc-4fb0-95fa-af2921eba6bd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1219 microversion: 2.1 time: 0.076978 Nov 27 21:19:15.209556 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3482/7092] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:15 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:15.575730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-251cd5e6-8e7f-49bb-afee-f4d69a0dba71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:15.576621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-251cd5e6-8e7f-49bb-afee-f4d69a0dba71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:15.582679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251cd5e6-8e7f-49bb-afee-f4d69a0dba71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:15.583134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251cd5e6-8e7f-49bb-afee-f4d69a0dba71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:15.583957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251cd5e6-8e7f-49bb-afee-f4d69a0dba71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:15.584398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-251cd5e6-8e7f-49bb-afee-f4d69a0dba71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:15.630189 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-251cd5e6-8e7f-49bb-afee-f4d69a0dba71 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.058026 Nov 27 21:19:15.630857 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3611/7093] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:15 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:19:16.225732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:16.226350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:16.234491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:16.234950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:16.235774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:16.236221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:16.327230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:16.335689 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-421721aa-c407-4e46-a979-e2577ace40c8 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1277 microversion: 2.1 time: 0.113494 Nov 27 21:19:16.336750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3483/7094] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:16 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:16.642483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cabaacea-4f4c-4dff-8ce0-d4f3c07fe895 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:16.644372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cabaacea-4f4c-4dff-8ce0-d4f3c07fe895 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:16.652186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cabaacea-4f4c-4dff-8ce0-d4f3c07fe895 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:16.652636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cabaacea-4f4c-4dff-8ce0-d4f3c07fe895 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:16.653416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cabaacea-4f4c-4dff-8ce0-d4f3c07fe895 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:16.653851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cabaacea-4f4c-4dff-8ce0-d4f3c07fe895 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:16.698621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cabaacea-4f4c-4dff-8ce0-d4f3c07fe895 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.060040 Nov 27 21:19:16.699566 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3612/7095] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:16 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:17.280702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f56dccd7-749e-44c5-bcd4-1362e6a8d389 req-c6c577cf-353a-48ab-936c-ab36e2f42ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ed9439-0c1d-446a-aa57-1f6156dbfd86", "tag": "4fa0dea5-dabc-4ab8-bd75-07aa2809370a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:17.282616 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:19:17.282616 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:19:17.292679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f56dccd7-749e-44c5-bcd4-1362e6a8d389 req-c6c577cf-353a-48ab-936c-ab36e2f42ebb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:17.293219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f56dccd7-749e-44c5-bcd4-1362e6a8d389 req-c6c577cf-353a-48ab-936c-ab36e2f42ebb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:17.305375 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f56dccd7-749e-44c5-bcd4-1362e6a8d389 req-c6c577cf-353a-48ab-936c-ab36e2f42ebb service nova] Creating event network-changed:4fa0dea5-dabc-4ab8-bd75-07aa2809370a for instance e0ed9439-0c1d-446a-aa57-1f6156dbfd86 on nch2-master-1 Nov 27 21:19:17.310154 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f56dccd7-749e-44c5-bcd4-1362e6a8d389 req-c6c577cf-353a-48ab-936c-ab36e2f42ebb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033194 Nov 27 21:19:17.310760 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3484/7096] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:19:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:17.354214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:17.355053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:17.362280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:17.362743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:17.363870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:17.364520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:17.710813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8714ca7c-0bb5-4099-8e9d-675d9000279d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:17.712071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8714ca7c-0bb5-4099-8e9d-675d9000279d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:17.719330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8714ca7c-0bb5-4099-8e9d-675d9000279d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:17.719786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8714ca7c-0bb5-4099-8e9d-675d9000279d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:17.720584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8714ca7c-0bb5-4099-8e9d-675d9000279d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:17.721021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8714ca7c-0bb5-4099-8e9d-675d9000279d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:17.773380 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8714ca7c-0bb5-4099-8e9d-675d9000279d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.066779 Nov 27 21:19:17.774984 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3485/7097] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:17 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:19:17.785152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:17.793046 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8d1794b0-d001-4721-ac06-b242c28a0019 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1319 microversion: 2.1 time: 0.442999 Nov 27 21:19:17.793680 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3613/7098] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:17 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:18.786596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f755af5a-553c-47b5-9469-41b05a0083de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:18.787682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f755af5a-553c-47b5-9469-41b05a0083de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:18.794975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f755af5a-553c-47b5-9469-41b05a0083de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:18.795458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f755af5a-553c-47b5-9469-41b05a0083de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:18.796234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f755af5a-553c-47b5-9469-41b05a0083de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:18.796665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f755af5a-553c-47b5-9469-41b05a0083de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:18.810441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:18.811053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:18.821110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:18.821564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:18.823106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:18.823592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:18.845056 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f755af5a-553c-47b5-9469-41b05a0083de tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.062434 Nov 27 21:19:18.845939 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3486/7099] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:18 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:18.952456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:18.959851 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04796bf7-37a2-475e-8a0a-3782f1ee44c3 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1319 microversion: 2.1 time: 0.153232 Nov 27 21:19:18.960423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3614/7100] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:18 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:19:19.857344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5c5945b9-4eda-49fb-bcf9-699d84dcb3ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:19.858342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5c5945b9-4eda-49fb-bcf9-699d84dcb3ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:19.865926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c5945b9-4eda-49fb-bcf9-699d84dcb3ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:19.866375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c5945b9-4eda-49fb-bcf9-699d84dcb3ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:19.867149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c5945b9-4eda-49fb-bcf9-699d84dcb3ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:19.867617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5c5945b9-4eda-49fb-bcf9-699d84dcb3ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:19.911241 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5c5945b9-4eda-49fb-bcf9-699d84dcb3ca tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.057898 Nov 27 21:19:19.912158 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3487/7101] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:19 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:19.976094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:19.976746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:19.983413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:19.983857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:19.984623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:19.985056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:20.115672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:20.123438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2cede717-c7dc-4db3-a838-7a621986ff8c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1319 microversion: 2.1 time: 0.150927 Nov 27 21:19:20.124250 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3615/7102] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:19 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:20.922581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-627b578d-4710-40f8-bf28-fb155c7e4ebe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:20.923615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-627b578d-4710-40f8-bf28-fb155c7e4ebe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:20.931030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-627b578d-4710-40f8-bf28-fb155c7e4ebe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:20.931516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-627b578d-4710-40f8-bf28-fb155c7e4ebe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:20.932309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-627b578d-4710-40f8-bf28-fb155c7e4ebe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:20.932789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-627b578d-4710-40f8-bf28-fb155c7e4ebe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:20.982782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-627b578d-4710-40f8-bf28-fb155c7e4ebe tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.064102 Nov 27 21:19:20.986746 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3488/7103] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:20 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:19:21.140889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:21.141498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:21.148724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:21.149181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:21.149958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:21.150396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:21.281095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:21.288053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-690ae86c-c429-4782-b2a3-efd800408c86 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1319 microversion: 2.1 time: 0.150877 Nov 27 21:19:21.288634 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3616/7104] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:21 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:21.995372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af707f9d-5331-425a-9f61-42761bd64695 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:21.996370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af707f9d-5331-425a-9f61-42761bd64695 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:22.003471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af707f9d-5331-425a-9f61-42761bd64695 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:22.003868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af707f9d-5331-425a-9f61-42761bd64695 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:22.004641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af707f9d-5331-425a-9f61-42761bd64695 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:22.005077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af707f9d-5331-425a-9f61-42761bd64695 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:22.050632 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af707f9d-5331-425a-9f61-42761bd64695 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.059333 Nov 27 21:19:22.051294 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3489/7105] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:21 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:22.305594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:22.306196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:22.312931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:22.313374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:22.314142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:22.314573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:22.444978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:22.453842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b20b0535-6c9b-4b8a-895c-3bff847320cb tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1319 microversion: 2.1 time: 0.152250 Nov 27 21:19:22.454435 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3617/7106] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:22 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:22.617941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3c7898c0-f998-4f86-8357-56d23e6e14c8 req-6b3a8309-f781-42e0-9ab8-ad9e06506f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ed9439-0c1d-446a-aa57-1f6156dbfd86", "name": "network-vif-plugged", "status": "completed", "tag": "4fa0dea5-dabc-4ab8-bd75-07aa2809370a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:22.619472 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:19:22.619472 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:19:22.627800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3c7898c0-f998-4f86-8357-56d23e6e14c8 req-6b3a8309-f781-42e0-9ab8-ad9e06506f4a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:22.628256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3c7898c0-f998-4f86-8357-56d23e6e14c8 req-6b3a8309-f781-42e0-9ab8-ad9e06506f4a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:22.641037 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3c7898c0-f998-4f86-8357-56d23e6e14c8 req-6b3a8309-f781-42e0-9ab8-ad9e06506f4a service nova] Creating event network-vif-plugged:4fa0dea5-dabc-4ab8-bd75-07aa2809370a for instance e0ed9439-0c1d-446a-aa57-1f6156dbfd86 on nch2-master-1 Nov 27 21:19:22.646213 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3c7898c0-f998-4f86-8357-56d23e6e14c8 req-6b3a8309-f781-42e0-9ab8-ad9e06506f4a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033172 Nov 27 21:19:22.647240 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3490/7107] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:19:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:23.061834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16a3a312-06e7-4fd8-bdcd-21b922c81d54 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:23.062750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16a3a312-06e7-4fd8-bdcd-21b922c81d54 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:23.068713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16a3a312-06e7-4fd8-bdcd-21b922c81d54 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:23.069166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16a3a312-06e7-4fd8-bdcd-21b922c81d54 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:23.069948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16a3a312-06e7-4fd8-bdcd-21b922c81d54 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:23.070391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16a3a312-06e7-4fd8-bdcd-21b922c81d54 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:23.114342 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16a3a312-06e7-4fd8-bdcd-21b922c81d54 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.056096 Nov 27 21:19:23.114953 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3618/7108] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:23 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:23.471600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:23.472309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:23.478547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:23.479005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:23.479821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:23.480273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:23.609462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:23.617088 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e795877-d52d-4fb2-99ca-b2ced7a474a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1319 microversion: 2.1 time: 0.150405 Nov 27 21:19:23.617659 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3491/7109] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:23 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:23.827133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef7f0018-c1f5-4a07-94c8-865cd44e3cc5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:23.828225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef7f0018-c1f5-4a07-94c8-865cd44e3cc5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:23.834319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7f0018-c1f5-4a07-94c8-865cd44e3cc5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:23.834769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7f0018-c1f5-4a07-94c8-865cd44e3cc5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:23.835567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7f0018-c1f5-4a07-94c8-865cd44e3cc5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:23.836028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7f0018-c1f5-4a07-94c8-865cd44e3cc5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:23.887275 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef7f0018-c1f5-4a07-94c8-865cd44e3cc5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action" status: 200 len: 62742 microversion: 2.1 time: 0.224770 Nov 27 21:19:23.887915 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3619/7110] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:23 2021] POST /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561/action => generated 62742 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:24.126101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be2976d7-3236-4210-80c9-53dfb5e0b55e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:24.127066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be2976d7-3236-4210-80c9-53dfb5e0b55e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:24.134056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2976d7-3236-4210-80c9-53dfb5e0b55e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:24.134767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2976d7-3236-4210-80c9-53dfb5e0b55e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:24.135632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2976d7-3236-4210-80c9-53dfb5e0b55e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:24.136193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2976d7-3236-4210-80c9-53dfb5e0b55e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:24.180989 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be2976d7-3236-4210-80c9-53dfb5e0b55e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.058574 Nov 27 21:19:24.181916 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3492/7111] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:24 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:24.634404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:24.635102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:24.642021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:24.642465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:24.643227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:24.643685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:24.777199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:24.785006 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a2df896d-80a2-4ea7-ab0e-1a938afa6fc4 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1508 microversion: 2.1 time: 0.154695 Nov 27 21:19:24.785571 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3620/7112] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:24 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:25.194284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-faab5993-142c-4367-831b-b84010d32609 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:25.195984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-faab5993-142c-4367-831b-b84010d32609 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:25.204265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faab5993-142c-4367-831b-b84010d32609 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:25.204851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faab5993-142c-4367-831b-b84010d32609 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:25.215270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faab5993-142c-4367-831b-b84010d32609 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:25.215855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-faab5993-142c-4367-831b-b84010d32609 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:25.264315 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-faab5993-142c-4367-831b-b84010d32609 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.074410 Nov 27 21:19:25.265085 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3493/7113] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:25 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:26.276069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dbac1be5-67d7-466d-a7b7-2c6d7a0cf623 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:26.276989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dbac1be5-67d7-466d-a7b7-2c6d7a0cf623 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:26.284372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbac1be5-67d7-466d-a7b7-2c6d7a0cf623 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:26.284818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbac1be5-67d7-466d-a7b7-2c6d7a0cf623 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:26.285583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbac1be5-67d7-466d-a7b7-2c6d7a0cf623 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:26.286017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dbac1be5-67d7-466d-a7b7-2c6d7a0cf623 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:26.332761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dbac1be5-67d7-466d-a7b7-2c6d7a0cf623 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.060608 Nov 27 21:19:26.333487 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3621/7114] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:26 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:27.283506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fbcfad7d-3995-493f-af47-09a4c74b6c99 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "555cdd24-e7af-4c5f-85e7-abcbaa558327", "device": "/dev/sdb"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:27.284680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fbcfad7d-3995-493f-af47-09a4c74b6c99 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:27.292556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbcfad7d-3995-493f-af47-09a4c74b6c99 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:27.293009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbcfad7d-3995-493f-af47-09a4c74b6c99 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:27.293781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbcfad7d-3995-493f-af47-09a4c74b6c99 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:27.294217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fbcfad7d-3995-493f-af47-09a4c74b6c99 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:27.345648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-26f214c3-8a8e-4547-9073-04106634a44b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:27.346648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-26f214c3-8a8e-4547-9073-04106634a44b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:27.354431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26f214c3-8a8e-4547-9073-04106634a44b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:27.354885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26f214c3-8a8e-4547-9073-04106634a44b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:27.355716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26f214c3-8a8e-4547-9073-04106634a44b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:27.356155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-26f214c3-8a8e-4547-9073-04106634a44b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:27.400343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-26f214c3-8a8e-4547-9073-04106634a44b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.058667 Nov 27 21:19:27.401542 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3622/7115] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:27 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:19:27.526431 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fbcfad7d-3995-493f-af47-09a4c74b6c99 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "POST /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246986 Nov 27 21:19:27.527043 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3494/7116] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:19:27 2021] POST /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:28.412543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42fe0535-6e3e-4bba-a6cb-5fb360f7c16f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:28.413539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42fe0535-6e3e-4bba-a6cb-5fb360f7c16f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:28.421853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42fe0535-6e3e-4bba-a6cb-5fb360f7c16f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:28.422307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42fe0535-6e3e-4bba-a6cb-5fb360f7c16f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:28.423084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42fe0535-6e3e-4bba-a6cb-5fb360f7c16f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:28.423544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42fe0535-6e3e-4bba-a6cb-5fb360f7c16f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:28.467578 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42fe0535-6e3e-4bba-a6cb-5fb360f7c16f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.058616 Nov 27 21:19:28.468315 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3623/7117] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:28 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:29.480112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0dfaf65-d594-4e50-aa91-6ed745aeec69 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:29.481106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0dfaf65-d594-4e50-aa91-6ed745aeec69 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:29.488118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0dfaf65-d594-4e50-aa91-6ed745aeec69 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:29.488819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0dfaf65-d594-4e50-aa91-6ed745aeec69 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:29.489591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0dfaf65-d594-4e50-aa91-6ed745aeec69 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:29.490048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0dfaf65-d594-4e50-aa91-6ed745aeec69 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:29.535242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0dfaf65-d594-4e50-aa91-6ed745aeec69 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 32631 microversion: 2.1 time: 0.059176 Nov 27 21:19:29.536201 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3495/7118] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:29 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 32631 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:30.547294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92f6b627-1100-4aee-be42-f07c1a05e384 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:30.548292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92f6b627-1100-4aee-be42-f07c1a05e384 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:30.556136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f6b627-1100-4aee-be42-f07c1a05e384 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:30.556584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f6b627-1100-4aee-be42-f07c1a05e384 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:30.557351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f6b627-1100-4aee-be42-f07c1a05e384 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:30.557789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92f6b627-1100-4aee-be42-f07c1a05e384 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:30.609707 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92f6b627-1100-4aee-be42-f07c1a05e384 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action" status: 200 len: 40783 microversion: 2.1 time: 0.066296 Nov 27 21:19:30.610364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3624/7119] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:19:30 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/action => generated 40783 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:19:30.621518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebc42757-184a-402b-9da2-c1b13c27f5f7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:30.622095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebc42757-184a-402b-9da2-c1b13c27f5f7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:30.629567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc42757-184a-402b-9da2-c1b13c27f5f7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:30.630016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc42757-184a-402b-9da2-c1b13c27f5f7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:30.630793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc42757-184a-402b-9da2-c1b13c27f5f7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:30.631230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc42757-184a-402b-9da2-c1b13c27f5f7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:30.654978 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebc42757-184a-402b-9da2-c1b13c27f5f7 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/ips" status: 200 len: 145 microversion: 2.1 time: 0.038074 Nov 27 21:19:30.655573 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3496/7120] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:19:30 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:31.964064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f5833fc-8042-4440-996a-f4d1f028c3c8"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:31.965019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:31.972336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:31.972789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:31.973567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:31.973998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:32.229639 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a5b3270-ac48-47ba-a4d6-02a8db658f6f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270430 Nov 27 21:19:32.230255 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3625/7121] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:19:31 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:35.508895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f6c8111-6d48-4ecc-8b23-21c4a092336b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:35.509820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5f6c8111-6d48-4ecc-8b23-21c4a092336b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:35.516854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f6c8111-6d48-4ecc-8b23-21c4a092336b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:35.517312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f6c8111-6d48-4ecc-8b23-21c4a092336b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:35.518106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f6c8111-6d48-4ecc-8b23-21c4a092336b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:35.518546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f6c8111-6d48-4ecc-8b23-21c4a092336b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:35.551126 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f6c8111-6d48-4ecc-8b23-21c4a092336b tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Nov 27 21:19:35.551737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3497/7122] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:19:35 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:35.563663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7c2f7883-7e24-410d-9297-7facb5f0f373 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:35.564242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7c2f7883-7e24-410d-9297-7facb5f0f373 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:35.570362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c2f7883-7e24-410d-9297-7facb5f0f373 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:35.570805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c2f7883-7e24-410d-9297-7facb5f0f373 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:35.571601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c2f7883-7e24-410d-9297-7facb5f0f373 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:35.572037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c2f7883-7e24-410d-9297-7facb5f0f373 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:35.603087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7c2f7883-7e24-410d-9297-7facb5f0f373 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/5f5833fc-8042-4440-996a-f4d1f028c3c8" status: 200 len: 194 microversion: 2.1 time: 0.044482 Nov 27 21:19:35.603702 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3626/7123] 10.222.0.21 () {58 vars in 1412 bytes} [Sat Nov 27 21:19:35 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/5f5833fc-8042-4440-996a-f4d1f028c3c8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:36.896499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cafa9637-d149-456a-b338-409aa272aa0b"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:36.897602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:36.904444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:36.904906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:36.905695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:36.906145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:37.141710 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64c4ac2d-d3c5-4cbf-9618-ed246e584896 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248808 Nov 27 21:19:37.142316 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3498/7124] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:19:36 2021] POST /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:40.408002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b837361-e2e2-4392-848d-ef63106820ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:40.408984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b837361-e2e2-4392-848d-ef63106820ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:40.417373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b837361-e2e2-4392-848d-ef63106820ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:40.417854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b837361-e2e2-4392-848d-ef63106820ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:40.418759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b837361-e2e2-4392-848d-ef63106820ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:40.419197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b837361-e2e2-4392-848d-ef63106820ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:40.449380 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b837361-e2e2-4392-848d-ef63106820ee tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045200 Nov 27 21:19:40.449955 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3627/7125] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:19:40 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:40.654342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6c6708c-ffb9-46a9-85e0-6b355102b43f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:40.654916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6c6708c-ffb9-46a9-85e0-6b355102b43f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:40.661065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6c6708c-ffb9-46a9-85e0-6b355102b43f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:40.661514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6c6708c-ffb9-46a9-85e0-6b355102b43f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:40.662287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6c6708c-ffb9-46a9-85e0-6b355102b43f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:40.662721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6c6708c-ffb9-46a9-85e0-6b355102b43f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:40.691272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6c6708c-ffb9-46a9-85e0-6b355102b43f tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/5f5833fc-8042-4440-996a-f4d1f028c3c8" status: 200 len: 194 microversion: 2.1 time: 0.041967 Nov 27 21:19:40.691860 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3499/7126] 10.222.0.21 () {58 vars in 1412 bytes} [Sat Nov 27 21:19:40 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/5f5833fc-8042-4440-996a-f4d1f028c3c8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:40.701722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:40.702245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:40.708638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:40.709087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:40.709861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:40.711005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:40.786427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lazy-loading 'services' on Instance uuid d4756739-b69b-486b-bcb3-faf9e9748ad9 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:19:40.852589 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-017f2cb5-081b-4054-a8c5-626a5baf9e31 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/5f5833fc-8042-4440-996a-f4d1f028c3c8" status: 202 len: 0 microversion: 2.1 time: 0.154425 Nov 27 21:19:40.853275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3628/7127] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:19:40 2021] DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/5f5833fc-8042-4440-996a-f4d1f028c3c8 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:19:41.959139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b7449e1-b83f-4412-8820-7a630eee014d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:41.959694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b7449e1-b83f-4412-8820-7a630eee014d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:41.966934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b7449e1-b83f-4412-8820-7a630eee014d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:41.967439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b7449e1-b83f-4412-8820-7a630eee014d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:41.968228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b7449e1-b83f-4412-8820-7a630eee014d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:41.968677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b7449e1-b83f-4412-8820-7a630eee014d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:41.997934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b7449e1-b83f-4412-8820-7a630eee014d tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/cafa9637-d149-456a-b338-409aa272aa0b" status: 200 len: 194 microversion: 2.1 time: 0.042578 Nov 27 21:19:41.998526 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3500/7128] 10.222.0.21 () {58 vars in 1412 bytes} [Sat Nov 27 21:19:41 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/cafa9637-d149-456a-b338-409aa272aa0b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:42.009205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:42.009777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:42.015863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:42.016308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:42.017075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:42.017507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:42.093926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lazy-loading 'services' on Instance uuid d4756739-b69b-486b-bcb3-faf9e9748ad9 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:19:42.160176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68de628b-f672-46d3-85dd-b128b04971ce tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/cafa9637-d149-456a-b338-409aa272aa0b" status: 202 len: 0 microversion: 2.1 time: 0.155669 Nov 27 21:19:42.160754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3629/7129] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:19:42 2021] DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments/cafa9637-d149-456a-b338-409aa272aa0b => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:19:43.316563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f24d524e-feef-43ba-8e21-7d81a3c8a96a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:43.317549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f24d524e-feef-43ba-8e21-7d81a3c8a96a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:43.324210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f24d524e-feef-43ba-8e21-7d81a3c8a96a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.324665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f24d524e-feef-43ba-8e21-7d81a3c8a96a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.325447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f24d524e-feef-43ba-8e21-7d81a3c8a96a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.325885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f24d524e-feef-43ba-8e21-7d81a3c8a96a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.358504 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f24d524e-feef-43ba-8e21-7d81a3c8a96a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045713 Nov 27 21:19:43.359082 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3501/7130] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:19:43 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:19:43.461929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-540cd792-cabb-49a6-89f8-c5fe9da53488 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:43.462938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-540cd792-cabb-49a6-89f8-c5fe9da53488 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:43.469190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-540cd792-cabb-49a6-89f8-c5fe9da53488 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.469620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-540cd792-cabb-49a6-89f8-c5fe9da53488 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.470401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-540cd792-cabb-49a6-89f8-c5fe9da53488 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.470836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-540cd792-cabb-49a6-89f8-c5fe9da53488 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.500205 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-540cd792-cabb-49a6-89f8-c5fe9da53488 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044694 Nov 27 21:19:43.500676 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3630/7131] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:19:43 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:19:43.555586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:43.556090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:43.561981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.562436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.563212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.563680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.588329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:19:43.661891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54634a8f-045d-43d1-aee9-acdff2f040a6 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 204 len: 0 microversion: 2.1 time: 0.109556 Nov 27 21:19:43.662707 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3502/7132] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:19:43 2021] DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:19:43.672627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:43.673308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:43.679114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.679662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.680435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:43.680871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:43.811773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:43.819728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2911f267-de92-4bc0-9b94-082f3e279587 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1672 microversion: 2.1 time: 0.151536 Nov 27 21:19:43.820331 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3631/7133] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:43 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:19:44.838287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:44.838989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:44.845702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:44.846152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:44.846921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:44.847384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:44.977770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:44.985286 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3ba16c72-a82c-4cc7-ad67-be42d40b548e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1672 microversion: 2.1 time: 0.151533 Nov 27 21:19:44.985849 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3503/7134] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:44 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:46.001685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:46.002361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:46.009076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:46.009523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:46.010292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:46.010724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:46.145640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b771da0354414b239da0cad505f8ffe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219be90852c0481aaad9862d1a485102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:46.153098 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff9d1638-f379-40d9-a5e0-436c70b5ce2e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 200 len: 1672 microversion: 2.1 time: 0.155038 Nov 27 21:19:46.153672 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3632/7135] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:45 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:46.609494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b9a4ae7f-d52d-4dee-a3a0-ccb6cc64d8d0 req-17e91cb5-4bc8-4525-b348-2c5710fca9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4756739-b69b-486b-bcb3-faf9e9748ad9", "name": "network-vif-deleted", "tag": "b7a3b32c-565f-4c0c-a9ae-31669d910917"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:46.611438 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:19:46.611438 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:19:46.620333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b9a4ae7f-d52d-4dee-a3a0-ccb6cc64d8d0 req-17e91cb5-4bc8-4525-b348-2c5710fca9f4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:46.621365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b9a4ae7f-d52d-4dee-a3a0-ccb6cc64d8d0 req-17e91cb5-4bc8-4525-b348-2c5710fca9f4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:46.643403 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b9a4ae7f-d52d-4dee-a3a0-ccb6cc64d8d0 req-17e91cb5-4bc8-4525-b348-2c5710fca9f4 service nova] Creating event network-vif-deleted:b7a3b32c-565f-4c0c-a9ae-31669d910917 for instance d4756739-b69b-486b-bcb3-faf9e9748ad9 on nch1-master-1 Nov 27 21:19:46.649017 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b9a4ae7f-d52d-4dee-a3a0-ccb6cc64d8d0 req-17e91cb5-4bc8-4525-b348-2c5710fca9f4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044929 Nov 27 21:19:46.650061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3504/7136] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:19:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:46.854334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43e932e3-7279-43fb-80d7-48d46ff36680 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:46.855073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43e932e3-7279-43fb-80d7-48d46ff36680 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:46.861381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e932e3-7279-43fb-80d7-48d46ff36680 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:46.861919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e932e3-7279-43fb-80d7-48d46ff36680 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:46.862722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e932e3-7279-43fb-80d7-48d46ff36680 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:46.863453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43e932e3-7279-43fb-80d7-48d46ff36680 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:46.991859 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43e932e3-7279-43fb-80d7-48d46ff36680 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1834 microversion: 2.1 time: 0.268222 Nov 27 21:19:46.992640 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3633/7137] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:46 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1834 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:47.170881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:47.171686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:47.184839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:47.185615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:47.187799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:47.189876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:47.212866 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] HTTP exception thrown: Instance d4756739-b69b-486b-bcb3-faf9e9748ad9 could not be found. Nov 27 21:19:47.214592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Returning 404 to user: Instance d4756739-b69b-486b-bcb3-faf9e9748ad9 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:47.214944 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9ecac68-9bf8-4499-8855-582c7e73252a tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 404 len: 111 microversion: 2.1 time: 0.048629 Nov 27 21:19:47.216035 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3505/7138] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:47 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:19:47.224913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4afa8ea2-d1ea-47d5-97a4-a2fedc210e1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '.version_select at 0x7f15d448aa60>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:47.252301 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4afa8ea2-d1ea-47d5-97a4-a2fedc210e1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-174928718" status: 202 len: 0 microversion: 2.1 time: 0.031909 Nov 27 21:19:47.253410 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3634/7139] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 21:19:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-174928718 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:19:48.029961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:48.031806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:48.041790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:48.042550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:48.043562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:48.044489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:48.083654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:19:48.096181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b751c90e-4875-48b0-b455-010e494af939 req-4897d8c8-dc3b-467e-852b-1eb42833d2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:48.097933 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:19:48.097933 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:19:48.108339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b751c90e-4875-48b0-b455-010e494af939 req-4897d8c8-dc3b-467e-852b-1eb42833d2d3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:48.109055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b751c90e-4875-48b0-b455-010e494af939 req-4897d8c8-dc3b-467e-852b-1eb42833d2d3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:48.122328 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b751c90e-4875-48b0-b455-010e494af939 req-4897d8c8-dc3b-467e-852b-1eb42833d2d3 service nova] Creating event network-changed:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:19:48.128383 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b751c90e-4875-48b0-b455-010e494af939 req-4897d8c8-dc3b-467e-852b-1eb42833d2d3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100875 Nov 27 21:19:48.129813 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3635/7140] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:19:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:19:48.178736 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f2aee4f-c0d5-473e-b30a-bd9bf318e68c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 204 len: 0 microversion: 2.1 time: 0.153401 Nov 27 21:19:48.179465 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3506/7141] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:19:48 2021] DELETE /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:19:48.188981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:48.189937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:48.197639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:48.198090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:48.199176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:48.199792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:48.370780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:48.386681 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f0d7de9-3bb2-4baa-8eb7-9dd046aff591 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1689 microversion: 2.1 time: 0.199583 Nov 27 21:19:48.387722 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3636/7142] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:48 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:49.405190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:49.405894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:49.412673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:49.413698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:49.414482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:49.414931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:49.557540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:49.565054 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8f2db37-9e2c-4b62-b528-fefd70d4a873 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1571 microversion: 2.1 time: 0.164001 Nov 27 21:19:49.565659 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3507/7143] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:49 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:50.263154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cd9a3143-9786-4bfa-8f00-f961b76422d1 req-dac7ab4b-e358-46a0-947b-8901931f5a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a2a9f-412b-42f2-a43d-6d67068c3561", "name": "network-vif-deleted", "tag": "5d76ab98-d439-4b56-b1f0-050a0b18eded"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:50.264713 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:19:50.264713 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:19:50.279470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd9a3143-9786-4bfa-8f00-f961b76422d1 req-dac7ab4b-e358-46a0-947b-8901931f5a74 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:50.279922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd9a3143-9786-4bfa-8f00-f961b76422d1 req-dac7ab4b-e358-46a0-947b-8901931f5a74 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:50.293184 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cd9a3143-9786-4bfa-8f00-f961b76422d1 req-dac7ab4b-e358-46a0-947b-8901931f5a74 service nova] Creating event network-vif-deleted:5d76ab98-d439-4b56-b1f0-050a0b18eded for instance 574a2a9f-412b-42f2-a43d-6d67068c3561 on nch2-master-1 Nov 27 21:19:50.300588 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cd9a3143-9786-4bfa-8f00-f961b76422d1 req-dac7ab4b-e358-46a0-947b-8901931f5a74 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043050 Nov 27 21:19:50.301199 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3637/7144] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:19:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:19:50.581756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:50.583068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:50.590877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:50.591545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:50.592476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:50.593039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:50.630878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:50.631465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:50.632005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lazy-loading 'fault' on Instance uuid 574a2a9f-412b-42f2-a43d-6d67068c3561 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:19:50.672803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:19:50.681008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0b84ba78-52a8-4c65-9fa1-3e817daa14bc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 200 len: 1357 microversion: 2.1 time: 0.103023 Nov 27 21:19:50.681592 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3508/7145] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:50 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:50.968945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:50.969604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:50.979509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:50.980212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:50.981587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:50.982026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:50.997479 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] HTTP exception thrown: Instance d4756739-b69b-486b-bcb3-faf9e9748ad9 could not be found. Nov 27 21:19:50.998137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Returning 404 to user: Instance d4756739-b69b-486b-bcb3-faf9e9748ad9 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:50.998977 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5c52ff5f-b3f6-4f72-b98d-f1702849f285 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 404 len: 111 microversion: 2.1 time: 0.037828 Nov 27 21:19:50.999590 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3638/7146] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:19:50 2021] DELETE /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:19:51.007880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:51.008644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: d4756739-b69b-486b-bcb3-faf9e9748ad9] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:51.015348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:51.015882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:51.016767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:51.017287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:51.033280 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] HTTP exception thrown: Instance d4756739-b69b-486b-bcb3-faf9e9748ad9 could not be found. Nov 27 21:19:51.033958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Returning 404 to user: Instance d4756739-b69b-486b-bcb3-faf9e9748ad9 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:51.034872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab2da522-8838-4609-95d5-e6be7c24fd1e tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9" status: 404 len: 111 microversion: 2.1 time: 0.031068 Nov 27 21:19:51.035687 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3509/7147] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:51 2021] GET /compute/v2.1/servers/d4756739-b69b-486b-bcb3-faf9e9748ad9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:19:51.697864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:51.698424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 574a2a9f-412b-42f2-a43d-6d67068c3561] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:51.705117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:51.705563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:51.706337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:51.706777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:51.720394 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] HTTP exception thrown: Instance 574a2a9f-412b-42f2-a43d-6d67068c3561 could not be found. Nov 27 21:19:51.720968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Returning 404 to user: Instance 574a2a9f-412b-42f2-a43d-6d67068c3561 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:51.721775 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5db1575f-1a93-4c47-ad4e-ce5f7d6ae53a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561" status: 404 len: 111 microversion: 2.1 time: 0.027725 Nov 27 21:19:51.722290 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3639/7148] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:51 2021] GET /compute/v2.1/servers/574a2a9f-412b-42f2-a43d-6d67068c3561 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:19:52.164370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:52.164894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:52.171179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:52.171664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:52.172450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:52.172895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:52.186543 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] HTTP exception thrown: Instance 16595aec-62b0-4a81-8923-9071b7521bfe could not be found. Nov 27 21:19:52.187160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Returning 404 to user: Instance 16595aec-62b0-4a81-8923-9071b7521bfe could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:52.188016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d356f8a2-9f3b-491e-959c-4d0a28c10475 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "DELETE /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 404 len: 111 microversion: 2.1 time: 0.027581 Nov 27 21:19:52.188590 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3510/7149] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:19:52 2021] DELETE /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:19:52.197395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:52.198251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] [instance: 16595aec-62b0-4a81-8923-9071b7521bfe] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:19:52.204331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:52.204888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:52.205717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:19:52.206280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:19:52.220244 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] HTTP exception thrown: Instance 16595aec-62b0-4a81-8923-9071b7521bfe could not be found. Nov 27 21:19:52.220828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] Returning 404 to user: Instance 16595aec-62b0-4a81-8923-9071b7521bfe could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:52.222274 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fcee5d17-f90f-415b-b5a8-5e9204263e20 tempest-AttachVolumeTestJSON-1651489591 tempest-AttachVolumeTestJSON-1651489591-project] 10.222.0.21 "GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe" status: 404 len: 111 microversion: 2.1 time: 0.029430 Nov 27 21:19:52.222816 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3640/7150] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:19:52 2021] GET /compute/v2.1/servers/16595aec-62b0-4a81-8923-9071b7521bfe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:19:55.497917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81e5ff56-f855-459e-8068-02ebbfdc8df8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '.version_select at 0x7f15c787a670>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:55.521616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81e5ff56-f855-459e-8068-02ebbfdc8df8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2076682201" status: 202 len: 0 microversion: 2.1 time: 0.027676 Nov 27 21:19:55.522289 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3511/7151] 10.222.0.21 () {58 vars in 1283 bytes} [Sat Nov 27 21:19:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2076682201 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:19:55.556959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-300e8a4b-6f8e-4717-9aa6-c86eb913acff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: .version_select at 0x7f15d9529dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-743160686"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:55.572704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-300e8a4b-6f8e-4717-9aa6-c86eb913acff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:19:55.578942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-300e8a4b-6f8e-4717-9aa6-c86eb913acff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:19:55.826071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-300e8a4b-6f8e-4717-9aa6-c86eb913acff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:19:55.831963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-300e8a4b-6f8e-4717-9aa6-c86eb913acff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:19:55.847193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-300e8a4b-6f8e-4717-9aa6-c86eb913acff tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.296890 Nov 27 21:19:55.847877 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3641/7152] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:19:55 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:19:57.326475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a001eea0-5276-4c51-8ac6-4333dce02e95 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Action: 'create', calling method: .version_select at 0x7f15c7d90b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1267192930", "metadata": {"Type": "work"}}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:57.328986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a001eea0-5276-4c51-8ac6-4333dce02e95 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:57.329849 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a001eea0-5276-4c51-8ac6-4333dce02e95 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127194 Nov 27 21:19:57.330608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3512/7153] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:19:57 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:19:57.340797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d78ee162-01d4-447c-bfb7-9c95b68d9043 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Action: 'create', calling method: .version_select at 0x7f15c790fe50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-8217185", "metadata": {"Type": "work"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:57.341926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d78ee162-01d4-447c-bfb7-9c95b68d9043 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:57.342712 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d78ee162-01d4-447c-bfb7-9c95b68d9043 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006652 Nov 27 21:19:57.343425 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3642/7154] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:19:57 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:19:57.352326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b9fe3cf-2939-4061-8085-3aab886e0ca3 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Action: 'create', calling method: .version_select at 0x7f15d4380a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1591367260", "metadata": {"Type": "work"}}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:19:57.353499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b9fe3cf-2939-4061-8085-3aab886e0ca3 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:57.354306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0b9fe3cf-2939-4061-8085-3aab886e0ca3 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006185 Nov 27 21:19:57.354819 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3513/7155] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:19:57 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:19:57.363463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-361a8f21-f7a7-4ee3-ae3e-885c0e4e3c3f tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Calling method '.version_select at 0x7f15c6e29940>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:57.391764 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-361a8f21-f7a7-4ee3-ae3e-885c0e4e3c3f tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] HTTP exception thrown: Volume tempest-invalid-1366635126 could not be found. Nov 27 21:19:57.392374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-361a8f21-f7a7-4ee3-ae3e-885c0e4e3c3f tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Returning 404 to user: Volume tempest-invalid-1366635126 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:57.393210 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-361a8f21-f7a7-4ee3-ae3e-885c0e4e3c3f tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1366635126" status: 404 len: 99 microversion: 2.1 time: 0.033666 Nov 27 21:19:57.393759 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3643/7156] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 21:19:57 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1366635126 => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 21:19:57.402996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb5a795a-45b9-4763-8e85-080b42454f7b tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003788 Nov 27 21:19:57.403540 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3514/7157] 10.222.0.21 () {58 vars in 1139 bytes} [Sat Nov 27 21:19:57 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 27 21:19:57.413019 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97551b70-b3b0-4943-8d52-7422dda4f14a tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003649 Nov 27 21:19:57.413521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3644/7158] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 21:19:57 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 27 21:19:57.422620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-127d4489-65c7-4fb1-929c-77fefd5def01 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Calling method '.version_select at 0x7f15c7c7e280>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:57.456957 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-127d4489-65c7-4fb1-929c-77fefd5def01 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] HTTP exception thrown: Volume b43b0786-8188-4057-9e1d-4cabd338d8df could not be found. Nov 27 21:19:57.457556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-127d4489-65c7-4fb1-929c-77fefd5def01 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Returning 404 to user: Volume b43b0786-8188-4057-9e1d-4cabd338d8df could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:57.458399 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-127d4489-65c7-4fb1-929c-77fefd5def01 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/b43b0786-8188-4057-9e1d-4cabd338d8df" status: 404 len: 109 microversion: 2.1 time: 0.039437 Nov 27 21:19:57.459129 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3515/7159] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:19:57 2021] DELETE /compute/v2.1/os-volumes/b43b0786-8188-4057-9e1d-4cabd338d8df => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:19:57.468146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7c4ecb7a-5f97-4d96-9cce-6488ef9dcfc1 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Calling method '.version_select at 0x7f15c7b58f70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:19:57.496109 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7c4ecb7a-5f97-4d96-9cce-6488ef9dcfc1 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] HTTP exception thrown: Volume bccba0aa-e60b-47ab-bdf8-efb4625811e6 could not be found. Nov 27 21:19:57.496880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7c4ecb7a-5f97-4d96-9cce-6488ef9dcfc1 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] Returning 404 to user: Volume bccba0aa-e60b-47ab-bdf8-efb4625811e6 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:19:57.497751 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7c4ecb7a-5f97-4d96-9cce-6488ef9dcfc1 tempest-VolumesNegativeTest-1310075612 tempest-VolumesNegativeTest-1310075612-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/bccba0aa-e60b-47ab-bdf8-efb4625811e6" status: 404 len: 109 microversion: 2.1 time: 0.033242 Nov 27 21:19:57.498292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3645/7160] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:19:57 2021] GET /compute/v2.1/os-volumes/bccba0aa-e60b-47ab-bdf8-efb4625811e6 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:20:02.797353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1086976757", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "4216be6c-3d07-4c65-92b4-8d5df1ec0e18"}], "key_name": "tempest-TestNetworkAdvancedServerOps-743160686", "security_groups": [{"name": "tempest-secgroup-smoke-1938598551"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:02.922949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] validate_networks() for [('4216be6c-3d07-4c65-92b4-8d5df1ec0e18', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:20:03.561917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:20:03.562649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:20:03.563324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:20:03.563743 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:20:03.564298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:20:03.579379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:03.579946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:03.580859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:03.581374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:03.599703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:20:03.605179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:20:03.619725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:20:03.622192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:20:03.696497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05baa0d0-ed22-414f-8800-971f88c70bbf tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.906085 Nov 27 21:20:03.697260 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3516/7161] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:20:02 2021] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:20:03.708826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7532ecf5-42ce-4e6a-97c2-c173269ea7fd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:03.710155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7532ecf5-42ce-4e6a-97c2-c173269ea7fd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:03.770686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7532ecf5-42ce-4e6a-97c2-c173269ea7fd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:03.781979 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7532ecf5-42ce-4e6a-97c2-c173269ea7fd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1266 microversion: 2.1 time: 0.074653 Nov 27 21:20:03.781979 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3646/7162] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:03 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:04.796708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:04.797358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:04.805241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:04.806018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:04.806982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:04.807767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:04.900806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:04.919792 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f446482e-d84e-46f1-9fb0-1ee9718532e3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1318 microversion: 2.1 time: 0.126823 Nov 27 21:20:04.921061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3517/7163] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:04 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1318 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:05.937672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:05.938279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:05.948964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:05.949542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:05.950447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:05.950990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:06.153261 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:06.164558 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-076a9469-b369-49a2-8f59-221552ea5b3f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.230388 Nov 27 21:20:06.165459 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3647/7164] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:05 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:06.686422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-86d96202-7268-4c5e-9a72-3ea0b72572b3 req-a7e887d6-b062-4b8b-81a4-cf105e589d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:06.689627 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:20:06.689627 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:20:06.703979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-86d96202-7268-4c5e-9a72-3ea0b72572b3 req-a7e887d6-b062-4b8b-81a4-cf105e589d76 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:06.704599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-86d96202-7268-4c5e-9a72-3ea0b72572b3 req-a7e887d6-b062-4b8b-81a4-cf105e589d76 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:06.718326 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-86d96202-7268-4c5e-9a72-3ea0b72572b3 req-a7e887d6-b062-4b8b-81a4-cf105e589d76 service nova] Creating event network-changed:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch1-master-1 Nov 27 21:20:06.723574 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-86d96202-7268-4c5e-9a72-3ea0b72572b3 req-a7e887d6-b062-4b8b-81a4-cf105e589d76 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046160 Nov 27 21:20:06.724359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3518/7165] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:20:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:20:07.182439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:07.184349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:07.193084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:07.193631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:07.194492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:07.195087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:07.363128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:07.370987 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-485d7397-834a-432d-bfe1-bd2a7107afd3 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.192198 Nov 27 21:20:07.371606 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3648/7166] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:07 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:08.390092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:08.390897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:08.397601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:08.398162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:08.399036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:08.399575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:08.545152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:08.556016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91417c02-a3d5-4f88-9f69-910ed1828cda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.171353 Nov 27 21:20:08.556878 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3519/7167] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:08 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:09.576456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:09.577146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:09.584439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:09.585615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:09.586657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:09.587118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:09.740337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:09.747749 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-889e39a6-e9d2-427a-b4c9-3f5615464e33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.176412 Nov 27 21:20:09.748318 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3649/7168] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:09 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:10.765227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:10.765838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:10.773232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:10.773678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:10.774462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:10.774898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:10.922658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:10.931123 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ad7ede3-6c25-48b1-90e3-94a5a5048b33 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.169523 Nov 27 21:20:10.932110 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3520/7169] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:10 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:11.948914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:11.950415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:11.957822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:11.958276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:11.960217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:11.960654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:12.104183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:12.111882 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10ebf0b7-98ab-4622-b786-c571578e5dbd tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.167637 Nov 27 21:20:12.112471 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3650/7170] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:11 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:13.128771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:13.129594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:13.136633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:13.137182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:13.137974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:13.138689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:13.309862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:13.317363 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9879d1e-8487-4778-a09a-5a60fb35a1ee tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.192424 Nov 27 21:20:13.317941 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3521/7171] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:13 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:13.569904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-971ab535-44af-4cce-bd5e-b92cd64e118e req-f89ca463-71d5-48b0-af9b-d67c2e6f993f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "name": "network-vif-plugged", "status": "completed", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:13.571975 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:20:13.571975 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:20:13.580314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-971ab535-44af-4cce-bd5e-b92cd64e118e req-f89ca463-71d5-48b0-af9b-d67c2e6f993f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:13.581090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-971ab535-44af-4cce-bd5e-b92cd64e118e req-f89ca463-71d5-48b0-af9b-d67c2e6f993f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:13.593195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-971ab535-44af-4cce-bd5e-b92cd64e118e req-f89ca463-71d5-48b0-af9b-d67c2e6f993f service nova] Creating event network-vif-plugged:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch1-master-1 Nov 27 21:20:13.598321 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-971ab535-44af-4cce-bd5e-b92cd64e118e req-f89ca463-71d5-48b0-af9b-d67c2e6f993f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032688 Nov 27 21:20:13.599147 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3651/7172] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:20:14.333897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:14.334532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:14.341357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:14.341813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:14.342589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:14.343027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:14.492117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:14.499595 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c58fea59-0b04-449a-b58a-a6219e12526f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1392 microversion: 2.1 time: 0.169432 Nov 27 21:20:14.500171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3522/7173] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:14 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:15.519082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:15.520212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:15.527382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:15.527833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:15.528604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:15.529085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:15.669541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:15.677649 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-574a2b8f-a17b-4225-9eba-9d7fb649806f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1564 microversion: 2.1 time: 0.164508 Nov 27 21:20:15.678498 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3652/7174] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:15 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:20:15.695102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:15.695764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:15.702386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:15.702840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:15.703679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:15.704105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:15.842091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:15.849436 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f1940075-6666-40eb-b5af-9a13fdaca386 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1564 microversion: 2.1 time: 0.158576 Nov 27 21:20:15.850009 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3523/7175] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:15 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:17.526917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:17.527681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:17.531815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1483384e-b97e-48ec-9379-73139d222b03 req-7f8b3f16-f87f-4f5b-9cd5-462df5c6ccd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:17.533628 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:20:17.533628 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:20:17.534786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:17.535549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:17.536906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:17.537497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:17.551164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1483384e-b97e-48ec-9379-73139d222b03 req-7f8b3f16-f87f-4f5b-9cd5-462df5c6ccd6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:17.551658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1483384e-b97e-48ec-9379-73139d222b03 req-7f8b3f16-f87f-4f5b-9cd5-462df5c6ccd6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:17.568823 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1483384e-b97e-48ec-9379-73139d222b03 req-7f8b3f16-f87f-4f5b-9cd5-462df5c6ccd6 service nova] Creating event network-changed:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch1-master-1 Nov 27 21:20:17.577009 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1483384e-b97e-48ec-9379-73139d222b03 req-7f8b3f16-f87f-4f5b-9cd5-462df5c6ccd6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049809 Nov 27 21:20:17.578143 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3524/7176] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:20:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:20:17.691413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:17.699756 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89785712-1926-43fe-8a23-554d68a21657 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1564 microversion: 2.1 time: 0.176460 Nov 27 21:20:17.700482 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3653/7177] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:17 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:40.965137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90f4cd2a-3a8c-43ef-9911-4a0a1c7501b4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:40.966199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90f4cd2a-3a8c-43ef-9911-4a0a1c7501b4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:40.972836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4cd2a-3a8c-43ef-9911-4a0a1c7501b4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:40.973330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4cd2a-3a8c-43ef-9911-4a0a1c7501b4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:40.974561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4cd2a-3a8c-43ef-9911-4a0a1c7501b4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:40.975177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4cd2a-3a8c-43ef-9911-4a0a1c7501b4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:41.034396 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90f4cd2a-3a8c-43ef-9911-4a0a1c7501b4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action" status: 200 len: 24560 microversion: 2.1 time: 0.077795 Nov 27 21:20:41.035276 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3525/7178] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:20:40 2021] POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action => generated 24560 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:20:51.960935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:51.961577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:51.967777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:51.968223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:51.968998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:51.969439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:52.283149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:52.290601 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e540b37d-1a7e-45d9-8970-55823582100c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1683 microversion: 2.1 time: 0.334236 Nov 27 21:20:52.291179 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3654/7179] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:51 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1683 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:52.384450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43705002-e403-440c-af00-af8ecc30bf76 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:52.385615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43705002-e403-440c-af00-af8ecc30bf76 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:52.392877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43705002-e403-440c-af00-af8ecc30bf76 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:52.393343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43705002-e403-440c-af00-af8ecc30bf76 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:52.394137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43705002-e403-440c-af00-af8ecc30bf76 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:52.394583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43705002-e403-440c-af00-af8ecc30bf76 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:52.453459 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43705002-e403-440c-af00-af8ecc30bf76 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action" status: 200 len: 32627 microversion: 2.1 time: 0.073687 Nov 27 21:20:52.459864 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3526/7180] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:20:52 2021] POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action => generated 32627 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:20:52.634217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aca09016-feb5-451f-a2da-d616c56c7d10 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:52.634893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aca09016-feb5-451f-a2da-d616c56c7d10 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:52.640964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aca09016-feb5-451f-a2da-d616c56c7d10 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:52.641416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aca09016-feb5-451f-a2da-d616c56c7d10 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:52.642306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aca09016-feb5-451f-a2da-d616c56c7d10 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:52.642849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aca09016-feb5-451f-a2da-d616c56c7d10 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:52.778738 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aca09016-feb5-451f-a2da-d616c56c7d10 tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1834 microversion: 2.1 time: 0.149448 Nov 27 21:20:52.779351 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3655/7181] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:52 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1834 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:52.795677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:52.797060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:52.804257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:52.804712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:52.806002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:52.806450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:52.832989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lazy-loading 'flavor' on Instance uuid 878689c5-c1b6-471c-84e2-177899462d5f {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:20:52.847085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Going to try to live migrate instance to another host {{(pid=135679) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 27 21:20:54.281393 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0c8c865c-40e2-45ba-be5b-9e4599f606fc tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action" status: 202 len: 0 microversion: 2.1 time: 1.488740 Nov 27 21:20:54.283908 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3527/7182] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:20:52 2021] POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action => generated 0 bytes in 1493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:20:54.292730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:54.293543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:54.301851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:54.302964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:54.304437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:54.304932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:54.540812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:54.548247 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53eaf73a-4cc7-4c4c-b13d-58ac596261e4 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.259947 Nov 27 21:20:54.548822 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3656/7183] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:54 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:55.566373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:55.568240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:55.584897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6c5b158d-1460-417c-9490-8d07352f4ce0 req-d7bca4e8-966e-4153-81b2-368a5e8bc007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "name": "network-vif-unplugged", "status": "completed", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:55.587075 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:20:55.587075 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:20:55.591595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:55.592384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:55.595024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:55.595714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:55.602977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6c5b158d-1460-417c-9490-8d07352f4ce0 req-d7bca4e8-966e-4153-81b2-368a5e8bc007 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:55.606460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6c5b158d-1460-417c-9490-8d07352f4ce0 req-d7bca4e8-966e-4153-81b2-368a5e8bc007 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:55.635443 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6c5b158d-1460-417c-9490-8d07352f4ce0 req-d7bca4e8-966e-4153-81b2-368a5e8bc007 service nova] Creating event network-vif-unplugged:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch1-master-1 Nov 27 21:20:55.645998 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6c5b158d-1460-417c-9490-8d07352f4ce0 req-d7bca4e8-966e-4153-81b2-368a5e8bc007 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066269 Nov 27 21:20:55.655382 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3657/7184] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:20:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:20:56.012132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:56.020174 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9c72a09-6387-45a7-b177-a549ac823e44 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.458144 Nov 27 21:20:56.021371 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3528/7185] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:55 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:56.750038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a74d6e97-d60f-4e1f-8933-054d05beb974 req-a9dc69b2-bc7a-4cea-8526-a5ec599e7d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "name": "network-vif-plugged", "status": "completed", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:56.752638 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:20:56.752638 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:20:56.765184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a74d6e97-d60f-4e1f-8933-054d05beb974 req-a9dc69b2-bc7a-4cea-8526-a5ec599e7d4e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:56.765687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a74d6e97-d60f-4e1f-8933-054d05beb974 req-a9dc69b2-bc7a-4cea-8526-a5ec599e7d4e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:56.780079 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a74d6e97-d60f-4e1f-8933-054d05beb974 req-a9dc69b2-bc7a-4cea-8526-a5ec599e7d4e service nova] Creating event network-vif-plugged:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch1-master-1 Nov 27 21:20:56.785886 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a74d6e97-d60f-4e1f-8933-054d05beb974 req-a9dc69b2-bc7a-4cea-8526-a5ec599e7d4e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042681 Nov 27 21:20:56.786589 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3658/7186] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:20:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:20:57.037848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:57.039034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:57.046381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:57.046841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:57.047666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:57.048100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:57.269939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:57.285497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-846a60a9-04ce-4514-af2b-e980283f2e03 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.251162 Nov 27 21:20:57.286842 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3529/7187] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:57 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:57.673296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-1f814992-17b4-4b6d-b373-fe3ac855e8aa req-4c0b1873-24e7-4113-9b2b-7c17c0e850da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:20:57.674783 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:20:57.674783 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:20:57.682729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1f814992-17b4-4b6d-b373-fe3ac855e8aa req-4c0b1873-24e7-4113-9b2b-7c17c0e850da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:57.683169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-1f814992-17b4-4b6d-b373-fe3ac855e8aa req-4c0b1873-24e7-4113-9b2b-7c17c0e850da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:57.698922 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-1f814992-17b4-4b6d-b373-fe3ac855e8aa req-4c0b1873-24e7-4113-9b2b-7c17c0e850da service nova] Creating event network-changed:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch1-master-1 Nov 27 21:20:57.703840 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-1f814992-17b4-4b6d-b373-fe3ac855e8aa req-4c0b1873-24e7-4113-9b2b-7c17c0e850da service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035018 Nov 27 21:20:57.704467 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3659/7188] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:20:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:20:58.305089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:58.305977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:58.313114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:58.313838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:58.314816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:58.315451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:58.556925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:58.568524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d01984b-67d7-4e24-b468-2eb26fc63dc9 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.268551 Nov 27 21:20:58.569543 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3530/7189] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:58 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:20:59.587582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:20:59.588369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:20:59.594497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:59.595073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:59.595886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:20:59.596323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:20:59.734937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:20:59.743422 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-efe61d1e-32ea-4693-aecf-eea9d1c37364 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.161367 Nov 27 21:20:59.744088 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3660/7190] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:20:59 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:21:00.760989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:00.761769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:00.768844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:00.769298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:00.770097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:00.771059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:00.915008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:00.922874 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47fd8171-993b-46f7-bb77-89ab8d5bd119 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.165633 Nov 27 21:21:00.923518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3531/7191] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:00 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:01.940080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:01.940683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:01.947173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:01.947647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:01.948416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:01.948854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:02.085308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:02.092281 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-56679472-78eb-4f85-b993-fa7eab15f67a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.155915 Nov 27 21:21:02.093100 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3661/7192] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:01 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:03.109775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:03.110388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:03.117845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:03.118298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:03.119081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:03.119717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:03.272772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:03.280259 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0aa97168-1b01-4bab-849c-32e9a138e5fa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.174173 Nov 27 21:21:03.280828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3532/7193] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:03 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:04.298421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:04.299034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:04.308470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:04.308969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:04.309860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:04.310646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:04.554820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:04.570430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0f411ab-e6c3-4262-be21-cc4692d6a4f6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.274909 Nov 27 21:21:04.572001 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3662/7194] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:04 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:04.831896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-bf3740b1-5fff-4955-b9e4-83d6e6fc910e req-1adeb3b3-1b04-41bc-8516-0bda516cc134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "name": "network-vif-unplugged", "status": "completed", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:04.834110 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:04.834110 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:21:04.843545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bf3740b1-5fff-4955-b9e4-83d6e6fc910e req-1adeb3b3-1b04-41bc-8516-0bda516cc134 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:04.844477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bf3740b1-5fff-4955-b9e4-83d6e6fc910e req-1adeb3b3-1b04-41bc-8516-0bda516cc134 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:04.865227 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-bf3740b1-5fff-4955-b9e4-83d6e6fc910e req-1adeb3b3-1b04-41bc-8516-0bda516cc134 service nova] Creating event network-vif-unplugged:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch1-master-1 Nov 27 21:21:04.870742 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-bf3740b1-5fff-4955-b9e4-83d6e6fc910e req-1adeb3b3-1b04-41bc-8516-0bda516cc134 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043116 Nov 27 21:21:04.871578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3533/7195] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:05.589917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:05.590529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:05.597600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:05.598093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:05.598883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:05.602953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:05.744504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:05.752903 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-946b1368-4536-45bc-887a-1aa4deb4d10e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1693 microversion: 2.1 time: 0.166752 Nov 27 21:21:05.753621 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3663/7196] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:05 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:06.771830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:06.772561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:06.778702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:06.779159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:06.779982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:06.780435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:07.298813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:07.299405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:07.306530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:07.306980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:07.307811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:07.308244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:07.396931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:07.397127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lazy-loading 'services' on Instance uuid e0ed9439-0c1d-446a-aa57-1f6156dbfd86 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:21:07.407021 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cbbce268-3409-41fc-a2c4-1cc7c8206a5b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1683 microversion: 2.1 time: 0.640157 Nov 27 21:21:07.420130 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3534/7197] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:06 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1683 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:07.425871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-006023d6-eeec-4624-b9f1-ce9b7db68b3d tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:07.427322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-006023d6-eeec-4624-b9f1-ce9b7db68b3d tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:07.434303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006023d6-eeec-4624-b9f1-ce9b7db68b3d tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:07.435141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006023d6-eeec-4624-b9f1-ce9b7db68b3d tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:07.436496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006023d6-eeec-4624-b9f1-ce9b7db68b3d tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:07.436955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006023d6-eeec-4624-b9f1-ce9b7db68b3d tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:07.493034 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab9ae4b5-b4db-4b89-8090-6ecfbd661dc5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86/os-volume_attachments/555cdd24-e7af-4c5f-85e7-abcbaa558327" status: 202 len: 0 microversion: 2.1 time: 0.197773 Nov 27 21:21:07.493646 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3664/7198] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:21:07 2021] DELETE /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86/os-volume_attachments/555cdd24-e7af-4c5f-85e7-abcbaa558327 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:21:07.688214 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-006023d6-eeec-4624-b9f1-ce9b7db68b3d tempest-TestNetworkAdvancedServerOps-561956051 tempest-TestNetworkAdvancedServerOps-561956051-project-admin] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1834 microversion: 2.1 time: 0.266561 Nov 27 21:21:07.689103 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3535/7199] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:07 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1834 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:07.706384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:07.707083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:07.715987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:07.716448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:07.717585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:07.718199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:07.949655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:07.958855 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5ff77204-97cb-4470-83f5-962fc4ea4ce8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1683 microversion: 2.1 time: 0.256997 Nov 27 21:21:07.959678 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3665/7200] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:07 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1683 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:08.061196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-39c28b06-858b-4f6d-b82f-d0edea4fc737 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:08.062129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-39c28b06-858b-4f6d-b82f-d0edea4fc737 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:08.069596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c28b06-858b-4f6d-b82f-d0edea4fc737 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:08.070047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c28b06-858b-4f6d-b82f-d0edea4fc737 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:08.070831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c28b06-858b-4f6d-b82f-d0edea4fc737 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:08.071304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c28b06-858b-4f6d-b82f-d0edea4fc737 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:08.122013 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-39c28b06-858b-4f6d-b82f-d0edea4fc737 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action" status: 200 len: 38654 microversion: 2.1 time: 0.064350 Nov 27 21:21:08.122846 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3536/7201] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:21:08 2021] POST /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f/action => generated 38654 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:21:08.615212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:08.616477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:08.625356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:08.625898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:08.626867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:08.627549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:08.699551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:21:08.809339 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9c97cd9-37cf-43e7-b44c-698be8f26c15 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 204 len: 0 microversion: 2.1 time: 0.198419 Nov 27 21:21:08.811074 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3666/7202] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:21:08 2021] DELETE /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:21:08.820133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:08.820865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:08.829548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:08.830265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:08.831450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:08.832096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:09.129817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:09.140073 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1172a88-2e7a-49d9-a0af-dd9151791d39 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1514 microversion: 2.1 time: 0.324027 Nov 27 21:21:09.141275 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3537/7203] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:08 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:09.420971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:09.421821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:09.427268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c4bba2ae-b3b8-4b2b-8142-69d902894a3b req-f6e0baa9-981c-4db3-a172-762a13ae8e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:09.429076 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:09.429076 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:21:09.432438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:09.434066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:09.437738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:09.438449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:09.447300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c4bba2ae-b3b8-4b2b-8142-69d902894a3b req-f6e0baa9-981c-4db3-a172-762a13ae8e9c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:09.447998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c4bba2ae-b3b8-4b2b-8142-69d902894a3b req-f6e0baa9-981c-4db3-a172-762a13ae8e9c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:09.463888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c4bba2ae-b3b8-4b2b-8142-69d902894a3b req-f6e0baa9-981c-4db3-a172-762a13ae8e9c service nova] Creating event network-changed:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch2-master-1 Nov 27 21:21:09.476792 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c4bba2ae-b3b8-4b2b-8142-69d902894a3b req-f6e0baa9-981c-4db3-a172-762a13ae8e9c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053109 Nov 27 21:21:09.477863 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3538/7204] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:21:09.511968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:21:09.665993 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c538046-bd7f-40b2-8306-de54f7f9dbd2 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 204 len: 0 microversion: 2.1 time: 0.247814 Nov 27 21:21:09.669532 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3667/7205] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:21:09 2021] DELETE /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:21:09.684070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:09.684771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:09.699337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:09.703831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:09.705454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:09.705974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:09.975498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:09.987879 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ca61a0a-b5fb-414d-b073-772f40aa2e97 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1689 microversion: 2.1 time: 0.308358 Nov 27 21:21:10.002654 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3539/7206] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:09 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1689 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:10.163910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:10.164972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:10.172167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:10.172873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:10.173943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:10.174828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:10.443379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:10.455560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ae6714c-447d-4482-8f6a-1ffaa2f13a35 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1514 microversion: 2.1 time: 0.296086 Nov 27 21:21:10.459626 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3668/7207] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:10 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:11.009948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:11.010578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:11.017770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:11.018542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:11.019648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:11.020323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:11.073776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b1a9ab0d-b021-4b4e-886c-e64a59ffa26f req-ae4fb427-086b-4242-9172-6b36ec98430b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ed9439-0c1d-446a-aa57-1f6156dbfd86", "name": "network-vif-deleted", "tag": "4fa0dea5-dabc-4ab8-bd75-07aa2809370a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:11.077005 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:11.077005 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:21:11.094221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b1a9ab0d-b021-4b4e-886c-e64a59ffa26f req-ae4fb427-086b-4242-9172-6b36ec98430b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:11.095753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b1a9ab0d-b021-4b4e-886c-e64a59ffa26f req-ae4fb427-086b-4242-9172-6b36ec98430b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:11.114138 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b1a9ab0d-b021-4b4e-886c-e64a59ffa26f req-ae4fb427-086b-4242-9172-6b36ec98430b service nova] Creating event network-vif-deleted:4fa0dea5-dabc-4ab8-bd75-07aa2809370a for instance e0ed9439-0c1d-446a-aa57-1f6156dbfd86 on nch2-master-1 Nov 27 21:21:11.119299 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b1a9ab0d-b021-4b4e-886c-e64a59ffa26f req-ae4fb427-086b-4242-9172-6b36ec98430b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049547 Nov 27 21:21:11.120948 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3669/7208] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:11.138397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:11.146948 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0bcd5963-185e-4708-a543-04bc79101c8f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 200 len: 1502 microversion: 2.1 time: 0.140612 Nov 27 21:21:11.147919 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3540/7209] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:11 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 1502 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:11.477306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:11.478309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:11.484714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:11.485618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:11.485986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:11.486619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:11.494422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8ad39a31-cb12-481c-9352-054912d8e9a9 req-d740b88e-02bc-437e-82d3-65883e7dac36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878689c5-c1b6-471c-84e2-177899462d5f", "name": "network-vif-deleted", "tag": "0039eec4-0dfe-4e82-bf4d-2494bfbe555c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:11.496000 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:11.496000 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:21:11.509388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8ad39a31-cb12-481c-9352-054912d8e9a9 req-d740b88e-02bc-437e-82d3-65883e7dac36 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:11.510624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8ad39a31-cb12-481c-9352-054912d8e9a9 req-d740b88e-02bc-437e-82d3-65883e7dac36 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:11.546407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:11.546884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:11.547582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lazy-loading 'fault' on Instance uuid e0ed9439-0c1d-446a-aa57-1f6156dbfd86 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:21:11.557366 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8ad39a31-cb12-481c-9352-054912d8e9a9 req-d740b88e-02bc-437e-82d3-65883e7dac36 service nova] Creating event network-vif-deleted:0039eec4-0dfe-4e82-bf4d-2494bfbe555c for instance 878689c5-c1b6-471c-84e2-177899462d5f on nch2-master-1 Nov 27 21:21:11.563651 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8ad39a31-cb12-481c-9352-054912d8e9a9 req-d740b88e-02bc-437e-82d3-65883e7dac36 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072651 Nov 27 21:21:11.564630 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3541/7210] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:11.628031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:11.637624 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f91e1ad-32bb-4810-8b13-639319a292dd tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 200 len: 1309 microversion: 2.1 time: 0.163532 Nov 27 21:21:11.639621 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3670/7211] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:11 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:12.166600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:12.167368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 878689c5-c1b6-471c-84e2-177899462d5f] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:12.173519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:12.173976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:12.174786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:12.175231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:12.189553 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] HTTP exception thrown: Instance 878689c5-c1b6-471c-84e2-177899462d5f could not be found. Nov 27 21:21:12.190164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Returning 404 to user: Instance 878689c5-c1b6-471c-84e2-177899462d5f could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:21:12.191013 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8300b820-b788-40f0-8331-758814309976 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f" status: 404 len: 111 microversion: 2.1 time: 0.029341 Nov 27 21:21:12.192159 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3542/7212] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:12 2021] GET /compute/v2.1/servers/878689c5-c1b6-471c-84e2-177899462d5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:21:12.655966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:12.656578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: e0ed9439-0c1d-446a-aa57-1f6156dbfd86] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:12.663748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:12.664457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:12.665902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:12.666415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:12.681532 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] HTTP exception thrown: Instance e0ed9439-0c1d-446a-aa57-1f6156dbfd86 could not be found. Nov 27 21:21:12.682218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Returning 404 to user: Instance e0ed9439-0c1d-446a-aa57-1f6156dbfd86 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:21:12.683124 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d2242dcc-69ce-4155-a168-cf57f8a4bcb2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86" status: 404 len: 111 microversion: 2.1 time: 0.031322 Nov 27 21:21:12.687515 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3671/7213] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:12 2021] GET /compute/v2.1/servers/e0ed9439-0c1d-446a-aa57-1f6156dbfd86 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:21:16.838827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-85d1c503-1601-41af-81f2-d59b334b22ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '.version_select at 0x7f15c6925f70>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:16.870533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-85d1c503-1601-41af-81f2-d59b334b22ec tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-743160686" status: 202 len: 0 microversion: 2.1 time: 0.036405 Nov 27 21:21:16.871225 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3543/7214] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 21:21:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-743160686 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:21:16.902005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d204174d-6941-4cd6-9eaa-a1deedba7aa6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: .version_select at 0x7f15d4305ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-994555197"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:16.920885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d204174d-6941-4cd6-9eaa-a1deedba7aa6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:21:16.928241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d204174d-6941-4cd6-9eaa-a1deedba7aa6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:21:17.130366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d204174d-6941-4cd6-9eaa-a1deedba7aa6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:21:17.139637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d204174d-6941-4cd6-9eaa-a1deedba7aa6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:21:17.155032 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d204174d-6941-4cd6-9eaa-a1deedba7aa6 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.260304 Nov 27 21:21:17.155690 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3672/7215] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:21:16 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:17.655780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-835473681", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "ebffb26f-bc13-421f-ad40-7f30998bc7a9"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:17.753359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] validate_networks() for [('ebffb26f-bc13-421f-ad40-7f30998bc7a9', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:21:18.291688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:21:18.292282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:21:18.292802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:21:18.293456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:21:18.293931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:21:18.302889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:18.303404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:18.304231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:18.304673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:18.323013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Getting quotas for project 05afa0d2a44144078e3fa7d820a95510. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:21:18.328396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Getting quotas for user 6e49ff29764540ae95d8b9d0f9d4fbfa and project 05afa0d2a44144078e3fa7d820a95510. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:21:18.342246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:21:18.344651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:21:18.402239 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f4cac9c-5aba-47af-b95e-1deb9294921e tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751316 Nov 27 21:21:18.407325 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3544/7216] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:21:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:21:18.421479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30075b36-4697-40c2-a7e4-7d3456bd5cd5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:18.422665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30075b36-4697-40c2-a7e4-7d3456bd5cd5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:18.532815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-30075b36-4697-40c2-a7e4-7d3456bd5cd5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:18.541963 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30075b36-4697-40c2-a7e4-7d3456bd5cd5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1218 microversion: 2.1 time: 0.126195 Nov 27 21:21:18.554908 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3673/7217] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:18 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:19.560439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:19.561059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:19.569565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:19.572569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:19.573348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:19.573959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:19.765572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:19.774972 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1381e819-0246-4b09-9242-ae186fc31bad tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1278 microversion: 2.1 time: 0.218130 Nov 27 21:21:19.776105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3545/7218] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:19 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:20.792891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:20.794110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:20.803229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:20.803944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:20.804833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:20.805515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:21.244751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-63d8107d-600c-4596-9cd6-ea09f86ec91e req-7a717091-8f7f-4c2e-9626-166841f29fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b475d9b-cae9-4927-8e6e-7350de7e4a42", "tag": "9a1e4b76-fd3c-453b-94c3-0dc63230c428"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:21.251144 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:21.251144 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:21:21.272046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-63d8107d-600c-4596-9cd6-ea09f86ec91e req-7a717091-8f7f-4c2e-9626-166841f29fc5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:21.272533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-63d8107d-600c-4596-9cd6-ea09f86ec91e req-7a717091-8f7f-4c2e-9626-166841f29fc5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:21.294702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-63d8107d-600c-4596-9cd6-ea09f86ec91e req-7a717091-8f7f-4c2e-9626-166841f29fc5 service nova] Creating event network-changed:9a1e4b76-fd3c-453b-94c3-0dc63230c428 for instance 0b475d9b-cae9-4927-8e6e-7350de7e4a42 on nch1-master-1 Nov 27 21:21:21.301390 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-63d8107d-600c-4596-9cd6-ea09f86ec91e req-7a717091-8f7f-4c2e-9626-166841f29fc5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070457 Nov 27 21:21:21.302110 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3546/7219] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:21.373538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:21.387670 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51e22a43-18e0-4028-9dc8-b23be1eaa065 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1318 microversion: 2.1 time: 0.598332 Nov 27 21:21:21.397781 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3674/7220] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:20 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:22.406802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:22.407463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:22.418954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:22.419445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:22.420237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:22.420675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:22.680393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:22.689122 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-14218db5-2942-46a3-a595-f8f5e2510ee1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1318 microversion: 2.1 time: 0.287163 Nov 27 21:21:22.690395 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3547/7221] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:22 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:23.709914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:23.711854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:23.730470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:23.731370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:23.735021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:23.735786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:24.027955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:24.038409 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-284528cb-a340-4812-bcb7-d46217afed7c tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1318 microversion: 2.1 time: 0.335533 Nov 27 21:21:24.040394 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3675/7222] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:23 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:25.058992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:25.059930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:25.076455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:25.078888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:25.079909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:25.081290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:25.658620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:25.666888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6729e0df-1948-4ef2-ae58-9ea36d7eafd2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1318 microversion: 2.1 time: 0.613718 Nov 27 21:21:25.667515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3548/7223] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:25 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:26.686067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:26.687632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:26.701774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:26.702377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:26.703280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:26.703886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:26.920582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:26.928554 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b74bed9-ecce-4eb9-adac-9e96f8ebb975 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1318 microversion: 2.1 time: 0.247997 Nov 27 21:21:26.932698 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3676/7224] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:26 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:26.947560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1526217915", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "463c888b-41a7-4f22-80c2-8966fe563e56"}], "key_name": "tempest-TestNetworkAdvancedServerOps-994555197", "security_groups": [{"name": "tempest-secgroup-smoke-148101319"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:27.109842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] validate_networks() for [('463c888b-41a7-4f22-80c2-8966fe563e56', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:21:27.714590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:21:27.715741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:21:27.716385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:21:27.716997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:21:27.718109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:21:27.739514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:27.740230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:27.741416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:27.742068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:27.761008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:21:27.767676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Getting quotas for user 98c4fe50315d4fc0b0329e80802eee86 and project 587ce621728b4cb1b01fd53d69d45d4d. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:21:27.782342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:21:27.785746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:21:27.869279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-996abe3b-bef6-4691-a83d-80c47ddfcb10 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.925447 Nov 27 21:21:27.876197 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3549/7225] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:21:26 2021] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:21:27.882945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59d42a73-77c9-49d1-beaf-3b1ce57683dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:27.883619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59d42a73-77c9-49d1-beaf-3b1ce57683dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:27.950427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:27.951056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:27.967699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:27.968174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:27.971145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:27.973044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:28.099607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-59d42a73-77c9-49d1-beaf-3b1ce57683dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:28.110595 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59d42a73-77c9-49d1-beaf-3b1ce57683dc tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1266 microversion: 2.1 time: 0.232597 Nov 27 21:21:28.115302 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3677/7226] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:27 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:21:28.261134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:28.289499 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18713fa2-cec2-4004-b036-b21056490412 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1318 microversion: 2.1 time: 0.342807 Nov 27 21:21:28.301283 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3550/7227] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:27 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:21:28.525759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-aec17b84-dac9-4437-b5fd-0db603a1f10a req-acb33a9a-89d5-4f3a-a96d-c0a0a93b6185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b475d9b-cae9-4927-8e6e-7350de7e4a42", "name": "network-vif-plugged", "status": "completed", "tag": "9a1e4b76-fd3c-453b-94c3-0dc63230c428"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:28.527738 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:28.527738 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:21:28.557260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-aec17b84-dac9-4437-b5fd-0db603a1f10a req-acb33a9a-89d5-4f3a-a96d-c0a0a93b6185 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:28.558017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-aec17b84-dac9-4437-b5fd-0db603a1f10a req-acb33a9a-89d5-4f3a-a96d-c0a0a93b6185 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:28.578411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-aec17b84-dac9-4437-b5fd-0db603a1f10a req-acb33a9a-89d5-4f3a-a96d-c0a0a93b6185 service nova] Creating event network-vif-plugged:9a1e4b76-fd3c-453b-94c3-0dc63230c428 for instance 0b475d9b-cae9-4927-8e6e-7350de7e4a42 on nch1-master-1 Nov 27 21:21:28.584436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-aec17b84-dac9-4437-b5fd-0db603a1f10a req-acb33a9a-89d5-4f3a-a96d-c0a0a93b6185 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065115 Nov 27 21:21:28.585635 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3678/7228] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:29.128823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:29.130502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:29.150702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:29.152648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:29.160167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:29.162828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:29.309892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:29.311967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:29.322856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:29.333931 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3dd90a1d-697f-443d-bff1-43bef8f2781a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1318 microversion: 2.1 time: 0.207649 Nov 27 21:21:29.338066 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3551/7229] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:29 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:29.338765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:29.339481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:29.340686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:29.341335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:29.741936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:29.764946 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71829b38-775e-48e8-b8ac-56348b49603a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1318 microversion: 2.1 time: 0.456836 Nov 27 21:21:29.767513 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3679/7230] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:29 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:21:30.354285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:30.356095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:30.364442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:30.365179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:30.366149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:30.366747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:30.472375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:30.487239 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab89f57c-f992-403e-942f-aad48a7aeab8 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1324 microversion: 2.1 time: 0.136861 Nov 27 21:21:30.500826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3552/7231] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:30 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1324 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:30.784342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:30.786032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:30.795629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:30.796355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:30.797316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:30.798128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:31.226618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:31.235185 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2e5a3158-7eaf-458f-8e07-4fd7845bd4d0 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1508 microversion: 2.1 time: 0.454811 Nov 27 21:21:31.248128 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3680/7232] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:30 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1508 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:31.255156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4f886f9-5e7d-4b5a-bdf9-24c0605166d5", "device": "/dev/sdb"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:31.257262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:31.280292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:31.281190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:31.282007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:31.282953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:31.519503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:31.521028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:31.535738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:31.541178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:31.544564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:31.545693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:31.762834 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0e63a2a8-275a-46a7-bdc1-7f4bd566df94 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "POST /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513989 Nov 27 21:21:31.763838 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3553/7233] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:21:31 2021] POST /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:31.909886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-60c70410-0dcd-4f22-a3f1-2e0914308914 req-b77e144c-a0d1-4fd7-983e-ea8ca2ef0939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d5cb7d-f3c6-4750-b3bb-b3635e9d5085", "tag": "6d6aee5a-e927-42d5-9274-f286c5113e62"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:31.913425 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:31.913425 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:21:31.932339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:31.944013 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ca2841ae-a288-46f1-9785-d302f685247c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.428875 Nov 27 21:21:31.944689 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3681/7234] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:31 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:21:31.954348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-60c70410-0dcd-4f22-a3f1-2e0914308914 req-b77e144c-a0d1-4fd7-983e-ea8ca2ef0939 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:31.954802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-60c70410-0dcd-4f22-a3f1-2e0914308914 req-b77e144c-a0d1-4fd7-983e-ea8ca2ef0939 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:31.972759 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-60c70410-0dcd-4f22-a3f1-2e0914308914 req-b77e144c-a0d1-4fd7-983e-ea8ca2ef0939 service nova] Creating event network-changed:6d6aee5a-e927-42d5-9274-f286c5113e62 for instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 on nch2-master-1 Nov 27 21:21:31.981135 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-60c70410-0dcd-4f22-a3f1-2e0914308914 req-b77e144c-a0d1-4fd7-983e-ea8ca2ef0939 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076332 Nov 27 21:21:31.984355 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3554/7235] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:21:32.962335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:32.963022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:32.973709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:32.974597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:32.975646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:32.976159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:33.252088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:33.260651 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03945e00-54fb-42e3-9263-0968a2c23e5e tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.302099 Nov 27 21:21:33.261489 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3682/7236] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:32 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:34.279126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:34.279993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:34.291339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:34.291797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:34.292594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:34.293032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:34.489620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:34.499872 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c1d63baf-16fc-45b0-8153-d1cbe899e794 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.226517 Nov 27 21:21:34.500479 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3555/7237] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:34 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:35.517644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:35.519551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:35.526396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:35.527739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:35.528737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:35.529418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:35.750612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:35.759217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e257cc42-983a-4808-87c8-72b3aea47a29 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.245651 Nov 27 21:21:35.759833 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3683/7238] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:35 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:36.776372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:36.777071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:36.785367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:36.786038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:36.786859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:36.787344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:37.071771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:37.089163 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1d37b9a8-0210-44e6-adf4-250618fd2875 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.316484 Nov 27 21:21:37.098738 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3556/7239] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:36 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:38.105743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:38.106903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:38.113993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:38.114437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:38.115432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:38.116337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:38.276195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:38.284739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9cc48c8c-8d7e-4dae-a17b-00577596e6f0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.181896 Nov 27 21:21:38.285526 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3684/7240] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:38 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:39.301857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:39.302647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:39.309555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:39.310100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:39.311665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:39.312114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:39.425033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fffa9620-6328-4474-ab05-581267c2517b req-dba74831-1084-45a9-8f4b-d42a4684d38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cb7d-f3c6-4750-b3bb-b3635e9d5085", "name": "network-vif-plugged", "status": "completed", "tag": "6d6aee5a-e927-42d5-9274-f286c5113e62"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:39.427142 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:39.427142 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:21:39.443008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fffa9620-6328-4474-ab05-581267c2517b req-dba74831-1084-45a9-8f4b-d42a4684d38d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:39.443518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fffa9620-6328-4474-ab05-581267c2517b req-dba74831-1084-45a9-8f4b-d42a4684d38d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:39.462826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fffa9620-6328-4474-ab05-581267c2517b req-dba74831-1084-45a9-8f4b-d42a4684d38d service nova] Creating event network-vif-plugged:6d6aee5a-e927-42d5-9274-f286c5113e62 for instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 on nch2-master-1 Nov 27 21:21:39.473099 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fffa9620-6328-4474-ab05-581267c2517b req-dba74831-1084-45a9-8f4b-d42a4684d38d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051755 Nov 27 21:21:39.474199 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3685/7241] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:39.664199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:39.672149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5a508328-9f6a-441a-93eb-93508b2e46db tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.374022 Nov 27 21:21:39.673871 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3557/7242] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:39 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:40.690591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:40.691799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:40.699049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:40.699599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:40.700543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:40.701011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:40.937322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:40.945732 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-08fffde0-732d-4aff-85ca-ea0ad231db2c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1391 microversion: 2.1 time: 0.260840 Nov 27 21:21:40.946584 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3686/7243] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:40 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:41.963050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:41.964259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:41.972082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:41.972545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:41.973342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:41.973783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:42.124732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:42.135404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad3fcdc2-a88b-440d-a8c2-f3bd784ef9e5 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1563 microversion: 2.1 time: 0.175999 Nov 27 21:21:42.136372 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3558/7244] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:41 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:42.153085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:42.154267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:42.163580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:42.164111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:42.165096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:42.165552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:42.434334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:42.442747 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba91f281-d2f0-4fac-abb9-72fef61f89ad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1563 microversion: 2.1 time: 0.294540 Nov 27 21:21:42.443779 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3687/7245] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:42 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1563 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:21:44.764977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:21:44.766355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:21:44.773055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7b3e015f-ee15-4965-9f56-5274e2b40e81 req-23288ceb-e648-49c8-b5ae-38f0f02f9c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d5cb7d-f3c6-4750-b3bb-b3635e9d5085", "tag": "6d6aee5a-e927-42d5-9274-f286c5113e62"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:21:44.775093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:44.775582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:44.775798 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:21:44.775798 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:21:44.776384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:44.776830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:44.788949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7b3e015f-ee15-4965-9f56-5274e2b40e81 req-23288ceb-e648-49c8-b5ae-38f0f02f9c2d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:21:44.790250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7b3e015f-ee15-4965-9f56-5274e2b40e81 req-23288ceb-e648-49c8-b5ae-38f0f02f9c2d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:21:44.809899 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7b3e015f-ee15-4965-9f56-5274e2b40e81 req-23288ceb-e648-49c8-b5ae-38f0f02f9c2d service nova] Creating event network-changed:6d6aee5a-e927-42d5-9274-f286c5113e62 for instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 on nch2-master-1 Nov 27 21:21:44.815242 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7b3e015f-ee15-4965-9f56-5274e2b40e81 req-23288ceb-e648-49c8-b5ae-38f0f02f9c2d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051475 Nov 27 21:21:44.817238 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3688/7246] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:21:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:21:45.057735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:21:45.069006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89a6beb8-6e78-4da1-b3ec-4084fd289291 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1563 microversion: 2.1 time: 0.307942 Nov 27 21:21:45.069925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3559/7247] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:21:44 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1563 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:06.539464 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:22:06.539976 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:22:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:22:17.533739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d8f6b2f-9a7b-4867-af59-d83661490637 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:17.535378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d8f6b2f-9a7b-4867-af59-d83661490637 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:17.546852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8f6b2f-9a7b-4867-af59-d83661490637 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:17.547330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8f6b2f-9a7b-4867-af59-d83661490637 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:17.548574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8f6b2f-9a7b-4867-af59-d83661490637 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:17.548680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d8f6b2f-9a7b-4867-af59-d83661490637 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:17.602805 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d8f6b2f-9a7b-4867-af59-d83661490637 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085/action" status: 200 len: 24551 microversion: 2.1 time: 0.074071 Nov 27 21:22:17.619493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3689/7248] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:22:17 2021] POST /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085/action => generated 24551 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:22:18.921905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2011330171", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "9179657c-3f2a-45fb-8e4e-1dd2cdaf2dfe"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:18.976577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] validate_networks() for [('9179657c-3f2a-45fb-8e4e-1dd2cdaf2dfe', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:22:19.327383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:22:19.327811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:22:19.328286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:22:19.328698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:22:19.329113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:22:19.338486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:19.338937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:19.339794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:19.340238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:19.357062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Getting quotas for project 686a8233f0e94b2bac7e4eb02ac5a4f1. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:22:19.363389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Getting quotas for user 4c026d87d35444e8a8a722c1d3cde5cb and project 686a8233f0e94b2bac7e4eb02ac5a4f1. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:22:19.378429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:22:19.380802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:22:19.424165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8dc143e2-5306-4971-a675-d86d2da88670 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625213 Nov 27 21:22:19.425015 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3560/7249] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:22:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:22:19.435018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-af9ad588-dfd4-4b83-a82a-c4e69045c70c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:19.435742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-af9ad588-dfd4-4b83-a82a-c4e69045c70c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:19.492590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-af9ad588-dfd4-4b83-a82a-c4e69045c70c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:19.499061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-af9ad588-dfd4-4b83-a82a-c4e69045c70c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1214 microversion: 2.1 time: 0.068043 Nov 27 21:22:19.499658 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3690/7250] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:19 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:20.517817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:20.519197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:20.526143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:20.526599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:20.527431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:20.527869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:20.623313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:20.630765 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-411a86e1-a7a8-4466-927e-119e112c16a0 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1284 microversion: 2.1 time: 0.118534 Nov 27 21:22:20.631368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3561/7251] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:20 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:21.647894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:21.648600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:21.655994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:21.656472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:21.657299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:21.657734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:21.802662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:21.810243 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5eff7fe6-5611-46be-92d1-788073f5ad89 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.166013 Nov 27 21:22:21.810839 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3691/7252] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:21 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:21.928979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2e3f974f-2990-4b84-b8e1-4c750be350f5 req-48dc8092-69b4-4509-934b-a72187e563f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720f830e-31ce-45d1-a1b2-de4a18cccbaf", "tag": "aeb107de-073a-4791-a30e-585daa097032"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:21.930779 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:22:21.930779 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:22:21.941451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2e3f974f-2990-4b84-b8e1-4c750be350f5 req-48dc8092-69b4-4509-934b-a72187e563f3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:21.941907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2e3f974f-2990-4b84-b8e1-4c750be350f5 req-48dc8092-69b4-4509-934b-a72187e563f3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:21.959162 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2e3f974f-2990-4b84-b8e1-4c750be350f5 req-48dc8092-69b4-4509-934b-a72187e563f3 service nova] Creating event network-changed:aeb107de-073a-4791-a30e-585daa097032 for instance 720f830e-31ce-45d1-a1b2-de4a18cccbaf on nch2-master-1 Nov 27 21:22:21.965669 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2e3f974f-2990-4b84-b8e1-4c750be350f5 req-48dc8092-69b4-4509-934b-a72187e563f3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040911 Nov 27 21:22:21.966482 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3562/7253] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:22:22.829276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:22.829817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:22.836371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:22.836819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:22.837578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:22.838010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:22.967024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:22.974908 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59ca2a68-6c36-4648-a47b-c1238cf4ca2c tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.149330 Nov 27 21:22:22.975548 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3692/7254] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:22 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:23.993780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:23.994513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:24.000833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:24.001285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:24.002061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:24.002499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:24.133014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:24.140445 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-09a0353c-c726-44c9-bd91-8de28dcbfe86 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.151513 Nov 27 21:22:24.141017 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3563/7255] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:23 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:25.157068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:25.157678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:25.164528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:25.164975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:25.165748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:25.166186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:25.297870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:25.305735 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d2b4bd9c-ddb4-4ee9-9319-dcd6698b43a7 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.152325 Nov 27 21:22:25.306300 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3693/7256] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:25 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:26.322643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:26.323209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:26.329687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:26.330141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:26.330923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:26.331403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:26.461606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:26.469095 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1fd276cb-0363-4f22-baed-a1e5f0c4cb35 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.150436 Nov 27 21:22:26.469663 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3564/7257] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:26 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:27.487492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:27.488206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:27.495055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:27.495629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:27.496425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:27.496899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:27.628733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:27.636118 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15f81a22-e274-456d-a41a-f9338704152f tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.153254 Nov 27 21:22:27.636890 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3694/7258] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:27 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:28.653409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:28.654019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:28.661482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:28.661929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:28.662698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:28.663133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:28.794642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:28.802509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e212151-9c27-4719-bace-d0aa746c2d13 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.152832 Nov 27 21:22:28.803076 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3565/7259] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:28 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:29.691835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-bc20812c-9fd6-4bb0-8dbb-a49414c67eea req-cbd703c8-63cb-49c2-9158-9c70d1c08cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720f830e-31ce-45d1-a1b2-de4a18cccbaf", "name": "network-vif-plugged", "status": "completed", "tag": "aeb107de-073a-4791-a30e-585daa097032"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:29.693500 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:22:29.693500 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:22:29.700452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bc20812c-9fd6-4bb0-8dbb-a49414c67eea req-cbd703c8-63cb-49c2-9158-9c70d1c08cdc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:29.700837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bc20812c-9fd6-4bb0-8dbb-a49414c67eea req-cbd703c8-63cb-49c2-9158-9c70d1c08cdc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:29.711888 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-bc20812c-9fd6-4bb0-8dbb-a49414c67eea req-cbd703c8-63cb-49c2-9158-9c70d1c08cdc service nova] Creating event network-vif-plugged:aeb107de-073a-4791-a30e-585daa097032 for instance 720f830e-31ce-45d1-a1b2-de4a18cccbaf on nch2-master-1 Nov 27 21:22:29.716855 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-bc20812c-9fd6-4bb0-8dbb-a49414c67eea req-cbd703c8-63cb-49c2-9158-9c70d1c08cdc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100600 Nov 27 21:22:29.717465 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3695/7260] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:22:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:22:29.819410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:29.820111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:29.827181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:29.827670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:29.828465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:29.828904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:29.960984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:29.968287 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c6c883a-cf9d-4ad6-b497-fd561e150cbe tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.152704 Nov 27 21:22:29.968857 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3566/7261] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:29 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:30.988031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:30.988760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:30.995090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:30.995569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:30.996352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:30.996911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:31.130907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:31.138687 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d79d05a9-423b-4b49-9968-ba7c49169a36 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1314 microversion: 2.1 time: 0.157195 Nov 27 21:22:31.139276 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3696/7262] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:30 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:32.156290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:32.156902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:32.164263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:32.164718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:32.165496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:32.165933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:32.294702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:32.302602 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-36ad9c09-fb2b-4e10-b677-9a599fae12f2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1496 microversion: 2.1 time: 0.150042 Nov 27 21:22:32.303169 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3567/7263] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:32 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:34.397435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:34.397909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:34.404635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:34.405362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:34.406155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:34.406594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:34.436265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:22:34.513571 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cbb541cd-3315-4084-9a0a-b2e9165cb9e2 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "DELETE /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 204 len: 0 microversion: 2.1 time: 0.119563 Nov 27 21:22:34.514168 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3697/7264] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:22:34 2021] DELETE /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:22:34.524155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:34.524782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:34.531709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:34.532174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:34.532971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:34.534012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:34.669470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:34.676805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9db6284-5a6d-4323-9117-3668459987f3 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1502 microversion: 2.1 time: 0.157266 Nov 27 21:22:34.677373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3568/7265] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:34 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:35.697375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:35.698076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:35.704873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:35.706111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:35.706897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:35.707356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:35.841178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c026d87d35444e8a8a722c1d3cde5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:35.849101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5b4e73e-9b6a-485d-b649-f0f559f4a8de tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 200 len: 1502 microversion: 2.1 time: 0.155905 Nov 27 21:22:35.849678 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3698/7266] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:35 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:36.457616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a8a899f8-b818-42e4-8966-c9a262d1ac30 req-6851688f-a6ab-40ee-a93b-d8cf0565bfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720f830e-31ce-45d1-a1b2-de4a18cccbaf", "name": "network-vif-deleted", "tag": "aeb107de-073a-4791-a30e-585daa097032"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:36.459330 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:22:36.459330 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:22:36.466614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a8a899f8-b818-42e4-8966-c9a262d1ac30 req-6851688f-a6ab-40ee-a93b-d8cf0565bfdc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:36.467064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a8a899f8-b818-42e4-8966-c9a262d1ac30 req-6851688f-a6ab-40ee-a93b-d8cf0565bfdc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:36.481692 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a8a899f8-b818-42e4-8966-c9a262d1ac30 req-6851688f-a6ab-40ee-a93b-d8cf0565bfdc service nova] Creating event network-vif-deleted:aeb107de-073a-4791-a30e-585daa097032 for instance 720f830e-31ce-45d1-a1b2-de4a18cccbaf on nch2-master-1 Nov 27 21:22:36.487828 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a8a899f8-b818-42e4-8966-c9a262d1ac30 req-6851688f-a6ab-40ee-a93b-d8cf0565bfdc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102012 Nov 27 21:22:36.488622 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3569/7267] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:22:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:22:36.866175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:36.866788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] [instance: 720f830e-31ce-45d1-a1b2-de4a18cccbaf] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:36.873560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:36.874015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:36.874794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:36.875235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:36.888635 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] HTTP exception thrown: Instance 720f830e-31ce-45d1-a1b2-de4a18cccbaf could not be found. Nov 27 21:22:36.889197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] Returning 404 to user: Instance 720f830e-31ce-45d1-a1b2-de4a18cccbaf could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:22:36.890009 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21e3d3db-3d76-44f7-b9a3-e342b1603049 tempest-VolumesActionsTest-1294016791 tempest-VolumesActionsTest-1294016791-project] 10.222.0.21 "GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf" status: 404 len: 111 microversion: 2.1 time: 0.027585 Nov 27 21:22:36.890532 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3699/7268] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:36 2021] GET /compute/v2.1/servers/720f830e-31ce-45d1-a1b2-de4a18cccbaf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:22:48.050168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:48.051697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:48.057860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:48.058309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:48.059112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:48.059578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:48.137380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:22:48.137802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:22:48.138271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:22:48.138675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:22:48.139083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:22:48.195887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:48.201812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:48.202304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:48.203229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:48.203701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:48.230528 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a13f2df5-58df-484e-a1ae-ec357ca87646 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085/action" status: 202 len: 1138 microversion: 2.1 time: 0.186239 Nov 27 21:22:48.231179 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3570/7269] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:22:48 2021] POST /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085/action => generated 1138 bytes in 188 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 21:22:48.246517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:48.247284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:48.254659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:48.255365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:48.256322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:48.257012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:48.407104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:48.414639 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f542048f-0ad5-480e-8074-79dba171b210 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.172252 Nov 27 21:22:48.415428 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3700/7270] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:48 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:49.431863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:49.432391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:49.439285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:49.439766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:49.440556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:49.441017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:49.578520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:49.586607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7cba33aa-742b-4d89-86c3-afe6be63e88d tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.158615 Nov 27 21:22:49.587185 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3571/7271] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:49 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:50.603203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:50.603851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:50.610577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:50.611217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:50.612625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:50.613058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:50.750761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:50.758468 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aeafacb1-a53f-40bf-8369-62362d79a4d0 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.159005 Nov 27 21:22:50.759064 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3701/7272] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:50 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:51.777547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:51.778171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:51.785395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:51.786092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:51.786899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:51.787380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:51.937733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:51.948149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a8ee0ef3-7ccd-4718-abd1-e71a4a1d422b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.174563 Nov 27 21:22:51.948964 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3572/7273] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:51 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:52.967685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:52.968977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:52.975985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:52.976754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:52.977548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:52.977996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:53.134878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:53.142475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2b0221e-c5bc-447f-96bf-a6d3ffc8bf9c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.180387 Nov 27 21:22:53.143110 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3702/7274] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:52 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:54.158945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:54.159589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:54.166280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:54.166736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:54.167555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:54.168001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:54.345305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:54.353859 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-04af8bdc-0185-45cc-9c1a-a9b0f4cb8502 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.198518 Nov 27 21:22:54.354482 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3573/7275] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:54 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:55.371745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:55.372433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:55.380169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:55.380692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:55.381490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:55.381968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:55.526224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:55.534501 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10c05695-ac04-4711-ae77-67ab25370576 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.166575 Nov 27 21:22:55.535058 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3703/7276] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:55 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:56.457269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1488333097", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:56.505538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] validate_networks() for None {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:22:56.551475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:56.552159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:56.559088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:56.559681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:56.560558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:56.561090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:56.695809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:56.703423 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00a8f630-c29f-4794-bd31-a5315e7e67c1 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.155602 Nov 27 21:22:56.704085 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3704/7277] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:56 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:56.775296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:22:56.775723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:22:56.776198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:22:56.776610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:22:56.777023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:22:56.785798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:56.786250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:56.787064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:56.787544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:56.804933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Getting quotas for project e83b027153ea42e1b193393f015947f1. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:22:56.809935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Getting quotas for user 5aa295a582b041a1a535958cbeb50e8f and project e83b027153ea42e1b193393f015947f1. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:22:56.822828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:22:56.825265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:22:56.868505 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-be2c04ec-1274-4ece-9315-8c28b50f9b05 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415670 Nov 27 21:22:56.869152 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3574/7278] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:22:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:22:56.879534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f37b1db-4058-41ad-b58b-9d9af0bce56c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:56.880148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f37b1db-4058-41ad-b58b-9d9af0bce56c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:56.931302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5f37b1db-4058-41ad-b58b-9d9af0bce56c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:56.938127 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f37b1db-4058-41ad-b58b-9d9af0bce56c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1214 microversion: 2.1 time: 0.062969 Nov 27 21:22:56.938687 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3705/7279] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:56 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:57.722341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:57.722977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:57.729106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:57.729574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:57.730346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:57.730789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:57.956003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:57.956711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:57.965038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:57.965493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:57.966289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:57.966728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:57.987882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:57.995384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8114974f-88b9-425d-93cc-c4721809e803 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.278277 Nov 27 21:22:57.995977 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3575/7280] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:57 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:58.034877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:58.042307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab83aa0a-2470-45ee-baae-525de1b630aa tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1272 microversion: 2.1 time: 0.090874 Nov 27 21:22:58.042875 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3706/7281] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:57 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:59.015176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:59.015843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:59.025143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:59.025795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:59.026941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:59.027590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:59.059897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:22:59.061236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:22:59.069818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:59.070281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:59.071089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:59.071567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:59.237714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:59.245477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b8d9041-84dc-43a9-9f86-dffda8b69018 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.190031 Nov 27 21:22:59.246076 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3707/7282] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:59 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:22:59.491324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:22:59.498563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d9d4abc2-6f08-4481-a2d2-5179c09ac75c tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1691 microversion: 2.1 time: 0.488769 Nov 27 21:22:59.499141 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3576/7283] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:22:59 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1691 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:22:59.573121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a3e94b12-d11d-4786-b453-62cac677f508 req-a210d4d0-e351-471a-b880-15e293b861a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb", "tag": "c339fd67-2b47-427e-9554-ab5aa9895550"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:22:59.575192 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:22:59.575192 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:22:59.586069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a3e94b12-d11d-4786-b453-62cac677f508 req-a210d4d0-e351-471a-b880-15e293b861a6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:22:59.586817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a3e94b12-d11d-4786-b453-62cac677f508 req-a210d4d0-e351-471a-b880-15e293b861a6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:22:59.612726 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a3e94b12-d11d-4786-b453-62cac677f508 req-a210d4d0-e351-471a-b880-15e293b861a6 service nova] Creating event network-changed:c339fd67-2b47-427e-9554-ab5aa9895550 for instance d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb on nch2-master-1 Nov 27 21:22:59.617739 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a3e94b12-d11d-4786-b453-62cac677f508 req-a210d4d0-e351-471a-b880-15e293b861a6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048250 Nov 27 21:22:59.618449 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3708/7284] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:22:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:23:00.263315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:00.263940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:00.271418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:00.271877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:00.272671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:00.273119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:00.483778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:00.492062 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ab5a31d4-470e-40a7-984c-0087160146ac tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.232472 Nov 27 21:23:00.492665 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3577/7285] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:00 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:00.516719 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:00.517416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:00.523664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:00.524119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:00.524894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:00.525329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:00.660918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:00.668351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0547a76b-652a-4cb2-a48d-29a3e7676534 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1697 microversion: 2.1 time: 0.156385 Nov 27 21:23:00.668912 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3709/7286] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:00 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:01.509014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:01.509622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:01.516360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:01.516812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:01.518083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:01.518518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:01.655521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:01.662891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66faaa84-6823-4d73-a95f-cbde652763e8 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.157657 Nov 27 21:23:01.663493 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3578/7287] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:01 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:01.685585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:01.686228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:01.693879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:01.694328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:01.695105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:01.695568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:01.828089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:01.836097 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-22b7b2d9-442e-4059-88a4-09d82c47469b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1697 microversion: 2.1 time: 0.154244 Nov 27 21:23:01.836687 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3710/7288] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:01 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:02.680352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:02.680978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:02.687909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:02.688367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:02.689169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:02.689621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:02.853095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:02.853710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:02.855746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:02.860301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:02.861001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:02.861821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:02.862435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:02.863810 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cad65042-ba2f-4c33-a0d0-143a86f86688 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.187182 Nov 27 21:23:02.864507 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3579/7289] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:02 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:02.997306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:03.005012 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2455bb9a-8014-49ce-a000-324040557dda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1697 microversion: 2.1 time: 0.155641 Nov 27 21:23:03.005577 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3711/7290] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:02 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:23:03.787396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-630c1194-aad7-48d2-826c-a7ba867218cf req-cf7993b7-dc2d-41f7-a8ee-e8f590b1443b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cb7d-f3c6-4750-b3bb-b3635e9d5085", "name": "network-vif-unplugged", "status": "completed", "tag": "6d6aee5a-e927-42d5-9274-f286c5113e62"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:03.789018 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:03.789018 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:03.796684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-630c1194-aad7-48d2-826c-a7ba867218cf req-cf7993b7-dc2d-41f7-a8ee-e8f590b1443b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:03.797132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-630c1194-aad7-48d2-826c-a7ba867218cf req-cf7993b7-dc2d-41f7-a8ee-e8f590b1443b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:03.811389 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-630c1194-aad7-48d2-826c-a7ba867218cf req-cf7993b7-dc2d-41f7-a8ee-e8f590b1443b service nova] Creating event network-vif-unplugged:6d6aee5a-e927-42d5-9274-f286c5113e62 for instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 on nch2-master-1 Nov 27 21:23:03.816883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-630c1194-aad7-48d2-826c-a7ba867218cf req-cf7993b7-dc2d-41f7-a8ee-e8f590b1443b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033734 Nov 27 21:23:03.819938 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3580/7291] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:23:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:03.881361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:03.881972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:03.888812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:03.889259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:03.890031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:03.890566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:04.022178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:04.023003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:04.029637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:04.030099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:04.030964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:04.031439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:04.031649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:04.039524 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c957150-8400-45d0-aaa6-e2f99aba2914 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.161856 Nov 27 21:23:04.040179 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3712/7292] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:03 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:04.173093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:04.181888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b30a28fa-0f1a-4373-ba6c-a8684a60df1f tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1697 microversion: 2.1 time: 0.164120 Nov 27 21:23:04.182477 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3581/7293] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:04 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:05.057692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:05.058303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:05.065143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:05.065591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:05.066357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:05.066790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:05.196051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:05.198226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:05.198842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:05.203630 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fdacb15-955b-406f-a383-7325e032e9f4 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.149903 Nov 27 21:23:05.204196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3713/7294] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:05 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:05.206085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:05.206538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:05.207352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:05.207792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:05.338999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:05.346380 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-180fd640-fee7-4344-843e-059d7c1c2316 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1682 microversion: 2.1 time: 0.151833 Nov 27 21:23:05.346942 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3582/7295] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:05 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:23:05.904698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fa9d9144-b724-4695-a303-df1726e5ed89 req-3d834ebb-151e-43d8-a778-adc90bceb123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb", "name": "network-vif-plugged", "status": "completed", "tag": "c339fd67-2b47-427e-9554-ab5aa9895550"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:05.906214 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:05.906214 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:23:05.913349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fa9d9144-b724-4695-a303-df1726e5ed89 req-3d834ebb-151e-43d8-a778-adc90bceb123 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:05.913786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fa9d9144-b724-4695-a303-df1726e5ed89 req-3d834ebb-151e-43d8-a778-adc90bceb123 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:05.925176 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fa9d9144-b724-4695-a303-df1726e5ed89 req-3d834ebb-151e-43d8-a778-adc90bceb123 service nova] Creating event network-vif-plugged:c339fd67-2b47-427e-9554-ab5aa9895550 for instance d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb on nch2-master-1 Nov 27 21:23:05.930042 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fa9d9144-b724-4695-a303-df1726e5ed89 req-3d834ebb-151e-43d8-a778-adc90bceb123 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028989 Nov 27 21:23:05.930650 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3714/7296] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:23:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:06.221712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:06.222250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:06.228976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:06.229427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:06.230207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:06.230645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:06.365147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:06.372550 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce37c009-42a4-4cff-b1b6-87ca9ba8a7a6 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.155281 Nov 27 21:23:06.373084 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3583/7297] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:06 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:07.389783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:07.390414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:07.397435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:07.397875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:07.398638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:07.399067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:07.534788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:07.542232 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3bd812d0-fdf7-4652-aefe-dd27172684d2 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1314 microversion: 2.1 time: 0.156490 Nov 27 21:23:07.543084 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3715/7298] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:07 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:07.946256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-6f08d80e-a359-45e2-839f-0aa2312c359e req-ddc59a18-c4a0-477f-a0ad-6fc33ca64eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cb7d-f3c6-4750-b3bb-b3635e9d5085", "name": "network-vif-plugged", "status": "completed", "tag": "6d6aee5a-e927-42d5-9274-f286c5113e62"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:07.947865 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:07.947865 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:07.956387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6f08d80e-a359-45e2-839f-0aa2312c359e req-ddc59a18-c4a0-477f-a0ad-6fc33ca64eda service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:07.956916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-6f08d80e-a359-45e2-839f-0aa2312c359e req-ddc59a18-c4a0-477f-a0ad-6fc33ca64eda service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:07.967624 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-6f08d80e-a359-45e2-839f-0aa2312c359e req-ddc59a18-c4a0-477f-a0ad-6fc33ca64eda service nova] Creating event network-vif-plugged:6d6aee5a-e927-42d5-9274-f286c5113e62 for instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 on nch2-master-1 Nov 27 21:23:07.973161 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-6f08d80e-a359-45e2-839f-0aa2312c359e req-ddc59a18-c4a0-477f-a0ad-6fc33ca64eda service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030768 Nov 27 21:23:07.973740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3584/7299] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:23:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:08.559672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:08.560278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:08.567669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:08.568116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:08.568893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:08.569331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:08.708866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:08.716691 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b41d3bb0-f38a-4d28-88e0-f38099b2fb8c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1464 microversion: 2.1 time: 0.160609 Nov 27 21:23:08.717275 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3716/7300] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:08 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:08.733670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6852a938-3fd7-4478-a155-dd36f379fae1 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdd54218-1833-48c7-b2c5-a71771d4a096", "device": "/dev/sdb"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:08.734857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6852a938-3fd7-4478-a155-dd36f379fae1 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:08.742128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6852a938-3fd7-4478-a155-dd36f379fae1 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:08.742591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6852a938-3fd7-4478-a155-dd36f379fae1 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:08.743434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6852a938-3fd7-4478-a155-dd36f379fae1 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:08.743934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6852a938-3fd7-4478-a155-dd36f379fae1 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:08.975497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6852a938-3fd7-4478-a155-dd36f379fae1 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "POST /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245744 Nov 27 21:23:08.976209 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3585/7301] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:23:08 2021] POST /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:11.285213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:11.285709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:11.292380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:11.292827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:11.293596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:11.294028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:11.370144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lazy-loading 'services' on Instance uuid 0b475d9b-cae9-4927-8e6e-7350de7e4a42 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:23:11.442945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4979f803-eb7c-43d9-852a-943c457dc080 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42/os-volume_attachments/f4f886f9-5e7d-4b5a-bdf9-24c0605166d5" status: 202 len: 0 microversion: 2.1 time: 0.161847 Nov 27 21:23:11.443577 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3717/7302] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:23:11 2021] DELETE /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42/os-volume_attachments/f4f886f9-5e7d-4b5a-bdf9-24c0605166d5 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:23:12.550669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:12.551280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:12.557524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:12.557977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:12.558764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:12.559205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:12.584931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:23:12.659524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-644c0432-c753-4c0b-b778-7a09fc7d98e1 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 204 len: 0 microversion: 2.1 time: 0.113435 Nov 27 21:23:12.660048 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3586/7303] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:23:12 2021] DELETE /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:23:12.669361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:12.670056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:12.676916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:12.677367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:12.678155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:12.678596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:12.811110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:12.818621 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2c2d4e42-7056-4576-8fce-89ae4dce0409 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1514 microversion: 2.1 time: 0.154048 Nov 27 21:23:12.819196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3718/7304] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:12 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:13.836731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:13.837426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:13.844092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:13.844535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:13.845310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:13.845745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:13.978781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:13.987323 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e368491-87f2-4746-80ee-22085f4abea2 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1514 microversion: 2.1 time: 0.154723 Nov 27 21:23:13.987905 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3587/7305] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:13 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:14.887832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7ac84b65-774f-42ac-ad25-834cfd8d3629 req-8a21e94f-4fa6-4ccf-8420-2d043d0c8ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b475d9b-cae9-4927-8e6e-7350de7e4a42", "name": "network-vif-deleted", "tag": "9a1e4b76-fd3c-453b-94c3-0dc63230c428"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:14.890108 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:14.890108 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:23:14.903135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7ac84b65-774f-42ac-ad25-834cfd8d3629 req-8a21e94f-4fa6-4ccf-8420-2d043d0c8ff6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:14.903602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7ac84b65-774f-42ac-ad25-834cfd8d3629 req-8a21e94f-4fa6-4ccf-8420-2d043d0c8ff6 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:14.915393 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7ac84b65-774f-42ac-ad25-834cfd8d3629 req-8a21e94f-4fa6-4ccf-8420-2d043d0c8ff6 service nova] Creating event network-vif-deleted:9a1e4b76-fd3c-453b-94c3-0dc63230c428 for instance 0b475d9b-cae9-4927-8e6e-7350de7e4a42 on nch1-master-1 Nov 27 21:23:14.920229 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7ac84b65-774f-42ac-ad25-834cfd8d3629 req-8a21e94f-4fa6-4ccf-8420-2d043d0c8ff6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039156 Nov 27 21:23:14.920813 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3719/7306] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:23:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:15.004376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:15.005090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:15.011939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:15.012395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:15.013181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:15.013624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:15.044524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:15.044977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:15.045431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lazy-loading 'fault' on Instance uuid 0b475d9b-cae9-4927-8e6e-7350de7e4a42 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:23:15.084938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e49ff29764540ae95d8b9d0f9d4fbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05afa0d2a44144078e3fa7d820a95510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:15.092362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3356a7e6-d89c-468a-9d4e-47b2153f440a tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 200 len: 1308 microversion: 2.1 time: 0.091918 Nov 27 21:23:15.092934 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3588/7307] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:14 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:16.109713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:16.110402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] [instance: 0b475d9b-cae9-4927-8e6e-7350de7e4a42] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:16.117523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:16.117963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:16.118726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:16.119160 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:16.132329 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] HTTP exception thrown: Instance 0b475d9b-cae9-4927-8e6e-7350de7e4a42 could not be found. Nov 27 21:23:16.132903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] Returning 404 to user: Instance 0b475d9b-cae9-4927-8e6e-7350de7e4a42 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:23:16.133712 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-167220cf-a026-4133-ade9-20edf16a40a5 tempest-VolumesSnapshotTestJSON-481511107 tempest-VolumesSnapshotTestJSON-481511107-project] 10.222.0.21 "GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42" status: 404 len: 111 microversion: 2.1 time: 0.028797 Nov 27 21:23:16.134230 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3720/7308] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:16 2021] GET /compute/v2.1/servers/0b475d9b-cae9-4927-8e6e-7350de7e4a42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:23:17.602297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:17.602849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:17.609310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:17.609774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:17.611573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:17.612107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:17.695078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lazy-loading 'services' on Instance uuid d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:23:17.762097 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc79b29f-c0b8-4aae-bed1-136fadabcd60 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb/os-volume_attachments/fdd54218-1833-48c7-b2c5-a71771d4a096" status: 202 len: 0 microversion: 2.1 time: 0.170523 Nov 27 21:23:17.765991 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3589/7309] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:23:17 2021] DELETE /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb/os-volume_attachments/fdd54218-1833-48c7-b2c5-a71771d4a096 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:23:18.872075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:18.872596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:18.879351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:18.879798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:18.880576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:18.881034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:18.907071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:23:18.984104 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f2d8323-8a9f-416d-b393-6e392d3ede13 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 204 len: 0 microversion: 2.1 time: 0.115269 Nov 27 21:23:18.984770 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3721/7310] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:23:18 2021] DELETE /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:23:18.995451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:18.996171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:19.003054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:19.003499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:19.004309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:19.004766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:19.141553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:19.149956 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9bd4102f-ee75-4b35-8435-793e74a95b5c tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1470 microversion: 2.1 time: 0.159672 Nov 27 21:23:19.150708 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3590/7311] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:18 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:23:20.167943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:20.168646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:20.176104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:20.176562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:20.177351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:20.177792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:20.324022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:20.332697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1fe22ad0-294f-4981-9cef-298c7dd3df09 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1470 microversion: 2.1 time: 0.168805 Nov 27 21:23:20.333198 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3722/7312] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:20 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:23:21.351066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-14e150cb-84c8-4e6c-9fd8-dd0bffedcdc3 req-4eea23a1-302f-44a1-b7c9-94aec4c4f30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb", "name": "network-vif-deleted", "tag": "c339fd67-2b47-427e-9554-ab5aa9895550"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:21.352363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:21.354285 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:21.354285 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:21.354834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:21.370916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:21.371714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:21.382927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-14e150cb-84c8-4e6c-9fd8-dd0bffedcdc3 req-4eea23a1-302f-44a1-b7c9-94aec4c4f30e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:21.382927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-14e150cb-84c8-4e6c-9fd8-dd0bffedcdc3 req-4eea23a1-302f-44a1-b7c9-94aec4c4f30e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:21.383154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:21.383154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:21.405873 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-14e150cb-84c8-4e6c-9fd8-dd0bffedcdc3 req-4eea23a1-302f-44a1-b7c9-94aec4c4f30e service nova] Creating event network-vif-deleted:c339fd67-2b47-427e-9554-ab5aa9895550 for instance d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb on nch2-master-1 Nov 27 21:23:21.414854 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-14e150cb-84c8-4e6c-9fd8-dd0bffedcdc3 req-4eea23a1-302f-44a1-b7c9-94aec4c4f30e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073204 Nov 27 21:23:21.418940 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3591/7313] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:23:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:21.480554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa295a582b041a1a535958cbeb50e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83b027153ea42e1b193393f015947f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:23:21.489106 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d32b509-c185-4b68-a15f-616c8bbde187 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 200 len: 1299 microversion: 2.1 time: 0.143024 Nov 27 21:23:21.496137 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3723/7314] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:21 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:23:22.510009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:22.510706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] [instance: d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:22.517459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:22.517908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:22.518684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:22.519119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:22.533295 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] HTTP exception thrown: Instance d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb could not be found. Nov 27 21:23:22.537705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] Returning 404 to user: Instance d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:23:22.537705 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb4db415-8ea0-4503-bd16-7b2ba8de1973 tempest-VolumesBackupsTest-1517995977 tempest-VolumesBackupsTest-1517995977-project] 10.222.0.21 "GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb" status: 404 len: 111 microversion: 2.1 time: 0.028852 Nov 27 21:23:22.537705 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3592/7315] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:23:22 2021] GET /compute/v2.1/servers/d90f308a-4dbf-4fd7-a3b5-0b6575d1a7fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:23:41.589740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b2b97a0-094b-4785-845e-b6456fd76fad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:41.590746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b2b97a0-094b-4785-845e-b6456fd76fad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:23:41.597721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2b97a0-094b-4785-845e-b6456fd76fad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:41.598207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2b97a0-094b-4785-845e-b6456fd76fad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:41.599661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2b97a0-094b-4785-845e-b6456fd76fad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:41.599661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b2b97a0-094b-4785-845e-b6456fd76fad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:41.650447 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b2b97a0-094b-4785-845e-b6456fd76fad tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "POST /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085/action" status: 200 len: 24566 microversion: 2.1 time: 0.064382 Nov 27 21:23:41.651307 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3724/7316] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:23:41 2021] POST /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085/action => generated 24566 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:23:58.906979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-39d59ffb-682c-4706-ac92-b1eb8c312007 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1815316208", "availability_zone": "foo_zone"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:58.908508 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:58.908508 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:58.909772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.aggregate [None req-39d59ffb-682c-4706-ac92-b1eb8c312007 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Generated uuid a167dc14-6e56-45a2-8f2a-5a04d10ef9e1 for aggregate {{(pid=135679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 27 21:23:58.941156 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-39d59ffb-682c-4706-ac92-b1eb8c312007 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.171402 Nov 27 21:23:58.942073 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3593/7317] 10.222.0.21 () {60 vars in 1163 bytes} [Sat Nov 27 21:23:58 2021] POST /compute/v2.1/os-aggregates => generated 209 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:58.953750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-239a7ee1-d466-4991-8c5f-217586710c7e tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:58.964538 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:58.964538 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:23:59.018106 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-239a7ee1-d466-4991-8c5f-217586710c7e tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.068836 Nov 27 21:23:59.019071 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3725/7318] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 21:23:58 2021] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.029335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-01fe3361-2d4a-4243-bb1a-25cd73b0140d tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:59.030585 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.030585 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:59.032256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fe3361-2d4a-4243-bb1a-25cd73b0140d tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:59.032707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fe3361-2d4a-4243-bb1a-25cd73b0140d tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:59.034431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fe3361-2d4a-4243-bb1a-25cd73b0140d tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:59.034880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01fe3361-2d4a-4243-bb1a-25cd73b0140d tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:59.064774 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-01fe3361-2d4a-4243-bb1a-25cd73b0140d tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039239 Nov 27 21:23:59.065383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3594/7319] 10.222.0.21 () {58 vars in 1175 bytes} [Sat Nov 27 21:23:59 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.076234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7de13e2e-c8c7-4db2-bddf-dcad2293ca13 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:59.076909 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.076909 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:23:59.088029 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7de13e2e-c8c7-4db2-bddf-dcad2293ca13 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016004 Nov 27 21:23:59.088603 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3726/7320] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 21:23:59 2021] GET /compute/v2.1/os-aggregates => generated 298 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.099665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05fd76b0-adc6-42a1-bff3-a719d17294d8 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:59.100855 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.100855 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:59.109600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05fd76b0-adc6-42a1-bff3-a719d17294d8 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:59.110063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05fd76b0-adc6-42a1-bff3-a719d17294d8 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:59.410566 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05fd76b0-adc6-42a1-bff3-a719d17294d8 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.314627 Nov 27 21:23:59.411132 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3595/7321] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 21:23:59 2021] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.421478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0be43d1-1b4c-45e7-bd60-20bd86a46f2a tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:59.422769 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.422769 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:23:59.439237 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0be43d1-1b4c-45e7-bd60-20bd86a46f2a tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.021684 Nov 27 21:23:59.440049 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3727/7322] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 21:23:59 2021] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.454840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2acbb0c-8f96-488d-8623-8012497e8f36 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1507668682", "availability_zone": "foo_zone"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:59.457536 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.457536 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:59.509136 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2acbb0c-8f96-488d-8623-8012497e8f36 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.061203 Nov 27 21:23:59.510007 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3596/7323] 10.222.0.21 () {60 vars in 1172 bytes} [Sat Nov 27 21:23:59 2021] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.520052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-daacd524-6cb7-4538-bd6d-919e6ca822f3 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:59.521534 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.521534 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:23:59.548256 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-daacd524-6cb7-4538-bd6d-919e6ca822f3 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.030845 Nov 27 21:23:59.549520 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3728/7324] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 21:23:59 2021] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.559517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6daee054-f1d2-460b-a14c-54baf2821dd1 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:59.560273 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.560273 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:59.569076 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6daee054-f1d2-460b-a14c-54baf2821dd1 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013227 Nov 27 21:23:59.569631 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3597/7325] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 21:23:59 2021] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.579679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f66b6ba-4a2d-4520-a32e-4bf6b4063a8a tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:23:59.581038 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.581038 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:23:59.590804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f66b6ba-4a2d-4520-a32e-4bf6b4063a8a tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:23:59.591374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f66b6ba-4a2d-4520-a32e-4bf6b4063a8a tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:23:59.876500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f66b6ba-4a2d-4520-a32e-4bf6b4063a8a tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.300325 Nov 27 21:23:59.877157 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3729/7326] 10.222.0.21 () {60 vars in 1193 bytes} [Sat Nov 27 21:23:59 2021] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:23:59.888448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-502daaad-ddbc-4d67-a820-73fa9ff37e44 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:23:59.889463 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:23:59.889463 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:23:59.918330 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-502daaad-ddbc-4d67-a820-73fa9ff37e44 tempest-TestAggregatesBasicOps-914403787 tempest-TestAggregatesBasicOps-914403787-project-admin] 10.222.0.21 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.034536 Nov 27 21:23:59.919720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3598/7327] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 21:23:59 2021] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 27 21:24:08.509833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-230f972a-66e8-4214-a17a-c0594677a27d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'create', calling method: .version_select at 0x7f15c6dbd4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-670670702"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:08.534921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-230f972a-66e8-4214-a17a-c0594677a27d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:24:08.548352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-230f972a-66e8-4214-a17a-c0594677a27d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:24:08.783188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-230f972a-66e8-4214-a17a-c0594677a27d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:24:08.798306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-230f972a-66e8-4214-a17a-c0594677a27d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:24:08.815832 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-230f972a-66e8-4214-a17a-c0594677a27d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.310066 Nov 27 21:24:08.816105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3730/7328] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:24:08 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:10.576227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2119594244", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "ec766a40-9645-4edf-b91e-8b4e69b2d68a"}], "key_name": "tempest-TestNetworkBasicOps-670670702", "security_groups": [{"name": "tempest-secgroup-smoke-905873407"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:10.767567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] validate_networks() for [('ec766a40-9645-4edf-b91e-8b4e69b2d68a', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:24:11.564892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:24:11.565320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:24:11.565798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:24:11.566390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:24:11.566808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:24:11.577525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:11.579406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:11.580431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:11.581060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:11.604055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:24:11.611725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:24:11.632859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:24:11.635568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:24:11.705522 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-640434a0-867d-4856-83f2-957c571c1cc0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.134398 Nov 27 21:24:11.706186 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3599/7329] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:24:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:24:11.717516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1c8471f1-83d6-4e88-ab6d-921c5f740862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:11.719207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1c8471f1-83d6-4e88-ab6d-921c5f740862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:11.785159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1c8471f1-83d6-4e88-ab6d-921c5f740862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:11.794128 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1c8471f1-83d6-4e88-ab6d-921c5f740862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1248 microversion: 2.1 time: 0.081537 Nov 27 21:24:11.795059 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3731/7330] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:11 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:12.760327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:12.761037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:12.765572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-53906169-a2a2-4394-9754-0ea166c15378 req-970f3332-c422-4e00-a81d-35ce57585cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d5cb7d-f3c6-4750-b3bb-b3635e9d5085", "tag": "6d6aee5a-e927-42d5-9274-f286c5113e62"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:12.766970 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:12.766970 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:24:12.769134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:12.769931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:12.771423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:12.772170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:12.775969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-53906169-a2a2-4394-9754-0ea166c15378 req-970f3332-c422-4e00-a81d-35ce57585cb0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:12.776515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-53906169-a2a2-4394-9754-0ea166c15378 req-970f3332-c422-4e00-a81d-35ce57585cb0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:12.790271 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-53906169-a2a2-4394-9754-0ea166c15378 req-970f3332-c422-4e00-a81d-35ce57585cb0 service nova] Creating event network-changed:6d6aee5a-e927-42d5-9274-f286c5113e62 for instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 on nch2-master-1 Nov 27 21:24:12.795577 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-53906169-a2a2-4394-9754-0ea166c15378 req-970f3332-c422-4e00-a81d-35ce57585cb0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033437 Nov 27 21:24:12.797171 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3732/7331] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:24:12.810984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:24:12.832367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:12.833269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:12.840595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:12.841278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:12.842272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:12.843024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:12.926840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:12.937493 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72f625af-d684-4d38-b1db-74e8f43fedff tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1308 microversion: 2.1 time: 0.128305 Nov 27 21:24:12.938976 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3733/7332] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:12 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:12.941918 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ae249b20-ebb6-4878-9dd8-6065e8c1f752 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 204 len: 0 microversion: 2.1 time: 0.185183 Nov 27 21:24:12.942502 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3600/7333] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:24:12 2021] DELETE /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:24:12.950629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:12.951361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:12.958666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:12.959321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:12.960186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:12.960694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:13.120793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:13.130470 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-304461c8-ab69-4430-9e8d-a4df5ef624aa tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1688 microversion: 2.1 time: 0.183580 Nov 27 21:24:13.131222 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3734/7334] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:12 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:13.956241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:13.957940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:13.965532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:13.966354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:13.967332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:13.968010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:14.147993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:14.148615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:14.155327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:14.155809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:14.156583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:14.157044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:14.265907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:14.273954 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-048f2eb8-2127-4893-a275-4b59312c91c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1373 microversion: 2.1 time: 0.321884 Nov 27 21:24:14.274805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3601/7335] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:13 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1373 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:14.303476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:14.311006 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c2926cc4-9b03-4f6f-871d-e4aea424ba1a tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1569 microversion: 2.1 time: 0.166757 Nov 27 21:24:14.311618 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3735/7336] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:14 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:24:14.864385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-664b017a-293d-41a2-a66c-0a5b599d57cc req-c13bc5eb-28d8-4504-b382-4bb8bacc9f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca8448b-eaa8-47e5-b00f-34103c7cc12b", "tag": "d30ce7d3-47f0-4788-b766-c0f924abb913"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:14.866501 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:14.866501 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:24:14.876608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-664b017a-293d-41a2-a66c-0a5b599d57cc req-c13bc5eb-28d8-4504-b382-4bb8bacc9f66 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:14.877456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-664b017a-293d-41a2-a66c-0a5b599d57cc req-c13bc5eb-28d8-4504-b382-4bb8bacc9f66 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:14.899793 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-664b017a-293d-41a2-a66c-0a5b599d57cc req-c13bc5eb-28d8-4504-b382-4bb8bacc9f66 service nova] Creating event network-changed:d30ce7d3-47f0-4788-b766-c0f924abb913 for instance aca8448b-eaa8-47e5-b00f-34103c7cc12b on nch1-master-1 Nov 27 21:24:14.907068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-664b017a-293d-41a2-a66c-0a5b599d57cc req-c13bc5eb-28d8-4504-b382-4bb8bacc9f66 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049397 Nov 27 21:24:14.907975 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3602/7337] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:24:15.293148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:15.293895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:15.301396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:15.301926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:15.302778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:15.303362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:15.330058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:15.331137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:15.337867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:15.338458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:15.339431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:15.339985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:15.423170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c4fe50315d4fc0b0329e80802eee86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587ce621728b4cb1b01fd53d69d45d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:15.431287 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f85510f3-230d-4f35-a2f6-8b82f5ebbc0b tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 200 len: 1502 microversion: 2.1 time: 0.106216 Nov 27 21:24:15.432784 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3603/7338] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:15 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 1502 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:24:15.477409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:15.484850 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1afb418c-bfde-4a6d-96d6-84ad011c9ad8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1373 microversion: 2.1 time: 0.196091 Nov 27 21:24:15.485915 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3736/7339] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:15 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:16.453043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:16.453729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] [instance: 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:16.461813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:16.462283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:16.463095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:16.463616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:16.480219 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] HTTP exception thrown: Instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 could not be found. Nov 27 21:24:16.480819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Returning 404 to user: Instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:24:16.481655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5a5d16f0-1920-4f73-ba36-85a68ec0eeda tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085" status: 404 len: 111 microversion: 2.1 time: 0.032844 Nov 27 21:24:16.482208 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3604/7340] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:16 2021] GET /compute/v2.1/servers/42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:24:16.502190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:16.502915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:16.509701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:16.510232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:16.511095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:16.511629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:16.769382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:16.776852 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-01beb8cb-653a-4ef3-a9ce-f72099fa743c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1373 microversion: 2.1 time: 0.278897 Nov 27 21:24:16.777538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3737/7341] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:16 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1373 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:16.932203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5c288d70-4a84-4f0f-b212-55d45447c543 req-35914cc7-e03d-4265-9817-c0a8b74af271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d5cb7d-f3c6-4750-b3bb-b3635e9d5085", "name": "network-vif-deleted", "tag": "6d6aee5a-e927-42d5-9274-f286c5113e62"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:16.933957 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:16.933957 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:24:16.940944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5c288d70-4a84-4f0f-b212-55d45447c543 req-35914cc7-e03d-4265-9817-c0a8b74af271 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:16.941391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5c288d70-4a84-4f0f-b212-55d45447c543 req-35914cc7-e03d-4265-9817-c0a8b74af271 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:16.952247 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5c288d70-4a84-4f0f-b212-55d45447c543 req-35914cc7-e03d-4265-9817-c0a8b74af271 service nova] Creating event network-vif-deleted:6d6aee5a-e927-42d5-9274-f286c5113e62 for instance 42d5cb7d-f3c6-4750-b3bb-b3635e9d5085 on nch2-master-1 Nov 27 21:24:16.957009 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5c288d70-4a84-4f0f-b212-55d45447c543 req-35914cc7-e03d-4265-9817-c0a8b74af271 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028473 Nov 27 21:24:16.957604 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3605/7342] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:24:17.793888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:17.794495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:17.802350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:17.802795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:17.803978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:17.804103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:18.030032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:18.038822 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6087ff6-25e1-48d8-8ca8-a9a023c91a4c tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1373 microversion: 2.1 time: 0.248142 Nov 27 21:24:18.039427 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3738/7343] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:17 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:19.058952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:19.059694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:19.068469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:19.068928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:19.069725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:19.070199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:19.262959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:19.271223 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58531a3e-5a41-4962-8962-55db01a89a51 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1373 microversion: 2.1 time: 0.217828 Nov 27 21:24:19.272089 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3606/7344] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:19 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:19.729248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72d8b4ef-04c2-4feb-bed5-9e1795c83863 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] Calling method '.version_select at 0x7f15d94bbf70>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:19.751486 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72d8b4ef-04c2-4feb-bed5-9e1795c83863 tempest-TestNetworkAdvancedServerOps-359302002 tempest-TestNetworkAdvancedServerOps-359302002-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-994555197" status: 202 len: 0 microversion: 2.1 time: 0.025292 Nov 27 21:24:19.752245 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3739/7345] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 21:24:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-994555197 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:24:20.289226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:20.289916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:20.296745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:20.297199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:20.299615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:20.300320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:20.444926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:20.453004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-245228ee-2160-40d4-93d9-3d16f672e28a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1373 microversion: 2.1 time: 0.167565 Nov 27 21:24:20.453558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3607/7346] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:20 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:20.747955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2f1e0b83-3289-47fb-a8ce-5ac3d96aeecc req-1ac1df99-daea-4109-a002-c7c6a82f35b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca8448b-eaa8-47e5-b00f-34103c7cc12b", "name": "network-vif-plugged", "status": "completed", "tag": "d30ce7d3-47f0-4788-b766-c0f924abb913"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:20.750195 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:20.750195 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:24:20.762496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2f1e0b83-3289-47fb-a8ce-5ac3d96aeecc req-1ac1df99-daea-4109-a002-c7c6a82f35b9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:20.763176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2f1e0b83-3289-47fb-a8ce-5ac3d96aeecc req-1ac1df99-daea-4109-a002-c7c6a82f35b9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:20.776414 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2f1e0b83-3289-47fb-a8ce-5ac3d96aeecc req-1ac1df99-daea-4109-a002-c7c6a82f35b9 service nova] Creating event network-vif-plugged:d30ce7d3-47f0-4788-b766-c0f924abb913 for instance aca8448b-eaa8-47e5-b00f-34103c7cc12b on nch1-master-1 Nov 27 21:24:20.781957 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2f1e0b83-3289-47fb-a8ce-5ac3d96aeecc req-1ac1df99-daea-4109-a002-c7c6a82f35b9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038977 Nov 27 21:24:20.783087 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3740/7347] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:24:21.470755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:21.471633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:21.478408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:21.478859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:21.479668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:21.480104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:21.617374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:21.625032 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24c73ee6-5ff6-4dba-8693-385295150efd tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1373 microversion: 2.1 time: 0.158013 Nov 27 21:24:21.632523 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3608/7348] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:21 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:22.643656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:22.645064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:22.651080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:22.651628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:22.652446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:22.652872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:22.790623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:22.797928 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-832a0dc0-1d5c-45ed-b205-0def92be0e53 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1544 microversion: 2.1 time: 0.159709 Nov 27 21:24:22.798502 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3741/7349] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:22 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:22.813999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:22.814750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:22.821632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:22.822082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:22.822863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:22.823328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:22.966718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:22.974594 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95adb05d-c102-42b6-bc0b-880985e30724 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1544 microversion: 2.1 time: 0.164393 Nov 27 21:24:22.975240 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3609/7350] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:22 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1544 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:25.119151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-18faf31e-8901-40af-91bb-7337f891fb73 req-2d7d124d-177e-4b1f-8c08-9ad5787e38bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca8448b-eaa8-47e5-b00f-34103c7cc12b", "tag": "d30ce7d3-47f0-4788-b766-c0f924abb913"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:25.121209 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:25.121209 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:24:25.133220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-18faf31e-8901-40af-91bb-7337f891fb73 req-2d7d124d-177e-4b1f-8c08-9ad5787e38bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:25.133838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-18faf31e-8901-40af-91bb-7337f891fb73 req-2d7d124d-177e-4b1f-8c08-9ad5787e38bd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:25.145704 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-18faf31e-8901-40af-91bb-7337f891fb73 req-2d7d124d-177e-4b1f-8c08-9ad5787e38bd service nova] Creating event network-changed:d30ce7d3-47f0-4788-b766-c0f924abb913 for instance aca8448b-eaa8-47e5-b00f-34103c7cc12b on nch1-master-1 Nov 27 21:24:25.151650 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-18faf31e-8901-40af-91bb-7337f891fb73 req-2d7d124d-177e-4b1f-8c08-9ad5787e38bd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037263 Nov 27 21:24:25.152865 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3742/7351] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:24:27.571465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1335338440", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "cfe74ea6-5149-437e-a407-b2d894036d57"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:27.622359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] validate_networks() for [('cfe74ea6-5149-437e-a407-b2d894036d57', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:24:27.962164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:24:27.962611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:24:27.963082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:24:27.963528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:24:27.963941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:24:27.973133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:27.973582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:27.974390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:27.974828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:27.991302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Getting quotas for project c7fd68c2720747e98f51f396d9f4dd78. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:24:27.996157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Getting quotas for user afd2e66b6a504b77a139c37ea777d41a and project c7fd68c2720747e98f51f396d9f4dd78. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:24:28.008029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:24:28.010319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:24:28.054228 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98c1dcc3-f6a8-4114-9c6b-61b473507b03 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596282 Nov 27 21:24:28.054881 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3610/7352] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:24:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:24:28.066131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2cd2d8d0-bea0-4e02-bdc9-f4c38c968af9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:28.066939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2cd2d8d0-bea0-4e02-bdc9-f4c38c968af9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:28.118925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2cd2d8d0-bea0-4e02-bdc9-f4c38c968af9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:28.126585 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2cd2d8d0-bea0-4e02-bdc9-f4c38c968af9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1215 microversion: 2.1 time: 0.065401 Nov 27 21:24:28.127151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3743/7353] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:28 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:29.146674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:29.147707 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:29.156270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:29.156922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:29.157723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:29.158162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:29.254859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:29.262234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b5187205-b2f6-457a-9b26-061c4504c708 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1273 microversion: 2.1 time: 0.122153 Nov 27 21:24:29.262812 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3611/7354] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:29 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:30.209728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a8f3a564-83cd-4e1e-aaf1-b19772d816ce req-65518712-9fc4-4b08-b0fc-3a588dacc437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7f8e36-7395-4d4b-bf2c-374275600825", "tag": "2c58aae0-e161-45cc-b01b-2bd02188fc40"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:30.212293 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:30.212293 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:24:30.221646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a8f3a564-83cd-4e1e-aaf1-b19772d816ce req-65518712-9fc4-4b08-b0fc-3a588dacc437 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:30.222103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a8f3a564-83cd-4e1e-aaf1-b19772d816ce req-65518712-9fc4-4b08-b0fc-3a588dacc437 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:30.241470 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a8f3a564-83cd-4e1e-aaf1-b19772d816ce req-65518712-9fc4-4b08-b0fc-3a588dacc437 service nova] Creating event network-changed:2c58aae0-e161-45cc-b01b-2bd02188fc40 for instance ea7f8e36-7395-4d4b-bf2c-374275600825 on nch2-master-1 Nov 27 21:24:30.246294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a8f3a564-83cd-4e1e-aaf1-b19772d816ce req-65518712-9fc4-4b08-b0fc-3a588dacc437 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040783 Nov 27 21:24:30.246959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3744/7355] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:24:30.280062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:30.280824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:30.288514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:30.289136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:30.289932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:30.290377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:30.524124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:30.532277 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ef78f43d-b9ef-4616-b5d3-9c3d51979311 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1315 microversion: 2.1 time: 0.255817 Nov 27 21:24:30.532983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3612/7356] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:30 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:31.550445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:31.551134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:31.557245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:31.557690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:31.558477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:31.558909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:31.689525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:31.696713 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-408e9bb6-1a5f-4038-9258-e231a1fd06e7 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1315 microversion: 2.1 time: 0.151136 Nov 27 21:24:31.697289 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3745/7357] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:31 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:32.714168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:32.714691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:32.722187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:32.722641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:32.723466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:32.723910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:32.852525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:32.860481 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f4c0d58c-08f1-4cbc-adee-c5969d7dddf8 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1315 microversion: 2.1 time: 0.149496 Nov 27 21:24:32.861058 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3613/7358] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:32 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:33.878053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:33.878691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:33.885472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:33.885923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:33.886694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:33.887131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:34.017924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:34.025323 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa5c2da0-d621-4f7f-b83e-9bf60a50b353 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1315 microversion: 2.1 time: 0.151721 Nov 27 21:24:34.025897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3746/7359] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:33 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:35.041685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:35.042281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:35.049196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:35.049647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:35.050419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:35.050858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:35.182142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:35.190233 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0168addf-f1d3-45b6-ac7c-96ec961b88b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1315 microversion: 2.1 time: 0.152222 Nov 27 21:24:35.190805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3614/7360] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:35 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:36.206790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:36.207759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:36.214946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:36.215437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:36.216221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:36.216662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:36.247564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1c952f1c-1b1d-49db-a309-88fc71dec94d req-121e85f7-831c-44d8-ae4b-72790d15e375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7f8e36-7395-4d4b-bf2c-374275600825", "name": "network-vif-plugged", "status": "completed", "tag": "2c58aae0-e161-45cc-b01b-2bd02188fc40"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:36.249187 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:36.249187 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:24:36.257644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1c952f1c-1b1d-49db-a309-88fc71dec94d req-121e85f7-831c-44d8-ae4b-72790d15e375 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:36.258076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1c952f1c-1b1d-49db-a309-88fc71dec94d req-121e85f7-831c-44d8-ae4b-72790d15e375 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:36.270986 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1c952f1c-1b1d-49db-a309-88fc71dec94d req-121e85f7-831c-44d8-ae4b-72790d15e375 service nova] Creating event network-vif-plugged:2c58aae0-e161-45cc-b01b-2bd02188fc40 for instance ea7f8e36-7395-4d4b-bf2c-374275600825 on nch2-master-1 Nov 27 21:24:36.276692 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1c952f1c-1b1d-49db-a309-88fc71dec94d req-121e85f7-831c-44d8-ae4b-72790d15e375 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Nov 27 21:24:36.277544 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3615/7361] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:24:36.357195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:36.364967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27063462-7b70-46b2-bfef-30de9981cbb0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1315 microversion: 2.1 time: 0.162365 Nov 27 21:24:36.365546 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3747/7362] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:36 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:37.382251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:37.382949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:37.389226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:37.389681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:37.390462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:37.390903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:37.526837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:37.534813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-291b90f8-2e79-401c-83dd-0bb41c717185 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1315 microversion: 2.1 time: 0.157421 Nov 27 21:24:37.535430 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3616/7363] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:37 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:38.551689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:38.552298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:38.559082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.559570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:38.560349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.560792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:38.692556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:38.700053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-474f4f9d-5c45-4221-95c4-5f6ceca89fa5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1501 microversion: 2.1 time: 0.152008 Nov 27 21:24:38.700565 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3748/7364] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:38 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:38.716412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:38.717063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:38.723853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.724313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:38.725100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.725571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:38.852962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:38.860665 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5427d140-6ac4-4998-a3c5-734b89e1b1bd tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1501 microversion: 2.1 time: 0.147919 Nov 27 21:24:38.861247 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3617/7365] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:38 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:38.877415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:38.877945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:38.883791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.884240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:38.885001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.885430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:38.908043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lazy-loading 'flavor' on Instance uuid ea7f8e36-7395-4d4b-bf2c-374275600825 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:24:38.971138 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20f2a3ad-cd2e-49d5-a02c-ee39fc2e7948 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action" status: 202 len: 0 microversion: 2.1 time: 0.098044 Nov 27 21:24:38.971764 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3749/7366] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:24:38 2021] POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:24:38.980323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:38.980942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:38.988144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.988739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:38.989613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:38.990176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:39.121080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:39.129098 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e34abbc9-83e0-44d1-a045-2e1c533942a0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1509 microversion: 2.1 time: 0.152919 Nov 27 21:24:39.129686 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3618/7367] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:38 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:40.147766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:40.148462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:40.154667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:40.155113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:40.156011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:40.156458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:40.286265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:40.293557 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c23b2145-50c0-4474-b698-2bede5a463b5 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1492 microversion: 2.1 time: 0.150689 Nov 27 21:24:40.294163 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3750/7368] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:40 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1492 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:40.310271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54916588-628e-4bd5-959d-8f6bb94d7e91 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:40.310854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54916588-628e-4bd5-959d-8f6bb94d7e91 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:40.319045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54916588-628e-4bd5-959d-8f6bb94d7e91 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:40.319668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54916588-628e-4bd5-959d-8f6bb94d7e91 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:40.320480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54916588-628e-4bd5-959d-8f6bb94d7e91 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:40.320926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54916588-628e-4bd5-959d-8f6bb94d7e91 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:40.389384 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54916588-628e-4bd5-959d-8f6bb94d7e91 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action" status: 202 len: 0 microversion: 2.1 time: 0.082870 Nov 27 21:24:40.390078 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3619/7369] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:24:40 2021] POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:24:40.398604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:40.399129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:40.405598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:40.406454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:40.407631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:40.408227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:40.545115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:40.553229 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f084786-6c2f-4d64-b2b8-e21ad1e867da tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1498 microversion: 2.1 time: 0.158464 Nov 27 21:24:40.553806 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3751/7370] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:40 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:24:41.572816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:41.573518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:41.580478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:41.580940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:41.581733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:41.582176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:41.714211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:41.722371 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d245991f-e335-4d65-90fb-a9df0030c8e0 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1498 microversion: 2.1 time: 0.154494 Nov 27 21:24:41.722950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3620/7371] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:41 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:42.740123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:42.740635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:42.747425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:42.747873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:42.748640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:42.749072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:42.879749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:42.886992 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12972166-9075-485a-805e-4b8702a0878d tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1501 microversion: 2.1 time: 0.150621 Nov 27 21:24:42.887632 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3752/7372] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:42 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:42.903695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:42.904216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:42.911467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:42.911918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:42.912689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:42.913129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:42.935092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lazy-loading 'flavor' on Instance uuid ea7f8e36-7395-4d4b-bf2c-374275600825 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:24:42.998248 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f04bf5d5-260c-4318-bb9d-cfa098917d06 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action" status: 202 len: 0 microversion: 2.1 time: 0.097918 Nov 27 21:24:42.998824 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3621/7373] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:24:42 2021] POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:24:43.007630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:43.008702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:43.014081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:43.014528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:43.015874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:43.016285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:43.146840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:43.154157 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b51d8f60-a749-4cc7-97e3-3bb6c8714f56 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1509 microversion: 2.1 time: 0.150573 Nov 27 21:24:43.154721 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3753/7374] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:43 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:44.171687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:44.172987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:44.179994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:44.180452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:44.181233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:44.181672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:44.314812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:44.322307 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e290a76b-03c7-4b5c-8f3d-80a48b76d3b2 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1492 microversion: 2.1 time: 0.154799 Nov 27 21:24:44.323059 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3622/7375] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:44 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1492 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:44.339377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2bd08fb4-4f52-476a-a3ff-bc3a9f49a12f tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:44.339901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2bd08fb4-4f52-476a-a3ff-bc3a9f49a12f tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:44.347199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bd08fb4-4f52-476a-a3ff-bc3a9f49a12f tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:44.347691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bd08fb4-4f52-476a-a3ff-bc3a9f49a12f tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:44.348462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bd08fb4-4f52-476a-a3ff-bc3a9f49a12f tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:44.348895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2bd08fb4-4f52-476a-a3ff-bc3a9f49a12f tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:44.412072 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2bd08fb4-4f52-476a-a3ff-bc3a9f49a12f tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action" status: 202 len: 0 microversion: 2.1 time: 0.076099 Nov 27 21:24:44.412717 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3754/7376] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:24:44 2021] POST /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:24:44.420577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:44.421189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:44.427464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:44.427829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:44.428681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:44.429161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:44.645069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:44.652477 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84863d99-09b3-4531-92b3-e72cd9c91024 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1498 microversion: 2.1 time: 0.235666 Nov 27 21:24:44.653052 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3623/7377] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:44 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:24:45.670763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:45.671482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:45.678216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:45.678665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:45.679467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:45.679901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:45.813421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:45.820777 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bbc20b06-7a92-4702-97c7-89c3c4546157 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1498 microversion: 2.1 time: 0.154897 Nov 27 21:24:45.821336 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3755/7378] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:45 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:46.838336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:46.838948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:46.846204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:46.846653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:46.847458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:46.847898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:46.977362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:46.985545 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf10db1b-ccb0-472e-a1a5-4fa18f5fda71 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1501 microversion: 2.1 time: 0.150045 Nov 27 21:24:46.986110 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3624/7379] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:46 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:47.001312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:47.001842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:47.008614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:47.009069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:47.009849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:47.010290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:47.034655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:24:47.112053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-06c76180-7299-4f9f-aada-d28c843ec57e tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 204 len: 0 microversion: 2.1 time: 0.114044 Nov 27 21:24:47.112564 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3756/7380] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:24:46 2021] DELETE /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:24:47.120693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:47.121315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:47.127417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:47.127883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:47.128678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:47.129123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:47.267477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:47.274890 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe258038-5822-4176-b80b-3dbabb12d9e9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1507 microversion: 2.1 time: 0.157916 Nov 27 21:24:47.275508 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3625/7381] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:47 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:24:48.292525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:48.293251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:48.299791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:48.300242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:48.301020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:48.301457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:48.438513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:48.446343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f61094a-f842-414c-994e-66556fc33635 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1507 microversion: 2.1 time: 0.157854 Nov 27 21:24:48.446918 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3757/7382] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:48 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:49.454847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e4f77dca-c2bc-4919-9919-7e4a9a9eddb1 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:49.455996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e4f77dca-c2bc-4919-9919-7e4a9a9eddb1 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:49.464854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:49.465460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:49.478269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:49.478965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:49.479355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4f77dca-c2bc-4919-9919-7e4a9a9eddb1 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:49.479990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4f77dca-c2bc-4919-9919-7e4a9a9eddb1 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:49.481901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:49.482342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:49.485699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4f77dca-c2bc-4919-9919-7e4a9a9eddb1 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:49.486153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4f77dca-c2bc-4919-9919-7e4a9a9eddb1 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:49.544966 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e4f77dca-c2bc-4919-9919-7e4a9a9eddb1 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b/action" status: 200 len: 24566 microversion: 2.1 time: 0.093849 Nov 27 21:24:49.545889 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3626/7383] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:24:49 2021] POST /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b/action => generated 24566 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:24:49.550702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2008fd13-2a91-475c-b0e9-8cabc8afd0ba req-c1e7dbd5-9d3a-4798-9906-ee3b105c7b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7f8e36-7395-4d4b-bf2c-374275600825", "name": "network-vif-deleted", "tag": "2c58aae0-e161-45cc-b01b-2bd02188fc40"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:24:49.552218 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:24:49.552218 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:24:49.569347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2008fd13-2a91-475c-b0e9-8cabc8afd0ba req-c1e7dbd5-9d3a-4798-9906-ee3b105c7b16 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:49.569697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd2e66b6a504b77a139c37ea777d41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fd68c2720747e98f51f396d9f4dd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:24:49.569833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2008fd13-2a91-475c-b0e9-8cabc8afd0ba req-c1e7dbd5-9d3a-4798-9906-ee3b105c7b16 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:49.579337 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfc47ad8-93de-4f8f-8d4d-8ebdc4711be4 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 200 len: 1465 microversion: 2.1 time: 0.118323 Nov 27 21:24:49.580008 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3758/7384] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:49 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 1465 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:24:49.583662 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2008fd13-2a91-475c-b0e9-8cabc8afd0ba req-c1e7dbd5-9d3a-4798-9906-ee3b105c7b16 service nova] Creating event network-vif-deleted:2c58aae0-e161-45cc-b01b-2bd02188fc40 for instance ea7f8e36-7395-4d4b-bf2c-374275600825 on nch2-master-1 Nov 27 21:24:49.588276 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2008fd13-2a91-475c-b0e9-8cabc8afd0ba req-c1e7dbd5-9d3a-4798-9906-ee3b105c7b16 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041305 Nov 27 21:24:49.588852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3627/7385] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:24:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:24:50.596768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:24:50.597372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] [instance: ea7f8e36-7395-4d4b-bf2c-374275600825] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:24:50.604725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:50.605304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:50.606248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:24:50.606811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:24:50.621559 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] HTTP exception thrown: Instance ea7f8e36-7395-4d4b-bf2c-374275600825 could not be found. Nov 27 21:24:50.622135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] Returning 404 to user: Instance ea7f8e36-7395-4d4b-bf2c-374275600825 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:24:50.622969 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-29d4857e-37ba-4bf1-807c-23593ad53aa9 tempest-TestServerAdvancedOps-35090785 tempest-TestServerAdvancedOps-35090785-project] 10.222.0.21 "GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825" status: 404 len: 111 microversion: 2.1 time: 0.030401 Nov 27 21:24:50.623531 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3759/7386] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:24:50 2021] GET /compute/v2.1/servers/ea7f8e36-7395-4d4b-bf2c-374275600825 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:25:04.402906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de0ebb02-50ff-4aaa-9416-8523da7663b6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'create', calling method: .version_select at 0x7f15d93791f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-979948476"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:04.418387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-de0ebb02-50ff-4aaa-9416-8523da7663b6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:25:04.426449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-de0ebb02-50ff-4aaa-9416-8523da7663b6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:25:04.560330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-de0ebb02-50ff-4aaa-9416-8523da7663b6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:25:04.565953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-de0ebb02-50ff-4aaa-9416-8523da7663b6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:25:04.581851 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de0ebb02-50ff-4aaa-9416-8523da7663b6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.184095 Nov 27 21:25:04.582624 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3628/7387] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:25:04 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:05.710965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-231645173", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "4891dc13-a504-442f-92d2-3f5d0a5a42bf"}], "key_name": "tempest-TestNetworkBasicOps-979948476", "security_groups": [{"name": "tempest-secgroup-smoke-596306792"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:05.842553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] validate_networks() for [('4891dc13-a504-442f-92d2-3f5d0a5a42bf', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:25:06.584450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:25:06.585063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:25:06.585623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:25:06.586225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:25:06.586627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:25:06.599566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:06.600271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:06.601404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:06.601999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:06.623773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:25:06.630203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:25:06.645197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:25:06.648794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:25:06.720508 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-313e44a9-2c5e-440d-95fb-960dbbfd9843 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.013105 Nov 27 21:25:06.722946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3760/7388] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:25:05 2021] POST /compute/v2.1/servers => generated 405 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:25:06.735121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-58bcc554-9c07-4462-8c26-8a5a6bbbc650 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:06.737632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-58bcc554-9c07-4462-8c26-8a5a6bbbc650 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:06.824281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-58bcc554-9c07-4462-8c26-8a5a6bbbc650 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:06.840718 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-58bcc554-9c07-4462-8c26-8a5a6bbbc650 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1247 microversion: 2.1 time: 0.109375 Nov 27 21:25:06.841975 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3629/7389] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:06 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1247 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:07.691311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-733769032", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cecccd8d-335b-4cd7-8fed-3c646fd55ff4", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5d1d65de-2cf6-426d-bf1f-f8a8267152d2"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:07.795951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] validate_networks() for [('5d1d65de-2cf6-426d-bf1f-f8a8267152d2', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:25:07.858868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:07.861042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:07.872934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:07.877889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:07.880489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:07.881176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:08.024330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:08.038357 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6af00842-8071-4881-9970-516f868abe19 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1307 microversion: 2.1 time: 0.183994 Nov 27 21:25:08.048620 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3630/7390] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:07 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:08.283496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:25:08.284080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:25:08.284761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:25:08.285347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:25:08.285760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:25:08.294883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:08.295376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:08.296209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:08.296694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:08.316297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:25:08.321369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:25:08.335216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:25:08.337248 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cecccd8d-335b-4cd7-8fed-3c646fd55ff4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:25:08.423124 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d959b9f-ad1f-4fee-9d6a-1728e9b279c5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736787 Nov 27 21:25:08.424051 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3761/7391] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:25:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:25:08.433951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a7d4c50-d6ce-4a93-8311-ba1ca33f7efb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:08.434574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a7d4c50-d6ce-4a93-8311-ba1ca33f7efb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:08.516442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a7d4c50-d6ce-4a93-8311-ba1ca33f7efb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:08.526970 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a7d4c50-d6ce-4a93-8311-ba1ca33f7efb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1056 microversion: 2.1 time: 0.095720 Nov 27 21:25:08.527930 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3631/7392] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:08 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1056 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:09.056924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:09.058900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:09.066626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:09.067225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:09.068896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:09.069442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:09.226058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:09.234174 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f9364f3-824d-46fb-b703-48ba7dde7267 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.181832 Nov 27 21:25:09.239374 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3762/7393] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:09 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:09.550909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:09.552894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:09.555036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-56d60c7b-8bfb-4256-b4e3-1f58cad82644 req-217e0df6-0011-4861-a25f-676017b4e3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38eac53-15ea-4f44-b636-d786651491e6", "tag": "05cc98ab-8bcc-4836-b729-b38cafadacbc"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:09.565346 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:09.565346 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:25:09.574026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:09.576401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:09.577233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:09.581668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:09.585353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-56d60c7b-8bfb-4256-b4e3-1f58cad82644 req-217e0df6-0011-4861-a25f-676017b4e3ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:09.589185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-56d60c7b-8bfb-4256-b4e3-1f58cad82644 req-217e0df6-0011-4861-a25f-676017b4e3ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:09.620306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-56d60c7b-8bfb-4256-b4e3-1f58cad82644 req-217e0df6-0011-4861-a25f-676017b4e3ab service nova] Creating event network-changed:05cc98ab-8bcc-4836-b729-b38cafadacbc for instance c38eac53-15ea-4f44-b636-d786651491e6 on nch2-master-1 Nov 27 21:25:09.636703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-56d60c7b-8bfb-4256-b4e3-1f58cad82644 req-217e0df6-0011-4861-a25f-676017b4e3ab service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093595 Nov 27 21:25:09.644595 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3632/7394] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:09.684005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:09.695087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f4f21d95-bbee-413d-aa9d-da87b56eb91a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1116 microversion: 2.1 time: 0.152902 Nov 27 21:25:09.707757 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3763/7395] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:09 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1116 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:10.257336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:10.258198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:10.264645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:10.265486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:10.267144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:10.268055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:10.645857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:10.653488 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b621e886-1df4-4c37-a3d9-d0bfad96c223 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.403640 Nov 27 21:25:10.654073 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3633/7396] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:10 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:10.713069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:10.713757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:10.720516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:10.721188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:10.721974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:10.722424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:10.784196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:10.791518 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-22779390-689f-4eb9-bb02-d639f620b4e3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1126 microversion: 2.1 time: 0.082108 Nov 27 21:25:10.792097 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3764/7397] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:10 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1126 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:11.671041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:11.671841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:11.679437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:11.679901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:11.680701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:11.681146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:11.807921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:11.808464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:11.816473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:11.816930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:11.817893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:11.818426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:11.907595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:11.915467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8b000cc5-2b92-40a8-ad3d-758d1207b35b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.248114 Nov 27 21:25:11.920839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3634/7398] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:11 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:11.964184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:11.972413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-378af04a-5a27-4162-8354-090b3b0767b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1168 microversion: 2.1 time: 0.168272 Nov 27 21:25:11.981793 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3765/7399] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:11 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:12.021206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-03236829-5141-4920-8513-e68c7fca2aed req-cf7a4ff8-7269-44c0-8045-8ab81bbaed17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b418f81-cfd4-455c-8ee3-c469705f9d7d", "tag": "31259807-40ee-433e-b328-dc6b15c42237"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:12.023316 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:12.023316 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:25:12.033961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-03236829-5141-4920-8513-e68c7fca2aed req-cf7a4ff8-7269-44c0-8045-8ab81bbaed17 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:12.034250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-03236829-5141-4920-8513-e68c7fca2aed req-cf7a4ff8-7269-44c0-8045-8ab81bbaed17 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:12.050039 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-03236829-5141-4920-8513-e68c7fca2aed req-cf7a4ff8-7269-44c0-8045-8ab81bbaed17 service nova] Creating event network-changed:31259807-40ee-433e-b328-dc6b15c42237 for instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d on nch1-master-1 Nov 27 21:25:12.055790 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-03236829-5141-4920-8513-e68c7fca2aed req-cf7a4ff8-7269-44c0-8045-8ab81bbaed17 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039297 Nov 27 21:25:12.056423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3635/7400] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:12.932995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:12.933579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:12.940910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:12.941367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:12.942158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:12.942599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:12.990554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:12.991083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:12.998273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:12.998727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:12.999535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:12.999976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:13.078558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:13.086043 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0fbbc55-4ce8-40b7-906e-34e55f3e7083 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.156826 Nov 27 21:25:13.086614 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3766/7401] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:12 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:13.135967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:13.143416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1e542393-d9d9-47d4-b8f1-cf0d225e9e70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1168 microversion: 2.1 time: 0.158839 Nov 27 21:25:13.143999 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3636/7402] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:12 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:14.103506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:14.104136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:14.112424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:14.112942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:14.113729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:14.114167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:14.160176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:14.161115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:14.168244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:14.168941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:14.169742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:14.170229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:14.262596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:14.271578 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b3fc8792-0c6d-405b-b9e0-115a71f708ba tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.171630 Nov 27 21:25:14.272926 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3767/7403] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:14 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:14.314082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:14.321852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc5ef5a5-5ae1-428f-8022-aea8de0925af tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1214 microversion: 2.1 time: 0.165463 Nov 27 21:25:14.322372 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3637/7404] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:14 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:15.288654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:15.289256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:15.296065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:15.296513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:15.297784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:15.298219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:15.340941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:15.341571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:15.349188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:15.349642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:15.350455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:15.350902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:15.435691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:15.443216 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c99beeaf-8d49-4861-acbe-b7de72497862 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.158089 Nov 27 21:25:15.443774 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3768/7405] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:15 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:15.499039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:15.507215 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-678789ea-a509-46bf-8621-e94821898e61 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1202 microversion: 2.1 time: 0.170033 Nov 27 21:25:15.507897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3638/7406] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:15 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:16.401740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d517ea88-d816-49fa-948e-b790f8120629 req-5bb3bd22-63eb-415f-8570-19f9908a07ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38eac53-15ea-4f44-b636-d786651491e6", "name": "network-vif-plugged", "status": "completed", "tag": "05cc98ab-8bcc-4836-b729-b38cafadacbc"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:16.403351 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:16.403351 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:25:16.411778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d517ea88-d816-49fa-948e-b790f8120629 req-5bb3bd22-63eb-415f-8570-19f9908a07ad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:16.412227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d517ea88-d816-49fa-948e-b790f8120629 req-5bb3bd22-63eb-415f-8570-19f9908a07ad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:16.423945 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d517ea88-d816-49fa-948e-b790f8120629 req-5bb3bd22-63eb-415f-8570-19f9908a07ad service nova] Creating event network-vif-plugged:05cc98ab-8bcc-4836-b729-b38cafadacbc for instance c38eac53-15ea-4f44-b636-d786651491e6 on nch2-master-1 Nov 27 21:25:16.432729 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d517ea88-d816-49fa-948e-b790f8120629 req-5bb3bd22-63eb-415f-8570-19f9908a07ad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034534 Nov 27 21:25:16.433329 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3769/7407] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:16.462018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:16.462669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:16.471078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:16.471560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:16.472360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:16.473204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:16.525928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:16.526629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:16.533605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:16.534049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:16.534837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:16.535291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:16.664109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:16.668180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:16.671562 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27f0d958-fe68-43a4-a2a7-4a0d4c00cdd0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.214725 Nov 27 21:25:16.672143 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3639/7408] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:16 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:16.675424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-790322c5-6b62-49d2-8543-426f4ac0521c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1202 microversion: 2.1 time: 0.153487 Nov 27 21:25:16.675983 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3770/7409] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:16 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:17.688231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:17.688845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:17.690918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:17.691651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:17.695713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:17.696169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:17.696955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:17.697449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:17.698227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:17.698684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:17.699493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:17.699935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:17.834530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:17.836972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:17.842778 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97025d9c-8024-44b2-a8bc-1742866d39e7 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1372 microversion: 2.1 time: 0.158309 Nov 27 21:25:17.843384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3640/7410] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:17 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:17.848455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fbb10c14-1602-4289-9bcf-ca51fca22354 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1202 microversion: 2.1 time: 0.161134 Nov 27 21:25:17.849380 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3771/7411] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:17 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:18.865808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:18.866471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:18.866751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:18.867869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:18.873511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:18.873957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:18.874152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:18.874761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:18.874881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:18.875220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:18.876485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:18.877091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:19.010027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:19.018466 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd8b7521-6f17-4c4b-8016-154682ba5b8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1202 microversion: 2.1 time: 0.155315 Nov 27 21:25:19.019051 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3772/7412] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:18 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:19.022287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:19.030717 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-44a738d6-927a-42d9-94db-5048d48bc351 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1545 microversion: 2.1 time: 0.173942 Nov 27 21:25:19.031304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3641/7413] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:18 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1545 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:19.046730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:19.047888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:19.053980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:19.054590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:19.055408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:19.055885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:19.198657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:19.206585 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9182b1e2-254c-48d6-9d3e-3614d0e69f06 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1545 microversion: 2.1 time: 0.163536 Nov 27 21:25:19.207152 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3773/7414] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:19 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1545 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:20.035965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:20.036563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:20.043369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:20.043841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:20.044598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:20.045037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:20.179505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:20.186870 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-535f9626-af1e-4dfb-a1e4-944ec869d1cc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1202 microversion: 2.1 time: 0.155225 Nov 27 21:25:20.187472 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3642/7415] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:20 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:21.044266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8d51ac4d-e596-4636-9f08-9308c631038a req-c38244f4-fc15-4141-ae30-58153b0fbcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b418f81-cfd4-455c-8ee3-c469705f9d7d", "name": "network-vif-plugged", "status": "completed", "tag": "31259807-40ee-433e-b328-dc6b15c42237"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:21.046724 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:21.046724 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:25:21.055285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8d51ac4d-e596-4636-9f08-9308c631038a req-c38244f4-fc15-4141-ae30-58153b0fbcd4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:21.055799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8d51ac4d-e596-4636-9f08-9308c631038a req-c38244f4-fc15-4141-ae30-58153b0fbcd4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:21.068792 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8d51ac4d-e596-4636-9f08-9308c631038a req-c38244f4-fc15-4141-ae30-58153b0fbcd4 service nova] Creating event network-vif-plugged:31259807-40ee-433e-b328-dc6b15c42237 for instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d on nch1-master-1 Nov 27 21:25:21.074164 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8d51ac4d-e596-4636-9f08-9308c631038a req-c38244f4-fc15-4141-ae30-58153b0fbcd4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034324 Nov 27 21:25:21.074947 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3774/7416] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:21.203568 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:21.205395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:21.212635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:21.213337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:21.214134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:21.214589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:21.353197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:21.363180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e88a021b-5897-4dc7-946d-65edc36d1b18 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1202 microversion: 2.1 time: 0.163221 Nov 27 21:25:21.363803 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3643/7417] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:21 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:22.381833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:22.382540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:22.388820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:22.389328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:22.389989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:22.390428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:22.665729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:22.673302 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a13c9a8e-6d06-43e6-8dd6-bc09ee327bc9 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1202 microversion: 2.1 time: 0.296428 Nov 27 21:25:22.673886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3775/7418] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:22 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1202 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:23.689790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:23.690402 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:23.697302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:23.697676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:23.698473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:23.698914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:23.865901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:23.873964 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc58d33c-5a5a-453a-aa7c-008deb3323ef tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1389 microversion: 2.1 time: 0.187651 Nov 27 21:25:23.881211 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3644/7419] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:23 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1389 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:23.897613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:23.900620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:23.908235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:23.909169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:23.910150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:23.910753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:24.074894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:24.083301 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed8be04e-b313-4541-8064-484fbba485ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1389 microversion: 2.1 time: 0.189288 Nov 27 21:25:24.083858 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3776/7420] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:23 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1389 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:24.101513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:24.102147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:24.111489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:24.111958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:24.112923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:24.113236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:24.251561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:24.259037 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e1aa7fc-219a-46d6-9ee7-b27bf8bb24f7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1389 microversion: 2.1 time: 0.162481 Nov 27 21:25:24.259729 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3645/7421] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:24 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:24.326121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:24.326619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:24.332501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:24.332956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:24.333723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:24.334155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:24.360498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:25:24.462961 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb714f60-0240-4cec-90ca-e4864c582901 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 204 len: 0 microversion: 2.1 time: 0.140179 Nov 27 21:25:24.463959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3777/7422] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:25:24 2021] DELETE /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:25:24.473571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:24.474201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:24.482360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:24.482906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:24.483831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:24.484374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:24.624397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:24.632800 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8263e07d-abcf-40e6-b4c4-e01bb38f94f1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1395 microversion: 2.1 time: 0.164727 Nov 27 21:25:24.633327 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3646/7423] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:24 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:25.650256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:25.650953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:25.658304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:25.658751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:25.659551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:25.659989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:25.799047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:25.806462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39283f05-037c-439a-b445-9f3b0c0a9636 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1395 microversion: 2.1 time: 0.160336 Nov 27 21:25:25.807044 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3778/7424] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:25 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1395 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:26.608049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e5dfe2ba-d1a0-4263-a17f-d750ae8e0512 req-b1e68567-59cb-47fa-9080-06136148d97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b418f81-cfd4-455c-8ee3-c469705f9d7d", "name": "network-vif-deleted", "tag": "31259807-40ee-433e-b328-dc6b15c42237"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:26.611722 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:26.611722 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:25:26.620919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e5dfe2ba-d1a0-4263-a17f-d750ae8e0512 req-b1e68567-59cb-47fa-9080-06136148d97d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:26.621667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e5dfe2ba-d1a0-4263-a17f-d750ae8e0512 req-b1e68567-59cb-47fa-9080-06136148d97d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:26.636307 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e5dfe2ba-d1a0-4263-a17f-d750ae8e0512 req-b1e68567-59cb-47fa-9080-06136148d97d service nova] Creating event network-vif-deleted:31259807-40ee-433e-b328-dc6b15c42237 for instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d on nch1-master-1 Nov 27 21:25:26.643382 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e5dfe2ba-d1a0-4263-a17f-d750ae8e0512 req-b1e68567-59cb-47fa-9080-06136148d97d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039549 Nov 27 21:25:26.644337 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3647/7425] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:26.823798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:26.824426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:26.832256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:26.832696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:26.833751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:26.834714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:26.907827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:26.918022 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85204aac-5602-44af-9759-9b95da0bae02 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 200 len: 1187 microversion: 2.1 time: 0.097993 Nov 27 21:25:26.919015 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3779/7426] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:26 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:27.936132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:27.936866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:27.943855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:27.944309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:27.945095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:27.945538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:27.959782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d could not be found. Nov 27 21:25:27.960392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:25:27.961213 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e3d3ccc-8639-43e1-b065-a453ff17a889 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 404 len: 111 microversion: 2.1 time: 0.029283 Nov 27 21:25:27.961752 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3648/7427] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:27 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:25:27.989729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:27.990220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:27.996786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:27.997231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:27.997995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:27.998428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:28.011374 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d could not be found. Nov 27 21:25:28.011945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:25:28.012740 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc330e2b-b73e-4de9-939c-2c8479e9dce0 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 404 len: 111 microversion: 2.1 time: 0.026918 Nov 27 21:25:28.013247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3780/7428] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:25:27 2021] DELETE /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:25:28.021549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:28.022160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5b418f81-cfd4-455c-8ee3-c469705f9d7d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:28.028012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:28.028462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:28.029238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:28.029671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:28.043458 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d could not be found. Nov 27 21:25:28.044034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 5b418f81-cfd4-455c-8ee3-c469705f9d7d could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:25:28.044829 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-09522a9b-83fe-4c09-8bcf-f8414ac37c80 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d" status: 404 len: 111 microversion: 2.1 time: 0.026973 Nov 27 21:25:28.045344 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3649/7429] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:28 2021] GET /compute/v2.1/servers/5b418f81-cfd4-455c-8ee3-c469705f9d7d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:25:32.829764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-777147670", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "47179aba-1206-4495-8631-f54d46f24132", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5d1d65de-2cf6-426d-bf1f-f8a8267152d2"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:32.888259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] validate_networks() for [('5d1d65de-2cf6-426d-bf1f-f8a8267152d2', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:25:33.247785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:25:33.248161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:25:33.248631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:25:33.249038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:25:33.249446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:25:33.258140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:33.258618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:33.259476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:33.259913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:33.276670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:25:33.281855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:25:33.336568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:25:33.338680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47179aba-1206-4495-8631-f54d46f24132',volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:25:33.465040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-76dbe08b-2e0a-4c0e-ba4d-122b99685c6c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638882 Nov 27 21:25:33.465678 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3781/7430] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:25:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:25:33.475891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-490e3cb4-14e2-4fea-9099-37a317f18a70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:33.476501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-490e3cb4-14e2-4fea-9099-37a317f18a70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:33.529768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-490e3cb4-14e2-4fea-9099-37a317f18a70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:33.537976 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-490e3cb4-14e2-4fea-9099-37a317f18a70 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1070 microversion: 2.1 time: 0.065690 Nov 27 21:25:33.538515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3650/7431] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:33 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1070 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:34.555609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:34.556379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:34.564482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:34.565174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:34.565980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:34.566421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:34.632619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:34.642304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b4277437-8b55-4273-90d5-d8cb2ef12e76 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1186 microversion: 2.1 time: 0.091512 Nov 27 21:25:34.643040 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3782/7432] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:34 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:35.659311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:35.659948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:35.666994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:35.667485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:35.668279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:35.668737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:35.904818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:35.913720 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-60c2a29a-a649-46ae-83be-7a3511af1c53 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.258647 Nov 27 21:25:35.914501 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3651/7433] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:35 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:36.104996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-41a92902-dd44-4c10-a12a-56b21cb3f936 req-0c882fe2-cfb1-47b9-959a-7ecdb64d1222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae43e86-b3a6-4c2b-b956-694403fe687c", "tag": "37849f71-d384-4d11-acdb-4afd32c10730"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:36.107998 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:36.107998 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:25:36.118560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-41a92902-dd44-4c10-a12a-56b21cb3f936 req-0c882fe2-cfb1-47b9-959a-7ecdb64d1222 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:36.119003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-41a92902-dd44-4c10-a12a-56b21cb3f936 req-0c882fe2-cfb1-47b9-959a-7ecdb64d1222 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:36.132222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-41a92902-dd44-4c10-a12a-56b21cb3f936 req-0c882fe2-cfb1-47b9-959a-7ecdb64d1222 service nova] Creating event network-changed:37849f71-d384-4d11-acdb-4afd32c10730 for instance 4ae43e86-b3a6-4c2b-b956-694403fe687c on nch1-master-1 Nov 27 21:25:36.138745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-41a92902-dd44-4c10-a12a-56b21cb3f936 req-0c882fe2-cfb1-47b9-959a-7ecdb64d1222 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038632 Nov 27 21:25:36.139963 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3783/7434] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:36.931134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:36.931784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:36.938525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:36.938984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:36.940289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:36.940728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:37.123038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:37.131450 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fb2529dc-9f55-4d1f-8e69-c8eadb29bbd8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.204125 Nov 27 21:25:37.132032 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3652/7435] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:36 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:38.148511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:38.149200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:38.156164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:38.156612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:38.157385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:38.157820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:38.293356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:38.300648 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b41b656-0de6-4a30-a03c-93b488d2a8d1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.156218 Nov 27 21:25:38.301208 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3784/7436] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:38 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:39.317869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:39.318413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:39.325280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:39.325732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:39.326504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:39.326939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:39.461316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:39.470029 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-301087df-73d7-4daf-abd2-bfb8808b5682 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.156520 Nov 27 21:25:39.470597 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3653/7437] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:39 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:40.486199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:40.487074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:40.493841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:40.494279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:40.495042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:40.495500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:40.625080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:40.633129 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-48d799fa-282c-49b5-9291-3c267494329b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.150649 Nov 27 21:25:40.633698 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3785/7438] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:40 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:41.649876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:41.650509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:41.659238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:41.659722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:41.660714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:41.661865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:41.798315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:41.805594 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9fbad2de-cbb0-4293-8e44-e86c911863f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.159476 Nov 27 21:25:41.806163 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3654/7439] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:41 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:42.821593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:42.822182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:42.828845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:42.829291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:42.830055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:42.830487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:42.964034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:42.972193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cde2b3c2-ef86-4ba0-96a3-983c512e7f88 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.154219 Nov 27 21:25:42.973006 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3786/7440] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:42 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:43.115381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b05101b2-a879-4492-b45a-d4aebb6d7b2e req-399a8e5a-0d91-402d-b8bd-a263310d8389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae43e86-b3a6-4c2b-b956-694403fe687c", "name": "network-vif-plugged", "status": "completed", "tag": "37849f71-d384-4d11-acdb-4afd32c10730"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:43.116964 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:43.116964 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:25:43.125065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b05101b2-a879-4492-b45a-d4aebb6d7b2e req-399a8e5a-0d91-402d-b8bd-a263310d8389 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:43.125590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b05101b2-a879-4492-b45a-d4aebb6d7b2e req-399a8e5a-0d91-402d-b8bd-a263310d8389 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:43.141515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b05101b2-a879-4492-b45a-d4aebb6d7b2e req-399a8e5a-0d91-402d-b8bd-a263310d8389 service nova] Creating event network-vif-plugged:37849f71-d384-4d11-acdb-4afd32c10730 for instance 4ae43e86-b3a6-4c2b-b956-694403fe687c on nch1-master-1 Nov 27 21:25:43.144368 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b05101b2-a879-4492-b45a-d4aebb6d7b2e req-399a8e5a-0d91-402d-b8bd-a263310d8389 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033377 Nov 27 21:25:43.144974 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3655/7441] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:43.989673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:43.990288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:43.996904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:43.997350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:43.998117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:43.998551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:44.125334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:44.133348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3dc38321-dc4a-42e4-b1d0-f7b0df356b79 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1216 microversion: 2.1 time: 0.148217 Nov 27 21:25:44.133906 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3787/7442] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:43 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:45.151966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:45.152670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:45.158863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:45.159349 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:45.160632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:45.161080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:45.297142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:45.305131 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99dc5bd4-a5ba-45b1-b668-5b39062256a4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1404 microversion: 2.1 time: 0.158250 Nov 27 21:25:45.305715 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3656/7443] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:45 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:45.320814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:45.321416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:45.328434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:45.328890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:45.329718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:45.330173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:45.457984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:45.466044 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c5e5dc53-a679-4549-852c-c29ee878a374 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1404 microversion: 2.1 time: 0.148944 Nov 27 21:25:45.466608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3788/7444] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:45 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:45.483736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-651064505"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:45.484767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:45.490901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:45.491401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:45.492182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:45.492631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:45.578044 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Attempting to quiesce instance before volume snapshot. Nov 27 21:25:45.646234 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 27 21:25:45.712055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Creating snapshot from volume 47179aba-1206-4495-8631-f54d46f24132. {{(pid=135679) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Nov 27 21:25:46.557209 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6eec41db-fb4b-4572-886d-806b55316ed7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c/action" status: 202 len: 0 microversion: 2.1 time: 1.077398 Nov 27 21:25:46.557985 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3657/7445] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:25:45 2021] POST /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c/action => generated 0 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 27 21:25:47.698509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-10536749", "imageRef": "963a68f8-4385-4f9f-aec2-0709b4d90d1e", "flavorRef": "452", "networks": [{"uuid": "5d1d65de-2cf6-426d-bf1f-f8a8267152d2"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:47.750763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] validate_networks() for [('5d1d65de-2cf6-426d-bf1f-f8a8267152d2', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:25:48.104667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:25:48.105102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:25:48.105574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:25:48.105989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:25:48.106400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:25:48.116239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:48.116687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:48.117498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:48.117940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:48.134108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:25:48.139130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:25:48.150983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:25:48.153502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='de8b445e-501a-46a6-8931-ad205722da94',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:25:48.224528 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e333c8d7-d790-4b5b-b27e-fb8ebf6affde tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529644 Nov 27 21:25:48.225177 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3789/7446] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:25:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:25:48.236452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98a7e73c-8690-49de-8431-3cb4fba186f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:48.237506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98a7e73c-8690-49de-8431-3cb4fba186f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:48.291889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98a7e73c-8690-49de-8431-3cb4fba186f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:48.299298 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98a7e73c-8690-49de-8431-3cb4fba186f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1228 microversion: 2.1 time: 0.067770 Nov 27 21:25:48.299868 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3658/7447] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:48 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1228 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:49.318403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:49.319144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:49.326754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:49.327210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:49.328066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:49.328443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:49.392360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:49.399658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4827b03-6686-4568-8cc2-5647e92500f5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1298 microversion: 2.1 time: 0.086306 Nov 27 21:25:49.400475 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3790/7448] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:49 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:50.416911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:50.417585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:50.432744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:50.433214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:50.434245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:50.434860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:50.617020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-41a31e15-d3d7-48ae-8cb1-67c734198ce3 req-6524cba9-3212-4982-b5c6-9cda59f072f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f387a10-b9bd-45db-a642-665f2f0ebfeb", "tag": "32c18bc5-c2ee-408a-82f6-0757b62eaf16"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:50.621291 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:50.621291 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:25:50.633947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-41a31e15-d3d7-48ae-8cb1-67c734198ce3 req-6524cba9-3212-4982-b5c6-9cda59f072f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:50.634669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-41a31e15-d3d7-48ae-8cb1-67c734198ce3 req-6524cba9-3212-4982-b5c6-9cda59f072f8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:50.650049 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-41a31e15-d3d7-48ae-8cb1-67c734198ce3 req-6524cba9-3212-4982-b5c6-9cda59f072f8 service nova] Creating event network-changed:32c18bc5-c2ee-408a-82f6-0757b62eaf16 for instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb on nch2-master-1 Nov 27 21:25:50.655306 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-41a31e15-d3d7-48ae-8cb1-67c734198ce3 req-6524cba9-3212-4982-b5c6-9cda59f072f8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044854 Nov 27 21:25:50.656367 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3791/7449] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:50.704107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:50.718618 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70a432c6-ddea-4e4b-aa83-b27b3431fe20 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1340 microversion: 2.1 time: 0.305362 Nov 27 21:25:50.719598 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3659/7450] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:50 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1340 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:51.737551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:51.738271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:51.744405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:51.744848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:51.745626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:51.746059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:51.996196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:52.003933 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fb473c2-72f2-48c4-ae50-0a3cf5525cce tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1340 microversion: 2.1 time: 0.271034 Nov 27 21:25:52.004494 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3792/7451] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:51 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1340 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:53.020651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:53.021555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:53.028206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:53.028975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:53.030019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:53.030684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:53.198825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:53.207934 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12d4f43e-edb8-489d-baee-defc2c8ca21f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1340 microversion: 2.1 time: 0.190964 Nov 27 21:25:53.218437 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3660/7452] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:53 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:54.170970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:54.171508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:54.178647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:54.179106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:54.179928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:54.180369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:54.208822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:25:54.224704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:54.225332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:54.232418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:54.232890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:54.233682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:54.234132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:54.296822 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bc361f1-bf48-48a6-aa29-abee07432619 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 204 len: 0 microversion: 2.1 time: 0.129023 Nov 27 21:25:54.299356 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3793/7453] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:25:54 2021] DELETE /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:25:54.307377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:54.307987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:54.315221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:54.315774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:54.317075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:54.317671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:54.388434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:54.396668 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7bfc7381-d46b-4449-8c4a-695903b1b563 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1374 microversion: 2.1 time: 0.175517 Nov 27 21:25:54.398048 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3661/7454] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:54 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:54.470459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:54.479128 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-910125c2-d589-45e6-b9cf-bf118207e86d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1551 microversion: 2.1 time: 0.176479 Nov 27 21:25:54.479847 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3794/7455] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:54 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1551 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:55.415198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:55.415971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:55.423459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:55.424136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:55.425331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:55.425477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:55.497400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:55.498047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:55.509206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:55.509872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:55.510668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:55.511327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:55.681007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:55.694151 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f8328e3-a3fc-44df-b8c9-4f779ac79d20 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1551 microversion: 2.1 time: 0.201097 Nov 27 21:25:55.694874 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3795/7456] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:55 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1551 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:55.700277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:55.709511 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa909746-b433-4f68-8962-6dfad6477a32 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1374 microversion: 2.1 time: 0.298262 Nov 27 21:25:55.710089 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3662/7457] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:55 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1374 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:56.659521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6273e63d-bda1-4f68-9c71-bc83bf3ea69b req-5a919cfb-fe18-43fb-bf5c-73ec5c2572f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38eac53-15ea-4f44-b636-d786651491e6", "name": "network-vif-deleted", "tag": "05cc98ab-8bcc-4836-b729-b38cafadacbc"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:56.662322 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:56.662322 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:25:56.670639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6273e63d-bda1-4f68-9c71-bc83bf3ea69b req-5a919cfb-fe18-43fb-bf5c-73ec5c2572f1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:56.671120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6273e63d-bda1-4f68-9c71-bc83bf3ea69b req-5a919cfb-fe18-43fb-bf5c-73ec5c2572f1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:56.682387 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6273e63d-bda1-4f68-9c71-bc83bf3ea69b req-5a919cfb-fe18-43fb-bf5c-73ec5c2572f1 service nova] Creating event network-vif-deleted:05cc98ab-8bcc-4836-b729-b38cafadacbc for instance c38eac53-15ea-4f44-b636-d786651491e6 on nch2-master-1 Nov 27 21:25:56.687645 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6273e63d-bda1-4f68-9c71-bc83bf3ea69b req-5a919cfb-fe18-43fb-bf5c-73ec5c2572f1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Nov 27 21:25:56.688277 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3796/7458] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:25:56.714670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:56.715922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:56.724240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:56.724864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:56.725778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:56.726364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:56.726785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:56.727526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:56.734671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:56.735132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:56.735955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:56.736397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:56.797303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:56.807279 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aa542439-122e-4c75-bee7-e38bfb5499e6 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 200 len: 1332 microversion: 2.1 time: 0.097856 Nov 27 21:25:56.808722 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3663/7459] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:56 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:56.875407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:56.882971 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3e7d66de-f29a-4baa-9f8d-a361646fb794 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1374 microversion: 2.1 time: 0.160823 Nov 27 21:25:56.883576 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3797/7460] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:56 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:25:57.824663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:57.825286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: c38eac53-15ea-4f44-b636-d786651491e6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:57.832168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:57.832637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:57.833427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:57.833882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:57.846943 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] HTTP exception thrown: Instance c38eac53-15ea-4f44-b636-d786651491e6 could not be found. Nov 27 21:25:57.848105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Returning 404 to user: Instance c38eac53-15ea-4f44-b636-d786651491e6 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:25:57.848927 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43e57e06-9dd1-4b9a-a18c-fdbd6543363b tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6" status: 404 len: 111 microversion: 2.1 time: 0.028083 Nov 27 21:25:57.849480 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3664/7461] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:57 2021] GET /compute/v2.1/servers/c38eac53-15ea-4f44-b636-d786651491e6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:25:57.899179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:57.899806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:57.906341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:57.906784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:57.907579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:57.908008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:58.063895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb5a3139-bf77-497e-b8e1-65c4a65db306 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '.version_select at 0x7f15d933ddc0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:58.082892 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb5a3139-bf77-497e-b8e1-65c4a65db306 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-979948476" status: 202 len: 0 microversion: 2.1 time: 0.022667 Nov 27 21:25:58.083725 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3665/7462] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:25:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-979948476 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:25:58.087041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:58.095039 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-22be0a9a-7028-45ef-81d0-61c7f7843bb4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1374 microversion: 2.1 time: 0.199663 Nov 27 21:25:58.096046 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3798/7463] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:57 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:59.113521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:59.114925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:59.124523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:59.124989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:59.125936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:59.126395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:59.292300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:25:59.302165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-39c6e1d3-cb1e-4eaf-b919-bc0212984b42 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1374 microversion: 2.1 time: 0.193186 Nov 27 21:25:59.303125 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3666/7464] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:59 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:25:59.825045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:59.825601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:25:59.832474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:59.832837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:59.838504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:59.839184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:59.872612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:25:59.909980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0efb3666-f201-4e30-939c-ba5f0264a808 req-4c807e06-c308-491e-bddd-1d5fdfbd1250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca8448b-eaa8-47e5-b00f-34103c7cc12b", "tag": "d30ce7d3-47f0-4788-b766-c0f924abb913"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:25:59.911954 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:25:59.911954 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:25:59.920109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0efb3666-f201-4e30-939c-ba5f0264a808 req-4c807e06-c308-491e-bddd-1d5fdfbd1250 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:25:59.920717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0efb3666-f201-4e30-939c-ba5f0264a808 req-4c807e06-c308-491e-bddd-1d5fdfbd1250 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:25:59.935280 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0efb3666-f201-4e30-939c-ba5f0264a808 req-4c807e06-c308-491e-bddd-1d5fdfbd1250 service nova] Creating event network-changed:d30ce7d3-47f0-4788-b766-c0f924abb913 for instance aca8448b-eaa8-47e5-b00f-34103c7cc12b on nch1-master-1 Nov 27 21:25:59.942718 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0efb3666-f201-4e30-939c-ba5f0264a808 req-4c807e06-c308-491e-bddd-1d5fdfbd1250 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116926 Nov 27 21:25:59.943666 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3667/7465] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:25:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:25:59.985744 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6067be83-e400-4f18-a303-152cbe3c7a91 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "DELETE /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 204 len: 0 microversion: 2.1 time: 0.163445 Nov 27 21:25:59.986620 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3799/7466] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:25:59 2021] DELETE /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:25:59.996863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:25:59.997810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:00.004364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:00.005039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:00.006153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:00.006780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:00.277623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:00.287815 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2e66bff8-a2fa-4ffb-ac4b-be57377c07e8 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1668 microversion: 2.1 time: 0.294768 Nov 27 21:26:00.289801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3668/7467] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:25:59 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1668 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:00.319680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:00.320505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:00.326468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:00.326911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:00.327894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:00.328321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:00.471793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:00.480054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5ed4c3eb-bd4e-43d5-b565-1494ea7120a6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1374 microversion: 2.1 time: 0.164453 Nov 27 21:26:00.489944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3800/7468] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:00 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:00.685811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-8269fd0f-5e84-4600-a714-bf0ce152abcc req-12696c23-e018-4fa7-bcf9-1bdd9c6e4c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f387a10-b9bd-45db-a642-665f2f0ebfeb", "name": "network-vif-plugged", "status": "completed", "tag": "32c18bc5-c2ee-408a-82f6-0757b62eaf16"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:00.687924 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:00.687924 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:26:00.697459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8269fd0f-5e84-4600-a714-bf0ce152abcc req-12696c23-e018-4fa7-bcf9-1bdd9c6e4c67 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:00.698834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-8269fd0f-5e84-4600-a714-bf0ce152abcc req-12696c23-e018-4fa7-bcf9-1bdd9c6e4c67 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:00.711887 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-8269fd0f-5e84-4600-a714-bf0ce152abcc req-12696c23-e018-4fa7-bcf9-1bdd9c6e4c67 service nova] Creating event network-vif-plugged:32c18bc5-c2ee-408a-82f6-0757b62eaf16 for instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb on nch2-master-1 Nov 27 21:26:00.717132 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-8269fd0f-5e84-4600-a714-bf0ce152abcc req-12696c23-e018-4fa7-bcf9-1bdd9c6e4c67 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035520 Nov 27 21:26:00.717828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3669/7469] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:01.310145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:01.310754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:01.317822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:01.318283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:01.319054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:01.319515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:01.456292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:01.465214 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f209971-2201-46ad-93b9-c8fd47a8033a tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1550 microversion: 2.1 time: 0.159558 Nov 27 21:26:01.465713 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3801/7470] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:01 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:01.497869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:01.498575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:01.504781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:01.505244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:01.506033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:01.506483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:01.718539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:01.726456 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f4e7ae89-5cb9-4076-8829-b52ee8f3312b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1374 microversion: 2.1 time: 0.233378 Nov 27 21:26:01.727042 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3670/7471] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:01 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1374 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:02.057636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-340ee6b3-16f9-4237-80bf-c3cc02f191db req-1ee466c3-4c04-434e-af80-225edf9c4cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca8448b-eaa8-47e5-b00f-34103c7cc12b", "name": "network-vif-deleted", "tag": "d30ce7d3-47f0-4788-b766-c0f924abb913"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:02.059283 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:02.059283 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:26:02.068127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-340ee6b3-16f9-4237-80bf-c3cc02f191db req-1ee466c3-4c04-434e-af80-225edf9c4cd7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.068573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-340ee6b3-16f9-4237-80bf-c3cc02f191db req-1ee466c3-4c04-434e-af80-225edf9c4cd7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:02.081103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-340ee6b3-16f9-4237-80bf-c3cc02f191db req-1ee466c3-4c04-434e-af80-225edf9c4cd7 service nova] Creating event network-vif-deleted:d30ce7d3-47f0-4788-b766-c0f924abb913 for instance aca8448b-eaa8-47e5-b00f-34103c7cc12b on nch1-master-1 Nov 27 21:26:02.086552 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-340ee6b3-16f9-4237-80bf-c3cc02f191db req-1ee466c3-4c04-434e-af80-225edf9c4cd7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Nov 27 21:26:02.087144 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3802/7472] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:02.486065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:02.486699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:02.492995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.493465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:02.494307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.494752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:02.533995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.534656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:02.534952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lazy-loading 'fault' on Instance uuid aca8448b-eaa8-47e5-b00f-34103c7cc12b {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:26:02.580135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:02.588134 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d2629189-4146-4a8a-bf1e-280bfc06588f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 200 len: 1338 microversion: 2.1 time: 0.105499 Nov 27 21:26:02.588744 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3671/7473] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:02 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:02.745050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:02.745769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:02.751871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.752317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:02.753082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.754131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:02.882717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:02.890185 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-739a8841-ad19-4942-816f-db001c9dfd65 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1562 microversion: 2.1 time: 0.149883 Nov 27 21:26:02.890751 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3803/7474] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:02 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:26:02.906183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:02.906817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:02.912959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.913432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:02.914227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:02.914685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:03.044247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:03.052208 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac5f463d-f40c-4b6b-afa9-42f9decb10fb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1562 microversion: 2.1 time: 0.149827 Nov 27 21:26:03.052779 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3672/7475] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:02 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:03.118371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:03.118872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:03.124778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:03.125232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:03.126008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:03.126452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:03.151342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:26:03.225312 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f7503d14-bf28-4e0f-a30e-d277dd4fb38b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 204 len: 0 microversion: 2.1 time: 0.110404 Nov 27 21:26:03.225909 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3804/7476] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:26:03 2021] DELETE /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:26:03.234027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:03.234649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:03.241726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:03.242191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:03.242979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:03.243457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:03.375394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:03.382809 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-306db042-0409-444a-b93c-51ac367afa12 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1568 microversion: 2.1 time: 0.152406 Nov 27 21:26:03.383436 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3673/7477] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:03 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:03.605735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:03.606483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: aca8448b-eaa8-47e5-b00f-34103c7cc12b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:03.612561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:03.613277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:03.614115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:03.614577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:03.631820 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] HTTP exception thrown: Instance aca8448b-eaa8-47e5-b00f-34103c7cc12b could not be found. Nov 27 21:26:03.632340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Returning 404 to user: Instance aca8448b-eaa8-47e5-b00f-34103c7cc12b could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:26:03.633477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a757ac21-1e10-46a2-acb7-7fadc09a46da tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b" status: 404 len: 111 microversion: 2.1 time: 0.032006 Nov 27 21:26:03.634026 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3805/7478] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:03 2021] GET /compute/v2.1/servers/aca8448b-eaa8-47e5-b00f-34103c7cc12b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:03.800278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-feb61b6e-8fa1-4fb0-a5b7-66d7b81a934f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '.version_select at 0x7f15d933f9d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:03.833883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-feb61b6e-8fa1-4fb0-a5b7-66d7b81a934f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-670670702" status: 202 len: 0 microversion: 2.1 time: 0.025331 Nov 27 21:26:03.834502 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3674/7479] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:26:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-670670702 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:26:04.401418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:04.402025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:04.411726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:04.412329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:04.413273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:04.413789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:04.636067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:04.644937 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8bc67bdc-16d5-4412-8ca2-27f7f8821ab6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1568 microversion: 2.1 time: 0.246750 Nov 27 21:26:04.645688 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3806/7480] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:04 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:05.374355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-276fc8b4-490d-413d-bbc3-662d2cf92db4 req-a80406e2-720b-470e-9163-b8a9073fba1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f387a10-b9bd-45db-a642-665f2f0ebfeb", "name": "network-vif-deleted", "tag": "32c18bc5-c2ee-408a-82f6-0757b62eaf16"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:05.376231 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:05.376231 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:26:05.388501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-276fc8b4-490d-413d-bbc3-662d2cf92db4 req-a80406e2-720b-470e-9163-b8a9073fba1b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:05.393346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-276fc8b4-490d-413d-bbc3-662d2cf92db4 req-a80406e2-720b-470e-9163-b8a9073fba1b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:05.417573 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-276fc8b4-490d-413d-bbc3-662d2cf92db4 req-a80406e2-720b-470e-9163-b8a9073fba1b service nova] Creating event network-vif-deleted:32c18bc5-c2ee-408a-82f6-0757b62eaf16 for instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb on nch2-master-1 Nov 27 21:26:05.431651 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-276fc8b4-490d-413d-bbc3-662d2cf92db4 req-a80406e2-720b-470e-9163-b8a9073fba1b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061886 Nov 27 21:26:05.432336 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3675/7481] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:05.664398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:05.665864 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:05.679119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:05.679613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:05.680426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:05.680871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:06.139649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:06.150186 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8aa0d998-77c2-48ee-acfa-04db70ac0828 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 200 len: 1359 microversion: 2.1 time: 0.491075 Nov 27 21:26:06.151520 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3807/7482] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:05 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 1359 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:07.170079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:07.171103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:07.177869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:07.178433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:07.179358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:07.179892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:07.195229 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb could not be found. Nov 27 21:26:07.195806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:26:07.197077 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a15d209b-5325-4a93-97ac-84606b9d7915 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 404 len: 111 microversion: 2.1 time: 0.032229 Nov 27 21:26:07.198133 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3676/7483] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:07 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:12.768653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a56062a3-d80d-4a89-b9a8-e18b77d87c4f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'create', calling method: .version_select at 0x7f15c6c00d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1141067363"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:12.794664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a56062a3-d80d-4a89-b9a8-e18b77d87c4f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:26:12.801381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a56062a3-d80d-4a89-b9a8-e18b77d87c4f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:26:12.982290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a56062a3-d80d-4a89-b9a8-e18b77d87c4f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:26:12.988598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-a56062a3-d80d-4a89-b9a8-e18b77d87c4f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:26:13.006265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a56062a3-d80d-4a89-b9a8-e18b77d87c4f tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.246540 Nov 27 21:26:13.006905 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3808/7484] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:26:12 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:14.317000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2053669768", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "c33d6791-2c38-4780-9894-27f4506dfe3b"}], "key_name": "tempest-TestNetworkBasicOps-1141067363", "security_groups": [{"name": "tempest-secgroup-smoke-606923258"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:14.461450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] validate_networks() for [('c33d6791-2c38-4780-9894-27f4506dfe3b', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:26:15.042673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:26:15.043579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:26:15.044264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:26:15.044761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:26:15.045324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:26:15.056186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:15.056755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:15.057845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:15.058435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:15.076646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:26:15.083193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Getting quotas for user a2b5ce3f808e49e3a6e346d26813ae5b and project c0ac40a766ea478bab3fe658ba56b08f. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:26:15.098461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:26:15.101228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:26:15.156584 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5d1264d1-ea70-4113-988b-5f36e16d57cc tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.844135 Nov 27 21:26:15.157162 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3677/7485] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:26:14 2021] POST /compute/v2.1/servers => generated 405 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 21:26:15.169420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-043bfe76-59b2-418a-befc-65e69f68961e tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:15.170028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-043bfe76-59b2-418a-befc-65e69f68961e tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:15.242368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-043bfe76-59b2-418a-befc-65e69f68961e tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:15.254544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-043bfe76-59b2-418a-befc-65e69f68961e tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1249 microversion: 2.1 time: 0.090393 Nov 27 21:26:15.258471 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3809/7486] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:15 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:16.273815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:16.275471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:16.284017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:16.284968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:16.286010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:16.286860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:16.367826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:16.375892 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29b128ff-6d75-41ea-b773-b850474fc776 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1319 microversion: 2.1 time: 0.106913 Nov 27 21:26:16.377188 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3678/7487] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:16 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1319 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:17.397890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:17.399164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:17.407225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:17.407754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:17.408677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:17.409127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:17.574581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:17.583892 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23413799-2c0b-4bf4-b1b5-22ffdd229f87 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.191425 Nov 27 21:26:17.584766 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3810/7488] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:17 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:17.710477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-37a62547-3bfc-4331-80e8-97db70606915 req-09dc873b-c1e0-48c9-9a98-838566eb23ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f602b93-d6a7-473f-aba0-0d0624a42b87", "tag": "4c482aab-a978-4508-9e66-0001b7f9d47e"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:17.713269 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:17.713269 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:26:17.725881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-37a62547-3bfc-4331-80e8-97db70606915 req-09dc873b-c1e0-48c9-9a98-838566eb23ca service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:17.726938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-37a62547-3bfc-4331-80e8-97db70606915 req-09dc873b-c1e0-48c9-9a98-838566eb23ca service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:17.751108 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-37a62547-3bfc-4331-80e8-97db70606915 req-09dc873b-c1e0-48c9-9a98-838566eb23ca service nova] Creating event network-changed:4c482aab-a978-4508-9e66-0001b7f9d47e for instance 4f602b93-d6a7-473f-aba0-0d0624a42b87 on nch2-master-1 Nov 27 21:26:17.757244 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-37a62547-3bfc-4331-80e8-97db70606915 req-09dc873b-c1e0-48c9-9a98-838566eb23ca service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053814 Nov 27 21:26:17.758125 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3679/7489] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:18.602310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:18.602929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:18.609324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:18.609778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:18.610558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:18.610997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:18.756438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:18.764075 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b271530a-249b-4e97-ae78-b7ae184d6aac tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.165476 Nov 27 21:26:18.764587 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3811/7490] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:18 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:26:19.782867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:19.783616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:19.790308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:19.790777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:19.791603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:19.792084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:19.922798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:19.930319 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e5cce5fb-5ea4-4610-afb0-a8d3275eeb24 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.152291 Nov 27 21:26:19.930904 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3680/7491] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:19 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:20.947287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:20.948062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:20.955562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:20.956072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:20.956804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:20.957233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:21.105012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:21.114168 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-12b40b50-8d52-4888-9e73-de80c0184abe tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.169609 Nov 27 21:26:21.114817 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3812/7492] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:20 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:26:22.133385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:22.134173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:22.141225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:22.141896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:22.142839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:22.143531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:22.299987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:22.308703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca66ccb7-8e7d-4ae9-bd34-7a8c6b72d6c3 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.180091 Nov 27 21:26:22.309299 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3681/7493] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:22 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:26:23.326306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:23.327006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:23.334454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:23.334896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:23.335705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:23.336392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:23.484437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:23.493265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb3131bd-9cde-4b00-a097-d2debf20b744 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.170868 Nov 27 21:26:23.493855 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3813/7494] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:23 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:24.510635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:24.511330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:24.518297 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:24.518767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:24.519601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:24.520056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:24.679596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:24.688744 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8a0ac2d4-2128-43ee-b7e3-908389c3a2ad tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.181634 Nov 27 21:26:24.689675 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3682/7495] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:24 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:24.795211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5c44e341-8389-4d31-87d5-99a55315c3e7 req-b3fb212d-a417-4c40-b2e5-eb809bb99c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f602b93-d6a7-473f-aba0-0d0624a42b87", "name": "network-vif-plugged", "status": "completed", "tag": "4c482aab-a978-4508-9e66-0001b7f9d47e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:24.797256 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:24.797256 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:26:24.807646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5c44e341-8389-4d31-87d5-99a55315c3e7 req-b3fb212d-a417-4c40-b2e5-eb809bb99c06 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:24.808190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5c44e341-8389-4d31-87d5-99a55315c3e7 req-b3fb212d-a417-4c40-b2e5-eb809bb99c06 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:24.823646 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5c44e341-8389-4d31-87d5-99a55315c3e7 req-b3fb212d-a417-4c40-b2e5-eb809bb99c06 service nova] Creating event network-vif-plugged:4c482aab-a978-4508-9e66-0001b7f9d47e for instance 4f602b93-d6a7-473f-aba0-0d0624a42b87 on nch2-master-1 Nov 27 21:26:24.829941 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5c44e341-8389-4d31-87d5-99a55315c3e7 req-b3fb212d-a417-4c40-b2e5-eb809bb99c06 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038483 Nov 27 21:26:24.830788 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3814/7496] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:25.707943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:25.708567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:25.715127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:25.715627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:25.716409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:25.716858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:25.865602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:25.874147 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abaa0ebc-8fc1-4a06-b3b5-818f697b9184 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1374 microversion: 2.1 time: 0.169867 Nov 27 21:26:25.874716 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3683/7497] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:25 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:26.893519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:26.894322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:26.904286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:26.904871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:26.905796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:26.906388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:27.057991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:27.065854 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf88bbc2-818b-45c8-8376-d956a22f0666 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1547 microversion: 2.1 time: 0.177020 Nov 27 21:26:27.066481 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3815/7498] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:26 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:26:27.082339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:27.082978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:27.090351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:27.090819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:27.091841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:27.092335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:27.231476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:27.243419 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-129be1c5-3b66-4310-b843-1f99082cd2b9 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1547 microversion: 2.1 time: 0.164797 Nov 27 21:26:27.244012 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3684/7499] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:27 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:29.352056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-444b4aec-3ae2-4abd-9062-85a72176bee9 req-1c320208-3b8e-448c-8410-c96583ee25c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f602b93-d6a7-473f-aba0-0d0624a42b87", "tag": "4c482aab-a978-4508-9e66-0001b7f9d47e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:29.353770 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:29.353770 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:26:29.363566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-444b4aec-3ae2-4abd-9062-85a72176bee9 req-1c320208-3b8e-448c-8410-c96583ee25c1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:29.364369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-444b4aec-3ae2-4abd-9062-85a72176bee9 req-1c320208-3b8e-448c-8410-c96583ee25c1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:29.377430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-444b4aec-3ae2-4abd-9062-85a72176bee9 req-1c320208-3b8e-448c-8410-c96583ee25c1 service nova] Creating event network-changed:4c482aab-a978-4508-9e66-0001b7f9d47e for instance 4f602b93-d6a7-473f-aba0-0d0624a42b87 on nch2-master-1 Nov 27 21:26:29.383584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-444b4aec-3ae2-4abd-9062-85a72176bee9 req-1c320208-3b8e-448c-8410-c96583ee25c1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035487 Nov 27 21:26:29.384423 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3816/7500] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:38.279220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:38.279764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:38.286397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:38.286862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:38.287791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:38.288244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:38.315841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:26:38.394738 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe8d0679-3b04-4992-a21d-1928b1005eaa tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 204 len: 0 microversion: 2.1 time: 0.117460 Nov 27 21:26:38.395549 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3685/7501] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:26:38 2021] DELETE /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:26:38.406525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:38.407387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:38.414554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:38.414998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:38.415884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:38.416477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:38.557546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:38.565514 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b607cda-0ad9-4b8c-a4d1-2437b3362cc7 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1410 microversion: 2.1 time: 0.164337 Nov 27 21:26:38.566431 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3817/7502] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:38 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:39.587498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:39.588211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:39.596282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:39.596745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:39.597538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:39.597988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:39.732662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:39.740939 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9884815-38e3-4352-86f2-2d868fadb769 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1410 microversion: 2.1 time: 0.158221 Nov 27 21:26:39.741678 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3686/7503] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:39 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:26:40.646177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8d28abc1-3c8b-40cb-b79c-1d18df4ed72d req-3d76e632-86f3-45ed-8131-83552076a210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae43e86-b3a6-4c2b-b956-694403fe687c", "name": "network-vif-deleted", "tag": "37849f71-d384-4d11-acdb-4afd32c10730"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:40.647772 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:40.647772 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:26:40.656855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8d28abc1-3c8b-40cb-b79c-1d18df4ed72d req-3d76e632-86f3-45ed-8131-83552076a210 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:40.657300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8d28abc1-3c8b-40cb-b79c-1d18df4ed72d req-3d76e632-86f3-45ed-8131-83552076a210 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:40.681765 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8d28abc1-3c8b-40cb-b79c-1d18df4ed72d req-3d76e632-86f3-45ed-8131-83552076a210 service nova] Creating event network-vif-deleted:37849f71-d384-4d11-acdb-4afd32c10730 for instance 4ae43e86-b3a6-4c2b-b956-694403fe687c on nch1-master-1 Nov 27 21:26:40.686807 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8d28abc1-3c8b-40cb-b79c-1d18df4ed72d req-3d76e632-86f3-45ed-8131-83552076a210 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044295 Nov 27 21:26:40.687430 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3818/7504] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:40.757719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:40.758398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:40.765499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:40.765906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:40.766702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:40.767152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:40.830114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:40.838173 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16e759f8-9f01-4fbf-b1dc-3e3defdca604 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 200 len: 1201 microversion: 2.1 time: 0.084179 Nov 27 21:26:40.838787 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3687/7505] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:40 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 1201 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:41.856774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:41.857481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:41.864725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:41.865181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:41.865961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:41.866396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:41.879493 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 4ae43e86-b3a6-4c2b-b956-694403fe687c could not be found. Nov 27 21:26:41.880302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 4ae43e86-b3a6-4c2b-b956-694403fe687c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:26:41.881131 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fbec6b17-b2a2-43c8-b0d1-3f9b5cad9be3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 404 len: 111 microversion: 2.1 time: 0.028471 Nov 27 21:26:41.881891 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3819/7506] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:41 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:41.910700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:41.911214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:41.918298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:41.918764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:41.919576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:41.920070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:41.935335 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb could not be found. Nov 27 21:26:41.935943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:26:41.937107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2d298a0-ebdf-4126-ae06-c2ba625206b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 404 len: 111 microversion: 2.1 time: 0.030176 Nov 27 21:26:41.937657 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3688/7507] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:26:41 2021] DELETE /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:41.946280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:41.946878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 5f387a10-b9bd-45db-a642-665f2f0ebfeb] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:41.953867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:41.954316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:41.955086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:41.955894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:41.972226 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb could not be found. Nov 27 21:26:41.972836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 5f387a10-b9bd-45db-a642-665f2f0ebfeb could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:26:41.973641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0a61495-3ee4-4669-96d8-a9ac4ad3a72b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb" status: 404 len: 111 microversion: 2.1 time: 0.031694 Nov 27 21:26:41.974171 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3820/7508] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:41 2021] GET /compute/v2.1/servers/5f387a10-b9bd-45db-a642-665f2f0ebfeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:42.377780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:42.378301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:42.384187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:42.384659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:42.385461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:42.385914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:42.399657 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 4ae43e86-b3a6-4c2b-b956-694403fe687c could not be found. Nov 27 21:26:42.400253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 4ae43e86-b3a6-4c2b-b956-694403fe687c could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:26:42.401109 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2081dd42-7f10-4eea-95e3-cb8009dfa978 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 404 len: 111 microversion: 2.1 time: 0.027153 Nov 27 21:26:42.401644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3689/7509] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:26:42 2021] DELETE /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:42.409362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:42.409955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 4ae43e86-b3a6-4c2b-b956-694403fe687c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:42.416445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:42.416886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:42.417644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:42.418256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:42.431885 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 4ae43e86-b3a6-4c2b-b956-694403fe687c could not be found. Nov 27 21:26:42.432461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 4ae43e86-b3a6-4c2b-b956-694403fe687c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:26:42.433275 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21b0f808-fceb-44eb-9342-ed9b340a5fb8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c" status: 404 len: 111 microversion: 2.1 time: 0.027547 Nov 27 21:26:42.433807 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3821/7510] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:42 2021] GET /compute/v2.1/servers/4ae43e86-b3a6-4c2b-b956-694403fe687c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:42.495488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e7d1b94-835a-4bb3-acf2-43217dc063b1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'create', calling method: .version_select at 0x7f15d9379160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1930131691"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:42.509160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5e7d1b94-835a-4bb3-acf2-43217dc063b1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:26:42.514058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5e7d1b94-835a-4bb3-acf2-43217dc063b1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:26:42.614723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5e7d1b94-835a-4bb3-acf2-43217dc063b1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:26:42.619670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-5e7d1b94-835a-4bb3-acf2-43217dc063b1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:26:42.634071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e7d1b94-835a-4bb3-acf2-43217dc063b1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.142391 Nov 27 21:26:42.634665 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3690/7511] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:26:42 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:45.035545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-730818227", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930131691", "security_groups": [{"name": "tempest-secgroup-smoke-1671575428"}], "block_device_mapping_v2": [{"uuid": "03079e0b-c8b5-4a98-beae-24c4370e0212", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5d1d65de-2cf6-426d-bf1f-f8a8267152d2"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:45.145131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] validate_networks() for [('5d1d65de-2cf6-426d-bf1f-f8a8267152d2', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:26:45.829768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:26:45.830193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:26:45.830663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:26:45.831098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:26:45.831540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:26:45.840793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:45.841236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:45.842043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:45.842477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:45.858625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:26:45.863665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:26:45.918616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:26:45.920823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03079e0b-c8b5-4a98-beae-24c4370e0212',volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:26:46.039932 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-30d93a15-1fbf-4bcb-8f3a-d5e209652116 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.007975 Nov 27 21:26:46.040608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3822/7512] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:26:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:26:46.051542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78732c7b-184e-4bee-b660-812659fdf0d3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:46.052168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78732c7b-184e-4bee-b660-812659fdf0d3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:46.104068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-78732c7b-184e-4bee-b660-812659fdf0d3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:46.112049 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78732c7b-184e-4bee-b660-812659fdf0d3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1094 microversion: 2.1 time: 0.065183 Nov 27 21:26:46.112620 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3691/7513] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:46 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:47.130800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:47.131615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:47.138986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:47.139468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:47.140246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:47.140683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:47.205542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:47.213560 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-77f6b484-f160-496e-8520-944251bbe01d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1210 microversion: 2.1 time: 0.087117 Nov 27 21:26:47.214434 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3823/7514] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:47 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:48.230497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:48.231124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:48.238262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:48.238733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:48.239591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:48.240299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:48.402889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0e983ec0-7d9a-45a6-bb9a-a58bc1c91d47 req-adbceb5c-243e-4ef2-87e1-90b4bca3edb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a998ba79-79c4-4e94-8cbb-7fabdce46b60", "tag": "eb002a01-708d-4e8b-b1d2-931d75476f38"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:48.405984 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:48.405984 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:26:48.416413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0e983ec0-7d9a-45a6-bb9a-a58bc1c91d47 req-adbceb5c-243e-4ef2-87e1-90b4bca3edb7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:48.416852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0e983ec0-7d9a-45a6-bb9a-a58bc1c91d47 req-adbceb5c-243e-4ef2-87e1-90b4bca3edb7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:48.438965 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0e983ec0-7d9a-45a6-bb9a-a58bc1c91d47 req-adbceb5c-243e-4ef2-87e1-90b4bca3edb7 service nova] Creating event network-changed:eb002a01-708d-4e8b-b1d2-931d75476f38 for instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 on nch1-master-1 Nov 27 21:26:48.456534 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0e983ec0-7d9a-45a6-bb9a-a58bc1c91d47 req-adbceb5c-243e-4ef2-87e1-90b4bca3edb7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059739 Nov 27 21:26:48.459845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:48.460034 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3824/7515] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:48.473306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-971689ef-0e18-46b4-872c-361c161a78e4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1266 microversion: 2.1 time: 0.247093 Nov 27 21:26:48.483650 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3692/7516] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:48 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:49.493054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:49.493753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:49.499854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:49.500308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:49.501083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:49.501526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:49.637109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:49.644473 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a4eaa793-85b3-40f2-a8e0-f91732a9222e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1266 microversion: 2.1 time: 0.157102 Nov 27 21:26:49.645051 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3825/7517] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:49 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:50.661153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:50.661769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:50.668575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:50.669042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:50.669835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:50.670282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:50.808370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:50.815778 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a4c8f63-fb02-4754-9c68-edbf8258afb1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1266 microversion: 2.1 time: 0.158315 Nov 27 21:26:50.816366 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3693/7518] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:50 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:26:51.835387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:51.836425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:51.843921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:51.844376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:51.845163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:51.845601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:51.974520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:51.981954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70ebf7a6-f36a-4140-9d93-a684d68678c8 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1266 microversion: 2.1 time: 0.152695 Nov 27 21:26:51.982541 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3826/7519] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:51 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:52.998939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:52.999611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:53.006155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:53.006619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:53.007434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:53.007888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:53.142746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:53.150130 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e82dd23-424d-4116-b0fd-c5f905944c97 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1266 microversion: 2.1 time: 0.154887 Nov 27 21:26:53.151295 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3694/7520] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:52 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:53.422244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-24cb31ae-9857-4df8-9840-a8ca1504e28f req-da4a2bf6-b26c-443e-ba23-1d0f7f8043e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a998ba79-79c4-4e94-8cbb-7fabdce46b60", "name": "network-vif-plugged", "status": "completed", "tag": "eb002a01-708d-4e8b-b1d2-931d75476f38"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:53.424122 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:53.424122 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:26:53.438720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-24cb31ae-9857-4df8-9840-a8ca1504e28f req-da4a2bf6-b26c-443e-ba23-1d0f7f8043e7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:53.439440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-24cb31ae-9857-4df8-9840-a8ca1504e28f req-da4a2bf6-b26c-443e-ba23-1d0f7f8043e7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:53.452463 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-24cb31ae-9857-4df8-9840-a8ca1504e28f req-da4a2bf6-b26c-443e-ba23-1d0f7f8043e7 service nova] Creating event network-vif-plugged:eb002a01-708d-4e8b-b1d2-931d75476f38 for instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 on nch1-master-1 Nov 27 21:26:53.459556 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-24cb31ae-9857-4df8-9840-a8ca1504e28f req-da4a2bf6-b26c-443e-ba23-1d0f7f8043e7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044591 Nov 27 21:26:53.460448 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3827/7521] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:26:54.167574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:54.168201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:54.174941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:54.175511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:54.176302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:54.176750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:54.311550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:54.318882 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac11f2e4-10be-446d-bcfd-bc03ae17bed2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1266 microversion: 2.1 time: 0.155602 Nov 27 21:26:54.319505 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3695/7522] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:54 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:55.337043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:55.337903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:55.344077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:55.344527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:55.345647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:55.346089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:55.481587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:55.488959 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d965c7f-8ea7-4ef4-9568-802b11927b09 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1453 microversion: 2.1 time: 0.156722 Nov 27 21:26:55.489466 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3828/7523] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:55 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:55.505837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:26:55.506461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:26:55.512813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:55.513274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:55.514059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:55.514510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:55.645115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:26:55.653250 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72f76293-083c-4bc4-b570-6e8f310cb865 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1453 microversion: 2.1 time: 0.151240 Nov 27 21:26:55.653828 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3696/7524] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:26:55 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:26:57.619745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-298bb13c-3651-4f89-8e34-5237a3b7b01b req-aa29fea5-a7f4-4dca-9920-7ddfb09a61a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a998ba79-79c4-4e94-8cbb-7fabdce46b60", "tag": "eb002a01-708d-4e8b-b1d2-931d75476f38"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:26:57.621286 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:26:57.621286 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:26:57.629111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-298bb13c-3651-4f89-8e34-5237a3b7b01b req-aa29fea5-a7f4-4dca-9920-7ddfb09a61a7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:26:57.629547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-298bb13c-3651-4f89-8e34-5237a3b7b01b req-aa29fea5-a7f4-4dca-9920-7ddfb09a61a7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:26:57.640602 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-298bb13c-3651-4f89-8e34-5237a3b7b01b req-aa29fea5-a7f4-4dca-9920-7ddfb09a61a7 service nova] Creating event network-changed:eb002a01-708d-4e8b-b1d2-931d75476f38 for instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 on nch1-master-1 Nov 27 21:26:57.645989 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-298bb13c-3651-4f89-8e34-5237a3b7b01b req-aa29fea5-a7f4-4dca-9920-7ddfb09a61a7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031279 Nov 27 21:26:57.646944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3829/7525] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:26:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:27:00.644024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c310d1d3-6aed-4ffd-9eb6-6dd2b3c41780 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:27:00.645028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c310d1d3-6aed-4ffd-9eb6-6dd2b3c41780 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:27:00.652508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c310d1d3-6aed-4ffd-9eb6-6dd2b3c41780 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:00.652976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c310d1d3-6aed-4ffd-9eb6-6dd2b3c41780 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:00.653767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c310d1d3-6aed-4ffd-9eb6-6dd2b3c41780 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:00.654226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c310d1d3-6aed-4ffd-9eb6-6dd2b3c41780 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:00.703485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c310d1d3-6aed-4ffd-9eb6-6dd2b3c41780 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87/action" status: 200 len: 24577 microversion: 2.1 time: 0.062811 Nov 27 21:27:00.704296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3697/7526] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:27:00 2021] POST /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87/action => generated 24577 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:27:30.996405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45c40092-ef32-4978-b956-48b58384636d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:27:30.997619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45c40092-ef32-4978-b956-48b58384636d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:27:31.004744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45c40092-ef32-4978-b956-48b58384636d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:31.005255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45c40092-ef32-4978-b956-48b58384636d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:31.006327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45c40092-ef32-4978-b956-48b58384636d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:31.006802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45c40092-ef32-4978-b956-48b58384636d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:31.076675 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45c40092-ef32-4978-b956-48b58384636d tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "POST /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87/action" status: 200 len: 32648 microversion: 2.1 time: 0.085785 Nov 27 21:27:31.077329 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3830/7527] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:27:30 2021] POST /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87/action => generated 32648 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:27:32.178614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:27:32.179995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-dcbc5989-a55c-4188-add0-a0f9fdc8b7a3 req-b85a35ed-d0df-4da3-b400-37697ada9f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f602b93-d6a7-473f-aba0-0d0624a42b87", "tag": "4c482aab-a978-4508-9e66-0001b7f9d47e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:27:32.182301 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:27:32.182301 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:27:32.184407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:27:32.195214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dcbc5989-a55c-4188-add0-a0f9fdc8b7a3 req-b85a35ed-d0df-4da3-b400-37697ada9f2c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:32.200615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:32.201099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:32.201998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:32.202433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:32.206008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dcbc5989-a55c-4188-add0-a0f9fdc8b7a3 req-b85a35ed-d0df-4da3-b400-37697ada9f2c service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:32.230308 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-dcbc5989-a55c-4188-add0-a0f9fdc8b7a3 req-b85a35ed-d0df-4da3-b400-37697ada9f2c service nova] Creating event network-changed:4c482aab-a978-4508-9e66-0001b7f9d47e for instance 4f602b93-d6a7-473f-aba0-0d0624a42b87 on nch2-master-1 Nov 27 21:27:32.241886 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-dcbc5989-a55c-4188-add0-a0f9fdc8b7a3 req-b85a35ed-d0df-4da3-b400-37697ada9f2c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069269 Nov 27 21:27:32.243307 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3831/7528] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:27:32.248902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:27:32.342826 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-302659a4-738a-4101-be54-58818d2e3327 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "DELETE /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 204 len: 0 microversion: 2.1 time: 0.173024 Nov 27 21:27:32.344087 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3698/7529] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:27:32 2021] DELETE /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:27:32.354482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:27:32.355180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:27:32.361663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:32.362115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:32.363123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:32.363592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:32.540732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:27:32.550747 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51d5ca2e-af5f-43df-85f8-2cc56ec42c71 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1672 microversion: 2.1 time: 0.201500 Nov 27 21:27:32.551935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3832/7530] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:27:32 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:27:33.570716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:27:33.572272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:27:33.580128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:33.580592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:33.581684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:33.581885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:33.732462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:27:33.741268 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e986eaab-4812-44b9-8486-ce382b408937 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1553 microversion: 2.1 time: 0.175066 Nov 27 21:27:33.742119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3699/7531] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:27:33 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:27:34.469058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-01f5b707-9774-4f42-a0de-327f94e12fa3 req-6b25726e-2d56-44ed-b2ba-2a8b8eaac66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f602b93-d6a7-473f-aba0-0d0624a42b87", "name": "network-vif-deleted", "tag": "4c482aab-a978-4508-9e66-0001b7f9d47e"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:27:34.471430 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:27:34.471430 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:27:34.481169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-01f5b707-9774-4f42-a0de-327f94e12fa3 req-6b25726e-2d56-44ed-b2ba-2a8b8eaac66d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:34.481627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-01f5b707-9774-4f42-a0de-327f94e12fa3 req-6b25726e-2d56-44ed-b2ba-2a8b8eaac66d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:34.496372 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-01f5b707-9774-4f42-a0de-327f94e12fa3 req-6b25726e-2d56-44ed-b2ba-2a8b8eaac66d service nova] Creating event network-vif-deleted:4c482aab-a978-4508-9e66-0001b7f9d47e for instance 4f602b93-d6a7-473f-aba0-0d0624a42b87 on nch2-master-1 Nov 27 21:27:34.501727 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-01f5b707-9774-4f42-a0de-327f94e12fa3 req-6b25726e-2d56-44ed-b2ba-2a8b8eaac66d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Nov 27 21:27:34.502478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3833/7532] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:27:34.762345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:27:34.763241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:27:34.771903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:34.772482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:34.773470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:34.774002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:34.816646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:34.817178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:34.817787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lazy-loading 'fault' on Instance uuid 4f602b93-d6a7-473f-aba0-0d0624a42b87 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:27:34.873698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b5ce3f808e49e3a6e346d26813ae5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac40a766ea478bab3fe658ba56b08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:27:34.884028 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b23581f-2215-4f25-a68c-9cd6d4d19e49 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 200 len: 1339 microversion: 2.1 time: 0.126374 Nov 27 21:27:34.884898 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3700/7533] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:27:34 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 1339 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:27:35.903078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:27:35.903802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] [instance: 4f602b93-d6a7-473f-aba0-0d0624a42b87] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:27:35.910009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:35.910460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:35.911238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:27:35.911711 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:27:35.924992 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] HTTP exception thrown: Instance 4f602b93-d6a7-473f-aba0-0d0624a42b87 could not be found. Nov 27 21:27:35.925569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Returning 404 to user: Instance 4f602b93-d6a7-473f-aba0-0d0624a42b87 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:27:35.926407 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2555f834-5310-4f55-81c6-d25adf0e5f32 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87" status: 404 len: 111 microversion: 2.1 time: 0.028220 Nov 27 21:27:35.926924 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3834/7534] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:27:35 2021] GET /compute/v2.1/servers/4f602b93-d6a7-473f-aba0-0d0624a42b87 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:27:36.089333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6713a8c9-fd34-48be-9be6-f98347a4c7c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] Calling method '.version_select at 0x7f15d94598b0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:27:36.112711 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6713a8c9-fd34-48be-9be6-f98347a4c7c0 tempest-TestNetworkBasicOps-722051392 tempest-TestNetworkBasicOps-722051392-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1141067363" status: 202 len: 0 microversion: 2.1 time: 0.027748 Nov 27 21:27:36.113291 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3701/7535] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 21:27:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1141067363 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:28:07.866873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea1392a2-2088-40c0-8be0-1df7c04f8ac3 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Action: 'create', calling method: .version_select at 0x7f15d9415790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1933348899"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:28:07.881240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ea1392a2-2088-40c0-8be0-1df7c04f8ac3 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Getting quotas for project 34545818a5a9484a943ab6e09bdd800a. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:28:07.886146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ea1392a2-2088-40c0-8be0-1df7c04f8ac3 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Getting quotas for user 011c76eca940449f865a90106ed59c41 and project 34545818a5a9484a943ab6e09bdd800a. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:28:08.149432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ea1392a2-2088-40c0-8be0-1df7c04f8ac3 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Getting quotas for project 34545818a5a9484a943ab6e09bdd800a. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:28:08.155866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ea1392a2-2088-40c0-8be0-1df7c04f8ac3 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Getting quotas for user 011c76eca940449f865a90106ed59c41 and project 34545818a5a9484a943ab6e09bdd800a. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:28:08.169875 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea1392a2-2088-40c0-8be0-1df7c04f8ac3 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.306929 Nov 27 21:28:08.170471 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3835/7536] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:28:07 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:09.072386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-711747255", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b896c246-d90f-40d7-8c0c-b3d5febff035", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1933348899", "security_groups": [{"name": "tempest-secgroup-smoke-79189950"}], "networks": [{"uuid": "10235729-5fad-4790-b874-ab2a684d29bb"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:28:09.182019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] validate_networks() for [('10235729-5fad-4790-b874-ab2a684d29bb', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:28:09.544806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:28:09.545242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:28:09.545726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:28:09.546145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:28:09.546570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:28:09.555229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:09.555723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:09.556844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:09.557301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:09.573897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Getting quotas for project 34545818a5a9484a943ab6e09bdd800a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:28:09.578895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Getting quotas for user 011c76eca940449f865a90106ed59c41 and project 34545818a5a9484a943ab6e09bdd800a. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:28:09.637777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:28:09.639975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b896c246-d90f-40d7-8c0c-b3d5febff035',volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:28:09.760770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c3bbb775-bfcb-4641-92e3-783b64a1f5dd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.692369 Nov 27 21:28:09.761519 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3702/7537] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:28:09 2021] POST /compute/v2.1/servers => generated 404 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:28:09.772332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ede6ee3f-b563-414d-8f07-4dd54ba0f30d tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:09.772936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ede6ee3f-b563-414d-8f07-4dd54ba0f30d tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:09.825395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ede6ee3f-b563-414d-8f07-4dd54ba0f30d tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:09.832041 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ede6ee3f-b563-414d-8f07-4dd54ba0f30d tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1098 microversion: 2.1 time: 0.064149 Nov 27 21:28:09.832608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3836/7538] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:09 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1098 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:10.850094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:10.850794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:10.856936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:10.857474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:10.858344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:10.858864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:10.933860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:10.941969 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18a50670-ced3-44f0-b588-b4a1a7dd6504 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1214 microversion: 2.1 time: 0.096577 Nov 27 21:28:10.942899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3703/7539] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:10 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:28:11.959658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:11.960215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:11.967985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:11.968447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:11.969247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:11.969687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:12.114619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:12.122990 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44185b34-be93-430b-9fe0-59c0654f8fe9 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.167197 Nov 27 21:28:12.123575 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3837/7540] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:11 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:12.342606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-566e019b-4000-4452-aa3d-fdf98565f537 req-676c7e10-a7b5-43c0-9c82-d829fbf36f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def76e60-9053-460c-86c1-87dd132dc625", "tag": "1a7ee37e-753a-462f-807c-cfcea192aed7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:28:12.345274 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:28:12.345274 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:28:12.352777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-566e019b-4000-4452-aa3d-fdf98565f537 req-676c7e10-a7b5-43c0-9c82-d829fbf36f3d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:12.353513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-566e019b-4000-4452-aa3d-fdf98565f537 req-676c7e10-a7b5-43c0-9c82-d829fbf36f3d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:12.366539 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-566e019b-4000-4452-aa3d-fdf98565f537 req-676c7e10-a7b5-43c0-9c82-d829fbf36f3d service nova] Creating event network-changed:1a7ee37e-753a-462f-807c-cfcea192aed7 for instance def76e60-9053-460c-86c1-87dd132dc625 on nch2-master-1 Nov 27 21:28:12.372001 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-566e019b-4000-4452-aa3d-fdf98565f537 req-676c7e10-a7b5-43c0-9c82-d829fbf36f3d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223861 Nov 27 21:28:12.372695 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3704/7541] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:28:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:28:13.139834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:13.140449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:13.147118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:13.147618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:13.148398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:13.148837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:13.279440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:13.286807 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a2a0d26-9c11-4694-b4a2-6256775bfddd tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.151287 Nov 27 21:28:13.287408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3838/7542] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:13 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:14.305542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:14.306241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:14.312565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:14.313027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:14.313811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:14.314266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:14.452382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:14.459804 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-49cb354a-830f-4733-8290-bcbfe3f68117 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.159099 Nov 27 21:28:14.460370 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3705/7543] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:14 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:15.476740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:15.477338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:15.484573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:15.485015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:15.485784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:15.486216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:15.617704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:15.625365 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff9bbec7-fb4d-4632-861f-6d5e940336be tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.152391 Nov 27 21:28:15.625944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3839/7544] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:15 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:16.642904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:16.643562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:16.650371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:16.650844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:16.651686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:16.652159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:16.786257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:16.793629 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7cea9cc9-8205-4ede-89cf-98531ca01a5e tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.154543 Nov 27 21:28:16.794206 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3706/7545] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:16 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:17.810467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:17.811099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:17.817826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:17.818269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:17.819041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:17.819501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:17.952764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:17.960048 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a5f4fed-a80d-499d-9aa8-365f90314c3b tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.153222 Nov 27 21:28:17.960614 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3840/7546] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:17 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:18.977533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:18.978197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:18.985023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:18.985491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:18.986286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:18.986738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:19.119116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:19.127907 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6555037c-a88f-49ff-8cd8-6c0ac8597f69 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.154156 Nov 27 21:28:19.137936 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3707/7547] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:18 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:19.306378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7199ef14-5975-4e33-8f08-ff878700e319 req-892b957c-ee41-4dd5-820b-190582838108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def76e60-9053-460c-86c1-87dd132dc625", "name": "network-vif-plugged", "status": "completed", "tag": "1a7ee37e-753a-462f-807c-cfcea192aed7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:28:19.307971 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:28:19.307971 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:28:19.315518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7199ef14-5975-4e33-8f08-ff878700e319 req-892b957c-ee41-4dd5-820b-190582838108 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:19.315967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7199ef14-5975-4e33-8f08-ff878700e319 req-892b957c-ee41-4dd5-820b-190582838108 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:19.326559 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7199ef14-5975-4e33-8f08-ff878700e319 req-892b957c-ee41-4dd5-820b-190582838108 service nova] Creating event network-vif-plugged:1a7ee37e-753a-462f-807c-cfcea192aed7 for instance def76e60-9053-460c-86c1-87dd132dc625 on nch2-master-1 Nov 27 21:28:19.333227 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7199ef14-5975-4e33-8f08-ff878700e319 req-892b957c-ee41-4dd5-820b-190582838108 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099282 Nov 27 21:28:19.334084 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3841/7548] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:28:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:28:20.144677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:20.145421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:20.152175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:20.152639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:20.153434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:20.153887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:20.285687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:20.292997 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-85e04b33-ff2d-4b5b-b5e6-72678383b378 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1268 microversion: 2.1 time: 0.152084 Nov 27 21:28:20.294066 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3708/7549] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:20 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:21.310386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:21.311087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:21.317715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:21.318165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:21.318935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:21.319413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:21.456339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:21.463773 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8400820c-cd18-4607-8085-ef37ed59eb27 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1457 microversion: 2.1 time: 0.157613 Nov 27 21:28:21.464330 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3842/7550] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:21 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:21.481823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:28:21.482495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:28:21.489375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:21.489839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:21.490640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:21.491094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:21.621574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:28:21.628990 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20ea6cce-214e-4c2d-8f19-77e3c8887baf tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1457 microversion: 2.1 time: 0.151526 Nov 27 21:28:21.629586 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3709/7551] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:28:21 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1457 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:28:23.608425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-707b148a-f719-4366-8d8e-51c28926ae37 req-d2cc1d83-7056-471b-83f8-3b077ab7dc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def76e60-9053-460c-86c1-87dd132dc625", "tag": "1a7ee37e-753a-462f-807c-cfcea192aed7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:28:23.609984 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:28:23.609984 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:28:23.618922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-707b148a-f719-4366-8d8e-51c28926ae37 req-d2cc1d83-7056-471b-83f8-3b077ab7dc49 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:23.619409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-707b148a-f719-4366-8d8e-51c28926ae37 req-d2cc1d83-7056-471b-83f8-3b077ab7dc49 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:23.630955 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-707b148a-f719-4366-8d8e-51c28926ae37 req-d2cc1d83-7056-471b-83f8-3b077ab7dc49 service nova] Creating event network-changed:1a7ee37e-753a-462f-807c-cfcea192aed7 for instance def76e60-9053-460c-86c1-87dd132dc625 on nch2-master-1 Nov 27 21:28:23.636197 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-707b148a-f719-4366-8d8e-51c28926ae37 req-d2cc1d83-7056-471b-83f8-3b077ab7dc49 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032045 Nov 27 21:28:23.637008 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3843/7552] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:28:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:28:24.740863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-312a2efd-6632-4bad-ad32-be472aea80b8 req-186c317d-1a6c-490e-ab52-918047b093c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def76e60-9053-460c-86c1-87dd132dc625", "tag": "1a7ee37e-753a-462f-807c-cfcea192aed7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:28:24.742549 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:28:24.742549 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:28:24.751594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-312a2efd-6632-4bad-ad32-be472aea80b8 req-186c317d-1a6c-490e-ab52-918047b093c2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:24.752390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-312a2efd-6632-4bad-ad32-be472aea80b8 req-186c317d-1a6c-490e-ab52-918047b093c2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:24.767766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-312a2efd-6632-4bad-ad32-be472aea80b8 req-186c317d-1a6c-490e-ab52-918047b093c2 service nova] Creating event network-changed:1a7ee37e-753a-462f-807c-cfcea192aed7 for instance def76e60-9053-460c-86c1-87dd132dc625 on nch2-master-1 Nov 27 21:28:24.772978 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-312a2efd-6632-4bad-ad32-be472aea80b8 req-186c317d-1a6c-490e-ab52-918047b093c2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036075 Nov 27 21:28:24.774233 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3710/7553] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:28:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:28:26.789224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3e973b5b-ed53-4cee-b251-b7e02c76b339 req-92e1bb5d-84ef-47ef-a6c3-3f7dde83e882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def76e60-9053-460c-86c1-87dd132dc625", "tag": "1a7ee37e-753a-462f-807c-cfcea192aed7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:28:26.790696 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:28:26.790696 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:28:26.798545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3e973b5b-ed53-4cee-b251-b7e02c76b339 req-92e1bb5d-84ef-47ef-a6c3-3f7dde83e882 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:28:26.798989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3e973b5b-ed53-4cee-b251-b7e02c76b339 req-92e1bb5d-84ef-47ef-a6c3-3f7dde83e882 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:28:26.809403 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3e973b5b-ed53-4cee-b251-b7e02c76b339 req-92e1bb5d-84ef-47ef-a6c3-3f7dde83e882 service nova] Creating event network-changed:1a7ee37e-753a-462f-807c-cfcea192aed7 for instance def76e60-9053-460c-86c1-87dd132dc625 on nch2-master-1 Nov 27 21:28:26.815232 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3e973b5b-ed53-4cee-b251-b7e02c76b339 req-92e1bb5d-84ef-47ef-a6c3-3f7dde83e882 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029534 Nov 27 21:28:26.817191 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3844/7554] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:28:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:29:06.086992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:06.087782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:06.088289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-43a7ecb5-1487-4f2a-9224-82f6a827e8c3 req-2fa630fc-8752-4054-af9a-24649308b4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def76e60-9053-460c-86c1-87dd132dc625", "tag": "1a7ee37e-753a-462f-807c-cfcea192aed7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:29:06.090533 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:29:06.090533 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:29:06.095453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:06.096005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:06.097142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:06.097838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:06.112299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-43a7ecb5-1487-4f2a-9224-82f6a827e8c3 req-2fa630fc-8752-4054-af9a-24649308b4b9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:06.112733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-43a7ecb5-1487-4f2a-9224-82f6a827e8c3 req-2fa630fc-8752-4054-af9a-24649308b4b9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:06.125793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:29:06.133860 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-43a7ecb5-1487-4f2a-9224-82f6a827e8c3 req-2fa630fc-8752-4054-af9a-24649308b4b9 service nova] Creating event network-changed:1a7ee37e-753a-462f-807c-cfcea192aed7 for instance def76e60-9053-460c-86c1-87dd132dc625 on nch2-master-1 Nov 27 21:29:06.140613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-43a7ecb5-1487-4f2a-9224-82f6a827e8c3 req-2fa630fc-8752-4054-af9a-24649308b4b9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056603 Nov 27 21:29:06.141246 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3845/7555] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:29:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:29:06.233411 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7395df6c-78ea-43fd-9e8d-976c1330284c tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "DELETE /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 204 len: 0 microversion: 2.1 time: 0.152648 Nov 27 21:29:06.237353 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3711/7556] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:29:06 2021] DELETE /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:29:06.244936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:06.245991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:06.253316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:06.254045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:06.254960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:06.255458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:06.417343 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:06.434585 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-048d73a6-734a-422d-a2ee-86764c31fd77 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1582 microversion: 2.1 time: 0.194878 Nov 27 21:29:06.435959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3846/7557] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:06 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1582 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:07.454203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:07.455049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:07.462255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:07.462731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:07.463564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:07.464216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:07.605143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:07.612908 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d4ed0efc-2b9c-4501-92da-fcea22051e32 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1463 microversion: 2.1 time: 0.163386 Nov 27 21:29:07.613518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3712/7558] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:07 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:08.467518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-dac00f5f-097e-4a85-9ce2-bd487705d5fe req-d2576604-b295-421f-9937-ae263ce2bb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def76e60-9053-460c-86c1-87dd132dc625", "name": "network-vif-deleted", "tag": "1a7ee37e-753a-462f-807c-cfcea192aed7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:29:08.469048 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:29:08.469048 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:29:08.477023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dac00f5f-097e-4a85-9ce2-bd487705d5fe req-d2576604-b295-421f-9937-ae263ce2bb2e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:08.477464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-dac00f5f-097e-4a85-9ce2-bd487705d5fe req-d2576604-b295-421f-9937-ae263ce2bb2e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:08.488843 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-dac00f5f-097e-4a85-9ce2-bd487705d5fe req-d2576604-b295-421f-9937-ae263ce2bb2e service nova] Creating event network-vif-deleted:1a7ee37e-753a-462f-807c-cfcea192aed7 for instance def76e60-9053-460c-86c1-87dd132dc625 on nch2-master-1 Nov 27 21:29:08.493405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-dac00f5f-097e-4a85-9ce2-bd487705d5fe req-d2576604-b295-421f-9937-ae263ce2bb2e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Nov 27 21:29:08.494021 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3847/7559] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:29:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:29:08.630970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:08.631786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:08.639765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:08.640378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:08.641187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:08.641662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:08.672527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:08.672998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:08.673468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lazy-loading 'fault' on Instance uuid def76e60-9053-460c-86c1-87dd132dc625 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:29:08.716526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011c76eca940449f865a90106ed59c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34545818a5a9484a943ab6e09bdd800a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:08.724059 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ffc620d-b457-4d25-a46c-a6bd1f4cfab8 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 200 len: 1234 microversion: 2.1 time: 0.096869 Nov 27 21:29:08.724626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3713/7560] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:08 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 1234 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:09.741839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:09.742528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] [instance: def76e60-9053-460c-86c1-87dd132dc625] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:09.749760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:09.750200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:09.750971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:09.751435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:09.766499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] HTTP exception thrown: Instance def76e60-9053-460c-86c1-87dd132dc625 could not be found. Nov 27 21:29:09.767069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Returning 404 to user: Instance def76e60-9053-460c-86c1-87dd132dc625 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:29:09.767919 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fdf6e04b-0200-4cc7-a735-8c0f51589e18 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625" status: 404 len: 111 microversion: 2.1 time: 0.030077 Nov 27 21:29:09.768434 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3848/7561] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:09 2021] GET /compute/v2.1/servers/def76e60-9053-460c-86c1-87dd132dc625 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:29:09.925955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46e9a8a2-8cd0-4568-bf43-b0d8fe2fde73 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] Calling method '.version_select at 0x7f15d9459d30>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:09.945365 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46e9a8a2-8cd0-4568-bf43-b0d8fe2fde73 tempest-TestVolumeBackupRestore-900720088 tempest-TestVolumeBackupRestore-900720088-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1933348899" status: 202 len: 0 microversion: 2.1 time: 0.023046 Nov 27 21:29:09.945951 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3714/7562] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:29:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1933348899 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:29:11.449929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:11.450446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:11.457949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:11.458395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:11.459166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:11.459626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:11.483731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:29:11.554267 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fe31d12e-e618-4aac-a4aa-6bcce72d3472 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 204 len: 0 microversion: 2.1 time: 0.107981 Nov 27 21:29:11.554944 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3849/7563] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:29:11 2021] DELETE /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:29:11.563683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:11.564496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:11.572175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:11.572647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:11.573454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:11.573914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:11.710461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:11.718107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-330983cc-7829-41fb-a235-c5715fdcef05 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1577 microversion: 2.1 time: 0.159052 Nov 27 21:29:11.718683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3715/7564] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:11 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:12.735831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:12.736516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:12.743511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:12.743957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:12.744978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:12.745409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:12.887800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:12.895890 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88906c4e-23bc-4130-a638-41cf38b666fe tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1577 microversion: 2.1 time: 0.164209 Nov 27 21:29:12.896455 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3850/7565] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:12 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:13.915845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:13.916546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:13.924654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:13.925132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:13.925929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:13.926376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:14.246007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:14.253869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ac8712a-bcb2-4ec4-8793-87c166fc8524 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1577 microversion: 2.1 time: 0.342012 Nov 27 21:29:14.263412 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3716/7566] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:13 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1577 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:14.694678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-bb4a23f6-2c67-4675-99ea-d7e1f7793ea2 req-7b513b8b-f146-486f-8f17-03c77fd803da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a998ba79-79c4-4e94-8cbb-7fabdce46b60", "name": "network-vif-deleted", "tag": "eb002a01-708d-4e8b-b1d2-931d75476f38"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:29:14.696642 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:29:14.696642 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:29:14.705734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bb4a23f6-2c67-4675-99ea-d7e1f7793ea2 req-7b513b8b-f146-486f-8f17-03c77fd803da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:14.706182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bb4a23f6-2c67-4675-99ea-d7e1f7793ea2 req-7b513b8b-f146-486f-8f17-03c77fd803da service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:14.728474 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-bb4a23f6-2c67-4675-99ea-d7e1f7793ea2 req-7b513b8b-f146-486f-8f17-03c77fd803da service nova] Creating event network-vif-deleted:eb002a01-708d-4e8b-b1d2-931d75476f38 for instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 on nch1-master-1 Nov 27 21:29:14.737940 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-bb4a23f6-2c67-4675-99ea-d7e1f7793ea2 req-7b513b8b-f146-486f-8f17-03c77fd803da service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046796 Nov 27 21:29:14.738554 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3851/7567] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:29:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:29:15.271460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:15.272859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:15.289016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:15.290446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:15.291816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:15.292519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:15.333313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:15.333982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:15.335186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lazy-loading 'fault' on Instance uuid a998ba79-79c4-4e94-8cbb-7fabdce46b60 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:29:15.432209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:15.442875 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43b2bfed-c944-411b-a336-570727bd113b tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 200 len: 1184 microversion: 2.1 time: 0.174979 Nov 27 21:29:15.451305 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3717/7568] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:15 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 1184 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:16.462184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:16.462871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:16.468936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:16.469378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:16.470152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:16.470585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:16.485596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 could not be found. Nov 27 21:29:16.486187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:29:16.487008 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81291c0b-8da1-4c99-83ac-379c1879aae1 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 404 len: 111 microversion: 2.1 time: 0.029684 Nov 27 21:29:16.487844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3852/7569] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:16 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:29:16.588927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-592604893", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930131691", "security_groups": [{"name": "tempest-secgroup-smoke-1671575428"}], "block_device_mapping_v2": [{"uuid": "03079e0b-c8b5-4a98-beae-24c4370e0212", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5d1d65de-2cf6-426d-bf1f-f8a8267152d2"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:29:16.725146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] validate_networks() for [('5d1d65de-2cf6-426d-bf1f-f8a8267152d2', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:29:17.328826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:29:17.329597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:29:17.330545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:29:17.330982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:29:17.331455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:29:17.341165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:17.341637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:17.342483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:17.342946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:17.361617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:29:17.368261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:29:17.433265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:29:17.435241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03079e0b-c8b5-4a98-beae-24c4370e0212',volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:29:17.577188 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cdc9776c-61ba-43c2-a969-e92f0e3e6c1c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.992349 Nov 27 21:29:17.577899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3718/7570] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:29:16 2021] POST /compute/v2.1/servers => generated 406 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:29:17.587968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da62f6e1-da25-4650-bc7a-995f0a60b1df tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:17.589705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da62f6e1-da25-4650-bc7a-995f0a60b1df tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:17.646819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da62f6e1-da25-4650-bc7a-995f0a60b1df tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:17.654584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da62f6e1-da25-4650-bc7a-995f0a60b1df tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1094 microversion: 2.1 time: 0.070213 Nov 27 21:29:17.655228 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3853/7571] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:17 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:18.673858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:18.675099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:18.682491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:18.683170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:18.684184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:18.684835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:18.788394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:18.796055 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db440d55-2632-455f-8400-ddfc628b5240 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1210 microversion: 2.1 time: 0.127652 Nov 27 21:29:18.806511 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3719/7572] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:18 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:19.813432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:19.814201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:19.820986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:19.821313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:19.822327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:19.822933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:20.125835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:20.135494 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-375b8421-a695-4d24-acdd-8e07894b8eb3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.326153 Nov 27 21:29:20.148393 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3854/7573] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:19 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:20.408148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-51f890d0-4b80-4042-b9b2-993c15528496 req-4934692f-9d85-4976-887f-2f0070ef9eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f703a2d-950d-4229-88ec-f7c7b5b30c53", "tag": "7fe4f942-a726-477b-ad52-6eb091e3cd6c"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:29:20.412819 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:29:20.412819 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:29:20.439917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-51f890d0-4b80-4042-b9b2-993c15528496 req-4934692f-9d85-4976-887f-2f0070ef9eee service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:20.440390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-51f890d0-4b80-4042-b9b2-993c15528496 req-4934692f-9d85-4976-887f-2f0070ef9eee service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:20.454394 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-51f890d0-4b80-4042-b9b2-993c15528496 req-4934692f-9d85-4976-887f-2f0070ef9eee service nova] Creating event network-changed:7fe4f942-a726-477b-ad52-6eb091e3cd6c for instance 3f703a2d-950d-4229-88ec-f7c7b5b30c53 on nch2-master-1 Nov 27 21:29:20.464504 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-51f890d0-4b80-4042-b9b2-993c15528496 req-4934692f-9d85-4976-887f-2f0070ef9eee service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065203 Nov 27 21:29:20.465919 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3720/7574] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:29:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:29:21.159197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:21.160554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:21.170123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:21.170668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:21.172155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:21.172593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:21.310489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:21.318787 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b80ceef0-9830-457c-a4a2-134fa9e3b50a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.164919 Nov 27 21:29:21.319386 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3855/7575] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:21 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:22.337544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:22.338249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:22.344845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:22.345308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:22.346106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:22.346554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:22.498098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:22.506037 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-35a9de6b-0a35-48ee-a16a-2e3e6ed4685e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.173257 Nov 27 21:29:22.506644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3721/7576] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:22 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:23.523987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:23.524580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:23.531175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:23.531653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:23.532421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:23.532856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:23.910540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:23.918087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e72c6f2-7162-4105-a17c-8e2a335f9c03 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.397736 Nov 27 21:29:23.918638 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3856/7577] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:23 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:24.935427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:24.936050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:24.943280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:24.943763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:24.944548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:24.944998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:25.075116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:25.083426 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d89b66ae-8dba-464d-847e-751c0c228f57 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.151762 Nov 27 21:29:25.083994 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3722/7578] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:24 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:26.100092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:26.100685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:26.107389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:26.107845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:26.108645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:26.109147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:26.236250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:26.243584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-513bc6fa-4cc6-4213-8a17-2f14dd1f6be4 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.147075 Nov 27 21:29:26.244135 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3857/7579] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:26 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:27.260631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:27.261241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:27.267794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:27.268264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:27.269066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:27.269521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:27.402147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:27.410039 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-901a7d66-a9ae-4530-8d83-4ea0519ad796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.153129 Nov 27 21:29:27.410791 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3723/7580] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:27 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:27.534109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3b13aebc-cce1-4526-aa5d-62b02dd1c598 req-4eba75d0-bf73-4a0b-a2d6-d689a62f2c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f703a2d-950d-4229-88ec-f7c7b5b30c53", "name": "network-vif-plugged", "status": "completed", "tag": "7fe4f942-a726-477b-ad52-6eb091e3cd6c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:29:27.535648 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:29:27.535648 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:29:27.544360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3b13aebc-cce1-4526-aa5d-62b02dd1c598 req-4eba75d0-bf73-4a0b-a2d6-d689a62f2c59 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:27.545628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3b13aebc-cce1-4526-aa5d-62b02dd1c598 req-4eba75d0-bf73-4a0b-a2d6-d689a62f2c59 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:27.556782 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3b13aebc-cce1-4526-aa5d-62b02dd1c598 req-4eba75d0-bf73-4a0b-a2d6-d689a62f2c59 service nova] Creating event network-vif-plugged:7fe4f942-a726-477b-ad52-6eb091e3cd6c for instance 3f703a2d-950d-4229-88ec-f7c7b5b30c53 on nch2-master-1 Nov 27 21:29:27.561682 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3b13aebc-cce1-4526-aa5d-62b02dd1c598 req-4eba75d0-bf73-4a0b-a2d6-d689a62f2c59 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032214 Nov 27 21:29:27.562337 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3858/7581] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:29:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:29:28.426843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:28.427488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:28.434440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:28.434873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:28.435681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:28.436129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:28.568495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:28.575919 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9035c7d-f8a6-4e8f-b093-e08e93b24709 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1266 microversion: 2.1 time: 0.152780 Nov 27 21:29:28.576491 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3724/7582] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:28 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:29:29.593146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:29.593812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:29.600667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:29.601113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:29.601878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:29.602313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:29.735706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:29.743070 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-67b04204-52eb-4071-9622-d83edfe9b34e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1453 microversion: 2.1 time: 0.154037 Nov 27 21:29:29.743647 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3859/7583] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:29 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:29.760304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:29:29.760934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:29:29.767653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:29.768124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:29.768917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:29.769371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:29.903120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:29:29.910586 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99a3b069-d3dc-433d-8645-ac83397dc2dc tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1453 microversion: 2.1 time: 0.153977 Nov 27 21:29:29.911158 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3725/7584] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:29:29 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:29:31.816493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-acd89be5-09b8-4cfa-8052-3dfa301f7332 req-5b275447-4c0c-4aaa-b93d-a9f3ef8f24ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f703a2d-950d-4229-88ec-f7c7b5b30c53", "tag": "7fe4f942-a726-477b-ad52-6eb091e3cd6c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:29:31.818039 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:29:31.818039 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:29:31.824952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-acd89be5-09b8-4cfa-8052-3dfa301f7332 req-5b275447-4c0c-4aaa-b93d-a9f3ef8f24ed service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:29:31.825501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-acd89be5-09b8-4cfa-8052-3dfa301f7332 req-5b275447-4c0c-4aaa-b93d-a9f3ef8f24ed service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:29:31.836764 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-acd89be5-09b8-4cfa-8052-3dfa301f7332 req-5b275447-4c0c-4aaa-b93d-a9f3ef8f24ed service nova] Creating event network-changed:7fe4f942-a726-477b-ad52-6eb091e3cd6c for instance 3f703a2d-950d-4229-88ec-f7c7b5b30c53 on nch2-master-1 Nov 27 21:29:31.842100 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-acd89be5-09b8-4cfa-8052-3dfa301f7332 req-5b275447-4c0c-4aaa-b93d-a9f3ef8f24ed service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033100 Nov 27 21:29:31.842692 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3860/7585] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:29:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:31:14.258247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1633788539", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930131691", "security_groups": [{"name": "tempest-secgroup-smoke-1671575428"}], "block_device_mapping_v2": [{"uuid": "1416292a-dba9-4a66-85b6-f0929de78ebf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5d1d65de-2cf6-426d-bf1f-f8a8267152d2"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:31:14.666375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] validate_networks() for [('5d1d65de-2cf6-426d-bf1f-f8a8267152d2', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:31:15.148302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:31:15.148767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:31:15.151463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:31:15.151463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:31:15.151463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:31:15.160300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:15.160792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:15.161624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:15.162076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:15.178986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:31:15.184057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Getting quotas for user 22d0ea2ed19044fa8d47565b0eb443d6 and project 75d471b7fbc14bbcbf3dbb7f1acbddcb. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:31:15.239691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:31:15.241850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1416292a-dba9-4a66-85b6-f0929de78ebf',volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:31:15.362137 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e2ff465-803c-44cc-914d-d2552f38fe77 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.108645 Nov 27 21:31:15.363531 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3726/7586] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:31:14 2021] POST /compute/v2.1/servers => generated 406 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:31:15.377233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2d64f365-6d3b-438a-a1bb-89ae7ce8cf89 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:15.378921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2d64f365-6d3b-438a-a1bb-89ae7ce8cf89 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:15.502132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2d64f365-6d3b-438a-a1bb-89ae7ce8cf89 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:15.509316 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2d64f365-6d3b-438a-a1bb-89ae7ce8cf89 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1095 microversion: 2.1 time: 0.139404 Nov 27 21:31:15.509872 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3861/7587] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:15 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1095 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:16.527138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:16.527709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:16.534029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:16.534616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:16.536240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:16.536697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:16.601082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:16.609452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55abb3c7-5495-4124-a558-86b6b657bdfd tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1211 microversion: 2.1 time: 0.087380 Nov 27 21:31:16.610287 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3727/7588] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:16 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:17.628899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:17.629518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:17.641585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:17.642047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:17.642862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:17.643337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:17.719293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2c365dc6-4613-4d26-82ce-f7c3cf42d983 req-47dc401b-dacf-4a6a-a8ac-4269a51f3f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fd0cf1-7723-40a0-8dc2-6bfb13663465", "tag": "2d5475af-4797-4a55-8682-9a7176af9fb7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:31:17.721174 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:31:17.721174 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:31:17.736526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2c365dc6-4613-4d26-82ce-f7c3cf42d983 req-47dc401b-dacf-4a6a-a8ac-4269a51f3f77 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:17.739455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2c365dc6-4613-4d26-82ce-f7c3cf42d983 req-47dc401b-dacf-4a6a-a8ac-4269a51f3f77 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:17.767891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2c365dc6-4613-4d26-82ce-f7c3cf42d983 req-47dc401b-dacf-4a6a-a8ac-4269a51f3f77 service nova] Creating event network-changed:2d5475af-4797-4a55-8682-9a7176af9fb7 for instance b8fd0cf1-7723-40a0-8dc2-6bfb13663465 on nch1-master-1 Nov 27 21:31:17.773764 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2c365dc6-4613-4d26-82ce-f7c3cf42d983 req-47dc401b-dacf-4a6a-a8ac-4269a51f3f77 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059762 Nov 27 21:31:17.775441 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3728/7589] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:31:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:31:17.822335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:17.830658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-44554ce6-f8b8-4ce0-b4c8-344c4658b77f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1267 microversion: 2.1 time: 0.205835 Nov 27 21:31:17.831542 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3862/7590] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:17 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:18.849751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:18.850371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:18.857105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:18.857575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:18.858374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:18.858835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:18.993237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:19.001107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f916f70-facd-43ef-911b-1344b3c5931a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1267 microversion: 2.1 time: 0.156389 Nov 27 21:31:19.001684 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3729/7591] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:18 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:20.017923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:20.018527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:20.025200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:20.025648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:20.026417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:20.026966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:20.163408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:20.171324 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-012f4021-93bb-45ba-ad36-28886ad1cdd3 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1267 microversion: 2.1 time: 0.157076 Nov 27 21:31:20.171914 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3863/7592] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:20 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:21.187833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:21.188458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:21.195173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:21.195666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:21.197108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:21.197562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:21.643987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:21.651468 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b04fcb1-8779-4ea6-8f21-e2079f693d87 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1267 microversion: 2.1 time: 0.467310 Nov 27 21:31:21.652052 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3730/7593] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:21 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1267 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:22.668213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:22.668916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:22.675468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:22.675922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:22.676706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:22.677145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:22.811317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:22.818832 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f252ea40-a152-4cd0-aaee-59866420f24d tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1267 microversion: 2.1 time: 0.154269 Nov 27 21:31:22.819509 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3864/7594] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:22 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:23.836477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:23.837714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:23.844610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:23.845083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:23.845888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:23.846345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:23.976225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:23.983515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9a6a883-bc1f-455c-ab42-27e99b062aeb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1267 microversion: 2.1 time: 0.150780 Nov 27 21:31:23.984083 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3731/7595] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:23 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:24.708039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fd1a42b6-4d60-4e32-b7b2-9f6c6a190a52 req-6ccbd55e-3ad3-4959-b19a-2acbbb830369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fd0cf1-7723-40a0-8dc2-6bfb13663465", "name": "network-vif-plugged", "status": "completed", "tag": "2d5475af-4797-4a55-8682-9a7176af9fb7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:31:24.709569 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:31:24.709569 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:31:24.717552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fd1a42b6-4d60-4e32-b7b2-9f6c6a190a52 req-6ccbd55e-3ad3-4959-b19a-2acbbb830369 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:24.718043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fd1a42b6-4d60-4e32-b7b2-9f6c6a190a52 req-6ccbd55e-3ad3-4959-b19a-2acbbb830369 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:24.729891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fd1a42b6-4d60-4e32-b7b2-9f6c6a190a52 req-6ccbd55e-3ad3-4959-b19a-2acbbb830369 service nova] Creating event network-vif-plugged:2d5475af-4797-4a55-8682-9a7176af9fb7 for instance b8fd0cf1-7723-40a0-8dc2-6bfb13663465 on nch1-master-1 Nov 27 21:31:24.735009 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fd1a42b6-4d60-4e32-b7b2-9f6c6a190a52 req-6ccbd55e-3ad3-4959-b19a-2acbbb830369 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030744 Nov 27 21:31:24.735630 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3865/7596] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:31:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:31:24.999866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:25.000429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:25.007110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:25.007604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:25.008416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:25.008853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:25.141260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:25.148544 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e3dbd9b-5dda-474a-8c37-7aaa619bc370 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1267 microversion: 2.1 time: 0.152720 Nov 27 21:31:25.149699 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3732/7597] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:24 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:26.167409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:26.168110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:26.174185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:26.174638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:26.175446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:26.175906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:26.304311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:26.312212 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-36761ac2-8e92-447e-8d14-2af19f0ca63e tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1454 microversion: 2.1 time: 0.150244 Nov 27 21:31:26.312777 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3866/7598] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:26 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:26.329910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:31:26.330535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:31:26.336903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:26.337368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:26.338156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:26.338608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:26.468448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:31:26.483235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c3c28fe5-a029-4966-95b4-f8f8fe0bc0b5 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1454 microversion: 2.1 time: 0.157121 Nov 27 21:31:26.483843 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3733/7599] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:31:26 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:31:28.077197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-47657e99-6922-4097-9ee0-9bc3fd8a87ee req-89562087-3a23-463a-91a2-2e9b8cdf3b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fd0cf1-7723-40a0-8dc2-6bfb13663465", "tag": "2d5475af-4797-4a55-8682-9a7176af9fb7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:31:28.078799 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:31:28.078799 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:31:28.087058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-47657e99-6922-4097-9ee0-9bc3fd8a87ee req-89562087-3a23-463a-91a2-2e9b8cdf3b29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:31:28.087863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-47657e99-6922-4097-9ee0-9bc3fd8a87ee req-89562087-3a23-463a-91a2-2e9b8cdf3b29 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:31:28.098708 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-47657e99-6922-4097-9ee0-9bc3fd8a87ee req-89562087-3a23-463a-91a2-2e9b8cdf3b29 service nova] Creating event network-changed:2d5475af-4797-4a55-8682-9a7176af9fb7 for instance b8fd0cf1-7723-40a0-8dc2-6bfb13663465 on nch1-master-1 Nov 27 21:31:28.104204 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-47657e99-6922-4097-9ee0-9bc3fd8a87ee req-89562087-3a23-463a-91a2-2e9b8cdf3b29 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031291 Nov 27 21:31:28.104782 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3867/7600] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:31:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:32:06.565032 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:32:06.565616 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:32:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:33:20.769524 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 21:33:20.770172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:20.770651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:20.777217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:20.777338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:20.778132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:20.778596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:20.804535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:33:20.846104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5e5c32c2-ad05-40a9-9f0e-5e2a527afbfd req-d890759b-ab32-4e9c-8998-5d692b30e463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fd0cf1-7723-40a0-8dc2-6bfb13663465", "tag": "2d5475af-4797-4a55-8682-9a7176af9fb7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:33:20.847863 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:33:20.847863 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:33:20.855741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5e5c32c2-ad05-40a9-9f0e-5e2a527afbfd req-d890759b-ab32-4e9c-8998-5d692b30e463 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:20.856191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5e5c32c2-ad05-40a9-9f0e-5e2a527afbfd req-d890759b-ab32-4e9c-8998-5d692b30e463 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:20.867370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5e5c32c2-ad05-40a9-9f0e-5e2a527afbfd req-d890759b-ab32-4e9c-8998-5d692b30e463 service nova] Creating event network-changed:2d5475af-4797-4a55-8682-9a7176af9fb7 for instance b8fd0cf1-7723-40a0-8dc2-6bfb13663465 on nch1-master-1 Nov 27 21:33:20.872697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5e5c32c2-ad05-40a9-9f0e-5e2a527afbfd req-d890759b-ab32-4e9c-8998-5d692b30e463 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105398 Nov 27 21:33:20.873286 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3868/7601] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:33:20.888975 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ffe2211-081c-4876-84a5-cf71604fd124 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 204 len: 0 microversion: 2.1 time: 0.124133 Nov 27 21:33:20.890778 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3734/7602] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:33:20 2021] DELETE /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:33:20.898977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:20.899876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:20.906330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:20.906790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:20.907623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:20.908067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:21.066199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:33:21.074684 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9c9c7cab-f38a-46fe-9ad8-b2e78011a72a tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1579 microversion: 2.1 time: 0.179943 Nov 27 21:33:21.075292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3869/7603] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:33:20 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:33:22.093291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:22.094014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:22.104189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:22.104665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:22.105479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:22.105941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:22.243549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:33:22.251193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1f7b3580-3b0b-4eb0-bd9d-6463de32624c tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1460 microversion: 2.1 time: 0.162208 Nov 27 21:33:22.251780 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3735/7604] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:33:22 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1460 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:33:23.178737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9a67cfd6-1c24-45c6-a3fc-36136a9a13ee req-f660df7c-2a8c-44e3-8043-df154d2e01fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fd0cf1-7723-40a0-8dc2-6bfb13663465", "name": "network-vif-deleted", "tag": "2d5475af-4797-4a55-8682-9a7176af9fb7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:33:23.180390 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:33:23.180390 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:33:23.200386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9a67cfd6-1c24-45c6-a3fc-36136a9a13ee req-f660df7c-2a8c-44e3-8043-df154d2e01fd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:23.200841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9a67cfd6-1c24-45c6-a3fc-36136a9a13ee req-f660df7c-2a8c-44e3-8043-df154d2e01fd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:23.212488 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 42266. Nov 27 21:33:23.214498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9a67cfd6-1c24-45c6-a3fc-36136a9a13ee req-f660df7c-2a8c-44e3-8043-df154d2e01fd service nova] Creating event network-vif-deleted:2d5475af-4797-4a55-8682-9a7176af9fb7 for instance b8fd0cf1-7723-40a0-8dc2-6bfb13663465 on nch1-master-1 Nov 27 21:33:23.219276 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9a67cfd6-1c24-45c6-a3fc-36136a9a13ee req-f660df7c-2a8c-44e3-8043-df154d2e01fd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044235 Nov 27 21:33:23.220190 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3870/7605] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:33:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:33:23.268437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:23.269647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:23.276441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:23.276910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:23.277708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:23.278163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:23.345261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:33:23.354287 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-791fdf03-4f11-4cce-8cf9-3c39e1286abb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 200 len: 1226 microversion: 2.1 time: 0.089467 Nov 27 21:33:23.354863 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3736/7606] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:33:23 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:33:24.372349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:24.373093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: b8fd0cf1-7723-40a0-8dc2-6bfb13663465] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:24.379519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:24.379966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:24.380740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:24.381172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:24.394544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance b8fd0cf1-7723-40a0-8dc2-6bfb13663465 could not be found. Nov 27 21:33:24.395119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance b8fd0cf1-7723-40a0-8dc2-6bfb13663465 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:33:24.395947 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8dab8cad-4dc4-4bad-a0d0-5f5a0d6f5f8f tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465" status: 404 len: 111 microversion: 2.1 time: 0.028463 Nov 27 21:33:24.396457 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3871/7607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:33:24 2021] GET /compute/v2.1/servers/b8fd0cf1-7723-40a0-8dc2-6bfb13663465 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:33:46.615137 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:33:46.615846 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:33:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:33:49.576659 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:33:49.577223 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:33:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:33:57.192703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:57.193367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:57.195134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-821c4fc2-fbd5-4d5e-9b0f-25af705628be req-74008295-8262-4f76-8f07-543d79f397e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f703a2d-950d-4229-88ec-f7c7b5b30c53", "tag": "7fe4f942-a726-477b-ad52-6eb091e3cd6c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:33:57.196891 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:33:57.196891 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:33:57.199768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:57.200495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:57.201443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:57.202120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:57.205480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-821c4fc2-fbd5-4d5e-9b0f-25af705628be req-74008295-8262-4f76-8f07-543d79f397e8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:57.205998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-821c4fc2-fbd5-4d5e-9b0f-25af705628be req-74008295-8262-4f76-8f07-543d79f397e8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:57.217801 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-821c4fc2-fbd5-4d5e-9b0f-25af705628be req-74008295-8262-4f76-8f07-543d79f397e8 service nova] Creating event network-changed:7fe4f942-a726-477b-ad52-6eb091e3cd6c for instance 3f703a2d-950d-4229-88ec-f7c7b5b30c53 on nch2-master-1 Nov 27 21:33:57.222968 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-821c4fc2-fbd5-4d5e-9b0f-25af705628be req-74008295-8262-4f76-8f07-543d79f397e8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031779 Nov 27 21:33:57.223663 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3872/7608] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:33:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:33:57.231031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:33:57.315369 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b0382c9b-bb62-427c-806e-d078f5c985de tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 204 len: 0 microversion: 2.1 time: 0.126534 Nov 27 21:33:57.320038 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3737/7609] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:33:57 2021] DELETE /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:33:57.328409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:57.329112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:57.335747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:57.336425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:57.337212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:57.337650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:57.484680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:33:57.492418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d075f13a-1130-4f6f-9744-4e60f31c73bb tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1578 microversion: 2.1 time: 0.167979 Nov 27 21:33:57.493247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3873/7610] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:33:57 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:33:58.510226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:58.510941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:58.517817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:58.518341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:58.519202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:58.519693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:58.663872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:33:58.671452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d782f50e-70d4-4d36-828f-6b8153c630b6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1459 microversion: 2.1 time: 0.165268 Nov 27 21:33:58.672061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3738/7611] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:33:58 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1459 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:33:59.420368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-63269880-017b-4aa9-8e96-74dacb5bb6fa req-adfd6bff-1828-4b5f-af86-766ed734ab33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f703a2d-950d-4229-88ec-f7c7b5b30c53", "name": "network-vif-deleted", "tag": "7fe4f942-a726-477b-ad52-6eb091e3cd6c"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:33:59.422821 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:33:59.422821 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:33:59.432785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-63269880-017b-4aa9-8e96-74dacb5bb6fa req-adfd6bff-1828-4b5f-af86-766ed734ab33 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:59.433242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-63269880-017b-4aa9-8e96-74dacb5bb6fa req-adfd6bff-1828-4b5f-af86-766ed734ab33 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:59.448424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-63269880-017b-4aa9-8e96-74dacb5bb6fa req-adfd6bff-1828-4b5f-af86-766ed734ab33 service nova] Creating event network-vif-deleted:7fe4f942-a726-477b-ad52-6eb091e3cd6c for instance 3f703a2d-950d-4229-88ec-f7c7b5b30c53 on nch2-master-1 Nov 27 21:33:59.453398 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-63269880-017b-4aa9-8e96-74dacb5bb6fa req-adfd6bff-1828-4b5f-af86-766ed734ab33 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036801 Nov 27 21:33:59.454083 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3874/7612] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:33:59.689094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:33:59.689716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:33:59.697330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:59.697795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:59.698589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:59.699042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:59.729900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:33:59.730362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:33:59.730826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lazy-loading 'fault' on Instance uuid 3f703a2d-950d-4229-88ec-f7c7b5b30c53 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:33:59.776013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d0ea2ed19044fa8d47565b0eb443d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:33:59.785731 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1d8f7857-dff4-4fea-9520-4c5d78b237d6 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 200 len: 1230 microversion: 2.1 time: 0.100313 Nov 27 21:33:59.786517 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3739/7613] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:33:59 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:00.803345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:00.804037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: 3f703a2d-950d-4229-88ec-f7c7b5b30c53] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:00.810830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:00.811304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:00.812080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:00.812516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:00.825700 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance 3f703a2d-950d-4229-88ec-f7c7b5b30c53 could not be found. Nov 27 21:34:00.826276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance 3f703a2d-950d-4229-88ec-f7c7b5b30c53 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:34:00.827069 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed34b8cd-46fb-4870-9434-92dea8fe86ac tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53" status: 404 len: 111 microversion: 2.1 time: 0.027799 Nov 27 21:34:00.827601 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3875/7614] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:00 2021] GET /compute/v2.1/servers/3f703a2d-950d-4229-88ec-f7c7b5b30c53 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:34:01.284238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:01.284799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:01.291667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:01.292131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:01.293032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:01.293595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:01.307563 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 could not be found. Nov 27 21:34:01.308161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:34:01.309115 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21c0b83d-7d4c-4280-a8e4-684821539f81 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 404 len: 111 microversion: 2.1 time: 0.028636 Nov 27 21:34:01.309741 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3740/7615] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:34:01 2021] DELETE /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:34:01.317849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:01.318578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [instance: a998ba79-79c4-4e94-8cbb-7fabdce46b60] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:01.325447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:01.325895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:01.326676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:01.327110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:01.340590 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] HTTP exception thrown: Instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 could not be found. Nov 27 21:34:01.341166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Returning 404 to user: Instance a998ba79-79c4-4e94-8cbb-7fabdce46b60 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:34:01.341981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85322675-2293-44fa-8247-9608f9ababc2 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60" status: 404 len: 111 microversion: 2.1 time: 0.027757 Nov 27 21:34:01.342502 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3876/7616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:01 2021] GET /compute/v2.1/servers/a998ba79-79c4-4e94-8cbb-7fabdce46b60 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:34:03.666645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2209e855-a5d0-4173-aaf4-ab8fc2a91796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] Calling method '.version_select at 0x7f15d93429d0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:03.670377 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2209e855-a5d0-4173-aaf4-ab8fc2a91796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [14fe4436-aa96-4a19-b938-ee833bc206f9] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 21:34:04.691329 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [None req-2209e855-a5d0-4173-aaf4-ab8fc2a91796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] [14fe4436-aa96-4a19-b938-ee833bc206f9] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 42474. Nov 27 21:34:04.711195 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2209e855-a5d0-4173-aaf4-ab8fc2a91796 tempest-TestVolumeBootPattern-1822676883 tempest-TestVolumeBootPattern-1822676883-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1930131691" status: 202 len: 0 microversion: 2.1 time: 1.048713 Nov 27 21:34:04.711804 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3741/7617] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 21:34:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1930131691 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:34:22.985118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1014130636", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:23.035649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] validate_networks() for None {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:34:23.305403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:34:23.305823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:34:23.306290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:34:23.306728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:34:23.307165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:34:23.315887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:23.316367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:23.317176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:23.317608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:23.334052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Getting quotas for project 7ae3208eb9084263841957ed1fabbfe6. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:34:23.339623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Getting quotas for user 2f82c3c3f75d4c0189c3b3dcd56b16cd and project 7ae3208eb9084263841957ed1fabbfe6. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:34:23.351241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:34:23.353533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:34:23.396320 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d026d017-2073-4a78-a520-04e4d9883004 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522586 Nov 27 21:34:23.396955 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3877/7618] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:34:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:34:23.408476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b506e133-f292-4a31-84a1-76d502c007f7 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:23.409097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b506e133-f292-4a31-84a1-76d502c007f7 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:23.460547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b506e133-f292-4a31-84a1-76d502c007f7 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:23.467938 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b506e133-f292-4a31-84a1-76d502c007f7 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1222 microversion: 2.1 time: 0.064106 Nov 27 21:34:23.468542 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3742/7619] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:23 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:24.486072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:24.487359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:24.495427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:24.496186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:24.497200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:24.497867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:24.559374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:24.566823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a99031b8-effa-4d96-8800-7ed4dcac078d tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1292 microversion: 2.1 time: 0.085720 Nov 27 21:34:24.567504 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3878/7620] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:24 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:25.583919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:25.584638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:25.592569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:25.593045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:25.593887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:25.594772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:25.860353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:25.867990 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-14737138-6fb0-45d4-9aeb-43d0dbf4cf39 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1322 microversion: 2.1 time: 0.287905 Nov 27 21:34:25.868573 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3743/7621] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:25 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:26.196080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-c8a735b3-7650-40d0-a21c-e8139c9f55fd req-898a46f4-646b-4fd4-ab6f-d2da7a9e3dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a3906b-6073-4a39-96bd-5e28a9ec0b98", "tag": "27a69e90-c26c-48c2-9887-e073caf61517"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:26.198056 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:26.198056 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:34:26.214954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c8a735b3-7650-40d0-a21c-e8139c9f55fd req-898a46f4-646b-4fd4-ab6f-d2da7a9e3dc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:26.215569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c8a735b3-7650-40d0-a21c-e8139c9f55fd req-898a46f4-646b-4fd4-ab6f-d2da7a9e3dc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:26.229366 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-c8a735b3-7650-40d0-a21c-e8139c9f55fd req-898a46f4-646b-4fd4-ab6f-d2da7a9e3dc7 service nova] Creating event network-changed:27a69e90-c26c-48c2-9887-e073caf61517 for instance 00a3906b-6073-4a39-96bd-5e28a9ec0b98 on nch2-master-1 Nov 27 21:34:26.234501 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-c8a735b3-7650-40d0-a21c-e8139c9f55fd req-898a46f4-646b-4fd4-ab6f-d2da7a9e3dc7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042161 Nov 27 21:34:26.235195 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3879/7622] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:34:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:26.885655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:26.886591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:26.893322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:26.893822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:26.894626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:26.895086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:27.100770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:27.108152 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa8e76eb-bb37-43e9-9ebd-45f8c738a0e4 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1322 microversion: 2.1 time: 0.226794 Nov 27 21:34:27.108735 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3744/7623] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:26 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:28.124984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:28.125674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:28.132945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:28.133408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:28.134166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:28.134602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:28.265962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:28.273893 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-84906460-28b8-40ed-ad02-6de12cc4fc52 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1322 microversion: 2.1 time: 0.152853 Nov 27 21:34:28.274463 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3880/7624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:28 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:29.290266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:29.290910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:29.297931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:29.298409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:29.299225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:29.299712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:29.435905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:29.444697 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d3924d7e-1374-431d-a207-c6a984c091fd tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1322 microversion: 2.1 time: 0.158533 Nov 27 21:34:29.445736 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3745/7625] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:29 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:30.461497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:30.462104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:30.469071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:30.469527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:30.470312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:30.470754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:30.599178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:30.606462 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5667b7ac-24f0-4736-8204-fc2a961081e9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1322 microversion: 2.1 time: 0.148841 Nov 27 21:34:30.607021 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3881/7626] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:30 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:31.108788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-dff64ba7-f1d0-4f25-931d-eabc4fc1d93f req-fba1ba2f-13d6-4497-8e32-32dce4aa4a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a3906b-6073-4a39-96bd-5e28a9ec0b98", "name": "network-vif-plugged", "status": "completed", "tag": "27a69e90-c26c-48c2-9887-e073caf61517"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:31.110361 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:31.110361 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:34:31.117865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dff64ba7-f1d0-4f25-931d-eabc4fc1d93f req-fba1ba2f-13d6-4497-8e32-32dce4aa4a73 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:31.118382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dff64ba7-f1d0-4f25-931d-eabc4fc1d93f req-fba1ba2f-13d6-4497-8e32-32dce4aa4a73 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:31.129151 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-dff64ba7-f1d0-4f25-931d-eabc4fc1d93f req-fba1ba2f-13d6-4497-8e32-32dce4aa4a73 service nova] Creating event network-vif-plugged:27a69e90-c26c-48c2-9887-e073caf61517 for instance 00a3906b-6073-4a39-96bd-5e28a9ec0b98 on nch2-master-1 Nov 27 21:34:31.134857 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-dff64ba7-f1d0-4f25-931d-eabc4fc1d93f req-fba1ba2f-13d6-4497-8e32-32dce4aa4a73 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108724 Nov 27 21:34:31.135507 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3746/7627] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:34:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:31.623623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:31.624259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:31.631482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:31.631966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:31.632782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:31.633232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:31.764202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:31.771567 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a918971-786b-4e26-a38d-46ce8551d696 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1322 microversion: 2.1 time: 0.151610 Nov 27 21:34:31.772557 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3882/7628] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:31 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:34:32.790280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:32.791022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:32.797198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:32.797662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:32.798466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:32.798915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:32.934242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:32.941533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8fa5ad78-e91b-4ee0-9b51-84968b41667f tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1471 microversion: 2.1 time: 0.156107 Nov 27 21:34:32.942098 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3747/7629] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:32 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:33.009750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce34c0f8-4c2c-47d7-8262-061687cdf217 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Calling method '.version_select at 0x7f15c6db2280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.074663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce34c0f8-4c2c-47d7-8262-061687cdf217 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/5b6c9423d7454ff9b193a0254711d916" status: 200 len: 371 microversion: 2.1 time: 0.118908 Nov 27 21:34:33.075220 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3883/7630] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 21:34:32 2021] GET /compute/v2.1/os-quota-sets/5b6c9423d7454ff9b193a0254711d916 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:33.085347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-822801bf-555a-499f-9f9e-b1bb3de476fc tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-231771365", "id": 881053827, "os-flavor-access:is_public": "True"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:33.086949 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:33.086949 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:34:33.102392 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-822801bf-555a-499f-9f9e-b1bb3de476fc tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.020734 Nov 27 21:34:33.102953 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3748/7631] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:34:33 2021] POST /compute/v2.1/flavors => generated 434 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:33.113553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "881053827"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:33.114567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:33.121149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.121601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.122412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.122854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.301539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9a217cb37c5c4080bbbe98d4d866e430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6c9423d7454ff9b193a0254711d916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:33.308390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-231771365 {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:34:33.309444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.309887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.310698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.311133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.331097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Getting quotas for project 7ae3208eb9084263841957ed1fabbfe6. Resources: {'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:34:33.336425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Getting quotas for user 2f82c3c3f75d4c0189c3b3dcd56b16cd and project 7ae3208eb9084263841957ed1fabbfe6. Resources: {'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:34:33.347868 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.compute.api [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] ram quota exceeded for 5b6c9423d7454ff9b193a0254711d916, tried to resize instance. Nov 27 21:34:33.348400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 27 21:34:33.348994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:34:33.349821 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4156bf1-2fe7-46e1-b636-ccac94561d44 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98/action" status: 403 len: 118 microversion: 2.1 time: 0.240038 Nov 27 21:34:33.350379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3884/7632] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:34:33 2021] POST /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98/action => generated 118 bytes in 241 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:34:33.359363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20aad9c8-8ba0-4f74-8309-f2d8aaac5ff7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.360164 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:33.360164 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:34:33.376361 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20aad9c8-8ba0-4f74-8309-f2d8aaac5ff7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/881053827" status: 202 len: 0 microversion: 2.1 time: 0.020494 Nov 27 21:34:33.376905 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3749/7633] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 21:34:33 2021] DELETE /compute/v2.1/flavors/881053827 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:34:33.384612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-57230be2-88ce-4f24-ac29-424dbe6c729b tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.403030 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-57230be2-88ce-4f24-ac29-424dbe6c729b tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021945 Nov 27 21:34:33.403620 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3885/7634] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 21:34:33 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:33.420519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7910b44e-ea18-4bad-becf-904f5cbf7757 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Calling method '.version_select at 0x7f15c727e700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.490004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7910b44e-ea18-4bad-becf-904f5cbf7757 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "GET /compute/v2.1/os-quota-sets/5b6c9423d7454ff9b193a0254711d916" status: 200 len: 371 microversion: 2.1 time: 0.073129 Nov 27 21:34:33.490571 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3750/7635] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 21:34:33 2021] GET /compute/v2.1/os-quota-sets/5b6c9423d7454ff9b193a0254711d916 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:33.500588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00735930-80a4-412a-9e5b-fc48b526e01c tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1193476348", "id": 819791639, "os-flavor-access:is_public": "True"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:33.502418 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:33.502418 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:34:33.517623 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00735930-80a4-412a-9e5b-fc48b526e01c tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.020720 Nov 27 21:34:33.518185 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3886/7636] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:34:33 2021] POST /compute/v2.1/flavors => generated 434 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:33.528862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "819791639"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:33.529890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:33.536206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.536678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.537573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.538030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.620442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9a217cb37c5c4080bbbe98d4d866e430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b6c9423d7454ff9b193a0254711d916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:33.626690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1193476348 {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:34:33.627796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.628253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.629068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.629513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.649921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Getting quotas for project 7ae3208eb9084263841957ed1fabbfe6. Resources: {'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:34:33.654716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Getting quotas for user 2f82c3c3f75d4c0189c3b3dcd56b16cd and project 7ae3208eb9084263841957ed1fabbfe6. Resources: {'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:34:33.666928 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] cores quota exceeded for 5b6c9423d7454ff9b193a0254711d916, tried to resize instance. Nov 27 21:34:33.667507 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 27 21:34:33.668112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:34:33.668955 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98392570-5a53-4860-aff3-04b107b25ca7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "POST /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98/action" status: 403 len: 113 microversion: 2.1 time: 0.143903 Nov 27 21:34:33.669534 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3751/7637] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:34:33 2021] POST /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98/action => generated 113 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:34:33.677666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-646c1aea-f7ab-496e-be17-f06524197668 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.678424 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:33.678424 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:34:33.695957 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-646c1aea-f7ab-496e-be17-f06524197668 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "DELETE /compute/v2.1/flavors/819791639" status: 202 len: 0 microversion: 2.1 time: 0.021909 Nov 27 21:34:33.696779 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3887/7638] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 21:34:33 2021] DELETE /compute/v2.1/flavors/819791639 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:34:33.704487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b1cb749-0196-438b-bcf1-bbe13c5cd848 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.726120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b1cb749-0196-438b-bcf1-bbe13c5cd848 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025282 Nov 27 21:34:33.726669 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3752/7639] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 21:34:33 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:33.742870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.743390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:33.749250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.749725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.750493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.751183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.775979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:34:33.849931 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d47cc92a-cb8e-4ee3-b236-fcdbff3396c2 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "DELETE /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 204 len: 0 microversion: 2.1 time: 0.110403 Nov 27 21:34:33.850617 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3888/7640] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:34:33 2021] DELETE /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:34:33.858665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:33.859324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:33.866106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.866570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.867438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:33.867836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:33.998756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:34.006415 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de9b228d-7927-437b-adb3-926cfff5687a tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1477 microversion: 2.1 time: 0.151443 Nov 27 21:34:34.006984 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3753/7641] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:33 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:34:35.024961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:35.025771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:35.032667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:35.033164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:35.033991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:35.034439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:35.169438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f82c3c3f75d4c0189c3b3dcd56b16cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae3208eb9084263841957ed1fabbfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:35.176774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7725cec8-3592-43ab-82d8-a254be272132 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 200 len: 1477 microversion: 2.1 time: 0.156338 Nov 27 21:34:35.177383 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3889/7642] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:35 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:35.720117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c64f8b59-7bc0-4ec6-a797-41298743ff94 req-3604bd7e-c2c6-4c91-ba71-b76b89a7fd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a3906b-6073-4a39-96bd-5e28a9ec0b98", "name": "network-vif-deleted", "tag": "27a69e90-c26c-48c2-9887-e073caf61517"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:35.722191 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:35.722191 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:34:35.731115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c64f8b59-7bc0-4ec6-a797-41298743ff94 req-3604bd7e-c2c6-4c91-ba71-b76b89a7fd48 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:35.732030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c64f8b59-7bc0-4ec6-a797-41298743ff94 req-3604bd7e-c2c6-4c91-ba71-b76b89a7fd48 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:35.744678 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c64f8b59-7bc0-4ec6-a797-41298743ff94 req-3604bd7e-c2c6-4c91-ba71-b76b89a7fd48 service nova] Creating event network-vif-deleted:27a69e90-c26c-48c2-9887-e073caf61517 for instance 00a3906b-6073-4a39-96bd-5e28a9ec0b98 on nch2-master-1 Nov 27 21:34:35.749552 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c64f8b59-7bc0-4ec6-a797-41298743ff94 req-3604bd7e-c2c6-4c91-ba71-b76b89a7fd48 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Nov 27 21:34:35.750165 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3754/7643] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:34:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:36.193925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:36.194552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] [instance: 00a3906b-6073-4a39-96bd-5e28a9ec0b98] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:36.202031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:36.202491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:36.203303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:36.203750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:36.216654 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] HTTP exception thrown: Instance 00a3906b-6073-4a39-96bd-5e28a9ec0b98 could not be found. Nov 27 21:34:36.217244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] Returning 404 to user: Instance 00a3906b-6073-4a39-96bd-5e28a9ec0b98 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:34:36.218063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4f0c477e-82ed-415a-9839-2acb5f1405c9 tempest-ServersAdminNegativeTestJSON-1562379187 tempest-ServersAdminNegativeTestJSON-1562379187-project] 10.222.0.21 "GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98" status: 404 len: 111 microversion: 2.1 time: 0.028083 Nov 27 21:34:36.218587 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3890/7644] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:36 2021] GET /compute/v2.1/servers/00a3906b-6073-4a39-96bd-5e28a9ec0b98 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:34:38.850111 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-932191621", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "383b4ccc-7a9e-48ef-9a6d-d98eecdd981b"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:38.901015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] validate_networks() for [('383b4ccc-7a9e-48ef-9a6d-d98eecdd981b', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:34:39.246112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:34:39.246556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:34:39.247047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:34:39.247505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:34:39.247938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:34:39.256941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:39.257407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:39.258241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:39.258724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:39.275505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Getting quotas for project 11fc5844e4a54a18a4a14eeb83b07c31. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:34:39.280729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Getting quotas for user 7980fb228ebd41d99746e8f1b78e32f2 and project 11fc5844e4a54a18a4a14eeb83b07c31. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:34:39.293899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:34:39.296388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:34:39.340381 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c4479346-0ffc-4954-b936-20f30dde5ccc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606718 Nov 27 21:34:39.341035 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3755/7645] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:34:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:34:39.350913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f90dc82-c35d-410f-8919-454c6f4b9140 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:39.351557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f90dc82-c35d-410f-8919-454c6f4b9140 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:39.405674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f90dc82-c35d-410f-8919-454c6f4b9140 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:39.412504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f90dc82-c35d-410f-8919-454c6f4b9140 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1214 microversion: 2.1 time: 0.065265 Nov 27 21:34:39.413075 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3891/7646] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:39 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:40.430684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:40.432757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:40.440783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:40.441612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:40.442816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:40.443550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:40.517005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:40.524480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-824b7a54-dba1-4c28-8682-c818a9db88f2 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1284 microversion: 2.1 time: 0.098489 Nov 27 21:34:40.525065 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3756/7647] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:40 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:41.542077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:41.542744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:41.550198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:41.550653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:41.551481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:41.551927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:41.694531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:41.699574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b65edf04-5015-4039-ad69-fa7f735911e3 req-614ead40-8b36-4848-8051-3e278b4809d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8", "tag": "3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:41.703526 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de01a903-9576-424f-9c99-1b9a0dbbfbde tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1314 microversion: 2.1 time: 0.165633 Nov 27 21:34:41.707537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3892/7648] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:41 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:41.707683 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:41.707683 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:34:41.720569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b65edf04-5015-4039-ad69-fa7f735911e3 req-614ead40-8b36-4848-8051-3e278b4809d7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:41.721033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b65edf04-5015-4039-ad69-fa7f735911e3 req-614ead40-8b36-4848-8051-3e278b4809d7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:41.732741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b65edf04-5015-4039-ad69-fa7f735911e3 req-614ead40-8b36-4848-8051-3e278b4809d7 service nova] Creating event network-changed:3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f for instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 on nch2-master-1 Nov 27 21:34:41.737519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b65edf04-5015-4039-ad69-fa7f735911e3 req-614ead40-8b36-4848-8051-3e278b4809d7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052136 Nov 27 21:34:41.738462 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3757/7649] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:34:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:42.720890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:42.721490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:42.728665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:42.729132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:42.729879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:42.730319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:42.860359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:42.867774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fe73567c-d77a-425c-bd3e-b93e4489203d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1314 microversion: 2.1 time: 0.150568 Nov 27 21:34:42.868959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3893/7650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:42 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:43.887667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:43.888383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:43.894576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:43.895043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:43.895869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:43.896328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:44.025687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:44.033052 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c7fa0cc8-19e4-4b8b-aa43-ef337beb4076 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1314 microversion: 2.1 time: 0.150989 Nov 27 21:34:44.033626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3758/7651] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:43 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:45.049692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:45.050309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:45.057473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:45.057928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:45.058742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:45.059493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:45.190501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:45.198444 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8d5cd27-402a-4778-8ee0-a826ab72a658 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1314 microversion: 2.1 time: 0.152470 Nov 27 21:34:45.199007 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3894/7652] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:45 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:46.215586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:46.216224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:46.222987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:46.223499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:46.224296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:46.224749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:46.357959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:46.365417 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b43feb3-6fa7-44ec-8eb4-09d5f1f2ab54 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1314 microversion: 2.1 time: 0.154002 Nov 27 21:34:46.366007 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3759/7653] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:46 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:47.122451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-46de070b-e8b9-42d4-8ae8-d38d47a38bb3 req-1fcd93eb-b626-4072-b023-a0abf5f6a53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8", "name": "network-vif-plugged", "status": "completed", "tag": "3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:47.124145 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:34:47.124145 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:34:47.132870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-46de070b-e8b9-42d4-8ae8-d38d47a38bb3 req-1fcd93eb-b626-4072-b023-a0abf5f6a53b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:47.134423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-46de070b-e8b9-42d4-8ae8-d38d47a38bb3 req-1fcd93eb-b626-4072-b023-a0abf5f6a53b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:47.145604 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-46de070b-e8b9-42d4-8ae8-d38d47a38bb3 req-1fcd93eb-b626-4072-b023-a0abf5f6a53b service nova] Creating event network-vif-plugged:3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f for instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 on nch2-master-1 Nov 27 21:34:47.151042 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-46de070b-e8b9-42d4-8ae8-d38d47a38bb3 req-1fcd93eb-b626-4072-b023-a0abf5f6a53b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032345 Nov 27 21:34:47.151806 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3895/7654] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:34:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:34:47.384786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:47.385422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:47.392261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:47.392738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:47.393715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:47.394218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:47.527133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:47.534576 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-601762df-fc24-476a-932e-1ffca919b5d4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1314 microversion: 2.1 time: 0.153970 Nov 27 21:34:47.535169 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3760/7655] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:47 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:48.552120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:48.554075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:48.561886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:48.562347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:48.563142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:48.563609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:48.695399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:48.703310 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f25cc5e8-7d9a-473f-8403-fbd0a1b5eec6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1314 microversion: 2.1 time: 0.155270 Nov 27 21:34:48.704083 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3896/7656] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:48 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:49.721634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:49.722160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:49.729680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:49.730150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:49.730955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:49.731443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:49.861301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:49.868621 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f9b4a48-cf13-4a30-beea-b6b9b8656fa4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1500 microversion: 2.1 time: 0.151107 Nov 27 21:34:49.869193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3761/7657] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:49 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1500 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:49.885255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:34:49.886221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:49.892913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:49.893360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:49.894131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:49.894567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:49.968232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:49.973935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Old instance type m1.heat2, new instance type m1.heat {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:34:49.980469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:34:49.980894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:34:49.981397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:34:49.981813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:34:49.982226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:34:50.089332 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bdcc9c4a-be3a-4e2f-b652-788c04fc6247 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "POST /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8/action" status: 202 len: 0 microversion: 2.1 time: 0.208067 Nov 27 21:34:50.089959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3897/7658] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:34:49 2021] POST /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:34:50.097838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:50.098462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:50.104439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:50.104924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:50.105717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:50.106167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:50.238192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:50.245717 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81e67bed-d101-4855-a46c-e3650797a8b1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1509 microversion: 2.1 time: 0.151576 Nov 27 21:34:50.246297 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3762/7659] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:50 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:51.264529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:51.265143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:51.271887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:51.272340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:51.273146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:51.273586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:51.402470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:51.410064 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-47be9574-836a-4d34-85d2-ae0bc4c5c77a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1509 microversion: 2.1 time: 0.150543 Nov 27 21:34:51.411120 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3898/7660] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:51 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:52.429310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:52.429953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:52.437331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:52.437800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:52.438590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:52.439035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:52.574769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:52.582159 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54afa1e2-9656-4368-a439-cd75d60db14f tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.156794 Nov 27 21:34:52.582737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3763/7661] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:52 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:53.599142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:53.599776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:53.606199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:53.606656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:53.607459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:53.607897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:53.742102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:53.750057 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-674147d3-3a6c-469d-a2a2-8d7a992a682a tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.154586 Nov 27 21:34:53.750629 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3899/7662] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:53 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:54.771811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:54.771811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:54.776220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:54.776688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:54.777488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:54.777941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:54.909201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:54.916962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b98a784-7c0e-4cf7-a24c-75c71f1a6a73 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.152881 Nov 27 21:34:54.917536 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3764/7663] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:54 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:55.933876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:55.934481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:55.941133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:55.941580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:55.942351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:55.942786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:56.073228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:56.080553 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-347a87f6-0de7-4a22-85f8-38c3c2a50c78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.150891 Nov 27 21:34:56.081347 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3900/7664] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:55 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:57.097919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:57.098465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:57.105085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:57.105545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:57.106329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:57.106778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:57.233877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:57.241147 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d3ebb39c-4f18-458b-a19f-48276c257557 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.147146 Nov 27 21:34:57.241715 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3765/7665] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:57 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:58.258025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:58.259339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:58.266231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:58.266687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:58.267505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:58.267949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:58.398065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:58.406054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0af8bb52-c037-4077-a405-2e74c9c7bd78 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.151806 Nov 27 21:34:58.406628 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3901/7666] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:58 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:34:59.422502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:34:59.423130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:34:59.431008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:59.431547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:59.432347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:34:59.432797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:34:59.562270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:34:59.569737 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-91c634b5-07d3-43b0-a3c9-4d8cf2a7f321 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.150941 Nov 27 21:34:59.570306 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3766/7667] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:34:59 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:00.585789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:00.587046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:00.593767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:00.594221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:00.595008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:00.595479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:00.986195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:00.994142 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ab8b73e9-a18b-4b76-a307-7d8c4c5aec90 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.411582 Nov 27 21:35:00.994718 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3902/7668] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:00 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:02.011907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:02.012525 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:02.019368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:02.019836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:02.020629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:02.021081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:02.158898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:02.166272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95f8f96b-28d5-44e9-bb2e-3293e6c6e084 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.158622 Nov 27 21:35:02.166842 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3767/7669] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:02 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:03.182632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:03.183239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:03.189997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:03.190447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:03.191226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:03.191691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:03.317652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:03.325639 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-710b9f74-2d0e-42c5-bdbe-51e81a81fc51 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.146763 Nov 27 21:35:03.326213 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3903/7670] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:03 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:04.342332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:04.342948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:04.349732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:04.350195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:04.350983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:04.351460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:04.487628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:04.495064 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f383b300-ed6b-43c1-a96a-f0c381596c43 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.156411 Nov 27 21:35:04.495669 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3768/7671] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:04 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:05.511217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:05.511849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:05.518846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:05.519321 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:05.520097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:05.520533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:05.651879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:05.659157 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d7ee0607-e2ee-4cf9-89d3-4d302ccd013d tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.151603 Nov 27 21:35:05.659751 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3904/7672] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:05 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:06.676545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:06.677170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:06.684634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:06.685096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:06.685884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:06.686337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:06.822483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:06.829902 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2089b91-5e01-4ae5-bca2-7e8e26c54ffc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.157043 Nov 27 21:35:06.830474 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3769/7673] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:06 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:07.845665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:07.846266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:07.852990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:07.853437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:07.854209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:07.854640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:07.986159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:07.993957 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-73e02695-ed52-49f1-9f20-2c8d584cbdb3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.151491 Nov 27 21:35:07.994528 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3905/7674] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:07 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:09.011541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:09.012173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:09.018927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:09.019447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:09.020250 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:09.020718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:09.149378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:09.156740 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-01ddb4c3-8e09-4691-baee-1ff31a4364cd tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.149548 Nov 27 21:35:09.157315 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3770/7675] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:09 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:10.173515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:10.174146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:10.181025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:10.181469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:10.182239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:10.182672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:10.309813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:10.317122 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-45fada2d-487f-4adf-b1bb-873abd588cb5 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.147318 Nov 27 21:35:10.317682 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3906/7676] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:10 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:11.333935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:11.334606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:11.341417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:11.341885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:11.342682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:11.343132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:11.573352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:11.580876 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9681b6c2-3c9c-47ec-8bd4-8a51b6c310bc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.250709 Nov 27 21:35:11.581468 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3771/7677] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:11 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:12.597768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:12.598377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:12.605664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:12.606124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:12.606912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:12.607385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:12.740471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:12.748485 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5b09c62-9302-48c7-933c-8e3689b8cc03 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.154409 Nov 27 21:35:12.749060 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3907/7678] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:12 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:13.765963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:13.766710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:13.773874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:13.774425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:13.775236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:13.775719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:14.212992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:14.220288 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-246f1863-6da8-4b56-8a61-3254562fdbc4 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.458090 Nov 27 21:35:14.220867 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3772/7679] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:13 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:15.237657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:15.238293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:15.245569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:15.246016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:15.246790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:15.247226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:15.375478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:15.383133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88d9a08b-0c3f-49e6-b48b-43f379c398dc tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.149184 Nov 27 21:35:15.383735 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3908/7680] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:15 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:16.400505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:16.401135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:16.407970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:16.408441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:16.409259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:16.409716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:16.540011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:16.547352 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55142028-3df5-4447-a748-1884075a28a1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.151192 Nov 27 21:35:16.547938 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3773/7681] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:16 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:17.563382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:17.563990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:17.570610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:17.571061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:17.571899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:17.572332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:17.703145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:17.710445 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-60d2037f-cbbc-46b2-956a-776d92861445 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.150850 Nov 27 21:35:17.711015 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3909/7682] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:17 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:18.727370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:18.728512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:18.735192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:18.735725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:18.736528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:18.736989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:18.865182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:18.873118 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ce0496f3-05c7-464a-a3df-ace136b50bd1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1514 microversion: 2.1 time: 0.149462 Nov 27 21:35:18.873695 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3774/7683] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:18 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:19.542659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2fc70746-f6ac-44a1-bca2-5617ba1b1539 req-bbbbe4cb-6501-489e-b603-360c8616e5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8", "name": "network-vif-unplugged", "status": "completed", "tag": "3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:19.544408 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:35:19.544408 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:35:19.552176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2fc70746-f6ac-44a1-bca2-5617ba1b1539 req-bbbbe4cb-6501-489e-b603-360c8616e5ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:19.552732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2fc70746-f6ac-44a1-bca2-5617ba1b1539 req-bbbbe4cb-6501-489e-b603-360c8616e5ab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:19.564702 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2fc70746-f6ac-44a1-bca2-5617ba1b1539 req-bbbbe4cb-6501-489e-b603-360c8616e5ab service nova] Creating event network-vif-unplugged:3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f for instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 on nch1-master-1 Nov 27 21:35:19.570029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-2fc70746-f6ac-44a1-bca2-5617ba1b1539 req-bbbbe4cb-6501-489e-b603-360c8616e5ab service nova] Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:35:19.581153 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2fc70746-f6ac-44a1-bca2-5617ba1b1539 req-bbbbe4cb-6501-489e-b603-360c8616e5ab service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042177 Nov 27 21:35:19.581756 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3910/7684] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:35:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:35:19.891730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:19.892392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:19.899310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:19.901440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:19.901440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:19.901440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:20.115889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:20.124069 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dfccdbe8-336b-459d-b16d-4d64e4044f31 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1513 microversion: 2.1 time: 0.236119 Nov 27 21:35:20.124646 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3775/7685] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:19 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:21.142660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:21.143525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:21.149651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:21.150143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:21.150905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:21.151383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:21.284547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:21.291927 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-665960cc-f912-4439-b517-6349a377b9b3 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1511 microversion: 2.1 time: 0.154234 Nov 27 21:35:21.292522 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3911/7686] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:21 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:21.598072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d8f48667-ba1b-442f-9b55-b2b4192c59e7 req-e729286d-2a77-46b3-9943-bf9f8ec62462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8", "tag": "3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:21.599614 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:35:21.599614 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:35:21.607887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d8f48667-ba1b-442f-9b55-b2b4192c59e7 req-e729286d-2a77-46b3-9943-bf9f8ec62462 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:21.608352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d8f48667-ba1b-442f-9b55-b2b4192c59e7 req-e729286d-2a77-46b3-9943-bf9f8ec62462 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:21.620225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d8f48667-ba1b-442f-9b55-b2b4192c59e7 req-e729286d-2a77-46b3-9943-bf9f8ec62462 service nova] Creating event network-changed:3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f for instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 on nch1-master-1 Nov 27 21:35:21.625481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-d8f48667-ba1b-442f-9b55-b2b4192c59e7 req-e729286d-2a77-46b3-9943-bf9f8ec62462 service nova] Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:35:21.636603 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d8f48667-ba1b-442f-9b55-b2b4192c59e7 req-e729286d-2a77-46b3-9943-bf9f8ec62462 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042104 Nov 27 21:35:21.637184 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3776/7687] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:35:22.309997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:22.312057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:22.317231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:22.317680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:22.318459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:22.318928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:22.455358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:22.462823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e9e435a2-c34f-467f-a4e6-a0b21e7253c1 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1508 microversion: 2.1 time: 0.157375 Nov 27 21:35:22.463436 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3912/7688] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:22 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:22.479592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:22.480188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:22.486627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:22.487092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:22.487906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:22.488352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:22.514299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:35:22.568588 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Found an unconfirmed migration during delete, id: 16, status: finished Nov 27 21:35:23.853691 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-010d290a-84a6-40e7-8ba3-07c99dcc3810 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 204 len: 0 microversion: 2.1 time: 1.377737 Nov 27 21:35:23.854707 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3777/7689] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:35:22 2021] DELETE /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 0 bytes in 1380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:35:23.863892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:23.864655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:23.872478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:23.872999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:23.873844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:23.874349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:24.019440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:24.027165 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-247ca11d-ee10-4ce1-bb97-ec6f776ef511 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1500 microversion: 2.1 time: 0.168200 Nov 27 21:35:24.027812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3913/7690] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:23 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:25.045424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:25.046158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:25.057051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:25.057516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:25.058315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:25.058770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:25.193988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7980fb228ebd41d99746e8f1b78e32f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fc5844e4a54a18a4a14eeb83b07c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:25.202054 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f86d5ea6-88eb-4aa0-8568-fd3c5b0cf455 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 200 len: 1500 microversion: 2.1 time: 0.160737 Nov 27 21:35:25.202626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3778/7691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:25 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:25.689061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-c2dc00a2-4308-4a4a-a1f5-f2f5f0c48731 req-3da61c9a-3383-491c-a97e-44fb322d9851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8", "name": "network-vif-deleted", "tag": "3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:25.690689 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:35:25.690689 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:35:25.700629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c2dc00a2-4308-4a4a-a1f5-f2f5f0c48731 req-3da61c9a-3383-491c-a97e-44fb322d9851 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:25.701094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-c2dc00a2-4308-4a4a-a1f5-f2f5f0c48731 req-3da61c9a-3383-491c-a97e-44fb322d9851 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:25.714505 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-c2dc00a2-4308-4a4a-a1f5-f2f5f0c48731 req-3da61c9a-3383-491c-a97e-44fb322d9851 service nova] Creating event network-vif-deleted:3ed2b4c3-9d67-4b42-8bd9-ae4f54c5072f for instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 on nch1-master-1 Nov 27 21:35:25.722375 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-c2dc00a2-4308-4a4a-a1f5-f2f5f0c48731 req-3da61c9a-3383-491c-a97e-44fb322d9851 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037136 Nov 27 21:35:25.723037 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3914/7692] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:35:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:35:26.218948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:26.219582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:26.226336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:26.226805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:26.227653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:26.228131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:26.241371 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] HTTP exception thrown: Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 could not be found. Nov 27 21:35:26.241968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Returning 404 to user: Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:35:26.242794 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9dc5b92-8c84-49a9-b69b-8d77364ee1a6 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 404 len: 111 microversion: 2.1 time: 0.027675 Nov 27 21:35:26.243334 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3779/7693] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:26 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:35:26.259212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:26.259837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:26.265898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:26.266350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:26.267119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:26.267582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:26.280884 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] HTTP exception thrown: Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 could not be found. Nov 27 21:35:26.281461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Returning 404 to user: Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:35:26.282258 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f3d6be2-4d5c-4a1e-8f79-0ace2dffcfda tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 404 len: 111 microversion: 2.1 time: 0.027872 Nov 27 21:35:26.282772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3915/7694] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:35:26 2021] DELETE /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:35:26.290393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:26.291026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] [instance: 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:26.296964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:26.297435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:26.298229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:26.298695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:26.311759 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] HTTP exception thrown: Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 could not be found. Nov 27 21:35:26.312352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] Returning 404 to user: Instance 3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:35:26.313170 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27692dcf-9e85-417f-8e81-7d35b6f0d760 tempest-DeleteServersTestJSON-999371377 tempest-DeleteServersTestJSON-999371377-project] 10.222.0.21 "GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8" status: 404 len: 111 microversion: 2.1 time: 0.026483 Nov 27 21:35:26.313690 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3780/7695] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:26 2021] GET /compute/v2.1/servers/3cec1a9c-ebd7-4ad0-b29b-7d3bc08bfaa8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:35:28.680862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1671237714", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "15710fef-5852-4102-a84f-03b444ed1343"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:28.732182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] validate_networks() for [('15710fef-5852-4102-a84f-03b444ed1343', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:35:29.083488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:35:29.083947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:35:29.084442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:35:29.084853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:35:29.085265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:35:29.094622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:29.095070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:29.095924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:29.096365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:29.112600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Getting quotas for project d123122da41042cf88d46e8761467e75. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:35:29.117977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Getting quotas for user 846ce1b3957d4992b8d0a1a265ec0997 and project d123122da41042cf88d46e8761467e75. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:35:29.130488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:35:29.132812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:35:29.176295 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99e93249-2539-464b-9102-fc0e81671386 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611688 Nov 27 21:35:29.176966 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3916/7696] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:35:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:35:29.186896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e57b9bb-0e65-48e7-8f2c-aa6bab53345d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:29.187552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e57b9bb-0e65-48e7-8f2c-aa6bab53345d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:29.254949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7e57b9bb-0e65-48e7-8f2c-aa6bab53345d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:29.262607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e57b9bb-0e65-48e7-8f2c-aa6bab53345d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1218 microversion: 2.1 time: 0.079462 Nov 27 21:35:29.263180 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3781/7697] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:29 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:30.280484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:30.281193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:30.288012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:30.288483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:30.289331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:30.290427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:30.350262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:30.358370 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-576978d6-819b-423c-a4de-f3fd1ec9a22f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1276 microversion: 2.1 time: 0.082480 Nov 27 21:35:30.359354 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3917/7698] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:30 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:35:31.375551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:31.376852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:31.384576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:31.385038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:31.385863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:31.386316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:31.412333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b5ccbe9d-c946-4273-b92e-b1d53255abcc req-5bbf11fb-1f27-47f4-b4bf-c8b6365f2292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd", "tag": "33153fd9-4248-4f97-a4d9-4e24ccf19a68"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:31.415563 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:35:31.415563 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:35:31.448490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b5ccbe9d-c946-4273-b92e-b1d53255abcc req-5bbf11fb-1f27-47f4-b4bf-c8b6365f2292 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:31.451926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b5ccbe9d-c946-4273-b92e-b1d53255abcc req-5bbf11fb-1f27-47f4-b4bf-c8b6365f2292 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:31.464083 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b5ccbe9d-c946-4273-b92e-b1d53255abcc req-5bbf11fb-1f27-47f4-b4bf-c8b6365f2292 service nova] Creating event network-changed:33153fd9-4248-4f97-a4d9-4e24ccf19a68 for instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd on nch1-master-1 Nov 27 21:35:31.469555 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b5ccbe9d-c946-4273-b92e-b1d53255abcc req-5bbf11fb-1f27-47f4-b4bf-c8b6365f2292 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061525 Nov 27 21:35:31.470153 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3918/7699] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:35:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:35:31.601821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:31.609810 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66a8625b-a8c5-4b53-8c5d-8c2f16ed3141 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1318 microversion: 2.1 time: 0.238127 Nov 27 21:35:31.610380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3782/7700] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:31 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:32.628622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:32.628622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:32.636352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:32.636805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:32.637593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:32.638030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:32.772847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:32.780142 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c59a726a-e6ab-4213-8374-d2d8bb080665 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1318 microversion: 2.1 time: 0.156629 Nov 27 21:35:32.780721 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3919/7701] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:32 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:33.796655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:33.797285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:33.804121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:33.804593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:33.805389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:33.805852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:33.940545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:33.949006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b94fcb9a-d4c8-41b6-912b-26c83fdc548e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1318 microversion: 2.1 time: 0.156033 Nov 27 21:35:33.949592 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3783/7702] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:33 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:34.966155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:34.966760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:34.973469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:34.973915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:34.974685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:34.975117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:35.108604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:35.115792 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-831af3cb-ca93-48e1-8226-95301915657c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1318 microversion: 2.1 time: 0.153370 Nov 27 21:35:35.116353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3920/7703] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:34 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:36.035828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b99c74cf-b41a-4ce6-ac98-fe3ff9e2dba7 req-23979ac3-8c21-4257-9097-3dda3bbf82ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd", "name": "network-vif-plugged", "status": "completed", "tag": "33153fd9-4248-4f97-a4d9-4e24ccf19a68"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:36.037640 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:35:36.037640 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:35:36.045708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b99c74cf-b41a-4ce6-ac98-fe3ff9e2dba7 req-23979ac3-8c21-4257-9097-3dda3bbf82ae service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:36.046245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b99c74cf-b41a-4ce6-ac98-fe3ff9e2dba7 req-23979ac3-8c21-4257-9097-3dda3bbf82ae service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:36.058776 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b99c74cf-b41a-4ce6-ac98-fe3ff9e2dba7 req-23979ac3-8c21-4257-9097-3dda3bbf82ae service nova] Creating event network-vif-plugged:33153fd9-4248-4f97-a4d9-4e24ccf19a68 for instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd on nch1-master-1 Nov 27 21:35:36.065843 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b99c74cf-b41a-4ce6-ac98-fe3ff9e2dba7 req-23979ac3-8c21-4257-9097-3dda3bbf82ae service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 Nov 27 21:35:36.066801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3784/7704] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:35:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:35:36.132593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:36.133207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:36.140745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:36.141203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:36.142271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:36.142777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:36.274101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:36.281383 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b2a075f-bfe1-45b3-a858-7ae96ab1162e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1318 microversion: 2.1 time: 0.152557 Nov 27 21:35:36.281948 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3921/7705] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:36 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:37.298199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:37.298911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:37.305881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:37.306341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:37.307128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:37.307600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:37.442664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:37.451032 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90b4f3a9-1206-4c92-b3fa-45451a2c5631 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1318 microversion: 2.1 time: 0.156753 Nov 27 21:35:37.451678 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3785/7706] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:37 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:38.468178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:38.468827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:38.475658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.476121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:38.476898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.477898 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:38.608491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:38.616171 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc8ac5d5-08cc-4f14-83a3-967ec2b99c15 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1507 microversion: 2.1 time: 0.151669 Nov 27 21:35:38.616743 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3922/7707] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:38 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:38.632205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:38.632834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:38.639612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.640081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:38.640881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.641346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:38.773248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:38.780568 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-280ed707-0f07-4c73-bc8f-82546560cbfa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1507 microversion: 2.1 time: 0.152003 Nov 27 21:35:38.781159 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3786/7708] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:38 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:35:38.796758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7dfad048-4dad-4c20-b181-ebc7d9b4d058 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:38.797905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7dfad048-4dad-4c20-b181-ebc7d9b4d058 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:38.803802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dfad048-4dad-4c20-b181-ebc7d9b4d058 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.804260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dfad048-4dad-4c20-b181-ebc7d9b4d058 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:38.805041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dfad048-4dad-4c20-b181-ebc7d9b4d058 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.806049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dfad048-4dad-4c20-b181-ebc7d9b4d058 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:38.866916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7dfad048-4dad-4c20-b181-ebc7d9b4d058 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "PUT /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1079 microversion: 2.1 time: 0.073787 Nov 27 21:35:38.867582 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3923/7709] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:35:38 2021] PUT /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1079 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:38.881842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:38.882497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:38.888468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.888935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:38.889727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:38.890175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:39.016700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:39.024312 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f3ae8eee-275a-4254-9e78-59fa9056c2a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1505 microversion: 2.1 time: 0.146139 Nov 27 21:35:39.024898 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3787/7710] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:38 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:39.041043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:39.041676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:39.047839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:39.048287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:39.049089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:39.049522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:39.181917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:39.189279 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0f264cc0-5cd0-4880-b1a4-b30be4707d06 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1505 microversion: 2.1 time: 0.152995 Nov 27 21:35:39.189851 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3924/7711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:39 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:39.205351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:35:39.206533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:39.214407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:39.214856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:39.215693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:39.216148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:39.243939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:39.249532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Old instance type m1.heat2, new instance type m1.heat {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:35:39.255848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:35:39.256283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:35:39.256772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:35:39.257197 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:35:39.257620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:35:39.317268 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-389a66bd-844f-4db7-9b72-f89bbbb55e57 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "POST /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd/action" status: 202 len: 0 microversion: 2.1 time: 0.115593 Nov 27 21:35:39.317927 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3788/7712] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:35:39 2021] POST /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:35:39.325815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:39.326424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:39.332482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:39.332940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:39.333723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:39.334163 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:39.494410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:39.502732 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f24ee96c-6d22-4fbf-b9ba-e348cb43e50d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1516 microversion: 2.1 time: 0.180508 Nov 27 21:35:39.503342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3925/7713] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:39 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:40.522052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:40.522669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:40.528537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:40.529000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:40.529789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:40.530239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:40.779547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:40.787149 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ee139013-fe16-477f-ab42-945b063b1efb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1516 microversion: 2.1 time: 0.269664 Nov 27 21:35:40.787710 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3789/7714] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:40 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:41.804433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:41.805040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:41.812378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:41.812830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:41.813612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:41.814084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:41.941834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:41.949150 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ffaaf04-3404-496e-8706-e698024dcee7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.148411 Nov 27 21:35:41.949718 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3926/7715] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:41 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:42.966267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:42.966901 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:42.973754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:42.974214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:42.975494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:42.976166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:43.108172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:43.115503 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0dd2622-7b9d-4890-80c0-f29037fe73c0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.152968 Nov 27 21:35:43.116076 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3790/7716] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:42 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:44.133608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:44.134254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:44.141065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:44.141523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:44.142304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:44.142749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:44.270825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:44.278830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f2fee4cf-cd82-4333-9348-53866530a1c2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.149464 Nov 27 21:35:44.279469 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3927/7717] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:44 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:45.295786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:45.296414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:45.303213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:45.303729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:45.304520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:45.305009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:45.440595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:45.448380 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31ce73d5-e564-4dea-aa88-32ec9e67a770 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.156253 Nov 27 21:35:45.448988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3791/7718] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:45 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:46.465434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:46.466064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:46.472934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:46.473388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:46.474167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:46.474601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:46.608113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:46.615627 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-16dcc17e-aa0c-4b45-8eb8-ee7b8a1262e3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.153878 Nov 27 21:35:46.616194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3928/7719] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:46 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:47.636380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:47.637004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:47.644151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:47.644614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:47.645399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:47.645849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:47.776960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:47.784277 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f6d93ae3-db0a-484f-8901-a8087231f8f2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.152140 Nov 27 21:35:47.784848 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3792/7720] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:47 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:48.801573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:48.802213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:48.808983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:48.809434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:48.810210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:48.810652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:48.939038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:48.946883 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3303410-4cac-492d-8ecd-8f5de4c89548 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.149065 Nov 27 21:35:48.947476 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3929/7721] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:48 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:49.963755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:49.964387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:49.971221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:49.971726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:49.972523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:49.972981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:50.104475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:50.111859 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98e11b44-8a93-4c45-8fa3-be56c76401d6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.151771 Nov 27 21:35:50.112435 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3793/7722] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:49 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:51.129563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:51.130220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:51.138354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:51.138809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:51.139628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:51.140070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:51.272397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:51.279917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f845272-fa1c-430b-81eb-f47e9752ead3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.154325 Nov 27 21:35:51.280497 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3930/7723] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:51 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:52.296435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:52.297061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:52.303469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:52.303940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:52.304763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:52.305786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:52.439891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:52.447461 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c6ef80a2-6155-4267-a2f3-77d921cb3fa9 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.154890 Nov 27 21:35:52.448041 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3794/7724] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:52 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:35:53.464255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:53.464869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:53.471473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:53.471926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:53.472706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:53.473143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:53.604580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:53.611939 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8ca7a9c7-5c09-4d28-9f4b-5d1e5c2be0ca tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.151418 Nov 27 21:35:53.612512 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3931/7725] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:53 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:54.629515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:54.630175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:54.637576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:54.638045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:54.638844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:54.639378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:54.773129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:54.781119 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f44624db-3bfb-4131-b33e-8694d94c32dc tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.155576 Nov 27 21:35:54.781685 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3795/7726] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:54 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:55.797826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:55.798429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:55.805168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:55.805610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:55.806378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:55.806811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:55.934135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:55.941413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78706af7-0a61-4c2c-ad1c-d8c9405c0462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.147267 Nov 27 21:35:55.941975 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3932/7727] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:55 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:56.957644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:56.958268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:56.964985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:56.965450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:56.966234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:56.966686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:57.097063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:57.105042 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bac382c4-8754-489a-a531-e2e8a857302a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.151076 Nov 27 21:35:57.105626 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3796/7728] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:56 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:58.122729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:58.123361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:58.130381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:58.130845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:58.131636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:58.132080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:58.263938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:58.271357 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-557d5b07-94d2-407a-a52e-3d954fca3d2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.152404 Nov 27 21:35:58.272239 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3933/7729] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:58 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:35:59.289048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:35:59.289677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:35:59.296540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:59.297005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:59.297800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:35:59.298246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:35:59.435747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:35:59.443231 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dbc67d8a-bbfc-4076-b5bf-ad4a1fa7f89c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.158070 Nov 27 21:35:59.443827 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3797/7730] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:35:59 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:00.460566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:00.461748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:00.468486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:00.468939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:00.469721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:00.470158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:00.600201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:00.607589 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-34fab373-25a2-4a89-b972-4aea3d1684cf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.150673 Nov 27 21:36:00.608164 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3934/7731] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:00 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:01.624226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:01.624850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:01.631824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:01.632289 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:01.633085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:01.633519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:01.765350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:01.772798 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90e70b55-2fdf-4422-9d54-b7114e8bcdb7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.152257 Nov 27 21:36:01.773386 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3798/7732] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:01 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:02.790007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:02.791108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:02.797838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:02.798289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:02.799060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:02.799524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:02.934191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:02.941465 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f7f72fff-b96c-4622-9f72-720cfa4669aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.155475 Nov 27 21:36:02.942029 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3935/7733] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:02 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:03.958415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:03.959028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:03.965877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:03.966340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:03.967124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:03.967668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:04.097416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:04.104753 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d828d05-4a74-4772-8301-1fd3d8d75184 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.150112 Nov 27 21:36:04.105328 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3799/7734] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:03 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:05.122095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:05.122707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:05.129765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:05.130221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:05.131003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:05.131468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:05.262013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:05.269466 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e023479b-23ca-47c2-88b5-537d1e0e90a0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.151700 Nov 27 21:36:05.270033 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3936/7735] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:05 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:06.285624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:06.286316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:06.298370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:06.298967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:06.299837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:06.300564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:06.438209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:06.445576 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bba87794-b4ca-4332-beca-a248d3d70ce6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.163680 Nov 27 21:36:06.446149 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3800/7736] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:06 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:07.463580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:07.464188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:07.470899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:07.471378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:07.472150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:07.472586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:07.607529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:07.614784 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d2f42bd-e614-4c87-af11-4cc2a39702fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1521 microversion: 2.1 time: 0.155575 Nov 27 21:36:07.615387 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3937/7737] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:07 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:08.632339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:08.632953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:08.640021 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:08.640491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:08.641306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:08.641758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:08.843803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:08.851086 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ffaf94f-f8aa-4916-861e-3d39fa537a74 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1520 microversion: 2.1 time: 0.222456 Nov 27 21:36:08.851884 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3801/7738] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:08 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:08.874910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8a1d11ed-1afe-4231-b4cf-ceee7f9fdc6c req-bbb0aa45-7881-4b80-a605-5eb056592b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd", "name": "network-vif-unplugged", "status": "completed", "tag": "33153fd9-4248-4f97-a4d9-4e24ccf19a68"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:08.877217 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:08.877217 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:36:08.885819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8a1d11ed-1afe-4231-b4cf-ceee7f9fdc6c req-bbb0aa45-7881-4b80-a605-5eb056592b69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:08.886270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8a1d11ed-1afe-4231-b4cf-ceee7f9fdc6c req-bbb0aa45-7881-4b80-a605-5eb056592b69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:08.897934 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8a1d11ed-1afe-4231-b4cf-ceee7f9fdc6c req-bbb0aa45-7881-4b80-a605-5eb056592b69 service nova] Creating event network-vif-unplugged:33153fd9-4248-4f97-a4d9-4e24ccf19a68 for instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd on nch2-master-1 Nov 27 21:36:08.904059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-8a1d11ed-1afe-4231-b4cf-ceee7f9fdc6c req-bbb0aa45-7881-4b80-a605-5eb056592b69 service nova] Instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:36:08.914761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8a1d11ed-1afe-4231-b4cf-ceee7f9fdc6c req-bbb0aa45-7881-4b80-a605-5eb056592b69 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043471 Nov 27 21:36:08.915571 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3938/7739] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:36:09.868308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:09.868939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:09.875693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:09.876163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:09.877216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:09.877671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:10.012688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:10.020044 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e040105c-376a-452e-b614-1ce19778429b tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1518 microversion: 2.1 time: 0.155461 Nov 27 21:36:10.020618 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3802/7740] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:09 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:10.934739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3468c0c0-fe20-4a44-bb33-fa1afcd4dcd9 req-f4cf5ead-6d7c-4aaf-91dd-99023e0f60c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd", "tag": "33153fd9-4248-4f97-a4d9-4e24ccf19a68"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:10.936233 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:10.936233 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:36:10.943299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3468c0c0-fe20-4a44-bb33-fa1afcd4dcd9 req-f4cf5ead-6d7c-4aaf-91dd-99023e0f60c4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:10.943751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3468c0c0-fe20-4a44-bb33-fa1afcd4dcd9 req-f4cf5ead-6d7c-4aaf-91dd-99023e0f60c4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:10.955294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3468c0c0-fe20-4a44-bb33-fa1afcd4dcd9 req-f4cf5ead-6d7c-4aaf-91dd-99023e0f60c4 service nova] Creating event network-changed:33153fd9-4248-4f97-a4d9-4e24ccf19a68 for instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd on nch2-master-1 Nov 27 21:36:10.960464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-3468c0c0-fe20-4a44-bb33-fa1afcd4dcd9 req-f4cf5ead-6d7c-4aaf-91dd-99023e0f60c4 service nova] Instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:36:10.971482 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3468c0c0-fe20-4a44-bb33-fa1afcd4dcd9 req-f4cf5ead-6d7c-4aaf-91dd-99023e0f60c4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041553 Nov 27 21:36:10.972057 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3939/7741] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:36:11.037834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:11.039214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:11.046516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:11.046992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:11.047839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:11.048304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:11.387467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:11.394918 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af19906a-f3ad-469d-bcea-6df3793e8a3f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1518 microversion: 2.1 time: 0.360839 Nov 27 21:36:11.395558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3803/7742] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:11 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1518 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:12.412350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:12.413052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:12.419859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:12.420314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:12.421091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:12.421534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:12.551768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:12.559082 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9d0f97ca-37f3-4e38-8874-1c33ba90a634 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1515 microversion: 2.1 time: 0.151705 Nov 27 21:36:12.559691 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3940/7743] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:12 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:12.575723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61fe283b-fec7-4581-b5f6-1f097c44249e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:12.576270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61fe283b-fec7-4581-b5f6-1f097c44249e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:12.583027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61fe283b-fec7-4581-b5f6-1f097c44249e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:12.583528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61fe283b-fec7-4581-b5f6-1f097c44249e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:12.584315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61fe283b-fec7-4581-b5f6-1f097c44249e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:12.584764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61fe283b-fec7-4581-b5f6-1f097c44249e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:12.646237 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61fe283b-fec7-4581-b5f6-1f097c44249e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "POST /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd/action" status: 204 len: 0 microversion: 2.1 time: 0.074444 Nov 27 21:36:12.646816 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3804/7744] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:36:12 2021] POST /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:36:12.655264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:12.655884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:12.661952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:12.662400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:12.663178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:12.663637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:12.797800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:12.805272 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd1c09a7-94ac-4aef-9e56-458b20071435 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1515 microversion: 2.1 time: 0.153685 Nov 27 21:36:12.805850 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3941/7745] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:12 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:13.823658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:13.825009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:13.831550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:13.832226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:13.833130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:13.833752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:13.968360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:13.976538 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-002c6529-0e66-4a90-89f9-00ac577b1b35 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1507 microversion: 2.1 time: 0.157767 Nov 27 21:36:13.977638 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3805/7746] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:13 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:13.994800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:13.997866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:14.006522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:14.008017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:14.009345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:14.010440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:14.147993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:14.156105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f70636e4-57ec-441c-94a4-7bebcd6581fa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1507 microversion: 2.1 time: 0.165678 Nov 27 21:36:14.156669 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3942/7747] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:13 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:14.171660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:14.172290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:14.178163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:14.178632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:14.179458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:14.179913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:14.308766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:14.316111 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a7de9de9-fc4c-41ce-abb0-f6dda8d8fa43 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 200 len: 1507 microversion: 2.1 time: 0.148039 Nov 27 21:36:14.316678 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3806/7748] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:14 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:14.332169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:14.332660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:14.339075 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:14.339554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:14.340320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:14.340755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:14.364239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:36:14.437164 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43ede305-d2af-48dd-8867-3d06f2380858 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "DELETE /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 204 len: 0 microversion: 2.1 time: 0.108325 Nov 27 21:36:14.437806 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3943/7749] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:36:14 2021] DELETE /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:36:14.489001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-113535109", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "15710fef-5852-4102-a84f-03b444ed1343"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:14.667934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] validate_networks() for [('15710fef-5852-4102-a84f-03b444ed1343', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:36:15.072001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:36:15.072575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:36:15.072908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:36:15.073441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:36:15.073872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:36:15.082593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:15.083052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:15.083940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:15.084386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:15.101006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Getting quotas for project d123122da41042cf88d46e8761467e75. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:36:15.106576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Getting quotas for user 846ce1b3957d4992b8d0a1a265ec0997 and project d123122da41042cf88d46e8761467e75. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:36:15.118316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:36:15.120635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:36:15.163655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d5a74af-706f-42e6-9225-f331904b911f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678271 Nov 27 21:36:15.164233 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3807/7750] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:36:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:36:15.175170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15027a5d-374c-4900-b5d9-76bd6062a579 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:15.175906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15027a5d-374c-4900-b5d9-76bd6062a579 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:15.229179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15027a5d-374c-4900-b5d9-76bd6062a579 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:15.236985 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15027a5d-374c-4900-b5d9-76bd6062a579 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1217 microversion: 2.1 time: 0.065886 Nov 27 21:36:15.237754 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3944/7751] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:15 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:15.605668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5f7b3a68-c22b-49da-b662-060723acbf11 req-9067947a-21cd-4722-bc5b-fd87fa3e2a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd", "name": "network-vif-plugged", "status": "completed", "tag": "33153fd9-4248-4f97-a4d9-4e24ccf19a68"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:15.607322 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:15.607322 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:36:15.618601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5f7b3a68-c22b-49da-b662-060723acbf11 req-9067947a-21cd-4722-bc5b-fd87fa3e2a00 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:15.619041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5f7b3a68-c22b-49da-b662-060723acbf11 req-9067947a-21cd-4722-bc5b-fd87fa3e2a00 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:15.632653 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5f7b3a68-c22b-49da-b662-060723acbf11 req-9067947a-21cd-4722-bc5b-fd87fa3e2a00 service nova] Creating event network-vif-plugged:33153fd9-4248-4f97-a4d9-4e24ccf19a68 for instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd on nch2-master-1 Nov 27 21:36:15.639523 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5f7b3a68-c22b-49da-b662-060723acbf11 req-9067947a-21cd-4722-bc5b-fd87fa3e2a00 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037155 Nov 27 21:36:15.640128 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3808/7752] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:36:16.254108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:16.254702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:16.261800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:16.262247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:16.263230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:16.263704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:16.412825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:16.421874 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c7bd6cd-1c55-49c7-80c5-b45d34325596 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1275 microversion: 2.1 time: 0.171626 Nov 27 21:36:16.422470 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3945/7753] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:16 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:36:16.633560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5c7f9b76-f549-40b6-b51e-6eee8224ed5b req-e92cf175-e9ab-425b-8835-036bba3de5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd", "name": "network-vif-deleted", "tag": "33153fd9-4248-4f97-a4d9-4e24ccf19a68"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:16.635521 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:16.635521 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:36:16.645581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5c7f9b76-f549-40b6-b51e-6eee8224ed5b req-e92cf175-e9ab-425b-8835-036bba3de5d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:16.646343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5c7f9b76-f549-40b6-b51e-6eee8224ed5b req-e92cf175-e9ab-425b-8835-036bba3de5d2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:16.658632 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5c7f9b76-f549-40b6-b51e-6eee8224ed5b req-e92cf175-e9ab-425b-8835-036bba3de5d2 service nova] Creating event network-vif-deleted:33153fd9-4248-4f97-a4d9-4e24ccf19a68 for instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd on nch2-master-1 Nov 27 21:36:16.663616 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5c7f9b76-f549-40b6-b51e-6eee8224ed5b req-e92cf175-e9ab-425b-8835-036bba3de5d2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034917 Nov 27 21:36:16.664221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3809/7754] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:36:17.439177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:17.439831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:17.447894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:17.447894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:17.448503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:17.448940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:17.566334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d4fcfc2b-1978-4203-99d3-e12abb2b4592 req-df5e857a-664e-4c97-a0f1-c5c0cad7be4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f020b7de-fce9-4eeb-a13d-e590b6cb8435", "tag": "63c2a51b-abad-4fe3-9761-9c5da5e9cb39"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:17.567921 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:17.567921 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:36:17.575594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d4fcfc2b-1978-4203-99d3-e12abb2b4592 req-df5e857a-664e-4c97-a0f1-c5c0cad7be4a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:17.576049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d4fcfc2b-1978-4203-99d3-e12abb2b4592 req-df5e857a-664e-4c97-a0f1-c5c0cad7be4a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:17.586490 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d4fcfc2b-1978-4203-99d3-e12abb2b4592 req-df5e857a-664e-4c97-a0f1-c5c0cad7be4a service nova] Creating event network-changed:63c2a51b-abad-4fe3-9761-9c5da5e9cb39 for instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 on nch2-master-1 Nov 27 21:36:17.591571 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d4fcfc2b-1978-4203-99d3-e12abb2b4592 req-df5e857a-664e-4c97-a0f1-c5c0cad7be4a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112496 Nov 27 21:36:17.592304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3810/7755] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:36:17.714123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:17.721728 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53bc8e19-e71a-4c1d-909e-fb6a187e5d36 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1317 microversion: 2.1 time: 0.286295 Nov 27 21:36:17.722236 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3946/7756] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:17 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:18.739890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:18.740603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:18.746751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:18.747226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:18.748072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:18.748533 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:18.888213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:18.895712 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-954c8532-8296-4f07-9bdc-4f9336db2206 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1317 microversion: 2.1 time: 0.161290 Nov 27 21:36:18.896311 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3811/7757] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:18 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:19.912255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:19.912869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:19.920173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:19.920620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:19.921391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:19.921823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:20.052179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:20.059449 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28512c8a-6967-403b-b689-8fffe37a3a52 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1317 microversion: 2.1 time: 0.150854 Nov 27 21:36:20.060052 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3947/7758] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:19 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:21.076279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:21.076927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:21.083700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:21.084167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:21.084963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:21.085440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:21.214800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:21.222100 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd000d9f-2821-426a-a4dc-5c7b1827c9f5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1317 microversion: 2.1 time: 0.149525 Nov 27 21:36:21.222700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3812/7759] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:21 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:22.239353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:22.239998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:22.247209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:22.247696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:22.248493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:22.248930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:22.380329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:22.387572 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5b3d6af-5dda-4ddb-896f-68e7f15bc8d7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1317 microversion: 2.1 time: 0.151877 Nov 27 21:36:22.388135 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3948/7760] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:22 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:23.404481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:23.405091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:23.411491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:23.411954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:23.412736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:23.413183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:23.549570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:23.557500 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e60667e7-f78a-4d8e-9100-a93ff5a08288 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1317 microversion: 2.1 time: 0.156865 Nov 27 21:36:23.558079 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3813/7761] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:23 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:36:23.659681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3a334f46-9677-4283-b6aa-0719f4f0175e req-c9bece92-5ab3-49b1-a32f-287257f02147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f020b7de-fce9-4eeb-a13d-e590b6cb8435", "name": "network-vif-plugged", "status": "completed", "tag": "63c2a51b-abad-4fe3-9761-9c5da5e9cb39"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:23.661124 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:23.661124 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:36:23.670162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3a334f46-9677-4283-b6aa-0719f4f0175e req-c9bece92-5ab3-49b1-a32f-287257f02147 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:23.670609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3a334f46-9677-4283-b6aa-0719f4f0175e req-c9bece92-5ab3-49b1-a32f-287257f02147 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:23.683087 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3a334f46-9677-4283-b6aa-0719f4f0175e req-c9bece92-5ab3-49b1-a32f-287257f02147 service nova] Creating event network-vif-plugged:63c2a51b-abad-4fe3-9761-9c5da5e9cb39 for instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 on nch2-master-1 Nov 27 21:36:23.688007 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3a334f46-9677-4283-b6aa-0719f4f0175e req-c9bece92-5ab3-49b1-a32f-287257f02147 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Nov 27 21:36:23.688772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3949/7762] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:36:24.574594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:24.575218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:24.582245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:24.582715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:24.583538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:24.584041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:24.714832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:24.722537 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3e919e12-a100-4802-9f4c-04104b6f4dde tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1317 microversion: 2.1 time: 0.152153 Nov 27 21:36:24.723114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3814/7763] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:24 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:25.740226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:25.740901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:25.747044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:25.747531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:25.748305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:25.748745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:25.880858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:25.888263 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c18c19d4-0921-44b1-8650-7cdadadfaaf1 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1507 microversion: 2.1 time: 0.152983 Nov 27 21:36:25.888836 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3950/7764] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:25 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:25.904681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:25.905341 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:25.911736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:25.912200 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:25.912989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:25.913443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:26.040915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:26.048905 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-79793319-59d4-4d34-999a-83fea8a41c41 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1507 microversion: 2.1 time: 0.148050 Nov 27 21:36:26.049712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3815/7765] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:25 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:26.064861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:26.065845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:26.072344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:26.072794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:26.073569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:26.074003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:26.100728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:26.106265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Old instance type m1.heat2, new instance type m1.heat {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:36:26.112545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:36:26.113058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:36:26.113732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:36:26.114233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:36:26.114715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:36:26.177973 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-653b5619-e56a-403e-9c0d-042ac5b918af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "POST /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435/action" status: 202 len: 0 microversion: 2.1 time: 0.116827 Nov 27 21:36:26.178756 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3951/7766] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:36:26 2021] POST /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:36:26.186756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:26.187409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:26.193359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:26.193829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:26.194623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:26.195079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:26.333922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:26.342591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-190e7199-3d68-4c8b-be01-78b2e9e6bf95 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1514 microversion: 2.1 time: 0.159427 Nov 27 21:36:26.343211 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3816/7767] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:26 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:27.360508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:27.361115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:27.368893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:27.369349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:27.370131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:27.370567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:27.571094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:27.578458 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c1b5c9f6-6fce-4a26-b72d-625ef9afa38a tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1514 microversion: 2.1 time: 0.222488 Nov 27 21:36:27.579221 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3952/7768] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:27 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:28.596186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:28.596820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:28.603848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:28.604322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:28.605122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:28.605583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:28.736558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:28.744458 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8203d547-c522-4017-82a1-c9df32c1f1b8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.152065 Nov 27 21:36:28.745027 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3817/7769] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:28 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:29.763088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:29.763727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:29.770431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:29.770884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:29.771704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:29.772139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:29.905002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:29.912305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0adc3bb-5b04-46f2-8663-1bebd6cf6c40 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.153740 Nov 27 21:36:29.912883 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3953/7770] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:29 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:30.928675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:30.929299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:30.936699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:30.937166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:30.937952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:30.938406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:31.073368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:31.080641 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b0b4e9f-67bc-44ca-8ab5-f5ab5e6c40f6 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.155746 Nov 27 21:36:31.081217 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3818/7771] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:30 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:32.097779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:32.098379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:32.105517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:32.105968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:32.106748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:32.107187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:32.236115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:32.243467 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f4b047c-7590-4397-889a-3f83ede324a2 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.149643 Nov 27 21:36:32.244043 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3954/7772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:32 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:33.260666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:33.261309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:33.268090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:33.268558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:33.269356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:33.269814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:33.398447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:33.406252 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad6e6a92-6ace-4f28-bf75-54760f46720f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.149351 Nov 27 21:36:33.406821 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3819/7773] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:33 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:34.423651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:34.424273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:34.431802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:34.432258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:34.433045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:34.433486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:34.565418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:34.572774 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-127fd23f-b484-4b59-a15c-3980c1d632aa tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.152832 Nov 27 21:36:34.573353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3955/7774] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:34 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:35.589254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:35.589865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:35.597276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:35.597739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:35.598548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:35.598997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:35.740974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:35.749028 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-538f547e-d8c3-4702-ae05-1b13f4773396 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.163623 Nov 27 21:36:35.749597 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3820/7775] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:35 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:36:36.765632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:36.766278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:36.773564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:36.774964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:36.775809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:36.776246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:36.911195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:36.918553 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b9843fa3-53ed-43f8-824f-4b90ea5538af tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.156554 Nov 27 21:36:36.919138 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3956/7776] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:36 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:37.936787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:37.937406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:37.943463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:37.943927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:37.944710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:37.945158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:38.076316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:38.083597 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd1e1dee-1be5-40c1-b265-c07b15ba78c3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.151261 Nov 27 21:36:38.084394 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3821/7777] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:37 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:39.099782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:39.100400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:39.107167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:39.107659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:39.108474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:39.108921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:39.243489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:39.250807 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a3e8ac0-fc6a-4dab-ac3f-986d55fdab44 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.154709 Nov 27 21:36:39.251419 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3957/7778] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:39 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:40.268646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:40.269291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:40.276838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:40.277304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:40.278103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:40.278558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:40.411313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:40.418709 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-642202f4-919c-4a26-a8c1-2dde3fc36725 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.153856 Nov 27 21:36:40.419303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3822/7779] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:40 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:41.435510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:41.436103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:41.443205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:41.443787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:41.444578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:41.445018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:41.578182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:41.585593 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6b63272d-fc6d-4dcb-a726-b0a2ae2bf302 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.153758 Nov 27 21:36:41.586647 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3958/7780] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:41 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:42.603114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:42.603847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:42.610607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:42.611068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:42.611884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:42.612331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:42.746748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:42.754327 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3f8d603-dfdf-4fe5-b3c9-57189566c978 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.155354 Nov 27 21:36:42.754901 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3823/7781] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:42 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:43.771013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:43.771669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:43.778463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:43.778908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:43.779709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:43.780147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:43.915035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:43.922305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-55c21712-14f6-43fc-9295-e3e5d3d68b84 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.154982 Nov 27 21:36:43.922878 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3959/7782] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:43 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:44.939515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:44.940132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:44.947461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:44.947929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:44.948710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:44.949158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:45.077434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:45.084689 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5f792939-dcbb-446d-964a-43656f5c73bf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.148854 Nov 27 21:36:45.085259 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3824/7783] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:44 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:46.102554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:46.103192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:46.109929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:46.110375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:46.111152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:46.111679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:46.241208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:46.248639 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65424ae5-d033-41b5-8fb6-5a254acc9d3c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.150370 Nov 27 21:36:46.249206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3960/7784] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:46 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:47.266445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:47.267144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:47.273786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:47.274247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:47.275028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:47.275509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:47.406752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:47.413986 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-51297442-6498-41ac-a087-ee752a627c4f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.151283 Nov 27 21:36:47.415169 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3825/7785] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:47 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:48.432298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:48.432938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:48.439714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:48.440489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:48.441312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:48.441753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:48.575282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:48.583579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d073e519-0822-44bf-8671-09f8aaf7ac0d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.155468 Nov 27 21:36:48.584156 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3961/7786] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:48 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:49.599761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:49.600882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:49.607948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:49.608412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:49.609195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:49.609732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:49.746699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:49.754318 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9b1a966b-fba9-4960-af72-d82ec46a34f8 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.158582 Nov 27 21:36:49.754900 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3826/7787] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:49 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:50.771740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:50.772350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:50.779809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:50.780262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:50.781043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:50.781481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:50.914080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:50.921801 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28ae04e4-5f17-4f1f-a4f2-4e707c97f00c tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.153755 Nov 27 21:36:50.922419 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3962/7788] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:50 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:51.938823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:51.939475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:51.945815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:51.946310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:51.947181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:51.947655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:52.075233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:52.082695 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d125610-25e9-4cb0-9e10-3b9853a5c2f7 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.147802 Nov 27 21:36:52.083281 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3827/7789] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:51 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:53.099643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:53.100263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:53.107092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:53.107569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:53.108341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:53.108774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:53.242639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:53.250563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3a060c4b-404f-479e-9077-8e3f388cf41f tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.154756 Nov 27 21:36:53.251128 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3963/7790] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:53 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:54.267635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:54.268267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:54.275056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:54.275556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:54.277038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:54.277501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:54.409053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:54.416430 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0b9effc2-b45d-49ab-b6ce-6452bdd947a4 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1519 microversion: 2.1 time: 0.152511 Nov 27 21:36:54.417001 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3828/7791] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:54 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:55.424788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-7b9bae0b-4123-4d8a-b8e9-6255e2e540ba req-1bc54c5c-1049-4794-b32e-48fae1f017f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f020b7de-fce9-4eeb-a13d-e590b6cb8435", "name": "network-vif-unplugged", "status": "completed", "tag": "63c2a51b-abad-4fe3-9761-9c5da5e9cb39"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:55.428190 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:55.428190 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:36:55.435360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:55.436726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:55.439601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7b9bae0b-4123-4d8a-b8e9-6255e2e540ba req-1bc54c5c-1049-4794-b32e-48fae1f017f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:55.440265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-7b9bae0b-4123-4d8a-b8e9-6255e2e540ba req-1bc54c5c-1049-4794-b32e-48fae1f017f9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:55.443531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:55.444270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:55.445738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:55.446212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:55.456430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-7b9bae0b-4123-4d8a-b8e9-6255e2e540ba req-1bc54c5c-1049-4794-b32e-48fae1f017f9 service nova] Creating event network-vif-unplugged:63c2a51b-abad-4fe3-9761-9c5da5e9cb39 for instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 on nch1-master-1 Nov 27 21:36:55.462727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-7b9bae0b-4123-4d8a-b8e9-6255e2e540ba req-1bc54c5c-1049-4794-b32e-48fae1f017f9 service nova] Instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:36:55.474490 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-7b9bae0b-4123-4d8a-b8e9-6255e2e540ba req-1bc54c5c-1049-4794-b32e-48fae1f017f9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053654 Nov 27 21:36:55.475543 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3964/7792] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:36:55.686027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:55.693546 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad05bb4e-6389-49ba-bd46-475444d16a86 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1518 microversion: 2.1 time: 0.263999 Nov 27 21:36:55.694210 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3829/7793] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:55 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:36:56.710948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:56.711696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:56.717848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:56.718293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:56.719060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:56.719528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:56.851378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:56.858787 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d4901446-a184-41da-bf92-db3ae887f678 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1516 microversion: 2.1 time: 0.152672 Nov 27 21:36:56.859379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3965/7794] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:56 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:57.491546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1495c2ec-a2b6-4db5-9a6d-025a728040cb req-8db8c0e2-fb96-4a5a-b657-299e36abb329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f020b7de-fce9-4eeb-a13d-e590b6cb8435", "tag": "63c2a51b-abad-4fe3-9761-9c5da5e9cb39"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:57.493059 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:36:57.493059 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:36:57.500796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1495c2ec-a2b6-4db5-9a6d-025a728040cb req-8db8c0e2-fb96-4a5a-b657-299e36abb329 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:57.501251 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1495c2ec-a2b6-4db5-9a6d-025a728040cb req-8db8c0e2-fb96-4a5a-b657-299e36abb329 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:57.512974 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1495c2ec-a2b6-4db5-9a6d-025a728040cb req-8db8c0e2-fb96-4a5a-b657-299e36abb329 service nova] Creating event network-changed:63c2a51b-abad-4fe3-9761-9c5da5e9cb39 for instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 on nch1-master-1 Nov 27 21:36:57.518225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-1495c2ec-a2b6-4db5-9a6d-025a728040cb req-8db8c0e2-fb96-4a5a-b657-299e36abb329 service nova] Instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:36:57.529334 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1495c2ec-a2b6-4db5-9a6d-025a728040cb req-8db8c0e2-fb96-4a5a-b657-299e36abb329 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041555 Nov 27 21:36:57.529912 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3830/7795] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:36:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:36:57.875799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:57.876610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:57.883537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:57.884201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:57.885665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:57.886232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:58.098712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:58.106236 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7d3f5e7-e163-4cbd-b9ce-832b314712e0 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1516 microversion: 2.1 time: 0.234058 Nov 27 21:36:58.106815 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3966/7796] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:57 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:59.124457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:59.125161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:59.131584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:59.132046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:59.132832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:59.133278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:59.273542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:59.281494 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71ed0d84-5099-4681-8ff4-79867d9d4cbf tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1513 microversion: 2.1 time: 0.162036 Nov 27 21:36:59.282081 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3831/7797] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:59 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:36:59.298197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5ac5167-432c-4628-ade7-b571940a5417 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:36:59.298732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5ac5167-432c-4628-ade7-b571940a5417 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:59.305457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5ac5167-432c-4628-ade7-b571940a5417 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:59.305913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5ac5167-432c-4628-ade7-b571940a5417 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:59.306698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5ac5167-432c-4628-ade7-b571940a5417 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:59.307141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5ac5167-432c-4628-ade7-b571940a5417 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:59.363326 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5ac5167-432c-4628-ade7-b571940a5417 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "POST /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435/action" status: 204 len: 0 microversion: 2.1 time: 0.068758 Nov 27 21:36:59.364067 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3967/7798] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:36:59 2021] POST /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:36:59.371972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:36:59.372710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:36:59.379056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:59.379799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:59.380923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:36:59.381544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:36:59.519665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:36:59.527739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ae5c2a4d-86ec-499e-a341-6dddd33258a3 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1513 microversion: 2.1 time: 0.159405 Nov 27 21:36:59.528324 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3832/7799] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:36:59 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:00.526616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0266f6ee-2d8d-4c69-970d-9fe51ff314b3 req-300ed4de-438a-4252-bb49-e66d56d1ab5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f020b7de-fce9-4eeb-a13d-e590b6cb8435", "name": "network-vif-plugged", "status": "completed", "tag": "63c2a51b-abad-4fe3-9761-9c5da5e9cb39"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:00.528320 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:37:00.528320 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:37:00.538668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0266f6ee-2d8d-4c69-970d-9fe51ff314b3 req-300ed4de-438a-4252-bb49-e66d56d1ab5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:00.539114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0266f6ee-2d8d-4c69-970d-9fe51ff314b3 req-300ed4de-438a-4252-bb49-e66d56d1ab5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:00.545573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:00.546365 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:00.553180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:00.553730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:00.554397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0266f6ee-2d8d-4c69-970d-9fe51ff314b3 req-300ed4de-438a-4252-bb49-e66d56d1ab5e service nova] Creating event network-vif-plugged:63c2a51b-abad-4fe3-9761-9c5da5e9cb39 for instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 on nch1-master-1 Nov 27 21:37:00.554713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:00.555416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:00.560872 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0266f6ee-2d8d-4c69-970d-9fe51ff314b3 req-300ed4de-438a-4252-bb49-e66d56d1ab5e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038642 Nov 27 21:37:00.562039 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3968/7800] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:37:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:37:00.705245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:00.712731 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4bd3d775-c7db-48f0-b1d0-603383906462 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1505 microversion: 2.1 time: 0.171957 Nov 27 21:37:00.713805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3833/7801] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:00 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:00.730526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:00.731231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:00.737334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:00.737782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:00.738871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:00.739429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:00.868725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:00.876105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78d5454d-233a-46a0-a337-24518054cd66 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1505 microversion: 2.1 time: 0.150326 Nov 27 21:37:00.876679 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3969/7802] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:00 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:37:00.892337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:00.893011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:00.898978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:00.899491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:00.900285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:00.901372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:01.032322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:01.039671 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0de3b3e3-6b5f-4be3-b4d3-4683418643cb tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1505 microversion: 2.1 time: 0.150928 Nov 27 21:37:01.040254 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3834/7803] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:00 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:01.055377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:01.055885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:01.061797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:01.062254 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:01.063037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:01.063509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:01.090306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:37:01.166793 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d211250-e9a1-4212-946b-1c64bfb84eb5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 204 len: 0 microversion: 2.1 time: 0.114835 Nov 27 21:37:01.167353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3970/7804] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:37:01 2021] DELETE /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:37:01.183780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:01.184293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:01.190159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:01.190626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:01.191457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:01.191908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:01.216363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:37:01.259058 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.compute.api [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Instance is already in deleting state, ignoring this request Nov 27 21:37:01.260533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-537fd774-85fa-4243-a7d6-c043cbe6fd5e tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 204 len: 0 microversion: 2.1 time: 0.080459 Nov 27 21:37:01.261097 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3835/7805] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:37:01 2021] DELETE /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:37:01.269422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:01.270142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:01.276187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:01.276631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:01.277397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:01.277827 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:01.411642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:01.419065 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-834b32ac-631c-42e2-8068-71112a253f42 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1511 microversion: 2.1 time: 0.153584 Nov 27 21:37:01.419606 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3971/7806] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:01 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:02.435272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:02.435908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:02.442671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:02.443142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:02.443979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:02.444441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:02.606551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846ce1b3957d4992b8d0a1a265ec0997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd123122da41042cf88d46e8761467e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:02.614996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-060857af-a753-40b5-baf7-1d12bbcabe96 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 200 len: 1511 microversion: 2.1 time: 0.183383 Nov 27 21:37:02.615816 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3836/7807] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:02 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:03.035974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d22acbf7-8950-4056-ad72-2bd16dea1233 req-a04966e3-d60a-4c96-ab33-0fcee6c05edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f020b7de-fce9-4eeb-a13d-e590b6cb8435", "name": "network-vif-deleted", "tag": "63c2a51b-abad-4fe3-9761-9c5da5e9cb39"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:03.037775 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:37:03.037775 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:37:03.047874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d22acbf7-8950-4056-ad72-2bd16dea1233 req-a04966e3-d60a-4c96-ab33-0fcee6c05edd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:03.048327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d22acbf7-8950-4056-ad72-2bd16dea1233 req-a04966e3-d60a-4c96-ab33-0fcee6c05edd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:03.061747 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d22acbf7-8950-4056-ad72-2bd16dea1233 req-a04966e3-d60a-4c96-ab33-0fcee6c05edd service nova] Creating event network-vif-deleted:63c2a51b-abad-4fe3-9761-9c5da5e9cb39 for instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 on nch1-master-1 Nov 27 21:37:03.066806 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d22acbf7-8950-4056-ad72-2bd16dea1233 req-a04966e3-d60a-4c96-ab33-0fcee6c05edd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Nov 27 21:37:03.067422 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3972/7808] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:37:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:37:03.631332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:03.632001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: f020b7de-fce9-4eeb-a13d-e590b6cb8435] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:03.638793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:03.639305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:03.640092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:03.640548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:03.654885 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] HTTP exception thrown: Instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 could not be found. Nov 27 21:37:03.655524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Returning 404 to user: Instance f020b7de-fce9-4eeb-a13d-e590b6cb8435 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:37:03.656364 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-264dc5d3-e6f2-459f-82d3-fcc4d554c627 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435" status: 404 len: 111 microversion: 2.1 time: 0.029235 Nov 27 21:37:03.656909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3837/7809] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:03 2021] GET /compute/v2.1/servers/f020b7de-fce9-4eeb-a13d-e590b6cb8435 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:37:03.665435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:03.666021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:03.672772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:03.673228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:03.674010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:03.674457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:03.688891 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] HTTP exception thrown: Instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd could not be found. Nov 27 21:37:03.689408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Returning 404 to user: Instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:37:03.690232 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7dc98c39-a954-4930-9a1c-206fb917ec2d tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "DELETE /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 404 len: 111 microversion: 2.1 time: 0.029009 Nov 27 21:37:03.690774 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3973/7810] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:37:03 2021] DELETE /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:37:03.698555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:03.699179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] [instance: 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:03.705321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:03.705788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:03.706583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:03.707038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:03.721723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] HTTP exception thrown: Instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd could not be found. Nov 27 21:37:03.722331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] Returning 404 to user: Instance 659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:37:03.723160 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c73bf5e7-87a2-4e76-a5a5-eb25673993b5 tempest-ServerDiskConfigTestJSON-647132650 tempest-ServerDiskConfigTestJSON-647132650-project] 10.222.0.21 "GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd" status: 404 len: 111 microversion: 2.1 time: 0.028262 Nov 27 21:37:03.723731 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3838/7811] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:03 2021] GET /compute/v2.1/servers/659763f8-8c6b-4fbb-8f7f-d4b768e4a8bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:37:06.634071 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:37:06.635139 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:37:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:37:09.479132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9beb585-0ae6-4542-9cdd-ed4f487c1c2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'create', calling method: .version_select at 0x7f15c7379b80>, body: {"keypair": {"name": "tempest-keypair-1705610460"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:09.493895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f9beb585-0ae6-4542-9cdd-ed4f487c1c2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:37:09.499428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f9beb585-0ae6-4542-9cdd-ed4f487c1c2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:37:09.708602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f9beb585-0ae6-4542-9cdd-ed4f487c1c2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:37:09.718884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f9beb585-0ae6-4542-9cdd-ed4f487c1c2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:37:09.734887 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9beb585-0ae6-4542-9cdd-ed4f487c1c2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.380189 Nov 27 21:37:09.735755 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3974/7812] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:37:09 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:11.096822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2114982993", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7f8e8e5-e085-4395-9b1c-093e8c6acee0"}], "security_groups": [{"name": "tempest-securitygroup--488750309"}], "key_name": "tempest-keypair-1705610460", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:11.201317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] validate_networks() for [('d7f8e8e5-e085-4395-9b1c-093e8c6acee0', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:37:11.583881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:37:11.584611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:37:11.585209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:37:11.585738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:37:11.586305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:37:11.596218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:11.596818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:11.597757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:11.598363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:11.615806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:37:11.622636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:37:11.636374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:37:11.639016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:37:11.687399 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8221572b-4c95-42f3-a4d4-6458bc1431b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.594409 Nov 27 21:37:11.693780 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3839/7813] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:37:11 2021] POST /compute/v2.1/servers => generated 408 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:37:11.699677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aeab601f-ee8c-4a4f-8f0e-16f36063bf74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:11.700383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aeab601f-ee8c-4a4f-8f0e-16f36063bf74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:11.763570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aeab601f-ee8c-4a4f-8f0e-16f36063bf74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:11.770583 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aeab601f-ee8c-4a4f-8f0e-16f36063bf74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1239 microversion: 2.1 time: 0.076053 Nov 27 21:37:11.773353 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3975/7814] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:11 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:37:12.790557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:12.792600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:12.799818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:12.800600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:12.801604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:12.802285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:12.876479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:12.884202 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73e25b18-581a-4765-919d-93fe5b88d225 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1299 microversion: 2.1 time: 0.098267 Nov 27 21:37:12.885947 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3840/7815] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:12 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:13.902308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:13.902845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:13.911069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:13.911561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:13.912365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:13.912809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:14.079591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:14.088307 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f772f17-f825-40a9-bbbe-566820b2c38b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1364 microversion: 2.1 time: 0.189739 Nov 27 21:37:14.089145 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3976/7816] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:13 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:14.216374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-559d9a1d-7433-4952-9b4c-30b9e8dcc6a7 req-3ec0fa2b-fc52-4ca2-a763-b74b48109415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13f8196-ea7a-4cfd-9b52-2d3437bea9ff", "tag": "c413ace1-22f0-4361-ad6c-b30681cc923d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:14.219006 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:37:14.219006 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:37:14.227882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-559d9a1d-7433-4952-9b4c-30b9e8dcc6a7 req-3ec0fa2b-fc52-4ca2-a763-b74b48109415 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:14.229472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-559d9a1d-7433-4952-9b4c-30b9e8dcc6a7 req-3ec0fa2b-fc52-4ca2-a763-b74b48109415 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:14.256452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-559d9a1d-7433-4952-9b4c-30b9e8dcc6a7 req-3ec0fa2b-fc52-4ca2-a763-b74b48109415 service nova] Creating event network-changed:c413ace1-22f0-4361-ad6c-b30681cc923d for instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff on nch1-master-1 Nov 27 21:37:14.261865 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-559d9a1d-7433-4952-9b4c-30b9e8dcc6a7 req-3ec0fa2b-fc52-4ca2-a763-b74b48109415 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049872 Nov 27 21:37:14.262773 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3841/7817] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:37:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:37:15.105859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:15.106477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:15.113275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:15.113731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:15.114516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:15.114960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:15.245431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:15.252943 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71e80126-1223-4d0f-a3e7-091bcf34fd0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1364 microversion: 2.1 time: 0.151139 Nov 27 21:37:15.253556 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3977/7818] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:15 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:16.271392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:16.272110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:16.278397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:16.278868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:16.279726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:16.280188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:16.410323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:16.417780 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-04fd058a-5753-4c7e-a907-b0a1c0a3c540 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1364 microversion: 2.1 time: 0.151742 Nov 27 21:37:16.418356 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3842/7819] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:16 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:17.433854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:17.434458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:17.441241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:17.441686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:17.442469 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:17.442911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:17.569488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:17.577430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d825761-b496-4526-8a77-647b9e9e9af6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1364 microversion: 2.1 time: 0.147333 Nov 27 21:37:17.578007 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3978/7820] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:17 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:18.595886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:18.596600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:18.603695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:18.604205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:18.605022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:18.605632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:18.612097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-fb3ea82c-095b-42eb-a3b8-020077f3ebee req-813c244e-b316-41ea-9b50-de8c0e560c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13f8196-ea7a-4cfd-9b52-2d3437bea9ff", "name": "network-vif-plugged", "status": "completed", "tag": "c413ace1-22f0-4361-ad6c-b30681cc923d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:18.614281 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:37:18.614281 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:37:18.623285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fb3ea82c-095b-42eb-a3b8-020077f3ebee req-813c244e-b316-41ea-9b50-de8c0e560c69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:18.623774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-fb3ea82c-095b-42eb-a3b8-020077f3ebee req-813c244e-b316-41ea-9b50-de8c0e560c69 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:18.638107 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-fb3ea82c-095b-42eb-a3b8-020077f3ebee req-813c244e-b316-41ea-9b50-de8c0e560c69 service nova] Creating event network-vif-plugged:c413ace1-22f0-4361-ad6c-b30681cc923d for instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff on nch1-master-1 Nov 27 21:37:18.643826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-fb3ea82c-095b-42eb-a3b8-020077f3ebee req-813c244e-b316-41ea-9b50-de8c0e560c69 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Nov 27 21:37:18.644443 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3979/7821] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:37:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:37:19.099998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:19.108175 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a1799b85-840b-41d7-8e72-0b8438cafce6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1364 microversion: 2.1 time: 0.517500 Nov 27 21:37:19.108747 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3843/7822] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:18 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1364 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:20.126756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:20.127763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:20.133919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:20.134997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:20.135824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:20.136260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:20.278637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:20.285999 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28541e4d-da59-4af5-8c58-373991b7cb6a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1364 microversion: 2.1 time: 0.164152 Nov 27 21:37:20.286582 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3980/7823] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:20 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:37:21.303135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:21.303805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:21.310513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:21.310980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:21.311806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:21.312260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:21.452502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:37:21.459962 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ddb665d-700f-4341-8d41-1b33d7e03cb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1551 microversion: 2.1 time: 0.160571 Nov 27 21:37:21.460527 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3844/7824] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:37:21 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:37:21.475865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc2b0c62-d722-4890-9532-7a15401821f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:37:21.476430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc2b0c62-d722-4890-9532-7a15401821f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:21.482727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b0c62-d722-4890-9532-7a15401821f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:21.483178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b0c62-d722-4890-9532-7a15401821f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:21.483985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b0c62-d722-4890-9532-7a15401821f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:21.484418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc2b0c62-d722-4890-9532-7a15401821f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:21.563712 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc2b0c62-d722-4890-9532-7a15401821f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091569 Nov 27 21:37:21.564309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3981/7825] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:37:21 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:37:22.772963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87a9ea0d-685d-4833-9389-cf580540afe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:22.773991 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87a9ea0d-685d-4833-9389-cf580540afe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:22.776821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-63af9e2d-ca8e-41b6-a3b7-530148c6a429 req-c5f1c9cd-21f2-44f5-a5f0-0d2b02445300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13f8196-ea7a-4cfd-9b52-2d3437bea9ff", "tag": "c413ace1-22f0-4361-ad6c-b30681cc923d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:22.779086 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:37:22.779086 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:37:22.781440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87a9ea0d-685d-4833-9389-cf580540afe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:22.781926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87a9ea0d-685d-4833-9389-cf580540afe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:22.782767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87a9ea0d-685d-4833-9389-cf580540afe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:22.783171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87a9ea0d-685d-4833-9389-cf580540afe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:22.787281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-63af9e2d-ca8e-41b6-a3b7-530148c6a429 req-c5f1c9cd-21f2-44f5-a5f0-0d2b02445300 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:22.787804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-63af9e2d-ca8e-41b6-a3b7-530148c6a429 req-c5f1c9cd-21f2-44f5-a5f0-0d2b02445300 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:22.799465 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-63af9e2d-ca8e-41b6-a3b7-530148c6a429 req-c5f1c9cd-21f2-44f5-a5f0-0d2b02445300 service nova] Creating event network-changed:c413ace1-22f0-4361-ad6c-b30681cc923d for instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff on nch1-master-1 Nov 27 21:37:22.804547 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-63af9e2d-ca8e-41b6-a3b7-530148c6a429 req-c5f1c9cd-21f2-44f5-a5f0-0d2b02445300 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032919 Nov 27 21:37:22.805969 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3982/7826] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:37:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:37:22.823309 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87a9ea0d-685d-4833-9389-cf580540afe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.054082 Nov 27 21:37:22.824095 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3845/7827] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:22 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:23.835811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-abaaff11-2656-483e-b90f-fb12c2672575 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:23.836831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-abaaff11-2656-483e-b90f-fb12c2672575 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:23.843663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abaaff11-2656-483e-b90f-fb12c2672575 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:23.844142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abaaff11-2656-483e-b90f-fb12c2672575 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:23.844936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abaaff11-2656-483e-b90f-fb12c2672575 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:23.845396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abaaff11-2656-483e-b90f-fb12c2672575 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:23.882605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-abaaff11-2656-483e-b90f-fb12c2672575 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.051911 Nov 27 21:37:23.883169 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3983/7828] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:23 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:24.892996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ee917c0-c769-43fb-b507-ebbd319ea1d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:24.894036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ee917c0-c769-43fb-b507-ebbd319ea1d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:24.901275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ee917c0-c769-43fb-b507-ebbd319ea1d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:24.901736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ee917c0-c769-43fb-b507-ebbd319ea1d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:24.902522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ee917c0-c769-43fb-b507-ebbd319ea1d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:24.902970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ee917c0-c769-43fb-b507-ebbd319ea1d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:24.944165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ee917c0-c769-43fb-b507-ebbd319ea1d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.055179 Nov 27 21:37:24.944798 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3846/7829] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:24 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:25.955382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a87ee30-9114-4fb1-bd71-adc4c4039586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:25.956410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a87ee30-9114-4fb1-bd71-adc4c4039586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:25.963747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a87ee30-9114-4fb1-bd71-adc4c4039586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:25.964194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a87ee30-9114-4fb1-bd71-adc4c4039586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:25.964976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a87ee30-9114-4fb1-bd71-adc4c4039586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:25.965414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a87ee30-9114-4fb1-bd71-adc4c4039586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:26.002201 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a87ee30-9114-4fb1-bd71-adc4c4039586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.050826 Nov 27 21:37:26.003232 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3984/7830] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:25 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:27.014296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-27e3d7ac-b07a-42d3-8db4-674eb5efc77a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:27.015373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-27e3d7ac-b07a-42d3-8db4-674eb5efc77a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:27.023346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27e3d7ac-b07a-42d3-8db4-674eb5efc77a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:27.023819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27e3d7ac-b07a-42d3-8db4-674eb5efc77a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:27.024652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27e3d7ac-b07a-42d3-8db4-674eb5efc77a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:27.025108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-27e3d7ac-b07a-42d3-8db4-674eb5efc77a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:27.063615 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-27e3d7ac-b07a-42d3-8db4-674eb5efc77a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.053939 Nov 27 21:37:27.064231 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3847/7831] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:27 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:28.073982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28f3ea96-8c19-4d05-99b6-7cd8d27b2d41 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:28.075089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28f3ea96-8c19-4d05-99b6-7cd8d27b2d41 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:28.082410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f3ea96-8c19-4d05-99b6-7cd8d27b2d41 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:28.082861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f3ea96-8c19-4d05-99b6-7cd8d27b2d41 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:28.083677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f3ea96-8c19-4d05-99b6-7cd8d27b2d41 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:28.084119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28f3ea96-8c19-4d05-99b6-7cd8d27b2d41 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:28.121250 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28f3ea96-8c19-4d05-99b6-7cd8d27b2d41 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.051269 Nov 27 21:37:28.121881 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3985/7832] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:28 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:29.133286 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3c0e2817-0f05-4652-b740-4e74c427da03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:29.134381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3c0e2817-0f05-4652-b740-4e74c427da03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:29.142317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0e2817-0f05-4652-b740-4e74c427da03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:29.142795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0e2817-0f05-4652-b740-4e74c427da03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:29.143611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0e2817-0f05-4652-b740-4e74c427da03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:29.144067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3c0e2817-0f05-4652-b740-4e74c427da03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:29.183509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3c0e2817-0f05-4652-b740-4e74c427da03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.053682 Nov 27 21:37:29.184124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3848/7833] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:29 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:30.194772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c70b69c2-2955-4aa3-9303-cbcb21fab43f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:30.195809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c70b69c2-2955-4aa3-9303-cbcb21fab43f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:30.203665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c70b69c2-2955-4aa3-9303-cbcb21fab43f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:30.204119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c70b69c2-2955-4aa3-9303-cbcb21fab43f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:30.204896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c70b69c2-2955-4aa3-9303-cbcb21fab43f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:30.205338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c70b69c2-2955-4aa3-9303-cbcb21fab43f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:30.244636 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c70b69c2-2955-4aa3-9303-cbcb21fab43f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.053792 Nov 27 21:37:30.245368 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3986/7834] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:30 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:31.256170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62b4d492-742f-4501-89a7-1b4594a8911c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:31.257193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62b4d492-742f-4501-89a7-1b4594a8911c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:31.264746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b4d492-742f-4501-89a7-1b4594a8911c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:31.265217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b4d492-742f-4501-89a7-1b4594a8911c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:31.266012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b4d492-742f-4501-89a7-1b4594a8911c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:31.266462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b4d492-742f-4501-89a7-1b4594a8911c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:31.304342 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62b4d492-742f-4501-89a7-1b4594a8911c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.052471 Nov 27 21:37:31.304953 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3849/7835] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:31 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:32.315605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d8aab72-868c-4d53-8ae6-ca0139033732 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:32.316616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d8aab72-868c-4d53-8ae6-ca0139033732 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:32.323955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d8aab72-868c-4d53-8ae6-ca0139033732 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:32.324411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d8aab72-868c-4d53-8ae6-ca0139033732 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:32.325184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d8aab72-868c-4d53-8ae6-ca0139033732 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:32.325625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d8aab72-868c-4d53-8ae6-ca0139033732 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:32.362910 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d8aab72-868c-4d53-8ae6-ca0139033732 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 14 microversion: 2.1 time: 0.051335 Nov 27 21:37:32.363540 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3987/7836] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:32 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:37:33.374538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7765ac45-ee0c-4468-8c0e-a117b95c67fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:33.375582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7765ac45-ee0c-4468-8c0e-a117b95c67fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:33.383118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7765ac45-ee0c-4468-8c0e-a117b95c67fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:33.383621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7765ac45-ee0c-4468-8c0e-a117b95c67fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:33.384411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7765ac45-ee0c-4468-8c0e-a117b95c67fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:33.384862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7765ac45-ee0c-4468-8c0e-a117b95c67fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:33.435421 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7765ac45-ee0c-4468-8c0e-a117b95c67fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 8206 microversion: 2.1 time: 0.065356 Nov 27 21:37:33.436297 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3850/7837] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:33 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 8206 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:37:34.446463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d51bff0-93e9-4517-9c76-6267d7852c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:34.447550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d51bff0-93e9-4517-9c76-6267d7852c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:34.455494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d51bff0-93e9-4517-9c76-6267d7852c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:34.455947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d51bff0-93e9-4517-9c76-6267d7852c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:34.456727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d51bff0-93e9-4517-9c76-6267d7852c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:34.457162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d51bff0-93e9-4517-9c76-6267d7852c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:34.507037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d51bff0-93e9-4517-9c76-6267d7852c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 16398 microversion: 2.1 time: 0.064516 Nov 27 21:37:34.508005 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3988/7838] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:34 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 16398 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:35.518468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-83ded1ec-472c-4af4-aba3-95e2b19b8f92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:35.519511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-83ded1ec-472c-4af4-aba3-95e2b19b8f92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:35.527486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83ded1ec-472c-4af4-aba3-95e2b19b8f92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:35.527952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83ded1ec-472c-4af4-aba3-95e2b19b8f92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:35.528735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83ded1ec-472c-4af4-aba3-95e2b19b8f92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:35.529182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83ded1ec-472c-4af4-aba3-95e2b19b8f92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:35.568937 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-83ded1ec-472c-4af4-aba3-95e2b19b8f92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 16398 microversion: 2.1 time: 0.054433 Nov 27 21:37:35.569641 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3851/7839] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:35 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 16398 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:36.580612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2a48e5be-847c-4ece-887b-99039ded5782 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:36.581600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2a48e5be-847c-4ece-887b-99039ded5782 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:36.589332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a48e5be-847c-4ece-887b-99039ded5782 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:36.589779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a48e5be-847c-4ece-887b-99039ded5782 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:36.590549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a48e5be-847c-4ece-887b-99039ded5782 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:36.590980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2a48e5be-847c-4ece-887b-99039ded5782 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:36.629602 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2a48e5be-847c-4ece-887b-99039ded5782 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 16398 microversion: 2.1 time: 0.052902 Nov 27 21:37:36.630388 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3989/7840] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:36 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 16398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:37.641694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40bff066-ab7b-4dca-aad0-92a44633ffed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:37.642714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40bff066-ab7b-4dca-aad0-92a44633ffed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:37.650026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40bff066-ab7b-4dca-aad0-92a44633ffed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:37.650496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40bff066-ab7b-4dca-aad0-92a44633ffed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:37.651310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40bff066-ab7b-4dca-aad0-92a44633ffed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:37.651764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40bff066-ab7b-4dca-aad0-92a44633ffed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:37.690454 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40bff066-ab7b-4dca-aad0-92a44633ffed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 16398 microversion: 2.1 time: 0.052747 Nov 27 21:37:37.691075 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3852/7841] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:37 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 16398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:38.702494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b8e2b6fc-9ec4-4dfa-aaa1-468f4b8620a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:38.703470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b8e2b6fc-9ec4-4dfa-aaa1-468f4b8620a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:38.710808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8e2b6fc-9ec4-4dfa-aaa1-468f4b8620a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:38.711313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8e2b6fc-9ec4-4dfa-aaa1-468f4b8620a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:38.712082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8e2b6fc-9ec4-4dfa-aaa1-468f4b8620a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:38.712529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b8e2b6fc-9ec4-4dfa-aaa1-468f4b8620a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:38.754327 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b8e2b6fc-9ec4-4dfa-aaa1-468f4b8620a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 16398 microversion: 2.1 time: 0.056550 Nov 27 21:37:38.754946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3990/7842] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:38 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 16398 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:39.765945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8aba82b2-b5ea-4c99-aa5a-652ab59030a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:39.766986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8aba82b2-b5ea-4c99-aa5a-652ab59030a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:39.774258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aba82b2-b5ea-4c99-aa5a-652ab59030a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:39.774721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aba82b2-b5ea-4c99-aa5a-652ab59030a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:39.775524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aba82b2-b5ea-4c99-aa5a-652ab59030a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:39.775977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8aba82b2-b5ea-4c99-aa5a-652ab59030a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:39.829255 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8aba82b2-b5ea-4c99-aa5a-652ab59030a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.067277 Nov 27 21:37:39.829882 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3853/7843] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:39 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:40.841023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-311feea0-f6e2-4d06-9756-1288d27d4837 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:40.842031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-311feea0-f6e2-4d06-9756-1288d27d4837 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:40.849361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-311feea0-f6e2-4d06-9756-1288d27d4837 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:40.849809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-311feea0-f6e2-4d06-9756-1288d27d4837 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:40.850579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-311feea0-f6e2-4d06-9756-1288d27d4837 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:40.851013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-311feea0-f6e2-4d06-9756-1288d27d4837 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:40.892153 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-311feea0-f6e2-4d06-9756-1288d27d4837 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.055191 Nov 27 21:37:40.892763 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3991/7844] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:40 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:41.904344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ad200ce-0fc7-4c5a-8811-83849d8dbf40 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:41.905379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ad200ce-0fc7-4c5a-8811-83849d8dbf40 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:41.912691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad200ce-0fc7-4c5a-8811-83849d8dbf40 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:41.913164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad200ce-0fc7-4c5a-8811-83849d8dbf40 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:41.913958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad200ce-0fc7-4c5a-8811-83849d8dbf40 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:41.914413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ad200ce-0fc7-4c5a-8811-83849d8dbf40 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:41.956655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ad200ce-0fc7-4c5a-8811-83849d8dbf40 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.056464 Nov 27 21:37:41.957351 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3854/7845] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:41 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:42.969332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ea6be4f-8e3e-46d0-831f-a395ce49cfe5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:42.970329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ea6be4f-8e3e-46d0-831f-a395ce49cfe5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:42.977622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ea6be4f-8e3e-46d0-831f-a395ce49cfe5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:42.978067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ea6be4f-8e3e-46d0-831f-a395ce49cfe5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:42.978830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ea6be4f-8e3e-46d0-831f-a395ce49cfe5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:42.979324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ea6be4f-8e3e-46d0-831f-a395ce49cfe5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:43.021393 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ea6be4f-8e3e-46d0-831f-a395ce49cfe5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.056013 Nov 27 21:37:43.022016 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3992/7846] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:42 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:44.033604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc3ab942-ddda-4f33-ab7f-8e121ebe7c80 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:44.034660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc3ab942-ddda-4f33-ab7f-8e121ebe7c80 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:44.042719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc3ab942-ddda-4f33-ab7f-8e121ebe7c80 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:44.043192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc3ab942-ddda-4f33-ab7f-8e121ebe7c80 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:44.044024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc3ab942-ddda-4f33-ab7f-8e121ebe7c80 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:44.044485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc3ab942-ddda-4f33-ab7f-8e121ebe7c80 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:44.084425 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc3ab942-ddda-4f33-ab7f-8e121ebe7c80 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.054870 Nov 27 21:37:44.085070 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3855/7847] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:44 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:45.096340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-166ea285-e8bc-41e6-a29a-61b48b1bf7ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:45.097330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-166ea285-e8bc-41e6-a29a-61b48b1bf7ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:45.105022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-166ea285-e8bc-41e6-a29a-61b48b1bf7ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:45.105468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-166ea285-e8bc-41e6-a29a-61b48b1bf7ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:45.106230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-166ea285-e8bc-41e6-a29a-61b48b1bf7ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:45.106661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-166ea285-e8bc-41e6-a29a-61b48b1bf7ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:45.147116 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-166ea285-e8bc-41e6-a29a-61b48b1bf7ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.054642 Nov 27 21:37:45.147803 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3993/7848] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:45 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:46.159535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0826a209-0ccc-4cf3-b003-cf5c2b6a2372 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:46.160469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0826a209-0ccc-4cf3-b003-cf5c2b6a2372 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:46.167814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0826a209-0ccc-4cf3-b003-cf5c2b6a2372 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:46.168287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0826a209-0ccc-4cf3-b003-cf5c2b6a2372 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:46.169084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0826a209-0ccc-4cf3-b003-cf5c2b6a2372 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:46.169539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0826a209-0ccc-4cf3-b003-cf5c2b6a2372 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:46.209604 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0826a209-0ccc-4cf3-b003-cf5c2b6a2372 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.054139 Nov 27 21:37:46.210249 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3856/7849] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:46 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:47.221487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-026f566c-7088-45c9-b05a-6750eb82bb74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:47.222490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-026f566c-7088-45c9-b05a-6750eb82bb74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:47.230393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026f566c-7088-45c9-b05a-6750eb82bb74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:47.230855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026f566c-7088-45c9-b05a-6750eb82bb74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:47.231633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026f566c-7088-45c9-b05a-6750eb82bb74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:47.232069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-026f566c-7088-45c9-b05a-6750eb82bb74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:47.277734 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-026f566c-7088-45c9-b05a-6750eb82bb74 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.060166 Nov 27 21:37:47.278692 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3994/7850] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:47 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:48.289914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d28658c3-095a-44ce-a30f-28feff4fc241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:48.290929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d28658c3-095a-44ce-a30f-28feff4fc241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:48.298291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28658c3-095a-44ce-a30f-28feff4fc241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:48.298763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28658c3-095a-44ce-a30f-28feff4fc241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:48.299590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28658c3-095a-44ce-a30f-28feff4fc241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:48.300046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d28658c3-095a-44ce-a30f-28feff4fc241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:48.343881 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d28658c3-095a-44ce-a30f-28feff4fc241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.057942 Nov 27 21:37:48.344519 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3857/7851] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:48 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:49.356271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c37464b5-43b3-47bd-8e76-c527e32e6ad7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:49.357268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c37464b5-43b3-47bd-8e76-c527e32e6ad7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:49.364554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37464b5-43b3-47bd-8e76-c527e32e6ad7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:49.365003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37464b5-43b3-47bd-8e76-c527e32e6ad7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:49.365771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37464b5-43b3-47bd-8e76-c527e32e6ad7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:49.366207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c37464b5-43b3-47bd-8e76-c527e32e6ad7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:49.407105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c37464b5-43b3-47bd-8e76-c527e32e6ad7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.055376 Nov 27 21:37:49.407765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3995/7852] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:49 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:50.418988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24988a83-6ac5-4bad-83b7-27ace974dd29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:50.420075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24988a83-6ac5-4bad-83b7-27ace974dd29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:50.427447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24988a83-6ac5-4bad-83b7-27ace974dd29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:50.427925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24988a83-6ac5-4bad-83b7-27ace974dd29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:50.428727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24988a83-6ac5-4bad-83b7-27ace974dd29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:50.429298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24988a83-6ac5-4bad-83b7-27ace974dd29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:50.469386 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24988a83-6ac5-4bad-83b7-27ace974dd29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.054819 Nov 27 21:37:50.470023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3858/7853] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:50 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:51.481897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-79b650a1-91a3-4150-875a-eec5a5fd0724 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:51.483089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-79b650a1-91a3-4150-875a-eec5a5fd0724 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:51.490378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79b650a1-91a3-4150-875a-eec5a5fd0724 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:51.490822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79b650a1-91a3-4150-875a-eec5a5fd0724 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:51.491622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79b650a1-91a3-4150-875a-eec5a5fd0724 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:51.492053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-79b650a1-91a3-4150-875a-eec5a5fd0724 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:51.531100 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-79b650a1-91a3-4150-875a-eec5a5fd0724 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.053791 Nov 27 21:37:51.531750 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3996/7854] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:51 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:52.544148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da1006f2-f620-43c3-a4fa-3dc478c9aeba tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:52.545164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da1006f2-f620-43c3-a4fa-3dc478c9aeba tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:52.552188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1006f2-f620-43c3-a4fa-3dc478c9aeba tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:52.552659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1006f2-f620-43c3-a4fa-3dc478c9aeba tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:52.553453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1006f2-f620-43c3-a4fa-3dc478c9aeba tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:52.553905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da1006f2-f620-43c3-a4fa-3dc478c9aeba tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:52.593392 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da1006f2-f620-43c3-a4fa-3dc478c9aeba tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 24574 microversion: 2.1 time: 0.053995 Nov 27 21:37:52.594020 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3859/7855] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:52 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 24574 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:53.605357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d7b02c5-431c-4464-8645-0a5e64ea9443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:53.606365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d7b02c5-431c-4464-8645-0a5e64ea9443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:53.613397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7b02c5-431c-4464-8645-0a5e64ea9443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:53.613849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7b02c5-431c-4464-8645-0a5e64ea9443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:53.614622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7b02c5-431c-4464-8645-0a5e64ea9443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:53.615060 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d7b02c5-431c-4464-8645-0a5e64ea9443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:53.667473 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d7b02c5-431c-4464-8645-0a5e64ea9443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.066080 Nov 27 21:37:53.668092 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3997/7856] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:53 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:54.679586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ccac0de-8845-43e8-9c2b-2137dbce0155 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:54.680605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ccac0de-8845-43e8-9c2b-2137dbce0155 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:54.687882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ccac0de-8845-43e8-9c2b-2137dbce0155 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:54.688358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ccac0de-8845-43e8-9c2b-2137dbce0155 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:54.689154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ccac0de-8845-43e8-9c2b-2137dbce0155 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:54.689609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ccac0de-8845-43e8-9c2b-2137dbce0155 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:54.732675 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ccac0de-8845-43e8-9c2b-2137dbce0155 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.057067 Nov 27 21:37:54.733478 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3860/7857] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:54 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:55.745849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4878adc9-438b-474b-821c-e33ac9c61f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:55.747126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4878adc9-438b-474b-821c-e33ac9c61f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:55.754964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4878adc9-438b-474b-821c-e33ac9c61f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:55.755463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4878adc9-438b-474b-821c-e33ac9c61f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:55.756249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4878adc9-438b-474b-821c-e33ac9c61f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:55.756688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4878adc9-438b-474b-821c-e33ac9c61f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:55.799515 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4878adc9-438b-474b-821c-e33ac9c61f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058789 Nov 27 21:37:55.800427 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3998/7858] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:55 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:56.812110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1cb7fd4d-203f-46a5-9baf-a6dfdef9b1fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:56.813157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1cb7fd4d-203f-46a5-9baf-a6dfdef9b1fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:56.820446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cb7fd4d-203f-46a5-9baf-a6dfdef9b1fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:56.820911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cb7fd4d-203f-46a5-9baf-a6dfdef9b1fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:56.821706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cb7fd4d-203f-46a5-9baf-a6dfdef9b1fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:56.822160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1cb7fd4d-203f-46a5-9baf-a6dfdef9b1fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:56.863943 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1cb7fd4d-203f-46a5-9baf-a6dfdef9b1fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.056197 Nov 27 21:37:56.864596 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3861/7859] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:56 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:57.876899 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3c411317-9d3c-400c-b6bf-901d7e39ad65 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:57.878153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3c411317-9d3c-400c-b6bf-901d7e39ad65 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:57.885411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c411317-9d3c-400c-b6bf-901d7e39ad65 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:57.885855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c411317-9d3c-400c-b6bf-901d7e39ad65 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:57.887138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c411317-9d3c-400c-b6bf-901d7e39ad65 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:57.887627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3c411317-9d3c-400c-b6bf-901d7e39ad65 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:57.929508 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3c411317-9d3c-400c-b6bf-901d7e39ad65 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.056567 Nov 27 21:37:57.930434 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 3999/7860] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:57 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:37:58.941593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12fdb09b-5f5e-427b-8f9f-1c6a00f2b5c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:37:58.942623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12fdb09b-5f5e-427b-8f9f-1c6a00f2b5c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:37:58.950022 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12fdb09b-5f5e-427b-8f9f-1c6a00f2b5c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:58.950490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12fdb09b-5f5e-427b-8f9f-1c6a00f2b5c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:58.951294 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12fdb09b-5f5e-427b-8f9f-1c6a00f2b5c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:37:58.951750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12fdb09b-5f5e-427b-8f9f-1c6a00f2b5c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:37:58.993655 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12fdb09b-5f5e-427b-8f9f-1c6a00f2b5c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.056047 Nov 27 21:37:58.994276 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3862/7861] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:37:58 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:00.006017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-54588121-39f4-4dd6-a8b9-d24ea6eae0c3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:00.007007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-54588121-39f4-4dd6-a8b9-d24ea6eae0c3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:00.014298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54588121-39f4-4dd6-a8b9-d24ea6eae0c3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:00.014747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54588121-39f4-4dd6-a8b9-d24ea6eae0c3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:00.015548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54588121-39f4-4dd6-a8b9-d24ea6eae0c3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:00.015983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54588121-39f4-4dd6-a8b9-d24ea6eae0c3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:00.058989 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-54588121-39f4-4dd6-a8b9-d24ea6eae0c3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.056502 Nov 27 21:38:00.059697 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4000/7862] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:00 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:01.071116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c37dfaea-b816-4d6c-b3a4-5fac3966d4e4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:01.072156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c37dfaea-b816-4d6c-b3a4-5fac3966d4e4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:01.080108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c37dfaea-b816-4d6c-b3a4-5fac3966d4e4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:01.080575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c37dfaea-b816-4d6c-b3a4-5fac3966d4e4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:01.081370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c37dfaea-b816-4d6c-b3a4-5fac3966d4e4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:01.081820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c37dfaea-b816-4d6c-b3a4-5fac3966d4e4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:01.123976 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c37dfaea-b816-4d6c-b3a4-5fac3966d4e4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.056671 Nov 27 21:38:01.124615 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3863/7863] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:01 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:02.135924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f5f50b70-a424-485a-b5cc-bbe9f3369154 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:02.136932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f5f50b70-a424-485a-b5cc-bbe9f3369154 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:02.144277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5f50b70-a424-485a-b5cc-bbe9f3369154 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:02.144734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5f50b70-a424-485a-b5cc-bbe9f3369154 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:02.145511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5f50b70-a424-485a-b5cc-bbe9f3369154 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:02.145952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f5f50b70-a424-485a-b5cc-bbe9f3369154 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:02.191515 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f5f50b70-a424-485a-b5cc-bbe9f3369154 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059517 Nov 27 21:38:02.192137 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4001/7864] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:02 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:03.204850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42636ced-94f5-4240-aebb-d14a02115858 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:03.205871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42636ced-94f5-4240-aebb-d14a02115858 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:03.213376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42636ced-94f5-4240-aebb-d14a02115858 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:03.213837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42636ced-94f5-4240-aebb-d14a02115858 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:03.214630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42636ced-94f5-4240-aebb-d14a02115858 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:03.215079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42636ced-94f5-4240-aebb-d14a02115858 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:03.261160 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42636ced-94f5-4240-aebb-d14a02115858 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.061883 Nov 27 21:38:03.261797 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3864/7865] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:03 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:04.273880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52b5a0af-2629-4981-8e89-04398d38fe94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:04.274886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52b5a0af-2629-4981-8e89-04398d38fe94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:04.282708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52b5a0af-2629-4981-8e89-04398d38fe94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:04.283164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52b5a0af-2629-4981-8e89-04398d38fe94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:04.283967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52b5a0af-2629-4981-8e89-04398d38fe94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:04.284410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52b5a0af-2629-4981-8e89-04398d38fe94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:04.329636 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52b5a0af-2629-4981-8e89-04398d38fe94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059807 Nov 27 21:38:04.330264 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4002/7866] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:04 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:05.341692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ccf9c07-acc7-4572-9490-a0ca879566ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:05.342700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ccf9c07-acc7-4572-9490-a0ca879566ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:05.350117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccf9c07-acc7-4572-9490-a0ca879566ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:05.350588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccf9c07-acc7-4572-9490-a0ca879566ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:05.351413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccf9c07-acc7-4572-9490-a0ca879566ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:05.351874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ccf9c07-acc7-4572-9490-a0ca879566ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:05.397550 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ccf9c07-acc7-4572-9490-a0ca879566ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059830 Nov 27 21:38:05.398185 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3865/7867] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:05 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:06.409589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f849866-893f-41ba-ab9c-19bf19779e9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:06.410600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f849866-893f-41ba-ab9c-19bf19779e9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:06.417938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f849866-893f-41ba-ab9c-19bf19779e9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:06.418391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f849866-893f-41ba-ab9c-19bf19779e9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:06.419173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f849866-893f-41ba-ab9c-19bf19779e9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:06.419642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f849866-893f-41ba-ab9c-19bf19779e9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:06.465863 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f849866-893f-41ba-ab9c-19bf19779e9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060229 Nov 27 21:38:06.466550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4003/7868] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:06 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:38:07.478040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b8b6a44a-df30-4c97-b256-493d43cb6ba5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:07.479066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b8b6a44a-df30-4c97-b256-493d43cb6ba5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:07.487058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8b6a44a-df30-4c97-b256-493d43cb6ba5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:07.487556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8b6a44a-df30-4c97-b256-493d43cb6ba5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:07.488363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8b6a44a-df30-4c97-b256-493d43cb6ba5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:07.488838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8b6a44a-df30-4c97-b256-493d43cb6ba5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:07.540452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b8b6a44a-df30-4c97-b256-493d43cb6ba5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.066424 Nov 27 21:38:07.541112 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3866/7869] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:07 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:08.552563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da57348b-9ebc-4d3f-8bd9-fc54903dbdd5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:08.553621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da57348b-9ebc-4d3f-8bd9-fc54903dbdd5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:08.561744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da57348b-9ebc-4d3f-8bd9-fc54903dbdd5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:08.562190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da57348b-9ebc-4d3f-8bd9-fc54903dbdd5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:08.562971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da57348b-9ebc-4d3f-8bd9-fc54903dbdd5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:08.563453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da57348b-9ebc-4d3f-8bd9-fc54903dbdd5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:08.612193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da57348b-9ebc-4d3f-8bd9-fc54903dbdd5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.063542 Nov 27 21:38:08.613094 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4004/7870] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:08 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:38:09.624788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3119591-642e-47fd-85a4-8d96f61182eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:09.625852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3119591-642e-47fd-85a4-8d96f61182eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:09.633888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3119591-642e-47fd-85a4-8d96f61182eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:09.634358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3119591-642e-47fd-85a4-8d96f61182eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:09.635157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3119591-642e-47fd-85a4-8d96f61182eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:09.635648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3119591-642e-47fd-85a4-8d96f61182eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:09.680955 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3119591-642e-47fd-85a4-8d96f61182eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060565 Nov 27 21:38:09.681903 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3867/7871] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:09 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:38:10.693221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e3fc948-72f9-4338-a1ef-7901cdd48fa2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:10.694147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e3fc948-72f9-4338-a1ef-7901cdd48fa2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:10.701418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e3fc948-72f9-4338-a1ef-7901cdd48fa2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:10.701872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e3fc948-72f9-4338-a1ef-7901cdd48fa2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:10.702643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e3fc948-72f9-4338-a1ef-7901cdd48fa2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:10.703080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e3fc948-72f9-4338-a1ef-7901cdd48fa2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:10.745722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e3fc948-72f9-4338-a1ef-7901cdd48fa2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.056474 Nov 27 21:38:10.746293 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4005/7872] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:10 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:11.757980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f64f22f5-44d4-42c9-97cf-23ba0ea39140 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:11.759031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f64f22f5-44d4-42c9-97cf-23ba0ea39140 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:11.767062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f64f22f5-44d4-42c9-97cf-23ba0ea39140 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:11.767552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f64f22f5-44d4-42c9-97cf-23ba0ea39140 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:11.768340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f64f22f5-44d4-42c9-97cf-23ba0ea39140 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:11.768791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f64f22f5-44d4-42c9-97cf-23ba0ea39140 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:11.813663 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f64f22f5-44d4-42c9-97cf-23ba0ea39140 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059663 Nov 27 21:38:11.814303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3868/7873] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:11 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:12.826355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f3f4b54-4d5e-4fff-9c20-9868fd9402b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:12.827407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f3f4b54-4d5e-4fff-9c20-9868fd9402b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:12.834684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3f4b54-4d5e-4fff-9c20-9868fd9402b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:12.835135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3f4b54-4d5e-4fff-9c20-9868fd9402b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:12.835932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3f4b54-4d5e-4fff-9c20-9868fd9402b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:12.836370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3f4b54-4d5e-4fff-9c20-9868fd9402b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:12.882447 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f3f4b54-4d5e-4fff-9c20-9868fd9402b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060505 Nov 27 21:38:12.883355 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4006/7874] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:12 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:13.894406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3859eac2-12ff-4b96-b519-ca3697623928 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:13.895458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3859eac2-12ff-4b96-b519-ca3697623928 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:13.903207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3859eac2-12ff-4b96-b519-ca3697623928 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:13.903716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3859eac2-12ff-4b96-b519-ca3697623928 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:13.905014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3859eac2-12ff-4b96-b519-ca3697623928 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:13.905472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3859eac2-12ff-4b96-b519-ca3697623928 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:13.952336 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3859eac2-12ff-4b96-b519-ca3697623928 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.061881 Nov 27 21:38:13.952970 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3869/7875] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:13 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:14.963794 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7a54f2fa-960f-44d6-837f-ee0e1f65a3db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:14.964800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7a54f2fa-960f-44d6-837f-ee0e1f65a3db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:14.972212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a54f2fa-960f-44d6-837f-ee0e1f65a3db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:14.972666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a54f2fa-960f-44d6-837f-ee0e1f65a3db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:14.973446 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a54f2fa-960f-44d6-837f-ee0e1f65a3db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:14.973883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7a54f2fa-960f-44d6-837f-ee0e1f65a3db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:15.020760 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7a54f2fa-960f-44d6-837f-ee0e1f65a3db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060914 Nov 27 21:38:15.021388 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4007/7876] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:14 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:16.033990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b1b56d15-faaa-4828-a67f-e2fa5c5cd5e8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:16.035031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b1b56d15-faaa-4828-a67f-e2fa5c5cd5e8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:16.042386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1b56d15-faaa-4828-a67f-e2fa5c5cd5e8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:16.042860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1b56d15-faaa-4828-a67f-e2fa5c5cd5e8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:16.043703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1b56d15-faaa-4828-a67f-e2fa5c5cd5e8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:16.044161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b1b56d15-faaa-4828-a67f-e2fa5c5cd5e8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:16.088560 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b1b56d15-faaa-4828-a67f-e2fa5c5cd5e8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059164 Nov 27 21:38:16.089187 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3870/7877] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:16 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:17.100958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02f30dbc-e570-4e97-83d1-7f9ff25f4435 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:17.101908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02f30dbc-e570-4e97-83d1-7f9ff25f4435 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:17.109265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f30dbc-e570-4e97-83d1-7f9ff25f4435 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:17.109720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f30dbc-e570-4e97-83d1-7f9ff25f4435 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:17.110493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f30dbc-e570-4e97-83d1-7f9ff25f4435 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:17.110933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02f30dbc-e570-4e97-83d1-7f9ff25f4435 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:17.154702 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02f30dbc-e570-4e97-83d1-7f9ff25f4435 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.057865 Nov 27 21:38:17.155340 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4008/7878] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:17 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:18.166473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d892cc0d-5ef9-48be-8e00-2d04ff5743c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:18.167550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d892cc0d-5ef9-48be-8e00-2d04ff5743c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:18.174866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d892cc0d-5ef9-48be-8e00-2d04ff5743c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:18.175363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d892cc0d-5ef9-48be-8e00-2d04ff5743c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:18.176165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d892cc0d-5ef9-48be-8e00-2d04ff5743c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:18.176623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d892cc0d-5ef9-48be-8e00-2d04ff5743c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:18.222466 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d892cc0d-5ef9-48be-8e00-2d04ff5743c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059954 Nov 27 21:38:18.223097 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3871/7879] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:18 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:19.235547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5e0c4d9-594e-4b26-b1da-3dcc5d393166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:19.236674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5e0c4d9-594e-4b26-b1da-3dcc5d393166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:19.243965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e0c4d9-594e-4b26-b1da-3dcc5d393166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:19.244412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e0c4d9-594e-4b26-b1da-3dcc5d393166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:19.245182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e0c4d9-594e-4b26-b1da-3dcc5d393166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:19.245614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5e0c4d9-594e-4b26-b1da-3dcc5d393166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:19.289245 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5e0c4d9-594e-4b26-b1da-3dcc5d393166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058393 Nov 27 21:38:19.290124 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4009/7880] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:19 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:20.301315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-78ea50d8-f252-4be7-9f8a-6e33ec678e93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:20.302339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-78ea50d8-f252-4be7-9f8a-6e33ec678e93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:20.309774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ea50d8-f252-4be7-9f8a-6e33ec678e93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:20.310839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ea50d8-f252-4be7-9f8a-6e33ec678e93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:20.311673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ea50d8-f252-4be7-9f8a-6e33ec678e93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:20.312125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-78ea50d8-f252-4be7-9f8a-6e33ec678e93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:20.361493 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-78ea50d8-f252-4be7-9f8a-6e33ec678e93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.064137 Nov 27 21:38:20.362135 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3872/7881] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:20 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:21.374151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-18307ff2-6f3e-4471-b71b-c2733c778ba4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:21.375184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-18307ff2-6f3e-4471-b71b-c2733c778ba4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:21.382866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18307ff2-6f3e-4471-b71b-c2733c778ba4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:21.383334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18307ff2-6f3e-4471-b71b-c2733c778ba4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:21.384103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18307ff2-6f3e-4471-b71b-c2733c778ba4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:21.384533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-18307ff2-6f3e-4471-b71b-c2733c778ba4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:21.430856 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-18307ff2-6f3e-4471-b71b-c2733c778ba4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.061092 Nov 27 21:38:21.431553 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4010/7882] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:21 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:22.442716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b55e5262-249f-46ae-ac06-513855490298 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:22.443794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b55e5262-249f-46ae-ac06-513855490298 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:22.451332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b55e5262-249f-46ae-ac06-513855490298 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:22.451807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b55e5262-249f-46ae-ac06-513855490298 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:22.452606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b55e5262-249f-46ae-ac06-513855490298 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:22.453058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b55e5262-249f-46ae-ac06-513855490298 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:22.497964 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b55e5262-249f-46ae-ac06-513855490298 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059359 Nov 27 21:38:22.498593 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3873/7883] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:22 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:23.510301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eeffd851-6f6c-4c5d-bddd-7837418ab6d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:23.511345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eeffd851-6f6c-4c5d-bddd-7837418ab6d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:23.519226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eeffd851-6f6c-4c5d-bddd-7837418ab6d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:23.520197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eeffd851-6f6c-4c5d-bddd-7837418ab6d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:23.520977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eeffd851-6f6c-4c5d-bddd-7837418ab6d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:23.521413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eeffd851-6f6c-4c5d-bddd-7837418ab6d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:23.567052 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eeffd851-6f6c-4c5d-bddd-7837418ab6d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060626 Nov 27 21:38:23.567974 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4011/7884] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:23 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:24.579836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dce290b1-9efa-49c1-b876-042e131f06d2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:24.580878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dce290b1-9efa-49c1-b876-042e131f06d2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:24.588178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dce290b1-9efa-49c1-b876-042e131f06d2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:24.588652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dce290b1-9efa-49c1-b876-042e131f06d2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:24.589438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dce290b1-9efa-49c1-b876-042e131f06d2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:24.589892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dce290b1-9efa-49c1-b876-042e131f06d2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:24.633180 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dce290b1-9efa-49c1-b876-042e131f06d2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058055 Nov 27 21:38:24.633986 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3874/7885] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:24 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:25.645778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0c46fbc-e458-49a1-8a4d-1678389033d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:25.646779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0c46fbc-e458-49a1-8a4d-1678389033d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:25.654720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c46fbc-e458-49a1-8a4d-1678389033d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:25.655171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c46fbc-e458-49a1-8a4d-1678389033d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:25.655968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c46fbc-e458-49a1-8a4d-1678389033d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:25.656433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c46fbc-e458-49a1-8a4d-1678389033d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:25.701215 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0c46fbc-e458-49a1-8a4d-1678389033d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058772 Nov 27 21:38:25.701808 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4012/7886] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:25 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:26.713521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3af1116-c139-489d-84a2-813fc6e8d376 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:26.714469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3af1116-c139-489d-84a2-813fc6e8d376 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:26.722409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3af1116-c139-489d-84a2-813fc6e8d376 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:26.722885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3af1116-c139-489d-84a2-813fc6e8d376 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:26.723713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3af1116-c139-489d-84a2-813fc6e8d376 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:26.724170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3af1116-c139-489d-84a2-813fc6e8d376 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:26.765300 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3af1116-c139-489d-84a2-813fc6e8d376 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.055948 Nov 27 21:38:26.765932 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3875/7887] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:26 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:27.777287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02053a20-aa4b-48c3-8f36-00d6007c3ce0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:27.778287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02053a20-aa4b-48c3-8f36-00d6007c3ce0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:27.785594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02053a20-aa4b-48c3-8f36-00d6007c3ce0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:27.786044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02053a20-aa4b-48c3-8f36-00d6007c3ce0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:27.786816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02053a20-aa4b-48c3-8f36-00d6007c3ce0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:27.787284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02053a20-aa4b-48c3-8f36-00d6007c3ce0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:27.831193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02053a20-aa4b-48c3-8f36-00d6007c3ce0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.057833 Nov 27 21:38:27.831854 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4013/7888] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:27 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:28.842832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-47b3acff-3f33-4df0-9a18-1d50fdd0c0d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:28.843878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-47b3acff-3f33-4df0-9a18-1d50fdd0c0d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:28.851245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47b3acff-3f33-4df0-9a18-1d50fdd0c0d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:28.851736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47b3acff-3f33-4df0-9a18-1d50fdd0c0d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:28.852521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47b3acff-3f33-4df0-9a18-1d50fdd0c0d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:28.852972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-47b3acff-3f33-4df0-9a18-1d50fdd0c0d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:28.894886 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-47b3acff-3f33-4df0-9a18-1d50fdd0c0d3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.055987 Nov 27 21:38:28.895540 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3876/7889] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:28 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:29.907564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e32fbed4-9d90-4f24-bf17-7d4eccd65255 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:29.908566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e32fbed4-9d90-4f24-bf17-7d4eccd65255 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:29.915861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e32fbed4-9d90-4f24-bf17-7d4eccd65255 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:29.916342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e32fbed4-9d90-4f24-bf17-7d4eccd65255 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:29.917117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e32fbed4-9d90-4f24-bf17-7d4eccd65255 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:29.917556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e32fbed4-9d90-4f24-bf17-7d4eccd65255 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:29.962667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e32fbed4-9d90-4f24-bf17-7d4eccd65255 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059736 Nov 27 21:38:29.963328 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4014/7890] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:29 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:30.976189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e06d94bc-ea31-4b7f-a0b3-61ff8f91fef7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:30.977238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e06d94bc-ea31-4b7f-a0b3-61ff8f91fef7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:30.985102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e06d94bc-ea31-4b7f-a0b3-61ff8f91fef7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:30.985563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e06d94bc-ea31-4b7f-a0b3-61ff8f91fef7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:30.986360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e06d94bc-ea31-4b7f-a0b3-61ff8f91fef7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:30.986809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e06d94bc-ea31-4b7f-a0b3-61ff8f91fef7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:31.031497 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e06d94bc-ea31-4b7f-a0b3-61ff8f91fef7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059798 Nov 27 21:38:31.032139 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3877/7891] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:30 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:32.043649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-17854a6f-f79a-4855-a5c9-5b883b765146 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:32.045233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-17854a6f-f79a-4855-a5c9-5b883b765146 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:32.052671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17854a6f-f79a-4855-a5c9-5b883b765146 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:32.053126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17854a6f-f79a-4855-a5c9-5b883b765146 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:32.053909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17854a6f-f79a-4855-a5c9-5b883b765146 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:32.054360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-17854a6f-f79a-4855-a5c9-5b883b765146 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:32.097685 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-17854a6f-f79a-4855-a5c9-5b883b765146 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058030 Nov 27 21:38:32.098323 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4015/7892] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:32 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:33.110273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1ffe61b0-6aa6-4460-845d-dcd61a325b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:33.111310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1ffe61b0-6aa6-4460-845d-dcd61a325b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:33.119114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ffe61b0-6aa6-4460-845d-dcd61a325b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:33.119994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ffe61b0-6aa6-4460-845d-dcd61a325b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:33.121436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ffe61b0-6aa6-4460-845d-dcd61a325b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:33.122239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ffe61b0-6aa6-4460-845d-dcd61a325b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:33.173883 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1ffe61b0-6aa6-4460-845d-dcd61a325b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.068032 Nov 27 21:38:33.174515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3878/7893] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:33 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:38:34.186555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39ff3088-a14d-42d1-8946-667642d194dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:34.187586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39ff3088-a14d-42d1-8946-667642d194dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:34.194828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39ff3088-a14d-42d1-8946-667642d194dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:34.195299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39ff3088-a14d-42d1-8946-667642d194dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:34.196072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39ff3088-a14d-42d1-8946-667642d194dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:34.196512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39ff3088-a14d-42d1-8946-667642d194dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:34.245610 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39ff3088-a14d-42d1-8946-667642d194dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.063510 Nov 27 21:38:34.246412 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4016/7894] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:34 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:35.258249 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e614f69b-de0f-406d-b26a-f62824858371 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:35.259279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e614f69b-de0f-406d-b26a-f62824858371 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:35.271042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e614f69b-de0f-406d-b26a-f62824858371 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:35.271539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e614f69b-de0f-406d-b26a-f62824858371 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:35.272370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e614f69b-de0f-406d-b26a-f62824858371 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:35.272822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e614f69b-de0f-406d-b26a-f62824858371 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:35.318225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e614f69b-de0f-406d-b26a-f62824858371 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.063782 Nov 27 21:38:35.318897 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3879/7895] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:35 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:36.330516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f27d46b-2fb8-4aba-83af-fde0753a721e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:36.331479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f27d46b-2fb8-4aba-83af-fde0753a721e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:36.338823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f27d46b-2fb8-4aba-83af-fde0753a721e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:36.339313 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f27d46b-2fb8-4aba-83af-fde0753a721e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:36.340090 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f27d46b-2fb8-4aba-83af-fde0753a721e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:36.340527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f27d46b-2fb8-4aba-83af-fde0753a721e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:36.386681 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f27d46b-2fb8-4aba-83af-fde0753a721e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060244 Nov 27 21:38:36.387338 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4017/7896] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:36 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:38:37.398836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dc8455aa-0bc1-4ab9-bc1a-fc7d4914fcae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:37.399913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dc8455aa-0bc1-4ab9-bc1a-fc7d4914fcae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:37.407243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc8455aa-0bc1-4ab9-bc1a-fc7d4914fcae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:37.407742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc8455aa-0bc1-4ab9-bc1a-fc7d4914fcae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:37.408542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc8455aa-0bc1-4ab9-bc1a-fc7d4914fcae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:37.409001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dc8455aa-0bc1-4ab9-bc1a-fc7d4914fcae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:37.455939 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dc8455aa-0bc1-4ab9-bc1a-fc7d4914fcae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.061017 Nov 27 21:38:37.456594 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3880/7897] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:37 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:38.468625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9d5e31ab-5916-49d6-a874-58278ca84432 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:38.469657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9d5e31ab-5916-49d6-a874-58278ca84432 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:38.477318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d5e31ab-5916-49d6-a874-58278ca84432 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:38.477764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d5e31ab-5916-49d6-a874-58278ca84432 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:38.478528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d5e31ab-5916-49d6-a874-58278ca84432 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:38.478963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9d5e31ab-5916-49d6-a874-58278ca84432 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:38.521614 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9d5e31ab-5916-49d6-a874-58278ca84432 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.057477 Nov 27 21:38:38.522258 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4018/7898] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:38 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:39.534598 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0197cd34-f3ef-41d8-86f9-513f6bc89ffc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:39.535688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0197cd34-f3ef-41d8-86f9-513f6bc89ffc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:39.543019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0197cd34-f3ef-41d8-86f9-513f6bc89ffc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:39.543514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0197cd34-f3ef-41d8-86f9-513f6bc89ffc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:39.544987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0197cd34-f3ef-41d8-86f9-513f6bc89ffc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:39.545419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0197cd34-f3ef-41d8-86f9-513f6bc89ffc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:39.591496 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0197cd34-f3ef-41d8-86f9-513f6bc89ffc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060305 Nov 27 21:38:39.592108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3881/7899] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:39 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:40.603451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f53b544-d792-416c-b06a-e5bee76420be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:40.604453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f53b544-d792-416c-b06a-e5bee76420be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:40.612359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f53b544-d792-416c-b06a-e5bee76420be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:40.612746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f53b544-d792-416c-b06a-e5bee76420be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:40.613500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f53b544-d792-416c-b06a-e5bee76420be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:40.613937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f53b544-d792-416c-b06a-e5bee76420be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:40.659878 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f53b544-d792-416c-b06a-e5bee76420be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060169 Nov 27 21:38:40.660599 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4019/7900] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:40 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:41.673166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d054498a-e2d4-45ce-9c21-543320febfcd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:41.674190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d054498a-e2d4-45ce-9c21-543320febfcd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:41.681495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d054498a-e2d4-45ce-9c21-543320febfcd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:41.681959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d054498a-e2d4-45ce-9c21-543320febfcd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:41.682739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d054498a-e2d4-45ce-9c21-543320febfcd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:41.683185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d054498a-e2d4-45ce-9c21-543320febfcd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:41.726550 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d054498a-e2d4-45ce-9c21-543320febfcd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058077 Nov 27 21:38:41.727124 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3882/7901] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:41 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:42.738678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b5b2de07-d719-442d-ab41-0a2683224ea2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:42.739669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b5b2de07-d719-442d-ab41-0a2683224ea2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:42.746988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b2de07-d719-442d-ab41-0a2683224ea2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:42.747496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b2de07-d719-442d-ab41-0a2683224ea2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:42.748917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b2de07-d719-442d-ab41-0a2683224ea2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:42.749362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b5b2de07-d719-442d-ab41-0a2683224ea2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:42.793512 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b5b2de07-d719-442d-ab41-0a2683224ea2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058865 Nov 27 21:38:42.794141 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4020/7902] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:42 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:43.806369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0a864103-6891-4095-96cc-b53913ddada4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:43.807434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0a864103-6891-4095-96cc-b53913ddada4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:43.815273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a864103-6891-4095-96cc-b53913ddada4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:43.815745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a864103-6891-4095-96cc-b53913ddada4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:43.816542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a864103-6891-4095-96cc-b53913ddada4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:43.817000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a864103-6891-4095-96cc-b53913ddada4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:43.860496 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0a864103-6891-4095-96cc-b53913ddada4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058124 Nov 27 21:38:43.861119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3883/7903] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:43 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:44.872546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-62cf849a-0723-49ee-9dea-bff0e51a08be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:44.873562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-62cf849a-0723-49ee-9dea-bff0e51a08be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:44.881207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62cf849a-0723-49ee-9dea-bff0e51a08be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:44.881700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62cf849a-0723-49ee-9dea-bff0e51a08be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:44.882476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62cf849a-0723-49ee-9dea-bff0e51a08be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:44.882920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-62cf849a-0723-49ee-9dea-bff0e51a08be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:44.927824 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-62cf849a-0723-49ee-9dea-bff0e51a08be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059202 Nov 27 21:38:44.928451 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4021/7904] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:44 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:45.940583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-decf661c-0079-447b-9eb7-b56b48ce58dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:45.941649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-decf661c-0079-447b-9eb7-b56b48ce58dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:45.949019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-decf661c-0079-447b-9eb7-b56b48ce58dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:45.949500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-decf661c-0079-447b-9eb7-b56b48ce58dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:45.950305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-decf661c-0079-447b-9eb7-b56b48ce58dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:45.950767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-decf661c-0079-447b-9eb7-b56b48ce58dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:45.994369 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-decf661c-0079-447b-9eb7-b56b48ce58dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058447 Nov 27 21:38:45.995015 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3884/7905] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:45 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:47.007369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1237e4ee-aeeb-4817-b5d6-2b6e5dd636b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:47.008365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1237e4ee-aeeb-4817-b5d6-2b6e5dd636b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:47.016168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1237e4ee-aeeb-4817-b5d6-2b6e5dd636b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:47.016613 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1237e4ee-aeeb-4817-b5d6-2b6e5dd636b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:47.017377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1237e4ee-aeeb-4817-b5d6-2b6e5dd636b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:47.017810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1237e4ee-aeeb-4817-b5d6-2b6e5dd636b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:47.064872 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1237e4ee-aeeb-4817-b5d6-2b6e5dd636b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.061714 Nov 27 21:38:47.065520 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4022/7906] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:47 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:48.077372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-312131e3-c8bf-42e0-8015-f4ff52b45315 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:48.078429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-312131e3-c8bf-42e0-8015-f4ff52b45315 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:48.085832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-312131e3-c8bf-42e0-8015-f4ff52b45315 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:48.086300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-312131e3-c8bf-42e0-8015-f4ff52b45315 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:48.087094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-312131e3-c8bf-42e0-8015-f4ff52b45315 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:48.087575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-312131e3-c8bf-42e0-8015-f4ff52b45315 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:48.131208 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-312131e3-c8bf-42e0-8015-f4ff52b45315 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058254 Nov 27 21:38:48.131900 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3885/7907] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:48 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:49.143144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a74e2689-bdf6-425e-a043-a876520f51e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:49.144170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a74e2689-bdf6-425e-a043-a876520f51e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:49.151479 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74e2689-bdf6-425e-a043-a876520f51e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:49.151927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74e2689-bdf6-425e-a043-a876520f51e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:49.152693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74e2689-bdf6-425e-a043-a876520f51e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:49.153126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a74e2689-bdf6-425e-a043-a876520f51e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:49.199454 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a74e2689-bdf6-425e-a043-a876520f51e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060233 Nov 27 21:38:49.200312 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4023/7908] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:49 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:50.211581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a39984f8-3445-4c9b-bbdd-449ac6eace0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:50.212602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a39984f8-3445-4c9b-bbdd-449ac6eace0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:50.219956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39984f8-3445-4c9b-bbdd-449ac6eace0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:50.220426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39984f8-3445-4c9b-bbdd-449ac6eace0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:50.221223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39984f8-3445-4c9b-bbdd-449ac6eace0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:50.221677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a39984f8-3445-4c9b-bbdd-449ac6eace0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:50.268513 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a39984f8-3445-4c9b-bbdd-449ac6eace0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.061009 Nov 27 21:38:50.269128 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3886/7909] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:50 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:51.281368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8cf7722a-1053-4ec3-a1da-2c82c7475e77 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:51.282413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8cf7722a-1053-4ec3-a1da-2c82c7475e77 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:51.289756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf7722a-1053-4ec3-a1da-2c82c7475e77 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:51.290212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf7722a-1053-4ec3-a1da-2c82c7475e77 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:51.290997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf7722a-1053-4ec3-a1da-2c82c7475e77 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:51.291475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8cf7722a-1053-4ec3-a1da-2c82c7475e77 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:51.336327 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8cf7722a-1053-4ec3-a1da-2c82c7475e77 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059703 Nov 27 21:38:51.336978 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4024/7910] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:51 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:52.348925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8945b044-663b-4819-8971-f09fc57bf6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:52.349945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8945b044-663b-4819-8971-f09fc57bf6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:52.357675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8945b044-663b-4819-8971-f09fc57bf6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:52.358141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8945b044-663b-4819-8971-f09fc57bf6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:52.358927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8945b044-663b-4819-8971-f09fc57bf6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:52.359415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8945b044-663b-4819-8971-f09fc57bf6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:52.405389 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8945b044-663b-4819-8971-f09fc57bf6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.060399 Nov 27 21:38:52.406009 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3887/7911] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:52 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:53.417618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1d4a5bf-7532-4151-916d-3db28a9cb6a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:53.418630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b1d4a5bf-7532-4151-916d-3db28a9cb6a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:53.426357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d4a5bf-7532-4151-916d-3db28a9cb6a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:53.426817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d4a5bf-7532-4151-916d-3db28a9cb6a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:53.427637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d4a5bf-7532-4151-916d-3db28a9cb6a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:53.428082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d4a5bf-7532-4151-916d-3db28a9cb6a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:53.473265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1d4a5bf-7532-4151-916d-3db28a9cb6a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059675 Nov 27 21:38:53.473907 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4025/7912] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:53 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:54.485543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1242ef5-a6dd-4661-a99a-6bd7453a989f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:54.486584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1242ef5-a6dd-4661-a99a-6bd7453a989f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:54.493940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1242ef5-a6dd-4661-a99a-6bd7453a989f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:54.494441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1242ef5-a6dd-4661-a99a-6bd7453a989f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:54.495282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1242ef5-a6dd-4661-a99a-6bd7453a989f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:54.495818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1242ef5-a6dd-4661-a99a-6bd7453a989f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:54.546191 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1242ef5-a6dd-4661-a99a-6bd7453a989f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.064547 Nov 27 21:38:54.546845 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3888/7913] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:54 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:55.557887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2ea67021-ffae-457b-a5a5-b30bcafe56f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:55.559003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2ea67021-ffae-457b-a5a5-b30bcafe56f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:55.566426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ea67021-ffae-457b-a5a5-b30bcafe56f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:55.566884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ea67021-ffae-457b-a5a5-b30bcafe56f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:55.567699 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ea67021-ffae-457b-a5a5-b30bcafe56f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:55.568139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2ea67021-ffae-457b-a5a5-b30bcafe56f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:55.612561 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2ea67021-ffae-457b-a5a5-b30bcafe56f2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.058600 Nov 27 21:38:55.613201 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4026/7914] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:55 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:56.624699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-41e8f163-fed1-4230-8518-18ec4dcbb26c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:56.625739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-41e8f163-fed1-4230-8518-18ec4dcbb26c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:56.633255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41e8f163-fed1-4230-8518-18ec4dcbb26c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:56.633720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41e8f163-fed1-4230-8518-18ec4dcbb26c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:56.634530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41e8f163-fed1-4230-8518-18ec4dcbb26c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:56.634977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-41e8f163-fed1-4230-8518-18ec4dcbb26c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:56.678607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-41e8f163-fed1-4230-8518-18ec4dcbb26c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.057940 Nov 27 21:38:56.679231 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3889/7915] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:56 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:57.691134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8c6a1fa1-9a47-40b7-9a0b-e24f9ff27c24 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:57.692217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8c6a1fa1-9a47-40b7-9a0b-e24f9ff27c24 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:57.699558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c6a1fa1-9a47-40b7-9a0b-e24f9ff27c24 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:57.699946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c6a1fa1-9a47-40b7-9a0b-e24f9ff27c24 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:57.700744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c6a1fa1-9a47-40b7-9a0b-e24f9ff27c24 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:57.701176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8c6a1fa1-9a47-40b7-9a0b-e24f9ff27c24 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:57.746471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8c6a1fa1-9a47-40b7-9a0b-e24f9ff27c24 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.059326 Nov 27 21:38:57.747344 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4027/7916] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:57 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:58.758380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4647eac-188a-4df9-b96b-69728178e197 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:58.759451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4647eac-188a-4df9-b96b-69728178e197 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:58.767278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4647eac-188a-4df9-b96b-69728178e197 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:58.767737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4647eac-188a-4df9-b96b-69728178e197 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:58.768547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4647eac-188a-4df9-b96b-69728178e197 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:58.768994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4647eac-188a-4df9-b96b-69728178e197 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:58.818371 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a4647eac-188a-4df9-b96b-69728178e197 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.063840 Nov 27 21:38:58.819193 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3890/7917] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:58 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:38:59.830378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f8cb87d-3cab-4906-bfb3-677db73d2b3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:38:59.831405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f8cb87d-3cab-4906-bfb3-677db73d2b3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:38:59.838615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f8cb87d-3cab-4906-bfb3-677db73d2b3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:59.839059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f8cb87d-3cab-4906-bfb3-677db73d2b3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:59.839880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f8cb87d-3cab-4906-bfb3-677db73d2b3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:38:59.840337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f8cb87d-3cab-4906-bfb3-677db73d2b3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:38:59.883852 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f8cb87d-3cab-4906-bfb3-677db73d2b3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.057377 Nov 27 21:38:59.884495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4028/7918] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:38:59 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:00.896034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6568564a-530b-4b3d-8f83-e81347d320c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:00.897050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6568564a-530b-4b3d-8f83-e81347d320c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:00.905180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6568564a-530b-4b3d-8f83-e81347d320c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:00.905638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6568564a-530b-4b3d-8f83-e81347d320c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:00.906429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6568564a-530b-4b3d-8f83-e81347d320c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:00.906879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6568564a-530b-4b3d-8f83-e81347d320c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:00.945829 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6568564a-530b-4b3d-8f83-e81347d320c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 32641 microversion: 2.1 time: 0.053755 Nov 27 21:39:00.946443 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3891/7919] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:00 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:01.957844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c310e25-1787-47fb-8730-d060fd4b22f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:01.958856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c310e25-1787-47fb-8730-d060fd4b22f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:01.966650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c310e25-1787-47fb-8730-d060fd4b22f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:01.967137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c310e25-1787-47fb-8730-d060fd4b22f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:01.967941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c310e25-1787-47fb-8730-d060fd4b22f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:01.968383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c310e25-1787-47fb-8730-d060fd4b22f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:02.024475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c310e25-1787-47fb-8730-d060fd4b22f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 200 len: 40796 microversion: 2.1 time: 0.070529 Nov 27 21:39:02.025124 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4029/7920] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:01 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 40796 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:02.036686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:02.037424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:02.045478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:02.045951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:02.046753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:02.047215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:02.181465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:02.188868 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-19c67aba-acae-4134-9f5d-c2ad036425b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1670 microversion: 2.1 time: 0.156237 Nov 27 21:39:02.189470 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3892/7921] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:02 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:02.205831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:02.206885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:02.213918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:02.214319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:02.215104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:02.215585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:02.242888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:02.249518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:39:02.256659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:39:02.257086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:39:02.257563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:39:02.257974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:39:02.258386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:39:02.318507 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddee0fb4-2bab-4044-aaa6-8742ee7a5166 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 202 len: 0 microversion: 2.1 time: 0.116759 Nov 27 21:39:02.319212 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4030/7922] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:02 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:39:02.327740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:02.328378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:02.334883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:02.335398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:02.336217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:02.336676 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:02.473095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:02.480596 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-824143fe-c7cf-45cf-9a54-8afe3a7b9477 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1679 microversion: 2.1 time: 0.157176 Nov 27 21:39:02.481175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3893/7923] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:02 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:03.499158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:03.499878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:03.510746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:03.511241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:03.512134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:03.512636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:03.663527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:03.671699 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87efbd1f-4dcf-4962-aedc-6c61a1662895 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1679 microversion: 2.1 time: 0.177459 Nov 27 21:39:03.672550 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4031/7924] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:03 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:04.690032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:04.690636 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:04.697436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:04.697912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:04.698714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:04.699176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:04.829102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:04.836555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2d378758-a65b-4319-8899-9d5ac76667c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.150369 Nov 27 21:39:04.837143 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3894/7925] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:04 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:05.853911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:05.854524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:05.861774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:05.862228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:05.863009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:05.863516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:05.991670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:05.999527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61d89baa-4a35-4723-a99c-dd9a2ea6646b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.149299 Nov 27 21:39:06.000085 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4032/7926] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:05 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:07.017517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:07.018140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:07.025014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:07.025478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:07.026275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:07.026728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:07.158113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:07.165448 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e1241d1a-14a4-4838-8318-d0978c8dc6a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.152313 Nov 27 21:39:07.166023 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3895/7927] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:07 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:08.182360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:08.182967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:08.189745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:08.190195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:08.190968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:08.191434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:08.323356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:08.331184 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-644eba9b-0ac3-4d7c-bd05-2a905de9d96c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.152469 Nov 27 21:39:08.331776 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4033/7928] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:08 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:09.347844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:09.348475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:09.355186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:09.355687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:09.357088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:09.357550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:09.490455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:09.497921 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4a4aa33f-f0bb-4c57-9d51-ae7a522300f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.153876 Nov 27 21:39:09.498504 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3896/7929] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:09 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:10.514781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:10.515440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:10.522459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:10.522917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:10.523738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:10.524178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:10.656167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:10.663673 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1d0d795-7b78-4b01-988a-b37b1c0b1434 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.152543 Nov 27 21:39:10.664281 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4034/7930] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:10 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:11.681089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:11.681722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:11.688965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:11.689442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:11.690271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:11.690733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:11.819356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:11.827519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-28a3acfa-6d89-4d46-9257-7f0349c7e98e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.150084 Nov 27 21:39:11.828095 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3897/7931] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:11 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:12.845097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:12.845677 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:12.852354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:12.852797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:12.853855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:12.854294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:12.984429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:12.991708 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-abf90e51-f450-4a1f-829a-d2af42826979 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.150858 Nov 27 21:39:12.992272 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4035/7932] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:12 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:14.009072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:14.009716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:14.017096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:14.017561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:14.018346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:14.018799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:14.151587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:14.159425 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b794af1-8eb1-4ec5-b534-d3495b615a67 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.154162 Nov 27 21:39:14.159997 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3898/7933] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:14 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:15.176888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:15.177492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:15.184184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:15.185205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:15.185971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:15.186415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:15.319546 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:15.327001 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03fa9cf6-d040-48ff-86a5-4892e767f1ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.153828 Nov 27 21:39:15.327608 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4036/7934] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:15 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:16.344201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:16.344827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:16.355054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:16.355549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:16.356364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:16.356816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:16.517947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:16.526338 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33abc457-c922-4621-87dd-1a455ca3cd44 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1684 microversion: 2.1 time: 0.186056 Nov 27 21:39:16.534554 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3899/7935] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:16 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:17.040918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-35720db0-0592-40b3-8ff6-b76b6e47769c req-cbf0afb7-85f2-4c15-a2c0-f011b0de667b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13f8196-ea7a-4cfd-9b52-2d3437bea9ff", "name": "network-vif-unplugged", "status": "completed", "tag": "c413ace1-22f0-4361-ad6c-b30681cc923d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:17.042885 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:39:17.042885 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:39:17.052338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-35720db0-0592-40b3-8ff6-b76b6e47769c req-cbf0afb7-85f2-4c15-a2c0-f011b0de667b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:17.052946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-35720db0-0592-40b3-8ff6-b76b6e47769c req-cbf0afb7-85f2-4c15-a2c0-f011b0de667b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:17.065543 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-35720db0-0592-40b3-8ff6-b76b6e47769c req-cbf0afb7-85f2-4c15-a2c0-f011b0de667b service nova] Creating event network-vif-unplugged:c413ace1-22f0-4361-ad6c-b30681cc923d for instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff on nch2-master-1 Nov 27 21:39:17.070987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-35720db0-0592-40b3-8ff6-b76b6e47769c req-cbf0afb7-85f2-4c15-a2c0-f011b0de667b service nova] Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:39:17.081822 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-35720db0-0592-40b3-8ff6-b76b6e47769c req-cbf0afb7-85f2-4c15-a2c0-f011b0de667b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044484 Nov 27 21:39:17.083292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4037/7936] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:39:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:39:17.542704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:17.543361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:17.550560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:17.551045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:17.551913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:17.552372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:17.706799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:17.714968 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-197184e9-c668-4888-9106-6f18f6193773 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1683 microversion: 2.1 time: 0.175898 Nov 27 21:39:17.715904 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3900/7937] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:17 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:18.732596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:18.733200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:18.740344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:18.740835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:18.741685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:18.742189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:18.878611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:18.886028 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8ad385b-5358-4048-92ee-9629b5bc68ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1681 microversion: 2.1 time: 0.157573 Nov 27 21:39:18.886593 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4038/7938] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:18 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:19.099015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-bad56b07-6531-4a4e-a27a-cd5da9b7edb1 req-dde699ab-4290-45a1-9287-5b65de1f0043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13f8196-ea7a-4cfd-9b52-2d3437bea9ff", "tag": "c413ace1-22f0-4361-ad6c-b30681cc923d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:19.100586 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:39:19.100586 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:39:19.108243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bad56b07-6531-4a4e-a27a-cd5da9b7edb1 req-dde699ab-4290-45a1-9287-5b65de1f0043 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:19.108713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-bad56b07-6531-4a4e-a27a-cd5da9b7edb1 req-dde699ab-4290-45a1-9287-5b65de1f0043 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:19.119915 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-bad56b07-6531-4a4e-a27a-cd5da9b7edb1 req-dde699ab-4290-45a1-9287-5b65de1f0043 service nova] Creating event network-changed:c413ace1-22f0-4361-ad6c-b30681cc923d for instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff on nch2-master-1 Nov 27 21:39:19.125706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-bad56b07-6531-4a4e-a27a-cd5da9b7edb1 req-dde699ab-4290-45a1-9287-5b65de1f0043 service nova] Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:39:19.136494 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-bad56b07-6531-4a4e-a27a-cd5da9b7edb1 req-dde699ab-4290-45a1-9287-5b65de1f0043 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041283 Nov 27 21:39:19.137070 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3901/7939] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:39:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:39:19.904325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:19.904908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:19.911534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:19.911987 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:19.912770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:19.913211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:20.052308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:20.059634 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d146aa07-fc62-433d-9bbd-450b63d618c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1681 microversion: 2.1 time: 0.159518 Nov 27 21:39:20.060172 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4039/7940] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:19 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:21.083615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:21.084331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:21.090546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:21.091097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:21.091940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:21.092384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:21.226635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:21.234501 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-522ee5bb-0f36-4c47-9528-05b28ddc0a02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1678 microversion: 2.1 time: 0.161417 Nov 27 21:39:21.235081 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3902/7941] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:21 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:39:21.251064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1798d268-657a-4c12-9b0a-8affd7bf3bcf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:21.251624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1798d268-657a-4c12-9b0a-8affd7bf3bcf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:21.258576 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1798d268-657a-4c12-9b0a-8affd7bf3bcf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:21.259007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1798d268-657a-4c12-9b0a-8affd7bf3bcf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:21.259815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1798d268-657a-4c12-9b0a-8affd7bf3bcf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:21.260272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1798d268-657a-4c12-9b0a-8affd7bf3bcf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:21.272606 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:39:21.272836 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:39:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:39:21.323625 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1798d268-657a-4c12-9b0a-8affd7bf3bcf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action" status: 204 len: 0 microversion: 2.1 time: 0.076687 Nov 27 21:39:21.324271 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4040/7942] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:21 2021] POST /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:39:21.332278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:21.332920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:21.339385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:21.339385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:21.340125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:21.340580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:21.545973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:21.553460 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0fbb1837-9150-4b6d-8e6a-384633af3c03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1678 microversion: 2.1 time: 0.224911 Nov 27 21:39:21.554091 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3903/7943] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:21 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:22.572561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:22.573260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:22.579322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:22.580010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:22.580774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:22.581481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:22.724843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:22.733610 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd3d3648-a7e4-4330-b1f4-c11c9d522845 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1670 microversion: 2.1 time: 0.166668 Nov 27 21:39:22.734187 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4041/7944] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:22 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:22.750414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:22.751056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:22.758115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:22.758600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:22.759451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:22.760137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:22.893931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:22.901747 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aaaa64f2-eb04-4c17-8b12-436ea901f515 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1670 microversion: 2.1 time: 0.155722 Nov 27 21:39:22.902257 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3904/7945] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:22 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:39:22.917741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:22.918350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:22.925058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:22.925515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:22.926300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:22.926741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:23.060315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:23.067761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0e4fa006-88c4-43f0-a2b4-42ba83ef5489 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1670 microversion: 2.1 time: 0.153622 Nov 27 21:39:23.068342 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4042/7946] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:22 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:23.083622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:23.084148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:23.090010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:23.090486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:23.091845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:23.092304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:23.116523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:39:23.193876 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6c3f7a14-1fb8-4c1c-a5fd-74eb9eccaeac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 204 len: 0 microversion: 2.1 time: 0.113353 Nov 27 21:39:23.194374 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3905/7947] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:39:23 2021] DELETE /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:39:23.203428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:23.204035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:23.209885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:23.210331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:23.211107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:23.211571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:23.338704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:23.346658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-457bff4d-7d04-44b2-860c-f440de32a454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1676 microversion: 2.1 time: 0.147665 Nov 27 21:39:23.347221 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4043/7948] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:23 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:24.363960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:24.364680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:24.371344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:24.371806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:24.372642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:24.373089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:24.509617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:24.518010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e5bc3de-e09a-4741-ad29-c86b508f535b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1676 microversion: 2.1 time: 0.157301 Nov 27 21:39:24.518782 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3906/7949] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:24 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:24.600128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4f3904dc-1bd2-4e1c-987d-b62b6f7f9b81 req-dfe6fd2c-9ef6-41f6-a0a6-940d1902a8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13f8196-ea7a-4cfd-9b52-2d3437bea9ff", "name": "network-vif-plugged", "status": "completed", "tag": "c413ace1-22f0-4361-ad6c-b30681cc923d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:24.602703 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:39:24.602703 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:39:24.615815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4f3904dc-1bd2-4e1c-987d-b62b6f7f9b81 req-dfe6fd2c-9ef6-41f6-a0a6-940d1902a8de service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:24.616432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4f3904dc-1bd2-4e1c-987d-b62b6f7f9b81 req-dfe6fd2c-9ef6-41f6-a0a6-940d1902a8de service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:24.634403 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4f3904dc-1bd2-4e1c-987d-b62b6f7f9b81 req-dfe6fd2c-9ef6-41f6-a0a6-940d1902a8de service nova] Creating event network-vif-plugged:c413ace1-22f0-4361-ad6c-b30681cc923d for instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff on nch2-master-1 Nov 27 21:39:24.639900 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4f3904dc-1bd2-4e1c-987d-b62b6f7f9b81 req-dfe6fd2c-9ef6-41f6-a0a6-940d1902a8de service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045524 Nov 27 21:39:24.640511 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4044/7950] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:39:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:39:25.536481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:25.537113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:25.544580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:25.545048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:25.545856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:25.546311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:25.582896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4690653d-531c-4c42-a403-a72799ca6a41 req-63263d06-f5c8-48bf-807e-1c363d77a0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13f8196-ea7a-4cfd-9b52-2d3437bea9ff", "name": "network-vif-deleted", "tag": "c413ace1-22f0-4361-ad6c-b30681cc923d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:25.585554 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:39:25.585554 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:39:25.596285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4690653d-531c-4c42-a403-a72799ca6a41 req-63263d06-f5c8-48bf-807e-1c363d77a0bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:25.596737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4690653d-531c-4c42-a403-a72799ca6a41 req-63263d06-f5c8-48bf-807e-1c363d77a0bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:25.609471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4690653d-531c-4c42-a403-a72799ca6a41 req-63263d06-f5c8-48bf-807e-1c363d77a0bc service nova] Creating event network-vif-deleted:c413ace1-22f0-4361-ad6c-b30681cc923d for instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff on nch2-master-1 Nov 27 21:39:25.624086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:25.627282 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4690653d-531c-4c42-a403-a72799ca6a41 req-63263d06-f5c8-48bf-807e-1c363d77a0bc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048743 Nov 27 21:39:25.628840 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4045/7951] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:39:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:39:25.634471 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-72e403b2-c59e-4925-938d-f8e6bed8e229 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 200 len: 1609 microversion: 2.1 time: 0.101539 Nov 27 21:39:25.635062 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3907/7952] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:25 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 1609 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:26.652950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:26.653763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:26.659981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:26.660439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:26.661209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:26.661672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:26.674627 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. Nov 27 21:39:26.675205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:39:26.676035 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b1d69dd2-2354-40c1-aace-b7b640f9f89c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 404 len: 111 microversion: 2.1 time: 0.028027 Nov 27 21:39:26.676555 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4046/7953] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:26 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:39:26.688415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:26.689041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:26.695896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:26.696364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:26.697155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:26.697609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:26.711577 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. Nov 27 21:39:26.712181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:39:26.713044 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ece8154-a6f0-4b63-a8d7-d16415d97d98 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 404 len: 111 microversion: 2.1 time: 0.028939 Nov 27 21:39:26.713591 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3908/7954] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:26 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:39:26.759663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-784055972", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "d7f8e8e5-e085-4395-9b1c-093e8c6acee0"}], "security_groups": [{"name": "tempest-securitygroup--488750309"}], "key_name": "tempest-keypair-1705610460", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:26.863118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] validate_networks() for [('d7f8e8e5-e085-4395-9b1c-093e8c6acee0', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:39:27.529938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:39:27.530377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:39:27.530839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:39:27.531292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:39:27.531710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:39:27.540565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:27.541027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:27.541848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:27.542292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:27.559425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:39:27.564496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:39:27.576452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:39:27.578759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:39:27.623552 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac321cd4-5386-4b9d-a339-b45a98e8663d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.867553 Nov 27 21:39:27.624204 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4047/7955] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:39:26 2021] POST /compute/v2.1/servers => generated 405 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:39:27.634183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46719235-e4e6-4d97-a47f-da51901d3a9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:27.634799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46719235-e4e6-4d97-a47f-da51901d3a9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:27.687466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-46719235-e4e6-4d97-a47f-da51901d3a9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:27.694798 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46719235-e4e6-4d97-a47f-da51901d3a9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1238 microversion: 2.1 time: 0.064302 Nov 27 21:39:27.699826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3909/7956] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:27 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:28.713647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:28.714183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:28.720778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:28.721240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:28.722025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:28.722472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:28.794771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:28.802540 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8807ddb2-3d8a-4daa-97b8-72eb5507d03b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1296 microversion: 2.1 time: 0.093632 Nov 27 21:39:28.803123 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4048/7957] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:28 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:29.819963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:29.820607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:29.830721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:29.830902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:29.831744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:29.832196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:29.861036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-9e377880-0797-4732-aae4-a1059f5fee69 req-0134d5b4-f4be-492d-b3f6-b5a8aa8bba57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf71db5b-1673-483b-9086-bf85ff0810a5", "tag": "4b9b3984-01a2-41a6-b059-356f9bf1e4b7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:29.863036 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:39:29.863036 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:39:29.887372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9e377880-0797-4732-aae4-a1059f5fee69 req-0134d5b4-f4be-492d-b3f6-b5a8aa8bba57 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:29.900121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-9e377880-0797-4732-aae4-a1059f5fee69 req-0134d5b4-f4be-492d-b3f6-b5a8aa8bba57 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:29.925411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-9e377880-0797-4732-aae4-a1059f5fee69 req-0134d5b4-f4be-492d-b3f6-b5a8aa8bba57 service nova] Creating event network-changed:4b9b3984-01a2-41a6-b059-356f9bf1e4b7 for instance bf71db5b-1673-483b-9086-bf85ff0810a5 on nch2-master-1 Nov 27 21:39:29.935914 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-9e377880-0797-4732-aae4-a1059f5fee69 req-0134d5b4-f4be-492d-b3f6-b5a8aa8bba57 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080048 Nov 27 21:39:29.940027 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4049/7958] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:39:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:39:30.013951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:30.022745 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a227f336-3f70-4cf0-ab66-8fb8f5ceb7b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.206345 Nov 27 21:39:30.023704 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3910/7959] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:29 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:31.042142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:31.042835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:31.049016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:31.049465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:31.050230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:31.050665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:31.183080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:31.191061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7871f667-4134-422c-9851-7ff19bd64685 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.153792 Nov 27 21:39:31.191660 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4050/7960] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:31 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:32.208900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:32.209506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:32.216911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:32.217379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:32.218176 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:32.218632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:32.348628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:32.356028 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4326fc2e-9454-4db7-86a7-4148a0f5ad1c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.150888 Nov 27 21:39:32.356600 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3911/7961] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:32 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:33.373148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:33.373785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:33.380786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:33.381238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:33.382012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:33.382451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:33.512017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:33.519242 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba570c0d-2d6d-4dfd-91d3-39c65c29299d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.149842 Nov 27 21:39:33.520270 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4051/7962] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:33 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:34.537960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:34.538688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:34.545940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:34.546415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:34.547202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:34.547677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:34.686033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:34.693672 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b084861-d386-40e4-8f95-0cf79931ba85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.159504 Nov 27 21:39:34.694730 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3912/7963] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:34 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:35.710848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:35.711401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:35.718123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:35.718568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:35.719396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:35.719833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:35.856299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:35.864067 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-36575960-dd6c-4d78-9f57-4b9c86953a83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.156938 Nov 27 21:39:35.864634 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4052/7964] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:35 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:36.751499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-aa9a52f0-1364-44f6-b627-1ea3917baefd req-55c38515-7a60-41db-8c57-934f0286141d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71db5b-1673-483b-9086-bf85ff0810a5", "name": "network-vif-plugged", "status": "completed", "tag": "4b9b3984-01a2-41a6-b059-356f9bf1e4b7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:36.753074 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:39:36.753074 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:39:36.760283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa9a52f0-1364-44f6-b627-1ea3917baefd req-55c38515-7a60-41db-8c57-934f0286141d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:36.760751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa9a52f0-1364-44f6-b627-1ea3917baefd req-55c38515-7a60-41db-8c57-934f0286141d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:36.771796 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-aa9a52f0-1364-44f6-b627-1ea3917baefd req-55c38515-7a60-41db-8c57-934f0286141d service nova] Creating event network-vif-plugged:4b9b3984-01a2-41a6-b059-356f9bf1e4b7 for instance bf71db5b-1673-483b-9086-bf85ff0810a5 on nch2-master-1 Nov 27 21:39:36.776863 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-aa9a52f0-1364-44f6-b627-1ea3917baefd req-55c38515-7a60-41db-8c57-934f0286141d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118040 Nov 27 21:39:36.777486 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3913/7965] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:39:36.882698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:36.883339 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:36.890894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:36.891379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:36.892169 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:36.892612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:37.026733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:37.034109 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2c1e6000-807e-4d26-9d80-325c005b37eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.156219 Nov 27 21:39:37.034675 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4053/7966] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:36 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:38.052640 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:38.053352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:38.059511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:38.059976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:38.060787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:38.061239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:38.201740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:38.209243 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e55df47a-a198-4003-9b15-39a9af67bd1d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1363 microversion: 2.1 time: 0.161548 Nov 27 21:39:38.209827 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3914/7967] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:38 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:39:39.227868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:39.228490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:39.234590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:39.235104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:39.235865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:39.236366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:39.364765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:39:39.372697 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bc15fb70-d608-4508-9a40-e5e6940c0c06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1549 microversion: 2.1 time: 0.149028 Nov 27 21:39:39.373272 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4054/7968] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:39:39 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:39:39.389933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-34346471-c439-44a4-9c4a-975c3035f19c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:39:39.390466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-34346471-c439-44a4-9c4a-975c3035f19c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:39.397241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34346471-c439-44a4-9c4a-975c3035f19c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:39.397705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34346471-c439-44a4-9c4a-975c3035f19c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:39.398487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34346471-c439-44a4-9c4a-975c3035f19c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:39.398942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-34346471-c439-44a4-9c4a-975c3035f19c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:39.476413 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-34346471-c439-44a4-9c4a-975c3035f19c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090776 Nov 27 21:39:39.477061 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3915/7969] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:39:39 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:39:40.728800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c839f9c5-7452-4927-b699-a868ce4d7b7b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:40.729727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c839f9c5-7452-4927-b699-a868ce4d7b7b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:40.737053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c839f9c5-7452-4927-b699-a868ce4d7b7b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:40.737519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c839f9c5-7452-4927-b699-a868ce4d7b7b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:40.738309 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c839f9c5-7452-4927-b699-a868ce4d7b7b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:40.738977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c839f9c5-7452-4927-b699-a868ce4d7b7b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:40.784486 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c839f9c5-7452-4927-b699-a868ce4d7b7b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.065882 Nov 27 21:39:40.786461 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4055/7970] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:40 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:40.796426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-a32cf90a-d24a-4629-b735-a3c3b351e11d req-dda01b7f-6997-49fa-8796-05ec449d4fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf71db5b-1673-483b-9086-bf85ff0810a5", "tag": "4b9b3984-01a2-41a6-b059-356f9bf1e4b7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:40.798014 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:39:40.798014 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:39:40.804966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a32cf90a-d24a-4629-b735-a3c3b351e11d req-dda01b7f-6997-49fa-8796-05ec449d4fff service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:40.805433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-a32cf90a-d24a-4629-b735-a3c3b351e11d req-dda01b7f-6997-49fa-8796-05ec449d4fff service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:40.817350 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-a32cf90a-d24a-4629-b735-a3c3b351e11d req-dda01b7f-6997-49fa-8796-05ec449d4fff service nova] Creating event network-changed:4b9b3984-01a2-41a6-b059-356f9bf1e4b7 for instance bf71db5b-1673-483b-9086-bf85ff0810a5 on nch2-master-1 Nov 27 21:39:40.822458 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-a32cf90a-d24a-4629-b735-a3c3b351e11d req-dda01b7f-6997-49fa-8796-05ec449d4fff service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101379 Nov 27 21:39:40.823059 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3916/7971] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:39:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:39:41.796851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-07aec841-cdcf-499a-89d0-93deb5527b83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:41.798064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-07aec841-cdcf-499a-89d0-93deb5527b83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:41.805431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07aec841-cdcf-499a-89d0-93deb5527b83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:41.805887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07aec841-cdcf-499a-89d0-93deb5527b83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:41.806660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07aec841-cdcf-499a-89d0-93deb5527b83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:41.807098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-07aec841-cdcf-499a-89d0-93deb5527b83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:41.845187 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-07aec841-cdcf-499a-89d0-93deb5527b83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.053035 Nov 27 21:39:41.845882 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4056/7972] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:41 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:42.857221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-46d050b2-eeaa-4a6d-accc-e7879fac5a28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:42.858241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-46d050b2-eeaa-4a6d-accc-e7879fac5a28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:42.865240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46d050b2-eeaa-4a6d-accc-e7879fac5a28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:42.865706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46d050b2-eeaa-4a6d-accc-e7879fac5a28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:42.866505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46d050b2-eeaa-4a6d-accc-e7879fac5a28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:42.866966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-46d050b2-eeaa-4a6d-accc-e7879fac5a28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:42.907818 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-46d050b2-eeaa-4a6d-accc-e7879fac5a28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.054686 Nov 27 21:39:42.908962 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3917/7973] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:42 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:43.919412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8a5dec11-de9d-4142-bba3-af793b322816 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:43.920429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8a5dec11-de9d-4142-bba3-af793b322816 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:43.927748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a5dec11-de9d-4142-bba3-af793b322816 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:43.928191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a5dec11-de9d-4142-bba3-af793b322816 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:43.928960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a5dec11-de9d-4142-bba3-af793b322816 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:43.929388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a5dec11-de9d-4142-bba3-af793b322816 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:43.966663 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8a5dec11-de9d-4142-bba3-af793b322816 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.051137 Nov 27 21:39:43.967333 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4057/7974] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:43 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:39:44.978186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a4ecbaeb-eead-4e3e-a099-376ac628652a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:44.979194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a4ecbaeb-eead-4e3e-a099-376ac628652a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:44.986785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4ecbaeb-eead-4e3e-a099-376ac628652a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:44.987277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4ecbaeb-eead-4e3e-a099-376ac628652a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:44.988086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4ecbaeb-eead-4e3e-a099-376ac628652a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:44.988540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a4ecbaeb-eead-4e3e-a099-376ac628652a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:45.026317 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a4ecbaeb-eead-4e3e-a099-376ac628652a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.052078 Nov 27 21:39:45.026925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3918/7975] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:44 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:46.037507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-297e71b7-1421-4694-9071-1f3218b7ab92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:46.038536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-297e71b7-1421-4694-9071-1f3218b7ab92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:46.046511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297e71b7-1421-4694-9071-1f3218b7ab92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:46.046964 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297e71b7-1421-4694-9071-1f3218b7ab92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:46.047837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297e71b7-1421-4694-9071-1f3218b7ab92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:46.048276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-297e71b7-1421-4694-9071-1f3218b7ab92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:46.083274 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-297e71b7-1421-4694-9071-1f3218b7ab92 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.049717 Nov 27 21:39:46.083878 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4058/7976] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:46 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:47.095463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4991dcf-0873-4ea1-b4ed-5114ad3e86b8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:47.096395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f4991dcf-0873-4ea1-b4ed-5114ad3e86b8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:47.103865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4991dcf-0873-4ea1-b4ed-5114ad3e86b8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:47.104333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4991dcf-0873-4ea1-b4ed-5114ad3e86b8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:47.105134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4991dcf-0873-4ea1-b4ed-5114ad3e86b8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:47.105585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4991dcf-0873-4ea1-b4ed-5114ad3e86b8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:47.144379 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f4991dcf-0873-4ea1-b4ed-5114ad3e86b8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.053851 Nov 27 21:39:47.144995 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3919/7977] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:47 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:48.156298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f4646ae-2d4d-4c21-b31d-01b0563828a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:48.157342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f4646ae-2d4d-4c21-b31d-01b0563828a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:48.164704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f4646ae-2d4d-4c21-b31d-01b0563828a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:48.165162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f4646ae-2d4d-4c21-b31d-01b0563828a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:48.165947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f4646ae-2d4d-4c21-b31d-01b0563828a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:48.166391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f4646ae-2d4d-4c21-b31d-01b0563828a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:48.201318 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f4646ae-2d4d-4c21-b31d-01b0563828a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.049665 Nov 27 21:39:48.202101 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4059/7978] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:48 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:49.212754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-18de6cea-9ada-4236-96bd-8b6928a82362 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:49.213678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-18de6cea-9ada-4236-96bd-8b6928a82362 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:49.221762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18de6cea-9ada-4236-96bd-8b6928a82362 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:49.222229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18de6cea-9ada-4236-96bd-8b6928a82362 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:49.223071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18de6cea-9ada-4236-96bd-8b6928a82362 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:49.223621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-18de6cea-9ada-4236-96bd-8b6928a82362 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:49.263304 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-18de6cea-9ada-4236-96bd-8b6928a82362 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 14 microversion: 2.1 time: 0.054496 Nov 27 21:39:49.264094 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3920/7979] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:49 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:39:50.274770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bbb0758b-1f63-4fdf-a936-a87ed5eae099 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:50.275739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bbb0758b-1f63-4fdf-a936-a87ed5eae099 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:50.283032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbb0758b-1f63-4fdf-a936-a87ed5eae099 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:50.283504 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbb0758b-1f63-4fdf-a936-a87ed5eae099 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:50.284279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbb0758b-1f63-4fdf-a936-a87ed5eae099 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:50.284716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bbb0758b-1f63-4fdf-a936-a87ed5eae099 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:50.332132 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bbb0758b-1f63-4fdf-a936-a87ed5eae099 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 8208 microversion: 2.1 time: 0.061435 Nov 27 21:39:50.332945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4060/7980] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:50 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 8208 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:39:51.343712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d2a49a9-8995-4852-b782-0d9dcdde2c42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:51.344755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d2a49a9-8995-4852-b782-0d9dcdde2c42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:51.352241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2a49a9-8995-4852-b782-0d9dcdde2c42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:51.352708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2a49a9-8995-4852-b782-0d9dcdde2c42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:51.353490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2a49a9-8995-4852-b782-0d9dcdde2c42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:51.353941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2a49a9-8995-4852-b782-0d9dcdde2c42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:51.401498 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d2a49a9-8995-4852-b782-0d9dcdde2c42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 16399 microversion: 2.1 time: 0.061721 Nov 27 21:39:51.402132 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3921/7981] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:51 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 16399 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:52.413379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e54449e7-57ef-49ab-b6f8-5a5496ba0ab2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:52.414378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e54449e7-57ef-49ab-b6f8-5a5496ba0ab2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:52.421716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e54449e7-57ef-49ab-b6f8-5a5496ba0ab2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:52.422159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e54449e7-57ef-49ab-b6f8-5a5496ba0ab2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:52.422923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e54449e7-57ef-49ab-b6f8-5a5496ba0ab2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:52.423388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e54449e7-57ef-49ab-b6f8-5a5496ba0ab2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:52.460592 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e54449e7-57ef-49ab-b6f8-5a5496ba0ab2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 16399 microversion: 2.1 time: 0.051187 Nov 27 21:39:52.461236 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4061/7982] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:52 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 16399 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:53.472633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c1633fa5-df00-4d07-b77a-41b5acdf8054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:53.473657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c1633fa5-df00-4d07-b77a-41b5acdf8054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:53.480733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1633fa5-df00-4d07-b77a-41b5acdf8054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:53.481869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1633fa5-df00-4d07-b77a-41b5acdf8054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:53.482651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1633fa5-df00-4d07-b77a-41b5acdf8054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:53.483100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1633fa5-df00-4d07-b77a-41b5acdf8054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:53.523485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c1633fa5-df00-4d07-b77a-41b5acdf8054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 16399 microversion: 2.1 time: 0.054635 Nov 27 21:39:53.524147 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3922/7983] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:53 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 16399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:54.536679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6bc7402e-dc45-4cdd-b46a-ca5a28abf239 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:54.537706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6bc7402e-dc45-4cdd-b46a-ca5a28abf239 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:54.544874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bc7402e-dc45-4cdd-b46a-ca5a28abf239 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:54.545326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bc7402e-dc45-4cdd-b46a-ca5a28abf239 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:54.546105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bc7402e-dc45-4cdd-b46a-ca5a28abf239 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:54.546545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6bc7402e-dc45-4cdd-b46a-ca5a28abf239 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:54.587871 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6bc7402e-dc45-4cdd-b46a-ca5a28abf239 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 16399 microversion: 2.1 time: 0.056690 Nov 27 21:39:54.588513 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4062/7984] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:54 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 16399 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:55.600248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ebc77e4e-1c82-41ad-a6f5-3b61e34e1314 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:55.601277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ebc77e4e-1c82-41ad-a6f5-3b61e34e1314 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:55.609081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc77e4e-1c82-41ad-a6f5-3b61e34e1314 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:55.609551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc77e4e-1c82-41ad-a6f5-3b61e34e1314 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:55.610361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc77e4e-1c82-41ad-a6f5-3b61e34e1314 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:55.610818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ebc77e4e-1c82-41ad-a6f5-3b61e34e1314 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:55.654415 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ebc77e4e-1c82-41ad-a6f5-3b61e34e1314 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 16399 microversion: 2.1 time: 0.058104 Nov 27 21:39:55.655071 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3923/7985] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:55 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 16399 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:56.666936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-718f50d1-abeb-4202-ba5d-beac02965c21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:56.667974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-718f50d1-abeb-4202-ba5d-beac02965c21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:56.674379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-718f50d1-abeb-4202-ba5d-beac02965c21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:56.674863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-718f50d1-abeb-4202-ba5d-beac02965c21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:56.675680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-718f50d1-abeb-4202-ba5d-beac02965c21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:56.676126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-718f50d1-abeb-4202-ba5d-beac02965c21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:56.725878 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-718f50d1-abeb-4202-ba5d-beac02965c21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.063788 Nov 27 21:39:56.726482 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4063/7986] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:56 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:57.737985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9dac546f-e798-4c04-a21e-5598dca81204 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:57.738919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9dac546f-e798-4c04-a21e-5598dca81204 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:57.747832 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9dac546f-e798-4c04-a21e-5598dca81204 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:57.749227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9dac546f-e798-4c04-a21e-5598dca81204 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:57.750119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9dac546f-e798-4c04-a21e-5598dca81204 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:57.750593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9dac546f-e798-4c04-a21e-5598dca81204 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:57.791009 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9dac546f-e798-4c04-a21e-5598dca81204 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.057018 Nov 27 21:39:57.791705 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3924/7987] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:57 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:58.802462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ddd4b6ef-d56b-4cb6-9473-3bdd70f20342 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:58.803498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ddd4b6ef-d56b-4cb6-9473-3bdd70f20342 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:58.810701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6ef-d56b-4cb6-9473-3bdd70f20342 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:58.811148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6ef-d56b-4cb6-9473-3bdd70f20342 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:58.811955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6ef-d56b-4cb6-9473-3bdd70f20342 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:58.812388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6ef-d56b-4cb6-9473-3bdd70f20342 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:58.849632 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ddd4b6ef-d56b-4cb6-9473-3bdd70f20342 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.051214 Nov 27 21:39:58.850518 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4064/7988] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:58 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:39:59.862088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81424f35-a008-474f-b30e-902d0c510df3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:39:59.863135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81424f35-a008-474f-b30e-902d0c510df3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:39:59.870539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81424f35-a008-474f-b30e-902d0c510df3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:59.871002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81424f35-a008-474f-b30e-902d0c510df3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:59.872462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81424f35-a008-474f-b30e-902d0c510df3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:39:59.872911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81424f35-a008-474f-b30e-902d0c510df3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:39:59.911059 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81424f35-a008-474f-b30e-902d0c510df3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052860 Nov 27 21:39:59.911764 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3925/7989] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:39:59 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:00.923199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7dd14b5-d0a8-4899-bdf9-e5f900e294eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:00.924253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7dd14b5-d0a8-4899-bdf9-e5f900e294eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:00.931530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7dd14b5-d0a8-4899-bdf9-e5f900e294eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:00.931980 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7dd14b5-d0a8-4899-bdf9-e5f900e294eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:00.932750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7dd14b5-d0a8-4899-bdf9-e5f900e294eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:00.933188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7dd14b5-d0a8-4899-bdf9-e5f900e294eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:00.970883 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7dd14b5-d0a8-4899-bdf9-e5f900e294eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.051676 Nov 27 21:40:00.971539 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4065/7990] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:00 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:40:01.983725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa2f622e-f724-486f-a5ca-3bdefc245fce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:01.984769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa2f622e-f724-486f-a5ca-3bdefc245fce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:01.992107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2f622e-f724-486f-a5ca-3bdefc245fce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:01.992577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2f622e-f724-486f-a5ca-3bdefc245fce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:01.993366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2f622e-f724-486f-a5ca-3bdefc245fce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:01.993818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fa2f622e-f724-486f-a5ca-3bdefc245fce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:02.031844 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa2f622e-f724-486f-a5ca-3bdefc245fce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052720 Nov 27 21:40:02.032487 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3926/7991] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:01 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:03.044252 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65588b9e-a30d-40c7-90ac-aa650129601e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:03.045241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65588b9e-a30d-40c7-90ac-aa650129601e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:03.052530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65588b9e-a30d-40c7-90ac-aa650129601e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:03.052978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65588b9e-a30d-40c7-90ac-aa650129601e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:03.053745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65588b9e-a30d-40c7-90ac-aa650129601e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:03.054180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65588b9e-a30d-40c7-90ac-aa650129601e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:03.092408 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65588b9e-a30d-40c7-90ac-aa650129601e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052626 Nov 27 21:40:03.093024 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4066/7992] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:03 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:04.104158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-201916b6-a673-47a6-a4e0-0e4e8f3ac037 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:04.105167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-201916b6-a673-47a6-a4e0-0e4e8f3ac037 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:04.112750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-201916b6-a673-47a6-a4e0-0e4e8f3ac037 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:04.113215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-201916b6-a673-47a6-a4e0-0e4e8f3ac037 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:04.114003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-201916b6-a673-47a6-a4e0-0e4e8f3ac037 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:04.114453 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-201916b6-a673-47a6-a4e0-0e4e8f3ac037 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:04.153825 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-201916b6-a673-47a6-a4e0-0e4e8f3ac037 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053669 Nov 27 21:40:04.154470 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3927/7993] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:04 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:05.165773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e96f697-7b9b-4cc5-8d00-b34c9a585b4b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:05.166790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e96f697-7b9b-4cc5-8d00-b34c9a585b4b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:05.174591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e96f697-7b9b-4cc5-8d00-b34c9a585b4b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:05.175045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e96f697-7b9b-4cc5-8d00-b34c9a585b4b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:05.175854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e96f697-7b9b-4cc5-8d00-b34c9a585b4b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:05.176333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e96f697-7b9b-4cc5-8d00-b34c9a585b4b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:05.215074 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e96f697-7b9b-4cc5-8d00-b34c9a585b4b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053290 Nov 27 21:40:05.215742 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4067/7994] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:05 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:40:06.227212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95e406b1-6a1b-41c3-89d5-7ffab4ae8402 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:06.228276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95e406b1-6a1b-41c3-89d5-7ffab4ae8402 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:06.235778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95e406b1-6a1b-41c3-89d5-7ffab4ae8402 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:06.236302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95e406b1-6a1b-41c3-89d5-7ffab4ae8402 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:06.237122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95e406b1-6a1b-41c3-89d5-7ffab4ae8402 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:06.237582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95e406b1-6a1b-41c3-89d5-7ffab4ae8402 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:06.276640 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95e406b1-6a1b-41c3-89d5-7ffab4ae8402 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053412 Nov 27 21:40:06.277275 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3928/7995] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:06 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:07.288635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0c7106b-7831-4182-809f-2d5115af9002 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:07.289637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0c7106b-7831-4182-809f-2d5115af9002 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:07.297643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0c7106b-7831-4182-809f-2d5115af9002 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:07.298104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0c7106b-7831-4182-809f-2d5115af9002 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:07.298904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0c7106b-7831-4182-809f-2d5115af9002 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:07.299369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0c7106b-7831-4182-809f-2d5115af9002 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:07.344081 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0c7106b-7831-4182-809f-2d5115af9002 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.059362 Nov 27 21:40:07.344876 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4068/7996] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:07 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:08.356774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-59795034-1d55-4da5-a724-01a53243dc53 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:08.357819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-59795034-1d55-4da5-a724-01a53243dc53 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:08.365160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59795034-1d55-4da5-a724-01a53243dc53 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:08.365626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59795034-1d55-4da5-a724-01a53243dc53 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:08.366425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59795034-1d55-4da5-a724-01a53243dc53 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:08.366881 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59795034-1d55-4da5-a724-01a53243dc53 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:08.410329 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-59795034-1d55-4da5-a724-01a53243dc53 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.058072 Nov 27 21:40:08.413108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3929/7997] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:08 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:09.424611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e171a359-3f74-483e-8f96-ed0a610993c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:09.425627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e171a359-3f74-483e-8f96-ed0a610993c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:09.433047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e171a359-3f74-483e-8f96-ed0a610993c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:09.433497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e171a359-3f74-483e-8f96-ed0a610993c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:09.434800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e171a359-3f74-483e-8f96-ed0a610993c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:09.435240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e171a359-3f74-483e-8f96-ed0a610993c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:09.474609 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e171a359-3f74-483e-8f96-ed0a610993c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053966 Nov 27 21:40:09.475241 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4069/7998] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:09 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:10.486391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f45c173-8d09-421a-ae80-0ec7ada71547 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:10.487443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f45c173-8d09-421a-ae80-0ec7ada71547 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:10.494773 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f45c173-8d09-421a-ae80-0ec7ada71547 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:10.495244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f45c173-8d09-421a-ae80-0ec7ada71547 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:10.496065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f45c173-8d09-421a-ae80-0ec7ada71547 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:10.496523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f45c173-8d09-421a-ae80-0ec7ada71547 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:10.535627 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f45c173-8d09-421a-ae80-0ec7ada71547 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053107 Nov 27 21:40:10.536259 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3930/7999] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:10 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:11.547776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9abeac36-9ec2-423d-b490-7ce9536ea4b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:11.548779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9abeac36-9ec2-423d-b490-7ce9536ea4b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:11.556119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9abeac36-9ec2-423d-b490-7ce9536ea4b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:11.556573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9abeac36-9ec2-423d-b490-7ce9536ea4b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:11.557355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9abeac36-9ec2-423d-b490-7ce9536ea4b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:11.557792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9abeac36-9ec2-423d-b490-7ce9536ea4b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:11.596053 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9abeac36-9ec2-423d-b490-7ce9536ea4b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052893 Nov 27 21:40:11.596675 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4070/8000] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:11 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:40:12.608706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7905ad85-3d97-4d57-9b82-865f21984b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:12.609759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7905ad85-3d97-4d57-9b82-865f21984b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:12.617203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7905ad85-3d97-4d57-9b82-865f21984b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:12.617674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7905ad85-3d97-4d57-9b82-865f21984b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:12.618464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7905ad85-3d97-4d57-9b82-865f21984b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:12.618921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7905ad85-3d97-4d57-9b82-865f21984b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:12.656925 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7905ad85-3d97-4d57-9b82-865f21984b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052802 Nov 27 21:40:12.657553 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3931/8001] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:12 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:13.668202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9ff6c32c-3993-4bcb-b9a3-8dd13416e1de tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:13.669240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9ff6c32c-3993-4bcb-b9a3-8dd13416e1de tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:13.676548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff6c32c-3993-4bcb-b9a3-8dd13416e1de tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:13.677008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff6c32c-3993-4bcb-b9a3-8dd13416e1de tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:13.677791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff6c32c-3993-4bcb-b9a3-8dd13416e1de tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:13.678238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9ff6c32c-3993-4bcb-b9a3-8dd13416e1de tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:13.716301 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9ff6c32c-3993-4bcb-b9a3-8dd13416e1de tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052012 Nov 27 21:40:13.716860 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4071/8002] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:13 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:14.728030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2941b77d-607a-4782-83e4-d0b75bbe9e0e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:14.728957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2941b77d-607a-4782-83e4-d0b75bbe9e0e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:14.736943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2941b77d-607a-4782-83e4-d0b75bbe9e0e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:14.737406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2941b77d-607a-4782-83e4-d0b75bbe9e0e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:14.738190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2941b77d-607a-4782-83e4-d0b75bbe9e0e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:14.738638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2941b77d-607a-4782-83e4-d0b75bbe9e0e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:14.777796 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2941b77d-607a-4782-83e4-d0b75bbe9e0e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053332 Nov 27 21:40:14.778433 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3932/8003] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:14 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:15.790126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cfa68be4-0480-411a-8a51-dbf3b9cf22dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:15.791142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cfa68be4-0480-411a-8a51-dbf3b9cf22dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:15.798642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfa68be4-0480-411a-8a51-dbf3b9cf22dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:15.799099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfa68be4-0480-411a-8a51-dbf3b9cf22dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:15.799918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfa68be4-0480-411a-8a51-dbf3b9cf22dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:15.800362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cfa68be4-0480-411a-8a51-dbf3b9cf22dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:15.839398 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cfa68be4-0480-411a-8a51-dbf3b9cf22dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053380 Nov 27 21:40:15.840716 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4072/8004] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:15 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:16.852116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-57e12ebc-e6a5-45d6-be56-fe8b52e60cd9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:16.853163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-57e12ebc-e6a5-45d6-be56-fe8b52e60cd9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:16.860699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57e12ebc-e6a5-45d6-be56-fe8b52e60cd9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:16.861162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57e12ebc-e6a5-45d6-be56-fe8b52e60cd9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:16.861952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57e12ebc-e6a5-45d6-be56-fe8b52e60cd9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:16.862403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-57e12ebc-e6a5-45d6-be56-fe8b52e60cd9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:16.902679 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-57e12ebc-e6a5-45d6-be56-fe8b52e60cd9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053996 Nov 27 21:40:16.903268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3933/8005] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:16 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:17.914582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-763d1c5b-622f-4f44-8f6e-5cf96857ea29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:17.915602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-763d1c5b-622f-4f44-8f6e-5cf96857ea29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:17.923544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-763d1c5b-622f-4f44-8f6e-5cf96857ea29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:17.923992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-763d1c5b-622f-4f44-8f6e-5cf96857ea29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:17.924757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-763d1c5b-622f-4f44-8f6e-5cf96857ea29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:17.925189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-763d1c5b-622f-4f44-8f6e-5cf96857ea29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:17.963401 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-763d1c5b-622f-4f44-8f6e-5cf96857ea29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052727 Nov 27 21:40:17.964032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4073/8006] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:17 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:18.975897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-959afe54-3425-468a-b861-37cdff6eda58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:18.976948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-959afe54-3425-468a-b861-37cdff6eda58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:18.984920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959afe54-3425-468a-b861-37cdff6eda58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:18.985383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959afe54-3425-468a-b861-37cdff6eda58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:18.986177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959afe54-3425-468a-b861-37cdff6eda58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:18.986625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-959afe54-3425-468a-b861-37cdff6eda58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:19.026977 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-959afe54-3425-468a-b861-37cdff6eda58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.055198 Nov 27 21:40:19.027672 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3934/8007] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:18 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:20.038402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3ff29b3-8781-459e-ad01-23d2afb95958 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:20.039424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3ff29b3-8781-459e-ad01-23d2afb95958 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:20.050501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3ff29b3-8781-459e-ad01-23d2afb95958 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:20.050948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3ff29b3-8781-459e-ad01-23d2afb95958 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:20.051748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3ff29b3-8781-459e-ad01-23d2afb95958 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:20.052186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3ff29b3-8781-459e-ad01-23d2afb95958 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:20.093926 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3ff29b3-8781-459e-ad01-23d2afb95958 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.059508 Nov 27 21:40:20.094693 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4074/8008] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:20 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:40:21.105932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f49e9bb0-4a43-47df-8784-d51a105f94eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:21.106948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f49e9bb0-4a43-47df-8784-d51a105f94eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:21.114296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f49e9bb0-4a43-47df-8784-d51a105f94eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:21.114763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f49e9bb0-4a43-47df-8784-d51a105f94eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:21.115631 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f49e9bb0-4a43-47df-8784-d51a105f94eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:21.116078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f49e9bb0-4a43-47df-8784-d51a105f94eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:21.157431 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f49e9bb0-4a43-47df-8784-d51a105f94eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.055489 Nov 27 21:40:21.158083 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3935/8009] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:21 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:22.170096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5564d0b9-5a57-418d-98fc-9071579a4011 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:22.171109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5564d0b9-5a57-418d-98fc-9071579a4011 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:22.179100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5564d0b9-5a57-418d-98fc-9071579a4011 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:22.179592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5564d0b9-5a57-418d-98fc-9071579a4011 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:22.180376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5564d0b9-5a57-418d-98fc-9071579a4011 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:22.180821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5564d0b9-5a57-418d-98fc-9071579a4011 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:22.218389 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5564d0b9-5a57-418d-98fc-9071579a4011 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052860 Nov 27 21:40:22.219015 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4075/8010] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:22 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:23.230436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e2f2fbe-9952-46c2-9b3a-0a862e59fffd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:23.231985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e2f2fbe-9952-46c2-9b3a-0a862e59fffd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:23.239415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2f2fbe-9952-46c2-9b3a-0a862e59fffd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:23.239896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2f2fbe-9952-46c2-9b3a-0a862e59fffd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:23.240686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2f2fbe-9952-46c2-9b3a-0a862e59fffd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:23.241137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e2f2fbe-9952-46c2-9b3a-0a862e59fffd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:23.279933 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e2f2fbe-9952-46c2-9b3a-0a862e59fffd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053494 Nov 27 21:40:23.280558 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3936/8011] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:23 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:24.292092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98b4f7aa-ff37-406d-b57a-e110a9876be5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:24.293097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98b4f7aa-ff37-406d-b57a-e110a9876be5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:24.300019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98b4f7aa-ff37-406d-b57a-e110a9876be5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:24.300476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98b4f7aa-ff37-406d-b57a-e110a9876be5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:24.301251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98b4f7aa-ff37-406d-b57a-e110a9876be5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:24.301690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98b4f7aa-ff37-406d-b57a-e110a9876be5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:24.340471 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98b4f7aa-ff37-406d-b57a-e110a9876be5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052562 Nov 27 21:40:24.341094 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4076/8012] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:24 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:25.352624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-060a3e46-93e8-4694-b5a5-690272d6ab00 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:25.353637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-060a3e46-93e8-4694-b5a5-690272d6ab00 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:25.360968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060a3e46-93e8-4694-b5a5-690272d6ab00 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:25.361429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060a3e46-93e8-4694-b5a5-690272d6ab00 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:25.362219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060a3e46-93e8-4694-b5a5-690272d6ab00 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:25.362670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-060a3e46-93e8-4694-b5a5-690272d6ab00 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:25.400891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-060a3e46-93e8-4694-b5a5-690272d6ab00 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052259 Nov 27 21:40:25.401517 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3937/8013] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:25 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:26.413590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-915f1420-c287-4cfc-bbce-f7e807f7c613 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:26.414579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-915f1420-c287-4cfc-bbce-f7e807f7c613 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:26.422415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915f1420-c287-4cfc-bbce-f7e807f7c613 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:26.422866 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915f1420-c287-4cfc-bbce-f7e807f7c613 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:26.423692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915f1420-c287-4cfc-bbce-f7e807f7c613 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:26.424378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-915f1420-c287-4cfc-bbce-f7e807f7c613 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:26.462136 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-915f1420-c287-4cfc-bbce-f7e807f7c613 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052526 Nov 27 21:40:26.462772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4077/8014] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:26 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:26.661716 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:40:26.661949 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:40:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:40:27.474403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15b992e7-d5be-4f6f-ab82-3eaaa7ed98b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:27.475459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15b992e7-d5be-4f6f-ab82-3eaaa7ed98b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:27.482813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15b992e7-d5be-4f6f-ab82-3eaaa7ed98b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:27.483333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15b992e7-d5be-4f6f-ab82-3eaaa7ed98b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:27.484109 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15b992e7-d5be-4f6f-ab82-3eaaa7ed98b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:27.484556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15b992e7-d5be-4f6f-ab82-3eaaa7ed98b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:27.522095 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15b992e7-d5be-4f6f-ab82-3eaaa7ed98b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.051436 Nov 27 21:40:27.522847 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3938/8015] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:27 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:28.534286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed16ffdf-9dea-4902-95ea-c3c739874720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:28.535383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed16ffdf-9dea-4902-95ea-c3c739874720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:28.542772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16ffdf-9dea-4902-95ea-c3c739874720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:28.543225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16ffdf-9dea-4902-95ea-c3c739874720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:28.544034 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16ffdf-9dea-4902-95ea-c3c739874720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:28.544474 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed16ffdf-9dea-4902-95ea-c3c739874720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:28.582579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed16ffdf-9dea-4902-95ea-c3c739874720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052252 Nov 27 21:40:28.583438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4078/8016] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:28 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:29.595601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-21890ee9-e843-48f4-af63-d6c828f6b113 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:29.596666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-21890ee9-e843-48f4-af63-d6c828f6b113 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:29.598764 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:40:29.599834 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:40:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action (ip 10.222.0.21) !!! Nov 27 21:40:29.617381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21890ee9-e843-48f4-af63-d6c828f6b113 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:29.618134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21890ee9-e843-48f4-af63-d6c828f6b113 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:29.619246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21890ee9-e843-48f4-af63-d6c828f6b113 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:29.620059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-21890ee9-e843-48f4-af63-d6c828f6b113 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:29.661273 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-21890ee9-e843-48f4-af63-d6c828f6b113 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.070651 Nov 27 21:40:29.661938 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3939/8017] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:29 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:30.674727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f538c67c-67fa-4103-8164-c45933cb6269 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:30.675785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f538c67c-67fa-4103-8164-c45933cb6269 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:30.683041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f538c67c-67fa-4103-8164-c45933cb6269 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:30.683521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f538c67c-67fa-4103-8164-c45933cb6269 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:30.683521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f538c67c-67fa-4103-8164-c45933cb6269 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:30.683521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f538c67c-67fa-4103-8164-c45933cb6269 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:30.723397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f538c67c-67fa-4103-8164-c45933cb6269 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052502 Nov 27 21:40:30.724777 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4079/8018] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:30 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:31.736129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24dcf34e-ea39-4346-80af-ef8598f8cb78 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:31.737196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24dcf34e-ea39-4346-80af-ef8598f8cb78 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:31.744545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dcf34e-ea39-4346-80af-ef8598f8cb78 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:31.745015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dcf34e-ea39-4346-80af-ef8598f8cb78 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:31.745811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dcf34e-ea39-4346-80af-ef8598f8cb78 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:31.746265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24dcf34e-ea39-4346-80af-ef8598f8cb78 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:31.784965 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24dcf34e-ea39-4346-80af-ef8598f8cb78 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.052858 Nov 27 21:40:31.785617 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3940/8019] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:31 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:32.797094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-599bf69e-82f2-4af6-91dd-76733124571e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:32.798140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-599bf69e-82f2-4af6-91dd-76733124571e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:32.805444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-599bf69e-82f2-4af6-91dd-76733124571e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:32.805895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-599bf69e-82f2-4af6-91dd-76733124571e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:32.806666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-599bf69e-82f2-4af6-91dd-76733124571e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:32.807112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-599bf69e-82f2-4af6-91dd-76733124571e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:32.848596 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-599bf69e-82f2-4af6-91dd-76733124571e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.055533 Nov 27 21:40:32.849227 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4080/8020] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:32 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:33.860941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a03d359c-1096-40e8-8ea1-46f94a367713 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:33.861954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a03d359c-1096-40e8-8ea1-46f94a367713 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:33.869247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a03d359c-1096-40e8-8ea1-46f94a367713 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:33.869709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a03d359c-1096-40e8-8ea1-46f94a367713 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:33.870495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a03d359c-1096-40e8-8ea1-46f94a367713 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:33.870973 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a03d359c-1096-40e8-8ea1-46f94a367713 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:33.912870 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a03d359c-1096-40e8-8ea1-46f94a367713 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.055839 Nov 27 21:40:33.913528 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3941/8021] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:33 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:34.925379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4c23b7ab-af82-4a0f-9f58-e9666cf51a49 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:34.926421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4c23b7ab-af82-4a0f-9f58-e9666cf51a49 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:34.933842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c23b7ab-af82-4a0f-9f58-e9666cf51a49 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:34.934296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c23b7ab-af82-4a0f-9f58-e9666cf51a49 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:34.935078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c23b7ab-af82-4a0f-9f58-e9666cf51a49 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:34.935558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4c23b7ab-af82-4a0f-9f58-e9666cf51a49 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:34.972103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4c23b7ab-af82-4a0f-9f58-e9666cf51a49 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.050723 Nov 27 21:40:34.972720 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4081/8022] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:34 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:40:35.984777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0636615-6e80-4cff-a13b-726c5df53b85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:35.985792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0636615-6e80-4cff-a13b-726c5df53b85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:35.993051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0636615-6e80-4cff-a13b-726c5df53b85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:35.993521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0636615-6e80-4cff-a13b-726c5df53b85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:35.994314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0636615-6e80-4cff-a13b-726c5df53b85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:35.994769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0636615-6e80-4cff-a13b-726c5df53b85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:36.034265 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0636615-6e80-4cff-a13b-726c5df53b85 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053936 Nov 27 21:40:36.034913 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3942/8023] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:35 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:37.046190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ebbaa328-1252-47e8-9dff-a55e6637ef6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:37.047222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ebbaa328-1252-47e8-9dff-a55e6637ef6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:37.054588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebbaa328-1252-47e8-9dff-a55e6637ef6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:37.055035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebbaa328-1252-47e8-9dff-a55e6637ef6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:37.055833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebbaa328-1252-47e8-9dff-a55e6637ef6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:37.056271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ebbaa328-1252-47e8-9dff-a55e6637ef6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:37.095816 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ebbaa328-1252-47e8-9dff-a55e6637ef6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.053493 Nov 27 21:40:37.096450 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4082/8024] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:37 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:38.107784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-23991910-325b-40e0-aec0-7aa89b8ead30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:38.108842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-23991910-325b-40e0-aec0-7aa89b8ead30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:38.116300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23991910-325b-40e0-aec0-7aa89b8ead30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:38.116775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23991910-325b-40e0-aec0-7aa89b8ead30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:38.117574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23991910-325b-40e0-aec0-7aa89b8ead30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:38.118030 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-23991910-325b-40e0-aec0-7aa89b8ead30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:38.160861 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-23991910-325b-40e0-aec0-7aa89b8ead30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.057088 Nov 27 21:40:38.161492 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3943/8025] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:38 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:39.173380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b67c95cc-4510-4a8d-b328-748782a9a499 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:39.174388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b67c95cc-4510-4a8d-b328-748782a9a499 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:39.181741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67c95cc-4510-4a8d-b328-748782a9a499 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:39.182195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67c95cc-4510-4a8d-b328-748782a9a499 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:39.183025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67c95cc-4510-4a8d-b328-748782a9a499 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:39.184128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b67c95cc-4510-4a8d-b328-748782a9a499 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:39.225258 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b67c95cc-4510-4a8d-b328-748782a9a499 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.055757 Nov 27 21:40:39.226634 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4083/8026] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:39 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:40.237471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2603704b-232f-4d33-895c-fecaf91fde3a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:40.238522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2603704b-232f-4d33-895c-fecaf91fde3a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:40.246451 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2603704b-232f-4d33-895c-fecaf91fde3a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:40.246923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2603704b-232f-4d33-895c-fecaf91fde3a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:40.247750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2603704b-232f-4d33-895c-fecaf91fde3a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:40.248210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2603704b-232f-4d33-895c-fecaf91fde3a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:40.288441 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2603704b-232f-4d33-895c-fecaf91fde3a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.054949 Nov 27 21:40:40.289063 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3944/8027] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:40 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:41.300206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f3de967-20ed-4069-be60-bbf7f0886345 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:41.301245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f3de967-20ed-4069-be60-bbf7f0886345 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:41.308591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3de967-20ed-4069-be60-bbf7f0886345 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:41.309042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3de967-20ed-4069-be60-bbf7f0886345 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:41.309817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3de967-20ed-4069-be60-bbf7f0886345 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:41.310257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f3de967-20ed-4069-be60-bbf7f0886345 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:41.358096 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f3de967-20ed-4069-be60-bbf7f0886345 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 24571 microversion: 2.1 time: 0.061839 Nov 27 21:40:41.358908 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4084/8028] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:41 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:42.370256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad675573-175c-4700-9991-c0c825559618 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:42.371303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad675573-175c-4700-9991-c0c825559618 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:42.378984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad675573-175c-4700-9991-c0c825559618 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:42.379484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad675573-175c-4700-9991-c0c825559618 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:42.380321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad675573-175c-4700-9991-c0c825559618 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:42.380777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad675573-175c-4700-9991-c0c825559618 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:42.433322 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad675573-175c-4700-9991-c0c825559618 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.066972 Nov 27 21:40:42.433972 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3945/8029] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:42 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:43.446033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4517f2c5-7a59-43fb-80e3-7c94896ca09a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:43.447180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4517f2c5-7a59-43fb-80e3-7c94896ca09a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:43.454973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4517f2c5-7a59-43fb-80e3-7c94896ca09a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:43.455451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4517f2c5-7a59-43fb-80e3-7c94896ca09a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:43.456981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4517f2c5-7a59-43fb-80e3-7c94896ca09a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:43.457999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4517f2c5-7a59-43fb-80e3-7c94896ca09a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:43.499495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4517f2c5-7a59-43fb-80e3-7c94896ca09a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.057366 Nov 27 21:40:43.500150 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4085/8030] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:43 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:44.511882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b5763cf-343d-4bc9-902c-9fca895239fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:44.512902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b5763cf-343d-4bc9-902c-9fca895239fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:44.520279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5763cf-343d-4bc9-902c-9fca895239fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:44.520753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5763cf-343d-4bc9-902c-9fca895239fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:44.521665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5763cf-343d-4bc9-902c-9fca895239fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:44.522105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b5763cf-343d-4bc9-902c-9fca895239fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:44.562846 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b5763cf-343d-4bc9-902c-9fca895239fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055077 Nov 27 21:40:44.563518 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3946/8031] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:44 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:45.575004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a0bb551f-30e2-403e-bb1f-df69a0fa1211 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:45.576030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a0bb551f-30e2-403e-bb1f-df69a0fa1211 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:45.583217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0bb551f-30e2-403e-bb1f-df69a0fa1211 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:45.583689 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0bb551f-30e2-403e-bb1f-df69a0fa1211 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:45.584454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0bb551f-30e2-403e-bb1f-df69a0fa1211 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:45.584891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a0bb551f-30e2-403e-bb1f-df69a0fa1211 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:45.625495 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a0bb551f-30e2-403e-bb1f-df69a0fa1211 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055023 Nov 27 21:40:45.626429 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4086/8032] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:45 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:46.638745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d258cf5b-6e40-4f0a-802e-c089ad0939a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:46.639709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d258cf5b-6e40-4f0a-802e-c089ad0939a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:46.647078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d258cf5b-6e40-4f0a-802e-c089ad0939a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:46.647569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d258cf5b-6e40-4f0a-802e-c089ad0939a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:46.648362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d258cf5b-6e40-4f0a-802e-c089ad0939a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:46.648814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d258cf5b-6e40-4f0a-802e-c089ad0939a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:46.691702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d258cf5b-6e40-4f0a-802e-c089ad0939a5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.057547 Nov 27 21:40:46.692345 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3947/8033] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:46 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:47.702985 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d698e155-ab8b-462d-b6eb-0116d20dcab6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:47.703953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d698e155-ab8b-462d-b6eb-0116d20dcab6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:47.711193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d698e155-ab8b-462d-b6eb-0116d20dcab6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:47.711673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d698e155-ab8b-462d-b6eb-0116d20dcab6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:47.712447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d698e155-ab8b-462d-b6eb-0116d20dcab6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:47.712881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d698e155-ab8b-462d-b6eb-0116d20dcab6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:47.752667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d698e155-ab8b-462d-b6eb-0116d20dcab6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053729 Nov 27 21:40:47.753292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4087/8034] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:47 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:48.765508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63a7b25d-9430-4f74-863a-5beebe98c931 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:48.766769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63a7b25d-9430-4f74-863a-5beebe98c931 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:48.774610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a7b25d-9430-4f74-863a-5beebe98c931 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:48.775083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a7b25d-9430-4f74-863a-5beebe98c931 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:48.775916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a7b25d-9430-4f74-863a-5beebe98c931 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:48.776381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63a7b25d-9430-4f74-863a-5beebe98c931 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:48.817242 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63a7b25d-9430-4f74-863a-5beebe98c931 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055739 Nov 27 21:40:48.817884 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3948/8035] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:48 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:49.830475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81693db5-1d1b-4721-b78c-8ece34dcdce5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:49.831511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81693db5-1d1b-4721-b78c-8ece34dcdce5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:49.838946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81693db5-1d1b-4721-b78c-8ece34dcdce5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:49.839473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81693db5-1d1b-4721-b78c-8ece34dcdce5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:49.840255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81693db5-1d1b-4721-b78c-8ece34dcdce5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:49.840693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81693db5-1d1b-4721-b78c-8ece34dcdce5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:49.879182 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81693db5-1d1b-4721-b78c-8ece34dcdce5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.052468 Nov 27 21:40:49.879861 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4088/8036] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:49 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:50.892043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8134c5c3-45ae-40b0-b842-e57a5e799ebe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:50.893099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8134c5c3-45ae-40b0-b842-e57a5e799ebe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:50.900447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8134c5c3-45ae-40b0-b842-e57a5e799ebe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:50.900917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8134c5c3-45ae-40b0-b842-e57a5e799ebe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:50.902328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8134c5c3-45ae-40b0-b842-e57a5e799ebe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:50.902779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8134c5c3-45ae-40b0-b842-e57a5e799ebe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:50.942047 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8134c5c3-45ae-40b0-b842-e57a5e799ebe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053952 Nov 27 21:40:50.942676 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3949/8037] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:50 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:51.954383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d6ca160b-daf3-45c4-b565-f930e517aa4f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:51.955406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d6ca160b-daf3-45c4-b565-f930e517aa4f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:51.962715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6ca160b-daf3-45c4-b565-f930e517aa4f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:51.963166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6ca160b-daf3-45c4-b565-f930e517aa4f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:51.963967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6ca160b-daf3-45c4-b565-f930e517aa4f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:51.964890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d6ca160b-daf3-45c4-b565-f930e517aa4f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:52.003956 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d6ca160b-daf3-45c4-b565-f930e517aa4f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053280 Nov 27 21:40:52.004587 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4089/8038] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:51 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:53.016730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ffbc75e2-6966-4f67-a855-d69ebcfc9522 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:53.017744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ffbc75e2-6966-4f67-a855-d69ebcfc9522 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:53.025045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffbc75e2-6966-4f67-a855-d69ebcfc9522 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:53.025512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffbc75e2-6966-4f67-a855-d69ebcfc9522 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:53.026306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffbc75e2-6966-4f67-a855-d69ebcfc9522 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:53.026762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffbc75e2-6966-4f67-a855-d69ebcfc9522 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:53.066082 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ffbc75e2-6966-4f67-a855-d69ebcfc9522 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053217 Nov 27 21:40:53.066733 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3950/8039] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:53 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:54.078921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-246d1f1c-94a5-4403-bb01-ea967f87b462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:54.079981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-246d1f1c-94a5-4403-bb01-ea967f87b462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:54.087003 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-246d1f1c-94a5-4403-bb01-ea967f87b462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:54.087491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-246d1f1c-94a5-4403-bb01-ea967f87b462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:54.088276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-246d1f1c-94a5-4403-bb01-ea967f87b462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:54.088723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-246d1f1c-94a5-4403-bb01-ea967f87b462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:54.128543 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-246d1f1c-94a5-4403-bb01-ea967f87b462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053730 Nov 27 21:40:54.129542 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4090/8040] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:54 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:55.140914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f5d6c1e-178b-4533-a06b-035d3406886b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:55.141936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f5d6c1e-178b-4533-a06b-035d3406886b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:55.149334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c1e-178b-4533-a06b-035d3406886b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:55.149808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c1e-178b-4533-a06b-035d3406886b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:55.150599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c1e-178b-4533-a06b-035d3406886b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:55.151083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c1e-178b-4533-a06b-035d3406886b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:55.188211 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f5d6c1e-178b-4533-a06b-035d3406886b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.051874 Nov 27 21:40:55.188832 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3951/8041] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:55 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:56.200988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3bc0f91d-3216-4afe-a07a-d54b2abfa098 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:56.202024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3bc0f91d-3216-4afe-a07a-d54b2abfa098 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:56.209363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bc0f91d-3216-4afe-a07a-d54b2abfa098 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:56.209815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bc0f91d-3216-4afe-a07a-d54b2abfa098 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:56.210590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bc0f91d-3216-4afe-a07a-d54b2abfa098 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:56.211038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bc0f91d-3216-4afe-a07a-d54b2abfa098 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:56.249855 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3bc0f91d-3216-4afe-a07a-d54b2abfa098 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053343 Nov 27 21:40:56.250472 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4091/8042] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:56 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:57.262492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-290fb53d-744e-400d-952c-2bcc51e8e5ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:57.263587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-290fb53d-744e-400d-952c-2bcc51e8e5ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:57.271049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-290fb53d-744e-400d-952c-2bcc51e8e5ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:57.271608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-290fb53d-744e-400d-952c-2bcc51e8e5ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:57.272407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-290fb53d-744e-400d-952c-2bcc51e8e5ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:57.272868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-290fb53d-744e-400d-952c-2bcc51e8e5ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:57.312871 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-290fb53d-744e-400d-952c-2bcc51e8e5ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054353 Nov 27 21:40:57.313502 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3952/8043] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:57 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:58.325644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9c42841-1c04-412a-a4df-d0e02833617b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:58.326718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9c42841-1c04-412a-a4df-d0e02833617b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:58.334039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9c42841-1c04-412a-a4df-d0e02833617b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:58.334491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9c42841-1c04-412a-a4df-d0e02833617b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:58.335278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9c42841-1c04-412a-a4df-d0e02833617b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:58.335731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9c42841-1c04-412a-a4df-d0e02833617b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:58.377709 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9c42841-1c04-412a-a4df-d0e02833617b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.056600 Nov 27 21:40:58.378886 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4092/8044] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:58 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:40:59.390163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe508485-9e80-4c92-8ae7-74488faf0482 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:40:59.391210 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe508485-9e80-4c92-8ae7-74488faf0482 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:40:59.398638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe508485-9e80-4c92-8ae7-74488faf0482 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:59.399101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe508485-9e80-4c92-8ae7-74488faf0482 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:59.399972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe508485-9e80-4c92-8ae7-74488faf0482 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:40:59.400751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe508485-9e80-4c92-8ae7-74488faf0482 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:40:59.442902 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe508485-9e80-4c92-8ae7-74488faf0482 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.057140 Nov 27 21:40:59.446748 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3953/8045] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:40:59 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:00.454526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e2a400a-709d-431c-ab63-d6c0ac84a9b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:00.455533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e2a400a-709d-431c-ab63-d6c0ac84a9b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:00.462800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e2a400a-709d-431c-ab63-d6c0ac84a9b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:00.463259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e2a400a-709d-431c-ab63-d6c0ac84a9b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:00.464632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e2a400a-709d-431c-ab63-d6c0ac84a9b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:00.465069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e2a400a-709d-431c-ab63-d6c0ac84a9b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:00.505452 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e2a400a-709d-431c-ab63-d6c0ac84a9b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054976 Nov 27 21:41:00.506086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4093/8046] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:00 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:01.517731 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-461a5606-99df-4184-928c-91c13513e733 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:01.518747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-461a5606-99df-4184-928c-91c13513e733 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:01.527083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-461a5606-99df-4184-928c-91c13513e733 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:01.527574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-461a5606-99df-4184-928c-91c13513e733 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:01.528364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-461a5606-99df-4184-928c-91c13513e733 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:01.528813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-461a5606-99df-4184-928c-91c13513e733 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:01.568172 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-461a5606-99df-4184-928c-91c13513e733 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054449 Nov 27 21:41:01.568800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3954/8047] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:01 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:02.581104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2585bbc6-3b6e-4803-8314-f99077f26bdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:02.582151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2585bbc6-3b6e-4803-8314-f99077f26bdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:02.589511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2585bbc6-3b6e-4803-8314-f99077f26bdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:02.589965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2585bbc6-3b6e-4803-8314-f99077f26bdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:02.590758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2585bbc6-3b6e-4803-8314-f99077f26bdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:02.591203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2585bbc6-3b6e-4803-8314-f99077f26bdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:02.630266 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2585bbc6-3b6e-4803-8314-f99077f26bdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053118 Nov 27 21:41:02.631134 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4094/8048] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:02 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:03.643229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9534c6a-05fb-4654-b1b2-8fb91e83f4cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:03.644195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9534c6a-05fb-4654-b1b2-8fb91e83f4cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:03.653614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9534c6a-05fb-4654-b1b2-8fb91e83f4cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:03.653614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9534c6a-05fb-4654-b1b2-8fb91e83f4cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:03.653614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9534c6a-05fb-4654-b1b2-8fb91e83f4cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:03.654093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9534c6a-05fb-4654-b1b2-8fb91e83f4cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:03.694453 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9534c6a-05fb-4654-b1b2-8fb91e83f4cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055216 Nov 27 21:41:03.695105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3955/8049] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:03 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:04.707220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1246639-54cc-43ab-b2a8-1f47ff66412f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:04.708203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1246639-54cc-43ab-b2a8-1f47ff66412f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:04.716032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1246639-54cc-43ab-b2a8-1f47ff66412f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:04.716483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1246639-54cc-43ab-b2a8-1f47ff66412f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:04.717292 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1246639-54cc-43ab-b2a8-1f47ff66412f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:04.717732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1246639-54cc-43ab-b2a8-1f47ff66412f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:04.756114 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1246639-54cc-43ab-b2a8-1f47ff66412f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.052978 Nov 27 21:41:04.756772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4095/8050] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:04 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:05.768388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-39194e85-829a-4f71-ac7d-b2e9f34ba337 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:05.769448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-39194e85-829a-4f71-ac7d-b2e9f34ba337 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:05.776940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39194e85-829a-4f71-ac7d-b2e9f34ba337 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:05.777424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39194e85-829a-4f71-ac7d-b2e9f34ba337 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:05.778201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39194e85-829a-4f71-ac7d-b2e9f34ba337 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:05.778654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-39194e85-829a-4f71-ac7d-b2e9f34ba337 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:05.820603 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-39194e85-829a-4f71-ac7d-b2e9f34ba337 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.056149 Nov 27 21:41:05.821244 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3956/8051] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:05 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:06.833498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6db9a8c8-0efb-40e4-b655-79136f0d7d45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:06.834535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6db9a8c8-0efb-40e4-b655-79136f0d7d45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:06.842564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6db9a8c8-0efb-40e4-b655-79136f0d7d45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:06.843021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6db9a8c8-0efb-40e4-b655-79136f0d7d45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:06.843846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6db9a8c8-0efb-40e4-b655-79136f0d7d45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:06.844291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6db9a8c8-0efb-40e4-b655-79136f0d7d45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:06.883909 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6db9a8c8-0efb-40e4-b655-79136f0d7d45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054259 Nov 27 21:41:06.884584 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4096/8052] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:06 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:07.896685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5550c53-0d1d-4885-be36-308e2e1e3185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:07.897725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5550c53-0d1d-4885-be36-308e2e1e3185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:07.905505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5550c53-0d1d-4885-be36-308e2e1e3185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:07.905992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5550c53-0d1d-4885-be36-308e2e1e3185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:07.906777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5550c53-0d1d-4885-be36-308e2e1e3185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:07.907227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5550c53-0d1d-4885-be36-308e2e1e3185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:07.946533 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5550c53-0d1d-4885-be36-308e2e1e3185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053832 Nov 27 21:41:07.947160 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3957/8053] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:07 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:08.958487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5b82ad98-b2c0-4045-a62d-32609067b40e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:08.959524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5b82ad98-b2c0-4045-a62d-32609067b40e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:08.967494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b82ad98-b2c0-4045-a62d-32609067b40e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:08.967947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b82ad98-b2c0-4045-a62d-32609067b40e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:08.968727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b82ad98-b2c0-4045-a62d-32609067b40e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:08.969167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5b82ad98-b2c0-4045-a62d-32609067b40e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:09.007500 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5b82ad98-b2c0-4045-a62d-32609067b40e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053036 Nov 27 21:41:09.008132 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4097/8054] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:08 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:10.019990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ed8401a-941b-4039-ada3-2c7a4548cdd7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:10.021012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ed8401a-941b-4039-ada3-2c7a4548cdd7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:10.028868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ed8401a-941b-4039-ada3-2c7a4548cdd7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:10.029328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ed8401a-941b-4039-ada3-2c7a4548cdd7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:10.030115 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ed8401a-941b-4039-ada3-2c7a4548cdd7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:10.030567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ed8401a-941b-4039-ada3-2c7a4548cdd7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:10.070766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ed8401a-941b-4039-ada3-2c7a4548cdd7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054733 Nov 27 21:41:10.071401 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3958/8055] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:10 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:11.082938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dcb8740a-e38c-4b5b-bb31-7e0286d13c07 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:11.083970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dcb8740a-e38c-4b5b-bb31-7e0286d13c07 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:11.091268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcb8740a-e38c-4b5b-bb31-7e0286d13c07 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:11.091722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcb8740a-e38c-4b5b-bb31-7e0286d13c07 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:11.092495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcb8740a-e38c-4b5b-bb31-7e0286d13c07 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:11.092932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dcb8740a-e38c-4b5b-bb31-7e0286d13c07 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:11.139438 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dcb8740a-e38c-4b5b-bb31-7e0286d13c07 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.060362 Nov 27 21:41:11.140107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4098/8056] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:11 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:12.151413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b1d29d6-ad1e-4c82-9ff0-36e0a8b58c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:12.152444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b1d29d6-ad1e-4c82-9ff0-36e0a8b58c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:12.159758 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b1d29d6-ad1e-4c82-9ff0-36e0a8b58c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:12.160226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b1d29d6-ad1e-4c82-9ff0-36e0a8b58c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:12.161016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b1d29d6-ad1e-4c82-9ff0-36e0a8b58c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:12.161472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b1d29d6-ad1e-4c82-9ff0-36e0a8b58c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:12.203104 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b1d29d6-ad1e-4c82-9ff0-36e0a8b58c70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055793 Nov 27 21:41:12.203770 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3959/8057] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:12 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:13.215277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3184f5f6-6c65-44e5-91e5-23520f2992c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:13.216283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3184f5f6-6c65-44e5-91e5-23520f2992c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:13.223762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3184f5f6-6c65-44e5-91e5-23520f2992c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:13.224218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3184f5f6-6c65-44e5-91e5-23520f2992c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:13.225033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3184f5f6-6c65-44e5-91e5-23520f2992c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:13.225476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3184f5f6-6c65-44e5-91e5-23520f2992c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:13.265143 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3184f5f6-6c65-44e5-91e5-23520f2992c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053822 Nov 27 21:41:13.265765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4099/8058] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:13 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:14.277246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6d342a28-fb57-44ff-9079-9edaf2973859 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:14.278879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6d342a28-fb57-44ff-9079-9edaf2973859 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:14.286208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d342a28-fb57-44ff-9079-9edaf2973859 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:14.286673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d342a28-fb57-44ff-9079-9edaf2973859 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:14.287482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d342a28-fb57-44ff-9079-9edaf2973859 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:14.287931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6d342a28-fb57-44ff-9079-9edaf2973859 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:14.327120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6d342a28-fb57-44ff-9079-9edaf2973859 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053793 Nov 27 21:41:14.328003 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3960/8059] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:14 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:15.339180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2679da06-e1d6-484b-ab0d-a36db888c6a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:15.340232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2679da06-e1d6-484b-ab0d-a36db888c6a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:15.347990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2679da06-e1d6-484b-ab0d-a36db888c6a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:15.348437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2679da06-e1d6-484b-ab0d-a36db888c6a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:15.349201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2679da06-e1d6-484b-ab0d-a36db888c6a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:15.349631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2679da06-e1d6-484b-ab0d-a36db888c6a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:15.390233 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2679da06-e1d6-484b-ab0d-a36db888c6a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054950 Nov 27 21:41:15.390859 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4100/8060] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:15 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:16.401872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32c8fff3-4070-46a5-8d59-a0a5cd00fd05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:16.403086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32c8fff3-4070-46a5-8d59-a0a5cd00fd05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:16.410338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32c8fff3-4070-46a5-8d59-a0a5cd00fd05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:16.410799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32c8fff3-4070-46a5-8d59-a0a5cd00fd05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:16.411612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32c8fff3-4070-46a5-8d59-a0a5cd00fd05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:16.412060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32c8fff3-4070-46a5-8d59-a0a5cd00fd05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:16.452085 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32c8fff3-4070-46a5-8d59-a0a5cd00fd05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054102 Nov 27 21:41:16.452781 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3961/8061] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:16 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:17.464332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d28f2252-a060-4c56-ae2b-1906426ad758 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:17.465342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d28f2252-a060-4c56-ae2b-1906426ad758 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:17.472706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28f2252-a060-4c56-ae2b-1906426ad758 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:17.473158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28f2252-a060-4c56-ae2b-1906426ad758 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:17.473934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28f2252-a060-4c56-ae2b-1906426ad758 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:17.474375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d28f2252-a060-4c56-ae2b-1906426ad758 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:17.514646 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d28f2252-a060-4c56-ae2b-1906426ad758 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053741 Nov 27 21:41:17.515771 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4101/8062] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:17 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:18.528237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-086abdad-0b8e-42bf-bc1d-adc6f0e9a34e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:18.529313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-086abdad-0b8e-42bf-bc1d-adc6f0e9a34e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:18.536998 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-086abdad-0b8e-42bf-bc1d-adc6f0e9a34e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:18.537464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-086abdad-0b8e-42bf-bc1d-adc6f0e9a34e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:18.538417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-086abdad-0b8e-42bf-bc1d-adc6f0e9a34e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:18.538874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-086abdad-0b8e-42bf-bc1d-adc6f0e9a34e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:18.577711 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-086abdad-0b8e-42bf-bc1d-adc6f0e9a34e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054514 Nov 27 21:41:18.578335 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3962/8063] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:18 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:19.592736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e14f16d1-1886-4a34-aab6-c191bae7db0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:19.595422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e14f16d1-1886-4a34-aab6-c191bae7db0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:19.605452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e14f16d1-1886-4a34-aab6-c191bae7db0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:19.606735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e14f16d1-1886-4a34-aab6-c191bae7db0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:19.608055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e14f16d1-1886-4a34-aab6-c191bae7db0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:19.608816 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e14f16d1-1886-4a34-aab6-c191bae7db0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:19.649590 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e14f16d1-1886-4a34-aab6-c191bae7db0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.062769 Nov 27 21:41:19.650480 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4102/8064] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:19 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:41:20.663372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-960531e7-4c37-4b5e-bee8-3cbdac340f58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:20.664398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-960531e7-4c37-4b5e-bee8-3cbdac340f58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:20.671932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-960531e7-4c37-4b5e-bee8-3cbdac340f58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:20.672399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-960531e7-4c37-4b5e-bee8-3cbdac340f58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:20.673187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-960531e7-4c37-4b5e-bee8-3cbdac340f58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:20.673634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-960531e7-4c37-4b5e-bee8-3cbdac340f58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:20.713649 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-960531e7-4c37-4b5e-bee8-3cbdac340f58 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054197 Nov 27 21:41:20.714207 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3963/8065] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:20 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:21.724928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6192582-0c16-4629-96c8-48b6a1188675 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:21.725886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6192582-0c16-4629-96c8-48b6a1188675 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:21.733641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6192582-0c16-4629-96c8-48b6a1188675 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:21.734087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6192582-0c16-4629-96c8-48b6a1188675 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:21.734849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6192582-0c16-4629-96c8-48b6a1188675 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:21.735302 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6192582-0c16-4629-96c8-48b6a1188675 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:21.775530 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6192582-0c16-4629-96c8-48b6a1188675 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054587 Nov 27 21:41:21.776168 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4103/8066] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:21 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:41:22.788040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3a7a412-0ccb-4011-a8a1-2608871b6496 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:22.789058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3a7a412-0ccb-4011-a8a1-2608871b6496 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:22.796804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a7a412-0ccb-4011-a8a1-2608871b6496 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:22.797275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a7a412-0ccb-4011-a8a1-2608871b6496 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:22.798185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a7a412-0ccb-4011-a8a1-2608871b6496 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:22.798649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a7a412-0ccb-4011-a8a1-2608871b6496 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:22.839272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3a7a412-0ccb-4011-a8a1-2608871b6496 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055461 Nov 27 21:41:22.839912 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3964/8067] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:22 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:23.851465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e11578e1-2af0-4b71-97d3-402ab8ff3100 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:23.852501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e11578e1-2af0-4b71-97d3-402ab8ff3100 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:23.859627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e11578e1-2af0-4b71-97d3-402ab8ff3100 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:23.860082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e11578e1-2af0-4b71-97d3-402ab8ff3100 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:23.860856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e11578e1-2af0-4b71-97d3-402ab8ff3100 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:23.861294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e11578e1-2af0-4b71-97d3-402ab8ff3100 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:23.904033 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e11578e1-2af0-4b71-97d3-402ab8ff3100 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.056593 Nov 27 21:41:23.904693 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4104/8068] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:23 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:24.915760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0c95395-d5fb-4f72-8b3f-a4055c0b0738 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:24.916817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a0c95395-d5fb-4f72-8b3f-a4055c0b0738 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:24.924891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c95395-d5fb-4f72-8b3f-a4055c0b0738 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:24.925356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c95395-d5fb-4f72-8b3f-a4055c0b0738 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:24.926149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c95395-d5fb-4f72-8b3f-a4055c0b0738 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:24.926606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0c95395-d5fb-4f72-8b3f-a4055c0b0738 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:24.967376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0c95395-d5fb-4f72-8b3f-a4055c0b0738 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055585 Nov 27 21:41:24.968013 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3965/8069] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:24 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:25.979604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc473cc8-d31d-48d1-8030-bc93a9a93ce9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:25.981246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc473cc8-d31d-48d1-8030-bc93a9a93ce9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:25.988619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc473cc8-d31d-48d1-8030-bc93a9a93ce9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:25.989077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc473cc8-d31d-48d1-8030-bc93a9a93ce9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:25.989857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc473cc8-d31d-48d1-8030-bc93a9a93ce9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:25.990301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc473cc8-d31d-48d1-8030-bc93a9a93ce9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:26.031920 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc473cc8-d31d-48d1-8030-bc93a9a93ce9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.056191 Nov 27 21:41:26.032566 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4105/8070] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:25 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:27.043754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c037415b-422a-4f1a-bd25-84714ff35686 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:27.044779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c037415b-422a-4f1a-bd25-84714ff35686 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:27.052083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c037415b-422a-4f1a-bd25-84714ff35686 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:27.052537 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c037415b-422a-4f1a-bd25-84714ff35686 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:27.053336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c037415b-422a-4f1a-bd25-84714ff35686 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:27.053793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c037415b-422a-4f1a-bd25-84714ff35686 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:27.092641 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c037415b-422a-4f1a-bd25-84714ff35686 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053343 Nov 27 21:41:27.093271 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3966/8071] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:27 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:28.103897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8a2f959-6f85-4320-abc6-97127e6ad698 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:28.104895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8a2f959-6f85-4320-abc6-97127e6ad698 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:28.112865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8a2f959-6f85-4320-abc6-97127e6ad698 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:28.113549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8a2f959-6f85-4320-abc6-97127e6ad698 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:28.114348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8a2f959-6f85-4320-abc6-97127e6ad698 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:28.114784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8a2f959-6f85-4320-abc6-97127e6ad698 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:28.154290 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8a2f959-6f85-4320-abc6-97127e6ad698 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054292 Nov 27 21:41:28.154933 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4106/8072] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:28 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:29.166570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3a415d7d-f662-4ede-b67b-8bc3ee98ea16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:29.167618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3a415d7d-f662-4ede-b67b-8bc3ee98ea16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:29.175504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a415d7d-f662-4ede-b67b-8bc3ee98ea16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:29.175974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a415d7d-f662-4ede-b67b-8bc3ee98ea16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:29.176770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a415d7d-f662-4ede-b67b-8bc3ee98ea16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:29.177228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3a415d7d-f662-4ede-b67b-8bc3ee98ea16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:29.216452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3a415d7d-f662-4ede-b67b-8bc3ee98ea16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053963 Nov 27 21:41:29.217527 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3967/8073] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:29 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:41:30.227907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-809763f7-7c6f-4f23-8a53-3b537f7fea30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:30.228911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-809763f7-7c6f-4f23-8a53-3b537f7fea30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:30.236194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-809763f7-7c6f-4f23-8a53-3b537f7fea30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:30.236643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-809763f7-7c6f-4f23-8a53-3b537f7fea30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:30.237411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-809763f7-7c6f-4f23-8a53-3b537f7fea30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:30.237843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-809763f7-7c6f-4f23-8a53-3b537f7fea30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:30.276418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-809763f7-7c6f-4f23-8a53-3b537f7fea30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.052566 Nov 27 21:41:30.277047 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4107/8074] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:30 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:31.288305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6a04f67-3148-433c-923c-4ff2c2160bc0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:31.289329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6a04f67-3148-433c-923c-4ff2c2160bc0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:31.296691 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a04f67-3148-433c-923c-4ff2c2160bc0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:31.297163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a04f67-3148-433c-923c-4ff2c2160bc0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:31.297977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a04f67-3148-433c-923c-4ff2c2160bc0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:31.298433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6a04f67-3148-433c-923c-4ff2c2160bc0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:31.336756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6a04f67-3148-433c-923c-4ff2c2160bc0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.052400 Nov 27 21:41:31.337383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3968/8075] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:31 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:32.348832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3677f1ea-5d6e-42c5-9460-87b07c560144 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:32.349840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3677f1ea-5d6e-42c5-9460-87b07c560144 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:32.357616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3677f1ea-5d6e-42c5-9460-87b07c560144 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:32.358065 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3677f1ea-5d6e-42c5-9460-87b07c560144 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:32.358869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3677f1ea-5d6e-42c5-9460-87b07c560144 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:32.359334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3677f1ea-5d6e-42c5-9460-87b07c560144 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:32.399065 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3677f1ea-5d6e-42c5-9460-87b07c560144 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054187 Nov 27 21:41:32.399744 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4108/8076] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:32 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:41:33.413946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32d99c5c-d09d-4936-ae87-013ee2fd6d95 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:33.414995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32d99c5c-d09d-4936-ae87-013ee2fd6d95 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:33.422935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d99c5c-d09d-4936-ae87-013ee2fd6d95 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:33.423430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d99c5c-d09d-4936-ae87-013ee2fd6d95 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:33.424230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d99c5c-d09d-4936-ae87-013ee2fd6d95 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:33.424682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32d99c5c-d09d-4936-ae87-013ee2fd6d95 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:33.463086 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32d99c5c-d09d-4936-ae87-013ee2fd6d95 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053195 Nov 27 21:41:33.463769 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3969/8077] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:33 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:34.475774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2feb5f4b-984c-49c0-85fb-2f56edf8294c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:34.476799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2feb5f4b-984c-49c0-85fb-2f56edf8294c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:34.484915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2feb5f4b-984c-49c0-85fb-2f56edf8294c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:34.485701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2feb5f4b-984c-49c0-85fb-2f56edf8294c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:34.486503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2feb5f4b-984c-49c0-85fb-2f56edf8294c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:34.486938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2feb5f4b-984c-49c0-85fb-2f56edf8294c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:34.542486 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2feb5f4b-984c-49c0-85fb-2f56edf8294c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.070592 Nov 27 21:41:34.543142 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4109/8078] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:34 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:35.554780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dd5a5a2f-5513-4aca-bca1-a97aad6f373e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:35.555868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dd5a5a2f-5513-4aca-bca1-a97aad6f373e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:35.563681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a2f-5513-4aca-bca1-a97aad6f373e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:35.564155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a2f-5513-4aca-bca1-a97aad6f373e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:35.564946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a2f-5513-4aca-bca1-a97aad6f373e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:35.565403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a2f-5513-4aca-bca1-a97aad6f373e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:35.604982 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dd5a5a2f-5513-4aca-bca1-a97aad6f373e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054137 Nov 27 21:41:35.605614 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3970/8079] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:35 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:36.617423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3fa1f074-695b-4a86-91e2-2cdb0c597407 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:36.618436 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3fa1f074-695b-4a86-91e2-2cdb0c597407 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:36.625735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fa1f074-695b-4a86-91e2-2cdb0c597407 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:36.626188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fa1f074-695b-4a86-91e2-2cdb0c597407 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:36.626963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fa1f074-695b-4a86-91e2-2cdb0c597407 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:36.627437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3fa1f074-695b-4a86-91e2-2cdb0c597407 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:36.669413 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3fa1f074-695b-4a86-91e2-2cdb0c597407 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055962 Nov 27 21:41:36.670292 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4110/8080] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:36 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:37.681891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e661a83-615e-4538-ae96-d91326f2426a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:37.682909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e661a83-615e-4538-ae96-d91326f2426a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:37.690772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e661a83-615e-4538-ae96-d91326f2426a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:37.691236 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e661a83-615e-4538-ae96-d91326f2426a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:37.692044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e661a83-615e-4538-ae96-d91326f2426a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:37.692494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e661a83-615e-4538-ae96-d91326f2426a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:37.736193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e661a83-615e-4538-ae96-d91326f2426a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.058293 Nov 27 21:41:37.736765 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3971/8081] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:37 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:38.748314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fcc1fb2d-7075-42fc-b10f-45a206e11f55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:38.749235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fcc1fb2d-7075-42fc-b10f-45a206e11f55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:38.756773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcc1fb2d-7075-42fc-b10f-45a206e11f55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:38.757224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcc1fb2d-7075-42fc-b10f-45a206e11f55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:38.757996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcc1fb2d-7075-42fc-b10f-45a206e11f55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:38.758435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcc1fb2d-7075-42fc-b10f-45a206e11f55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:38.798678 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fcc1fb2d-7075-42fc-b10f-45a206e11f55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054290 Nov 27 21:41:38.799364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4111/8082] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:38 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:39.811477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7e99ee71-d44f-4928-9ccf-76d2cd7e77cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:39.813105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7e99ee71-d44f-4928-9ccf-76d2cd7e77cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:39.820381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e99ee71-d44f-4928-9ccf-76d2cd7e77cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:39.820844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e99ee71-d44f-4928-9ccf-76d2cd7e77cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:39.821632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e99ee71-d44f-4928-9ccf-76d2cd7e77cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:39.822081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7e99ee71-d44f-4928-9ccf-76d2cd7e77cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:39.861485 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7e99ee71-d44f-4928-9ccf-76d2cd7e77cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054261 Nov 27 21:41:39.862108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3972/8083] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:39 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:40.873942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd4d16ad-0966-4abf-8969-c45cbdbb6262 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:40.875461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd4d16ad-0966-4abf-8969-c45cbdbb6262 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:40.883179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4d16ad-0966-4abf-8969-c45cbdbb6262 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:40.883709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4d16ad-0966-4abf-8969-c45cbdbb6262 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:40.884464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4d16ad-0966-4abf-8969-c45cbdbb6262 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:40.884901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd4d16ad-0966-4abf-8969-c45cbdbb6262 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:40.924920 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd4d16ad-0966-4abf-8969-c45cbdbb6262 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055133 Nov 27 21:41:40.925735 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4112/8084] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:40 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:41.936858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f5d37a33-72a0-41b5-ae84-8c6503db45eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:41.937942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f5d37a33-72a0-41b5-ae84-8c6503db45eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:41.945260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d37a33-72a0-41b5-ae84-8c6503db45eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:41.945729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d37a33-72a0-41b5-ae84-8c6503db45eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:41.946524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d37a33-72a0-41b5-ae84-8c6503db45eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:41.946978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f5d37a33-72a0-41b5-ae84-8c6503db45eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:41.987327 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f5d37a33-72a0-41b5-ae84-8c6503db45eb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054523 Nov 27 21:41:41.987954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3973/8085] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:41 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:42.999515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ef7ea380-1e9b-4512-adfe-3c65858d5a48 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:43.000535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ef7ea380-1e9b-4512-adfe-3c65858d5a48 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:43.008017 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7ea380-1e9b-4512-adfe-3c65858d5a48 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:43.008464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7ea380-1e9b-4512-adfe-3c65858d5a48 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:43.009232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7ea380-1e9b-4512-adfe-3c65858d5a48 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:43.009669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ef7ea380-1e9b-4512-adfe-3c65858d5a48 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:43.049094 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ef7ea380-1e9b-4512-adfe-3c65858d5a48 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053585 Nov 27 21:41:43.049732 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4113/8086] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:42 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:44.063518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-169efd8a-c17b-478a-9c45-4b5f3976a19a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:44.064634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-169efd8a-c17b-478a-9c45-4b5f3976a19a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:44.073359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-169efd8a-c17b-478a-9c45-4b5f3976a19a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:44.073829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-169efd8a-c17b-478a-9c45-4b5f3976a19a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:44.074774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-169efd8a-c17b-478a-9c45-4b5f3976a19a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:44.075230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-169efd8a-c17b-478a-9c45-4b5f3976a19a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:44.114064 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-169efd8a-c17b-478a-9c45-4b5f3976a19a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055440 Nov 27 21:41:44.114714 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3974/8087] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:44 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:45.127085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-37480af4-6827-4e5c-a957-07b679fda7b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:45.128115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-37480af4-6827-4e5c-a957-07b679fda7b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:45.135661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37480af4-6827-4e5c-a957-07b679fda7b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:45.136107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37480af4-6827-4e5c-a957-07b679fda7b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:45.136877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37480af4-6827-4e5c-a957-07b679fda7b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:45.137319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-37480af4-6827-4e5c-a957-07b679fda7b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:45.176264 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-37480af4-6827-4e5c-a957-07b679fda7b2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053644 Nov 27 21:41:45.176877 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4114/8088] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:45 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:46.188794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15d1f9eb-be65-41c5-b981-686970f0d2a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:46.189836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15d1f9eb-be65-41c5-b981-686970f0d2a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:46.197107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15d1f9eb-be65-41c5-b981-686970f0d2a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:46.197573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15d1f9eb-be65-41c5-b981-686970f0d2a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:46.198363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15d1f9eb-be65-41c5-b981-686970f0d2a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:46.198809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15d1f9eb-be65-41c5-b981-686970f0d2a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:46.238568 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15d1f9eb-be65-41c5-b981-686970f0d2a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053700 Nov 27 21:41:46.239198 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3975/8089] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:46 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:47.251377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-840b4188-85f4-4ac6-88ec-48e63e7737ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:47.252389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-840b4188-85f4-4ac6-88ec-48e63e7737ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:47.260102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-840b4188-85f4-4ac6-88ec-48e63e7737ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:47.260560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-840b4188-85f4-4ac6-88ec-48e63e7737ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:47.261340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-840b4188-85f4-4ac6-88ec-48e63e7737ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:47.261781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-840b4188-85f4-4ac6-88ec-48e63e7737ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:47.301039 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-840b4188-85f4-4ac6-88ec-48e63e7737ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054230 Nov 27 21:41:47.301788 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4115/8090] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:47 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:48.313868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90171d83-fd5d-4309-b9fe-9d55add670a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:48.314897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90171d83-fd5d-4309-b9fe-9d55add670a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:48.322332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90171d83-fd5d-4309-b9fe-9d55add670a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:48.322831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90171d83-fd5d-4309-b9fe-9d55add670a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:48.323657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90171d83-fd5d-4309-b9fe-9d55add670a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:48.324124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90171d83-fd5d-4309-b9fe-9d55add670a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:48.362614 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90171d83-fd5d-4309-b9fe-9d55add670a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053364 Nov 27 21:41:48.363230 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3976/8091] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:48 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:49.375435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f351a268-3e05-4e1c-9abd-e7e4f54effb8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:49.376434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f351a268-3e05-4e1c-9abd-e7e4f54effb8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:49.383958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f351a268-3e05-4e1c-9abd-e7e4f54effb8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:49.384403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f351a268-3e05-4e1c-9abd-e7e4f54effb8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:49.385183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f351a268-3e05-4e1c-9abd-e7e4f54effb8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:49.385640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f351a268-3e05-4e1c-9abd-e7e4f54effb8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:49.426363 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f351a268-3e05-4e1c-9abd-e7e4f54effb8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055532 Nov 27 21:41:49.427298 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4116/8092] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:49 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:50.438936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-febda21d-bc86-43f0-aa19-c4dbe1dc0c9e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:50.440016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-febda21d-bc86-43f0-aa19-c4dbe1dc0c9e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:50.447564 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-febda21d-bc86-43f0-aa19-c4dbe1dc0c9e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:50.448035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-febda21d-bc86-43f0-aa19-c4dbe1dc0c9e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:50.448837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-febda21d-bc86-43f0-aa19-c4dbe1dc0c9e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:50.449292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-febda21d-bc86-43f0-aa19-c4dbe1dc0c9e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:50.490716 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-febda21d-bc86-43f0-aa19-c4dbe1dc0c9e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.056154 Nov 27 21:41:50.491371 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3977/8093] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:50 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:51.503511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-530cc993-dd60-4d40-9db1-b022495f497d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:51.504774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-530cc993-dd60-4d40-9db1-b022495f497d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:51.512020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530cc993-dd60-4d40-9db1-b022495f497d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:51.512465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530cc993-dd60-4d40-9db1-b022495f497d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:51.513239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530cc993-dd60-4d40-9db1-b022495f497d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:51.513673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-530cc993-dd60-4d40-9db1-b022495f497d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:51.553120 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-530cc993-dd60-4d40-9db1-b022495f497d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054198 Nov 27 21:41:51.553756 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4117/8094] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:51 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:52.565855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4914f156-d67b-4f7f-9ca4-48e971b59f0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:52.566871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4914f156-d67b-4f7f-9ca4-48e971b59f0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:52.574050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4914f156-d67b-4f7f-9ca4-48e971b59f0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:52.574515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4914f156-d67b-4f7f-9ca4-48e971b59f0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:52.575392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4914f156-d67b-4f7f-9ca4-48e971b59f0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:52.575852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4914f156-d67b-4f7f-9ca4-48e971b59f0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:52.615080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4914f156-d67b-4f7f-9ca4-48e971b59f0b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053705 Nov 27 21:41:52.615741 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3978/8095] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:52 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:53.626536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d803fe2-5d21-4c89-8dd8-347e2555c825 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:53.627588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d803fe2-5d21-4c89-8dd8-347e2555c825 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:53.634897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d803fe2-5d21-4c89-8dd8-347e2555c825 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:53.635406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d803fe2-5d21-4c89-8dd8-347e2555c825 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:53.636182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d803fe2-5d21-4c89-8dd8-347e2555c825 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:53.636621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d803fe2-5d21-4c89-8dd8-347e2555c825 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:53.676181 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d803fe2-5d21-4c89-8dd8-347e2555c825 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053573 Nov 27 21:41:53.676811 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4118/8096] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:53 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:54.688820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b498ce4-ad78-4afc-a9c6-0be98bf366ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:54.689835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b498ce4-ad78-4afc-a9c6-0be98bf366ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:54.697110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b498ce4-ad78-4afc-a9c6-0be98bf366ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:54.697511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b498ce4-ad78-4afc-a9c6-0be98bf366ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:54.698327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b498ce4-ad78-4afc-a9c6-0be98bf366ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:54.698779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b498ce4-ad78-4afc-a9c6-0be98bf366ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:54.738329 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b498ce4-ad78-4afc-a9c6-0be98bf366ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054023 Nov 27 21:41:54.739187 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3979/8097] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:54 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:55.751098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b013be7-e091-4661-80b9-ce934118c68e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:55.752091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b013be7-e091-4661-80b9-ce934118c68e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:55.759884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b013be7-e091-4661-80b9-ce934118c68e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:55.760344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b013be7-e091-4661-80b9-ce934118c68e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:55.761131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b013be7-e091-4661-80b9-ce934118c68e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:55.761578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b013be7-e091-4661-80b9-ce934118c68e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:55.800677 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b013be7-e091-4661-80b9-ce934118c68e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054117 Nov 27 21:41:55.801317 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4119/8098] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:55 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:56.812892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-044fa19c-dfef-4570-8f36-32f873c2e273 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:56.813950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-044fa19c-dfef-4570-8f36-32f873c2e273 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:56.821300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-044fa19c-dfef-4570-8f36-32f873c2e273 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:56.821774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-044fa19c-dfef-4570-8f36-32f873c2e273 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:56.822570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-044fa19c-dfef-4570-8f36-32f873c2e273 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:56.823027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-044fa19c-dfef-4570-8f36-32f873c2e273 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:56.864251 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-044fa19c-dfef-4570-8f36-32f873c2e273 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055229 Nov 27 21:41:56.864916 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3980/8099] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:56 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:57.876412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-72bcaf2e-b339-4fb1-9314-4377dde28993 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:57.877414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-72bcaf2e-b339-4fb1-9314-4377dde28993 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:57.885250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72bcaf2e-b339-4fb1-9314-4377dde28993 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:57.885704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72bcaf2e-b339-4fb1-9314-4377dde28993 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:57.886480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72bcaf2e-b339-4fb1-9314-4377dde28993 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:57.886922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-72bcaf2e-b339-4fb1-9314-4377dde28993 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:57.926968 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-72bcaf2e-b339-4fb1-9314-4377dde28993 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054526 Nov 27 21:41:57.927633 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4120/8100] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:57 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:58.939784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-564a9701-d8e3-4624-9a07-03039870f2d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:41:58.940794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-564a9701-d8e3-4624-9a07-03039870f2d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:41:58.948153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564a9701-d8e3-4624-9a07-03039870f2d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:58.948618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564a9701-d8e3-4624-9a07-03039870f2d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:58.949406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564a9701-d8e3-4624-9a07-03039870f2d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:41:58.949854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564a9701-d8e3-4624-9a07-03039870f2d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:41:58.987546 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-564a9701-d8e3-4624-9a07-03039870f2d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.052291 Nov 27 21:41:58.988191 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3981/8101] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:58 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:41:59.999809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-94131bbe-bab3-456e-889d-d878eacf21e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:00.000834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-94131bbe-bab3-456e-889d-d878eacf21e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:00.008414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94131bbe-bab3-456e-889d-d878eacf21e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:00.008859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94131bbe-bab3-456e-889d-d878eacf21e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:00.009629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94131bbe-bab3-456e-889d-d878eacf21e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:00.010064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-94131bbe-bab3-456e-889d-d878eacf21e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:00.049641 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-94131bbe-bab3-456e-889d-d878eacf21e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053767 Nov 27 21:42:00.050308 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4121/8102] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:41:59 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:01.062055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7488f18-b1a0-451e-82c6-937e8cd6189e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:01.063076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7488f18-b1a0-451e-82c6-937e8cd6189e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:01.070414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7488f18-b1a0-451e-82c6-937e8cd6189e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:01.070888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7488f18-b1a0-451e-82c6-937e8cd6189e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:01.071722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7488f18-b1a0-451e-82c6-937e8cd6189e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:01.072180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7488f18-b1a0-451e-82c6-937e8cd6189e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:01.111837 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7488f18-b1a0-451e-82c6-937e8cd6189e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.053654 Nov 27 21:42:01.112451 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3982/8103] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:01 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:02.123465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-377201b3-702d-4f8c-8cd4-fba98eba855a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:02.125131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-377201b3-702d-4f8c-8cd4-fba98eba855a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:02.132716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377201b3-702d-4f8c-8cd4-fba98eba855a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:02.133165 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377201b3-702d-4f8c-8cd4-fba98eba855a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:02.133939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377201b3-702d-4f8c-8cd4-fba98eba855a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:02.134374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-377201b3-702d-4f8c-8cd4-fba98eba855a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:02.178717 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-377201b3-702d-4f8c-8cd4-fba98eba855a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.059274 Nov 27 21:42:02.179405 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4122/8104] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:02 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:03.191231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-20567c71-8308-470e-bab1-674d363c2694 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:03.192296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-20567c71-8308-470e-bab1-674d363c2694 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:03.199562 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20567c71-8308-470e-bab1-674d363c2694 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:03.200028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20567c71-8308-470e-bab1-674d363c2694 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:03.200810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20567c71-8308-470e-bab1-674d363c2694 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:03.201257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-20567c71-8308-470e-bab1-674d363c2694 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:03.242703 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-20567c71-8308-470e-bab1-674d363c2694 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.055897 Nov 27 21:42:03.243380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3983/8105] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:03 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:04.255388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f0db089-ba23-4036-8b56-6daae122a041 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:04.256401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f0db089-ba23-4036-8b56-6daae122a041 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:04.263744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f0db089-ba23-4036-8b56-6daae122a041 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:04.264197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f0db089-ba23-4036-8b56-6daae122a041 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:04.265008 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f0db089-ba23-4036-8b56-6daae122a041 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:04.265451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f0db089-ba23-4036-8b56-6daae122a041 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:04.305814 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f0db089-ba23-4036-8b56-6daae122a041 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.054777 Nov 27 21:42:04.306673 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4123/8106] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:04 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:05.317988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-63bf065b-693a-44e2-8c8f-3169a2a95ad8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:05.319087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-63bf065b-693a-44e2-8c8f-3169a2a95ad8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:05.326438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63bf065b-693a-44e2-8c8f-3169a2a95ad8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:05.326908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63bf065b-693a-44e2-8c8f-3169a2a95ad8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:05.327740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63bf065b-693a-44e2-8c8f-3169a2a95ad8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:05.328198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-63bf065b-693a-44e2-8c8f-3169a2a95ad8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:05.367026 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-63bf065b-693a-44e2-8c8f-3169a2a95ad8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.052981 Nov 27 21:42:05.367684 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3984/8107] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:05 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:06.379909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88fd0593-af8e-4189-81bf-f20f5bd336e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:06.380947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88fd0593-af8e-4189-81bf-f20f5bd336e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:06.388692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88fd0593-af8e-4189-81bf-f20f5bd336e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:06.389143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88fd0593-af8e-4189-81bf-f20f5bd336e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:06.389930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88fd0593-af8e-4189-81bf-f20f5bd336e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:06.390369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88fd0593-af8e-4189-81bf-f20f5bd336e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:06.431625 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88fd0593-af8e-4189-81bf-f20f5bd336e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.056349 Nov 27 21:42:06.432283 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4124/8108] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:06 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:06.589919 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:42:06.590105 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:42:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:42:07.444235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81de1ea5-6da3-41c1-9060-9886f4b9e683 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:07.445258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81de1ea5-6da3-41c1-9060-9886f4b9e683 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:07.453123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81de1ea5-6da3-41c1-9060-9886f4b9e683 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:07.454096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81de1ea5-6da3-41c1-9060-9886f4b9e683 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:07.454896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81de1ea5-6da3-41c1-9060-9886f4b9e683 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:07.455379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81de1ea5-6da3-41c1-9060-9886f4b9e683 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:07.500423 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81de1ea5-6da3-41c1-9060-9886f4b9e683 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.060097 Nov 27 21:42:07.501368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3985/8109] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:07 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:08.575686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-465d4fa5-c237-4f21-a2b5-e8377c1cf4cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:08.576778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-465d4fa5-c237-4f21-a2b5-e8377c1cf4cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:08.583327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-465d4fa5-c237-4f21-a2b5-e8377c1cf4cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:08.583780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-465d4fa5-c237-4f21-a2b5-e8377c1cf4cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:08.584558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-465d4fa5-c237-4f21-a2b5-e8377c1cf4cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:08.584996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-465d4fa5-c237-4f21-a2b5-e8377c1cf4cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:08.624037 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-465d4fa5-c237-4f21-a2b5-e8377c1cf4cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 32638 microversion: 2.1 time: 0.114187 Nov 27 21:42:08.624641 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4125/8110] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:08 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 32638 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:42:09.636131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-65aa15ac-2bfb-477a-882b-3776168c63ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:09.637156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-65aa15ac-2bfb-477a-882b-3776168c63ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:09.647088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65aa15ac-2bfb-477a-882b-3776168c63ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:09.647603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65aa15ac-2bfb-477a-882b-3776168c63ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:09.648406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65aa15ac-2bfb-477a-882b-3776168c63ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:09.648889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65aa15ac-2bfb-477a-882b-3776168c63ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:09.703816 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-65aa15ac-2bfb-477a-882b-3776168c63ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 200 len: 40790 microversion: 2.1 time: 0.071423 Nov 27 21:42:09.704512 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3986/8111] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:09 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 40790 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:42:09.715425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce8e8da4-3d21-46bd-b545-d1094cc046c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:09.722989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce8e8da4-3d21-46bd-b545-d1094cc046c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:09.723467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce8e8da4-3d21-46bd-b545-d1094cc046c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:09.746174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce8e8da4-3d21-46bd-b545-d1094cc046c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Going to try to stop instance {{(pid=135680) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 21:42:09.785897 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce8e8da4-3d21-46bd-b545-d1094cc046c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 202 len: 0 microversion: 2.1 time: 0.074663 Nov 27 21:42:09.786509 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4126/8112] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:09 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:42:09.795517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:09.796238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:09.804651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:09.805162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:09.805980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:09.806438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:10.005946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:10.013404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22621c8b-86ab-4e3c-80d9-83d1a512758b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.222621 Nov 27 21:42:10.013980 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3987/8113] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:09 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:11.031032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:11.031754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:11.037905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:11.038350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:11.039110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:11.039601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:11.227332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:11.235419 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-51807629-5bc0-4919-a327-dc098b4e2964 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.209224 Nov 27 21:42:11.236050 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4127/8114] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:11 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:12.252351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:12.252979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:12.260821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:12.261295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:12.262092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:12.262546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:12.393328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:12.400782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed52cad1-18c5-400b-b551-26f05e4269a0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.152195 Nov 27 21:42:12.401361 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3988/8115] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:12 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:13.417680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:13.418316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:13.425516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:13.425971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:13.426750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:13.427186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:13.565868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:13.573280 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7197ffcd-78d7-4012-9cbe-8b9ff202fb5f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.159280 Nov 27 21:42:13.573844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4128/8116] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:13 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:14.590438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:14.591062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:14.598310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:14.598774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:14.599593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:14.600046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:14.730344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:14.737594 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b290b714-0a71-4659-a2d2-1050b692ba7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.150862 Nov 27 21:42:14.738234 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3989/8117] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:14 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:15.755386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:15.756014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:15.762611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:15.763056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:15.763853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:15.764286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:15.893397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:15.900753 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-52a6e25d-184b-4e8d-9dd4-473dfecd4aac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.149302 Nov 27 21:42:15.901326 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4129/8118] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:15 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:16.918263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:16.918917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:16.926345 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:16.926822 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:16.927643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:16.928091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:17.314624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:17.321900 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f09bce2f-e1da-4787-8b7f-df6bf9cb7649 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.407867 Nov 27 21:42:17.322466 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3990/8119] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:16 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:18.340784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:18.341331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:18.348288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:18.348769 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:18.349560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:18.350001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:18.477518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:18.485368 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-481e4c0a-6b8f-49d1-a7f8-8aff174a287c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.148386 Nov 27 21:42:18.485933 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4130/8120] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:18 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:19.501722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:19.502318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:19.509457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:19.509916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:19.510699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:19.511147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:19.649121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:19.656576 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ea2331ae-7415-43ad-a1fb-e2dd4e6f045a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.158437 Nov 27 21:42:19.657139 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3991/8121] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:19 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:20.673663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:20.674272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:20.681143 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:20.681626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:20.682402 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:20.682843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:20.814868 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:20.822204 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65aeb8ee-6a40-489f-a406-12543e77f451 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.152359 Nov 27 21:42:20.822772 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4131/8122] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:20 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:21.839653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:21.840283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:21.847627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:21.848098 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:21.848900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:21.849357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:21.976577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:21.984790 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9d6b5f0-e9b7-4f08-8dee-e87129d0f8e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.148225 Nov 27 21:42:21.985362 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3992/8123] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:21 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:23.002304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:23.002903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:23.009972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:23.010423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:23.011196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:23.011657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:23.138171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:23.145502 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0daa994e-5c02-4418-9182-7f25608dec96 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.147562 Nov 27 21:42:23.146072 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4132/8124] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:22 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:24.162629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:24.163246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:24.169946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:24.170409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:24.171186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:24.171660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:24.304868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:24.312702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4426873a-bf7e-4fdb-8bcc-ee4c6c50d3b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.153268 Nov 27 21:42:24.313432 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3993/8125] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:24 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:25.330231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:25.330840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:25.337329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:25.337774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:25.338572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:25.339000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:25.468923 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:25.476796 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b8219ea-7475-45c4-849d-e58cdb215387 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1655 microversion: 2.1 time: 0.150848 Nov 27 21:42:25.477360 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4133/8126] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:25 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:25.492786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:25.493800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:25.500542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:25.501508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:25.502302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:25.502759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:25.532012 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:25.537847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Old instance type m1.heat2, new instance type m1.heat {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:42:25.543975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:42:25.544865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:42:25.545358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:42:25.545785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:42:25.546212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:42:25.608882 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eebbc208-dc99-4b3f-9959-c74fb1b2a5c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 202 len: 0 microversion: 2.1 time: 0.119689 Nov 27 21:42:25.612283 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3994/8127] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:25 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:42:25.617334 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:25.617935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:25.623789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:25.624236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:25.625010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:25.625440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:25.788728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:25.796351 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0640a21a-edcc-449e-9ab0-b01054e4e806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.182723 Nov 27 21:42:25.796921 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4134/8128] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:25 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:26.813087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:26.813702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:26.821347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:26.821819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:26.822658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:26.823121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:26.963616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:26.971967 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b7f31284-32d4-4544-9ec4-6f1d0bd88e59 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1678 microversion: 2.1 time: 0.162643 Nov 27 21:42:26.972708 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3995/8129] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:26 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:27.989615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:27.990142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:27.996848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:27.997290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:27.998055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:27.998489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:28.126139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:28.133741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ff44f5de-c937-4e9e-a2c1-b272f8f3c8a7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1683 microversion: 2.1 time: 0.148488 Nov 27 21:42:28.134307 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4135/8130] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:27 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:29.151719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:29.152329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:29.159167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:29.159666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:29.160464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:29.160921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:29.299123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:29.306774 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3e21d40-9ebe-4e06-ba8e-2b952e50f47d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1683 microversion: 2.1 time: 0.158829 Nov 27 21:42:29.307384 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3996/8131] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:29 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:29.906615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4d54eca0-6411-4fe8-8da1-127702b82fc9 req-af6663ae-56db-4018-9963-1f0254300d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71db5b-1673-483b-9086-bf85ff0810a5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b9b3984-01a2-41a6-b059-356f9bf1e4b7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:29.909314 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:42:29.909314 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:42:29.917228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4d54eca0-6411-4fe8-8da1-127702b82fc9 req-af6663ae-56db-4018-9963-1f0254300d33 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:29.917707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4d54eca0-6411-4fe8-8da1-127702b82fc9 req-af6663ae-56db-4018-9963-1f0254300d33 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:29.929604 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4d54eca0-6411-4fe8-8da1-127702b82fc9 req-af6663ae-56db-4018-9963-1f0254300d33 service nova] Creating event network-vif-unplugged:4b9b3984-01a2-41a6-b059-356f9bf1e4b7 for instance bf71db5b-1673-483b-9086-bf85ff0810a5 on nch1-master-1 Nov 27 21:42:29.934917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-4d54eca0-6411-4fe8-8da1-127702b82fc9 req-af6663ae-56db-4018-9963-1f0254300d33 service nova] Instance bf71db5b-1673-483b-9086-bf85ff0810a5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:42:29.945640 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4d54eca0-6411-4fe8-8da1-127702b82fc9 req-af6663ae-56db-4018-9963-1f0254300d33 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042726 Nov 27 21:42:29.946241 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4136/8132] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:42:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:42:30.324133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:30.324761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:30.332529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:30.333001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:30.333806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:30.334269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:30.594129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:30.602309 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db699aa5-fb95-4b33-af6e-0d1dab5a1568 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1682 microversion: 2.1 time: 0.281981 Nov 27 21:42:30.603742 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3997/8133] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:30 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:31.621536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:31.622229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:31.629151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:31.629606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:31.630389 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:31.630825 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:31.765434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:31.773350 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7f7e5dc7-caa1-40ea-b2d1-cc07d8386842 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1680 microversion: 2.1 time: 0.156774 Nov 27 21:42:31.773916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4137/8134] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:31 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:31.960337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-32bca91f-82b1-4e85-9713-d4dbd72bb472 req-7846f97d-d7f8-48ab-97dc-e0221f557eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf71db5b-1673-483b-9086-bf85ff0810a5", "tag": "4b9b3984-01a2-41a6-b059-356f9bf1e4b7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:31.961844 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:42:31.961844 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:42:31.969506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-32bca91f-82b1-4e85-9713-d4dbd72bb472 req-7846f97d-d7f8-48ab-97dc-e0221f557eab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:31.969959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-32bca91f-82b1-4e85-9713-d4dbd72bb472 req-7846f97d-d7f8-48ab-97dc-e0221f557eab service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:31.980901 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-32bca91f-82b1-4e85-9713-d4dbd72bb472 req-7846f97d-d7f8-48ab-97dc-e0221f557eab service nova] Creating event network-changed:4b9b3984-01a2-41a6-b059-356f9bf1e4b7 for instance bf71db5b-1673-483b-9086-bf85ff0810a5 on nch1-master-1 Nov 27 21:42:31.986762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-32bca91f-82b1-4e85-9713-d4dbd72bb472 req-7846f97d-d7f8-48ab-97dc-e0221f557eab service nova] Instance bf71db5b-1673-483b-9086-bf85ff0810a5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:42:31.997374 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-32bca91f-82b1-4e85-9713-d4dbd72bb472 req-7846f97d-d7f8-48ab-97dc-e0221f557eab service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040685 Nov 27 21:42:31.997950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3998/8135] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:42:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:42:32.790596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:32.791148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:32.797839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:32.798291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:32.799072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:32.799548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:32.928836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:32.936190 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a9c87ceb-e9d1-4519-bee5-a48b71c7aece tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1676 microversion: 2.1 time: 0.149339 Nov 27 21:42:32.936761 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4138/8136] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:32 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:32.952875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6ae7bf0-65d7-4a4d-8e09-29017d7157a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:32.953513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6ae7bf0-65d7-4a4d-8e09-29017d7157a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:32.960217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6ae7bf0-65d7-4a4d-8e09-29017d7157a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:32.960688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6ae7bf0-65d7-4a4d-8e09-29017d7157a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:32.961490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6ae7bf0-65d7-4a4d-8e09-29017d7157a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:32.961950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6ae7bf0-65d7-4a4d-8e09-29017d7157a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:33.019764 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6ae7bf0-65d7-4a4d-8e09-29017d7157a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 204 len: 0 microversion: 2.1 time: 0.070780 Nov 27 21:42:33.020398 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 3999/8137] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:32 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:42:33.029176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:33.029787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:33.035902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:33.036335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:33.037144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:33.037578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:33.237074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:33.244431 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1f11545-feda-46ac-86b2-9373ac8d0eac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1676 microversion: 2.1 time: 0.219902 Nov 27 21:42:33.245215 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4139/8138] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:33 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:34.263414 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:34.264133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:34.271638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:34.272114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:34.272915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:34.273371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:34.414069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:34.422331 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0ec02d5-c941-400e-9904-1b7d2a2a9f5a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1676 microversion: 2.1 time: 0.163244 Nov 27 21:42:34.422899 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4000/8139] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:34 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:42:35.439497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:35.440130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:35.446954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:35.447461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:35.448274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:35.448716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:35.577437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:35.584846 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb8f0341-0133-4c52-a2cd-acb6f479c812 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1655 microversion: 2.1 time: 0.149134 Nov 27 21:42:35.585411 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4140/8140] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:35 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:35.601266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:35.601891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:35.608561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:35.609024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:35.609807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:35.611242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:35.744479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:35.751855 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c8de7ebc-33dc-4f70-bd9c-4210da8e54fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1655 microversion: 2.1 time: 0.154282 Nov 27 21:42:35.752420 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4001/8141] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:35 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:35.768518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-98a0bfa8-1934-4690-84fd-3d16d96f6963 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:35.774341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98a0bfa8-1934-4690-84fd-3d16d96f6963 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:35.774796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-98a0bfa8-1934-4690-84fd-3d16d96f6963 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:35.799024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-98a0bfa8-1934-4690-84fd-3d16d96f6963 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Going to try to start instance {{(pid=135680) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 27 21:42:35.839556 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-98a0bfa8-1934-4690-84fd-3d16d96f6963 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action" status: 202 len: 0 microversion: 2.1 time: 0.074988 Nov 27 21:42:35.840157 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4141/8142] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:35 2021] POST /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:42:35.848945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:35.849612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:35.855572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:35.856040 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:35.857019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:35.857514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:36.020844 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:36.028517 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31afdc25-6f58-4ac6-bac8-a7e4282d7b47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1664 microversion: 2.1 time: 0.184008 Nov 27 21:42:36.029224 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4002/8143] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:35 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1664 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:42:36.163374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-bc5cc5fd-cfe8-4465-9a62-79e9f6755675 req-6a842782-bbc4-439b-a10c-669601807fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71db5b-1673-483b-9086-bf85ff0810a5", "name": "network-vif-plugged", "status": "completed", "tag": "4b9b3984-01a2-41a6-b059-356f9bf1e4b7"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:36.164880 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:42:36.164880 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:42:36.172383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bc5cc5fd-cfe8-4465-9a62-79e9f6755675 req-6a842782-bbc4-439b-a10c-669601807fb8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:36.173050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bc5cc5fd-cfe8-4465-9a62-79e9f6755675 req-6a842782-bbc4-439b-a10c-669601807fb8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:36.186217 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-bc5cc5fd-cfe8-4465-9a62-79e9f6755675 req-6a842782-bbc4-439b-a10c-669601807fb8 service nova] Creating event network-vif-plugged:4b9b3984-01a2-41a6-b059-356f9bf1e4b7 for instance bf71db5b-1673-483b-9086-bf85ff0810a5 on nch1-master-1 Nov 27 21:42:36.191651 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-bc5cc5fd-cfe8-4465-9a62-79e9f6755675 req-6a842782-bbc4-439b-a10c-669601807fb8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032205 Nov 27 21:42:36.192321 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4142/8144] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:42:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:42:37.045837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:37.046467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:37.054151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:37.054619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:37.055517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:37.055976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:37.184835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:37.192477 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc155003-4ed3-462e-8efe-f460481d1e34 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1668 microversion: 2.1 time: 0.150371 Nov 27 21:42:37.193053 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4003/8145] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:37 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:37.211001 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:37.211605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:37.217896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:37.218349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:37.219128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:37.220210 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:37.244129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:42:37.315242 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3df5af86-a852-4a64-bb64-6b4ea6addb21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 204 len: 0 microversion: 2.1 time: 0.108739 Nov 27 21:42:37.315784 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4143/8146] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:42:37 2021] DELETE /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:42:37.324896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:37.325527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:37.331949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:37.332412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:37.333196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:37.333671 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:37.468295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:37.476313 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31d99f5e-32a2-48c1-abf0-00304b04296b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1674 microversion: 2.1 time: 0.156052 Nov 27 21:42:37.476878 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4004/8147] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:37 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:38.493912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:38.494608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:38.501412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:38.501862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:38.502645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:38.503079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:38.635810 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:38.643615 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3290d3a5-b580-4c9f-a75b-382fc807453c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1674 microversion: 2.1 time: 0.153816 Nov 27 21:42:38.644186 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4144/8148] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:38 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:39.569551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1fd7d276-3a04-45ae-81b6-3d593a4c7896 req-5a04642a-8b36-4ce3-8f27-797cb7d9fd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71db5b-1673-483b-9086-bf85ff0810a5", "name": "network-vif-deleted", "tag": "4b9b3984-01a2-41a6-b059-356f9bf1e4b7"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:39.572371 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:42:39.572371 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:42:39.581560 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1fd7d276-3a04-45ae-81b6-3d593a4c7896 req-5a04642a-8b36-4ce3-8f27-797cb7d9fd37 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:39.582141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1fd7d276-3a04-45ae-81b6-3d593a4c7896 req-5a04642a-8b36-4ce3-8f27-797cb7d9fd37 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:39.594567 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1fd7d276-3a04-45ae-81b6-3d593a4c7896 req-5a04642a-8b36-4ce3-8f27-797cb7d9fd37 service nova] Creating event network-vif-deleted:4b9b3984-01a2-41a6-b059-356f9bf1e4b7 for instance bf71db5b-1673-483b-9086-bf85ff0810a5 on nch1-master-1 Nov 27 21:42:39.600555 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1fd7d276-3a04-45ae-81b6-3d593a4c7896 req-5a04642a-8b36-4ce3-8f27-797cb7d9fd37 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034583 Nov 27 21:42:39.601453 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4005/8149] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:42:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:42:39.660942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:39.661563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:39.668680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:39.669759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:39.670553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:39.670991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:39.711238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:39.711739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:39.712189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lazy-loading 'fault' on Instance uuid bf71db5b-1673-483b-9086-bf85ff0810a5 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:42:39.755896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:39.765329 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db8ea363-1922-4877-b576-1467aaa81129 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 200 len: 1328 microversion: 2.1 time: 0.108419 Nov 27 21:42:39.779706 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4145/8150] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:39 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:40.791417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:40.792130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:40.799139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:40.799634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:40.800419 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:40.800868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:40.814915 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. Nov 27 21:42:40.815569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:42:40.816452 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ca83e533-a16c-4b2e-a39f-05077550a23c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 404 len: 111 microversion: 2.1 time: 0.029111 Nov 27 21:42:40.816988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4006/8151] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:40 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:42:40.892538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:40.893133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:40.899886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:40.900331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:40.901099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:40.901530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:40.914294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. Nov 27 21:42:40.914865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:42:40.915691 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-423fa064-0bfa-4ce1-9cdc-b50b1df289e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 404 len: 111 microversion: 2.1 time: 0.026879 Nov 27 21:42:40.916201 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4146/8152] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:40 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:42:40.961935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2059122569", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "d7f8e8e5-e085-4395-9b1c-093e8c6acee0"}], "security_groups": [{"name": "tempest-securitygroup--488750309"}], "key_name": "tempest-keypair-1705610460", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:41.061818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] validate_networks() for [('d7f8e8e5-e085-4395-9b1c-093e8c6acee0', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:42:41.293186 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:42:41.293358 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:42:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.21) !!! Nov 27 21:42:41.486557 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:42:41.486999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:42:41.487558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:42:41.487992 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:42:41.488424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:42:41.497374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:41.497846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:41.498689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:41.499151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:41.515817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:42:41.520870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:42:41.533614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:42:41.536034 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:42:41.580129 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12e54731-c619-467d-935c-55fb3763edf0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.621843 Nov 27 21:42:41.580769 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4007/8153] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:42:40 2021] POST /compute/v2.1/servers => generated 405 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:42:41.590615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-598e5c18-cb05-4b1f-9b19-e7b6b22973e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:41.591227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-598e5c18-cb05-4b1f-9b19-e7b6b22973e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:41.643045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-598e5c18-cb05-4b1f-9b19-e7b6b22973e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:41.649818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-598e5c18-cb05-4b1f-9b19-e7b6b22973e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1239 microversion: 2.1 time: 0.062862 Nov 27 21:42:41.650950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4147/8154] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:41 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:42.668800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:42.669432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:42.676836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:42.677303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:42.678620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:42.679272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:42.740977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:42.748799 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fb974220-1837-40f4-beed-f77df9224246 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1297 microversion: 2.1 time: 0.084822 Nov 27 21:42:42.749380 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4008/8155] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:42 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:43.767683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:43.768483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:43.776352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:43.776948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:43.778014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:43.778559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:43.994862 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2b711bcb-9d09-440d-a0f9-22ba7be047af req-d14bb292-bee6-459c-91f7-3145d604dfbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:43.996500 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:42:43.996500 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:42:44.009784 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2b711bcb-9d09-440d-a0f9-22ba7be047af req-d14bb292-bee6-459c-91f7-3145d604dfbd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:44.010378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2b711bcb-9d09-440d-a0f9-22ba7be047af req-d14bb292-bee6-459c-91f7-3145d604dfbd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:44.022247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:44.027783 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2b711bcb-9d09-440d-a0f9-22ba7be047af req-d14bb292-bee6-459c-91f7-3145d604dfbd service nova] Creating event network-changed:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch2-master-1 Nov 27 21:42:44.033427 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c0a286f5-f1e2-40a9-9d06-5965c6c827fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1364 microversion: 2.1 time: 0.269109 Nov 27 21:42:44.034776 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4148/8156] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:43 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:44.049864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2b711bcb-9d09-440d-a0f9-22ba7be047af req-d14bb292-bee6-459c-91f7-3145d604dfbd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151307 Nov 27 21:42:44.050478 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4009/8157] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:42:45.054048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:45.054570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:45.061247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:45.061694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:45.062490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:45.062978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:45.196087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:45.203265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15ffc187-3790-4afe-8d7e-e07c70201d9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1364 microversion: 2.1 time: 0.152928 Nov 27 21:42:45.203837 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4149/8158] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:45 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:46.221426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:46.222145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:46.228681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:46.229152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:46.229951 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:46.230411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:46.365315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:46.372663 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-85f2f139-5d20-4837-a4ce-f3a372514bf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1364 microversion: 2.1 time: 0.156174 Nov 27 21:42:46.373227 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4010/8159] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:46 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:47.389669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:47.390274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:47.397098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:47.397547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:47.398319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:47.398760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:47.532259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:47.540286 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-821de62d-fc9d-4a69-8e45-0519fb49c731 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1364 microversion: 2.1 time: 0.154296 Nov 27 21:42:47.540844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4150/8160] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:47 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:48.558059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:48.558694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:48.566105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:48.566576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:48.567404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:48.567859 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:48.697874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:48.705773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-598b1c84-039e-4e80-9ace-7c87f2e69c8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1364 microversion: 2.1 time: 0.151474 Nov 27 21:42:48.706372 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4011/8161] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:48 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:49.616296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-350a9d01-e6a7-4997-86e1-433cef847ac3 req-f5798365-8e2a-47f6-a6dd-c8a3c80c6fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "name": "network-vif-plugged", "status": "completed", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:49.617851 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:42:49.617851 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:42:49.626247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-350a9d01-e6a7-4997-86e1-433cef847ac3 req-f5798365-8e2a-47f6-a6dd-c8a3c80c6fbc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:49.627428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-350a9d01-e6a7-4997-86e1-433cef847ac3 req-f5798365-8e2a-47f6-a6dd-c8a3c80c6fbc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:49.638823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-350a9d01-e6a7-4997-86e1-433cef847ac3 req-f5798365-8e2a-47f6-a6dd-c8a3c80c6fbc service nova] Creating event network-vif-plugged:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch2-master-1 Nov 27 21:42:49.644457 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-350a9d01-e6a7-4997-86e1-433cef847ac3 req-f5798365-8e2a-47f6-a6dd-c8a3c80c6fbc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031826 Nov 27 21:42:49.645061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4151/8162] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:42:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:42:49.723180 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:49.723945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:49.730709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:49.731185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:49.732009 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:49.732468 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:49.867658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:49.875014 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d53512df-5e05-4531-bbbb-cc6a912eab37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1364 microversion: 2.1 time: 0.155687 Nov 27 21:42:49.875640 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4012/8163] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:49 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:50.894604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:50.895325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:50.901498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:50.901946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:50.902708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:50.903140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:51.038205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:51.045589 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a51b6780-1ea8-428c-8d4a-ccf8a48ce65c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1364 microversion: 2.1 time: 0.156226 Nov 27 21:42:51.046159 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4152/8164] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:50 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:52.062664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:52.063375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:52.069813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:52.070279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:52.071074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:52.071554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:52.198897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:42:52.206749 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75f92c3e-9ce7-4b58-b04d-354c904dc49f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1550 microversion: 2.1 time: 0.147938 Nov 27 21:42:52.207340 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4013/8165] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:42:52 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:42:52.223730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5af996e-979a-46eb-b261-b25467df630b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:42:52.224215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5af996e-979a-46eb-b261-b25467df630b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:52.230907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5af996e-979a-46eb-b261-b25467df630b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:52.231399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5af996e-979a-46eb-b261-b25467df630b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:52.232185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5af996e-979a-46eb-b261-b25467df630b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:52.232627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5af996e-979a-46eb-b261-b25467df630b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:52.310698 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5af996e-979a-46eb-b261-b25467df630b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091196 Nov 27 21:42:52.311367 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4153/8166] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:42:52 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:42:53.242290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bcae6965-1512-4dc3-8210-cc19c59d33bb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:53.243324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bcae6965-1512-4dc3-8210-cc19c59d33bb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:53.245000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-88c88c51-1bcb-436e-8b80-4440341f99fb req-dcad201d-1ddf-4671-8387-637427928d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:53.246747 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:42:53.246747 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:42:53.251053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcae6965-1512-4dc3-8210-cc19c59d33bb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:53.251545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcae6965-1512-4dc3-8210-cc19c59d33bb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:53.252356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcae6965-1512-4dc3-8210-cc19c59d33bb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:53.252916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bcae6965-1512-4dc3-8210-cc19c59d33bb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:53.254452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-88c88c51-1bcb-436e-8b80-4440341f99fb req-dcad201d-1ddf-4671-8387-637427928d9a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:53.254903 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-88c88c51-1bcb-436e-8b80-4440341f99fb req-dcad201d-1ddf-4671-8387-637427928d9a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:53.266474 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-88c88c51-1bcb-436e-8b80-4440341f99fb req-dcad201d-1ddf-4671-8387-637427928d9a service nova] Creating event network-changed:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch2-master-1 Nov 27 21:42:53.271563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-88c88c51-1bcb-436e-8b80-4440341f99fb req-dcad201d-1ddf-4671-8387-637427928d9a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030912 Nov 27 21:42:53.272395 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4154/8167] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:42:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:42:53.291464 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bcae6965-1512-4dc3-8210-cc19c59d33bb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.052844 Nov 27 21:42:53.292880 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4014/8168] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:53 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:42:54.303584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b9e6dd78-3d26-4514-85bc-615804c42d05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:54.304918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b9e6dd78-3d26-4514-85bc-615804c42d05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:54.311072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9e6dd78-3d26-4514-85bc-615804c42d05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:54.311561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9e6dd78-3d26-4514-85bc-615804c42d05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:54.312840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9e6dd78-3d26-4514-85bc-615804c42d05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:54.312840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b9e6dd78-3d26-4514-85bc-615804c42d05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:54.353582 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b9e6dd78-3d26-4514-85bc-615804c42d05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.054784 Nov 27 21:42:54.356640 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4155/8169] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:54 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 21:42:55.364920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2caef2de-a07a-4e69-be44-18f0d5bae966 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:55.365950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2caef2de-a07a-4e69-be44-18f0d5bae966 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:55.373650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2caef2de-a07a-4e69-be44-18f0d5bae966 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:55.374121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2caef2de-a07a-4e69-be44-18f0d5bae966 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:55.374921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2caef2de-a07a-4e69-be44-18f0d5bae966 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:55.375404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2caef2de-a07a-4e69-be44-18f0d5bae966 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:55.412957 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2caef2de-a07a-4e69-be44-18f0d5bae966 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.052055 Nov 27 21:42:55.413802 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4015/8170] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:55 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:42:56.424895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd0808dd-be79-404b-b941-2404e0ab04be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:56.426204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd0808dd-be79-404b-b941-2404e0ab04be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:56.433631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd0808dd-be79-404b-b941-2404e0ab04be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:56.434076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd0808dd-be79-404b-b941-2404e0ab04be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:56.434852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd0808dd-be79-404b-b941-2404e0ab04be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:56.435300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd0808dd-be79-404b-b941-2404e0ab04be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:56.475484 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd0808dd-be79-404b-b941-2404e0ab04be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.055120 Nov 27 21:42:56.476144 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4156/8171] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:56 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:42:57.488322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-980959d2-c88d-4bcc-b944-d958a4141a5d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:57.489437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-980959d2-c88d-4bcc-b944-d958a4141a5d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:57.496808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-980959d2-c88d-4bcc-b944-d958a4141a5d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:57.497270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-980959d2-c88d-4bcc-b944-d958a4141a5d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:57.498065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-980959d2-c88d-4bcc-b944-d958a4141a5d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:57.498517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-980959d2-c88d-4bcc-b944-d958a4141a5d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:57.534700 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-980959d2-c88d-4bcc-b944-d958a4141a5d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.051853 Nov 27 21:42:57.535423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4016/8172] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:57 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:42:58.546020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-227d5c8f-38f5-4fd8-9651-b75de720d565 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:58.547033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-227d5c8f-38f5-4fd8-9651-b75de720d565 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:58.554348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-227d5c8f-38f5-4fd8-9651-b75de720d565 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:58.554804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-227d5c8f-38f5-4fd8-9651-b75de720d565 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:58.555608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-227d5c8f-38f5-4fd8-9651-b75de720d565 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:58.556051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-227d5c8f-38f5-4fd8-9651-b75de720d565 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:58.594797 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-227d5c8f-38f5-4fd8-9651-b75de720d565 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.052671 Nov 27 21:42:58.595525 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4157/8173] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:58 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:42:59.606469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a90d3832-53af-4af7-b1cf-8b32e62aec4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:42:59.607528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a90d3832-53af-4af7-b1cf-8b32e62aec4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:42:59.614921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a90d3832-53af-4af7-b1cf-8b32e62aec4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:59.615425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a90d3832-53af-4af7-b1cf-8b32e62aec4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:59.616225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a90d3832-53af-4af7-b1cf-8b32e62aec4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:42:59.616681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a90d3832-53af-4af7-b1cf-8b32e62aec4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:42:59.656271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a90d3832-53af-4af7-b1cf-8b32e62aec4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.053775 Nov 27 21:42:59.656827 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4017/8174] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:42:59 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:43:00.668859 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6a90ab6-e7d8-47b4-9b1c-576a12543cf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:00.669860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6a90ab6-e7d8-47b4-9b1c-576a12543cf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:00.677973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6a90ab6-e7d8-47b4-9b1c-576a12543cf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:00.678424 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6a90ab6-e7d8-47b4-9b1c-576a12543cf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:00.679219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6a90ab6-e7d8-47b4-9b1c-576a12543cf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:00.679694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6a90ab6-e7d8-47b4-9b1c-576a12543cf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:00.717580 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6a90ab6-e7d8-47b4-9b1c-576a12543cf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.052697 Nov 27 21:43:00.718107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4158/8175] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:00 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:43:01.728392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89172647-4c1b-4317-b5b6-9f67d10617e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:01.729460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89172647-4c1b-4317-b5b6-9f67d10617e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:01.736801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89172647-4c1b-4317-b5b6-9f67d10617e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:01.737275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89172647-4c1b-4317-b5b6-9f67d10617e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:01.738067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89172647-4c1b-4317-b5b6-9f67d10617e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:01.738526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89172647-4c1b-4317-b5b6-9f67d10617e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:01.775811 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89172647-4c1b-4317-b5b6-9f67d10617e2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.051336 Nov 27 21:43:01.776408 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4018/8176] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:01 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:43:02.787153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1696523f-a778-47ad-92a1-ad6e7fffb5c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:02.788173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1696523f-a778-47ad-92a1-ad6e7fffb5c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:02.795364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1696523f-a778-47ad-92a1-ad6e7fffb5c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:02.795832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1696523f-a778-47ad-92a1-ad6e7fffb5c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:02.796586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1696523f-a778-47ad-92a1-ad6e7fffb5c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:02.797021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1696523f-a778-47ad-92a1-ad6e7fffb5c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:02.833601 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1696523f-a778-47ad-92a1-ad6e7fffb5c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 14 microversion: 2.1 time: 0.051074 Nov 27 21:43:02.834203 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4159/8177] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:02 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:43:03.845464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2664cd0-36cd-406e-bef4-ababc3d6314e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:03.846478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2664cd0-36cd-406e-bef4-ababc3d6314e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:03.853792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2664cd0-36cd-406e-bef4-ababc3d6314e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:03.854258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2664cd0-36cd-406e-bef4-ababc3d6314e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:03.855043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2664cd0-36cd-406e-bef4-ababc3d6314e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:03.855522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2664cd0-36cd-406e-bef4-ababc3d6314e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:03.904936 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2664cd0-36cd-406e-bef4-ababc3d6314e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 8208 microversion: 2.1 time: 0.063954 Nov 27 21:43:03.905879 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4019/8178] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:03 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 8208 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:43:04.916489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e78ac18-3874-4f1d-b484-a57d4e2f13a9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:04.917530 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e78ac18-3874-4f1d-b484-a57d4e2f13a9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:04.925315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e78ac18-3874-4f1d-b484-a57d4e2f13a9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:04.925767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e78ac18-3874-4f1d-b484-a57d4e2f13a9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:04.926547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e78ac18-3874-4f1d-b484-a57d4e2f13a9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:04.926986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e78ac18-3874-4f1d-b484-a57d4e2f13a9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:04.989294 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e78ac18-3874-4f1d-b484-a57d4e2f13a9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 16395 microversion: 2.1 time: 0.076826 Nov 27 21:43:04.989907 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4160/8179] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:04 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 16395 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:06.001771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-259f8bbc-060e-4607-8c80-a6c90b05c953 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:06.002704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-259f8bbc-060e-4607-8c80-a6c90b05c953 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:06.010348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-259f8bbc-060e-4607-8c80-a6c90b05c953 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:06.010817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-259f8bbc-060e-4607-8c80-a6c90b05c953 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:06.011646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-259f8bbc-060e-4607-8c80-a6c90b05c953 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:06.012102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-259f8bbc-060e-4607-8c80-a6c90b05c953 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:06.050080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-259f8bbc-060e-4607-8c80-a6c90b05c953 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 16395 microversion: 2.1 time: 0.052880 Nov 27 21:43:06.050693 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4020/8180] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:05 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 16395 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:07.061784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1303e497-13df-4a23-82b4-f19be712d064 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:07.062782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1303e497-13df-4a23-82b4-f19be712d064 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:07.070631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1303e497-13df-4a23-82b4-f19be712d064 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:07.071077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1303e497-13df-4a23-82b4-f19be712d064 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:07.071865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1303e497-13df-4a23-82b4-f19be712d064 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:07.072324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1303e497-13df-4a23-82b4-f19be712d064 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:07.112430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1303e497-13df-4a23-82b4-f19be712d064 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 16395 microversion: 2.1 time: 0.054529 Nov 27 21:43:07.113042 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4161/8181] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:07 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 16395 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:08.124485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aec49421-55fe-486d-90fa-75593f58b947 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:08.125540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aec49421-55fe-486d-90fa-75593f58b947 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:08.133213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aec49421-55fe-486d-90fa-75593f58b947 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:08.133689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aec49421-55fe-486d-90fa-75593f58b947 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:08.134492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aec49421-55fe-486d-90fa-75593f58b947 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:08.134954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aec49421-55fe-486d-90fa-75593f58b947 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:08.175107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aec49421-55fe-486d-90fa-75593f58b947 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 16395 microversion: 2.1 time: 0.054675 Nov 27 21:43:08.175770 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4021/8182] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:08 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 16395 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:09.186828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f7a99671-8715-4604-a47b-f24fa341c99e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:09.187861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f7a99671-8715-4604-a47b-f24fa341c99e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:09.195152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a99671-8715-4604-a47b-f24fa341c99e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:09.195628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a99671-8715-4604-a47b-f24fa341c99e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:09.196408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a99671-8715-4604-a47b-f24fa341c99e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:09.196845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f7a99671-8715-4604-a47b-f24fa341c99e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:09.250010 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f7a99671-8715-4604-a47b-f24fa341c99e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.067062 Nov 27 21:43:09.250685 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4162/8183] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:09 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:10.262239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-403f8231-96c2-4ccf-ba43-2c951b061504 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:10.263332 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-403f8231-96c2-4ccf-ba43-2c951b061504 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:10.270655 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-403f8231-96c2-4ccf-ba43-2c951b061504 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:10.271125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-403f8231-96c2-4ccf-ba43-2c951b061504 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:10.271953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-403f8231-96c2-4ccf-ba43-2c951b061504 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:10.272410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-403f8231-96c2-4ccf-ba43-2c951b061504 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:10.311045 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-403f8231-96c2-4ccf-ba43-2c951b061504 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052860 Nov 27 21:43:10.311696 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4022/8184] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:10 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:11.323662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f77f950-07c9-4a9e-91ba-7b617978aeda tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:11.324666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f77f950-07c9-4a9e-91ba-7b617978aeda tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:11.331974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f77f950-07c9-4a9e-91ba-7b617978aeda tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:11.332427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f77f950-07c9-4a9e-91ba-7b617978aeda tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:11.333198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f77f950-07c9-4a9e-91ba-7b617978aeda tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:11.333639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f77f950-07c9-4a9e-91ba-7b617978aeda tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:11.372527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f77f950-07c9-4a9e-91ba-7b617978aeda tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052871 Nov 27 21:43:11.373373 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4163/8185] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:11 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:12.384893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb1fde43-4994-4cc6-9cc3-5bb9ec0621c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:12.385914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb1fde43-4994-4cc6-9cc3-5bb9ec0621c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:12.393917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb1fde43-4994-4cc6-9cc3-5bb9ec0621c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:12.394391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb1fde43-4994-4cc6-9cc3-5bb9ec0621c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:12.395187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb1fde43-4994-4cc6-9cc3-5bb9ec0621c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:12.395668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb1fde43-4994-4cc6-9cc3-5bb9ec0621c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:12.438289 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb1fde43-4994-4cc6-9cc3-5bb9ec0621c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.057344 Nov 27 21:43:12.438957 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4023/8186] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:12 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:43:13.450429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83476bc1-718c-4d5e-87ae-7f70078ab60f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:13.451458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-83476bc1-718c-4d5e-87ae-7f70078ab60f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:13.458657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83476bc1-718c-4d5e-87ae-7f70078ab60f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:13.459106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83476bc1-718c-4d5e-87ae-7f70078ab60f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:13.459900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83476bc1-718c-4d5e-87ae-7f70078ab60f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:13.460335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83476bc1-718c-4d5e-87ae-7f70078ab60f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:13.497826 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83476bc1-718c-4d5e-87ae-7f70078ab60f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.051491 Nov 27 21:43:13.498457 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4164/8187] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:13 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:14.510335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-006a301e-40ef-477e-bfc4-39976a4f4343 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:14.511371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-006a301e-40ef-477e-bfc4-39976a4f4343 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:14.518602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006a301e-40ef-477e-bfc4-39976a4f4343 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:14.519045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006a301e-40ef-477e-bfc4-39976a4f4343 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:14.519858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006a301e-40ef-477e-bfc4-39976a4f4343 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:14.520309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-006a301e-40ef-477e-bfc4-39976a4f4343 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:14.559213 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-006a301e-40ef-477e-bfc4-39976a4f4343 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052906 Nov 27 21:43:14.559874 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4024/8188] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:14 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:15.571280 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8631aafd-f88a-4e64-b6e7-d3e0e3121e7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:15.572320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8631aafd-f88a-4e64-b6e7-d3e0e3121e7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:15.579641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8631aafd-f88a-4e64-b6e7-d3e0e3121e7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:15.580089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8631aafd-f88a-4e64-b6e7-d3e0e3121e7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:15.580857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8631aafd-f88a-4e64-b6e7-d3e0e3121e7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:15.581290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8631aafd-f88a-4e64-b6e7-d3e0e3121e7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:15.621048 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8631aafd-f88a-4e64-b6e7-d3e0e3121e7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053817 Nov 27 21:43:15.621939 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4165/8189] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:15 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:16.633448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c56b850c-181e-406c-812e-f4053bb261f5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:16.634461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c56b850c-181e-406c-812e-f4053bb261f5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:16.642385 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c56b850c-181e-406c-812e-f4053bb261f5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:16.642848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c56b850c-181e-406c-812e-f4053bb261f5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:16.643668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c56b850c-181e-406c-812e-f4053bb261f5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:16.644118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c56b850c-181e-406c-812e-f4053bb261f5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:16.682519 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c56b850c-181e-406c-812e-f4053bb261f5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053182 Nov 27 21:43:16.683102 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4025/8190] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:16 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:17.694548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9aca38af-f849-48c7-b540-0dde456dda35 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:17.695594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9aca38af-f849-48c7-b540-0dde456dda35 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:17.703145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9aca38af-f849-48c7-b540-0dde456dda35 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:17.703564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9aca38af-f849-48c7-b540-0dde456dda35 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:17.704860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9aca38af-f849-48c7-b540-0dde456dda35 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:17.705293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9aca38af-f849-48c7-b540-0dde456dda35 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:17.744313 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9aca38af-f849-48c7-b540-0dde456dda35 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053780 Nov 27 21:43:17.744967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4166/8191] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:17 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:18.755949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d1b7ba29-1044-4e52-9222-17511a3b4b15 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:18.756979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d1b7ba29-1044-4e52-9222-17511a3b4b15 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:18.764404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1b7ba29-1044-4e52-9222-17511a3b4b15 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:18.764874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1b7ba29-1044-4e52-9222-17511a3b4b15 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:18.765667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1b7ba29-1044-4e52-9222-17511a3b4b15 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:18.766131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d1b7ba29-1044-4e52-9222-17511a3b4b15 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:18.819278 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d1b7ba29-1044-4e52-9222-17511a3b4b15 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.067584 Nov 27 21:43:18.819954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4026/8192] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:18 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:19.831862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ffb373fd-4761-4ced-8d08-4165370cc1e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:19.832880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ffb373fd-4761-4ced-8d08-4165370cc1e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:19.840268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb373fd-4761-4ced-8d08-4165370cc1e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:19.840722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb373fd-4761-4ced-8d08-4165370cc1e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:19.841508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb373fd-4761-4ced-8d08-4165370cc1e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:19.841949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ffb373fd-4761-4ced-8d08-4165370cc1e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:19.880875 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ffb373fd-4761-4ced-8d08-4165370cc1e9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053559 Nov 27 21:43:19.881571 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4167/8193] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:19 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:43:20.893350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-721aef58-3ee6-4085-aec3-de19c93d710b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:20.894281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-721aef58-3ee6-4085-aec3-de19c93d710b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:20.902047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721aef58-3ee6-4085-aec3-de19c93d710b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:20.902519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721aef58-3ee6-4085-aec3-de19c93d710b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:20.903354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721aef58-3ee6-4085-aec3-de19c93d710b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:20.903814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721aef58-3ee6-4085-aec3-de19c93d710b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:20.945748 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-721aef58-3ee6-4085-aec3-de19c93d710b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.056559 Nov 27 21:43:20.946636 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4027/8194] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:20 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:21.958131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4cc1447c-739f-403f-a4bd-8ed17d41f96b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:21.959127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4cc1447c-739f-403f-a4bd-8ed17d41f96b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:21.966653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cc1447c-739f-403f-a4bd-8ed17d41f96b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:21.967094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cc1447c-739f-403f-a4bd-8ed17d41f96b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:21.967890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cc1447c-739f-403f-a4bd-8ed17d41f96b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:21.968325 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4cc1447c-739f-403f-a4bd-8ed17d41f96b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:22.009396 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4cc1447c-739f-403f-a4bd-8ed17d41f96b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.055425 Nov 27 21:43:22.010052 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4168/8195] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:21 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:23.021076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e780d9fe-b792-47b3-83ec-da242f4b9e9f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:23.022103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e780d9fe-b792-47b3-83ec-da242f4b9e9f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:23.029229 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e780d9fe-b792-47b3-83ec-da242f4b9e9f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:23.029699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e780d9fe-b792-47b3-83ec-da242f4b9e9f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:23.030498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e780d9fe-b792-47b3-83ec-da242f4b9e9f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:23.030954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e780d9fe-b792-47b3-83ec-da242f4b9e9f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:23.069980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e780d9fe-b792-47b3-83ec-da242f4b9e9f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052880 Nov 27 21:43:23.070607 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4028/8196] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:23 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:24.082326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-54adfc23-85ef-43ef-992a-e2e576d446e0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:24.083439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-54adfc23-85ef-43ef-992a-e2e576d446e0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:24.090765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54adfc23-85ef-43ef-992a-e2e576d446e0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:24.091225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54adfc23-85ef-43ef-992a-e2e576d446e0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:24.092033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54adfc23-85ef-43ef-992a-e2e576d446e0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:24.092477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-54adfc23-85ef-43ef-992a-e2e576d446e0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:24.137446 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-54adfc23-85ef-43ef-992a-e2e576d446e0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.059076 Nov 27 21:43:24.138119 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4169/8197] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:24 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:25.149529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7d7e96f4-44c8-4c97-b9c0-04a474ded421 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:25.150551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7d7e96f4-44c8-4c97-b9c0-04a474ded421 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:25.157865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d7e96f4-44c8-4c97-b9c0-04a474ded421 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:25.158328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d7e96f4-44c8-4c97-b9c0-04a474ded421 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:25.159114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d7e96f4-44c8-4c97-b9c0-04a474ded421 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:25.159593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7d7e96f4-44c8-4c97-b9c0-04a474ded421 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:25.201402 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7d7e96f4-44c8-4c97-b9c0-04a474ded421 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.055853 Nov 27 21:43:25.202054 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4029/8198] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:25 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:26.213049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-634e6cc6-5879-4599-a336-27536dd7ac6f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:26.214050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-634e6cc6-5879-4599-a336-27536dd7ac6f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:26.222084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634e6cc6-5879-4599-a336-27536dd7ac6f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:26.222537 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634e6cc6-5879-4599-a336-27536dd7ac6f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:26.223360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634e6cc6-5879-4599-a336-27536dd7ac6f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:26.223799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-634e6cc6-5879-4599-a336-27536dd7ac6f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:26.261160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-634e6cc6-5879-4599-a336-27536dd7ac6f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052040 Nov 27 21:43:26.261817 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4170/8199] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:26 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:27.273681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a866f3d7-f5c8-4620-a550-9155b80cbf7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:27.274687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a866f3d7-f5c8-4620-a550-9155b80cbf7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:27.282066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a866f3d7-f5c8-4620-a550-9155b80cbf7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:27.282528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a866f3d7-f5c8-4620-a550-9155b80cbf7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:27.283344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a866f3d7-f5c8-4620-a550-9155b80cbf7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:27.283797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a866f3d7-f5c8-4620-a550-9155b80cbf7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:27.323244 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a866f3d7-f5c8-4620-a550-9155b80cbf7e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053518 Nov 27 21:43:27.323901 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4030/8200] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:27 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:28.335656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-65f05cd1-e363-47bc-a4e8-e54a4ef6dfff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:28.336658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-65f05cd1-e363-47bc-a4e8-e54a4ef6dfff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:28.344011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65f05cd1-e363-47bc-a4e8-e54a4ef6dfff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:28.344922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65f05cd1-e363-47bc-a4e8-e54a4ef6dfff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:28.345688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65f05cd1-e363-47bc-a4e8-e54a4ef6dfff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:28.346122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-65f05cd1-e363-47bc-a4e8-e54a4ef6dfff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:28.384359 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-65f05cd1-e363-47bc-a4e8-e54a4ef6dfff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052599 Nov 27 21:43:28.385704 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4171/8201] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:28 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:29.396428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71eb2d4a-790d-4284-9df9-313a427770fd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:29.397452 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71eb2d4a-790d-4284-9df9-313a427770fd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:29.404874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71eb2d4a-790d-4284-9df9-313a427770fd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:29.405342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71eb2d4a-790d-4284-9df9-313a427770fd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:29.406141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71eb2d4a-790d-4284-9df9-313a427770fd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:29.406599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71eb2d4a-790d-4284-9df9-313a427770fd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:29.446650 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71eb2d4a-790d-4284-9df9-313a427770fd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.054157 Nov 27 21:43:29.447578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4031/8202] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:29 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:30.458697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e478654-c8c8-4fa1-9734-9784c56cb7ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:30.459732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e478654-c8c8-4fa1-9734-9784c56cb7ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:30.467044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e478654-c8c8-4fa1-9734-9784c56cb7ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:30.467532 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e478654-c8c8-4fa1-9734-9784c56cb7ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:30.468318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e478654-c8c8-4fa1-9734-9784c56cb7ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:30.468760 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e478654-c8c8-4fa1-9734-9784c56cb7ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:30.506984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e478654-c8c8-4fa1-9734-9784c56cb7ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052320 Nov 27 21:43:30.507644 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4172/8203] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:30 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:31.519819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3753e50-eea7-49b5-960c-28780ed2ff47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:31.520847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3753e50-eea7-49b5-960c-28780ed2ff47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:31.528380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3753e50-eea7-49b5-960c-28780ed2ff47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:31.528853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3753e50-eea7-49b5-960c-28780ed2ff47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:31.529647 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3753e50-eea7-49b5-960c-28780ed2ff47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:31.530107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3753e50-eea7-49b5-960c-28780ed2ff47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:31.574442 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3753e50-eea7-49b5-960c-28780ed2ff47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.059396 Nov 27 21:43:31.575079 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4032/8204] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:31 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:32.586624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c6e25fcc-d0bc-4821-be91-990eb47a44a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:32.587678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c6e25fcc-d0bc-4821-be91-990eb47a44a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:32.595567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6e25fcc-d0bc-4821-be91-990eb47a44a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:32.596018 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6e25fcc-d0bc-4821-be91-990eb47a44a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:32.596822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6e25fcc-d0bc-4821-be91-990eb47a44a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:32.597266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6e25fcc-d0bc-4821-be91-990eb47a44a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:32.635877 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c6e25fcc-d0bc-4821-be91-990eb47a44a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053210 Nov 27 21:43:32.636511 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4173/8205] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:32 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:33.648049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-871c1be0-411d-4b30-846e-4a33db9eeba8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:33.649177 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-871c1be0-411d-4b30-846e-4a33db9eeba8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:33.656837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-871c1be0-411d-4b30-846e-4a33db9eeba8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:33.657959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-871c1be0-411d-4b30-846e-4a33db9eeba8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:33.658795 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-871c1be0-411d-4b30-846e-4a33db9eeba8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:33.659273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-871c1be0-411d-4b30-846e-4a33db9eeba8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:33.697406 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-871c1be0-411d-4b30-846e-4a33db9eeba8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053297 Nov 27 21:43:33.697965 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4033/8206] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:33 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:43:34.709403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7aee9287-3469-41fb-9682-f9ed64b473ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:34.710394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7aee9287-3469-41fb-9682-f9ed64b473ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:34.717654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aee9287-3469-41fb-9682-f9ed64b473ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:34.718101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aee9287-3469-41fb-9682-f9ed64b473ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:34.718862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aee9287-3469-41fb-9682-f9ed64b473ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:34.719314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aee9287-3469-41fb-9682-f9ed64b473ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:34.760738 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7aee9287-3469-41fb-9682-f9ed64b473ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.055343 Nov 27 21:43:34.761377 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4174/8207] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:34 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:35.772767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5ce3219a-714d-4eb0-87f9-6b43b512b6fb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:35.773793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5ce3219a-714d-4eb0-87f9-6b43b512b6fb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:35.781122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce3219a-714d-4eb0-87f9-6b43b512b6fb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:35.781599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce3219a-714d-4eb0-87f9-6b43b512b6fb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:35.782489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce3219a-714d-4eb0-87f9-6b43b512b6fb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:35.782944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5ce3219a-714d-4eb0-87f9-6b43b512b6fb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:35.822207 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5ce3219a-714d-4eb0-87f9-6b43b512b6fb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053421 Nov 27 21:43:35.822847 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4034/8208] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:35 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:36.834818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b147916-7ab2-47b8-8662-2e8bdeefad16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:36.835878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b147916-7ab2-47b8-8662-2e8bdeefad16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:36.843109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b147916-7ab2-47b8-8662-2e8bdeefad16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:36.843582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b147916-7ab2-47b8-8662-2e8bdeefad16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:36.844388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b147916-7ab2-47b8-8662-2e8bdeefad16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:36.844799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b147916-7ab2-47b8-8662-2e8bdeefad16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:36.883032 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b147916-7ab2-47b8-8662-2e8bdeefad16 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052246 Nov 27 21:43:36.883699 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4175/8209] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:36 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:37.895554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f2ab8c7-efbd-4eaa-bbef-a080377f2ed6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:37.896617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f2ab8c7-efbd-4eaa-bbef-a080377f2ed6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:37.904028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ab8c7-efbd-4eaa-bbef-a080377f2ed6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:37.904504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ab8c7-efbd-4eaa-bbef-a080377f2ed6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:37.905308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ab8c7-efbd-4eaa-bbef-a080377f2ed6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:37.905767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f2ab8c7-efbd-4eaa-bbef-a080377f2ed6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:37.946766 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f2ab8c7-efbd-4eaa-bbef-a080377f2ed6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.055780 Nov 27 21:43:37.947470 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4035/8210] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:37 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:38.957909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-69966567-34e4-4a7f-8754-6e577f3b114d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:38.958905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-69966567-34e4-4a7f-8754-6e577f3b114d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:38.966130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69966567-34e4-4a7f-8754-6e577f3b114d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:38.966574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69966567-34e4-4a7f-8754-6e577f3b114d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:38.967363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69966567-34e4-4a7f-8754-6e577f3b114d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:38.967797 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-69966567-34e4-4a7f-8754-6e577f3b114d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:39.005437 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-69966567-34e4-4a7f-8754-6e577f3b114d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.051582 Nov 27 21:43:39.006396 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4176/8211] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:38 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:40.018203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-152d9c8f-bb9b-4962-9f20-565233d9f66c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:40.019225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-152d9c8f-bb9b-4962-9f20-565233d9f66c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:40.026570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-152d9c8f-bb9b-4962-9f20-565233d9f66c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:40.027041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-152d9c8f-bb9b-4962-9f20-565233d9f66c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:40.027878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-152d9c8f-bb9b-4962-9f20-565233d9f66c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:40.028337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-152d9c8f-bb9b-4962-9f20-565233d9f66c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:40.067697 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-152d9c8f-bb9b-4962-9f20-565233d9f66c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.054049 Nov 27 21:43:40.068569 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4036/8212] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:40 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:41.079471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c7420175-48d8-455c-87f8-999c26bfe363 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:41.080383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c7420175-48d8-455c-87f8-999c26bfe363 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:41.087638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7420175-48d8-455c-87f8-999c26bfe363 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:41.088083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7420175-48d8-455c-87f8-999c26bfe363 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:41.088852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7420175-48d8-455c-87f8-999c26bfe363 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:41.089287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c7420175-48d8-455c-87f8-999c26bfe363 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:41.129421 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c7420175-48d8-455c-87f8-999c26bfe363 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.053706 Nov 27 21:43:41.130045 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4177/8213] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:41 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:42.142050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5af09571-5e34-4ab3-bab1-f159e040b70a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:42.143089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5af09571-5e34-4ab3-bab1-f159e040b70a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:42.150532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5af09571-5e34-4ab3-bab1-f159e040b70a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:42.151007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5af09571-5e34-4ab3-bab1-f159e040b70a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:42.151848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5af09571-5e34-4ab3-bab1-f159e040b70a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:42.152312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5af09571-5e34-4ab3-bab1-f159e040b70a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:42.190021 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5af09571-5e34-4ab3-bab1-f159e040b70a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052543 Nov 27 21:43:42.190717 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4037/8214] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:42 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:43.202156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-690219e7-61e3-40db-b269-7577b0cb5b4e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:43.203277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-690219e7-61e3-40db-b269-7577b0cb5b4e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:43.211209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690219e7-61e3-40db-b269-7577b0cb5b4e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:43.211682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690219e7-61e3-40db-b269-7577b0cb5b4e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:43.212489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690219e7-61e3-40db-b269-7577b0cb5b4e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:43.212925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-690219e7-61e3-40db-b269-7577b0cb5b4e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:43.251105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-690219e7-61e3-40db-b269-7577b0cb5b4e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052936 Nov 27 21:43:43.251783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4178/8215] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:43 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:44.262470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f4476edb-5fea-460d-9cf6-1556d05a4e39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:44.263559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f4476edb-5fea-460d-9cf6-1556d05a4e39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:44.270924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4476edb-5fea-460d-9cf6-1556d05a4e39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:44.271909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4476edb-5fea-460d-9cf6-1556d05a4e39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:44.272725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4476edb-5fea-460d-9cf6-1556d05a4e39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:44.273186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f4476edb-5fea-460d-9cf6-1556d05a4e39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:44.319210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f4476edb-5fea-460d-9cf6-1556d05a4e39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.060673 Nov 27 21:43:44.319873 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4038/8216] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:44 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:45.330398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9a3343e0-7079-4cae-9657-7eb05e13eac3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:45.331448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9a3343e0-7079-4cae-9657-7eb05e13eac3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:45.338718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3343e0-7079-4cae-9657-7eb05e13eac3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:45.339164 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3343e0-7079-4cae-9657-7eb05e13eac3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:45.339957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3343e0-7079-4cae-9657-7eb05e13eac3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:45.340392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9a3343e0-7079-4cae-9657-7eb05e13eac3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:45.379676 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9a3343e0-7079-4cae-9657-7eb05e13eac3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.052967 Nov 27 21:43:45.380291 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4179/8217] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:45 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:46.392135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-af8de8b5-9ec9-48de-acb6-e36bd19176f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:46.393212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-af8de8b5-9ec9-48de-acb6-e36bd19176f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:46.400607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8de8b5-9ec9-48de-acb6-e36bd19176f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:46.401088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8de8b5-9ec9-48de-acb6-e36bd19176f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:46.401894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8de8b5-9ec9-48de-acb6-e36bd19176f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:46.402354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-af8de8b5-9ec9-48de-acb6-e36bd19176f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:46.442825 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-af8de8b5-9ec9-48de-acb6-e36bd19176f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.055079 Nov 27 21:43:46.443547 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4039/8218] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:46 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:46.680527 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:43:46.681074 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:43:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:43:47.455392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f309279-2734-44e7-a7f5-79280555ff42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:47.456422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f309279-2734-44e7-a7f5-79280555ff42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:47.468129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f309279-2734-44e7-a7f5-79280555ff42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:47.468651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f309279-2734-44e7-a7f5-79280555ff42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:47.470151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f309279-2734-44e7-a7f5-79280555ff42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:47.470588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f309279-2734-44e7-a7f5-79280555ff42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:47.509907 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f309279-2734-44e7-a7f5-79280555ff42 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.058440 Nov 27 21:43:47.511349 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4180/8219] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:47 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:48.523068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-374c40df-b663-4353-9fc3-8ca113240e50 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:48.524116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-374c40df-b663-4353-9fc3-8ca113240e50 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:48.532552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374c40df-b663-4353-9fc3-8ca113240e50 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:48.533016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374c40df-b663-4353-9fc3-8ca113240e50 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:48.533808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374c40df-b663-4353-9fc3-8ca113240e50 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:48.534259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-374c40df-b663-4353-9fc3-8ca113240e50 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:48.575863 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-374c40df-b663-4353-9fc3-8ca113240e50 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.057294 Nov 27 21:43:48.576540 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4040/8220] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:48 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:49.587130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c53e216d-c8bc-4855-91b8-b84a2e573f62 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:49.588151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c53e216d-c8bc-4855-91b8-b84a2e573f62 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:49.599910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53e216d-c8bc-4855-91b8-b84a2e573f62 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:49.600366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53e216d-c8bc-4855-91b8-b84a2e573f62 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:49.601146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53e216d-c8bc-4855-91b8-b84a2e573f62 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:49.601582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c53e216d-c8bc-4855-91b8-b84a2e573f62 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:49.639134 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c53e216d-c8bc-4855-91b8-b84a2e573f62 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.056065 Nov 27 21:43:49.640056 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4181/8221] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:49 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:50.652001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ef61f2d-b04b-48c0-9777-8df2dfdee772 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:50.653059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ef61f2d-b04b-48c0-9777-8df2dfdee772 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:50.661394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef61f2d-b04b-48c0-9777-8df2dfdee772 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:50.661899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef61f2d-b04b-48c0-9777-8df2dfdee772 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:50.662705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef61f2d-b04b-48c0-9777-8df2dfdee772 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:50.663162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ef61f2d-b04b-48c0-9777-8df2dfdee772 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:50.703785 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ef61f2d-b04b-48c0-9777-8df2dfdee772 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.055223 Nov 27 21:43:50.704340 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4041/8222] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:50 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:51.715757 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14dce219-2b21-4ad1-856f-e271e0933d8b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:51.716724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-14dce219-2b21-4ad1-856f-e271e0933d8b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:51.724102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14dce219-2b21-4ad1-856f-e271e0933d8b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:51.724549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14dce219-2b21-4ad1-856f-e271e0933d8b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:51.725317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14dce219-2b21-4ad1-856f-e271e0933d8b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:51.725749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14dce219-2b21-4ad1-856f-e271e0933d8b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:51.763593 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-14dce219-2b21-4ad1-856f-e271e0933d8b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.051853 Nov 27 21:43:51.764212 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4182/8223] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:51 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:52.775879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1acb03f8-9ab5-4446-988f-4748c6432787 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:52.776897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1acb03f8-9ab5-4446-988f-4748c6432787 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:52.784554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1acb03f8-9ab5-4446-988f-4748c6432787 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:52.785020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1acb03f8-9ab5-4446-988f-4748c6432787 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:52.785816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1acb03f8-9ab5-4446-988f-4748c6432787 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:52.786267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1acb03f8-9ab5-4446-988f-4748c6432787 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:52.826988 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1acb03f8-9ab5-4446-988f-4748c6432787 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.055097 Nov 27 21:43:52.827700 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4042/8224] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:52 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 24564 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:43:53.839834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-866b3ab4-0670-49c5-b953-da45372f8cff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:53.840910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-866b3ab4-0670-49c5-b953-da45372f8cff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:53.848694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-866b3ab4-0670-49c5-b953-da45372f8cff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:53.849150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-866b3ab4-0670-49c5-b953-da45372f8cff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:53.849963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-866b3ab4-0670-49c5-b953-da45372f8cff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:53.850403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-866b3ab4-0670-49c5-b953-da45372f8cff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:53.900047 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-866b3ab4-0670-49c5-b953-da45372f8cff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.064185 Nov 27 21:43:53.900680 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4183/8225] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:53 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:54.912809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b37607ca-f7c0-4ef5-aaf8-d16cbfb27242 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:54.913826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b37607ca-f7c0-4ef5-aaf8-d16cbfb27242 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:54.921179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37607ca-f7c0-4ef5-aaf8-d16cbfb27242 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:54.921646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37607ca-f7c0-4ef5-aaf8-d16cbfb27242 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:54.923005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37607ca-f7c0-4ef5-aaf8-d16cbfb27242 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:54.923482 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37607ca-f7c0-4ef5-aaf8-d16cbfb27242 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:54.962508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b37607ca-f7c0-4ef5-aaf8-d16cbfb27242 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053777 Nov 27 21:43:54.963117 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4043/8226] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:54 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:55.975177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-23b3b59d-2ec6-4baf-8aaa-b4829bf2d19f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:55.976196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-23b3b59d-2ec6-4baf-8aaa-b4829bf2d19f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:55.983405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23b3b59d-2ec6-4baf-8aaa-b4829bf2d19f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:55.983852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23b3b59d-2ec6-4baf-8aaa-b4829bf2d19f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:55.984665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23b3b59d-2ec6-4baf-8aaa-b4829bf2d19f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:55.985096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-23b3b59d-2ec6-4baf-8aaa-b4829bf2d19f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:56.023785 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-23b3b59d-2ec6-4baf-8aaa-b4829bf2d19f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052596 Nov 27 21:43:56.024424 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4184/8227] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:55 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:57.036771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99b1d225-d30d-4974-90e0-eaf204f2b7be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:57.037824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99b1d225-d30d-4974-90e0-eaf204f2b7be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:57.045134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b1d225-d30d-4974-90e0-eaf204f2b7be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:57.045628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b1d225-d30d-4974-90e0-eaf204f2b7be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:57.046442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b1d225-d30d-4974-90e0-eaf204f2b7be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:57.047570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99b1d225-d30d-4974-90e0-eaf204f2b7be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:57.087349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99b1d225-d30d-4974-90e0-eaf204f2b7be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054780 Nov 27 21:43:57.087936 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4044/8228] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:57 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:58.098357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c728f819-4753-47c2-a067-b9944b31b40c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:58.099421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c728f819-4753-47c2-a067-b9944b31b40c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:58.106698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c728f819-4753-47c2-a067-b9944b31b40c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:58.107150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c728f819-4753-47c2-a067-b9944b31b40c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:58.107956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c728f819-4753-47c2-a067-b9944b31b40c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:58.108400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c728f819-4753-47c2-a067-b9944b31b40c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:58.148602 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c728f819-4753-47c2-a067-b9944b31b40c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054197 Nov 27 21:43:58.149216 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4185/8229] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:58 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:43:59.160702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-82de05b6-7e36-4f13-9696-ea6bac8741f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:43:59.161746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-82de05b6-7e36-4f13-9696-ea6bac8741f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:43:59.169073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82de05b6-7e36-4f13-9696-ea6bac8741f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:59.169542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82de05b6-7e36-4f13-9696-ea6bac8741f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:59.170330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82de05b6-7e36-4f13-9696-ea6bac8741f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:43:59.170780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-82de05b6-7e36-4f13-9696-ea6bac8741f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:43:59.211052 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-82de05b6-7e36-4f13-9696-ea6bac8741f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054855 Nov 27 21:43:59.211947 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4045/8230] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:43:59 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:00.223715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b39fbc06-7730-4de1-a5af-4915640c107c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:00.224725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b39fbc06-7730-4de1-a5af-4915640c107c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:00.232073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b39fbc06-7730-4de1-a5af-4915640c107c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:00.232527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b39fbc06-7730-4de1-a5af-4915640c107c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:00.233305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b39fbc06-7730-4de1-a5af-4915640c107c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:00.233740 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b39fbc06-7730-4de1-a5af-4915640c107c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:00.276209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b39fbc06-7730-4de1-a5af-4915640c107c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056476 Nov 27 21:44:00.276870 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4186/8231] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:00 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:01.288820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5327bd28-1404-4353-8b5e-3eacf0a409a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:01.289851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5327bd28-1404-4353-8b5e-3eacf0a409a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:01.297217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5327bd28-1404-4353-8b5e-3eacf0a409a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:01.297689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5327bd28-1404-4353-8b5e-3eacf0a409a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:01.298493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5327bd28-1404-4353-8b5e-3eacf0a409a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:01.298955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5327bd28-1404-4353-8b5e-3eacf0a409a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:01.338324 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5327bd28-1404-4353-8b5e-3eacf0a409a3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053432 Nov 27 21:44:01.339175 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4046/8232] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:01 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:44:02.350999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e461738e-8a6d-47cf-9be2-ddf5a5d40794 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:02.352029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e461738e-8a6d-47cf-9be2-ddf5a5d40794 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:02.359914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e461738e-8a6d-47cf-9be2-ddf5a5d40794 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:02.360371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e461738e-8a6d-47cf-9be2-ddf5a5d40794 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:02.361140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e461738e-8a6d-47cf-9be2-ddf5a5d40794 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:02.361585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e461738e-8a6d-47cf-9be2-ddf5a5d40794 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:02.400551 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e461738e-8a6d-47cf-9be2-ddf5a5d40794 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053603 Nov 27 21:44:02.401302 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4187/8233] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:02 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:03.412922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-29dff249-d9ab-43bb-a63f-5358f91b9472 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:03.413947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-29dff249-d9ab-43bb-a63f-5358f91b9472 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:03.421333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29dff249-d9ab-43bb-a63f-5358f91b9472 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:03.422310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29dff249-d9ab-43bb-a63f-5358f91b9472 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:03.423106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29dff249-d9ab-43bb-a63f-5358f91b9472 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:03.423610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-29dff249-d9ab-43bb-a63f-5358f91b9472 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:03.466793 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-29dff249-d9ab-43bb-a63f-5358f91b9472 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.057793 Nov 27 21:44:03.467460 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4047/8234] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:03 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:04.478481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e5b1bb7-dd0b-455c-95b3-20525b314d8f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:04.479517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e5b1bb7-dd0b-455c-95b3-20525b314d8f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:04.486788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e5b1bb7-dd0b-455c-95b3-20525b314d8f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:04.487239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e5b1bb7-dd0b-455c-95b3-20525b314d8f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:04.488033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e5b1bb7-dd0b-455c-95b3-20525b314d8f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:04.488472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e5b1bb7-dd0b-455c-95b3-20525b314d8f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:04.528341 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e5b1bb7-dd0b-455c-95b3-20525b314d8f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053773 Nov 27 21:44:04.528994 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4188/8235] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:04 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:05.540495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-32ac189c-30dd-4e78-ab84-b4ea7893edfc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:05.541628 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-32ac189c-30dd-4e78-ab84-b4ea7893edfc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:05.549023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32ac189c-30dd-4e78-ab84-b4ea7893edfc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:05.549498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32ac189c-30dd-4e78-ab84-b4ea7893edfc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:05.550300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32ac189c-30dd-4e78-ab84-b4ea7893edfc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:05.550757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-32ac189c-30dd-4e78-ab84-b4ea7893edfc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:05.590018 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-32ac189c-30dd-4e78-ab84-b4ea7893edfc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053516 Nov 27 21:44:05.590570 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4048/8236] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:05 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:06.602698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d157acef-0094-4fcf-976b-ecb78725339e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:06.603744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d157acef-0094-4fcf-976b-ecb78725339e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:06.611922 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d157acef-0094-4fcf-976b-ecb78725339e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:06.612375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d157acef-0094-4fcf-976b-ecb78725339e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:06.613156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d157acef-0094-4fcf-976b-ecb78725339e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:06.613592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d157acef-0094-4fcf-976b-ecb78725339e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:06.653853 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d157acef-0094-4fcf-976b-ecb78725339e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055295 Nov 27 21:44:06.654477 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4189/8237] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:06 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:44:07.665793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-71bea19b-e885-4ba9-a851-124f6c02392b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:07.666812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-71bea19b-e885-4ba9-a851-124f6c02392b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:07.674240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bea19b-e885-4ba9-a851-124f6c02392b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:07.674705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bea19b-e885-4ba9-a851-124f6c02392b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:07.675528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bea19b-e885-4ba9-a851-124f6c02392b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:07.675982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-71bea19b-e885-4ba9-a851-124f6c02392b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:07.715438 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-71bea19b-e885-4ba9-a851-124f6c02392b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053555 Nov 27 21:44:07.716014 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4049/8238] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:07 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:08.727929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1610dae8-5d7d-425a-8722-0d4d594c3ad9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:08.728852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1610dae8-5d7d-425a-8722-0d4d594c3ad9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:08.736168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1610dae8-5d7d-425a-8722-0d4d594c3ad9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:08.736620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1610dae8-5d7d-425a-8722-0d4d594c3ad9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:08.737395 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1610dae8-5d7d-425a-8722-0d4d594c3ad9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:08.737833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1610dae8-5d7d-425a-8722-0d4d594c3ad9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:08.776224 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1610dae8-5d7d-425a-8722-0d4d594c3ad9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052426 Nov 27 21:44:08.776866 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4190/8239] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:08 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:09.788427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c5bd46cf-17cb-4ba7-8d41-fb7b268ac801 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:09.789457 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c5bd46cf-17cb-4ba7-8d41-fb7b268ac801 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:09.796924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5bd46cf-17cb-4ba7-8d41-fb7b268ac801 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:09.797392 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5bd46cf-17cb-4ba7-8d41-fb7b268ac801 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:09.798196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5bd46cf-17cb-4ba7-8d41-fb7b268ac801 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:09.798650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c5bd46cf-17cb-4ba7-8d41-fb7b268ac801 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:09.838604 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c5bd46cf-17cb-4ba7-8d41-fb7b268ac801 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054083 Nov 27 21:44:09.839549 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4050/8240] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:09 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:10.851157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a9e97ad-2dec-431c-9e8b-d3b37b16ea93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:10.852215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a9e97ad-2dec-431c-9e8b-d3b37b16ea93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:10.859690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a9e97ad-2dec-431c-9e8b-d3b37b16ea93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:10.860149 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a9e97ad-2dec-431c-9e8b-d3b37b16ea93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:10.860934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a9e97ad-2dec-431c-9e8b-d3b37b16ea93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:10.861379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a9e97ad-2dec-431c-9e8b-d3b37b16ea93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:10.900873 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a9e97ad-2dec-431c-9e8b-d3b37b16ea93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053833 Nov 27 21:44:10.901498 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4191/8241] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:10 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:11.913531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-767501a9-57ab-44a2-a904-a432947c04a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:11.914548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-767501a9-57ab-44a2-a904-a432947c04a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:11.921959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767501a9-57ab-44a2-a904-a432947c04a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:11.923061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767501a9-57ab-44a2-a904-a432947c04a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:11.923891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767501a9-57ab-44a2-a904-a432947c04a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:11.924344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-767501a9-57ab-44a2-a904-a432947c04a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:11.963286 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-767501a9-57ab-44a2-a904-a432947c04a2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053712 Nov 27 21:44:11.963901 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4051/8242] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:11 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:12.975423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5bfa789e-116f-48e0-9a76-78d6db862d02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:12.976425 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5bfa789e-116f-48e0-9a76-78d6db862d02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:12.983722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bfa789e-116f-48e0-9a76-78d6db862d02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:12.984166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bfa789e-116f-48e0-9a76-78d6db862d02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:12.984933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bfa789e-116f-48e0-9a76-78d6db862d02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:12.985365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bfa789e-116f-48e0-9a76-78d6db862d02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:13.026667 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5bfa789e-116f-48e0-9a76-78d6db862d02 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055214 Nov 27 21:44:13.027356 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4192/8243] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:12 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:14.039064 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-97be4f62-5cb8-4a65-9694-5329270012ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:14.040175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-97be4f62-5cb8-4a65-9694-5329270012ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:14.048342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97be4f62-5cb8-4a65-9694-5329270012ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:14.048813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97be4f62-5cb8-4a65-9694-5329270012ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:14.049873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97be4f62-5cb8-4a65-9694-5329270012ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:14.050334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-97be4f62-5cb8-4a65-9694-5329270012ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:14.090692 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-97be4f62-5cb8-4a65-9694-5329270012ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055632 Nov 27 21:44:14.091357 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4052/8244] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:14 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:15.102796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8e7f79fa-1a5c-4455-86c9-081ad0228492 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:15.103818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8e7f79fa-1a5c-4455-86c9-081ad0228492 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:15.111721 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e7f79fa-1a5c-4455-86c9-081ad0228492 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:15.112168 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e7f79fa-1a5c-4455-86c9-081ad0228492 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:15.112933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e7f79fa-1a5c-4455-86c9-081ad0228492 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:15.113366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8e7f79fa-1a5c-4455-86c9-081ad0228492 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:15.156807 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8e7f79fa-1a5c-4455-86c9-081ad0228492 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.057917 Nov 27 21:44:15.157455 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4193/8245] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:15 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:16.169789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2f80cd34-c38c-4ce4-bd5c-6a436fd98a84 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:16.170761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2f80cd34-c38c-4ce4-bd5c-6a436fd98a84 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:16.178729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f80cd34-c38c-4ce4-bd5c-6a436fd98a84 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:16.179202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f80cd34-c38c-4ce4-bd5c-6a436fd98a84 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:16.180024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f80cd34-c38c-4ce4-bd5c-6a436fd98a84 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:16.180481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2f80cd34-c38c-4ce4-bd5c-6a436fd98a84 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:16.222455 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2f80cd34-c38c-4ce4-bd5c-6a436fd98a84 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056819 Nov 27 21:44:16.223359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4053/8246] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:16 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:17.234349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3dba1e1e-b4f9-4772-a4f2-a2c35fab0c54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:17.235275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3dba1e1e-b4f9-4772-a4f2-a2c35fab0c54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:17.242538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dba1e1e-b4f9-4772-a4f2-a2c35fab0c54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:17.242991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dba1e1e-b4f9-4772-a4f2-a2c35fab0c54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:17.243800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dba1e1e-b4f9-4772-a4f2-a2c35fab0c54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:17.244242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3dba1e1e-b4f9-4772-a4f2-a2c35fab0c54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:17.284550 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3dba1e1e-b4f9-4772-a4f2-a2c35fab0c54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054286 Nov 27 21:44:17.285181 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4194/8247] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:17 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:18.296732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dd941df8-a7b9-4239-a250-8e476192d893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:18.297761 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dd941df8-a7b9-4239-a250-8e476192d893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:18.305108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd941df8-a7b9-4239-a250-8e476192d893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:18.305583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd941df8-a7b9-4239-a250-8e476192d893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:18.306394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd941df8-a7b9-4239-a250-8e476192d893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:18.306852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd941df8-a7b9-4239-a250-8e476192d893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:18.346927 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dd941df8-a7b9-4239-a250-8e476192d893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054164 Nov 27 21:44:18.347596 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4054/8248] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:18 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:19.359005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-202fc157-1183-48e5-a350-cc22711da0ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:19.360079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-202fc157-1183-48e5-a350-cc22711da0ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:19.367914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-202fc157-1183-48e5-a350-cc22711da0ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:19.368366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-202fc157-1183-48e5-a350-cc22711da0ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:19.369135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-202fc157-1183-48e5-a350-cc22711da0ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:19.369573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-202fc157-1183-48e5-a350-cc22711da0ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:19.408696 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-202fc157-1183-48e5-a350-cc22711da0ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053600 Nov 27 21:44:19.409337 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4195/8249] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:19 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:20.420895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4cf6427c-4457-4b58-ac9c-a30fcff42d18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:20.421932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4cf6427c-4457-4b58-ac9c-a30fcff42d18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:20.429461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cf6427c-4457-4b58-ac9c-a30fcff42d18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:20.429935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cf6427c-4457-4b58-ac9c-a30fcff42d18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:20.430748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cf6427c-4457-4b58-ac9c-a30fcff42d18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:20.431209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4cf6427c-4457-4b58-ac9c-a30fcff42d18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:20.471664 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4cf6427c-4457-4b58-ac9c-a30fcff42d18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054731 Nov 27 21:44:20.472315 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4055/8250] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:20 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:21.483031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a5ef315c-140d-4e3d-9bd5-c555eafd4e12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:21.484563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a5ef315c-140d-4e3d-9bd5-c555eafd4e12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:21.491933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5ef315c-140d-4e3d-9bd5-c555eafd4e12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:21.492392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5ef315c-140d-4e3d-9bd5-c555eafd4e12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:21.493187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5ef315c-140d-4e3d-9bd5-c555eafd4e12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:21.493658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a5ef315c-140d-4e3d-9bd5-c555eafd4e12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:21.533898 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a5ef315c-140d-4e3d-9bd5-c555eafd4e12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054929 Nov 27 21:44:21.534765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4196/8251] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:21 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:22.546575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-161cf338-0c07-4db8-902c-ac57a11d0c01 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:22.547633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-161cf338-0c07-4db8-902c-ac57a11d0c01 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:22.555272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-161cf338-0c07-4db8-902c-ac57a11d0c01 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:22.555752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-161cf338-0c07-4db8-902c-ac57a11d0c01 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:22.556585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-161cf338-0c07-4db8-902c-ac57a11d0c01 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:22.557047 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-161cf338-0c07-4db8-902c-ac57a11d0c01 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:22.595773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-161cf338-0c07-4db8-902c-ac57a11d0c01 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052812 Nov 27 21:44:22.596654 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4056/8252] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:22 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:23.607306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fadf8169-55b6-4b3f-877e-17c702a50a52 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:23.608315 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fadf8169-55b6-4b3f-877e-17c702a50a52 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:23.616046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fadf8169-55b6-4b3f-877e-17c702a50a52 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:23.616526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fadf8169-55b6-4b3f-877e-17c702a50a52 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:23.617311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fadf8169-55b6-4b3f-877e-17c702a50a52 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:23.617749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fadf8169-55b6-4b3f-877e-17c702a50a52 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:23.667447 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fadf8169-55b6-4b3f-877e-17c702a50a52 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.064191 Nov 27 21:44:23.668332 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4197/8253] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:23 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:24.679386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a0f3455-2800-4955-b8db-4830794a3a03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:24.680422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a0f3455-2800-4955-b8db-4830794a3a03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:24.687789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a0f3455-2800-4955-b8db-4830794a3a03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:24.688262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a0f3455-2800-4955-b8db-4830794a3a03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:24.689559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a0f3455-2800-4955-b8db-4830794a3a03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:24.690017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a0f3455-2800-4955-b8db-4830794a3a03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:24.729032 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a0f3455-2800-4955-b8db-4830794a3a03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053648 Nov 27 21:44:24.729819 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4057/8254] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:24 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:25.741940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ae9f19d-2e7f-45a3-b887-cd88f9e427b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:25.742892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ae9f19d-2e7f-45a3-b887-cd88f9e427b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:25.750157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ae9f19d-2e7f-45a3-b887-cd88f9e427b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:25.750605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ae9f19d-2e7f-45a3-b887-cd88f9e427b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:25.751456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ae9f19d-2e7f-45a3-b887-cd88f9e427b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:25.751888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ae9f19d-2e7f-45a3-b887-cd88f9e427b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:25.793044 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ae9f19d-2e7f-45a3-b887-cd88f9e427b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055069 Nov 27 21:44:25.793752 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4198/8255] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:25 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:26.805485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-86d0dd81-18bc-4bd1-a0b6-5d51db0349db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:26.806513 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-86d0dd81-18bc-4bd1-a0b6-5d51db0349db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:26.814588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d0dd81-18bc-4bd1-a0b6-5d51db0349db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:26.815066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d0dd81-18bc-4bd1-a0b6-5d51db0349db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:26.815914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d0dd81-18bc-4bd1-a0b6-5d51db0349db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:26.816374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-86d0dd81-18bc-4bd1-a0b6-5d51db0349db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:26.855747 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-86d0dd81-18bc-4bd1-a0b6-5d51db0349db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054205 Nov 27 21:44:26.856374 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4058/8256] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:26 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:27.867729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39e73af2-e715-4185-b71a-03d5aeb921ed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:27.868727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39e73af2-e715-4185-b71a-03d5aeb921ed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:27.876523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e73af2-e715-4185-b71a-03d5aeb921ed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:27.876977 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e73af2-e715-4185-b71a-03d5aeb921ed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:27.877741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e73af2-e715-4185-b71a-03d5aeb921ed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:27.878174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e73af2-e715-4185-b71a-03d5aeb921ed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:27.917033 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39e73af2-e715-4185-b71a-03d5aeb921ed tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053252 Nov 27 21:44:27.917642 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4199/8257] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:27 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:44:28.928544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8f5ef200-3c6e-40cc-bcf4-5acb5e00f0f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:28.929566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8f5ef200-3c6e-40cc-bcf4-5acb5e00f0f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:28.936979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5ef200-3c6e-40cc-bcf4-5acb5e00f0f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:28.937444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5ef200-3c6e-40cc-bcf4-5acb5e00f0f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:28.938233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5ef200-3c6e-40cc-bcf4-5acb5e00f0f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:28.938777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8f5ef200-3c6e-40cc-bcf4-5acb5e00f0f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:28.982551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8f5ef200-3c6e-40cc-bcf4-5acb5e00f0f7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.057957 Nov 27 21:44:28.983218 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4059/8258] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:28 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:29.994789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-907a289b-bf7e-485e-bd3f-17d8e48ce3e3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:29.995833 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-907a289b-bf7e-485e-bd3f-17d8e48ce3e3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:30.003084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907a289b-bf7e-485e-bd3f-17d8e48ce3e3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:30.003566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907a289b-bf7e-485e-bd3f-17d8e48ce3e3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:30.004581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907a289b-bf7e-485e-bd3f-17d8e48ce3e3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:30.005012 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-907a289b-bf7e-485e-bd3f-17d8e48ce3e3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:30.046477 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-907a289b-bf7e-485e-bd3f-17d8e48ce3e3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055466 Nov 27 21:44:30.047025 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4200/8259] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:29 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:31.059436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9197aac9-a106-40ef-ab3c-fba6a45a0949 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:31.060461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9197aac9-a106-40ef-ab3c-fba6a45a0949 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:31.067867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9197aac9-a106-40ef-ab3c-fba6a45a0949 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:31.068338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9197aac9-a106-40ef-ab3c-fba6a45a0949 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:31.069139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9197aac9-a106-40ef-ab3c-fba6a45a0949 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:31.069594 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9197aac9-a106-40ef-ab3c-fba6a45a0949 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:31.111551 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9197aac9-a106-40ef-ab3c-fba6a45a0949 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056238 Nov 27 21:44:31.112223 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4060/8260] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:31 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:32.123560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e1a0a05-ff36-4d91-a5fa-b3924f1c8fdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:32.124476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e1a0a05-ff36-4d91-a5fa-b3924f1c8fdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:32.132664 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e1a0a05-ff36-4d91-a5fa-b3924f1c8fdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:32.133111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e1a0a05-ff36-4d91-a5fa-b3924f1c8fdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:32.133877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e1a0a05-ff36-4d91-a5fa-b3924f1c8fdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:32.134307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e1a0a05-ff36-4d91-a5fa-b3924f1c8fdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:32.174733 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e1a0a05-ff36-4d91-a5fa-b3924f1c8fdf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055185 Nov 27 21:44:32.175374 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4201/8261] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:32 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:33.186993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0d2b790f-eb3a-472e-97eb-d6d881abd3f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:33.188102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0d2b790f-eb3a-472e-97eb-d6d881abd3f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:33.195955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2b790f-eb3a-472e-97eb-d6d881abd3f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:33.196431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2b790f-eb3a-472e-97eb-d6d881abd3f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:33.197230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2b790f-eb3a-472e-97eb-d6d881abd3f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:33.197688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0d2b790f-eb3a-472e-97eb-d6d881abd3f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:33.238770 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0d2b790f-eb3a-472e-97eb-d6d881abd3f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055739 Nov 27 21:44:33.239431 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4061/8262] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:33 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:34.251387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-593c6567-46e4-4d55-ac81-4a5cbc7d7bbb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:34.252341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-593c6567-46e4-4d55-ac81-4a5cbc7d7bbb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:34.259960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-593c6567-46e4-4d55-ac81-4a5cbc7d7bbb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:34.260408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-593c6567-46e4-4d55-ac81-4a5cbc7d7bbb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:34.261174 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-593c6567-46e4-4d55-ac81-4a5cbc7d7bbb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:34.261608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-593c6567-46e4-4d55-ac81-4a5cbc7d7bbb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:34.300271 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-593c6567-46e4-4d55-ac81-4a5cbc7d7bbb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052969 Nov 27 21:44:34.301184 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4202/8263] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:34 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:35.312459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11600ed4-a7b0-4ed8-8fe5-8c80dc8ca7bf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:35.313484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11600ed4-a7b0-4ed8-8fe5-8c80dc8ca7bf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:35.321137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11600ed4-a7b0-4ed8-8fe5-8c80dc8ca7bf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:35.321599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11600ed4-a7b0-4ed8-8fe5-8c80dc8ca7bf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:35.322388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11600ed4-a7b0-4ed8-8fe5-8c80dc8ca7bf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:35.322840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11600ed4-a7b0-4ed8-8fe5-8c80dc8ca7bf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:35.361572 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11600ed4-a7b0-4ed8-8fe5-8c80dc8ca7bf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052979 Nov 27 21:44:35.362227 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4062/8264] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:35 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:36.373779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-27c9fe29-9bd6-447e-a6b5-5c4612c309b7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:36.374694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-27c9fe29-9bd6-447e-a6b5-5c4612c309b7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:36.382241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c9fe29-9bd6-447e-a6b5-5c4612c309b7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:36.382682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c9fe29-9bd6-447e-a6b5-5c4612c309b7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:36.383477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c9fe29-9bd6-447e-a6b5-5c4612c309b7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:36.383917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-27c9fe29-9bd6-447e-a6b5-5c4612c309b7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:36.422278 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-27c9fe29-9bd6-447e-a6b5-5c4612c309b7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052576 Nov 27 21:44:36.422942 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4203/8265] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:36 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:37.434704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eea0f263-6997-41ec-80a4-afc9f1bf57d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:37.435769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eea0f263-6997-41ec-80a4-afc9f1bf57d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:37.443360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eea0f263-6997-41ec-80a4-afc9f1bf57d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:37.443839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eea0f263-6997-41ec-80a4-afc9f1bf57d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:37.444651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eea0f263-6997-41ec-80a4-afc9f1bf57d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:37.445108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eea0f263-6997-41ec-80a4-afc9f1bf57d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:37.485852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eea0f263-6997-41ec-80a4-afc9f1bf57d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054474 Nov 27 21:44:37.486539 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4063/8266] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:37 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:38.497371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5b9329e-15fd-4087-9362-66211e3b1265 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:38.498363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5b9329e-15fd-4087-9362-66211e3b1265 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:38.511464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b9329e-15fd-4087-9362-66211e3b1265 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:38.511917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b9329e-15fd-4087-9362-66211e3b1265 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:38.512690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b9329e-15fd-4087-9362-66211e3b1265 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:38.513130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5b9329e-15fd-4087-9362-66211e3b1265 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:38.552310 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5b9329e-15fd-4087-9362-66211e3b1265 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.058811 Nov 27 21:44:38.552946 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4204/8267] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:38 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:39.564737 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9f54e0a3-be81-4da2-a188-b83cbf99780d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:39.565778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9f54e0a3-be81-4da2-a188-b83cbf99780d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:39.573131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f54e0a3-be81-4da2-a188-b83cbf99780d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:39.573592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f54e0a3-be81-4da2-a188-b83cbf99780d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:39.574401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f54e0a3-be81-4da2-a188-b83cbf99780d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:39.574833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9f54e0a3-be81-4da2-a188-b83cbf99780d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:39.617116 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9f54e0a3-be81-4da2-a188-b83cbf99780d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056347 Nov 27 21:44:39.617766 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4064/8268] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:39 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:40.629337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00427321-d3dd-4c17-8c19-6a8e9ae221c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:40.630333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00427321-d3dd-4c17-8c19-6a8e9ae221c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:40.637633 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00427321-d3dd-4c17-8c19-6a8e9ae221c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:40.638021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00427321-d3dd-4c17-8c19-6a8e9ae221c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:40.638784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00427321-d3dd-4c17-8c19-6a8e9ae221c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:40.639211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00427321-d3dd-4c17-8c19-6a8e9ae221c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:40.678125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00427321-d3dd-4c17-8c19-6a8e9ae221c5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053049 Nov 27 21:44:40.678742 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4205/8269] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:40 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:44:41.690897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-07f721fc-0e9a-4c31-bc43-e6d6263cebc2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:41.691970 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-07f721fc-0e9a-4c31-bc43-e6d6263cebc2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:41.699444 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07f721fc-0e9a-4c31-bc43-e6d6263cebc2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:41.699861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07f721fc-0e9a-4c31-bc43-e6d6263cebc2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:41.700670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07f721fc-0e9a-4c31-bc43-e6d6263cebc2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:41.701131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-07f721fc-0e9a-4c31-bc43-e6d6263cebc2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:41.742722 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-07f721fc-0e9a-4c31-bc43-e6d6263cebc2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056497 Nov 27 21:44:41.743410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4065/8270] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:41 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:42.755841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-97c9945a-2b30-4282-beb7-8591ad213b6e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:42.756861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-97c9945a-2b30-4282-beb7-8591ad213b6e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:42.764228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97c9945a-2b30-4282-beb7-8591ad213b6e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:42.764685 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97c9945a-2b30-4282-beb7-8591ad213b6e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:42.765470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97c9945a-2b30-4282-beb7-8591ad213b6e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:42.765911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-97c9945a-2b30-4282-beb7-8591ad213b6e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:42.806040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-97c9945a-2b30-4282-beb7-8591ad213b6e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054394 Nov 27 21:44:42.806916 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4206/8271] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:42 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:43.818529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a41d723b-e368-4537-863a-300511fe1c3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:43.819582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a41d723b-e368-4537-863a-300511fe1c3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:43.826837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a41d723b-e368-4537-863a-300511fe1c3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:43.827329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a41d723b-e368-4537-863a-300511fe1c3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:43.828118 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a41d723b-e368-4537-863a-300511fe1c3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:43.829092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a41d723b-e368-4537-863a-300511fe1c3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:43.869888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a41d723b-e368-4537-863a-300511fe1c3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055291 Nov 27 21:44:43.870527 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4066/8272] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:43 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:44.882068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bac7961-c4d6-4090-b880-66dbc5de893c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:44.883101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0bac7961-c4d6-4090-b880-66dbc5de893c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:44.890473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bac7961-c4d6-4090-b880-66dbc5de893c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:44.890979 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bac7961-c4d6-4090-b880-66dbc5de893c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:44.891786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bac7961-c4d6-4090-b880-66dbc5de893c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:44.892226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bac7961-c4d6-4090-b880-66dbc5de893c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:44.931173 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bac7961-c4d6-4090-b880-66dbc5de893c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053332 Nov 27 21:44:44.931840 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4207/8273] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:44 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:45.943944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-564f5e80-0162-4779-b598-cdfb5afe8848 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:45.944997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-564f5e80-0162-4779-b598-cdfb5afe8848 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:45.952396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564f5e80-0162-4779-b598-cdfb5afe8848 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:45.952871 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564f5e80-0162-4779-b598-cdfb5afe8848 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:45.954288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564f5e80-0162-4779-b598-cdfb5afe8848 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:45.954749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-564f5e80-0162-4779-b598-cdfb5afe8848 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:46.002980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-564f5e80-0162-4779-b598-cdfb5afe8848 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.063027 Nov 27 21:44:46.003925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4067/8274] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:45 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:47.014377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1206d8c2-3503-4218-bb65-288cbc318dbe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:47.015422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1206d8c2-3503-4218-bb65-288cbc318dbe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:47.023145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1206d8c2-3503-4218-bb65-288cbc318dbe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:47.023620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1206d8c2-3503-4218-bb65-288cbc318dbe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:47.024394 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1206d8c2-3503-4218-bb65-288cbc318dbe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:47.024828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1206d8c2-3503-4218-bb65-288cbc318dbe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:47.063830 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1206d8c2-3503-4218-bb65-288cbc318dbe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053340 Nov 27 21:44:47.064471 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4208/8275] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:47 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:48.076140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7bc9eb64-1c97-4e65-8e6a-fc6f7e81c288 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:48.077088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7bc9eb64-1c97-4e65-8e6a-fc6f7e81c288 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:48.084471 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc9eb64-1c97-4e65-8e6a-fc6f7e81c288 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:48.084944 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc9eb64-1c97-4e65-8e6a-fc6f7e81c288 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:48.085742 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc9eb64-1c97-4e65-8e6a-fc6f7e81c288 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:48.086227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7bc9eb64-1c97-4e65-8e6a-fc6f7e81c288 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:48.125337 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7bc9eb64-1c97-4e65-8e6a-fc6f7e81c288 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053278 Nov 27 21:44:48.125966 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4068/8276] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:48 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:49.137879 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-21cbcbae-359b-435f-aad5-8b9f1f17797e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:49.138831 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-21cbcbae-359b-435f-aad5-8b9f1f17797e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:49.146172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21cbcbae-359b-435f-aad5-8b9f1f17797e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:49.146623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21cbcbae-359b-435f-aad5-8b9f1f17797e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:49.147433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21cbcbae-359b-435f-aad5-8b9f1f17797e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:49.147872 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-21cbcbae-359b-435f-aad5-8b9f1f17797e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:49.191574 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-21cbcbae-359b-435f-aad5-8b9f1f17797e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.057691 Nov 27 21:44:49.192196 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4209/8277] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:49 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:50.204606 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-77ebae53-b20e-4f56-9536-c2d1ab2479da tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:50.205546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-77ebae53-b20e-4f56-9536-c2d1ab2479da tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:50.215076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77ebae53-b20e-4f56-9536-c2d1ab2479da tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:50.215587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77ebae53-b20e-4f56-9536-c2d1ab2479da tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:50.216390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77ebae53-b20e-4f56-9536-c2d1ab2479da tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:50.216845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-77ebae53-b20e-4f56-9536-c2d1ab2479da tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:50.257392 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-77ebae53-b20e-4f56-9536-c2d1ab2479da tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.057500 Nov 27 21:44:50.258028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4069/8278] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:50 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:51.270472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6b8afe0-e6a8-43fd-9d51-2afd9b124324 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:51.271540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e6b8afe0-e6a8-43fd-9d51-2afd9b124324 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:51.281082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6b8afe0-e6a8-43fd-9d51-2afd9b124324 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:51.282227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6b8afe0-e6a8-43fd-9d51-2afd9b124324 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:51.283066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6b8afe0-e6a8-43fd-9d51-2afd9b124324 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:51.283543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6b8afe0-e6a8-43fd-9d51-2afd9b124324 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:51.326199 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6b8afe0-e6a8-43fd-9d51-2afd9b124324 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.060261 Nov 27 21:44:51.326838 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4210/8279] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:51 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:52.338863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b5069c62-b846-4e2d-808d-6f7bff9ef43b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:52.339930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b5069c62-b846-4e2d-808d-6f7bff9ef43b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:52.347069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5069c62-b846-4e2d-808d-6f7bff9ef43b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:52.347558 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5069c62-b846-4e2d-808d-6f7bff9ef43b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:52.348347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5069c62-b846-4e2d-808d-6f7bff9ef43b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:52.348800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b5069c62-b846-4e2d-808d-6f7bff9ef43b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:52.388548 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b5069c62-b846-4e2d-808d-6f7bff9ef43b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053641 Nov 27 21:44:52.389196 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4070/8280] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:52 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:53.400873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-38c9ecc2-de9f-4ded-9ca5-5124f8ef2361 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:53.401873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-38c9ecc2-de9f-4ded-9ca5-5124f8ef2361 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:53.408857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38c9ecc2-de9f-4ded-9ca5-5124f8ef2361 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:53.409306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38c9ecc2-de9f-4ded-9ca5-5124f8ef2361 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:53.410089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38c9ecc2-de9f-4ded-9ca5-5124f8ef2361 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:53.410529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38c9ecc2-de9f-4ded-9ca5-5124f8ef2361 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:53.449221 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-38c9ecc2-de9f-4ded-9ca5-5124f8ef2361 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052370 Nov 27 21:44:53.449869 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4211/8281] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:53 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:54.462206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-83342104-5fb0-414b-bf03-3e251731c8ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:54.463295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-83342104-5fb0-414b-bf03-3e251731c8ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:54.471352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83342104-5fb0-414b-bf03-3e251731c8ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:54.471829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83342104-5fb0-414b-bf03-3e251731c8ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:54.472630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83342104-5fb0-414b-bf03-3e251731c8ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:54.473087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83342104-5fb0-414b-bf03-3e251731c8ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:54.515185 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-83342104-5fb0-414b-bf03-3e251731c8ec tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056975 Nov 27 21:44:54.516389 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4071/8282] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:54 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:55.527679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cf3baf2d-d5cf-457a-b24f-8575424f9b23 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:55.528789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cf3baf2d-d5cf-457a-b24f-8575424f9b23 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:55.536490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf3baf2d-d5cf-457a-b24f-8575424f9b23 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:55.536937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf3baf2d-d5cf-457a-b24f-8575424f9b23 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:55.537704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf3baf2d-d5cf-457a-b24f-8575424f9b23 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:55.538138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cf3baf2d-d5cf-457a-b24f-8575424f9b23 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:55.577276 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cf3baf2d-d5cf-457a-b24f-8575424f9b23 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053427 Nov 27 21:44:55.577904 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4212/8283] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:55 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:56.589549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-90f4e1a0-e35b-4233-a309-103f14eb6b06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:56.590561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-90f4e1a0-e35b-4233-a309-103f14eb6b06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:56.597904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4e1a0-e35b-4233-a309-103f14eb6b06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:56.598375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4e1a0-e35b-4233-a309-103f14eb6b06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:56.599164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4e1a0-e35b-4233-a309-103f14eb6b06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:56.599644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-90f4e1a0-e35b-4233-a309-103f14eb6b06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:56.639079 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-90f4e1a0-e35b-4233-a309-103f14eb6b06 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053521 Nov 27 21:44:56.639734 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4072/8284] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:56 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:57.651014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d29b2c5-97d5-45d4-b6cf-520fb5b0ee4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:57.652233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d29b2c5-97d5-45d4-b6cf-520fb5b0ee4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:57.659639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d29b2c5-97d5-45d4-b6cf-520fb5b0ee4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:57.660243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d29b2c5-97d5-45d4-b6cf-520fb5b0ee4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:57.660933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d29b2c5-97d5-45d4-b6cf-520fb5b0ee4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:57.661429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d29b2c5-97d5-45d4-b6cf-520fb5b0ee4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:57.702188 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d29b2c5-97d5-45d4-b6cf-520fb5b0ee4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055123 Nov 27 21:44:57.703543 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4213/8285] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:57 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:58.715753 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9042589c-6dda-4a98-acf1-0d9f606f7a54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:58.716699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9042589c-6dda-4a98-acf1-0d9f606f7a54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:58.724026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9042589c-6dda-4a98-acf1-0d9f606f7a54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:58.724497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9042589c-6dda-4a98-acf1-0d9f606f7a54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:58.725292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9042589c-6dda-4a98-acf1-0d9f606f7a54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:58.725748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9042589c-6dda-4a98-acf1-0d9f606f7a54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:58.766275 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9042589c-6dda-4a98-acf1-0d9f606f7a54 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054973 Nov 27 21:44:58.766919 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4073/8286] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:58 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:44:59.778637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68bb9ef7-b5aa-4d05-85ec-16f257d1b2ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:44:59.779678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68bb9ef7-b5aa-4d05-85ec-16f257d1b2ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:44:59.787621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bb9ef7-b5aa-4d05-85ec-16f257d1b2ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:59.788076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bb9ef7-b5aa-4d05-85ec-16f257d1b2ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:59.788861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bb9ef7-b5aa-4d05-85ec-16f257d1b2ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:44:59.789305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68bb9ef7-b5aa-4d05-85ec-16f257d1b2ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:44:59.827571 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68bb9ef7-b5aa-4d05-85ec-16f257d1b2ab tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052920 Nov 27 21:44:59.830621 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4214/8287] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:44:59 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:45:00.842703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-85e72e65-46a9-4e5e-b852-dcdee0cdc20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:00.843885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-85e72e65-46a9-4e5e-b852-dcdee0cdc20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:00.851827 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e72e65-46a9-4e5e-b852-dcdee0cdc20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:00.852305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e72e65-46a9-4e5e-b852-dcdee0cdc20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:00.853121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e72e65-46a9-4e5e-b852-dcdee0cdc20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:00.853586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85e72e65-46a9-4e5e-b852-dcdee0cdc20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:00.894454 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-85e72e65-46a9-4e5e-b852-dcdee0cdc20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056244 Nov 27 21:45:00.895100 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4074/8288] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:00 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:01.906735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9488eafb-ff3f-4168-82f9-7a6b7748a7c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:01.907762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9488eafb-ff3f-4168-82f9-7a6b7748a7c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:01.914976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9488eafb-ff3f-4168-82f9-7a6b7748a7c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:01.915461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9488eafb-ff3f-4168-82f9-7a6b7748a7c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:01.916230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9488eafb-ff3f-4168-82f9-7a6b7748a7c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:01.916663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9488eafb-ff3f-4168-82f9-7a6b7748a7c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:01.955690 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9488eafb-ff3f-4168-82f9-7a6b7748a7c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053478 Nov 27 21:45:01.956304 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4215/8289] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:01 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:45:02.966909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-60e88849-eb7f-4f4c-ac4c-685c9303a26e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:02.967948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60e88849-eb7f-4f4c-ac4c-685c9303a26e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:02.975757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60e88849-eb7f-4f4c-ac4c-685c9303a26e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:02.976221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60e88849-eb7f-4f4c-ac4c-685c9303a26e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:02.977024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60e88849-eb7f-4f4c-ac4c-685c9303a26e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:02.977472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60e88849-eb7f-4f4c-ac4c-685c9303a26e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:03.016412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-60e88849-eb7f-4f4c-ac4c-685c9303a26e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053513 Nov 27 21:45:03.017033 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4075/8290] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:02 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:04.028675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fcebbd06-892f-46a7-b8a9-4d7a69ee4d94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:04.029590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fcebbd06-892f-46a7-b8a9-4d7a69ee4d94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:04.036921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcebbd06-892f-46a7-b8a9-4d7a69ee4d94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:04.037372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcebbd06-892f-46a7-b8a9-4d7a69ee4d94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:04.038150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcebbd06-892f-46a7-b8a9-4d7a69ee4d94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:04.038585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fcebbd06-892f-46a7-b8a9-4d7a69ee4d94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:04.081777 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fcebbd06-892f-46a7-b8a9-4d7a69ee4d94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.057145 Nov 27 21:45:04.082422 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4216/8291] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:04 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:05.094907 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b8498d06-c237-4d68-b5d9-53b8b8a85806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:05.095954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b8498d06-c237-4d68-b5d9-53b8b8a85806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:05.103182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8498d06-c237-4d68-b5d9-53b8b8a85806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:05.103672 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8498d06-c237-4d68-b5d9-53b8b8a85806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:05.104459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8498d06-c237-4d68-b5d9-53b8b8a85806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:05.104910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8498d06-c237-4d68-b5d9-53b8b8a85806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:05.144759 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b8498d06-c237-4d68-b5d9-53b8b8a85806 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054494 Nov 27 21:45:05.145439 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4076/8292] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:05 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:06.157562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75898abd-e28d-4ca3-99c7-17db3f73e93d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:06.158494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75898abd-e28d-4ca3-99c7-17db3f73e93d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:06.165750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75898abd-e28d-4ca3-99c7-17db3f73e93d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:06.166218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75898abd-e28d-4ca3-99c7-17db3f73e93d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:06.166970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75898abd-e28d-4ca3-99c7-17db3f73e93d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:06.167437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75898abd-e28d-4ca3-99c7-17db3f73e93d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:06.205137 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75898abd-e28d-4ca3-99c7-17db3f73e93d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052128 Nov 27 21:45:06.205797 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4217/8293] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:06 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:07.217495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42148466-a5cf-4f79-8f89-375c4d21852b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:07.218534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42148466-a5cf-4f79-8f89-375c4d21852b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:07.225854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42148466-a5cf-4f79-8f89-375c4d21852b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:07.226330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42148466-a5cf-4f79-8f89-375c4d21852b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:07.227133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42148466-a5cf-4f79-8f89-375c4d21852b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:07.227620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42148466-a5cf-4f79-8f89-375c4d21852b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:07.270601 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42148466-a5cf-4f79-8f89-375c4d21852b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.057174 Nov 27 21:45:07.271281 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4077/8294] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:07 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:08.282718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a826255e-7a92-49c5-a956-29a6993b69d6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:08.283785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a826255e-7a92-49c5-a956-29a6993b69d6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:08.291046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a826255e-7a92-49c5-a956-29a6993b69d6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:08.291528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a826255e-7a92-49c5-a956-29a6993b69d6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:08.292307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a826255e-7a92-49c5-a956-29a6993b69d6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:08.292746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a826255e-7a92-49c5-a956-29a6993b69d6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:08.331632 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a826255e-7a92-49c5-a956-29a6993b69d6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052831 Nov 27 21:45:08.332262 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4218/8295] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:08 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:09.344542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bfee3bb4-9628-4e70-b4a2-edf5f6fea0a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:09.345579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bfee3bb4-9628-4e70-b4a2-edf5f6fea0a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:09.353090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfee3bb4-9628-4e70-b4a2-edf5f6fea0a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:09.353566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfee3bb4-9628-4e70-b4a2-edf5f6fea0a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:09.354369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfee3bb4-9628-4e70-b4a2-edf5f6fea0a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:09.354834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bfee3bb4-9628-4e70-b4a2-edf5f6fea0a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:09.394416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bfee3bb4-9628-4e70-b4a2-edf5f6fea0a1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054519 Nov 27 21:45:09.395058 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4078/8296] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:09 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:10.407041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-691d73ef-d17f-4085-8753-024f2e594dea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:10.408128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-691d73ef-d17f-4085-8753-024f2e594dea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:10.415832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-691d73ef-d17f-4085-8753-024f2e594dea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:10.416289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-691d73ef-d17f-4085-8753-024f2e594dea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:10.417068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-691d73ef-d17f-4085-8753-024f2e594dea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:10.417508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-691d73ef-d17f-4085-8753-024f2e594dea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:10.461316 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-691d73ef-d17f-4085-8753-024f2e594dea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.058765 Nov 27 21:45:10.462009 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4219/8297] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:10 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:11.473648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2796fe73-56f7-4f35-a013-c52ac203cf9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:11.474665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2796fe73-56f7-4f35-a013-c52ac203cf9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:11.481977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2796fe73-56f7-4f35-a013-c52ac203cf9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:11.482445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2796fe73-56f7-4f35-a013-c52ac203cf9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:11.483228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2796fe73-56f7-4f35-a013-c52ac203cf9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:11.484202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2796fe73-56f7-4f35-a013-c52ac203cf9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:11.524585 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2796fe73-56f7-4f35-a013-c52ac203cf9b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.054869 Nov 27 21:45:11.525249 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4079/8298] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:11 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:12.536718 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f63c702d-bf90-40dd-9328-dc08d0a466e7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:12.537716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f63c702d-bf90-40dd-9328-dc08d0a466e7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:12.545247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63c702d-bf90-40dd-9328-dc08d0a466e7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:12.545704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63c702d-bf90-40dd-9328-dc08d0a466e7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:12.546585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63c702d-bf90-40dd-9328-dc08d0a466e7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:12.547054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f63c702d-bf90-40dd-9328-dc08d0a466e7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:12.586042 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f63c702d-bf90-40dd-9328-dc08d0a466e7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053256 Nov 27 21:45:12.586834 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4220/8299] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:12 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:13.602395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f53b3074-295d-4960-8483-627703538a8d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:13.603483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f53b3074-295d-4960-8483-627703538a8d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:13.611506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f53b3074-295d-4960-8483-627703538a8d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:13.611975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f53b3074-295d-4960-8483-627703538a8d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:13.612771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f53b3074-295d-4960-8483-627703538a8d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:13.613224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f53b3074-295d-4960-8483-627703538a8d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:13.651871 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f53b3074-295d-4960-8483-627703538a8d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056551 Nov 27 21:45:13.652515 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4080/8300] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:13 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:45:14.664535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc7e8bea-ab4f-406b-a01a-38499a19142d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:14.665654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc7e8bea-ab4f-406b-a01a-38499a19142d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:14.673443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc7e8bea-ab4f-406b-a01a-38499a19142d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:14.673892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc7e8bea-ab4f-406b-a01a-38499a19142d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:14.674669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc7e8bea-ab4f-406b-a01a-38499a19142d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:14.675104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc7e8bea-ab4f-406b-a01a-38499a19142d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:14.714193 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc7e8bea-ab4f-406b-a01a-38499a19142d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053588 Nov 27 21:45:14.714733 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4221/8301] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:14 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:15.726729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed9d1f61-bbec-444a-87e9-172428758017 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:15.727700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed9d1f61-bbec-444a-87e9-172428758017 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:15.735060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed9d1f61-bbec-444a-87e9-172428758017 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:15.735571 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed9d1f61-bbec-444a-87e9-172428758017 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:15.736364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed9d1f61-bbec-444a-87e9-172428758017 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:15.736810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed9d1f61-bbec-444a-87e9-172428758017 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:15.776360 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed9d1f61-bbec-444a-87e9-172428758017 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.053697 Nov 27 21:45:15.776999 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4081/8302] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:15 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:16.788599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7577df3a-6312-4c2a-a88e-4457a5379a13 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:16.789612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7577df3a-6312-4c2a-a88e-4457a5379a13 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:16.796870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7577df3a-6312-4c2a-a88e-4457a5379a13 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:16.797312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7577df3a-6312-4c2a-a88e-4457a5379a13 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:16.798086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7577df3a-6312-4c2a-a88e-4457a5379a13 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:16.798527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7577df3a-6312-4c2a-a88e-4457a5379a13 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:16.839883 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7577df3a-6312-4c2a-a88e-4457a5379a13 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.055237 Nov 27 21:45:16.840810 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4222/8303] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:16 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:17.853327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-828773b6-ecb0-412a-9151-025b906dccd6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:17.854384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-828773b6-ecb0-412a-9151-025b906dccd6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:17.862387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828773b6-ecb0-412a-9151-025b906dccd6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:17.862851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828773b6-ecb0-412a-9151-025b906dccd6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:17.863673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828773b6-ecb0-412a-9151-025b906dccd6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:17.864126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-828773b6-ecb0-412a-9151-025b906dccd6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:17.910201 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-828773b6-ecb0-412a-9151-025b906dccd6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.060857 Nov 27 21:45:17.910852 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4082/8304] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:17 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:18.922400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a6b64b9-0f05-4959-b27c-36e67e0bbbbd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:18.923438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a6b64b9-0f05-4959-b27c-36e67e0bbbbd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:18.930728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6b64b9-0f05-4959-b27c-36e67e0bbbbd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:18.931192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6b64b9-0f05-4959-b27c-36e67e0bbbbd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:18.931978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6b64b9-0f05-4959-b27c-36e67e0bbbbd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:18.932415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a6b64b9-0f05-4959-b27c-36e67e0bbbbd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:18.970656 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a6b64b9-0f05-4959-b27c-36e67e0bbbbd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.052158 Nov 27 21:45:18.971293 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4223/8305] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:18 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:19.982487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-037dd699-bcf4-4862-9579-2f5eba414cb7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:19.983548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-037dd699-bcf4-4862-9579-2f5eba414cb7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:19.990898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037dd699-bcf4-4862-9579-2f5eba414cb7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:19.991429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037dd699-bcf4-4862-9579-2f5eba414cb7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:19.992240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037dd699-bcf4-4862-9579-2f5eba414cb7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:19.992702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-037dd699-bcf4-4862-9579-2f5eba414cb7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:20.034661 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-037dd699-bcf4-4862-9579-2f5eba414cb7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 32637 microversion: 2.1 time: 0.056066 Nov 27 21:45:20.035244 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4083/8306] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:19 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:21.047742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0bc08fe9-0870-4e9a-999d-29560fe44943 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:21.048743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0bc08fe9-0870-4e9a-999d-29560fe44943 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:21.056092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc08fe9-0870-4e9a-999d-29560fe44943 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:21.056548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc08fe9-0870-4e9a-999d-29560fe44943 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:21.057330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc08fe9-0870-4e9a-999d-29560fe44943 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:21.057768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0bc08fe9-0870-4e9a-999d-29560fe44943 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:21.108007 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0bc08fe9-0870-4e9a-999d-29560fe44943 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 200 len: 40793 microversion: 2.1 time: 0.064843 Nov 27 21:45:21.109324 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4224/8307] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:21 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 40793 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:45:21.119714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:21.120840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:21.128261 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:21.128733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:21.129789 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:21.130246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:21.241546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:21.248202 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Old instance type m1.heat2, new instance type m1.heat {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:45:21.254727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:45:21.255172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:45:21.255697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:45:21.256124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:45:21.256554 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:45:21.319459 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e033b97-f096-4699-b99f-5b984e5cb2df tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 202 len: 0 microversion: 2.1 time: 0.203714 Nov 27 21:45:21.319993 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4084/8308] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:21 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:45:21.328948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:21.329655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:21.336812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:21.337268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:21.338057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:21.338500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:21.618934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:21.627424 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8084f7ef-67b8-4b27-9fce-bb354b482e8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1678 microversion: 2.1 time: 0.303017 Nov 27 21:45:21.628000 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4225/8309] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:21 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1678 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:22.646255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:22.646890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:22.653786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:22.654259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:22.655057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:22.655540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:22.912393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:22.920608 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c2cba9d2-b281-4588-822b-2ee59bbec02e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1678 microversion: 2.1 time: 0.279030 Nov 27 21:45:22.921683 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4085/8310] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:22 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1678 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:23.938330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:23.938937 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:23.945945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:23.946396 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:23.947170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:23.947658 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:24.086587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:24.094045 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a104dbf6-789b-4e33-9245-416fc471de43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1678 microversion: 2.1 time: 0.159962 Nov 27 21:45:24.094621 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4226/8311] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:23 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:25.111155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:25.111812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:25.118578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:25.119039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:25.119861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:25.120314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:25.249688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:25.262158 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f8742a0c-ed8a-4da1-b0fd-378720caac68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1678 microversion: 2.1 time: 0.154742 Nov 27 21:45:25.262740 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4086/8312] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:25 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:26.282043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:26.282696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:26.289435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:26.289891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:26.290700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:26.291136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:26.429887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:26.437694 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7de8124b-b5da-4df5-b1a4-552caca30513 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1678 microversion: 2.1 time: 0.160070 Nov 27 21:45:26.438268 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4227/8313] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:26 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:26.607867 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:45:26.608164 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:45:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:45:27.453698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:27.454322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:27.461029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:27.461488 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:27.462292 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:27.462726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:27.594543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:27.601928 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9d34b2f-e3f2-43d1-9aa1-83193e8d15db tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.151957 Nov 27 21:45:27.602531 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4087/8314] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:27 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:28.619401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:28.620007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:28.627298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:28.627742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:28.628533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:28.629218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:28.765029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:28.772514 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-902a94c8-b498-4457-8bd7-638baba0d7d1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.156846 Nov 27 21:45:28.773142 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4228/8315] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:28 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:45:29.789643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:29.790269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:29.799220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:29.799728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:29.800531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:29.800987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:29.933372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:29.941347 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d9d31614-6701-43de-8297-ba30334d6408 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.155488 Nov 27 21:45:29.941925 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4088/8316] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:29 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:30.958622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:30.959230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:30.968284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:30.968731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:30.969528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:30.969960 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:31.105967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:31.114222 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3957fc66-777a-426b-8bbe-020abff4b8bd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.159332 Nov 27 21:45:31.114787 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4229/8317] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:30 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:32.131045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:32.131695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:32.138395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:32.138886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:32.140265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:32.140719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:32.275461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:32.282894 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-60174427-08eb-4acb-a1e7-bb91d21fbea8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.155882 Nov 27 21:45:32.283520 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4089/8318] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:32 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:33.299782 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:33.300383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:33.306981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:33.307460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:33.308226 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:33.308656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:33.437358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:33.444935 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02ee3baa-c97b-4a5d-b3e7-03a91e0e6d55 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.148796 Nov 27 21:45:33.445510 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4230/8319] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:33 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:34.461896 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:34.462527 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:34.469858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:34.470335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:34.471146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:34.471641 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:34.606220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:34.614385 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3f0dcaad-5134-4845-b04a-925cb72969aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.156249 Nov 27 21:45:34.614967 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4090/8320] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:34 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:35.631671 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:35.632282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:35.638993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:35.639477 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:35.640439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:35.640880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:35.770913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:35.779317 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a131c650-f986-468a-aea9-e5ffd8d03234 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.151676 Nov 27 21:45:35.779987 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4231/8321] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:35 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:36.796306 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:36.796940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:36.803808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:36.804281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:36.805082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:36.805543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:36.935245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:36.945856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c38b1dec-e455-44a4-9d1a-0208401a5bb9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.153141 Nov 27 21:45:36.946495 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4091/8322] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:36 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:37.964667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:37.965259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:37.972636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:37.973077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:37.973844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:37.974276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:38.106803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:38.114539 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3a8bd9f7-b69c-4c02-a981-dd21ae72db29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.153539 Nov 27 21:45:38.115118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4232/8323] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:37 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:39.131810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:39.132435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:39.139191 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:39.139694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:39.140518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:39.140977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:39.292823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:39.300531 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4255abcd-416a-49a8-bc93-a6a956da0d39 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1683 microversion: 2.1 time: 0.172749 Nov 27 21:45:39.301115 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4092/8324] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:39 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:40.228602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-23528b4a-1471-401a-93cd-dad843dacec5 req-521fcc23-b7b1-4e38-8a80-1fe215d54a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "name": "network-vif-unplugged", "status": "completed", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:40.230192 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:45:40.230192 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:45:40.240447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-23528b4a-1471-401a-93cd-dad843dacec5 req-521fcc23-b7b1-4e38-8a80-1fe215d54a82 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:40.241680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-23528b4a-1471-401a-93cd-dad843dacec5 req-521fcc23-b7b1-4e38-8a80-1fe215d54a82 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:40.259906 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-23528b4a-1471-401a-93cd-dad843dacec5 req-521fcc23-b7b1-4e38-8a80-1fe215d54a82 service nova] Creating event network-vif-unplugged:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch1-master-1 Nov 27 21:45:40.268410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-23528b4a-1471-401a-93cd-dad843dacec5 req-521fcc23-b7b1-4e38-8a80-1fe215d54a82 service nova] Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:45:40.282592 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-23528b4a-1471-401a-93cd-dad843dacec5 req-521fcc23-b7b1-4e38-8a80-1fe215d54a82 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113623 Nov 27 21:45:40.283214 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4233/8325] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:45:40 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:45:40.317829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:40.318478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:40.329866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:40.330340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:40.331154 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:40.331642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:40.534961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:40.542662 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f51dcdbc-cdd7-4338-95d0-d14f944523a4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1682 microversion: 2.1 time: 0.228477 Nov 27 21:45:40.543619 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4093/8326] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:40 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:41.564093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:41.564793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:41.571773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:41.572563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:41.573398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:41.573902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:41.717259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:41.725050 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eed60dc7-ff0d-4e5c-a9f3-3c737f82ccef tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1680 microversion: 2.1 time: 0.166586 Nov 27 21:45:41.725652 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4234/8327] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:41 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:42.297056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-5d0a8b6c-12bf-40da-b049-b2c720eaa151 req-e9177c12-5550-4820-b306-35c7a4a96899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:42.298608 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:45:42.298608 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:45:42.306347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5d0a8b6c-12bf-40da-b049-b2c720eaa151 req-e9177c12-5550-4820-b306-35c7a4a96899 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:42.306814 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-5d0a8b6c-12bf-40da-b049-b2c720eaa151 req-e9177c12-5550-4820-b306-35c7a4a96899 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:42.318107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-5d0a8b6c-12bf-40da-b049-b2c720eaa151 req-e9177c12-5550-4820-b306-35c7a4a96899 service nova] Creating event network-changed:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch1-master-1 Nov 27 21:45:42.323342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-5d0a8b6c-12bf-40da-b049-b2c720eaa151 req-e9177c12-5550-4820-b306-35c7a4a96899 service nova] Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:45:42.334306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-5d0a8b6c-12bf-40da-b049-b2c720eaa151 req-e9177c12-5550-4820-b306-35c7a4a96899 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040901 Nov 27 21:45:42.334886 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4094/8328] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:45:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:45:42.742915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:42.743813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:42.751220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:42.751694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:42.752684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:42.753124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:42.947122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:42.956350 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a29f974-7e48-47ba-b94d-e24f399f5f7f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1680 microversion: 2.1 time: 0.217335 Nov 27 21:45:42.957206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4235/8329] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:42 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:45:43.975218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:43.975971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:43.982228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:43.982699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:43.983541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:43.984005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:44.122473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:44.130870 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-04ef4123-ca24-4a92-9b48-b06d7f523294 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1677 microversion: 2.1 time: 0.160615 Nov 27 21:45:44.131490 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4095/8330] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:43 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:44.147775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:44.148324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:44.154949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:44.155448 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:44.156227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:44.156687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:44.187972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:44.188422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:44.189234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:44.189675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:44.211941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:45:44.217046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:45:44.319449 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ecdd5bb-42fb-481d-b234-73b4f6979e4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action" status: 202 len: 0 microversion: 2.1 time: 0.175120 Nov 27 21:45:44.319977 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4236/8331] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:45:44 2021] POST /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:45:44.328493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:44.329130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:44.335134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:44.335642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:44.336448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:44.336902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:44.533266 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:44.542225 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1363dc44-97d0-42ba-a029-3fe65ef05edc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1676 microversion: 2.1 time: 0.217655 Nov 27 21:45:44.543415 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4096/8332] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:44 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:45.112897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d0c4c045-9fe2-40bd-a53c-9c845c6bb3e5 req-416e604e-5ae9-46a5-802d-af8c6161db9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "name": "network-vif-plugged", "status": "completed", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:45.114437 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:45:45.114437 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:45:45.121354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d0c4c045-9fe2-40bd-a53c-9c845c6bb3e5 req-416e604e-5ae9-46a5-802d-af8c6161db9b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:45.121792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d0c4c045-9fe2-40bd-a53c-9c845c6bb3e5 req-416e604e-5ae9-46a5-802d-af8c6161db9b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:45.133405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d0c4c045-9fe2-40bd-a53c-9c845c6bb3e5 req-416e604e-5ae9-46a5-802d-af8c6161db9b service nova] Creating event network-vif-plugged:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch1-master-1 Nov 27 21:45:45.138551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-d0c4c045-9fe2-40bd-a53c-9c845c6bb3e5 req-416e604e-5ae9-46a5-802d-af8c6161db9b service nova] Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:45:45.149110 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d0c4c045-9fe2-40bd-a53c-9c845c6bb3e5 req-416e604e-5ae9-46a5-802d-af8c6161db9b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107794 Nov 27 21:45:45.149770 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4237/8333] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:45:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:45:45.560298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:45.560984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:45.567802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:45.568276 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:45.569080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:45.569542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:45.705338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:45.712805 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-738b8f99-caab-4f96-a288-74268a308062 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1676 microversion: 2.1 time: 0.156318 Nov 27 21:45:45.713383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4097/8334] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:45 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:45:46.731506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:46.732118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:46.738838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:46.739314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:46.740093 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:46.740531 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:46.879235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:46.887482 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-03a36441-264d-476e-8edb-8cb4195db20d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1676 microversion: 2.1 time: 0.160956 Nov 27 21:45:46.888974 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4238/8335] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:46 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:47.635635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-ad507fc3-876a-47be-9539-ac8ea887ae0b req-adb7450b-a28f-4be6-a4fd-94dd40ab700e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "name": "network-vif-unplugged", "status": "completed", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:47.637916 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:45:47.637916 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:45:47.646281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ad507fc3-876a-47be-9539-ac8ea887ae0b req-adb7450b-a28f-4be6-a4fd-94dd40ab700e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:47.646949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-ad507fc3-876a-47be-9539-ac8ea887ae0b req-adb7450b-a28f-4be6-a4fd-94dd40ab700e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:47.664193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-ad507fc3-876a-47be-9539-ac8ea887ae0b req-adb7450b-a28f-4be6-a4fd-94dd40ab700e service nova] Creating event network-vif-unplugged:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch2-master-1 Nov 27 21:45:47.671601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-ad507fc3-876a-47be-9539-ac8ea887ae0b req-adb7450b-a28f-4be6-a4fd-94dd40ab700e service nova] Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:45:47.683405 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-ad507fc3-876a-47be-9539-ac8ea887ae0b req-adb7450b-a28f-4be6-a4fd-94dd40ab700e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104500 Nov 27 21:45:47.684121 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4098/8336] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:45:47 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:45:47.906559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:47.907171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:47.913891 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:47.914352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:47.915126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:47.915591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:48.150994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:48.158851 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8447ad49-4fc0-4c5e-b73a-1d86c823ccea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1676 microversion: 2.1 time: 0.257122 Nov 27 21:45:48.159536 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4239/8337] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:47 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:49.178054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:49.178690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:49.184979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:49.186160 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:49.186976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:49.187472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:49.318961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:49.326443 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7770c19b-0f92-4f3b-b1aa-ee9ca494dbe8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1676 microversion: 2.1 time: 0.153512 Nov 27 21:45:49.327012 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4099/8338] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:49 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:49.701753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-29f738ce-6132-4b6b-92e1-61eaef0fa96a req-dddc87bf-1f1d-41dc-9a53-0284d6039ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:49.703183 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:45:49.703183 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:45:49.710860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-29f738ce-6132-4b6b-92e1-61eaef0fa96a req-dddc87bf-1f1d-41dc-9a53-0284d6039ec4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:49.711330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-29f738ce-6132-4b6b-92e1-61eaef0fa96a req-dddc87bf-1f1d-41dc-9a53-0284d6039ec4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:49.723017 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-29f738ce-6132-4b6b-92e1-61eaef0fa96a req-dddc87bf-1f1d-41dc-9a53-0284d6039ec4 service nova] Creating event network-changed:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch2-master-1 Nov 27 21:45:49.728444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-29f738ce-6132-4b6b-92e1-61eaef0fa96a req-dddc87bf-1f1d-41dc-9a53-0284d6039ec4 service nova] Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:45:49.739800 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-29f738ce-6132-4b6b-92e1-61eaef0fa96a req-dddc87bf-1f1d-41dc-9a53-0284d6039ec4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041676 Nov 27 21:45:49.740404 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4240/8339] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:45:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:45:50.343087 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:50.343747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:50.350439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:50.350916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:50.351746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:50.352208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:50.487541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:50.495009 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-96c58dcc-318e-4505-9649-b70b39a47c3e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1676 microversion: 2.1 time: 0.155705 Nov 27 21:45:50.495695 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4100/8340] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:50 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:51.514336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:51.515543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:51.522385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:51.522836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:51.523652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:51.524086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:51.658727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:51.666103 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-28b920dc-755d-4635-96db-a1d1c35841b6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1669 microversion: 2.1 time: 0.155883 Nov 27 21:45:51.666677 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4241/8341] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:51 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:51.682199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:51.682817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:51.689644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:51.690107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:51.690895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:51.691373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:51.828342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:51.835631 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-aee1893c-fde8-4abf-a2d9-aa15d027cf70 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1669 microversion: 2.1 time: 0.157195 Nov 27 21:45:51.836197 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4101/8342] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:51 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:51.851222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:51.851865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:51.857853 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:51.858332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:51.859112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:51.859577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:51.992704 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:52.000803 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4bcbab37-60e0-4a09-8330-02974f622898 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1669 microversion: 2.1 time: 0.153258 Nov 27 21:45:52.001367 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4242/8343] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:51 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:52.017099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:52.017612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:52.023668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:52.024072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:52.024864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:52.025327 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:52.050645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:45:52.126442 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6908bd8e-8e91-4830-9515-3a373bee3665 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 204 len: 0 microversion: 2.1 time: 0.112651 Nov 27 21:45:52.127037 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4102/8344] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:45:52 2021] DELETE /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:45:52.135233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:52.135865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:52.141656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:52.142105 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:52.142876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:52.143337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:52.271467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:52.278880 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-caf14f94-142c-4da8-9b50-f9103497d19b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1675 microversion: 2.1 time: 0.147262 Nov 27 21:45:52.279417 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4243/8345] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:52 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:53.296477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:53.297187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:53.303834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:53.304300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:53.305095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:53.305546 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:53.436002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:53.444437 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f00abacd-8406-4d5e-8ee5-9e03374725e6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1675 microversion: 2.1 time: 0.152027 Nov 27 21:45:53.445020 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4103/8346] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:53 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:54.461927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:54.462783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:54.469966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:54.470640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:54.471385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:54.471982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:54.487241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-03f22230-34ea-465d-9563-d2221bc21260 req-2e227cb8-2b0a-4f91-bd56-41579c77a8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dae413f-06a3-4b54-b500-c39507b7ea3b", "name": "network-vif-deleted", "tag": "1ba7c268-4792-4f7d-bec0-77f8c8df1c22"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:54.489756 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:45:54.489756 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:45:54.500005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-03f22230-34ea-465d-9563-d2221bc21260 req-2e227cb8-2b0a-4f91-bd56-41579c77a8b5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:54.500477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-03f22230-34ea-465d-9563-d2221bc21260 req-2e227cb8-2b0a-4f91-bd56-41579c77a8b5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:54.515901 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-03f22230-34ea-465d-9563-d2221bc21260 req-2e227cb8-2b0a-4f91-bd56-41579c77a8b5 service nova] Creating event network-vif-deleted:1ba7c268-4792-4f7d-bec0-77f8c8df1c22 for instance 2dae413f-06a3-4b54-b500-c39507b7ea3b on nch2-master-1 Nov 27 21:45:54.524909 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-03f22230-34ea-465d-9563-d2221bc21260 req-2e227cb8-2b0a-4f91-bd56-41579c77a8b5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041258 Nov 27 21:45:54.525534 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4104/8347] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:45:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:45:54.546496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:54.559406 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8de233ce-c455-4769-8e22-a8a75a9a452b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 200 len: 1608 microversion: 2.1 time: 0.100827 Nov 27 21:45:54.560303 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4244/8348] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:54 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 1608 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:55.577785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:55.578501 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:55.585168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:55.585642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:55.586438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:55.586892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:55.600583 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. Nov 27 21:45:55.601184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:45:55.602017 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff8c6e8a-7ea8-4615-8649-fa1bdaf2d661 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 404 len: 111 microversion: 2.1 time: 0.028499 Nov 27 21:45:55.602560 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4105/8349] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:55 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:45:55.674612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:55.675223 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:55.682047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:55.682492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:55.683294 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:55.683735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:55.697914 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. Nov 27 21:45:55.698456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:45:55.699305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-90527cef-506f-4067-8849-08dc541b6068 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 404 len: 111 microversion: 2.1 time: 0.029036 Nov 27 21:45:55.699846 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4245/8350] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:55 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:45:55.745322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-563077406", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "d7f8e8e5-e085-4395-9b1c-093e8c6acee0"}], "security_groups": [{"name": "tempest-securitygroup--488750309"}], "key_name": "tempest-keypair-1705610460", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:55.847283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] validate_networks() for [('d7f8e8e5-e085-4395-9b1c-093e8c6acee0', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:45:56.211143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:45:56.211605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:45:56.212100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:45:56.212519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:45:56.212940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:45:56.223969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:56.224432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:56.225262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:56.225750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:56.244283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:45:56.249851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:45:56.262158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:45:56.264549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:45:56.309562 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a87e1130-528b-4f23-9517-42e3deeceacc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.567976 Nov 27 21:45:56.310201 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4106/8351] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:45:55 2021] POST /compute/v2.1/servers => generated 405 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:45:56.321045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a16b3495-eb24-430f-9386-3346d84bb203 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:56.321668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a16b3495-eb24-430f-9386-3346d84bb203 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:56.373735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a16b3495-eb24-430f-9386-3346d84bb203 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:56.383481 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a16b3495-eb24-430f-9386-3346d84bb203 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1238 microversion: 2.1 time: 0.066663 Nov 27 21:45:56.384234 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4246/8352] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:56 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:57.402092 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:57.402834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:57.410388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:57.410865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:57.411735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:57.412193 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:57.474535 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:57.481935 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d6d61c1-9cf7-4a7c-a30c-7bf430bf9b45 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1296 microversion: 2.1 time: 0.084456 Nov 27 21:45:57.482510 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4107/8353] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:57 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:45:58.499732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:45:58.500324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:45:58.512820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:58.513377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:58.514161 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:58.514635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:58.556699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-531ea517-8c78-40a5-b185-dafab63ba486 req-68ccf980-04b4-415c-8355-6585156ffd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:45:58.559526 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:45:58.559526 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:45:58.572766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-531ea517-8c78-40a5-b185-dafab63ba486 req-68ccf980-04b4-415c-8355-6585156ffd10 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:45:58.573282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-531ea517-8c78-40a5-b185-dafab63ba486 req-68ccf980-04b4-415c-8355-6585156ffd10 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:45:58.598031 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-531ea517-8c78-40a5-b185-dafab63ba486 req-68ccf980-04b4-415c-8355-6585156ffd10 service nova] Creating event network-changed:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch2-master-1 Nov 27 21:45:58.604658 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-531ea517-8c78-40a5-b185-dafab63ba486 req-68ccf980-04b4-415c-8355-6585156ffd10 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058306 Nov 27 21:45:58.605383 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4108/8354] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:45:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:45:59.093793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:45:59.101197 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f6dc9557-8d0f-465f-8ca6-688a327a17cd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1363 microversion: 2.1 time: 0.605171 Nov 27 21:45:59.101763 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4247/8355] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:45:58 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1363 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:00.119550 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:00.120282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:00.126854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:00.127347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:00.128138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:00.128588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:00.260920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:46:00.268549 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e42c8fbe-099b-443b-b180-3ae7bfb5ce21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1363 microversion: 2.1 time: 0.153898 Nov 27 21:46:00.269113 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4109/8356] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:46:00 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:01.284943 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:01.285582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:01.292492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:01.292944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:01.293750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:01.294192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:01.315830 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:46:01.316312 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:46:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:46:01.427695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:46:01.435125 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2fefe1b1-ca67-40f5-a5fe-396a5686636f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1363 microversion: 2.1 time: 0.153835 Nov 27 21:46:01.435712 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4248/8357] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:46:01 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:02.452785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:02.453971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:02.460785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:02.461264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:02.462080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:02.462544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:02.595055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:46:02.602527 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f831b07c-cb13-4229-99ab-854aef29a2b3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1363 microversion: 2.1 time: 0.154130 Nov 27 21:46:02.603129 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4110/8358] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:46:02 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:03.620593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:03.621196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:03.628323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:03.628838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:03.629871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:03.630303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:03.759846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:46:03.768109 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2dde785e-63b3-40f0-aa24-7e49f5bf1e83 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1363 microversion: 2.1 time: 0.151475 Nov 27 21:46:03.768667 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4249/8359] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:46:03 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:04.500190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-57a0e16a-00b1-4138-85c1-800a1f51d263 req-6ae61da3-a819-4ba0-8d37-28b67f14ac21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "name": "network-vif-plugged", "status": "completed", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:04.501856 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:46:04.501856 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:46:04.511146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-57a0e16a-00b1-4138-85c1-800a1f51d263 req-6ae61da3-a819-4ba0-8d37-28b67f14ac21 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:04.511757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-57a0e16a-00b1-4138-85c1-800a1f51d263 req-6ae61da3-a819-4ba0-8d37-28b67f14ac21 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:04.522926 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-57a0e16a-00b1-4138-85c1-800a1f51d263 req-6ae61da3-a819-4ba0-8d37-28b67f14ac21 service nova] Creating event network-vif-plugged:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch2-master-1 Nov 27 21:46:04.527659 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-57a0e16a-00b1-4138-85c1-800a1f51d263 req-6ae61da3-a819-4ba0-8d37-28b67f14ac21 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031286 Nov 27 21:46:04.528260 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4111/8360] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:46:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:46:04.785599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:04.786200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:04.792878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:04.793323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:04.794095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:04.794527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:04.924020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:46:04.931232 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6effa3ba-5b5b-40b2-b07a-c23e7152b9cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1363 microversion: 2.1 time: 0.149271 Nov 27 21:46:04.931816 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4250/8361] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:46:04 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:05.951223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:05.952060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:05.958240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:05.958748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:05.959576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:05.960029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:06.095308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:46:06.102842 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eaaab0bc-281d-4846-a12e-5434067f69be tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1363 microversion: 2.1 time: 0.158083 Nov 27 21:46:06.103452 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4112/8362] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:46:05 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:07.120684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:07.121323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:07.128707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:07.129407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:07.130180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:07.130623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:07.260850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:46:07.268397 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d1572344-8048-4f19-b94e-4892128ded28 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1549 microversion: 2.1 time: 0.151392 Nov 27 21:46:07.268972 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4251/8363] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:46:07 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:07.284909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5fca7076-dbba-4214-b4a5-a0773076ae0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:46:07.285435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5fca7076-dbba-4214-b4a5-a0773076ae0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:07.292172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fca7076-dbba-4214-b4a5-a0773076ae0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:07.292653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fca7076-dbba-4214-b4a5-a0773076ae0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:07.293455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fca7076-dbba-4214-b4a5-a0773076ae0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:07.293917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5fca7076-dbba-4214-b4a5-a0773076ae0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:07.380817 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5fca7076-dbba-4214-b4a5-a0773076ae0d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099646 Nov 27 21:46:07.381429 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4113/8364] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:46:07 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:46:08.668130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-815269cc-4fff-4219-9e6a-f1afc32530c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:08.669117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-815269cc-4fff-4219-9e6a-f1afc32530c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:08.674296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-20199087-e6b3-44f1-8088-97da112ac91e req-24923400-0f75-43b3-a999-bbfd0e618f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:08.676481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815269cc-4fff-4219-9e6a-f1afc32530c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:08.676786 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:46:08.676786 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:46:08.677019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815269cc-4fff-4219-9e6a-f1afc32530c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:08.677716 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815269cc-4fff-4219-9e6a-f1afc32530c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:08.678158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-815269cc-4fff-4219-9e6a-f1afc32530c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:08.685864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-20199087-e6b3-44f1-8088-97da112ac91e req-24923400-0f75-43b3-a999-bbfd0e618f00 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:08.687233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-20199087-e6b3-44f1-8088-97da112ac91e req-24923400-0f75-43b3-a999-bbfd0e618f00 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:08.700138 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-20199087-e6b3-44f1-8088-97da112ac91e req-24923400-0f75-43b3-a999-bbfd0e618f00 service nova] Creating event network-changed:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch2-master-1 Nov 27 21:46:08.706199 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-20199087-e6b3-44f1-8088-97da112ac91e req-24923400-0f75-43b3-a999-bbfd0e618f00 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038816 Nov 27 21:46:08.707063 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4114/8365] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:46:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:46:08.723479 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-815269cc-4fff-4219-9e6a-f1afc32530c9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.058827 Nov 27 21:46:08.724950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4252/8366] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:08 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:09.735994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-31942f36-ec63-4619-bf95-fcbc40ce3602 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:09.737114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-31942f36-ec63-4619-bf95-fcbc40ce3602 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:09.744287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31942f36-ec63-4619-bf95-fcbc40ce3602 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:09.744766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31942f36-ec63-4619-bf95-fcbc40ce3602 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:09.745583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31942f36-ec63-4619-bf95-fcbc40ce3602 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:09.746056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-31942f36-ec63-4619-bf95-fcbc40ce3602 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:09.784008 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-31942f36-ec63-4619-bf95-fcbc40ce3602 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.052246 Nov 27 21:46:09.784633 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4115/8367] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:09 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:10.794527 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1b9f1dc6-f529-45ad-8ab8-cc81b773f6cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:10.795585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1b9f1dc6-f529-45ad-8ab8-cc81b773f6cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:10.802839 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b9f1dc6-f529-45ad-8ab8-cc81b773f6cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:10.803307 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b9f1dc6-f529-45ad-8ab8-cc81b773f6cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:10.804077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b9f1dc6-f529-45ad-8ab8-cc81b773f6cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:10.804509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1b9f1dc6-f529-45ad-8ab8-cc81b773f6cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:10.840314 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1b9f1dc6-f529-45ad-8ab8-cc81b773f6cb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.049754 Nov 27 21:46:10.840933 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4253/8368] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:10 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:11.852342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf7e382d-85a7-4b88-a718-be0a483c767d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:11.853379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf7e382d-85a7-4b88-a718-be0a483c767d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:11.861429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7e382d-85a7-4b88-a718-be0a483c767d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:11.861905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7e382d-85a7-4b88-a718-be0a483c767d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:11.862710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7e382d-85a7-4b88-a718-be0a483c767d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:11.863172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf7e382d-85a7-4b88-a718-be0a483c767d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:11.900275 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf7e382d-85a7-4b88-a718-be0a483c767d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.051907 Nov 27 21:46:11.900912 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4116/8369] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:11 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:12.911764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0a9eb3f3-2c27-456e-be56-f276f7b5211f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:12.912761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0a9eb3f3-2c27-456e-be56-f276f7b5211f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:12.920040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9eb3f3-2c27-456e-be56-f276f7b5211f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:12.920486 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9eb3f3-2c27-456e-be56-f276f7b5211f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:12.921249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9eb3f3-2c27-456e-be56-f276f7b5211f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:12.921682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0a9eb3f3-2c27-456e-be56-f276f7b5211f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:12.957633 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0a9eb3f3-2c27-456e-be56-f276f7b5211f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.049949 Nov 27 21:46:12.958277 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4254/8370] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:12 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:13.969611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10bcc9be-9023-4e07-8a9f-b6fbd543e725 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:13.970682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10bcc9be-9023-4e07-8a9f-b6fbd543e725 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:13.978112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10bcc9be-9023-4e07-8a9f-b6fbd543e725 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:13.978585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10bcc9be-9023-4e07-8a9f-b6fbd543e725 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:13.979422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10bcc9be-9023-4e07-8a9f-b6fbd543e725 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:13.979880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10bcc9be-9023-4e07-8a9f-b6fbd543e725 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:14.016607 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10bcc9be-9023-4e07-8a9f-b6fbd543e725 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.051660 Nov 27 21:46:14.017381 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4117/8371] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:13 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:15.027298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8aa8095c-3850-4f48-ab24-d9ce2ea2f443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:15.028327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8aa8095c-3850-4f48-ab24-d9ce2ea2f443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:15.036106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa8095c-3850-4f48-ab24-d9ce2ea2f443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:15.036553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa8095c-3850-4f48-ab24-d9ce2ea2f443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:15.037314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa8095c-3850-4f48-ab24-d9ce2ea2f443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:15.037744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8aa8095c-3850-4f48-ab24-d9ce2ea2f443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:15.075259 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8aa8095c-3850-4f48-ab24-d9ce2ea2f443 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.051954 Nov 27 21:46:15.075876 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4255/8372] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:15 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:16.088358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac314ae1-680a-4824-a6d7-1e5bd1faf281 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:16.089338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac314ae1-680a-4824-a6d7-1e5bd1faf281 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:16.096714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac314ae1-680a-4824-a6d7-1e5bd1faf281 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:16.097183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac314ae1-680a-4824-a6d7-1e5bd1faf281 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:16.097983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac314ae1-680a-4824-a6d7-1e5bd1faf281 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:16.098441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac314ae1-680a-4824-a6d7-1e5bd1faf281 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:16.139004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac314ae1-680a-4824-a6d7-1e5bd1faf281 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.054789 Nov 27 21:46:16.139673 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4118/8373] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:16 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:17.150588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-473d8c39-4e7d-4e9a-a091-1a123aff4588 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:17.151539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-473d8c39-4e7d-4e9a-a091-1a123aff4588 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:17.158796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-473d8c39-4e7d-4e9a-a091-1a123aff4588 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:17.159247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-473d8c39-4e7d-4e9a-a091-1a123aff4588 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:17.160045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-473d8c39-4e7d-4e9a-a091-1a123aff4588 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:17.160480 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-473d8c39-4e7d-4e9a-a091-1a123aff4588 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:17.199876 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-473d8c39-4e7d-4e9a-a091-1a123aff4588 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 14 microversion: 2.1 time: 0.053282 Nov 27 21:46:17.200549 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4256/8374] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:17 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:46:18.211426 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-840f64ce-cc7d-4d5e-84b5-76e2177cca47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:18.212408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-840f64ce-cc7d-4d5e-84b5-76e2177cca47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:18.220352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-840f64ce-cc7d-4d5e-84b5-76e2177cca47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:18.220816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-840f64ce-cc7d-4d5e-84b5-76e2177cca47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:18.221604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-840f64ce-cc7d-4d5e-84b5-76e2177cca47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:18.222058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-840f64ce-cc7d-4d5e-84b5-76e2177cca47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:18.272088 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-840f64ce-cc7d-4d5e-84b5-76e2177cca47 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 8206 microversion: 2.1 time: 0.064754 Nov 27 21:46:18.272744 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4119/8375] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:18 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 8206 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:46:19.283637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8a8a8416-9398-4e3d-af04-3a80d1c18e2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:19.284645 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8a8a8416-9398-4e3d-af04-3a80d1c18e2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:19.291904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a8a8416-9398-4e3d-af04-3a80d1c18e2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:19.292353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a8a8416-9398-4e3d-af04-3a80d1c18e2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:19.293131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a8a8416-9398-4e3d-af04-3a80d1c18e2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:19.293572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8a8a8416-9398-4e3d-af04-3a80d1c18e2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:19.341917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8a8a8416-9398-4e3d-af04-3a80d1c18e2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 16399 microversion: 2.1 time: 0.062194 Nov 27 21:46:19.342543 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4257/8376] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:19 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 16399 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:20.353805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-efd044ee-075a-4541-8880-3dfb376a1241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:20.354848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-efd044ee-075a-4541-8880-3dfb376a1241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:20.362223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd044ee-075a-4541-8880-3dfb376a1241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:20.362690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd044ee-075a-4541-8880-3dfb376a1241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:20.363514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd044ee-075a-4541-8880-3dfb376a1241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:20.363972 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-efd044ee-075a-4541-8880-3dfb376a1241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:20.403409 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-efd044ee-075a-4541-8880-3dfb376a1241 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 16399 microversion: 2.1 time: 0.053513 Nov 27 21:46:20.404050 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4120/8377] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:20 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 16399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:21.415793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ac612718-d63e-4238-b7c7-dc1e024d9188 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:21.416796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ac612718-d63e-4238-b7c7-dc1e024d9188 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:21.424755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac612718-d63e-4238-b7c7-dc1e024d9188 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:21.425209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac612718-d63e-4238-b7c7-dc1e024d9188 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:21.425983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac612718-d63e-4238-b7c7-dc1e024d9188 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:21.426420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ac612718-d63e-4238-b7c7-dc1e024d9188 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:21.466553 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ac612718-d63e-4238-b7c7-dc1e024d9188 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 16399 microversion: 2.1 time: 0.054607 Nov 27 21:46:21.467222 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4258/8378] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:21 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 16399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:22.478336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b449ae21-07f3-4384-a832-c9a88d27ef60 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:22.479384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b449ae21-07f3-4384-a832-c9a88d27ef60 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:22.486790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b449ae21-07f3-4384-a832-c9a88d27ef60 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:22.487272 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b449ae21-07f3-4384-a832-c9a88d27ef60 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:22.488077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b449ae21-07f3-4384-a832-c9a88d27ef60 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:22.488524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b449ae21-07f3-4384-a832-c9a88d27ef60 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:22.528665 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b449ae21-07f3-4384-a832-c9a88d27ef60 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 16399 microversion: 2.1 time: 0.054455 Nov 27 21:46:22.529332 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4121/8379] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:22 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 16399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:23.540959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2421a252-6d1c-45a3-99f3-9b5e42c6f21d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:23.541956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2421a252-6d1c-45a3-99f3-9b5e42c6f21d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:23.549033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2421a252-6d1c-45a3-99f3-9b5e42c6f21d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:23.549481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2421a252-6d1c-45a3-99f3-9b5e42c6f21d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:23.550251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2421a252-6d1c-45a3-99f3-9b5e42c6f21d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:23.550684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2421a252-6d1c-45a3-99f3-9b5e42c6f21d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:23.590048 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2421a252-6d1c-45a3-99f3-9b5e42c6f21d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 16399 microversion: 2.1 time: 0.053214 Nov 27 21:46:23.590672 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4259/8380] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:23 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 16399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:24.602062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac97763b-654f-438f-9fa9-dada5fa278f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:24.603084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac97763b-654f-438f-9fa9-dada5fa278f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:24.610876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac97763b-654f-438f-9fa9-dada5fa278f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:24.611367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac97763b-654f-438f-9fa9-dada5fa278f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:24.612163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac97763b-654f-438f-9fa9-dada5fa278f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:24.612623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac97763b-654f-438f-9fa9-dada5fa278f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:24.662155 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac97763b-654f-438f-9fa9-dada5fa278f1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.063970 Nov 27 21:46:24.662808 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4122/8381] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:24 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:25.674358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8440145-a696-4624-b03b-17841296defb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:25.675414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8440145-a696-4624-b03b-17841296defb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:25.682674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8440145-a696-4624-b03b-17841296defb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:25.683122 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8440145-a696-4624-b03b-17841296defb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:25.683926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8440145-a696-4624-b03b-17841296defb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:25.684365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8440145-a696-4624-b03b-17841296defb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:25.722320 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8440145-a696-4624-b03b-17841296defb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.051902 Nov 27 21:46:25.722866 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4260/8382] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:25 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:46:26.734545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7e70ea9-b31a-4d37-9e6a-b0dcf513e18c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:26.735580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7e70ea9-b31a-4d37-9e6a-b0dcf513e18c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:26.742887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7e70ea9-b31a-4d37-9e6a-b0dcf513e18c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:26.743394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7e70ea9-b31a-4d37-9e6a-b0dcf513e18c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:26.744194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7e70ea9-b31a-4d37-9e6a-b0dcf513e18c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:26.744651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7e70ea9-b31a-4d37-9e6a-b0dcf513e18c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:26.784508 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7e70ea9-b31a-4d37-9e6a-b0dcf513e18c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054671 Nov 27 21:46:26.785337 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4123/8383] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:26 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:27.797043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3b02942b-d01f-47e9-8de0-bcdf72600d79 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:27.798042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3b02942b-d01f-47e9-8de0-bcdf72600d79 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:27.805219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b02942b-d01f-47e9-8de0-bcdf72600d79 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:27.805665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b02942b-d01f-47e9-8de0-bcdf72600d79 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:27.806428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b02942b-d01f-47e9-8de0-bcdf72600d79 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:27.806856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3b02942b-d01f-47e9-8de0-bcdf72600d79 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:27.846548 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3b02942b-d01f-47e9-8de0-bcdf72600d79 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053900 Nov 27 21:46:27.847188 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4261/8384] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:27 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:28.858710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c2a2068b-cd87-4f38-ad2f-973be64da0c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:28.859857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c2a2068b-cd87-4f38-ad2f-973be64da0c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:28.868567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2a2068b-cd87-4f38-ad2f-973be64da0c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:28.869035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2a2068b-cd87-4f38-ad2f-973be64da0c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:28.869846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2a2068b-cd87-4f38-ad2f-973be64da0c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:28.870308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c2a2068b-cd87-4f38-ad2f-973be64da0c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:28.915894 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c2a2068b-cd87-4f38-ad2f-973be64da0c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.061323 Nov 27 21:46:28.916552 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4124/8385] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:28 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:29.928040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25afc946-1edd-4d14-adb6-3b2d38fc3f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:29.929052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-25afc946-1edd-4d14-adb6-3b2d38fc3f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:29.936351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25afc946-1edd-4d14-adb6-3b2d38fc3f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:29.936836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25afc946-1edd-4d14-adb6-3b2d38fc3f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:29.937607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25afc946-1edd-4d14-adb6-3b2d38fc3f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:29.938057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25afc946-1edd-4d14-adb6-3b2d38fc3f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:29.985975 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25afc946-1edd-4d14-adb6-3b2d38fc3f8e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.061981 Nov 27 21:46:29.986874 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4262/8386] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:29 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:30.998066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4148c87d-090e-4aba-b8fe-c82e3e1e50dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:30.999136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4148c87d-090e-4aba-b8fe-c82e3e1e50dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:31.006836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4148c87d-090e-4aba-b8fe-c82e3e1e50dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:31.007340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4148c87d-090e-4aba-b8fe-c82e3e1e50dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:31.008143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4148c87d-090e-4aba-b8fe-c82e3e1e50dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:31.008609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4148c87d-090e-4aba-b8fe-c82e3e1e50dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:31.048075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4148c87d-090e-4aba-b8fe-c82e3e1e50dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053988 Nov 27 21:46:31.048714 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4125/8387] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:30 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:32.060127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-960e7554-7547-4969-84de-5bd3a81e87d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:32.061130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-960e7554-7547-4969-84de-5bd3a81e87d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:32.068968 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-960e7554-7547-4969-84de-5bd3a81e87d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:32.069369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-960e7554-7547-4969-84de-5bd3a81e87d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:32.070151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-960e7554-7547-4969-84de-5bd3a81e87d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:32.070595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-960e7554-7547-4969-84de-5bd3a81e87d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:32.111078 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-960e7554-7547-4969-84de-5bd3a81e87d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054943 Nov 27 21:46:32.111744 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4263/8388] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:32 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:33.122517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-606990e1-b9c9-4819-9bd4-734c43010720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:33.123575 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-606990e1-b9c9-4819-9bd4-734c43010720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:33.131183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-606990e1-b9c9-4819-9bd4-734c43010720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:33.131683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-606990e1-b9c9-4819-9bd4-734c43010720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:33.132487 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-606990e1-b9c9-4819-9bd4-734c43010720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:33.132947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-606990e1-b9c9-4819-9bd4-734c43010720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:33.175235 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-606990e1-b9c9-4819-9bd4-734c43010720 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.056655 Nov 27 21:46:33.175920 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4126/8389] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:33 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:34.186384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bb9ed145-6ebc-43ea-8160-7642220a30f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:34.187358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bb9ed145-6ebc-43ea-8160-7642220a30f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:34.194683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb9ed145-6ebc-43ea-8160-7642220a30f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:34.195133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb9ed145-6ebc-43ea-8160-7642220a30f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:34.195928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb9ed145-6ebc-43ea-8160-7642220a30f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:34.196361 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bb9ed145-6ebc-43ea-8160-7642220a30f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:34.235832 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bb9ed145-6ebc-43ea-8160-7642220a30f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053458 Nov 27 21:46:34.236615 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4264/8390] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:34 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:35.247555 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb4ea6a7-9e1b-4659-ae6b-a1e7af60de3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:35.248613 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb4ea6a7-9e1b-4659-ae6b-a1e7af60de3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:35.256831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb4ea6a7-9e1b-4659-ae6b-a1e7af60de3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:35.257301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb4ea6a7-9e1b-4659-ae6b-a1e7af60de3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:35.258101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb4ea6a7-9e1b-4659-ae6b-a1e7af60de3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:35.258552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb4ea6a7-9e1b-4659-ae6b-a1e7af60de3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:35.297739 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb4ea6a7-9e1b-4659-ae6b-a1e7af60de3c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054210 Nov 27 21:46:35.298396 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4127/8391] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:35 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:46:36.309099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b10f8409-2aa5-4523-9b6f-76c9c3d77d68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:36.310100 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b10f8409-2aa5-4523-9b6f-76c9c3d77d68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:36.317907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b10f8409-2aa5-4523-9b6f-76c9c3d77d68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:36.318352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b10f8409-2aa5-4523-9b6f-76c9c3d77d68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:36.319137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b10f8409-2aa5-4523-9b6f-76c9c3d77d68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:36.319594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b10f8409-2aa5-4523-9b6f-76c9c3d77d68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:36.363435 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b10f8409-2aa5-4523-9b6f-76c9c3d77d68 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.058132 Nov 27 21:46:36.363992 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4265/8392] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:36 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:37.375218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc77df5f-9d70-498e-bbfe-6fcc307668ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:37.376179 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc77df5f-9d70-498e-bbfe-6fcc307668ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:37.383706 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc77df5f-9d70-498e-bbfe-6fcc307668ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:37.384174 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc77df5f-9d70-498e-bbfe-6fcc307668ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:37.384964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc77df5f-9d70-498e-bbfe-6fcc307668ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:37.385427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc77df5f-9d70-498e-bbfe-6fcc307668ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:37.424623 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc77df5f-9d70-498e-bbfe-6fcc307668ae tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053451 Nov 27 21:46:37.425525 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4128/8393] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:37 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:38.435888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-757d2a0d-4447-40ba-b59e-aff29c17a320 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:38.437485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-757d2a0d-4447-40ba-b59e-aff29c17a320 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:38.444901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757d2a0d-4447-40ba-b59e-aff29c17a320 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:38.445356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757d2a0d-4447-40ba-b59e-aff29c17a320 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:38.446137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757d2a0d-4447-40ba-b59e-aff29c17a320 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:38.446571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-757d2a0d-4447-40ba-b59e-aff29c17a320 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:38.485464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-757d2a0d-4447-40ba-b59e-aff29c17a320 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053593 Nov 27 21:46:38.486113 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4266/8394] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:38 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:39.497885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e473246b-bc7c-4175-85b1-79e257141478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:39.498909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e473246b-bc7c-4175-85b1-79e257141478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:39.507061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e473246b-bc7c-4175-85b1-79e257141478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:39.507551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e473246b-bc7c-4175-85b1-79e257141478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:39.508348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e473246b-bc7c-4175-85b1-79e257141478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:39.508804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e473246b-bc7c-4175-85b1-79e257141478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:39.548636 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e473246b-bc7c-4175-85b1-79e257141478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054723 Nov 27 21:46:39.549266 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4129/8395] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:39 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:40.560405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de448865-c0d8-4303-b6f9-ed733c3bce1e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:40.561414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de448865-c0d8-4303-b6f9-ed733c3bce1e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:40.568824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de448865-c0d8-4303-b6f9-ed733c3bce1e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:40.569217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de448865-c0d8-4303-b6f9-ed733c3bce1e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:40.569995 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de448865-c0d8-4303-b6f9-ed733c3bce1e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:40.570443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de448865-c0d8-4303-b6f9-ed733c3bce1e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:40.609368 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de448865-c0d8-4303-b6f9-ed733c3bce1e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.052957 Nov 27 21:46:40.610033 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4267/8396] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:40 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:41.621384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0911c91-4017-4779-950e-d39bb517ad22 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:41.622404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0911c91-4017-4779-950e-d39bb517ad22 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:41.630301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0911c91-4017-4779-950e-d39bb517ad22 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:41.630774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0911c91-4017-4779-950e-d39bb517ad22 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:41.631679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0911c91-4017-4779-950e-d39bb517ad22 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:41.632143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0911c91-4017-4779-950e-d39bb517ad22 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:41.675318 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0911c91-4017-4779-950e-d39bb517ad22 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.057843 Nov 27 21:46:41.676000 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4130/8397] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:41 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:42.686871 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfe5531a-cf00-4976-a03d-404fc0a33454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:42.688586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfe5531a-cf00-4976-a03d-404fc0a33454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:42.695863 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe5531a-cf00-4976-a03d-404fc0a33454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:42.696305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe5531a-cf00-4976-a03d-404fc0a33454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:42.697119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe5531a-cf00-4976-a03d-404fc0a33454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:42.697497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfe5531a-cf00-4976-a03d-404fc0a33454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:42.738765 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfe5531a-cf00-4976-a03d-404fc0a33454 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.055871 Nov 27 21:46:42.739535 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4268/8398] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:42 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:43.750837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5917a331-5a15-4e07-aafc-45b661d15bb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:43.751799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5917a331-5a15-4e07-aafc-45b661d15bb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:43.759608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5917a331-5a15-4e07-aafc-45b661d15bb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:43.760075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5917a331-5a15-4e07-aafc-45b661d15bb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:43.760867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5917a331-5a15-4e07-aafc-45b661d15bb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:43.761320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5917a331-5a15-4e07-aafc-45b661d15bb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:43.801189 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5917a331-5a15-4e07-aafc-45b661d15bb6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054923 Nov 27 21:46:43.801856 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4131/8399] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:43 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:44.813788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d112b471-28ee-4ab3-9880-cf4c5058133e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:44.814795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d112b471-28ee-4ab3-9880-cf4c5058133e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:44.822083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d112b471-28ee-4ab3-9880-cf4c5058133e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:44.822536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d112b471-28ee-4ab3-9880-cf4c5058133e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:44.823346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d112b471-28ee-4ab3-9880-cf4c5058133e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:44.823788 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d112b471-28ee-4ab3-9880-cf4c5058133e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:44.862209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d112b471-28ee-4ab3-9880-cf4c5058133e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053008 Nov 27 21:46:44.862829 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4269/8400] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:44 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:45.874246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf61eba3-4a75-48b4-a78d-4095db83c756 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:45.875299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf61eba3-4a75-48b4-a78d-4095db83c756 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:45.882858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf61eba3-4a75-48b4-a78d-4095db83c756 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:45.883418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf61eba3-4a75-48b4-a78d-4095db83c756 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:45.884233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf61eba3-4a75-48b4-a78d-4095db83c756 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:45.884687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf61eba3-4a75-48b4-a78d-4095db83c756 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:45.926527 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf61eba3-4a75-48b4-a78d-4095db83c756 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.056224 Nov 27 21:46:45.927174 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4132/8401] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:45 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:46.938582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7ceeb3ab-867c-4f09-9242-9516f36c7fc7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:46.939619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7ceeb3ab-867c-4f09-9242-9516f36c7fc7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:46.948106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ceeb3ab-867c-4f09-9242-9516f36c7fc7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:46.948569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ceeb3ab-867c-4f09-9242-9516f36c7fc7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:46.949354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ceeb3ab-867c-4f09-9242-9516f36c7fc7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:46.949791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7ceeb3ab-867c-4f09-9242-9516f36c7fc7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:46.988885 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7ceeb3ab-867c-4f09-9242-9516f36c7fc7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054202 Nov 27 21:46:46.989562 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4270/8402] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:46 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:48.001607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ba24a2b-8eb0-4620-a5ab-a6f4e6d13a20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:48.002664 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ba24a2b-8eb0-4620-a5ab-a6f4e6d13a20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:48.010305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba24a2b-8eb0-4620-a5ab-a6f4e6d13a20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:48.010776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba24a2b-8eb0-4620-a5ab-a6f4e6d13a20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:48.011608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba24a2b-8eb0-4620-a5ab-a6f4e6d13a20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:48.012065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ba24a2b-8eb0-4620-a5ab-a6f4e6d13a20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:48.059089 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ba24a2b-8eb0-4620-a5ab-a6f4e6d13a20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.062074 Nov 27 21:46:48.059764 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4133/8403] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:47 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:46:49.070738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c390fdaf-cf19-4753-840f-ba7c456d48e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:49.071800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c390fdaf-cf19-4753-840f-ba7c456d48e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:49.079680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c390fdaf-cf19-4753-840f-ba7c456d48e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:49.080132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c390fdaf-cf19-4753-840f-ba7c456d48e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:49.080905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c390fdaf-cf19-4753-840f-ba7c456d48e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:49.081346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c390fdaf-cf19-4753-840f-ba7c456d48e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:49.120305 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c390fdaf-cf19-4753-840f-ba7c456d48e5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053511 Nov 27 21:46:49.120935 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4271/8404] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:49 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:50.132714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62292f9d-58f3-4b16-bbbb-2dac146e0945 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:50.133653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62292f9d-58f3-4b16-bbbb-2dac146e0945 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:50.141694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62292f9d-58f3-4b16-bbbb-2dac146e0945 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:50.142189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62292f9d-58f3-4b16-bbbb-2dac146e0945 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:50.142983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62292f9d-58f3-4b16-bbbb-2dac146e0945 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:50.143542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62292f9d-58f3-4b16-bbbb-2dac146e0945 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:50.182237 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62292f9d-58f3-4b16-bbbb-2dac146e0945 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053902 Nov 27 21:46:50.182866 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4134/8405] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:50 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:51.194387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b7f4e86-54d2-4845-bdc3-3c3f59efcb43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:51.195414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b7f4e86-54d2-4845-bdc3-3c3f59efcb43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:51.202564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b7f4e86-54d2-4845-bdc3-3c3f59efcb43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:51.203013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b7f4e86-54d2-4845-bdc3-3c3f59efcb43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:51.203815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b7f4e86-54d2-4845-bdc3-3c3f59efcb43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:51.204247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b7f4e86-54d2-4845-bdc3-3c3f59efcb43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:51.248226 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b7f4e86-54d2-4845-bdc3-3c3f59efcb43 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.057694 Nov 27 21:46:51.248869 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4272/8406] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:51 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:52.260841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb0b25db-8b76-4188-902d-a4e19201adfe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:52.261883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb0b25db-8b76-4188-902d-a4e19201adfe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:52.268811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb0b25db-8b76-4188-902d-a4e19201adfe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:52.269273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb0b25db-8b76-4188-902d-a4e19201adfe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:52.270059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb0b25db-8b76-4188-902d-a4e19201adfe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:52.270508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb0b25db-8b76-4188-902d-a4e19201adfe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:52.311043 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb0b25db-8b76-4188-902d-a4e19201adfe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054407 Nov 27 21:46:52.311729 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4135/8407] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:52 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:53.322464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed4bbb70-67da-4187-af2d-0365e5dcf8c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:53.323539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed4bbb70-67da-4187-af2d-0365e5dcf8c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:53.330592 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed4bbb70-67da-4187-af2d-0365e5dcf8c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:53.331028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed4bbb70-67da-4187-af2d-0365e5dcf8c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:53.331828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed4bbb70-67da-4187-af2d-0365e5dcf8c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:53.332266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed4bbb70-67da-4187-af2d-0365e5dcf8c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:53.378320 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed4bbb70-67da-4187-af2d-0365e5dcf8c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.059867 Nov 27 21:46:53.379199 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4273/8408] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:53 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:54.391224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-11f32dbc-12af-46b5-8c1f-7aa48609b185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:54.392282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-11f32dbc-12af-46b5-8c1f-7aa48609b185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:54.399658 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f32dbc-12af-46b5-8c1f-7aa48609b185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:54.400130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f32dbc-12af-46b5-8c1f-7aa48609b185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:54.400924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f32dbc-12af-46b5-8c1f-7aa48609b185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:54.401382 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-11f32dbc-12af-46b5-8c1f-7aa48609b185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:54.443495 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-11f32dbc-12af-46b5-8c1f-7aa48609b185 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.056875 Nov 27 21:46:54.444359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4136/8409] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:54 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:55.454821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f71334c-810c-42b2-91ba-9b74ca048b3f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:55.455849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f71334c-810c-42b2-91ba-9b74ca048b3f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:55.463097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f71334c-810c-42b2-91ba-9b74ca048b3f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:55.463579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f71334c-810c-42b2-91ba-9b74ca048b3f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:55.464374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f71334c-810c-42b2-91ba-9b74ca048b3f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:55.464807 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f71334c-810c-42b2-91ba-9b74ca048b3f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:55.504837 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f71334c-810c-42b2-91ba-9b74ca048b3f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.054395 Nov 27 21:46:55.505487 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4274/8410] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:55 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:56.517218 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f92b6322-d4a9-48a1-8f14-d172d869891e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:56.518256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f92b6322-d4a9-48a1-8f14-d172d869891e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:56.526127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f92b6322-d4a9-48a1-8f14-d172d869891e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:56.526609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f92b6322-d4a9-48a1-8f14-d172d869891e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:56.527504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f92b6322-d4a9-48a1-8f14-d172d869891e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:56.527967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f92b6322-d4a9-48a1-8f14-d172d869891e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:56.568435 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f92b6322-d4a9-48a1-8f14-d172d869891e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.055266 Nov 27 21:46:56.569076 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4137/8411] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:56 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:57.580647 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8f1a2498-38f5-4e21-ab10-40f30c7f8ca6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:57.581652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8f1a2498-38f5-4e21-ab10-40f30c7f8ca6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:57.588952 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f1a2498-38f5-4e21-ab10-40f30c7f8ca6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:57.589401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f1a2498-38f5-4e21-ab10-40f30c7f8ca6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:57.590175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f1a2498-38f5-4e21-ab10-40f30c7f8ca6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:57.590615 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8f1a2498-38f5-4e21-ab10-40f30c7f8ca6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:57.639745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8f1a2498-38f5-4e21-ab10-40f30c7f8ca6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.063001 Nov 27 21:46:57.641948 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4275/8412] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:57 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:58.651835 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-266e78fd-ecd1-40e8-a0d5-6a79942c21d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:58.652890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-266e78fd-ecd1-40e8-a0d5-6a79942c21d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:58.661321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-266e78fd-ecd1-40e8-a0d5-6a79942c21d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:58.661800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-266e78fd-ecd1-40e8-a0d5-6a79942c21d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:58.662616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-266e78fd-ecd1-40e8-a0d5-6a79942c21d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:58.663072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-266e78fd-ecd1-40e8-a0d5-6a79942c21d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:58.702957 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-266e78fd-ecd1-40e8-a0d5-6a79942c21d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.055060 Nov 27 21:46:58.703545 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4138/8413] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:58 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:46:59.715731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-59629281-da15-4929-9429-f5ce84adaa32 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:46:59.716679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-59629281-da15-4929-9429-f5ce84adaa32 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:46:59.724485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59629281-da15-4929-9429-f5ce84adaa32 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:59.724932 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59629281-da15-4929-9429-f5ce84adaa32 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:59.725708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59629281-da15-4929-9429-f5ce84adaa32 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:46:59.726145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-59629281-da15-4929-9429-f5ce84adaa32 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:46:59.763894 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-59629281-da15-4929-9429-f5ce84adaa32 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.052339 Nov 27 21:46:59.764730 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4276/8414] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:46:59 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:00.775943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-70c02346-d7cc-480a-8a1e-ebdc380d5054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:00.777013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-70c02346-d7cc-480a-8a1e-ebdc380d5054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:00.784489 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c02346-d7cc-480a-8a1e-ebdc380d5054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:00.784962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c02346-d7cc-480a-8a1e-ebdc380d5054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:00.785792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c02346-d7cc-480a-8a1e-ebdc380d5054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:00.786255 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-70c02346-d7cc-480a-8a1e-ebdc380d5054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:00.824398 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-70c02346-d7cc-480a-8a1e-ebdc380d5054 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.052485 Nov 27 21:47:00.825050 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4139/8415] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:00 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:01.836669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ea7f5148-ff28-4b84-96f4-9bd94670c6d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:01.837678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ea7f5148-ff28-4b84-96f4-9bd94670c6d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:01.845025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea7f5148-ff28-4b84-96f4-9bd94670c6d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:01.845481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea7f5148-ff28-4b84-96f4-9bd94670c6d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:01.846265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea7f5148-ff28-4b84-96f4-9bd94670c6d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:01.846706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ea7f5148-ff28-4b84-96f4-9bd94670c6d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:01.885545 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ea7f5148-ff28-4b84-96f4-9bd94670c6d0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.052852 Nov 27 21:47:01.886409 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4277/8416] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:01 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:02.898168 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c0001ec4-403f-482b-b988-282665d65276 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:02.899226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c0001ec4-403f-482b-b988-282665d65276 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:02.906600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0001ec4-403f-482b-b988-282665d65276 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:02.907067 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0001ec4-403f-482b-b988-282665d65276 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:02.907899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0001ec4-403f-482b-b988-282665d65276 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:02.908358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c0001ec4-403f-482b-b988-282665d65276 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:02.954410 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c0001ec4-403f-482b-b988-282665d65276 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.060262 Nov 27 21:47:02.955059 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4140/8417] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:02 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:03.965723 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a2efad3-9ff6-4388-9a0e-703d2a10faf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:03.966738 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a2efad3-9ff6-4388-9a0e-703d2a10faf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:03.974468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2efad3-9ff6-4388-9a0e-703d2a10faf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:03.974956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2efad3-9ff6-4388-9a0e-703d2a10faf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:03.975764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2efad3-9ff6-4388-9a0e-703d2a10faf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:03.976218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a2efad3-9ff6-4388-9a0e-703d2a10faf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:04.014519 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a2efad3-9ff6-4388-9a0e-703d2a10faf6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.052786 Nov 27 21:47:04.015154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4278/8418] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:03 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:05.027122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9d10000-d20d-44b5-8768-7c3b775f8763 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:05.028175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9d10000-d20d-44b5-8768-7c3b775f8763 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:05.036074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d10000-d20d-44b5-8768-7c3b775f8763 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:05.036542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d10000-d20d-44b5-8768-7c3b775f8763 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:05.037335 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d10000-d20d-44b5-8768-7c3b775f8763 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:05.037792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9d10000-d20d-44b5-8768-7c3b775f8763 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:05.080937 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9d10000-d20d-44b5-8768-7c3b775f8763 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.057838 Nov 27 21:47:05.081560 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4141/8419] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:05 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:06.092634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f756361-9bab-4d93-9700-31f03f6e3f29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:06.093556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f756361-9bab-4d93-9700-31f03f6e3f29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:06.100884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f756361-9bab-4d93-9700-31f03f6e3f29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:06.101337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f756361-9bab-4d93-9700-31f03f6e3f29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:06.102109 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f756361-9bab-4d93-9700-31f03f6e3f29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:06.102549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f756361-9bab-4d93-9700-31f03f6e3f29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:06.141916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f756361-9bab-4d93-9700-31f03f6e3f29 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.053376 Nov 27 21:47:06.142537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4279/8420] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:06 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:06.698016 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:47:06.698219 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:47:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:47:07.153310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22c8806b-4833-4dff-be17-7126190f733e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:07.154376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22c8806b-4833-4dff-be17-7126190f733e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:07.162240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22c8806b-4833-4dff-be17-7126190f733e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:07.162709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22c8806b-4833-4dff-be17-7126190f733e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:07.163543 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22c8806b-4833-4dff-be17-7126190f733e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:07.164002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22c8806b-4833-4dff-be17-7126190f733e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:07.206628 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22c8806b-4833-4dff-be17-7126190f733e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.057275 Nov 27 21:47:07.207289 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4142/8421] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:07 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:47:08.293895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7dbb8e23-5dc7-4247-abc6-94fa36cfbbbc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:08.294892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7dbb8e23-5dc7-4247-abc6-94fa36cfbbbc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:08.301503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dbb8e23-5dc7-4247-abc6-94fa36cfbbbc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:08.301947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dbb8e23-5dc7-4247-abc6-94fa36cfbbbc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:08.303176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dbb8e23-5dc7-4247-abc6-94fa36cfbbbc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:08.303636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7dbb8e23-5dc7-4247-abc6-94fa36cfbbbc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:08.345599 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7dbb8e23-5dc7-4247-abc6-94fa36cfbbbc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 24571 microversion: 2.1 time: 0.130850 Nov 27 21:47:08.346285 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4280/8422] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:08 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 24571 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:47:09.358073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8341e01a-ef2f-4982-a6c1-793bcbe92c75 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:09.359104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8341e01a-ef2f-4982-a6c1-793bcbe92c75 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:09.366429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8341e01a-ef2f-4982-a6c1-793bcbe92c75 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:09.366899 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8341e01a-ef2f-4982-a6c1-793bcbe92c75 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:09.367729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8341e01a-ef2f-4982-a6c1-793bcbe92c75 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:09.368186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8341e01a-ef2f-4982-a6c1-793bcbe92c75 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:09.420376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8341e01a-ef2f-4982-a6c1-793bcbe92c75 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.066388 Nov 27 21:47:09.421256 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4143/8423] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:09 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:10.431764 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c75754f0-196a-4b13-a886-953d20fac67e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:10.432762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c75754f0-196a-4b13-a886-953d20fac67e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:10.440114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c75754f0-196a-4b13-a886-953d20fac67e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:10.440567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c75754f0-196a-4b13-a886-953d20fac67e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:10.441344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c75754f0-196a-4b13-a886-953d20fac67e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:10.441783 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c75754f0-196a-4b13-a886-953d20fac67e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:10.482517 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c75754f0-196a-4b13-a886-953d20fac67e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054704 Nov 27 21:47:10.483478 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4281/8424] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:10 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:11.494848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37cc94e2-1ee0-43cc-abc2-fa516164bf18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:11.496103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37cc94e2-1ee0-43cc-abc2-fa516164bf18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:11.504281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37cc94e2-1ee0-43cc-abc2-fa516164bf18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:11.504749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37cc94e2-1ee0-43cc-abc2-fa516164bf18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:11.505549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37cc94e2-1ee0-43cc-abc2-fa516164bf18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:11.506005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37cc94e2-1ee0-43cc-abc2-fa516164bf18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:11.546116 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-37cc94e2-1ee0-43cc-abc2-fa516164bf18 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055299 Nov 27 21:47:11.546767 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4144/8425] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:11 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:12.558763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d314c4b-ce8f-45f1-b629-1d358f67091a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:12.559789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d314c4b-ce8f-45f1-b629-1d358f67091a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:12.567086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d314c4b-ce8f-45f1-b629-1d358f67091a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:12.567566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d314c4b-ce8f-45f1-b629-1d358f67091a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:12.568336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d314c4b-ce8f-45f1-b629-1d358f67091a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:12.568775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d314c4b-ce8f-45f1-b629-1d358f67091a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:12.609515 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d314c4b-ce8f-45f1-b629-1d358f67091a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054711 Nov 27 21:47:12.610173 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4282/8426] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:12 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:13.621933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-559a35d5-2e8f-42e0-b8d7-7289e9e0ecf3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:13.622954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-559a35d5-2e8f-42e0-b8d7-7289e9e0ecf3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:13.631135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-559a35d5-2e8f-42e0-b8d7-7289e9e0ecf3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:13.631627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-559a35d5-2e8f-42e0-b8d7-7289e9e0ecf3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:13.632415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-559a35d5-2e8f-42e0-b8d7-7289e9e0ecf3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:13.632866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-559a35d5-2e8f-42e0-b8d7-7289e9e0ecf3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:13.672856 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-559a35d5-2e8f-42e0-b8d7-7289e9e0ecf3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054288 Nov 27 21:47:13.673504 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4145/8427] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:13 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:14.685088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fd462915-ca07-4b9c-844b-58f82bb61b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:14.686078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fd462915-ca07-4b9c-844b-58f82bb61b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:14.694203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd462915-ca07-4b9c-844b-58f82bb61b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:14.694675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd462915-ca07-4b9c-844b-58f82bb61b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:14.695475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd462915-ca07-4b9c-844b-58f82bb61b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:14.695911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fd462915-ca07-4b9c-844b-58f82bb61b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:14.737619 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fd462915-ca07-4b9c-844b-58f82bb61b3b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056411 Nov 27 21:47:14.738154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4283/8428] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:14 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:15.749791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0795222f-05fb-4638-8164-e9d618b01b94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:15.750799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0795222f-05fb-4638-8164-e9d618b01b94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:15.758522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0795222f-05fb-4638-8164-e9d618b01b94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:15.758997 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0795222f-05fb-4638-8164-e9d618b01b94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:15.759833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0795222f-05fb-4638-8164-e9d618b01b94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:15.760291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0795222f-05fb-4638-8164-e9d618b01b94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:15.800226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0795222f-05fb-4638-8164-e9d618b01b94 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054556 Nov 27 21:47:15.800863 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4146/8429] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:15 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:16.811877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d5a1e570-45fc-4bad-a014-89dd55b463b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:16.812916 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d5a1e570-45fc-4bad-a014-89dd55b463b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:16.820190 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a1e570-45fc-4bad-a014-89dd55b463b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:16.820646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a1e570-45fc-4bad-a014-89dd55b463b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:16.821420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a1e570-45fc-4bad-a014-89dd55b463b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:16.821857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d5a1e570-45fc-4bad-a014-89dd55b463b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:16.861175 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d5a1e570-45fc-4bad-a014-89dd55b463b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053227 Nov 27 21:47:16.861808 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4284/8430] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:16 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:47:17.873828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b774443-a880-4b31-9d92-ec07ab0edae5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:17.874865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b774443-a880-4b31-9d92-ec07ab0edae5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:17.883123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b774443-a880-4b31-9d92-ec07ab0edae5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:17.883619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b774443-a880-4b31-9d92-ec07ab0edae5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:17.884418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b774443-a880-4b31-9d92-ec07ab0edae5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:17.884877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b774443-a880-4b31-9d92-ec07ab0edae5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:17.932657 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b774443-a880-4b31-9d92-ec07ab0edae5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.062744 Nov 27 21:47:17.933311 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4147/8431] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:17 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:18.944955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-74977fd3-8b75-4356-bfce-d1b8058c2b2a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:18.945994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-74977fd3-8b75-4356-bfce-d1b8058c2b2a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:18.953856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74977fd3-8b75-4356-bfce-d1b8058c2b2a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:18.954306 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74977fd3-8b75-4356-bfce-d1b8058c2b2a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:18.955077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74977fd3-8b75-4356-bfce-d1b8058c2b2a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:18.955545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74977fd3-8b75-4356-bfce-d1b8058c2b2a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:18.997613 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-74977fd3-8b75-4356-bfce-d1b8058c2b2a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056602 Nov 27 21:47:18.998246 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4285/8432] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:18 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:20.010415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0943e4c8-ce22-4a7f-a614-6d2908a3671d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:20.011495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0943e4c8-ce22-4a7f-a614-6d2908a3671d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:20.019333 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0943e4c8-ce22-4a7f-a614-6d2908a3671d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:20.019803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0943e4c8-ce22-4a7f-a614-6d2908a3671d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:20.020626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0943e4c8-ce22-4a7f-a614-6d2908a3671d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:20.021186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0943e4c8-ce22-4a7f-a614-6d2908a3671d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:20.066251 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0943e4c8-ce22-4a7f-a614-6d2908a3671d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.059687 Nov 27 21:47:20.067036 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4148/8433] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:20 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:21.078400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2c0f76b3-9039-402e-9196-419c14251d61 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:21.079465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2c0f76b3-9039-402e-9196-419c14251d61 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:21.086778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c0f76b3-9039-402e-9196-419c14251d61 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:21.087234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c0f76b3-9039-402e-9196-419c14251d61 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:21.088118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c0f76b3-9039-402e-9196-419c14251d61 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:21.088558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2c0f76b3-9039-402e-9196-419c14251d61 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:21.133607 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2c0f76b3-9039-402e-9196-419c14251d61 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.059148 Nov 27 21:47:21.134247 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4286/8434] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:21 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:22.145983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38c656b4-63d8-4549-9949-72959ad5151f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:22.146921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-38c656b4-63d8-4549-9949-72959ad5151f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:22.154420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c656b4-63d8-4549-9949-72959ad5151f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:22.154883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c656b4-63d8-4549-9949-72959ad5151f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:22.155842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c656b4-63d8-4549-9949-72959ad5151f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:22.156857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38c656b4-63d8-4549-9949-72959ad5151f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:22.197041 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38c656b4-63d8-4549-9949-72959ad5151f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055429 Nov 27 21:47:22.197707 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4149/8435] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:22 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:47:23.209341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-22218cd3-6980-4ac5-a739-67d7ea511ab9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:23.210385 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-22218cd3-6980-4ac5-a739-67d7ea511ab9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:23.218014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22218cd3-6980-4ac5-a739-67d7ea511ab9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:23.219127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22218cd3-6980-4ac5-a739-67d7ea511ab9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:23.219935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22218cd3-6980-4ac5-a739-67d7ea511ab9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:23.220374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-22218cd3-6980-4ac5-a739-67d7ea511ab9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:23.259162 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-22218cd3-6980-4ac5-a739-67d7ea511ab9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053854 Nov 27 21:47:23.260152 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4287/8436] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:23 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:24.271464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fffd88c7-20fa-4cb9-9e83-6909bb01f0b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:24.272493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fffd88c7-20fa-4cb9-9e83-6909bb01f0b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:24.279831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fffd88c7-20fa-4cb9-9e83-6909bb01f0b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:24.280301 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fffd88c7-20fa-4cb9-9e83-6909bb01f0b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:24.281603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fffd88c7-20fa-4cb9-9e83-6909bb01f0b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:24.282059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fffd88c7-20fa-4cb9-9e83-6909bb01f0b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:24.322376 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fffd88c7-20fa-4cb9-9e83-6909bb01f0b4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054851 Nov 27 21:47:24.323013 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4150/8437] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:24 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:25.336152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0dabe91b-eb13-49a8-a3b8-d33cbc4693c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:25.337199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0dabe91b-eb13-49a8-a3b8-d33cbc4693c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:25.344673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dabe91b-eb13-49a8-a3b8-d33cbc4693c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:25.345128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dabe91b-eb13-49a8-a3b8-d33cbc4693c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:25.345905 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dabe91b-eb13-49a8-a3b8-d33cbc4693c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:25.346347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dabe91b-eb13-49a8-a3b8-d33cbc4693c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:25.384316 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0dabe91b-eb13-49a8-a3b8-d33cbc4693c1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053240 Nov 27 21:47:25.385235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4288/8438] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:25 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:26.397389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-84eca92a-58b8-4b8c-aa67-472156819eb0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:26.398371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-84eca92a-58b8-4b8c-aa67-472156819eb0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:26.405399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84eca92a-58b8-4b8c-aa67-472156819eb0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:26.405909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84eca92a-58b8-4b8c-aa67-472156819eb0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:26.407196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84eca92a-58b8-4b8c-aa67-472156819eb0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:26.407673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-84eca92a-58b8-4b8c-aa67-472156819eb0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:26.452850 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-84eca92a-58b8-4b8c-aa67-472156819eb0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.058697 Nov 27 21:47:26.453785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4151/8439] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:26 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:27.465829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75c6e61a-3653-4be6-b5af-28d8867c50f6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:27.466832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75c6e61a-3653-4be6-b5af-28d8867c50f6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:27.474657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75c6e61a-3653-4be6-b5af-28d8867c50f6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:27.475106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75c6e61a-3653-4be6-b5af-28d8867c50f6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:27.475910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75c6e61a-3653-4be6-b5af-28d8867c50f6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:27.476346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75c6e61a-3653-4be6-b5af-28d8867c50f6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:27.514198 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75c6e61a-3653-4be6-b5af-28d8867c50f6 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.052262 Nov 27 21:47:27.514825 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4289/8440] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:27 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:28.526935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-491c7922-4eff-40b9-ad6c-360ef37ebd04 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:28.528029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-491c7922-4eff-40b9-ad6c-360ef37ebd04 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:28.535485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-491c7922-4eff-40b9-ad6c-360ef37ebd04 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:28.535965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-491c7922-4eff-40b9-ad6c-360ef37ebd04 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:28.536771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-491c7922-4eff-40b9-ad6c-360ef37ebd04 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:28.537233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-491c7922-4eff-40b9-ad6c-360ef37ebd04 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:28.578252 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-491c7922-4eff-40b9-ad6c-360ef37ebd04 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055339 Nov 27 21:47:28.578910 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4152/8441] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:28 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:29.590351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f12ed11-47df-4fad-ba57-864f1334f79a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:29.591443 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f12ed11-47df-4fad-ba57-864f1334f79a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:29.598893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f12ed11-47df-4fad-ba57-864f1334f79a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:29.599367 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f12ed11-47df-4fad-ba57-864f1334f79a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:29.600133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f12ed11-47df-4fad-ba57-864f1334f79a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:29.600567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f12ed11-47df-4fad-ba57-864f1334f79a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:29.642561 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f12ed11-47df-4fad-ba57-864f1334f79a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056118 Nov 27 21:47:29.643192 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4290/8442] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:29 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:30.654019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ddea19ad-6425-4073-8364-224227467818 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:30.655082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ddea19ad-6425-4073-8364-224227467818 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:30.663108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddea19ad-6425-4073-8364-224227467818 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:30.663615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddea19ad-6425-4073-8364-224227467818 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:30.664428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddea19ad-6425-4073-8364-224227467818 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:30.664889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ddea19ad-6425-4073-8364-224227467818 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:30.705000 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ddea19ad-6425-4073-8364-224227467818 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054981 Nov 27 21:47:30.705565 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4153/8443] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:30 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:31.717111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-00dbe84a-845a-44aa-8ef3-062c162b9c05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:31.718042 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-00dbe84a-845a-44aa-8ef3-062c162b9c05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:31.725242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dbe84a-845a-44aa-8ef3-062c162b9c05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:31.725686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dbe84a-845a-44aa-8ef3-062c162b9c05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:31.726449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dbe84a-845a-44aa-8ef3-062c162b9c05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:31.726884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-00dbe84a-845a-44aa-8ef3-062c162b9c05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:31.765771 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-00dbe84a-845a-44aa-8ef3-062c162b9c05 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.052058 Nov 27 21:47:31.766367 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4291/8444] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:31 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:32.778136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2c556345-9c8a-4df3-8e50-686abe2c9b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:32.779166 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2c556345-9c8a-4df3-8e50-686abe2c9b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:32.787050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c556345-9c8a-4df3-8e50-686abe2c9b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:32.787556 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c556345-9c8a-4df3-8e50-686abe2c9b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:32.788361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c556345-9c8a-4df3-8e50-686abe2c9b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:32.788817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2c556345-9c8a-4df3-8e50-686abe2c9b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:32.831353 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2c556345-9c8a-4df3-8e50-686abe2c9b86 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.057167 Nov 27 21:47:32.832012 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4154/8445] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:32 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:33.843512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da3b3322-a526-4e4f-b6a6-fd82478e5bf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:33.844511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da3b3322-a526-4e4f-b6a6-fd82478e5bf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:33.851814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3b3322-a526-4e4f-b6a6-fd82478e5bf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:33.852288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3b3322-a526-4e4f-b6a6-fd82478e5bf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:33.853465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3b3322-a526-4e4f-b6a6-fd82478e5bf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:33.853906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da3b3322-a526-4e4f-b6a6-fd82478e5bf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:33.897214 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da3b3322-a526-4e4f-b6a6-fd82478e5bf9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.057630 Nov 27 21:47:33.897973 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4292/8446] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:33 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:34.909875 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54c020fc-03a8-4ff3-8f6a-65dba35480f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:34.910911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54c020fc-03a8-4ff3-8f6a-65dba35480f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:34.918307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54c020fc-03a8-4ff3-8f6a-65dba35480f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:34.918777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54c020fc-03a8-4ff3-8f6a-65dba35480f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:34.919607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54c020fc-03a8-4ff3-8f6a-65dba35480f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:34.920066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54c020fc-03a8-4ff3-8f6a-65dba35480f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:34.960774 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54c020fc-03a8-4ff3-8f6a-65dba35480f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054919 Nov 27 21:47:34.961425 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4155/8447] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:34 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:35.973107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9eb9059f-b542-4349-9ab5-5385a62c3d21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:35.974102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9eb9059f-b542-4349-9ab5-5385a62c3d21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:35.981336 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9eb9059f-b542-4349-9ab5-5385a62c3d21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:35.981779 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9eb9059f-b542-4349-9ab5-5385a62c3d21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:35.982549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9eb9059f-b542-4349-9ab5-5385a62c3d21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:35.982983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9eb9059f-b542-4349-9ab5-5385a62c3d21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:36.022156 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9eb9059f-b542-4349-9ab5-5385a62c3d21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053731 Nov 27 21:47:36.022808 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4293/8448] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:35 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:37.034935 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e4e25367-ea57-47c6-8a5d-372bcb27f59d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:37.036018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e4e25367-ea57-47c6-8a5d-372bcb27f59d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:37.043305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4e25367-ea57-47c6-8a5d-372bcb27f59d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:37.043775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4e25367-ea57-47c6-8a5d-372bcb27f59d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:37.044565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4e25367-ea57-47c6-8a5d-372bcb27f59d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:37.045017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4e25367-ea57-47c6-8a5d-372bcb27f59d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:37.084148 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e4e25367-ea57-47c6-8a5d-372bcb27f59d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053675 Nov 27 21:47:37.084701 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4156/8449] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:37 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:38.096926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-463eea94-b436-4494-a1f3-1c8fa5410a30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:38.097934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-463eea94-b436-4494-a1f3-1c8fa5410a30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:38.105340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463eea94-b436-4494-a1f3-1c8fa5410a30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:38.105734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463eea94-b436-4494-a1f3-1c8fa5410a30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:38.106536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463eea94-b436-4494-a1f3-1c8fa5410a30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:38.106978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-463eea94-b436-4494-a1f3-1c8fa5410a30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:38.144656 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-463eea94-b436-4494-a1f3-1c8fa5410a30 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.052384 Nov 27 21:47:38.145294 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4294/8450] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:38 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:39.156723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-558a2f71-5cbe-4638-a393-5fb09b4ead21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:39.157754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-558a2f71-5cbe-4638-a393-5fb09b4ead21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:39.165146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-558a2f71-5cbe-4638-a393-5fb09b4ead21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:39.165619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-558a2f71-5cbe-4638-a393-5fb09b4ead21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:39.166425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-558a2f71-5cbe-4638-a393-5fb09b4ead21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:39.166886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-558a2f71-5cbe-4638-a393-5fb09b4ead21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:39.206484 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-558a2f71-5cbe-4638-a393-5fb09b4ead21 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054306 Nov 27 21:47:39.207111 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4157/8451] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:39 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:40.218572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-385a1095-294c-4d32-b3a8-0c1d1ffce183 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:40.219607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-385a1095-294c-4d32-b3a8-0c1d1ffce183 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:40.227103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-385a1095-294c-4d32-b3a8-0c1d1ffce183 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:40.227585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-385a1095-294c-4d32-b3a8-0c1d1ffce183 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:40.228371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-385a1095-294c-4d32-b3a8-0c1d1ffce183 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:40.228808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-385a1095-294c-4d32-b3a8-0c1d1ffce183 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:40.269097 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-385a1095-294c-4d32-b3a8-0c1d1ffce183 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054478 Nov 27 21:47:40.269724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4295/8452] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:40 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:41.281889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bd7e640c-a45a-47ef-bff1-9c352ae7c50e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:41.282911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bd7e640c-a45a-47ef-bff1-9c352ae7c50e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:41.290308 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7e640c-a45a-47ef-bff1-9c352ae7c50e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:41.290783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7e640c-a45a-47ef-bff1-9c352ae7c50e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:41.291602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7e640c-a45a-47ef-bff1-9c352ae7c50e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:41.292055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bd7e640c-a45a-47ef-bff1-9c352ae7c50e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:41.333540 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bd7e640c-a45a-47ef-bff1-9c352ae7c50e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056157 Nov 27 21:47:41.334605 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4158/8453] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:41 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:42.346593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-91cb659d-9246-4a7f-8997-8bc57777f1fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:42.347623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91cb659d-9246-4a7f-8997-8bc57777f1fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:42.354862 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91cb659d-9246-4a7f-8997-8bc57777f1fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:42.355328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91cb659d-9246-4a7f-8997-8bc57777f1fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:42.356095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91cb659d-9246-4a7f-8997-8bc57777f1fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:42.356533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91cb659d-9246-4a7f-8997-8bc57777f1fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:42.397906 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-91cb659d-9246-4a7f-8997-8bc57777f1fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055679 Nov 27 21:47:42.398554 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4296/8454] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:42 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:43.410246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eb37dc29-6677-4356-99f8-d4a714bc42fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:43.411290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eb37dc29-6677-4356-99f8-d4a714bc42fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:43.418608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb37dc29-6677-4356-99f8-d4a714bc42fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:43.419078 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb37dc29-6677-4356-99f8-d4a714bc42fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:43.419918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb37dc29-6677-4356-99f8-d4a714bc42fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:43.420373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eb37dc29-6677-4356-99f8-d4a714bc42fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:43.460628 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eb37dc29-6677-4356-99f8-d4a714bc42fe tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054359 Nov 27 21:47:43.461274 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4159/8455] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:43 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:44.472780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4ffe57e-1220-4731-abd9-98fe92ac68ee tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:44.473793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4ffe57e-1220-4731-abd9-98fe92ac68ee tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:44.481066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4ffe57e-1220-4731-abd9-98fe92ac68ee tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:44.481518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4ffe57e-1220-4731-abd9-98fe92ac68ee tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:44.482291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4ffe57e-1220-4731-abd9-98fe92ac68ee tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:44.482758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4ffe57e-1220-4731-abd9-98fe92ac68ee tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:44.522265 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4ffe57e-1220-4731-abd9-98fe92ac68ee tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053457 Nov 27 21:47:44.522897 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4297/8456] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:44 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:45.535198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9e0ce705-50ce-4ad3-bbc6-1e411124e4ac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:45.536330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9e0ce705-50ce-4ad3-bbc6-1e411124e4ac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:45.543874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e0ce705-50ce-4ad3-bbc6-1e411124e4ac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:45.544344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e0ce705-50ce-4ad3-bbc6-1e411124e4ac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:45.545144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e0ce705-50ce-4ad3-bbc6-1e411124e4ac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:45.545599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9e0ce705-50ce-4ad3-bbc6-1e411124e4ac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:45.587498 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9e0ce705-50ce-4ad3-bbc6-1e411124e4ac tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056916 Nov 27 21:47:45.588145 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4160/8457] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:45 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:46.600268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-563a4c38-c452-4b83-a874-1dd7e04abf9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:46.601271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-563a4c38-c452-4b83-a874-1dd7e04abf9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:46.608557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-563a4c38-c452-4b83-a874-1dd7e04abf9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:46.609007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-563a4c38-c452-4b83-a874-1dd7e04abf9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:46.609777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-563a4c38-c452-4b83-a874-1dd7e04abf9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:46.610213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-563a4c38-c452-4b83-a874-1dd7e04abf9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:46.651947 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-563a4c38-c452-4b83-a874-1dd7e04abf9c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055590 Nov 27 21:47:46.652832 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4298/8458] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:46 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:47.665119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-79912204-9b78-4cdc-865f-62706c0347d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:47.666393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-79912204-9b78-4cdc-865f-62706c0347d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:47.675004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79912204-9b78-4cdc-865f-62706c0347d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:47.675596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79912204-9b78-4cdc-865f-62706c0347d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:47.676436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79912204-9b78-4cdc-865f-62706c0347d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:47.676888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-79912204-9b78-4cdc-865f-62706c0347d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:47.716652 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-79912204-9b78-4cdc-865f-62706c0347d5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055692 Nov 27 21:47:47.717953 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4161/8459] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:47 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:48.729246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-20003a4c-90ec-4b2c-9f6d-b6b0406462e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:48.730173 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-20003a4c-90ec-4b2c-9f6d-b6b0406462e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:48.737444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20003a4c-90ec-4b2c-9f6d-b6b0406462e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:48.737895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20003a4c-90ec-4b2c-9f6d-b6b0406462e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:48.738668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20003a4c-90ec-4b2c-9f6d-b6b0406462e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:48.739107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-20003a4c-90ec-4b2c-9f6d-b6b0406462e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:48.779672 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-20003a4c-90ec-4b2c-9f6d-b6b0406462e1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054407 Nov 27 21:47:48.781014 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4299/8460] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:48 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:49.792902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf762e41-9584-4bd0-bef5-34c8ccd0141c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:49.793956 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf762e41-9584-4bd0-bef5-34c8ccd0141c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:49.801877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf762e41-9584-4bd0-bef5-34c8ccd0141c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:49.802340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf762e41-9584-4bd0-bef5-34c8ccd0141c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:49.803131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf762e41-9584-4bd0-bef5-34c8ccd0141c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:49.803612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf762e41-9584-4bd0-bef5-34c8ccd0141c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:49.842915 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf762e41-9584-4bd0-bef5-34c8ccd0141c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053452 Nov 27 21:47:49.843585 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4162/8461] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:49 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:47:50.855646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-57b89afc-95b5-4629-9d2f-9ce5b3ad62b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:50.856643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-57b89afc-95b5-4629-9d2f-9ce5b3ad62b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:50.863956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b89afc-95b5-4629-9d2f-9ce5b3ad62b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:50.864404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b89afc-95b5-4629-9d2f-9ce5b3ad62b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:50.865181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b89afc-95b5-4629-9d2f-9ce5b3ad62b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:50.865610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-57b89afc-95b5-4629-9d2f-9ce5b3ad62b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:50.905478 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-57b89afc-95b5-4629-9d2f-9ce5b3ad62b9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053111 Nov 27 21:47:50.906364 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4300/8462] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:50 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:51.919855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a8f56955-8d01-4e2c-816c-cbdd6c190586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:51.921687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a8f56955-8d01-4e2c-816c-cbdd6c190586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:51.928857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8f56955-8d01-4e2c-816c-cbdd6c190586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:51.929334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8f56955-8d01-4e2c-816c-cbdd6c190586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:51.930133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8f56955-8d01-4e2c-816c-cbdd6c190586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:51.930592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a8f56955-8d01-4e2c-816c-cbdd6c190586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:51.973092 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a8f56955-8d01-4e2c-816c-cbdd6c190586 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.059073 Nov 27 21:47:51.973737 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4163/8463] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:51 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:52.985688 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae3d8ef4-47b8-4eef-82d3-dbc2b6526ff1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:52.986785 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae3d8ef4-47b8-4eef-82d3-dbc2b6526ff1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:52.994524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3d8ef4-47b8-4eef-82d3-dbc2b6526ff1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:52.994970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3d8ef4-47b8-4eef-82d3-dbc2b6526ff1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:52.995773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3d8ef4-47b8-4eef-82d3-dbc2b6526ff1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:52.996209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae3d8ef4-47b8-4eef-82d3-dbc2b6526ff1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:53.038147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae3d8ef4-47b8-4eef-82d3-dbc2b6526ff1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056538 Nov 27 21:47:53.038815 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4301/8464] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:52 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:54.049678 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75ac66f9-f37a-4f16-93ed-44b4f5919024 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:54.050709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75ac66f9-f37a-4f16-93ed-44b4f5919024 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:54.058262 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75ac66f9-f37a-4f16-93ed-44b4f5919024 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:54.058741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75ac66f9-f37a-4f16-93ed-44b4f5919024 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:54.059578 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75ac66f9-f37a-4f16-93ed-44b4f5919024 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:54.060045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75ac66f9-f37a-4f16-93ed-44b4f5919024 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:54.101006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75ac66f9-f37a-4f16-93ed-44b4f5919024 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055357 Nov 27 21:47:54.101663 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4164/8465] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:54 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:55.114136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f9a7730a-4a6b-4abc-8db2-289a77abb8ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:55.115154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f9a7730a-4a6b-4abc-8db2-289a77abb8ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:55.122151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9a7730a-4a6b-4abc-8db2-289a77abb8ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:55.122607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9a7730a-4a6b-4abc-8db2-289a77abb8ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:55.123429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9a7730a-4a6b-4abc-8db2-289a77abb8ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:55.123907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f9a7730a-4a6b-4abc-8db2-289a77abb8ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:55.162635 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f9a7730a-4a6b-4abc-8db2-289a77abb8ad tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.052570 Nov 27 21:47:55.163294 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4302/8466] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:55 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:56.175298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e9971d03-3c5c-41be-9648-de61a5d6a15a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:56.176259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e9971d03-3c5c-41be-9648-de61a5d6a15a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:56.183633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9971d03-3c5c-41be-9648-de61a5d6a15a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:56.184105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9971d03-3c5c-41be-9648-de61a5d6a15a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:56.184903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9971d03-3c5c-41be-9648-de61a5d6a15a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:56.185362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e9971d03-3c5c-41be-9648-de61a5d6a15a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:56.224673 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e9971d03-3c5c-41be-9648-de61a5d6a15a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053937 Nov 27 21:47:56.225303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4165/8467] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:56 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:57.237497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-301fd980-5a04-401a-b5af-7f5eb1d85893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:57.238561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-301fd980-5a04-401a-b5af-7f5eb1d85893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:57.245849 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-301fd980-5a04-401a-b5af-7f5eb1d85893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:57.246304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-301fd980-5a04-401a-b5af-7f5eb1d85893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:57.247086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-301fd980-5a04-401a-b5af-7f5eb1d85893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:57.247563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-301fd980-5a04-401a-b5af-7f5eb1d85893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:57.287842 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-301fd980-5a04-401a-b5af-7f5eb1d85893 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054885 Nov 27 21:47:57.288495 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4303/8468] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:57 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:58.300530 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d1a01ef-f0a6-4774-a9f6-2b634a1511b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:58.301559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d1a01ef-f0a6-4774-a9f6-2b634a1511b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:58.308924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d1a01ef-f0a6-4774-a9f6-2b634a1511b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:58.309393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d1a01ef-f0a6-4774-a9f6-2b634a1511b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:58.310190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d1a01ef-f0a6-4774-a9f6-2b634a1511b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:58.310646 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d1a01ef-f0a6-4774-a9f6-2b634a1511b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:58.354271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d1a01ef-f0a6-4774-a9f6-2b634a1511b1 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.057698 Nov 27 21:47:58.354943 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4166/8469] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:58 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:47:59.367560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f98034f9-f1ed-405d-b0b1-6730d860fb12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:47:59.368572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f98034f9-f1ed-405d-b0b1-6730d860fb12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:47:59.376282 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f98034f9-f1ed-405d-b0b1-6730d860fb12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:59.376767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f98034f9-f1ed-405d-b0b1-6730d860fb12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:59.377557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f98034f9-f1ed-405d-b0b1-6730d860fb12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:47:59.377999 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f98034f9-f1ed-405d-b0b1-6730d860fb12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:47:59.420448 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f98034f9-f1ed-405d-b0b1-6730d860fb12 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.057046 Nov 27 21:47:59.421327 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4304/8470] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:47:59 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:00.432752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-73cab219-6b97-40a2-aed0-c6ed0cb92cb5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:00.433804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-73cab219-6b97-40a2-aed0-c6ed0cb92cb5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:00.441244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73cab219-6b97-40a2-aed0-c6ed0cb92cb5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:00.441713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73cab219-6b97-40a2-aed0-c6ed0cb92cb5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:00.442508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73cab219-6b97-40a2-aed0-c6ed0cb92cb5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:00.442960 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-73cab219-6b97-40a2-aed0-c6ed0cb92cb5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:00.484460 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-73cab219-6b97-40a2-aed0-c6ed0cb92cb5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055696 Nov 27 21:48:00.485114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4167/8471] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:00 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:01.496630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7bef7a3a-e080-4697-9d6b-afe75d5f3a7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:01.497643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7bef7a3a-e080-4697-9d6b-afe75d5f3a7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:01.507175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bef7a3a-e080-4697-9d6b-afe75d5f3a7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:01.507665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bef7a3a-e080-4697-9d6b-afe75d5f3a7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:01.508463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bef7a3a-e080-4697-9d6b-afe75d5f3a7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:01.508907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7bef7a3a-e080-4697-9d6b-afe75d5f3a7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:01.548406 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7bef7a3a-e080-4697-9d6b-afe75d5f3a7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055694 Nov 27 21:48:01.549304 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4305/8472] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:01 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:02.561185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bb5de09e-944f-499e-b77d-7d9bb41132a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:02.562205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bb5de09e-944f-499e-b77d-7d9bb41132a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:02.569518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb5de09e-944f-499e-b77d-7d9bb41132a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:02.569981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb5de09e-944f-499e-b77d-7d9bb41132a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:02.570771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb5de09e-944f-499e-b77d-7d9bb41132a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:02.571220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bb5de09e-944f-499e-b77d-7d9bb41132a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:02.611118 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bb5de09e-944f-499e-b77d-7d9bb41132a8 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054770 Nov 27 21:48:02.611785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4168/8473] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:02 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:03.623180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ba43053e-cd2f-4dbe-af6c-d43186cf7174 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:03.624801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ba43053e-cd2f-4dbe-af6c-d43186cf7174 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:03.633328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba43053e-cd2f-4dbe-af6c-d43186cf7174 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:03.633787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba43053e-cd2f-4dbe-af6c-d43186cf7174 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:03.634629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba43053e-cd2f-4dbe-af6c-d43186cf7174 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:03.635069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ba43053e-cd2f-4dbe-af6c-d43186cf7174 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:03.674626 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ba43053e-cd2f-4dbe-af6c-d43186cf7174 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055821 Nov 27 21:48:03.675305 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4306/8474] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:03 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:04.687828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98749d19-8604-44de-8653-85e869ff1a7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:04.688769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98749d19-8604-44de-8653-85e869ff1a7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:04.696128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98749d19-8604-44de-8653-85e869ff1a7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:04.696600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98749d19-8604-44de-8653-85e869ff1a7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:04.697406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98749d19-8604-44de-8653-85e869ff1a7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:04.697866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-98749d19-8604-44de-8653-85e869ff1a7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:04.736689 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98749d19-8604-44de-8653-85e869ff1a7c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053524 Nov 27 21:48:04.737365 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4169/8475] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:04 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:48:05.749666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-88cc00e3-40b2-4480-98cb-93b825745175 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:05.750584 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-88cc00e3-40b2-4480-98cb-93b825745175 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:05.758055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cc00e3-40b2-4480-98cb-93b825745175 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:05.758509 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cc00e3-40b2-4480-98cb-93b825745175 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:05.759298 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cc00e3-40b2-4480-98cb-93b825745175 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:05.759737 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-88cc00e3-40b2-4480-98cb-93b825745175 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:05.799703 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-88cc00e3-40b2-4480-98cb-93b825745175 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054726 Nov 27 21:48:05.800334 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4307/8476] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:05 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:06.811769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d2dedc2-9bf0-4408-84a4-0167dbb68954 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:06.812807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d2dedc2-9bf0-4408-84a4-0167dbb68954 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:06.820307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2dedc2-9bf0-4408-84a4-0167dbb68954 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:06.820782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2dedc2-9bf0-4408-84a4-0167dbb68954 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:06.821579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2dedc2-9bf0-4408-84a4-0167dbb68954 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:06.822038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d2dedc2-9bf0-4408-84a4-0167dbb68954 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:06.864352 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d2dedc2-9bf0-4408-84a4-0167dbb68954 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056749 Nov 27 21:48:06.864987 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4170/8477] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:06 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:07.876515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ead9dfb-028f-4fe7-b903-26403bc57fa3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:07.877535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ead9dfb-028f-4fe7-b903-26403bc57fa3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:07.885262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ead9dfb-028f-4fe7-b903-26403bc57fa3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:07.885717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ead9dfb-028f-4fe7-b903-26403bc57fa3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:07.886505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ead9dfb-028f-4fe7-b903-26403bc57fa3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:07.886945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ead9dfb-028f-4fe7-b903-26403bc57fa3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:07.927058 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ead9dfb-028f-4fe7-b903-26403bc57fa3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054473 Nov 27 21:48:07.927726 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4308/8478] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:07 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:08.939689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-069dc377-e468-417d-a076-f01d0f9fa9fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:08.940882 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-069dc377-e468-417d-a076-f01d0f9fa9fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:08.948660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-069dc377-e468-417d-a076-f01d0f9fa9fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:08.949140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-069dc377-e468-417d-a076-f01d0f9fa9fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:08.949947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-069dc377-e468-417d-a076-f01d0f9fa9fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:08.950410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-069dc377-e468-417d-a076-f01d0f9fa9fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:08.989401 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-069dc377-e468-417d-a076-f01d0f9fa9fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054360 Nov 27 21:48:08.990041 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4171/8479] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:08 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:10.002243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6afda324-fd07-49de-b35f-edbb359f68b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:10.003159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6afda324-fd07-49de-b35f-edbb359f68b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:10.010787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6afda324-fd07-49de-b35f-edbb359f68b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:10.011241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6afda324-fd07-49de-b35f-edbb359f68b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:10.012033 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6afda324-fd07-49de-b35f-edbb359f68b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:10.012462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6afda324-fd07-49de-b35f-edbb359f68b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:10.059636 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6afda324-fd07-49de-b35f-edbb359f68b0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.061951 Nov 27 21:48:10.060288 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4309/8480] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:09 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:11.072315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2e98e09-6169-4d1e-a4cc-deedfda36544 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:11.073336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2e98e09-6169-4d1e-a4cc-deedfda36544 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:11.081162 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e98e09-6169-4d1e-a4cc-deedfda36544 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:11.081630 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e98e09-6169-4d1e-a4cc-deedfda36544 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:11.082423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e98e09-6169-4d1e-a4cc-deedfda36544 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:11.082874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2e98e09-6169-4d1e-a4cc-deedfda36544 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:11.125804 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2e98e09-6169-4d1e-a4cc-deedfda36544 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.057522 Nov 27 21:48:11.126452 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4172/8481] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:11 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:12.138345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39a0364a-963f-4db0-bb03-ca96ab8d24c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:12.139331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39a0364a-963f-4db0-bb03-ca96ab8d24c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:12.146519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39a0364a-963f-4db0-bb03-ca96ab8d24c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:12.146963 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39a0364a-963f-4db0-bb03-ca96ab8d24c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:12.147746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39a0364a-963f-4db0-bb03-ca96ab8d24c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:12.148175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39a0364a-963f-4db0-bb03-ca96ab8d24c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:12.189487 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39a0364a-963f-4db0-bb03-ca96ab8d24c7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055068 Nov 27 21:48:12.190150 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4310/8482] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:12 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:13.201602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0e051038-ca5f-4152-ba67-77a5fddfad27 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:13.202634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e051038-ca5f-4152-ba67-77a5fddfad27 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:13.210020 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e051038-ca5f-4152-ba67-77a5fddfad27 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:13.210492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e051038-ca5f-4152-ba67-77a5fddfad27 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:13.211319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e051038-ca5f-4152-ba67-77a5fddfad27 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:13.211780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e051038-ca5f-4152-ba67-77a5fddfad27 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:13.252262 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0e051038-ca5f-4152-ba67-77a5fddfad27 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054631 Nov 27 21:48:13.252888 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4173/8483] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:13 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:14.264419 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-55824969-6dee-4243-a544-b51b377a186f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:14.265420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-55824969-6dee-4243-a544-b51b377a186f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:14.272955 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55824969-6dee-4243-a544-b51b377a186f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:14.273412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55824969-6dee-4243-a544-b51b377a186f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:14.274225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55824969-6dee-4243-a544-b51b377a186f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:14.274667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55824969-6dee-4243-a544-b51b377a186f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:14.313861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-55824969-6dee-4243-a544-b51b377a186f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053426 Nov 27 21:48:14.314746 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4311/8484] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:14 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:15.325509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-65831b9f-941f-4aac-aa4a-c49aa8cb3c7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:15.327172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-65831b9f-941f-4aac-aa4a-c49aa8cb3c7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:15.334590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65831b9f-941f-4aac-aa4a-c49aa8cb3c7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:15.335054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65831b9f-941f-4aac-aa4a-c49aa8cb3c7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:15.335869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65831b9f-941f-4aac-aa4a-c49aa8cb3c7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:15.336324 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-65831b9f-941f-4aac-aa4a-c49aa8cb3c7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:15.376065 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-65831b9f-941f-4aac-aa4a-c49aa8cb3c7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054504 Nov 27 21:48:15.376704 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4174/8485] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:15 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:16.391461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b4b6efe-4ec1-48d1-af4f-3b59e1b5a50b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:16.392468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b4b6efe-4ec1-48d1-af4f-3b59e1b5a50b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:16.398965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4b6efe-4ec1-48d1-af4f-3b59e1b5a50b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:16.399461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4b6efe-4ec1-48d1-af4f-3b59e1b5a50b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:16.400244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4b6efe-4ec1-48d1-af4f-3b59e1b5a50b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:16.400686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4b6efe-4ec1-48d1-af4f-3b59e1b5a50b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:16.439803 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b4b6efe-4ec1-48d1-af4f-3b59e1b5a50b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055194 Nov 27 21:48:16.440360 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4312/8486] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:16 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:17.452192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e4b6f20b-401f-464f-810b-766d4bc7838e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:17.453256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e4b6f20b-401f-464f-810b-766d4bc7838e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:17.460858 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4b6f20b-401f-464f-810b-766d4bc7838e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:17.461356 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4b6f20b-401f-464f-810b-766d4bc7838e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:17.462183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4b6f20b-401f-464f-810b-766d4bc7838e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:17.462634 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4b6f20b-401f-464f-810b-766d4bc7838e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:17.502596 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e4b6f20b-401f-464f-810b-766d4bc7838e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054418 Nov 27 21:48:17.503238 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4175/8487] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:17 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:18.514892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8b4ba4ce-2db4-4ad3-b718-cfaa5c0bb29c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:18.515910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8b4ba4ce-2db4-4ad3-b718-cfaa5c0bb29c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:18.523413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4ba4ce-2db4-4ad3-b718-cfaa5c0bb29c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:18.523870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4ba4ce-2db4-4ad3-b718-cfaa5c0bb29c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:18.524637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4ba4ce-2db4-4ad3-b718-cfaa5c0bb29c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:18.525068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8b4ba4ce-2db4-4ad3-b718-cfaa5c0bb29c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:18.568554 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8b4ba4ce-2db4-4ad3-b718-cfaa5c0bb29c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.058158 Nov 27 21:48:18.569167 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4313/8488] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:18 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:19.581465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cf27725f-5e8d-4931-937b-ef5d50a137ea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:19.582483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cf27725f-5e8d-4931-937b-ef5d50a137ea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:19.589809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf27725f-5e8d-4931-937b-ef5d50a137ea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:19.590273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf27725f-5e8d-4931-937b-ef5d50a137ea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:19.591062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf27725f-5e8d-4931-937b-ef5d50a137ea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:19.591544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cf27725f-5e8d-4931-937b-ef5d50a137ea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:19.647507 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cf27725f-5e8d-4931-937b-ef5d50a137ea tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.070041 Nov 27 21:48:19.648157 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4176/8489] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:19 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:20.660672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f16a426f-40a2-4686-a80b-4778a89d64f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:20.661756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f16a426f-40a2-4686-a80b-4778a89d64f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:20.669066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16a426f-40a2-4686-a80b-4778a89d64f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:20.669512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16a426f-40a2-4686-a80b-4778a89d64f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:20.670945 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16a426f-40a2-4686-a80b-4778a89d64f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:20.671411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f16a426f-40a2-4686-a80b-4778a89d64f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:20.710404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f16a426f-40a2-4686-a80b-4778a89d64f9 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053786 Nov 27 21:48:20.710971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4314/8490] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:20 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:21.722848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0ebd4e0e-b45c-4d9f-a7ac-66edd162dafd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:21.723830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0ebd4e0e-b45c-4d9f-a7ac-66edd162dafd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:21.730866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ebd4e0e-b45c-4d9f-a7ac-66edd162dafd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:21.731381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ebd4e0e-b45c-4d9f-a7ac-66edd162dafd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:21.732188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ebd4e0e-b45c-4d9f-a7ac-66edd162dafd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:21.733139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0ebd4e0e-b45c-4d9f-a7ac-66edd162dafd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:21.773624 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0ebd4e0e-b45c-4d9f-a7ac-66edd162dafd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055017 Nov 27 21:48:21.774278 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4177/8491] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:21 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:48:22.786552 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c9c8b662-70c7-4405-a25d-5d809b22ae5c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:22.787606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c9c8b662-70c7-4405-a25d-5d809b22ae5c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:22.795416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9c8b662-70c7-4405-a25d-5d809b22ae5c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:22.795876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9c8b662-70c7-4405-a25d-5d809b22ae5c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:22.796679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9c8b662-70c7-4405-a25d-5d809b22ae5c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:22.797124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c9c8b662-70c7-4405-a25d-5d809b22ae5c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:22.839973 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c9c8b662-70c7-4405-a25d-5d809b22ae5c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.057393 Nov 27 21:48:22.840591 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4315/8492] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:22 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:23.852760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eebbc8a1-34d7-40f7-9913-cd19e63d503d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:23.853775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eebbc8a1-34d7-40f7-9913-cd19e63d503d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:23.861401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc8a1-34d7-40f7-9913-cd19e63d503d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:23.861865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc8a1-34d7-40f7-9913-cd19e63d503d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:23.862661 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc8a1-34d7-40f7-9913-cd19e63d503d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:23.863114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-eebbc8a1-34d7-40f7-9913-cd19e63d503d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:23.908014 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eebbc8a1-34d7-40f7-9913-cd19e63d503d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.059110 Nov 27 21:48:23.908655 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4178/8493] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:23 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:24.920865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-99ae8794-d70c-4369-96c9-ff3f5e6341ce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:24.921889 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-99ae8794-d70c-4369-96c9-ff3f5e6341ce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:24.928920 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99ae8794-d70c-4369-96c9-ff3f5e6341ce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:24.929383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99ae8794-d70c-4369-96c9-ff3f5e6341ce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:24.930146 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99ae8794-d70c-4369-96c9-ff3f5e6341ce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:24.930577 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-99ae8794-d70c-4369-96c9-ff3f5e6341ce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:24.971195 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-99ae8794-d70c-4369-96c9-ff3f5e6341ce tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054909 Nov 27 21:48:24.971891 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4316/8494] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:24 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 21:48:25.983325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a3cb235d-c1ab-4dd3-8b44-ac42602d31f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:25.984342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a3cb235d-c1ab-4dd3-8b44-ac42602d31f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:25.991668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3cb235d-c1ab-4dd3-8b44-ac42602d31f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:25.992135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3cb235d-c1ab-4dd3-8b44-ac42602d31f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:25.992921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3cb235d-c1ab-4dd3-8b44-ac42602d31f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:25.993371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a3cb235d-c1ab-4dd3-8b44-ac42602d31f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:26.034758 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a3cb235d-c1ab-4dd3-8b44-ac42602d31f3 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055361 Nov 27 21:48:26.035417 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4179/8495] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:25 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:27.047014 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25bbdec2-0a3d-4d0c-9b26-262d8bb864d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:27.048101 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-25bbdec2-0a3d-4d0c-9b26-262d8bb864d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:27.055415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25bbdec2-0a3d-4d0c-9b26-262d8bb864d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:27.055873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25bbdec2-0a3d-4d0c-9b26-262d8bb864d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:27.056649 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25bbdec2-0a3d-4d0c-9b26-262d8bb864d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:27.057088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25bbdec2-0a3d-4d0c-9b26-262d8bb864d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:27.095694 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25bbdec2-0a3d-4d0c-9b26-262d8bb864d7 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.052712 Nov 27 21:48:27.096321 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4317/8496] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:27 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:28.107841 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8bd09f16-ea30-4a16-965d-fb56813a6274 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:28.108885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8bd09f16-ea30-4a16-965d-fb56813a6274 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:28.116152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bd09f16-ea30-4a16-965d-fb56813a6274 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:28.116616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bd09f16-ea30-4a16-965d-fb56813a6274 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:28.117404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bd09f16-ea30-4a16-965d-fb56813a6274 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:28.117856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8bd09f16-ea30-4a16-965d-fb56813a6274 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:28.158813 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8bd09f16-ea30-4a16-965d-fb56813a6274 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.055473 Nov 27 21:48:28.159530 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4180/8497] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:28 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:29.170593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5a5a5294-ec97-4a9a-beef-9ac49f210a72 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:29.171610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5a5a5294-ec97-4a9a-beef-9ac49f210a72 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:29.178792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a5a5294-ec97-4a9a-beef-9ac49f210a72 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:29.179240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a5a5294-ec97-4a9a-beef-9ac49f210a72 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:29.180026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a5a5294-ec97-4a9a-beef-9ac49f210a72 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:29.180454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5a5a5294-ec97-4a9a-beef-9ac49f210a72 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:29.220418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5a5a5294-ec97-4a9a-beef-9ac49f210a72 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053830 Nov 27 21:48:29.222755 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4318/8498] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:29 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:30.234233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-99d8436e-c55a-493c-9690-eaf36c7d202d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:30.235183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-99d8436e-c55a-493c-9690-eaf36c7d202d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:30.242603 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8436e-c55a-493c-9690-eaf36c7d202d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:30.243074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8436e-c55a-493c-9690-eaf36c7d202d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:30.243961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8436e-c55a-493c-9690-eaf36c7d202d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:30.244418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-99d8436e-c55a-493c-9690-eaf36c7d202d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:30.291041 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-99d8436e-c55a-493c-9690-eaf36c7d202d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.061403 Nov 27 21:48:30.291729 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4181/8499] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:30 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:31.303786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68b7a574-7c1d-42cf-bf01-d7538c094625 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:31.304792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68b7a574-7c1d-42cf-bf01-d7538c094625 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:31.312102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68b7a574-7c1d-42cf-bf01-d7538c094625 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:31.312560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68b7a574-7c1d-42cf-bf01-d7538c094625 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:31.313338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68b7a574-7c1d-42cf-bf01-d7538c094625 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:31.313781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68b7a574-7c1d-42cf-bf01-d7538c094625 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:31.358343 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68b7a574-7c1d-42cf-bf01-d7538c094625 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.058554 Nov 27 21:48:31.358970 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4319/8500] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:31 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:32.370466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-54e25e22-abec-4ef3-93d9-7677708bca93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:32.371512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-54e25e22-abec-4ef3-93d9-7677708bca93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:32.379633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e25e22-abec-4ef3-93d9-7677708bca93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:32.380099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e25e22-abec-4ef3-93d9-7677708bca93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:32.380892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e25e22-abec-4ef3-93d9-7677708bca93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:32.381344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-54e25e22-abec-4ef3-93d9-7677708bca93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:32.420541 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-54e25e22-abec-4ef3-93d9-7677708bca93 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.054101 Nov 27 21:48:32.421189 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4182/8501] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:32 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:33.432753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10276eab-227b-46cd-9588-d643a777c74b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:33.433755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10276eab-227b-46cd-9588-d643a777c74b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:33.441123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10276eab-227b-46cd-9588-d643a777c74b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:33.441581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10276eab-227b-46cd-9588-d643a777c74b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:33.442364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10276eab-227b-46cd-9588-d643a777c74b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:33.442803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10276eab-227b-46cd-9588-d643a777c74b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:33.483184 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10276eab-227b-46cd-9588-d643a777c74b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.053718 Nov 27 21:48:33.483868 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4320/8502] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:33 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:34.495417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1db682c4-f88d-4e6c-a9c6-0aae310fac20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:34.496450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1db682c4-f88d-4e6c-a9c6-0aae310fac20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:34.504650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db682c4-f88d-4e6c-a9c6-0aae310fac20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:34.505149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db682c4-f88d-4e6c-a9c6-0aae310fac20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:34.505949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db682c4-f88d-4e6c-a9c6-0aae310fac20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:34.506407 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1db682c4-f88d-4e6c-a9c6-0aae310fac20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:34.548556 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1db682c4-f88d-4e6c-a9c6-0aae310fac20 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 32644 microversion: 2.1 time: 0.056970 Nov 27 21:48:34.549636 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4183/8503] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:34 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:35.562525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e6316315-ecd2-4194-951e-df1534b4c681 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:35.563566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e6316315-ecd2-4194-951e-df1534b4c681 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:35.570749 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6316315-ecd2-4194-951e-df1534b4c681 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:35.571198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6316315-ecd2-4194-951e-df1534b4c681 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:35.571996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6316315-ecd2-4194-951e-df1534b4c681 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:35.572430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e6316315-ecd2-4194-951e-df1534b4c681 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:35.624004 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e6316315-ecd2-4194-951e-df1534b4c681 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 200 len: 40793 microversion: 2.1 time: 0.065953 Nov 27 21:48:35.624922 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4321/8504] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:35 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 40793 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:48:36.955311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:36.956044 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:36.963363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:36.963838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:36.964644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:36.965107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:37.104062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:37.112160 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c9947b4c-b8f4-4db3-b920-d64147e0a4fc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1668 microversion: 2.1 time: 0.161842 Nov 27 21:48:37.112734 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4184/8505] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:36 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:37.132141 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0dde2f13-b187-4849-808a-4bfbd524c07a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed512092-9da9-4d3d-b19b-33dad77c3f26"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:37.133285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0dde2f13-b187-4849-808a-4bfbd524c07a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:37.140554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dde2f13-b187-4849-808a-4bfbd524c07a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:37.141005 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dde2f13-b187-4849-808a-4bfbd524c07a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:37.141781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dde2f13-b187-4849-808a-4bfbd524c07a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:37.142217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dde2f13-b187-4849-808a-4bfbd524c07a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:37.377345 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0dde2f13-b187-4849-808a-4bfbd524c07a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249475 Nov 27 21:48:37.377981 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4322/8506] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:48:37 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:48:40.640280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:40.641268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:40.648900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:40.649373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:40.650172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:40.650686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:40.677573 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:40.683216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Old instance type m1.heat2, new instance type m1.heat {{(pid=135679) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:48:40.690217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:48:40.690650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:48:40.691135 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:48:40.691615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:48:40.692035 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:48:40.751053 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [880f4612-1ace-4297-b2a7-99d2794ef18f] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 21:48:41.767823 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [880f4612-1ace-4297-b2a7-99d2794ef18f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 45348. Nov 27 21:48:41.770959 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9d321de5-bdd9-4ed3-8067-46079d2f0a4d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 202 len: 0 microversion: 2.1 time: 1.135009 Nov 27 21:48:41.771615 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4185/8507] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:48:40 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:48:41.780476 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:41.781192 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:41.788073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:41.788523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:41.789354 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:41.789792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:41.958250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:41.966293 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4e498fad-4a91-4c90-a4ff-904655218c1a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1723 microversion: 2.1 time: 0.190398 Nov 27 21:48:41.967474 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4323/8508] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:41 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:48:42.985801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:42.986358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:42.993346 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:42.993821 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:42.994626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:42.995086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:43.131845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:43.140046 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-164b3944-4eba-4ff8-991f-779bc50f436f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1723 microversion: 2.1 time: 0.159343 Nov 27 21:48:43.141089 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4186/8509] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:42 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:44.157665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:44.158239 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:44.164809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:44.165257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:44.166025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:44.166460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:44.297300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:44.305118 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-918a2636-0d65-48b4-bcd6-6b65d4ab9b03 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.151199 Nov 27 21:48:44.305681 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4324/8510] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:44 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:45.322767 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:45.323425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:45.330633 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:45.331099 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:45.331914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:45.332367 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:45.467390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:45.475362 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0e1babb6-ace7-46af-bcc3-080a4d158c6b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.156355 Nov 27 21:48:45.475948 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4187/8511] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:45 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:46.492289 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:46.493097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:46.500051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:46.500497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:46.501267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:46.501697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:46.624584 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:48:46.624852 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:48:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 (ip 10.222.0.21) !!! Nov 27 21:48:46.639571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:46.651296 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fa1efac-6d1c-49fc-ac30-2ad54fbb35c4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.162651 Nov 27 21:48:46.651856 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4325/8512] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:46 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:47.668388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:47.669003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:47.676806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:47.677310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:47.678153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:47.678617 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:47.812549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:47.820663 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f0be6bf6-831b-4ceb-b0d4-c3c758a0093f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.155995 Nov 27 21:48:47.821254 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4188/8513] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:47 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:48.837786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:48.838404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:48.845198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:48.845644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:48.846418 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:48.846852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:48.977049 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:48.985450 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7cb942f4-3503-4a21-85c7-c98a2cb26751 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.151547 Nov 27 21:48:48.986009 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4326/8514] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:48 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:50.002437 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:50.003086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:50.010104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:50.010565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:50.011404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:50.011855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:50.149373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:50.157265 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f40c27ba-9510-4a8e-9bf7-f15c2168577b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.159137 Nov 27 21:48:50.157833 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4189/8515] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:49 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:51.173962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:51.174573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:51.181262 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:51.181715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:51.182494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:51.182935 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:51.318391 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:51.326117 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-165a435b-536e-41db-ba54-2cddda88ef8a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.155839 Nov 27 21:48:51.326692 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4327/8516] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:51 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:52.344409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:52.345060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:52.351460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:52.351924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:52.352716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:52.353167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:52.482763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:52.491416 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3d05e4f6-acad-4a26-a811-c9faeaf1acdb tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.151444 Nov 27 21:48:52.491987 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4190/8517] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:52 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:53.508588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:53.509189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:53.515464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:53.515913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:53.516679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:53.517205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:53.644277 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:53.651965 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42e5090b-ae97-4b1c-8f8b-4538c50353b5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.147158 Nov 27 21:48:53.652531 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4328/8518] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:53 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:54.668833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:54.669470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:54.676243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:54.676739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:54.677542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:54.678003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:54.814256 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:54.822271 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6812d561-1839-4fb8-8704-775b7c7c2608 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.157187 Nov 27 21:48:54.822839 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4191/8519] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:54 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:55.840026 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:55.840608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:55.848191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:55.848642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:55.849420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:55.849856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:55.984897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:55.992849 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4a976e35-6353-4c30-86c5-8dd7b0105245 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1728 microversion: 2.1 time: 0.156464 Nov 27 21:48:55.993419 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4329/8520] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:55 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:56.781497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7813168f-e74a-4275-b366-b2ff473cf74a req-01ef076b-0d68-4923-b3f9-e29eb8a59cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "name": "network-vif-unplugged", "status": "completed", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:56.783821 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:48:56.783821 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:48:56.792677 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7813168f-e74a-4275-b366-b2ff473cf74a req-01ef076b-0d68-4923-b3f9-e29eb8a59cfe service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:56.793285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7813168f-e74a-4275-b366-b2ff473cf74a req-01ef076b-0d68-4923-b3f9-e29eb8a59cfe service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:56.807222 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7813168f-e74a-4275-b366-b2ff473cf74a req-01ef076b-0d68-4923-b3f9-e29eb8a59cfe service nova] Creating event network-vif-unplugged:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch1-master-1 Nov 27 21:48:56.812552 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-7813168f-e74a-4275-b366-b2ff473cf74a req-01ef076b-0d68-4923-b3f9-e29eb8a59cfe service nova] Instance 25774708-7210-45ee-9097-d55a89f2b668 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:48:56.823488 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7813168f-e74a-4275-b366-b2ff473cf74a req-01ef076b-0d68-4923-b3f9-e29eb8a59cfe service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046197 Nov 27 21:48:56.824114 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4192/8521] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:48:57.010733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:57.011490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:57.019622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:57.020078 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:57.020860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:57.021602 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:57.157542 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:57.166205 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0ecdac1b-843c-4df3-a523-24c889d1c57f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1727 microversion: 2.1 time: 0.159153 Nov 27 21:48:57.166783 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4330/8522] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:57 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:58.184958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:58.185559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:58.191798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:58.192264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:58.193082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:58.193534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:58.332754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:58.340701 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-75055c73-c902-495a-ad94-79ead704d18d tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1725 microversion: 2.1 time: 0.160757 Nov 27 21:48:58.341276 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4193/8523] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:58 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:48:58.840854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ce74efef-9197-465c-8a41-46a5ce3a4f6a req-1c9df674-0eff-4a1e-830c-bc33c7791270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:48:58.843075 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:48:58.843075 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:48:58.852571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ce74efef-9197-465c-8a41-46a5ce3a4f6a req-1c9df674-0eff-4a1e-830c-bc33c7791270 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:58.853022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ce74efef-9197-465c-8a41-46a5ce3a4f6a req-1c9df674-0eff-4a1e-830c-bc33c7791270 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:58.865134 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ce74efef-9197-465c-8a41-46a5ce3a4f6a req-1c9df674-0eff-4a1e-830c-bc33c7791270 service nova] Creating event network-changed:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch1-master-1 Nov 27 21:48:58.870442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-ce74efef-9197-465c-8a41-46a5ce3a4f6a req-1c9df674-0eff-4a1e-830c-bc33c7791270 service nova] Instance 25774708-7210-45ee-9097-d55a89f2b668 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:48:58.882607 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ce74efef-9197-465c-8a41-46a5ce3a4f6a req-1c9df674-0eff-4a1e-830c-bc33c7791270 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045301 Nov 27 21:48:58.883203 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4331/8524] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:48:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:48:59.357958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:48:59.358696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:48:59.365825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:59.366618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:59.367539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:48:59.368075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:48:59.523515 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:48:59.532062 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8b19ecbe-e25f-448a-bfe1-fc160dc08a2e tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1725 microversion: 2.1 time: 0.178054 Nov 27 21:48:59.532643 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4194/8525] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:48:59 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:00.550091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:00.550778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:00.556930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:00.557381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:00.558185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:00.558627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:00.688843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:00.696744 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-636138c5-44c8-4722-b00f-8a06d4744e7a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1725 microversion: 2.1 time: 0.151528 Nov 27 21:49:00.697248 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4332/8526] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:00 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:01.713813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:01.714359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:01.721774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:01.722238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:01.723027 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:01.723519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:01.854542 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:01.862390 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d04ab8a7-ef05-4587-b6db-cc3fa69731aa tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1725 microversion: 2.1 time: 0.152363 Nov 27 21:49:01.862978 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4195/8527] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:01 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:02.879631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:02.880240 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:02.886914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:02.887399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:02.888170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:02.888606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:03.023918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:03.032317 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-476e5b31-8587-4f5f-89ef-7efa3de90d4a tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1722 microversion: 2.1 time: 0.156317 Nov 27 21:49:03.032890 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4333/8528] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:02 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:03.049307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:03.049864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:03.056590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:03.057063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:03.057892 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:03.058350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:03.092032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:03.092503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:03.093338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:03.093800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:03.113995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:49:03.118990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Getting quotas for user df0509ba3bea4d9f893f5c966b9efd46 and project 8ac362e2c70a4862919a7dfcd5f32167. Resources: {'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:49:03.226760 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-37ecbfdf-6117-4971-9a2b-a8a01a9bcef5 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action" status: 202 len: 0 microversion: 2.1 time: 0.181599 Nov 27 21:49:03.227534 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4196/8529] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:49:03 2021] POST /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:49:03.236538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:03.237150 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:03.243074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:03.243553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:03.244326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:03.244791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:03.378037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:03.386685 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-53c75072-d5f6-4bf9-9a9b-d1297b5944c0 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.154087 Nov 27 21:49:03.387569 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4334/8530] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:03 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:04.405906 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:04.415883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:04.417969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:04.418450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:04.419305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:04.419775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:04.557416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:04.566241 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fe1f387d-8271-4641-8983-3bd9341aeb37 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.164657 Nov 27 21:49:04.566823 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4197/8531] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:04 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:05.583812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:05.584422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:05.591124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:05.591606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:05.592382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:05.592819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:05.729257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:05.737102 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-80b6d702-394a-47fd-9af9-c4ab154160c2 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.156986 Nov 27 21:49:05.737689 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4335/8532] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:05 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:05.968937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-1164d194-d844-4abb-bc98-b377cbd355f8 req-186f7174-52c9-4ea3-879a-daa6e7cdb36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "name": "network-vif-plugged", "status": "completed", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:05.971744 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:05.971744 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:49:05.979394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1164d194-d844-4abb-bc98-b377cbd355f8 req-186f7174-52c9-4ea3-879a-daa6e7cdb36a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:05.979868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-1164d194-d844-4abb-bc98-b377cbd355f8 req-186f7174-52c9-4ea3-879a-daa6e7cdb36a service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:05.992954 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-1164d194-d844-4abb-bc98-b377cbd355f8 req-186f7174-52c9-4ea3-879a-daa6e7cdb36a service nova] Creating event network-vif-plugged:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch1-master-1 Nov 27 21:49:05.999493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-1164d194-d844-4abb-bc98-b377cbd355f8 req-186f7174-52c9-4ea3-879a-daa6e7cdb36a service nova] Instance 25774708-7210-45ee-9097-d55a89f2b668 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:49:06.011230 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-1164d194-d844-4abb-bc98-b377cbd355f8 req-186f7174-52c9-4ea3-879a-daa6e7cdb36a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046448 Nov 27 21:49:06.012044 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4198/8533] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:06.754635 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:06.755379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:06.762229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:06.762690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:06.763496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:06.763938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:07.029260 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:07.038435 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c62878e9-0277-4901-a827-ef68a9e03fde tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.287748 Nov 27 21:49:07.048785 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4336/8534] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:06 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:07.199926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9e28140b-6f06-47d4-adb9-ce0cb910e562 req-b63ea787-46b8-4669-94a9-235a1bb640a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "name": "network-vif-unplugged", "status": "completed", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:07.201464 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:07.201464 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:49:07.208610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9e28140b-6f06-47d4-adb9-ce0cb910e562 req-b63ea787-46b8-4669-94a9-235a1bb640a3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:07.209079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9e28140b-6f06-47d4-adb9-ce0cb910e562 req-b63ea787-46b8-4669-94a9-235a1bb640a3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:07.221788 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9e28140b-6f06-47d4-adb9-ce0cb910e562 req-b63ea787-46b8-4669-94a9-235a1bb640a3 service nova] Creating event network-vif-unplugged:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch2-master-1 Nov 27 21:49:07.227344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-9e28140b-6f06-47d4-adb9-ce0cb910e562 req-b63ea787-46b8-4669-94a9-235a1bb640a3 service nova] Instance 25774708-7210-45ee-9097-d55a89f2b668 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:49:07.238721 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9e28140b-6f06-47d4-adb9-ce0cb910e562 req-b63ea787-46b8-4669-94a9-235a1bb640a3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043756 Nov 27 21:49:07.239514 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4199/8535] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:08.056273 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:08.056878 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:08.064180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:08.064626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:08.065398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:08.065830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:08.222002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:08.230035 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5617b584-f778-49e6-ae8e-57cf7bc22212 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.177462 Nov 27 21:49:08.230622 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4337/8536] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:08 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:09.249147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:09.249908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:09.254789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-044638de-c030-41ca-87d3-299d0389e3a3 req-e3ec3dc6-2bef-496d-b4ed-38884d29285d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:09.256374 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:09.256374 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:49:09.259126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:09.259780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:09.260612 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:09.261077 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:09.263874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-044638de-c030-41ca-87d3-299d0389e3a3 req-e3ec3dc6-2bef-496d-b4ed-38884d29285d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:09.264308 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-044638de-c030-41ca-87d3-299d0389e3a3 req-e3ec3dc6-2bef-496d-b4ed-38884d29285d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:09.275748 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-044638de-c030-41ca-87d3-299d0389e3a3 req-e3ec3dc6-2bef-496d-b4ed-38884d29285d service nova] Creating event network-changed:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch2-master-1 Nov 27 21:49:09.280824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-044638de-c030-41ca-87d3-299d0389e3a3 req-e3ec3dc6-2bef-496d-b4ed-38884d29285d service nova] Instance 25774708-7210-45ee-9097-d55a89f2b668 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:49:09.292536 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-044638de-c030-41ca-87d3-299d0389e3a3 req-e3ec3dc6-2bef-496d-b4ed-38884d29285d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041694 Nov 27 21:49:09.293139 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4338/8537] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:09.474585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:09.483965 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1ace1548-45bf-4c8a-8a07-fed8d8a441dc tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.239447 Nov 27 21:49:09.484593 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4200/8538] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:09 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:10.503196 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:10.504170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:10.510347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:10.510799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:10.511650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:10.512121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:10.645036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:10.652916 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-614eb3ca-19f8-4c13-95e0-d6f812c740d4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.154762 Nov 27 21:49:10.653474 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4339/8539] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:10 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:11.669681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:11.670325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:11.677710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:11.678169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:11.678954 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:11.679476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:11.817235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:11.825207 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7b4568c3-af25-46e0-8c24-fee97aa2f420 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1721 microversion: 2.1 time: 0.159224 Nov 27 21:49:11.825789 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4201/8540] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:11 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:12.843154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:12.843814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:12.850625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:12.850983 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:12.851726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:12.852241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:12.987068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:12.995012 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cdbeaf9a-604c-43d2-b7e9-1259a4294122 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1714 microversion: 2.1 time: 0.155901 Nov 27 21:49:12.995616 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4340/8541] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:12 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:13.011583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:13.012217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:13.018880 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.019398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.020207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.020667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.148493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:13.157237 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d63dacfb-6945-4edb-84f4-1864d977e462 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1714 microversion: 2.1 time: 0.148830 Nov 27 21:49:13.157812 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4202/8542] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:13 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:13.173726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:13.174326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:13.180137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.180588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.181357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.181793 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.313468 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:13.321122 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5bdea7d2-5474-496b-8d90-c365de79d64b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1714 microversion: 2.1 time: 0.151607 Nov 27 21:49:13.321688 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4341/8543] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:13 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:13.337326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:13.337845 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:13.343653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.344869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.345727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.346187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.373595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:49:13.455243 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0e54513a-37c0-4100-9178-218f9f9a4ade tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 204 len: 0 microversion: 2.1 time: 0.119477 Nov 27 21:49:13.456268 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4203/8544] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:13 2021] DELETE /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:49:13.464800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:13.465393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:13.471870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.472316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.473089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:13.473519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:13.607375 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:13.615279 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c8e686d0-4759-4b8e-8732-8c263f157019 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1720 microversion: 2.1 time: 0.154907 Nov 27 21:49:13.615862 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4342/8545] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:13 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:14.633608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:14.634323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:14.645438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:14.645913 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:14.646721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:14.647175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:14.784981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:14.794042 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2347d0b5-d6d9-49cd-a10b-75d6c64d72f4 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1720 microversion: 2.1 time: 0.164974 Nov 27 21:49:14.794623 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4204/8546] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:14 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:15.526132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e663701d-5904-4bd8-8009-d5f146e230db req-2c06bb05-dd8b-4212-86e2-1674c24a2a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "name": "network-vif-plugged", "status": "completed", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:15.528409 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:15.528409 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:49:15.536646 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e663701d-5904-4bd8-8009-d5f146e230db req-2c06bb05-dd8b-4212-86e2-1674c24a2a19 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:15.537386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e663701d-5904-4bd8-8009-d5f146e230db req-2c06bb05-dd8b-4212-86e2-1674c24a2a19 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:15.550299 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e663701d-5904-4bd8-8009-d5f146e230db req-2c06bb05-dd8b-4212-86e2-1674c24a2a19 service nova] Creating event network-vif-plugged:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch2-master-1 Nov 27 21:49:15.555400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e663701d-5904-4bd8-8009-d5f146e230db req-2c06bb05-dd8b-4212-86e2-1674c24a2a19 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034599 Nov 27 21:49:15.556079 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4343/8547] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:15.811238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:15.812584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:15.820461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:15.820938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:15.821762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:15.822224 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:15.890063 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0509ba3bea4d9f893f5c966b9efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac362e2c70a4862919a7dfcd5f32167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:15.902117 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a103c5c-c1a5-44c5-8636-62876dc43a66 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 200 len: 1653 microversion: 2.1 time: 0.095086 Nov 27 21:49:15.907937 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4205/8548] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:15 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 1653 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:16.355714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-98a4fda1-50a8-4e79-9115-a86f8712894f req-e98044b0-de6a-4725-930b-6df717786b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25774708-7210-45ee-9097-d55a89f2b668", "name": "network-vif-deleted", "tag": "d33abb14-0e81-4511-aece-6a890371c60a"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:16.357702 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:16.357702 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:49:16.365936 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-98a4fda1-50a8-4e79-9115-a86f8712894f req-e98044b0-de6a-4725-930b-6df717786b82 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:16.366384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-98a4fda1-50a8-4e79-9115-a86f8712894f req-e98044b0-de6a-4725-930b-6df717786b82 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:16.378054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-98a4fda1-50a8-4e79-9115-a86f8712894f req-e98044b0-de6a-4725-930b-6df717786b82 service nova] Creating event network-vif-deleted:d33abb14-0e81-4511-aece-6a890371c60a for instance 25774708-7210-45ee-9097-d55a89f2b668 on nch2-master-1 Nov 27 21:49:16.383467 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-98a4fda1-50a8-4e79-9115-a86f8712894f req-e98044b0-de6a-4725-930b-6df717786b82 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Nov 27 21:49:16.384112 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4344/8549] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:16.924368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:16.925708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:16.935068 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:16.935654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:16.936725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:16.937404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:16.955586 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. Nov 27 21:49:16.956287 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:16.957207 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6eef75d1-e2a5-464b-98a7-230aec1feb8c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 404 len: 111 microversion: 2.1 time: 0.040439 Nov 27 21:49:16.957840 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4206/8550] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:16 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:17.014893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:17.016545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:17.022516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:17.022975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:17.023791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:17.024234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:17.036624 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. Nov 27 21:49:17.037221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:17.038045 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d40e8b0f-ee92-408a-a847-ab7f93441478 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028487 Nov 27 21:49:17.038583 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4345/8551] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:49:17 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.297962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.298496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.305227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.305685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.306472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.306921 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.320617 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. Nov 27 21:49:18.321206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.322020 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b87b558b-7486-43b0-8413-bcb69ff775dd tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 404 len: 111 microversion: 2.1 time: 0.027799 Nov 27 21:49:18.322535 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4207/8552] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:18 2021] DELETE /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.330792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.331434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 25774708-7210-45ee-9097-d55a89f2b668] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.338055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.338498 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.339281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.339715 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.352544 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. Nov 27 21:49:18.353108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 25774708-7210-45ee-9097-d55a89f2b668 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.353935 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2da3c43e-921c-4ff7-aa69-d86f9fb0e877 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668" status: 404 len: 111 microversion: 2.1 time: 0.027538 Nov 27 21:49:18.354438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4346/8553] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:18 2021] GET /compute/v2.1/servers/25774708-7210-45ee-9097-d55a89f2b668 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.362093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.362601 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.368401 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.368865 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.369651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.370103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.384092 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. Nov 27 21:49:18.384674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.385482 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e7430fc2-2103-46da-9087-ff6d190d944f tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 404 len: 111 microversion: 2.1 time: 0.027186 Nov 27 21:49:18.386002 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4208/8554] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:18 2021] DELETE /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.394031 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.394638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: 2dae413f-06a3-4b54-b500-c39507b7ea3b] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.400493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.400925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.401700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.402138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.415161 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. Nov 27 21:49:18.415765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance 2dae413f-06a3-4b54-b500-c39507b7ea3b could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.416600 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2216ccaf-5c76-4854-96bd-e972cb935a2c tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b" status: 404 len: 111 microversion: 2.1 time: 0.026829 Nov 27 21:49:18.417109 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4347/8555] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:18 2021] GET /compute/v2.1/servers/2dae413f-06a3-4b54-b500-c39507b7ea3b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.424757 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.425277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.431388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.431864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.432663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.433125 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.447147 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. Nov 27 21:49:18.447790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.448629 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e6096616-fbfc-401a-b6b3-b500a88ff8af tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 404 len: 111 microversion: 2.1 time: 0.027550 Nov 27 21:49:18.449171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4209/8556] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:18 2021] DELETE /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.457598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.458200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: bf71db5b-1673-483b-9086-bf85ff0810a5] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.464907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.465358 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.466132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.466579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.479653 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. Nov 27 21:49:18.480233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance bf71db5b-1673-483b-9086-bf85ff0810a5 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.481061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0aa2d820-c658-4514-82d4-1ffa6a0ac30b tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5" status: 404 len: 111 microversion: 2.1 time: 0.027740 Nov 27 21:49:18.481578 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4348/8557] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:18 2021] GET /compute/v2.1/servers/bf71db5b-1673-483b-9086-bf85ff0810a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.489107 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.489653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.495547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.496018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.496809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.497264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.511137 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. Nov 27 21:49:18.511752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.512572 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bac3e008-6a56-41e7-9312-941cdb85f4ff tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 404 len: 111 microversion: 2.1 time: 0.027128 Nov 27 21:49:18.513298 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4210/8558] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:18 2021] DELETE /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.521148 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.521761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [instance: e13f8196-ea7a-4cfd-9b52-2d3437bea9ff] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:18.527554 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.528064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.528754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:18.529183 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:18.542009 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] HTTP exception thrown: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. Nov 27 21:49:18.542582 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Returning 404 to user: Instance e13f8196-ea7a-4cfd-9b52-2d3437bea9ff could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:18.543440 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e4217feb-59d7-4f9f-a870-c086835408cf tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff" status: 404 len: 111 microversion: 2.1 time: 0.025923 Nov 27 21:49:18.543936 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4349/8559] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:18 2021] GET /compute/v2.1/servers/e13f8196-ea7a-4cfd-9b52-2d3437bea9ff => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:18.551988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-76da305f-210f-4680-beb2-feebf0ab3f38 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] Calling method '.version_select at 0x7f15c7d653a0>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:18.555142 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76da305f-210f-4680-beb2-feebf0ab3f38 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [14fe4436-aa96-4a19-b938-ee833bc206f9] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 21:49:19.571585 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [None req-76da305f-210f-4680-beb2-feebf0ab3f38 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] [14fe4436-aa96-4a19-b938-ee833bc206f9] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 45566. Nov 27 21:49:19.592710 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-76da305f-210f-4680-beb2-feebf0ab3f38 tempest-ServerActionsTestJSON-439351180 tempest-ServerActionsTestJSON-439351180-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705610460" status: 202 len: 0 microversion: 2.1 time: 1.044260 Nov 27 21:49:19.593304 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4211/8560] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 21:49:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705610460 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:49:25.258133 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1208384748", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "35af38be-d225-4fe0-b76c-130dcf0ec72b"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:25.309194 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] validate_networks() for [('35af38be-d225-4fe0-b76c-130dcf0ec72b', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:49:25.733104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:49:25.733525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:49:25.734080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:49:25.734990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:49:25.735428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:49:25.745052 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:25.745494 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:25.746295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:25.746728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:25.763157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Getting quotas for project 22da8510e20f4540924f5d45f11f0d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:49:25.768179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Getting quotas for user a9b5e9107eab489f9ad4d198b9b92313 and project 22da8510e20f4540924f5d45f11f0d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:49:25.780063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:49:25.782847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:49:25.829761 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5f31d7fb-95d7-4c3a-a150-2a805efb825b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682341 Nov 27 21:49:25.830437 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4350/8561] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:49:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:49:25.841328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-293924e7-e2a5-42b1-8c2c-2fb39acd3269 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:25.841953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-293924e7-e2a5-42b1-8c2c-2fb39acd3269 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:25.893526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-293924e7-e2a5-42b1-8c2c-2fb39acd3269 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:25.900652 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-293924e7-e2a5-42b1-8c2c-2fb39acd3269 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1217 microversion: 2.1 time: 0.064029 Nov 27 21:49:25.901260 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4212/8562] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:25 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:26.919662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:26.920284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:26.927496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:26.928045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:26.928947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:26.929440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:27.329158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:27.336403 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-14679996-4865-4415-b35b-9d7572675cb4 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1275 microversion: 2.1 time: 0.421565 Nov 27 21:49:27.337158 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4351/8563] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:26 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1275 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:28.353868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:28.354610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:28.363933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:28.364403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:28.365201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:28.365653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:28.476634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ed7bbec7-e9ed-4b40-8b5b-4753750ec610 req-64fedba6-7f0c-4bca-a5d8-23a11ba030d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd22f22e-feb2-49e8-89e0-214632bdd30d", "tag": "84cdbad4-7553-4b67-94a6-f8554f0b0586"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:28.478239 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:28.478239 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:49:28.504205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ed7bbec7-e9ed-4b40-8b5b-4753750ec610 req-64fedba6-7f0c-4bca-a5d8-23a11ba030d4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:28.504667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ed7bbec7-e9ed-4b40-8b5b-4753750ec610 req-64fedba6-7f0c-4bca-a5d8-23a11ba030d4 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:28.506353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:28.514587 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02e4e593-d748-408b-ad88-40ed19caf501 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1317 microversion: 2.1 time: 0.164358 Nov 27 21:49:28.515992 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4213/8564] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:28 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:28.527063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ed7bbec7-e9ed-4b40-8b5b-4753750ec610 req-64fedba6-7f0c-4bca-a5d8-23a11ba030d4 service nova] Creating event network-changed:84cdbad4-7553-4b67-94a6-f8554f0b0586 for instance dd22f22e-feb2-49e8-89e0-214632bdd30d on nch2-master-1 Nov 27 21:49:28.532813 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ed7bbec7-e9ed-4b40-8b5b-4753750ec610 req-64fedba6-7f0c-4bca-a5d8-23a11ba030d4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059200 Nov 27 21:49:28.533422 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4352/8565] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:49:29.532267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:29.533004 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:29.539864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:29.540360 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:29.541164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:29.541620 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:29.673183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:29.680672 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cdfad8c2-54d2-4d1d-8108-a8ab2d65198c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1317 microversion: 2.1 time: 0.152597 Nov 27 21:49:29.681258 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4214/8566] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:29 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:30.698481 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:30.699092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:30.705870 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:30.706312 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:30.707079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:30.707538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:30.837362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:30.845233 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de72135b-e4f7-4f1c-938c-3b8258b7ac46 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1317 microversion: 2.1 time: 0.152403 Nov 27 21:49:30.845810 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4353/8567] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:30 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:31.862275 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:31.862890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:31.869642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:31.870104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:31.870890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:31.871368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:32.004198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:32.011581 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d4d9a63f-ecf3-4c2d-9a68-651cbf05c327 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1317 microversion: 2.1 time: 0.153750 Nov 27 21:49:32.012156 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4215/8568] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:31 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:33.028798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:33.029437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:33.036208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:33.036657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:33.037434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:33.037874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:33.169708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:33.177008 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c474f41a-4e04-41d7-a0db-34143667c357 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1317 microversion: 2.1 time: 0.151980 Nov 27 21:49:33.177569 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4354/8569] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:33 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:33.572800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-c648a814-f99d-4964-b521-b96a117014cf req-0c49bb33-e4d9-453e-ad90-94dbd5ad8287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd22f22e-feb2-49e8-89e0-214632bdd30d", "name": "network-vif-plugged", "status": "completed", "tag": "84cdbad4-7553-4b67-94a6-f8554f0b0586"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:33.574447 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:33.574447 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:49:33.582477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c648a814-f99d-4964-b521-b96a117014cf req-0c49bb33-e4d9-453e-ad90-94dbd5ad8287 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:33.582950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-c648a814-f99d-4964-b521-b96a117014cf req-0c49bb33-e4d9-453e-ad90-94dbd5ad8287 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:33.593970 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-c648a814-f99d-4964-b521-b96a117014cf req-0c49bb33-e4d9-453e-ad90-94dbd5ad8287 service nova] Creating event network-vif-plugged:84cdbad4-7553-4b67-94a6-f8554f0b0586 for instance dd22f22e-feb2-49e8-89e0-214632bdd30d on nch2-master-1 Nov 27 21:49:33.598953 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-c648a814-f99d-4964-b521-b96a117014cf req-0c49bb33-e4d9-453e-ad90-94dbd5ad8287 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029934 Nov 27 21:49:33.599580 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4216/8570] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:49:34.193569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:34.194234 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:34.200758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:34.201201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:34.201966 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:34.202397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:34.330166 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:34.337340 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39e687b7-50a7-4397-ad71-c0637a00c28a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1317 microversion: 2.1 time: 0.147470 Nov 27 21:49:34.337909 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4355/8571] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:34 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:35.355347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:35.356066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:35.362955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:35.363470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:35.364274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:35.364735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:35.498065 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:35.505801 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-758ef75c-6362-49b8-bb63-bd84a8963612 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1505 microversion: 2.1 time: 0.155647 Nov 27 21:49:35.506373 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4217/8572] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:35 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:35.558115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1304920856", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "35af38be-d225-4fe0-b76c-130dcf0ec72b"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:35.608566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] validate_networks() for [('35af38be-d225-4fe0-b76c-130dcf0ec72b', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:49:35.963655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:49:35.964072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:49:35.964540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:49:35.964973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:49:35.965379 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:49:35.973971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:35.974412 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:35.975209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:35.975673 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:35.992114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Getting quotas for project 22da8510e20f4540924f5d45f11f0d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:49:35.997007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Getting quotas for user a9b5e9107eab489f9ad4d198b9b92313 and project 22da8510e20f4540924f5d45f11f0d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:49:36.009515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:49:36.011804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:49:36.054473 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-767c12e7-63b2-4f11-8be2-b70f7e403b54 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500003 Nov 27 21:49:36.055323 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4356/8573] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:49:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:49:36.065339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-98c6d8da-0417-4f48-beb9-96c0e79a5a0b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:36.065993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-98c6d8da-0417-4f48-beb9-96c0e79a5a0b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:36.119435 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-98c6d8da-0417-4f48-beb9-96c0e79a5a0b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:36.126314 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-98c6d8da-0417-4f48-beb9-96c0e79a5a0b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1217 microversion: 2.1 time: 0.065267 Nov 27 21:49:36.126908 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4218/8574] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:36 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:37.143528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:37.144170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:37.151548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:37.151994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:37.152773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:37.153208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:37.213231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:37.220591 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-867fbac5-7136-410e-9745-4df4963e2284 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1275 microversion: 2.1 time: 0.081471 Nov 27 21:49:37.221176 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4357/8575] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:37 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:38.238408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:38.239091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:38.247093 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:38.247604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:38.248422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:38.248879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:38.582940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:38.590524 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a8a6191-9a79-4813-9f6e-a7996c2dee58 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1317 microversion: 2.1 time: 0.356487 Nov 27 21:49:38.591113 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4219/8576] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:38 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:38.652982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d6b7ee89-9e0a-4dc6-a65e-177af836370c req-96bfa598-4d7e-4f62-95a9-248e16310e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021ef6ec-61b0-4f6d-8f29-4235cbe2e90a", "tag": "e7715e91-6c8f-4301-b79c-3814bf6bd703"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:38.654594 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:38.654594 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:49:38.662950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d6b7ee89-9e0a-4dc6-a65e-177af836370c req-96bfa598-4d7e-4f62-95a9-248e16310e27 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:38.663417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d6b7ee89-9e0a-4dc6-a65e-177af836370c req-96bfa598-4d7e-4f62-95a9-248e16310e27 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:38.675002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d6b7ee89-9e0a-4dc6-a65e-177af836370c req-96bfa598-4d7e-4f62-95a9-248e16310e27 service nova] Creating event network-changed:e7715e91-6c8f-4301-b79c-3814bf6bd703 for instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a on nch1-master-1 Nov 27 21:49:38.680184 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d6b7ee89-9e0a-4dc6-a65e-177af836370c req-96bfa598-4d7e-4f62-95a9-248e16310e27 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031143 Nov 27 21:49:38.680623 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4358/8577] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:39.608069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:39.608651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:39.615908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:39.616403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:39.617195 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:39.617648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:39.751780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:39.759484 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22b0fa4d-904a-4251-91ee-7bf8eb633040 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1317 microversion: 2.1 time: 0.155157 Nov 27 21:49:39.760081 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4220/8578] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:39 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:40.777657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:40.778401 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:40.784622 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:40.785062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:40.785826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:40.786259 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:40.922513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:40.930054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-db5e21f9-5fe9-4612-8d6e-4b148093bf2c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1317 microversion: 2.1 time: 0.157223 Nov 27 21:49:40.930637 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4359/8579] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:40 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:41.947150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:41.947818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:41.955129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:41.955627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:41.956446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:41.956891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:42.089376 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:42.097432 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fc4237a4-a33f-4f8f-b510-82b5f9f56f49 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1317 microversion: 2.1 time: 0.154074 Nov 27 21:49:42.098021 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4221/8580] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:41 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:43.114540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:43.115134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:43.121873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:43.122320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:43.123130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:43.123597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:43.491461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:43.498823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb14ce39-ca58-4ebc-a6fd-65594737a58a tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1317 microversion: 2.1 time: 0.388564 Nov 27 21:49:43.499417 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4360/8581] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:43 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:44.160139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0b4858db-c8bc-47be-ad24-8ceaf0fe1605 req-a2dfbfc5-6c9c-4b5c-8135-bb38c000a494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021ef6ec-61b0-4f6d-8f29-4235cbe2e90a", "name": "network-vif-plugged", "status": "completed", "tag": "e7715e91-6c8f-4301-b79c-3814bf6bd703"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:44.161662 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:44.161662 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:49:44.169713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0b4858db-c8bc-47be-ad24-8ceaf0fe1605 req-a2dfbfc5-6c9c-4b5c-8135-bb38c000a494 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:44.170184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0b4858db-c8bc-47be-ad24-8ceaf0fe1605 req-a2dfbfc5-6c9c-4b5c-8135-bb38c000a494 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:44.181760 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0b4858db-c8bc-47be-ad24-8ceaf0fe1605 req-a2dfbfc5-6c9c-4b5c-8135-bb38c000a494 service nova] Creating event network-vif-plugged:e7715e91-6c8f-4301-b79c-3814bf6bd703 for instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a on nch1-master-1 Nov 27 21:49:44.186617 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0b4858db-c8bc-47be-ad24-8ceaf0fe1605 req-a2dfbfc5-6c9c-4b5c-8135-bb38c000a494 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030434 Nov 27 21:49:44.187211 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4222/8582] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:44.515681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:44.516300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:44.523074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:44.523558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:44.524337 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:44.524784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:44.657606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:44.664862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46f94965-3e56-491e-ae27-6353d8c96557 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1317 microversion: 2.1 time: 0.152936 Nov 27 21:49:44.665426 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4361/8583] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:44 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:45.683227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:45.684048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:45.690932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:45.691443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:45.692271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:45.692732 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:45.829143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:45.836571 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5e8b17b0-5510-4cc5-98e3-36b4cd74c35c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1505 microversion: 2.1 time: 0.158350 Nov 27 21:49:45.837150 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4223/8584] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:45 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:45.852604 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:45.853112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:45.859736 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:45.860855 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:45.861644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:45.862084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:45.886246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:49:45.961531 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed60eca7-a1b1-4d09-9590-b3a9e932e343 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "DELETE /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 204 len: 0 microversion: 2.1 time: 0.112266 Nov 27 21:49:45.962932 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4362/8585] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:45 2021] DELETE /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:49:45.972619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:45.973309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:45.979328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:45.979799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:45.980593 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:45.981046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:46.114999 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:46.122500 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cda588f9-a324-4b0d-bd9c-f2ef31b1bafe tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1511 microversion: 2.1 time: 0.154964 Nov 27 21:49:46.123074 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4224/8586] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:45 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:49:47.140381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:47.141134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:47.147776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:47.148232 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:47.149016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:47.149459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:47.280428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:47.287947 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-befc2dcc-0d25-4760-9172-8d2c7b94be26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1511 microversion: 2.1 time: 0.151708 Nov 27 21:49:47.288532 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4363/8587] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:47 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:47.863807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-fa362189-23b8-403a-864a-5dfacf0a5ca6 req-66f7154e-a9b0-4297-aed0-d0d726e5273f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021ef6ec-61b0-4f6d-8f29-4235cbe2e90a", "name": "network-vif-deleted", "tag": "e7715e91-6c8f-4301-b79c-3814bf6bd703"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:47.865416 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:47.865416 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:49:47.874033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fa362189-23b8-403a-864a-5dfacf0a5ca6 req-66f7154e-a9b0-4297-aed0-d0d726e5273f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:47.874648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-fa362189-23b8-403a-864a-5dfacf0a5ca6 req-66f7154e-a9b0-4297-aed0-d0d726e5273f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:47.887869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-fa362189-23b8-403a-864a-5dfacf0a5ca6 req-66f7154e-a9b0-4297-aed0-d0d726e5273f service nova] Creating event network-vif-deleted:e7715e91-6c8f-4301-b79c-3814bf6bd703 for instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a on nch1-master-1 Nov 27 21:49:47.893773 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-fa362189-23b8-403a-864a-5dfacf0a5ca6 req-66f7154e-a9b0-4297-aed0-d0d726e5273f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033716 Nov 27 21:49:47.894616 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4225/8588] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:48.305129 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:48.305773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:48.312756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:48.313214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:48.314025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:48.314596 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:48.346459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:48.346988 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:48.347464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lazy-loading 'fault' on Instance uuid 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:49:48.388349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:48.395594 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6e01664b-2927-4ddc-b28d-728a66a9193e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 200 len: 1307 microversion: 2.1 time: 0.094784 Nov 27 21:49:48.396169 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4364/8589] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:48 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:49.415373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:49.416100 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:49.422393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.422863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.423690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.424158 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.437977 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] HTTP exception thrown: Instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a could not be found. Nov 27 21:49:49.438616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Returning 404 to user: Instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:49.439495 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ded54a3c-54dc-401b-b53e-9af9f56f83a9 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 404 len: 111 microversion: 2.1 time: 0.029175 Nov 27 21:49:49.440047 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4226/8590] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:49 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:49.448520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:49.449162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:49.456574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.457028 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.457811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.458251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.592553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:49.600579 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b6ac7d74-025e-4891-8a9f-270f232e01f1 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1505 microversion: 2.1 time: 0.155738 Nov 27 21:49:49.601142 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4365/8591] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:49 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:49.616982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6814db0b-2240-41be-9e58-38f728ad4d3c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:49.617975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6814db0b-2240-41be-9e58-38f728ad4d3c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 8dcc7dc0-90ef-41fc-9bb9-9f19b34c896a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:49.623218 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-6814db0b-2240-41be-9e58-38f728ad4d3c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] HTTP exception thrown: Instance 8dcc7dc0-90ef-41fc-9bb9-9f19b34c896a could not be found. Nov 27 21:49:49.623829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6814db0b-2240-41be-9e58-38f728ad4d3c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Returning 404 to user: Instance 8dcc7dc0-90ef-41fc-9bb9-9f19b34c896a could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:49.624636 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6814db0b-2240-41be-9e58-38f728ad4d3c tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "POST /compute/v2.1/servers/8dcc7dc0-90ef-41fc-9bb9-9f19b34c896a/action" status: 404 len: 111 microversion: 2.1 time: 0.011469 Nov 27 21:49:49.625164 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4227/8592] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:49:49 2021] POST /compute/v2.1/servers/8dcc7dc0-90ef-41fc-9bb9-9f19b34c896a/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:49.633311 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:49.633918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:49.639670 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.640123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.640908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.641880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.769575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:49.776815 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2cca1168-b25d-4e8c-9815-edfdda07fc26 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1505 microversion: 2.1 time: 0.146966 Nov 27 21:49:49.777406 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4366/8593] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:49 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:49:49.793570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:49.794196 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:49.801318 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.801791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.802596 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.803052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.940458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:49.947922 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-096e3fc5-41d0-4476-8ddb-98220cc183a0 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1505 microversion: 2.1 time: 0.158122 Nov 27 21:49:49.948492 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4228/8594] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:49 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:49.964796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "5bafbfae-b8c1-44f3-a458-02bd54b035cb"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:49.965796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:49.971751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.972158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:49.972925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:49.973393 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.013423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:50.018993 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] HTTP exception thrown: Flavor 5bafbfae-b8c1-44f3-a458-02bd54b035cb could not be found. Nov 27 21:49:50.019665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Returning 400 to user: Flavor 5bafbfae-b8c1-44f3-a458-02bd54b035cb could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:50.020499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-10bbf142-6fcb-4b7f-9513-f3f1053b2d55 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "POST /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d/action" status: 400 len: 107 microversion: 2.1 time: 0.059493 Nov 27 21:49:50.021061 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4367/8595] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:49:49 2021] POST /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d/action => generated 107 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:49:50.029247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:50.029919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:50.037057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.037544 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.038353 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.038819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.167243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:50.175173 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-62b80992-a761-4b1e-8126-04f0a67dc11e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1505 microversion: 2.1 time: 0.149668 Nov 27 21:49:50.175795 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4229/8596] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:50 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:50.192460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:50.193077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:50.198926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.199429 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.200207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.200648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.328459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:50.335883 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8bb47b6f-cf6e-4ec1-a57e-4f39760ff80e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1505 microversion: 2.1 time: 0.147681 Nov 27 21:49:50.336452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4368/8597] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:50 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:50.352441 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3cbfc53-53ae-45be-a2c1-af764c5b9873 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:50.353590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3cbfc53-53ae-45be-a2c1-af764c5b9873 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:50.354397 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3cbfc53-53ae-45be-a2c1-af764c5b9873 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "POST /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d/action" status: 400 len: 113 microversion: 2.1 time: 0.005835 Nov 27 21:49:50.354914 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4230/8598] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:49:50 2021] POST /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 21:49:50.362655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:50.363275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:50.369045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.369496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.370271 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.370712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.501722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:50.509365 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5030d039-3b94-47bc-985c-fd3be2071ad3 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1505 microversion: 2.1 time: 0.150657 Nov 27 21:49:50.509934 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4369/8599] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:50 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:49:50.529642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:50.530130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:50.539476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.539952 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.540748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.541206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.554645 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] HTTP exception thrown: Instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a could not be found. Nov 27 21:49:50.555238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Returning 404 to user: Instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:50.556083 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-30294881-0312-4874-bb5c-9b1371d11857 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "DELETE /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 404 len: 111 microversion: 2.1 time: 0.031126 Nov 27 21:49:50.556620 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4231/8600] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:50 2021] DELETE /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:50.565912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:50.566528 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:50.572561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.573006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.573803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.574238 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.587844 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] HTTP exception thrown: Instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a could not be found. Nov 27 21:49:50.588415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Returning 404 to user: Instance 021ef6ec-61b0-4f6d-8f29-4235cbe2e90a could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:50.589214 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-25e77e53-7e18-4dd5-a2a7-c2f8773cd4bb tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a" status: 404 len: 111 microversion: 2.1 time: 0.028630 Nov 27 21:49:50.589727 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4370/8601] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:50 2021] GET /compute/v2.1/servers/021ef6ec-61b0-4f6d-8f29-4235cbe2e90a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:49:50.597408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:50.597919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:50.603817 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.604291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.605089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.605547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.630129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:49:50.705903 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ef96e855-ac5c-4718-826e-1262d8a19a02 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "DELETE /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 204 len: 0 microversion: 2.1 time: 0.111361 Nov 27 21:49:50.706606 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4232/8602] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:49:50 2021] DELETE /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:49:50.716029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:50.716629 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:50.722387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.722838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.723631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:50.724063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:50.852299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:50.859634 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-05636c0e-a709-470e-86f3-74cf17338868 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1511 microversion: 2.1 time: 0.147981 Nov 27 21:49:50.860859 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4371/8603] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:50 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:49:51.878018 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:51.878994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:51.885344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:51.885808 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:51.886599 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:51.887048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:52.026183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:52.033864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-10da046d-8a73-487f-bb73-6ebc61a3272b tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1511 microversion: 2.1 time: 0.160634 Nov 27 21:49:52.034443 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4233/8604] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:51 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:52.712548 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-15c8b3a2-ef5f-4542-a892-96948cc97982 req-6a8943be-93da-4cba-9d4e-f3f786a85d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd22f22e-feb2-49e8-89e0-214632bdd30d", "name": "network-vif-deleted", "tag": "84cdbad4-7553-4b67-94a6-f8554f0b0586"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:49:52.714691 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:49:52.714691 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:49:52.724004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-15c8b3a2-ef5f-4542-a892-96948cc97982 req-6a8943be-93da-4cba-9d4e-f3f786a85d5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:52.724544 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-15c8b3a2-ef5f-4542-a892-96948cc97982 req-6a8943be-93da-4cba-9d4e-f3f786a85d5e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:52.736450 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-15c8b3a2-ef5f-4542-a892-96948cc97982 req-6a8943be-93da-4cba-9d4e-f3f786a85d5e service nova] Creating event network-vif-deleted:84cdbad4-7553-4b67-94a6-f8554f0b0586 for instance dd22f22e-feb2-49e8-89e0-214632bdd30d on nch2-master-1 Nov 27 21:49:52.742185 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-15c8b3a2-ef5f-4542-a892-96948cc97982 req-6a8943be-93da-4cba-9d4e-f3f786a85d5e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Nov 27 21:49:52.742817 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4372/8605] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:49:53.051110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:53.052073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:53.058910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:53.059438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:53.060317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:53.060702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:53.092940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:53.093413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:53.093889 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lazy-loading 'fault' on Instance uuid dd22f22e-feb2-49e8-89e0-214632bdd30d {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:49:53.134476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b5e9107eab489f9ad4d198b9b92313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22da8510e20f4540924f5d45f11f0d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:49:53.143333 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7474f2cb-6b11-4276-8c4e-ee6e60adde34 tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 200 len: 1307 microversion: 2.1 time: 0.096333 Nov 27 21:49:53.144077 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4234/8606] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:53 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:49:54.163731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:49:54.164352 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] [instance: dd22f22e-feb2-49e8-89e0-214632bdd30d] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:49:54.171083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:54.171569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:54.172349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:49:54.172792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:49:54.185708 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] HTTP exception thrown: Instance dd22f22e-feb2-49e8-89e0-214632bdd30d could not be found. Nov 27 21:49:54.186293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] Returning 404 to user: Instance dd22f22e-feb2-49e8-89e0-214632bdd30d could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:49:54.187105 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0c4044a-e30d-48a5-9818-7e1975e74e8e tempest-ServersNegativeTestJSON-1242530998 tempest-ServersNegativeTestJSON-1242530998-project] 10.222.0.21 "GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d" status: 404 len: 111 microversion: 2.1 time: 0.027614 Nov 27 21:49:54.187653 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4373/8607] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:49:54 2021] GET /compute/v2.1/servers/dd22f22e-feb2-49e8-89e0-214632bdd30d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 21:50:26.715207 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:50:26.715997 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:50:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:50:32.147966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4072ca01-bdf8-4875-8a29-ae5a224b0a8e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Action: 'create', calling method: .version_select at 0x7f15c7378a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-939911263"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:50:32.161893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4072ca01-bdf8-4875-8a29-ae5a224b0a8e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Getting quotas for project 741fb423d7b24833be8f3d9d7d83294e. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:50:32.166856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4072ca01-bdf8-4875-8a29-ae5a224b0a8e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Getting quotas for user a32b19324e154c7fb5e29e374753ba7f and project 741fb423d7b24833be8f3d9d7d83294e. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:50:32.552588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4072ca01-bdf8-4875-8a29-ae5a224b0a8e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Getting quotas for project 741fb423d7b24833be8f3d9d7d83294e. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:50:32.557450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-4072ca01-bdf8-4875-8a29-ae5a224b0a8e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Getting quotas for user a32b19324e154c7fb5e29e374753ba7f and project 741fb423d7b24833be8f3d9d7d83294e. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:50:32.572349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4072ca01-bdf8-4875-8a29-ae5a224b0a8e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.428431 Nov 27 21:50:32.572983 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4235/8608] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:50:32 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:32.623595 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2029380484", "imageRef": "b8cfd57c-0e9f-472c-b6bd-33f86a0be00a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-939911263", "networks": [{"uuid": "3f414279-f8bb-40c2-aeb6-b0aa92043f81"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:50:32.793230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] validate_networks() for [('3f414279-f8bb-40c2-aeb6-b0aa92043f81', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:50:33.172399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:50:33.172818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:50:33.173286 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:50:33.173686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:50:33.174092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:50:33.182939 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:33.183422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:33.184228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:33.184657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:33.201068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Getting quotas for project 741fb423d7b24833be8f3d9d7d83294e. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:50:33.206787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Getting quotas for user a32b19324e154c7fb5e29e374753ba7f and project 741fb423d7b24833be8f3d9d7d83294e. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:50:33.218359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:50:33.220666 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8cfd57c-0e9f-472c-b6bd-33f86a0be00a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:50:33.264890 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de5a1241-c8cd-4c15-828b-44a319490169 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644977 Nov 27 21:50:33.265578 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4374/8609] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:50:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:50:33.276459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-eae68c75-d363-4e87-8333-d58ccea15373 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:33.277090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-eae68c75-d363-4e87-8333-d58ccea15373 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:33.428222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-eae68c75-d363-4e87-8333-d58ccea15373 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:33.436275 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-eae68c75-d363-4e87-8333-d58ccea15373 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1258 microversion: 2.1 time: 0.164243 Nov 27 21:50:33.436917 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4236/8610] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:33 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:34.456301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:34.456919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:34.464909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:34.465558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:34.466722 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:34.467411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:34.542516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:34.559563 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-89bb4287-1075-47d7-9ef3-a1de43f784ea tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.107334 Nov 27 21:50:34.564105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4375/8611] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:34 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:35.581458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:35.582208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:35.590172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:35.590925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:35.592232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:35.592867 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:35.736680 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:35.758274 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-484aa9ba-7429-4031-96cb-36d91b4abb3e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.180428 Nov 27 21:50:35.758874 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4237/8612] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:35 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:36.777197 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:36.777830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:36.785318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:36.785774 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:36.786569 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:36.787009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:36.927269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:36.941962 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b17aef53-7dd9-4977-a030-b6a62fe964aa tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.168614 Nov 27 21:50:36.943453 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4376/8613] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:36 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:37.960013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:37.960851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:37.967829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:37.968456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:37.969856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:37.970380 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:38.115172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:38.122888 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-723d91ab-d56d-4594-81a1-593eca51e894 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.166890 Nov 27 21:50:38.123542 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4238/8614] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:37 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:39.143869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:39.144533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:39.151450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:39.151896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:39.152684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:39.153114 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:39.307383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:39.326209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d82dde85-63f2-4e72-a3a7-720878c27e88 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.185898 Nov 27 21:50:39.332566 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4377/8615] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:39 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:40.345387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:40.346088 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:40.354404 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:40.354869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:40.356003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:40.356717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:40.506656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:40.515767 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e0986d84-b29e-4690-ba5b-1d32b5bf3b4e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.173937 Nov 27 21:50:40.516875 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4239/8616] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:40 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:41.533478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:41.535588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:41.543707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:41.544561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:41.545611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:41.546288 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:41.692191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:41.699979 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b479258e-2ca3-4c47-ab4b-23065e72af6e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.170569 Nov 27 21:50:41.700479 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4378/8617] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:41 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:42.717131 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:42.717721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:42.725181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:42.725666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:42.726627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:42.727091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:42.869976 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:42.878019 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2b9576eb-8b41-4589-9352-de9af50a7aaf tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.164635 Nov 27 21:50:42.878869 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4240/8618] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:42 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:43.895488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:43.896125 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:43.902728 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:43.903172 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:43.903971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:43.904410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:44.044882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:44.052280 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d171e34-440d-4e65-928e-33440db567e9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.160455 Nov 27 21:50:44.052829 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4379/8619] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:43 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:45.069403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:45.070054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:45.076904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:45.077369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:45.078860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:45.079388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:45.206836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:45.214158 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-5b558c44-81f1-4750-b7da-7a0e2b28c380 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.148630 Nov 27 21:50:45.214739 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4241/8620] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:45 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:50:46.230991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:46.231591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:46.238493 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:46.238949 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:46.239775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:46.240216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:46.370700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:46.378404 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-02b833e4-0237-4843-94cc-705461930b99 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.151298 Nov 27 21:50:46.379270 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4380/8621] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:46 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:47.395316 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:47.395926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:47.402627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:47.403090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:47.403918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:47.404370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:47.539719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:47.547801 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d635a166-aaf0-46b9-a2e2-c886ef0f9d9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.156352 Nov 27 21:50:47.548389 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4242/8622] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:47 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:47.929847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e69c5f88-6b4a-434c-91c3-b0f5a22fa9ea req-b9731581-232b-4a1e-9b16-f4c295d53dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99a4db6-835e-403c-9047-af75b1fdf7c6", "tag": "8aa65ade-7fba-49f6-9871-05b34ef63a7f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:50:47.932133 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:50:47.932133 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:50:47.944303 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e69c5f88-6b4a-434c-91c3-b0f5a22fa9ea req-b9731581-232b-4a1e-9b16-f4c295d53dcf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:47.944836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e69c5f88-6b4a-434c-91c3-b0f5a22fa9ea req-b9731581-232b-4a1e-9b16-f4c295d53dcf service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:47.961221 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e69c5f88-6b4a-434c-91c3-b0f5a22fa9ea req-b9731581-232b-4a1e-9b16-f4c295d53dcf service nova] Creating event network-changed:8aa65ade-7fba-49f6-9871-05b34ef63a7f for instance d99a4db6-835e-403c-9047-af75b1fdf7c6 on nch2-master-1 Nov 27 21:50:47.967136 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e69c5f88-6b4a-434c-91c3-b0f5a22fa9ea req-b9731581-232b-4a1e-9b16-f4c295d53dcf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133853 Nov 27 21:50:47.968454 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4381/8623] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:50:48.564534 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:48.565163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:48.572498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:48.572966 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:48.573770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:48.574223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:48.704167 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:48.711522 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d6fda6cb-1a67-4df6-bb57-e1b69229eb7c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.150772 Nov 27 21:50:48.712108 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4243/8624] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:48 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:49.730250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:49.730856 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:49.737630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:49.738077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:49.738841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:49.739290 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:49.873287 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:49.880806 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-605c5b5a-ae01-4b90-b13d-6b65a3f5c69c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.155568 Nov 27 21:50:49.881366 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4382/8625] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:49 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:50.897713 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:50.898329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:50.905169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:50.905643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:50.906474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:50.906931 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:51.037194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:51.044665 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3dcf6fd9-b836-4bed-80c7-e7d9bf9f2e71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.150740 Nov 27 21:50:51.045245 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4244/8626] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:50 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:52.034525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e8e6f2bf-7584-4b59-8415-07c10c0ad92e req-027f738b-fef0-40cd-8a87-c1fbfde6a318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99a4db6-835e-403c-9047-af75b1fdf7c6", "name": "network-vif-plugged", "status": "completed", "tag": "8aa65ade-7fba-49f6-9871-05b34ef63a7f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:50:52.036319 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:50:52.036319 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:50:52.043413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e8e6f2bf-7584-4b59-8415-07c10c0ad92e req-027f738b-fef0-40cd-8a87-c1fbfde6a318 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:52.043858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e8e6f2bf-7584-4b59-8415-07c10c0ad92e req-027f738b-fef0-40cd-8a87-c1fbfde6a318 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:52.055029 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e8e6f2bf-7584-4b59-8415-07c10c0ad92e req-027f738b-fef0-40cd-8a87-c1fbfde6a318 service nova] Creating event network-vif-plugged:8aa65ade-7fba-49f6-9871-05b34ef63a7f for instance d99a4db6-835e-403c-9047-af75b1fdf7c6 on nch2-master-1 Nov 27 21:50:52.060091 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e8e6f2bf-7584-4b59-8415-07c10c0ad92e req-027f738b-fef0-40cd-8a87-c1fbfde6a318 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084839 Nov 27 21:50:52.060799 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4383/8627] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:50:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:50:52.061995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:52.063225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:52.070153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:52.070520 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:52.071337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:52.071791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:52.213454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:52.221107 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7d20a8f-2247-4c71-8cc2-e55dc6327129 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.162841 Nov 27 21:50:52.221699 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4245/8628] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:52 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:50:53.239328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:53.240058 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:53.246332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:53.246784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:53.247678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:53.248113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:53.377837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:53.385354 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d8f11f2b-067c-4b02-9723-f384f3bc7f66 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1358 microversion: 2.1 time: 0.150970 Nov 27 21:50:53.385922 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4384/8629] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:53 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:54.402659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:54.403321 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:54.410811 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.411317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.412129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.412590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.541597 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:54.548980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-25696955-9070-44ff-aa52-cf4cc69b2e26 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1548 microversion: 2.1 time: 0.150118 Nov 27 21:50:54.549559 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4246/8630] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:54 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:54.564591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:54.565189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:54.573024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.573473 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.574256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.574693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.706030 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:54.713374 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ecdedcab-7775-4387-88f8-e20de1f955f9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1548 microversion: 2.1 time: 0.152452 Nov 27 21:50:54.714080 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4385/8631] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:54 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:54.729964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:54.733312 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:50:54.733312 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:50:54.734328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:54.735142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Searching by: {'deleted': False, 'project_id': '741fb423d7b24833be8f3d9d7d83294e'} {{(pid=135679) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 27 21:50:54.740443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.740915 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.741746 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.742211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.766089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.multi_cell_list [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 21:50:54.792166 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ffaa178f-3e65-4fb7-8e82-f830d4e9b23a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.065933 Nov 27 21:50:54.792756 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4247/8632] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 21:50:54 2021] GET /compute/v2.1/servers => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:50:54.802598 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:54.803212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:54.809010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.809463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.810253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:54.810680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:54.939656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:50:54.948040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ec349b89-6fb5-44bb-b6bf-9be82d7b3f84 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1548 microversion: 2.1 time: 0.149045 Nov 27 21:50:54.948831 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4386/8633] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:54 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:50:56.435058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-665c849f-dbdd-42d5-a897-4de7cfad6c6a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9207a48d-29e4-4cd6-820f-811f7049dcef"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:50:56.436260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-665c849f-dbdd-42d5-a897-4de7cfad6c6a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:56.442924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-665c849f-dbdd-42d5-a897-4de7cfad6c6a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:56.443467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-665c849f-dbdd-42d5-a897-4de7cfad6c6a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:56.444282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-665c849f-dbdd-42d5-a897-4de7cfad6c6a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:56.444750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-665c849f-dbdd-42d5-a897-4de7cfad6c6a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:56.667889 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-665c849f-dbdd-42d5-a897-4de7cfad6c6a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.236414 Nov 27 21:50:56.668507 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4248/8634] 10.222.0.21 () {60 vars in 1322 bytes} [Sat Nov 27 21:50:56 2021] POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments => generated 194 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:50:59.977593 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:50:59.978208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:50:59.985043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:59.985496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:50:59.986276 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:50:59.986717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:51:00.119388 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:51:00.127785 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9019cbb1-e79d-45d1-9e10-eaa45beb9ef9 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1594 microversion: 2.1 time: 0.153761 Nov 27 21:51:00.128361 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4387/8635] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:50:59 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:51:01.738823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-75a5db41-7e6f-4667-b96e-1ab57b948459 req-b76f3003-601f-40b4-a2e3-54605e5c3675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99a4db6-835e-403c-9047-af75b1fdf7c6", "tag": "8aa65ade-7fba-49f6-9871-05b34ef63a7f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:51:01.740403 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:51:01.740403 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:51:01.748891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-75a5db41-7e6f-4667-b96e-1ab57b948459 req-b76f3003-601f-40b4-a2e3-54605e5c3675 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:51:01.749517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-75a5db41-7e6f-4667-b96e-1ab57b948459 req-b76f3003-601f-40b4-a2e3-54605e5c3675 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:51:01.763869 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-75a5db41-7e6f-4667-b96e-1ab57b948459 req-b76f3003-601f-40b4-a2e3-54605e5c3675 service nova] Creating event network-changed:8aa65ade-7fba-49f6-9871-05b34ef63a7f for instance d99a4db6-835e-403c-9047-af75b1fdf7c6 on nch2-master-1 Nov 27 21:51:01.768776 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-75a5db41-7e6f-4667-b96e-1ab57b948459 req-b76f3003-601f-40b4-a2e3-54605e5c3675 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035378 Nov 27 21:51:01.769388 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4249/8636] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:51:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:51:02.846370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1018884706"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:51:02.846912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:51:02.853637 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:51:02.854089 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:51:02.855179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:51:02.855650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:51:02.995951 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.network.security_group_api [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Adding security group d5760e5d-b2f5-427a-afdd-00fe8b8d5367 to port 8aa65ade-7fba-49f6-9871-05b34ef63a7f Nov 27 21:51:03.345271 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b34865fc-1ac0-46d3-9ed4-884e2548ea9a tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/action" status: 202 len: 0 microversion: 2.1 time: 0.497537 Nov 27 21:51:03.345271 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4388/8637] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:51:02 2021] POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:51:03.350245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:51:03.351689 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:51:03.360804 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:51:03.362104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:51:03.363208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:51:03.364042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:51:03.535936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:51:03.544139 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da7dc6bd-d3ab-486b-a935-5c799e8cdbc0 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1759 microversion: 2.1 time: 0.198005 Nov 27 21:51:03.544814 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4250/8638] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:51:03 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:51:03.784697 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-3d7e34f1-d566-4656-adc7-78a7195c1d0f req-5c8bc281-5882-4878-8687-db65a15c9326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99a4db6-835e-403c-9047-af75b1fdf7c6", "tag": "8aa65ade-7fba-49f6-9871-05b34ef63a7f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:51:03.786458 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:51:03.786458 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:51:03.793784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3d7e34f1-d566-4656-adc7-78a7195c1d0f req-5c8bc281-5882-4878-8687-db65a15c9326 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:51:03.794373 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-3d7e34f1-d566-4656-adc7-78a7195c1d0f req-5c8bc281-5882-4878-8687-db65a15c9326 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:51:03.806255 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-3d7e34f1-d566-4656-adc7-78a7195c1d0f req-5c8bc281-5882-4878-8687-db65a15c9326 service nova] Creating event network-changed:8aa65ade-7fba-49f6-9871-05b34ef63a7f for instance d99a4db6-835e-403c-9047-af75b1fdf7c6 on nch2-master-1 Nov 27 21:51:03.811390 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-3d7e34f1-d566-4656-adc7-78a7195c1d0f req-5c8bc281-5882-4878-8687-db65a15c9326 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030896 Nov 27 21:51:03.811993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4389/8639] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:51:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:52:04.066667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c26519b7-d1c4-4264-a195-efdc85d97b8b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:52:04.067703 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c26519b7-d1c4-4264-a195-efdc85d97b8b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:04.073714 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26519b7-d1c4-4264-a195-efdc85d97b8b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:04.074188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26519b7-d1c4-4264-a195-efdc85d97b8b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:04.074990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26519b7-d1c4-4264-a195-efdc85d97b8b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:04.075522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c26519b7-d1c4-4264-a195-efdc85d97b8b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:04.152733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c26519b7-d1c4-4264-a195-efdc85d97b8b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/action" status: 202 len: 0 microversion: 2.1 time: 0.091178 Nov 27 21:52:04.153407 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4251/8640] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:52:04 2021] POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:52:04.163789 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:04.164491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:04.171452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:04.171967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:04.172751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:04.173188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:04.416231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:04.426672 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-46ceffd4-dee6-4135-bb57-e2546351476e tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1751 microversion: 2.1 time: 0.268623 Nov 27 21:52:04.439820 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4390/8641] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:04 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:05.447480 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:05.448220 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:05.455053 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:05.455548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:05.456336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:05.456785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:05.603470 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:05.612004 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-40b713c4-42a4-4581-8e1b-ba2b404fc581 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.169739 Nov 27 21:52:05.612575 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4252/8642] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:05 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:06.629997 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:06.630634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:06.637553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:06.637992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:06.638777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:06.639734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:06.781208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:06.789025 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-85b5d810-1c1c-4449-a3ca-5bcda6685e34 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.163005 Nov 27 21:52:06.789597 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4391/8643] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:06 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:07.805238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:07.805898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:07.812787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:07.813257 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:07.814086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:07.814541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:07.957085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:07.965083 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b981cfe0-da1e-4c1f-ac35-f0580f6dd945 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.163617 Nov 27 21:52:07.965656 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4253/8644] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:07 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:08.982326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:08.983463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:08.990070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:08.990520 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:08.991333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:08.991765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:09.140906 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:09.148741 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92358399-f2e4-4bfd-980b-74323051f940 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.170079 Nov 27 21:52:09.149306 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4392/8645] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:08 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:10.166263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:10.166910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:10.174164 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:10.175198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:10.176081 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:10.176532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:10.322587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:10.330477 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a23cbbac-3ec9-4d66-86ea-a92f727c18dc tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.167996 Nov 27 21:52:10.331047 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4254/8646] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:10 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:11.346942 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:11.347572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:11.354255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:11.354706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:11.355639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:11.356081 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:11.499411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:11.507470 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-81557dbf-6792-46b6-b70e-b5c23860df71 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.164245 Nov 27 21:52:11.508054 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4393/8647] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:11 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:12.525055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:12.525673 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:12.532495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:12.532963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:12.533760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:12.534215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:12.676522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:12.684449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-89dd9ba4-68be-452b-8d5b-40e6a75d1546 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.163165 Nov 27 21:52:12.685028 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4255/8648] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:12 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:13.703316 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:13.703917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:13.710519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:13.711488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:13.712274 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:13.712713 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:13.853770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:13.862045 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c548da3c-3c0d-483d-a3ba-82546ea22037 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.163798 Nov 27 21:52:13.862609 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4394/8649] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:13 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:14.879194 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:14.879849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:14.886644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:14.887112 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:14.887938 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:14.888396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:15.038614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:15.047007 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6a1fa501-63c0-4647-9a64-44ea42eed705 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.171813 Nov 27 21:52:15.047603 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4256/8650] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:14 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:16.063687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:16.064296 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:16.070951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:16.071451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:16.072229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:16.072667 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:16.220638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:16.228662 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6da124c4-c005-4181-82b9-e37241ae3717 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.168710 Nov 27 21:52:16.229252 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4395/8651] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:16 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:17.245669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:17.246230 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:17.253023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:17.253748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:17.254548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:17.255013 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:17.403079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:17.411777 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da29b020-d9b4-4fbf-a9e6-918c69c81c2d tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.169894 Nov 27 21:52:17.412368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4257/8652] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:17 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:18.429222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:18.429844 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:18.436653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:18.437106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:18.437893 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:18.438333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:18.585242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:18.593706 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d256a2e-4884-4b9d-a1d2-58b2426b889f tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.168222 Nov 27 21:52:18.594269 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4396/8653] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:18 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:19.609769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:19.610408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:19.617240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:19.617712 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:19.618516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:19.618974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:19.763615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:19.772068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b2f005eb-9e85-45f0-b425-bfd418a0b46c tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1756 microversion: 2.1 time: 0.166069 Nov 27 21:52:19.772652 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4258/8654] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:19 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:52:20.789038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:52:20.789657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:52:20.796521 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:20.796976 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:20.797763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:52:20.798207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:52:20.943529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:52:20.951593 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43b4fa39-48e3-4442-a6d6-d5ec9cef29a1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1759 microversion: 2.1 time: 0.166261 Nov 27 21:52:20.952876 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4397/8655] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:52:20 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:16.282469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1018884706"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:16.283105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:16.289038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:16.289504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:16.290290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:16.290740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:16.421891 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.network.security_group_api [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Removing security group d5760e5d-b2f5-427a-afdd-00fe8b8d5367 from port 8aa65ade-7fba-49f6-9871-05b34ef63a7f Nov 27 21:53:16.760892 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-de51a28d-365c-46e5-a749-f9a4953a774b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/action" status: 202 len: 0 microversion: 2.1 time: 0.483168 Nov 27 21:53:16.762228 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4259/8656] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:53:16 2021] POST /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:53:16.867518 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-38b535df-6222-478e-9ab2-439696e1f76a req-12335ce0-03e9-444e-a8e8-c69fa5f79e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99a4db6-835e-403c-9047-af75b1fdf7c6", "tag": "8aa65ade-7fba-49f6-9871-05b34ef63a7f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:16.869925 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:53:16.869925 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:53:16.877739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-38b535df-6222-478e-9ab2-439696e1f76a req-12335ce0-03e9-444e-a8e8-c69fa5f79e4e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:16.878969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-38b535df-6222-478e-9ab2-439696e1f76a req-12335ce0-03e9-444e-a8e8-c69fa5f79e4e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:16.894113 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-38b535df-6222-478e-9ab2-439696e1f76a req-12335ce0-03e9-444e-a8e8-c69fa5f79e4e service nova] Creating event network-changed:8aa65ade-7fba-49f6-9871-05b34ef63a7f for instance d99a4db6-835e-403c-9047-af75b1fdf7c6 on nch2-master-1 Nov 27 21:53:16.902967 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-38b535df-6222-478e-9ab2-439696e1f76a req-12335ce0-03e9-444e-a8e8-c69fa5f79e4e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131875 Nov 27 21:53:16.903934 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4398/8657] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:53:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:53:17.931051 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:17.931669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:17.938662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:17.939137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:17.939982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:17.940443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:18.020172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lazy-loading 'services' on Instance uuid d99a4db6-835e-403c-9047-af75b1fdf7c6 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:53:18.089681 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-13daa70a-0d96-49dd-be52-0ebb17724747 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments/9207a48d-29e4-4cd6-820f-811f7049dcef" status: 202 len: 0 microversion: 2.1 time: 0.163345 Nov 27 21:53:18.090302 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4260/8658] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:53:17 2021] DELETE /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments/9207a48d-29e4-4cd6-820f-811f7049dcef => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:53:18.099338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-291276e7-3c55-42f9-a7dd-7f9392497b6b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:18.101191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-291276e7-3c55-42f9-a7dd-7f9392497b6b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:18.109191 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-291276e7-3c55-42f9-a7dd-7f9392497b6b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:18.109628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-291276e7-3c55-42f9-a7dd-7f9392497b6b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:18.110428 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-291276e7-3c55-42f9-a7dd-7f9392497b6b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:18.111086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-291276e7-3c55-42f9-a7dd-7f9392497b6b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:18.142587 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-291276e7-3c55-42f9-a7dd-7f9392497b6b tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Nov 27 21:53:18.143521 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4399/8659] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:53:18 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:53:18.919221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-d0b48b85-242c-44c1-a838-e47c85d597fd req-95c2321a-8729-405e-8dda-c46d830268c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99a4db6-835e-403c-9047-af75b1fdf7c6", "tag": "8aa65ade-7fba-49f6-9871-05b34ef63a7f"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:18.920934 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:53:18.920934 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:53:18.929977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d0b48b85-242c-44c1-a838-e47c85d597fd req-95c2321a-8729-405e-8dda-c46d830268c9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:18.930443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-d0b48b85-242c-44c1-a838-e47c85d597fd req-95c2321a-8729-405e-8dda-c46d830268c9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:18.941833 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-d0b48b85-242c-44c1-a838-e47c85d597fd req-95c2321a-8729-405e-8dda-c46d830268c9 service nova] Creating event network-changed:8aa65ade-7fba-49f6-9871-05b34ef63a7f for instance d99a4db6-835e-403c-9047-af75b1fdf7c6 on nch2-master-1 Nov 27 21:53:18.947056 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-d0b48b85-242c-44c1-a838-e47c85d597fd req-95c2321a-8729-405e-8dda-c46d830268c9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032121 Nov 27 21:53:18.947950 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4261/8660] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:53:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:53:19.154104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6d1df3df-8752-4701-8cd5-b0a98091f2e1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:19.155181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6d1df3df-8752-4701-8cd5-b0a98091f2e1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:19.162434 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1df3df-8752-4701-8cd5-b0a98091f2e1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:19.162894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1df3df-8752-4701-8cd5-b0a98091f2e1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:19.163712 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1df3df-8752-4701-8cd5-b0a98091f2e1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:19.164162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6d1df3df-8752-4701-8cd5-b0a98091f2e1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:19.192032 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6d1df3df-8752-4701-8cd5-b0a98091f2e1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041787 Nov 27 21:53:19.192619 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4400/8661] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:53:19 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 21:53:19.203418 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:19.204015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:19.210190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:19.210660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:19.211485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:19.211940 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:19.290080 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] HTTP exception thrown: Instance d99a4db6-835e-403c-9047-af75b1fdf7c6 is not attached to volume 9207a48d-29e4-4cd6-820f-811f7049dcef Nov 27 21:53:19.290774 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Returning 404 to user: Instance d99a4db6-835e-403c-9047-af75b1fdf7c6 is not attached to volume 9207a48d-29e4-4cd6-820f-811f7049dcef {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:53:19.291735 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dcc5658e-0109-4010-abf1-df15909fc6f4 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments/9207a48d-29e4-4cd6-820f-811f7049dcef" status: 404 len: 154 microversion: 2.1 time: 0.093122 Nov 27 21:53:19.292406 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4262/8662] 10.222.0.21 () {58 vars in 1415 bytes} [Sat Nov 27 21:53:19 2021] DELETE /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6/os-volume_attachments/9207a48d-29e4-4cd6-820f-811f7049dcef => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:53:20.428775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:20.429347 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:20.436070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:20.436522 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:20.437304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:20.437743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:20.462374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:53:20.536374 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f8d7322-2357-4e50-bf05-3fb2695142bd tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 204 len: 0 microversion: 2.1 time: 0.112392 Nov 27 21:53:20.537014 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4401/8663] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:53:20 2021] DELETE /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 21:53:20.545121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:20.545749 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:20.553996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:20.554469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:20.555282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:20.555744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:20.685410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:20.692857 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1666ac31-6ab8-4389-921b-427b10c59891 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1554 microversion: 2.1 time: 0.151385 Nov 27 21:53:20.693423 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4263/8664] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:20 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:21.711969 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:21.712636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:21.719858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:21.720319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:21.721187 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:21.721665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:21.862398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:21.869777 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb3fb922-e590-4b83-96fe-2309c9b24b40 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1554 microversion: 2.1 time: 0.162095 Nov 27 21:53:21.870347 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4402/8665] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:21 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:22.887119 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:22.887848 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:22.894587 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:22.895198 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:22.896190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:22.896635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:22.957603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ceebd10d-9306-4edc-a4f0-7c8eaab79957 req-ce8c977a-8965-4e54-8509-ba4f8777bfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99a4db6-835e-403c-9047-af75b1fdf7c6", "name": "network-vif-deleted", "tag": "8aa65ade-7fba-49f6-9871-05b34ef63a7f"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:22.959628 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:53:22.959628 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:53:22.961681 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32b19324e154c7fb5e29e374753ba7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741fb423d7b24833be8f3d9d7d83294e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:22.968735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ceebd10d-9306-4edc-a4f0-7c8eaab79957 req-ce8c977a-8965-4e54-8509-ba4f8777bfff service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:22.969180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ceebd10d-9306-4edc-a4f0-7c8eaab79957 req-ce8c977a-8965-4e54-8509-ba4f8777bfff service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:22.970228 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-310fa9a7-d579-4067-91f1-1d2d8603ecd7 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 200 len: 1512 microversion: 2.1 time: 0.087167 Nov 27 21:53:22.970823 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4264/8666] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:22 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 1512 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:22.980686 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ceebd10d-9306-4edc-a4f0-7c8eaab79957 req-ce8c977a-8965-4e54-8509-ba4f8777bfff service nova] Creating event network-vif-deleted:8aa65ade-7fba-49f6-9871-05b34ef63a7f for instance d99a4db6-835e-403c-9047-af75b1fdf7c6 on nch2-master-1 Nov 27 21:53:22.986378 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ceebd10d-9306-4edc-a4f0-7c8eaab79957 req-ce8c977a-8965-4e54-8509-ba4f8777bfff service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032749 Nov 27 21:53:22.987032 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4403/8667] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:53:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:53:23.987524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:23.988153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] [instance: d99a4db6-835e-403c-9047-af75b1fdf7c6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:23.994840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:23.995331 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:23.996124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:23.996589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:24.010715 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] HTTP exception thrown: Instance d99a4db6-835e-403c-9047-af75b1fdf7c6 could not be found. Nov 27 21:53:24.011348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Returning 404 to user: Instance d99a4db6-835e-403c-9047-af75b1fdf7c6 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:53:24.012181 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-caeda3b2-776d-412c-a9d6-be20f5178814 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6" status: 404 len: 111 microversion: 2.1 time: 0.028567 Nov 27 21:53:24.012720 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4265/8668] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:23 2021] GET /compute/v2.1/servers/d99a4db6-835e-403c-9047-af75b1fdf7c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:53:24.022766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-186d2a57-3177-4fea-af06-ee896aae1bc1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] Calling method '.version_select at 0x7f15d94e49d0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:24.045368 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-186d2a57-3177-4fea-af06-ee896aae1bc1 tempest-TestMinimumBasicScenario-1311005881 tempest-TestMinimumBasicScenario-1311005881-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-939911263" status: 202 len: 0 microversion: 2.1 time: 0.027395 Nov 27 21:53:24.045940 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4404/8669] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:53:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-939911263 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:53:33.190070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-8ce338b9-3520-4f34-aef5-e55424535269 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: .version_select at 0x7f15c6b02e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-306581529"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:33.203652 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8ce338b9-3520-4f34-aef5-e55424535269 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:53:33.209412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8ce338b9-3520-4f34-aef5-e55424535269 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:53:33.411690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8ce338b9-3520-4f34-aef5-e55424535269 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:53:33.416500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-8ce338b9-3520-4f34-aef5-e55424535269 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:53:33.431006 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-8ce338b9-3520-4f34-aef5-e55424535269 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.395650 Nov 27 21:53:33.431568 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4266/8670] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:53:33 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:39.058565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1996192582", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "768e2a9c-bb75-4004-a637-c0def13f5596"}], "key_name": "tempest-TestNetworkAdvancedServerOps-306581529", "security_groups": [{"name": "tempest-secgroup-smoke-430493402"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:39.169675 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] validate_networks() for [('768e2a9c-bb75-4004-a637-c0def13f5596', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:53:39.577858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:53:39.578558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:53:39.579040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:53:39.579771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:53:39.580318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:53:39.594009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:39.594803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:39.596011 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:39.596657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:39.614551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:53:39.621345 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:53:39.634545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:53:39.636776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:53:39.687790 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [1d9f363e-327d-4ca2-8bd9-e4b8d5e39839] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 21:53:40.705755 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [1d9f363e-327d-4ca2-8bd9-e4b8d5e39839] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 46606. Nov 27 21:53:40.711235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ad72a246-5ac2-48dd-a3f2-8089f4ed2d2f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.657255 Nov 27 21:53:40.711979 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4405/8671] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:53:39 2021] POST /compute/v2.1/servers => generated 405 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:53:40.727656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fa08291f-76ef-433b-a823-86121b0982c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:40.730670 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fa08291f-76ef-433b-a823-86121b0982c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:40.792189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fa08291f-76ef-433b-a823-86121b0982c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:40.802120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fa08291f-76ef-433b-a823-86121b0982c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1266 microversion: 2.1 time: 0.083318 Nov 27 21:53:40.812755 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4267/8672] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:40 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:41.822040 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:41.822904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:41.831138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:41.831659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:41.832607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:41.833050 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:41.919134 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:41.928230 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f298eb23-520f-4693-9371-61f100567d37 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1336 microversion: 2.1 time: 0.110798 Nov 27 21:53:41.928744 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4406/8673] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:41 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:42.946265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:42.946898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:42.955281 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:42.955884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:42.956733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:42.957185 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:43.126498 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:43.136449 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-da441907-6b28-4225-ba0f-39015edfb806 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.194262 Nov 27 21:53:43.146293 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4268/8674] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:42 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:43.225489 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2780de8c-4617-4bef-abf2-0c7c380bdd63 req-bbc35668-aa3f-481c-98bd-c9269fbb2937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d19c-1f0d-4f06-83cc-4ed618bc3f79", "tag": "2a33a9cd-95ae-4466-ab25-1d65f9577c3d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:43.226667 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:53:43.226667 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:53:43.237326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2780de8c-4617-4bef-abf2-0c7c380bdd63 req-bbc35668-aa3f-481c-98bd-c9269fbb2937 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:43.238074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2780de8c-4617-4bef-abf2-0c7c380bdd63 req-bbc35668-aa3f-481c-98bd-c9269fbb2937 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:43.251820 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2780de8c-4617-4bef-abf2-0c7c380bdd63 req-bbc35668-aa3f-481c-98bd-c9269fbb2937 service nova] Creating event network-changed:2a33a9cd-95ae-4466-ab25-1d65f9577c3d for instance b257d19c-1f0d-4f06-83cc-4ed618bc3f79 on nch2-master-1 Nov 27 21:53:43.258055 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2780de8c-4617-4bef-abf2-0c7c380bdd63 req-bbc35668-aa3f-481c-98bd-c9269fbb2937 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036607 Nov 27 21:53:43.258947 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4407/8675] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:53:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:53:44.153829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:44.155295 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:44.162291 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:44.162760 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:44.163720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:44.164175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:44.302271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:44.310395 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b465616b-0555-4f3f-acf9-50b0dda953b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.160494 Nov 27 21:53:44.311542 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4269/8676] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:44 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:45.329762 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:45.330466 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:45.336656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:45.337117 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:45.337904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:45.338349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:45.473836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:45.481086 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a127f7fc-2e0c-4c47-998f-c6ac5e83f9f2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.156785 Nov 27 21:53:45.481652 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4408/8677] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:45 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:46.497937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:46.498570 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:46.505607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:46.506069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:46.506864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:46.507394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:46.643215 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:46.650714 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-df2260ee-345b-47a8-a011-2990386efd86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.156551 Nov 27 21:53:46.651301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4270/8678] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:46 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:47.668155 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:47.668714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:47.675956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:47.676411 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:47.677185 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:47.677625 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:47.817076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:47.824431 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-70bb0e05-1d97-41f1-b747-6329d9947749 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.160146 Nov 27 21:53:47.824998 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4409/8679] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:47 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:48.840876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:48.841517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:48.848381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:48.848852 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:48.849653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:48.850110 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:48.982805 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:48.990257 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f0b9d565-72bb-4829-ad0e-fa523cad092b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.153209 Nov 27 21:53:48.990829 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4271/8680] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:48 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:49.633692 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:53:49.633916 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:53:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:53:50.006836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:50.007475 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:50.014686 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:50.015139 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:50.015946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:50.016390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:50.153209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:50.161273 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-82235e2d-32c5-4598-b742-30f8056a61ab tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.158401 Nov 27 21:53:50.161856 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4410/8681] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:50 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:50.803945 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4403e7e7-f6ad-4f2d-9720-7a8150187a9b req-19af0e82-4b01-4977-b889-57fb4e85ff83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b257d19c-1f0d-4f06-83cc-4ed618bc3f79", "name": "network-vif-plugged", "status": "completed", "tag": "2a33a9cd-95ae-4466-ab25-1d65f9577c3d"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:50.805509 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:53:50.805509 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:53:50.815348 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4403e7e7-f6ad-4f2d-9720-7a8150187a9b req-19af0e82-4b01-4977-b889-57fb4e85ff83 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:50.815876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4403e7e7-f6ad-4f2d-9720-7a8150187a9b req-19af0e82-4b01-4977-b889-57fb4e85ff83 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:50.827644 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4403e7e7-f6ad-4f2d-9720-7a8150187a9b req-19af0e82-4b01-4977-b889-57fb4e85ff83 service nova] Creating event network-vif-plugged:2a33a9cd-95ae-4466-ab25-1d65f9577c3d for instance b257d19c-1f0d-4f06-83cc-4ed618bc3f79 on nch2-master-1 Nov 27 21:53:50.833175 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4403e7e7-f6ad-4f2d-9720-7a8150187a9b req-19af0e82-4b01-4977-b889-57fb4e85ff83 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032848 Nov 27 21:53:50.833785 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4272/8682] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:53:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:53:51.177854 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:51.178445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:51.184798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:51.185244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:51.186023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:51.186459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:51.318378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:51.325694 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-35e9ee81-2cac-4e6b-a489-b18fc1761a39 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1391 microversion: 2.1 time: 0.151660 Nov 27 21:53:51.326757 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4411/8683] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:51 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:52.343499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:52.344209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:52.350337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:52.350801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:52.351632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:52.352080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:52.488350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:52.495730 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02cbf940-bb29-43ab-adb4-d30ca6939eac tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1562 microversion: 2.1 time: 0.157191 Nov 27 21:53:52.496303 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4273/8684] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:52 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:52.511586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:52.512189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:52.518901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:52.519381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:52.520297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:52.520741 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:52.650591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:52.658398 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5cc6cac3-27bb-4a08-ab64-e8e8802c0c32 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1562 microversion: 2.1 time: 0.150471 Nov 27 21:53:52.659030 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4412/8685] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:52 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:53:54.235439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:53:54.236124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:53:54.237975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-4810d1b7-b2e5-4cc0-a0af-3b2fee6fedc0 req-945d3dfc-6959-4bd1-af49-a02a0077fe02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d19c-1f0d-4f06-83cc-4ed618bc3f79", "tag": "2a33a9cd-95ae-4466-ab25-1d65f9577c3d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:53:54.239576 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:53:54.239576 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:53:54.243344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:54.244094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:54.244903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:54.245648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:54.246946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4810d1b7-b2e5-4cc0-a0af-3b2fee6fedc0 req-945d3dfc-6959-4bd1-af49-a02a0077fe02 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:53:54.247453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-4810d1b7-b2e5-4cc0-a0af-3b2fee6fedc0 req-945d3dfc-6959-4bd1-af49-a02a0077fe02 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:53:54.258735 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-4810d1b7-b2e5-4cc0-a0af-3b2fee6fedc0 req-945d3dfc-6959-4bd1-af49-a02a0077fe02 service nova] Creating event network-changed:2a33a9cd-95ae-4466-ab25-1d65f9577c3d for instance b257d19c-1f0d-4f06-83cc-4ed618bc3f79 on nch2-master-1 Nov 27 21:53:54.263966 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-4810d1b7-b2e5-4cc0-a0af-3b2fee6fedc0 req-945d3dfc-6959-4bd1-af49-a02a0077fe02 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029651 Nov 27 21:53:54.265163 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4413/8686] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:53:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:53:54.389807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:53:54.398071 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-910e000d-911c-4924-abbe-731078b4f2dc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1562 microversion: 2.1 time: 0.167051 Nov 27 21:53:54.398938 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4274/8687] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:53:54 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:54:27.687958 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a61edbb2-cc61-45e3-9c0e-8091d8bfb249 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:54:27.688975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a61edbb2-cc61-45e3-9c0e-8091d8bfb249 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:54:27.695456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a61edbb2-cc61-45e3-9c0e-8091d8bfb249 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:27.695921 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a61edbb2-cc61-45e3-9c0e-8091d8bfb249 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:27.696756 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a61edbb2-cc61-45e3-9c0e-8091d8bfb249 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:27.697153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a61edbb2-cc61-45e3-9c0e-8091d8bfb249 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:27.759721 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a61edbb2-cc61-45e3-9c0e-8091d8bfb249 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action" status: 200 len: 24572 microversion: 2.1 time: 0.075889 Nov 27 21:54:27.760383 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4414/8688] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:54:27 2021] POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:54:58.238582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-22caef24-b74d-40d9-a937-2a83afd382ba tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:54:58.239142 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-22caef24-b74d-40d9-a937-2a83afd382ba tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:54:58.246073 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22caef24-b74d-40d9-a937-2a83afd382ba tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:58.246547 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22caef24-b74d-40d9-a937-2a83afd382ba tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:58.247366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22caef24-b74d-40d9-a937-2a83afd382ba tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:58.247830 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-22caef24-b74d-40d9-a937-2a83afd382ba tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:58.315469 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-22caef24-b74d-40d9-a937-2a83afd382ba tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action" status: 202 len: 0 microversion: 2.1 time: 0.082122 Nov 27 21:54:58.316577 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4275/8689] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:54:58 2021] POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:54:58.324766 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:54:58.325497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:54:58.334035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:58.334496 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:58.335318 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:58.335767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:58.472113 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:54:58.480274 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb28a68a-2137-4faa-a424-1983bcd9e21a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1686 microversion: 2.1 time: 0.159765 Nov 27 21:54:58.480832 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4415/8690] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:54:58 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:54:59.499981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:54:59.500718 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:54:59.507823 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:59.508293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:59.509086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:54:59.509541 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:54:59.643283 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:54:59.650644 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd194d8a-8268-4694-81cf-17144a9bc574 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1666 microversion: 2.1 time: 0.155867 Nov 27 21:54:59.651225 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4276/8691] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:54:59 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:00.741682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-adee2e9d-9029-4f67-a9b9-23c3fc9f8492 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:00.742674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-adee2e9d-9029-4f67-a9b9-23c3fc9f8492 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:00.750628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adee2e9d-9029-4f67-a9b9-23c3fc9f8492 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:00.751088 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adee2e9d-9029-4f67-a9b9-23c3fc9f8492 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:00.752408 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adee2e9d-9029-4f67-a9b9-23c3fc9f8492 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:00.753120 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-adee2e9d-9029-4f67-a9b9-23c3fc9f8492 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:00.805112 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-adee2e9d-9029-4f67-a9b9-23c3fc9f8492 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action" status: 200 len: 32644 microversion: 2.1 time: 0.067113 Nov 27 21:55:00.806941 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4416/8692] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:55:00 2021] POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:55:00.817310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e4da765f-4fe0-49aa-815e-6d19ae3cf2d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:00.817869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e4da765f-4fe0-49aa-815e-6d19ae3cf2d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:00.825693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4da765f-4fe0-49aa-815e-6d19ae3cf2d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:00.826161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4da765f-4fe0-49aa-815e-6d19ae3cf2d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:00.826950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4da765f-4fe0-49aa-815e-6d19ae3cf2d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:00.827439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e4da765f-4fe0-49aa-815e-6d19ae3cf2d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:00.894302 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e4da765f-4fe0-49aa-815e-6d19ae3cf2d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action" status: 202 len: 0 microversion: 2.1 time: 0.080973 Nov 27 21:55:00.895082 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4277/8693] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:55:00 2021] POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:55:00.903842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:00.904551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:00.912218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:00.912668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:00.913482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:00.913901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:01.073249 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:01.084082 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7c58bf75-9f26-4142-a3a1-ae34277d3f77 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1673 microversion: 2.1 time: 0.184365 Nov 27 21:55:01.085016 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4417/8694] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:00 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:55:02.103296 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:02.104015 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:02.110315 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:02.110781 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:02.111682 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:02.112171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:02.242854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:02.250193 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a2188b9f-4959-41b4-9cdd-60a756a13a5c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1681 microversion: 2.1 time: 0.151922 Nov 27 21:55:02.250769 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4278/8695] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:02 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:02.345616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f741a165-49fd-4617-9f85-597a85b24b70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:02.346471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f741a165-49fd-4617-9f85-597a85b24b70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:02.353910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f741a165-49fd-4617-9f85-597a85b24b70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:02.354371 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f741a165-49fd-4617-9f85-597a85b24b70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:02.355157 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f741a165-49fd-4617-9f85-597a85b24b70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:02.355654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f741a165-49fd-4617-9f85-597a85b24b70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:02.403626 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f741a165-49fd-4617-9f85-597a85b24b70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action" status: 200 len: 37513 microversion: 2.1 time: 0.061743 Nov 27 21:55:02.404243 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4418/8696] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:55:02 2021] POST /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79/action => generated 37513 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:55:03.738516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:03.739161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:03.741929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-916ff8f3-5a49-4819-bed0-48a8420d1c0c req-6ec5d244-b0f5-440c-a8e1-69074ebd9c46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d19c-1f0d-4f06-83cc-4ed618bc3f79", "tag": "2a33a9cd-95ae-4466-ab25-1d65f9577c3d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:03.744104 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:55:03.744104 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:55:03.746665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:03.747213 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:03.748132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:03.748667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:03.753207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-916ff8f3-5a49-4819-bed0-48a8420d1c0c req-6ec5d244-b0f5-440c-a8e1-69074ebd9c46 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:03.753656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-916ff8f3-5a49-4819-bed0-48a8420d1c0c req-6ec5d244-b0f5-440c-a8e1-69074ebd9c46 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:03.765581 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-916ff8f3-5a49-4819-bed0-48a8420d1c0c req-6ec5d244-b0f5-440c-a8e1-69074ebd9c46 service nova] Creating event network-changed:2a33a9cd-95ae-4466-ab25-1d65f9577c3d for instance b257d19c-1f0d-4f06-83cc-4ed618bc3f79 on nch2-master-1 Nov 27 21:55:03.771460 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-916ff8f3-5a49-4819-bed0-48a8420d1c0c req-6ec5d244-b0f5-440c-a8e1-69074ebd9c46 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033415 Nov 27 21:55:03.772058 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4419/8697] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:55:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:55:03.784140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:55:03.877515 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-846d9944-22b8-40f2-870f-3838888222ff tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 204 len: 0 microversion: 2.1 time: 0.142532 Nov 27 21:55:03.879557 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4279/8698] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:55:03 2021] DELETE /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:55:03.888918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:03.889707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:03.897258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:03.897796 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:03.898678 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:03.899193 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:04.122501 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:04.131085 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-107119da-64c9-461d-b6ce-b29eec24127f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1687 microversion: 2.1 time: 0.246897 Nov 27 21:55:04.131906 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4420/8699] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:03 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1687 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:55:05.149698 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:05.150413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:05.157203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:05.157770 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:05.158574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:05.159031 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:05.291916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:05.299230 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-841dada7-f37a-41a2-8c9a-746792f55109 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1568 microversion: 2.1 time: 0.153885 Nov 27 21:55:05.299818 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4280/8700] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:05 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:06.014951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d052dc6b-5b9c-4510-9305-31bc56091891 req-334d8ca9-b2a2-4756-be36-7e38510d7822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b257d19c-1f0d-4f06-83cc-4ed618bc3f79", "name": "network-vif-deleted", "tag": "2a33a9cd-95ae-4466-ab25-1d65f9577c3d"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:06.016488 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:55:06.016488 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:55:06.024910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d052dc6b-5b9c-4510-9305-31bc56091891 req-334d8ca9-b2a2-4756-be36-7e38510d7822 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:06.025359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d052dc6b-5b9c-4510-9305-31bc56091891 req-334d8ca9-b2a2-4756-be36-7e38510d7822 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:06.037648 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d052dc6b-5b9c-4510-9305-31bc56091891 req-334d8ca9-b2a2-4756-be36-7e38510d7822 service nova] Creating event network-vif-deleted:2a33a9cd-95ae-4466-ab25-1d65f9577c3d for instance b257d19c-1f0d-4f06-83cc-4ed618bc3f79 on nch2-master-1 Nov 27 21:55:06.042858 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d052dc6b-5b9c-4510-9305-31bc56091891 req-334d8ca9-b2a2-4756-be36-7e38510d7822 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031460 Nov 27 21:55:06.043507 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4421/8701] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:55:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:55:06.316462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:06.317011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:06.324369 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:06.324831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:06.332708 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:06.333254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:06.369466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:06.369939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:06.370410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lazy-loading 'fault' on Instance uuid b257d19c-1f0d-4f06-83cc-4ed618bc3f79 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:55:06.414279 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:06.423289 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ae4938ee-c7f6-4e69-921a-55f9bbd07869 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 200 len: 1356 microversion: 2.1 time: 0.110122 Nov 27 21:55:06.423890 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4281/8702] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:06 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:07.442098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:07.442805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: b257d19c-1f0d-4f06-83cc-4ed618bc3f79] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:07.449118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:07.449579 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:07.450378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:07.450826 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:07.463981 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] HTTP exception thrown: Instance b257d19c-1f0d-4f06-83cc-4ed618bc3f79 could not be found. Nov 27 21:55:07.464567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Returning 404 to user: Instance b257d19c-1f0d-4f06-83cc-4ed618bc3f79 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:55:07.465428 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ed49bb71-5a11-4b37-9a8b-611e7db3107f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79" status: 404 len: 111 microversion: 2.1 time: 0.028324 Nov 27 21:55:07.465993 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4422/8703] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:07 2021] GET /compute/v2.1/servers/b257d19c-1f0d-4f06-83cc-4ed618bc3f79 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:55:10.814605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-840231b9-355f-4a4f-858a-d40f63b12862 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '.version_select at 0x7f15c7f53b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:10.839007 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-840231b9-355f-4a4f-858a-d40f63b12862 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-306581529" status: 202 len: 0 microversion: 2.1 time: 0.029693 Nov 27 21:55:10.839738 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4282/8704] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 21:55:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-306581529 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:55:10.864116 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f1b5595b-e9d1-4b8d-a78d-174fa9880ac3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: .version_select at 0x7f15c6e1de50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-449222368"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:10.879652 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f1b5595b-e9d1-4b8d-a78d-174fa9880ac3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:55:10.884631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f1b5595b-e9d1-4b8d-a78d-174fa9880ac3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:55:10.985209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f1b5595b-e9d1-4b8d-a78d-174fa9880ac3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:55:10.990025 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-f1b5595b-e9d1-4b8d-a78d-174fa9880ac3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:55:11.004690 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f1b5595b-e9d1-4b8d-a78d-174fa9880ac3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.144278 Nov 27 21:55:11.005382 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4423/8705] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:55:10 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:16.332447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1633895838", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "f76c6bf2-2d4e-4f50-ac4d-c516a8eb4313"}], "key_name": "tempest-TestNetworkAdvancedServerOps-449222368", "security_groups": [{"name": "tempest-secgroup-smoke-1527392686"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:16.475800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] validate_networks() for [('f76c6bf2-2d4e-4f50-ac4d-c516a8eb4313', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:55:16.948165 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:55:16.948693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:55:16.949238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:55:16.949866 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:55:16.950314 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:55:16.960340 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:16.961217 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:16.961660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:16.962120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:16.979400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:55:16.984715 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:55:16.997232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:55:16.999675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:55:17.075650 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d08f5dd6-69bb-4a0b-ba99-0bdf95a19c33 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747534 Nov 27 21:55:17.077055 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4283/8706] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:55:16 2021] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:55:17.089818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6deeb586-462a-4282-b292-fdfaed79b8d7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:17.097127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6deeb586-462a-4282-b292-fdfaed79b8d7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:17.177009 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6deeb586-462a-4282-b292-fdfaed79b8d7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:17.186185 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6deeb586-462a-4282-b292-fdfaed79b8d7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1266 microversion: 2.1 time: 0.101010 Nov 27 21:55:17.187375 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4424/8707] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:17 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:18.206912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:18.208511 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:18.218268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:18.219187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:18.220838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:18.221317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:18.340802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:18.350016 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f2e6b7e0-bff3-48da-80eb-43f364142e70 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1326 microversion: 2.1 time: 0.149844 Nov 27 21:55:18.352640 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4284/8708] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:18 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:19.368096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:19.369032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:19.378453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:19.379041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:19.380140 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:19.380590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:19.618386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:19.626445 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-24c9b80a-7c81-4940-b410-debb0e8ca41a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.261946 Nov 27 21:55:19.627378 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4425/8709] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:19 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:19.984011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-903fd7f0-81a0-47da-b6bd-617fca4c0b59 req-2af0e944-5197-4ea5-9237-3eec9a49964b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e696595-bdd6-4963-a15b-8e4cfc31be41", "tag": "72e05286-f238-47c8-8844-60e25612a094"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:19.987073 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:55:19.987073 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:55:19.997540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-903fd7f0-81a0-47da-b6bd-617fca4c0b59 req-2af0e944-5197-4ea5-9237-3eec9a49964b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:19.998322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-903fd7f0-81a0-47da-b6bd-617fca4c0b59 req-2af0e944-5197-4ea5-9237-3eec9a49964b service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:20.013278 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-903fd7f0-81a0-47da-b6bd-617fca4c0b59 req-2af0e944-5197-4ea5-9237-3eec9a49964b service nova] Creating event network-changed:72e05286-f238-47c8-8844-60e25612a094 for instance 3e696595-bdd6-4963-a15b-8e4cfc31be41 on nch2-master-1 Nov 27 21:55:20.022012 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-903fd7f0-81a0-47da-b6bd-617fca4c0b59 req-2af0e944-5197-4ea5-9237-3eec9a49964b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042548 Nov 27 21:55:20.022493 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4285/8710] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:55:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:55:20.644416 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:20.645123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:20.652085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:20.652539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:20.653327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:20.653767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:20.840913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:20.848258 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d13a1fd8-9188-4b4e-819a-09341e10cde7 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.208191 Nov 27 21:55:20.848837 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4426/8711] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:20 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:21.867054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:21.867786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:21.874146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:21.874611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:21.875448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:21.875908 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:22.009969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:22.018412 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61076586-cac2-43ea-9311-b1603aebab3a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.156930 Nov 27 21:55:22.019068 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4286/8712] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:21 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:23.035059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:23.035709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:23.042529 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:23.042959 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:23.044020 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:23.044458 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:23.178268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:23.185577 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ada14827-ef3f-47dc-9ed7-d15b8baad867 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.154231 Nov 27 21:55:23.186138 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4427/8713] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:23 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:24.203173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:24.203838 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:24.211069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:24.211581 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:24.212386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:24.212847 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:24.349319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:24.358807 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d0e6a1d5-6f93-417f-af83-ae69da1626a4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.159343 Nov 27 21:55:24.359915 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4287/8714] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:24 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:25.376512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:25.377123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:25.383820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:25.384216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:25.385059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:25.385505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:25.515978 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:25.523392 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c6358dca-e899-4cd7-b08d-dbed944bfabe tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.150722 Nov 27 21:55:25.523959 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4428/8715] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:25 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:55:26.540037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:26.540690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:26.547240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:26.547739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:26.549036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:26.549491 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:26.684659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:26.692693 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ec35ebbe-93ce-424f-a143-bc7e5b1d015d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.156398 Nov 27 21:55:26.693283 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4288/8716] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:26 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:27.297734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f4593b4b-64a1-4edf-b556-10a9f309adbc req-e49603f8-247e-47f1-8aa8-ed9de48e3cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e696595-bdd6-4963-a15b-8e4cfc31be41", "name": "network-vif-plugged", "status": "completed", "tag": "72e05286-f238-47c8-8844-60e25612a094"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:27.299822 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:55:27.299822 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:55:27.309091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f4593b4b-64a1-4edf-b556-10a9f309adbc req-e49603f8-247e-47f1-8aa8-ed9de48e3cb9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:27.309541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f4593b4b-64a1-4edf-b556-10a9f309adbc req-e49603f8-247e-47f1-8aa8-ed9de48e3cb9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:27.321399 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f4593b4b-64a1-4edf-b556-10a9f309adbc req-e49603f8-247e-47f1-8aa8-ed9de48e3cb9 service nova] Creating event network-vif-plugged:72e05286-f238-47c8-8844-60e25612a094 for instance 3e696595-bdd6-4963-a15b-8e4cfc31be41 on nch2-master-1 Nov 27 21:55:27.326594 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f4593b4b-64a1-4edf-b556-10a9f309adbc req-e49603f8-247e-47f1-8aa8-ed9de48e3cb9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Nov 27 21:55:27.327541 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4429/8717] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:55:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:55:27.709393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:27.709953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:27.716736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:27.717205 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:27.717995 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:27.718455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:27.853500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:27.861711 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e722c47d-73c2-428e-84f9-39aebda82d65 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1392 microversion: 2.1 time: 0.155553 Nov 27 21:55:27.862286 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4289/8718] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:27 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:28.879051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:28.879808 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:28.886803 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:28.887268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:28.888062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:28.888503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:29.024925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:29.032400 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0e4b4af5-4601-45df-9556-4c7abe4802e5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1564 microversion: 2.1 time: 0.158286 Nov 27 21:55:29.033062 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4430/8719] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:28 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:29.049101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:29.049828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:29.057235 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:29.057701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:29.058496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:29.058949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:29.194278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:29.201723 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-38e65799-48ef-4607-8614-497ce2d70c57 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1564 microversion: 2.1 time: 0.156308 Nov 27 21:55:29.202297 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4290/8720] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:29 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:55:31.106873 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:55:31.107523 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:55:31.110120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-7b6cbab5-5ae0-4024-a92d-a615018116c0 req-405655de-ec4b-4b7d-a663-cfb3a8dac47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e696595-bdd6-4963-a15b-8e4cfc31be41", "tag": "72e05286-f238-47c8-8844-60e25612a094"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:55:31.111813 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:55:31.111813 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:55:31.114211 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:31.114668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:31.115502 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:31.115934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:31.120930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7b6cbab5-5ae0-4024-a92d-a615018116c0 req-405655de-ec4b-4b7d-a663-cfb3a8dac47d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:55:31.121481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-7b6cbab5-5ae0-4024-a92d-a615018116c0 req-405655de-ec4b-4b7d-a663-cfb3a8dac47d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:55:31.139611 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-7b6cbab5-5ae0-4024-a92d-a615018116c0 req-405655de-ec4b-4b7d-a663-cfb3a8dac47d service nova] Creating event network-changed:72e05286-f238-47c8-8844-60e25612a094 for instance 3e696595-bdd6-4963-a15b-8e4cfc31be41 on nch2-master-1 Nov 27 21:55:31.146009 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-7b6cbab5-5ae0-4024-a92d-a615018116c0 req-405655de-ec4b-4b7d-a663-cfb3a8dac47d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040168 Nov 27 21:55:31.147301 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4291/8721] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:55:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:55:31.345560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:55:31.352802 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ee232f50-8561-44f2-a08c-5e15aae9de55 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1564 microversion: 2.1 time: 0.249961 Nov 27 21:55:31.353379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4431/8722] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:55:31 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1564 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:02.623159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-42c1d1de-258e-40d7-9154-862994386bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:56:02.624304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-42c1d1de-258e-40d7-9154-862994386bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:02.630856 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42c1d1de-258e-40d7-9154-862994386bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:02.631357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42c1d1de-258e-40d7-9154-862994386bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:02.632155 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42c1d1de-258e-40d7-9154-862994386bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:02.632611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-42c1d1de-258e-40d7-9154-862994386bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:02.684435 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-42c1d1de-258e-40d7-9154-862994386bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41/action" status: 200 len: 24568 microversion: 2.1 time: 0.066432 Nov 27 21:56:02.685072 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4292/8723] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:56:02 2021] POST /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41/action => generated 24568 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:56:33.107203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e05fffb-8f9e-42ad-bd4f-078f32968fa3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:56:33.108177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e05fffb-8f9e-42ad-bd4f-078f32968fa3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:33.114103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e05fffb-8f9e-42ad-bd4f-078f32968fa3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:33.114556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e05fffb-8f9e-42ad-bd4f-078f32968fa3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:33.115360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e05fffb-8f9e-42ad-bd4f-078f32968fa3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:33.115800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e05fffb-8f9e-42ad-bd4f-078f32968fa3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:33.192950 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e05fffb-8f9e-42ad-bd4f-078f32968fa3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41/action" status: 202 len: 0 microversion: 2.1 time: 0.090424 Nov 27 21:56:33.193576 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4432/8724] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:56:33 2021] POST /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:56:33.202386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:33.203108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:33.210762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:33.211240 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:33.212085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:33.212548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:33.405023 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:33.412426 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b37eb97d-395b-43cb-b372-30ad82a136c2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1675 microversion: 2.1 time: 0.214329 Nov 27 21:56:33.413027 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4293/8725] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:33 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:34.434094 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:34.434835 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:34.447167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:34.447656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:34.449299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:34.449751 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:34.754630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:34.762218 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2b990257-8e8a-4951-9f2f-616f76ccf471 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.335517 Nov 27 21:56:34.762892 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4433/8726] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:34 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:35.780239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:35.780874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:35.789144 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:35.789622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:35.790428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:35.790885 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:35.923771 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:35.932328 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e8bd0e82-f899-4329-b591-ea398157735f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.155604 Nov 27 21:56:35.932905 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4294/8727] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:35 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:36.949189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:36.949792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:36.956575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:36.957021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:36.957820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:36.958256 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:37.089950 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:37.097571 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c18d8ffc-85ad-4397-8f39-583d603c084d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.152112 Nov 27 21:56:37.098826 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4434/8728] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:36 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:38.121754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:38.122384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:38.129354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:38.129815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:38.130629 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:38.131086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:38.268059 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:38.276237 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0a3b6d6e-9544-4e4f-9c76-99b5d6e941b1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.158152 Nov 27 21:56:38.276801 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4295/8729] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:38 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:39.293092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:39.293710 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:39.300444 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:39.300902 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:39.301687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:39.302130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:39.437564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:39.444973 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ce503f93-4c32-4def-ab74-4d0a58e8d192 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.155588 Nov 27 21:56:39.445544 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4435/8730] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:39 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:40.461763 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:40.462424 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:40.469264 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:40.469736 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:40.470539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:40.470996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:40.608657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:40.616782 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c4730f0a-9af3-49d4-a875-822fc47e2887 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.158794 Nov 27 21:56:40.617342 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4296/8731] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:40 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:41.634574 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:41.635184 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:41.642007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:41.642449 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:41.643224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:41.643691 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:41.772505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:41.779879 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6dd8e11a-9769-4d0a-b7a2-b5aaa6207925 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.149625 Nov 27 21:56:41.780452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4436/8732] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:41 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:42.797310 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:42.797936 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:42.804719 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:42.805184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:42.805968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:42.806421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:42.936787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:42.944580 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6e718703-6f3d-4912-9b6a-36127be28952 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.151037 Nov 27 21:56:42.945153 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4297/8733] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:42 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:43.962087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:43.962701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:43.969386 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:43.969838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:43.970619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:43.971059 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:44.100650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:44.107929 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-71aed05d-1b26-4d0d-a45c-596b00a82251 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1680 microversion: 2.1 time: 0.150063 Nov 27 21:56:44.108538 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4437/8734] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:43 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:56:45.124825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:56:45.125448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:56:45.132439 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:45.132905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:45.133694 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:56:45.134148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:56:45.263702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:56:45.271128 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c02bc18c-331c-418c-a600-5a0b7417705a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1683 microversion: 2.1 time: 0.149998 Nov 27 21:56:45.271726 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4298/8735] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:56:45 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:17.479010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a40915e7-0f00-401f-bb4b-d3142d37180b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:57:17.480006 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a40915e7-0f00-401f-bb4b-d3142d37180b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:17.486199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a40915e7-0f00-401f-bb4b-d3142d37180b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:17.486648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a40915e7-0f00-401f-bb4b-d3142d37180b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:17.487460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a40915e7-0f00-401f-bb4b-d3142d37180b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:17.487896 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a40915e7-0f00-401f-bb4b-d3142d37180b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:17.544997 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a40915e7-0f00-401f-bb4b-d3142d37180b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41/action" status: 200 len: 69165 microversion: 2.1 time: 0.069861 Nov 27 21:57:17.545671 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4438/8736] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:57:17 2021] POST /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41/action => generated 69165 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:57:34.795244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:34.795828 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:34.802284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:34.802751 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:34.803589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:34.804042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:34.829352 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:57:34.859214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b0227fd0-6b5f-48b0-aa68-48df0974699c req-5c89d7bd-ac33-4404-875a-3a946ada3f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e696595-bdd6-4963-a15b-8e4cfc31be41", "tag": "72e05286-f238-47c8-8844-60e25612a094"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:57:34.860784 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:57:34.860784 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:57:34.872485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b0227fd0-6b5f-48b0-aa68-48df0974699c req-5c89d7bd-ac33-4404-875a-3a946ada3f10 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:34.872946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b0227fd0-6b5f-48b0-aa68-48df0974699c req-5c89d7bd-ac33-4404-875a-3a946ada3f10 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:34.883777 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b0227fd0-6b5f-48b0-aa68-48df0974699c req-5c89d7bd-ac33-4404-875a-3a946ada3f10 service nova] Creating event network-changed:72e05286-f238-47c8-8844-60e25612a094 for instance 3e696595-bdd6-4963-a15b-8e4cfc31be41 on nch2-master-1 Nov 27 21:57:34.889818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b0227fd0-6b5f-48b0-aa68-48df0974699c req-5c89d7bd-ac33-4404-875a-3a946ada3f10 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095554 Nov 27 21:57:34.891162 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4439/8737] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:57:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:57:34.915017 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cb7df1ba-7fa5-44d2-840f-35f3c60620c5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 204 len: 0 microversion: 2.1 time: 0.123549 Nov 27 21:57:34.915752 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4299/8738] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:57:34 2021] DELETE /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:57:34.925940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:34.927342 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:34.934733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:34.935353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:34.936720 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:34.937229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:35.173894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:35.181357 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fa2caf25-da1f-4c9a-977e-d3671c091cc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1689 microversion: 2.1 time: 0.260851 Nov 27 21:57:35.182132 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4440/8739] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:34 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:36.199854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:36.200577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:36.207611 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:36.208085 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:36.208887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:36.209354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:36.345506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:36.352871 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-80845966-b44e-4165-9439-fe17e18dd707 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1570 microversion: 2.1 time: 0.157169 Nov 27 21:57:36.353448 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4300/8740] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:36 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:37.108195 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-cd107187-5223-4e77-94e0-8bfa5698ce63 req-ac19c4f8-82f7-4c01-ad07-7fb8860b7a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e696595-bdd6-4963-a15b-8e4cfc31be41", "name": "network-vif-deleted", "tag": "72e05286-f238-47c8-8844-60e25612a094"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:57:37.109730 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:57:37.109730 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:57:37.117842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd107187-5223-4e77-94e0-8bfa5698ce63 req-ac19c4f8-82f7-4c01-ad07-7fb8860b7a43 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:37.118305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-cd107187-5223-4e77-94e0-8bfa5698ce63 req-ac19c4f8-82f7-4c01-ad07-7fb8860b7a43 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:37.130319 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-cd107187-5223-4e77-94e0-8bfa5698ce63 req-ac19c4f8-82f7-4c01-ad07-7fb8860b7a43 service nova] Creating event network-vif-deleted:72e05286-f238-47c8-8844-60e25612a094 for instance 3e696595-bdd6-4963-a15b-8e4cfc31be41 on nch2-master-1 Nov 27 21:57:37.135516 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-cd107187-5223-4e77-94e0-8bfa5698ce63 req-ac19c4f8-82f7-4c01-ad07-7fb8860b7a43 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030881 Nov 27 21:57:37.136105 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4441/8741] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:57:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:57:37.369971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:37.370539 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:37.377720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:37.378192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:37.379006 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:37.379521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:37.413846 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:37.414326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:37.414803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lazy-loading 'fault' on Instance uuid 3e696595-bdd6-4963-a15b-8e4cfc31be41 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 21:57:37.459086 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:37.470385 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-66ad278a-812b-431e-99d8-f2ab703e10b3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 200 len: 1356 microversion: 2.1 time: 0.104101 Nov 27 21:57:37.470976 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4301/8742] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:37 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:38.488547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:38.489275 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 3e696595-bdd6-4963-a15b-8e4cfc31be41] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:38.496121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:38.496572 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:38.497351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:38.497791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:38.510955 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] HTTP exception thrown: Instance 3e696595-bdd6-4963-a15b-8e4cfc31be41 could not be found. Nov 27 21:57:38.511575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Returning 404 to user: Instance 3e696595-bdd6-4963-a15b-8e4cfc31be41 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:57:38.512426 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b72c0a70-f2df-47be-b000-046ac2312002 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41" status: 404 len: 111 microversion: 2.1 time: 0.028851 Nov 27 21:57:38.512952 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4442/8743] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:38 2021] GET /compute/v2.1/servers/3e696595-bdd6-4963-a15b-8e4cfc31be41 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 21:57:41.348829 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:57:41.349400 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 21:57:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:57:41.771869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a6ad76e7-745c-4366-b541-bbd7faf02623 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '.version_select at 0x7f15c7d90b80>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:41.800322 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a6ad76e7-745c-4366-b541-bbd7faf02623 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-449222368" status: 202 len: 0 microversion: 2.1 time: 0.032115 Nov 27 21:57:41.801000 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4302/8744] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 21:57:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-449222368 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 21:57:41.827575 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-359f62a7-e568-4c1e-8336-6222541df3be tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: .version_select at 0x7f15c773d670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-339776816"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:57:41.842417 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-359f62a7-e568-4c1e-8336-6222541df3be tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:57:41.848112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-359f62a7-e568-4c1e-8336-6222541df3be tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:57:42.209085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-359f62a7-e568-4c1e-8336-6222541df3be tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:57:42.214644 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-359f62a7-e568-4c1e-8336-6222541df3be tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:57:42.228441 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-359f62a7-e568-4c1e-8336-6222541df3be tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.404831 Nov 27 21:57:42.229037 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4443/8745] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 21:57:41 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:47.657461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-756829942", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "3061940c-7737-4508-b719-3b40d7e97ac0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-339776816", "security_groups": [{"name": "tempest-secgroup-smoke-1197155587"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:57:47.775005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] validate_networks() for [('3061940c-7737-4508-b719-3b40d7e97ac0', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 21:57:48.198025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:57:48.198569 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:57:48.199293 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:57:48.199829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:57:48.200269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:57:48.209094 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:48.209532 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:48.211008 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:48.211494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:48.228490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 21:57:48.233580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 21:57:48.245683 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 21:57:48.248076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 21:57:48.297340 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-85bed79b-2c62-4996-b645-adf657009f43 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.643386 Nov 27 21:57:48.297996 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4303/8746] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:57:47 2021] POST /compute/v2.1/servers => generated 406 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 21:57:48.309405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b92a3f41-df6b-40e3-a4ee-5435ed379e09 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:48.310029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b92a3f41-df6b-40e3-a4ee-5435ed379e09 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:48.387729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b92a3f41-df6b-40e3-a4ee-5435ed379e09 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:48.397116 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b92a3f41-df6b-40e3-a4ee-5435ed379e09 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1265 microversion: 2.1 time: 0.091076 Nov 27 21:57:48.397116 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4444/8747] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:48 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:49.413870 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:49.414503 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:49.423242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:49.424156 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:49.425246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:49.425937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:49.499934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:49.509779 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-52fd1f49-bbe9-4d88-9534-f59d55c64846 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1323 microversion: 2.1 time: 0.099547 Nov 27 21:57:49.520490 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4304/8748] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:49 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:50.529660 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:50.531053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:50.545422 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:50.546802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:50.547817 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:50.548590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:50.794181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:50.802402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae03d2c9-01ad-40ae-8d52-48f54974e48b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.278093 Nov 27 21:57:50.812458 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4445/8749] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:50 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:50.859105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-80d25e45-2b77-4487-9079-7d6aef5f15a2 req-521104fa-c60f-45ac-bf9b-4fe515efcd7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:57:50.860990 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:57:50.860990 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:57:50.884378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80d25e45-2b77-4487-9079-7d6aef5f15a2 req-521104fa-c60f-45ac-bf9b-4fe515efcd7e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:50.885188 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-80d25e45-2b77-4487-9079-7d6aef5f15a2 req-521104fa-c60f-45ac-bf9b-4fe515efcd7e service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:50.903539 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-80d25e45-2b77-4487-9079-7d6aef5f15a2 req-521104fa-c60f-45ac-bf9b-4fe515efcd7e service nova] Creating event network-changed:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch2-master-1 Nov 27 21:57:50.909321 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-80d25e45-2b77-4487-9079-7d6aef5f15a2 req-521104fa-c60f-45ac-bf9b-4fe515efcd7e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054030 Nov 27 21:57:50.910390 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4305/8750] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:57:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:57:51.819653 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:51.820279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:51.826729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:51.827137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:51.827967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:51.828508 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:51.959231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:51.966535 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-38e1583d-440d-44ed-aee5-109efd4fe882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.150875 Nov 27 21:57:51.967107 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4446/8751] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:51 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:52.985054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:52.985772 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:52.992697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:52.993157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:52.993948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:52.994397 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:53.129388 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:53.137465 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87288b25-2fbc-46fb-b61e-62f8c2230466 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.157379 Nov 27 21:57:53.138052 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4306/8752] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:52 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:54.154007 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:54.154632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:54.161111 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:54.161553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:54.162348 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:54.162828 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:54.298965 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:54.306837 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1cdad8e3-8043-48a2-9d4e-f0dc3907c01e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.156514 Nov 27 21:57:54.307752 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4447/8753] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:54 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:55.323101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:55.323792 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:55.330624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:55.331091 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:55.331918 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:55.332374 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:55.465946 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:55.473161 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-56d88dcc-743e-42a4-be87-78c6f25bc882 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.153825 Nov 27 21:57:55.473722 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4307/8754] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:55 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:56.489727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:56.490426 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:56.497623 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:56.498077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:56.498869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:56.499320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:56.636222 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:56.643712 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf9f4ee2-0007-4fa2-960b-1dd8c2ebd6bf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.157666 Nov 27 21:57:56.644324 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4448/8755] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:56 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:57.661239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:57.661887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:57.669104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:57.669565 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:57.670347 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:57.670794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:57.803985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:57.811153 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-05b5e5b6-dd15-4625-bc53-edd9e6b7b12d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.153674 Nov 27 21:57:57.811758 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4308/8756] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:57 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:58.182258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a99cd600-e5b4-49fc-8bca-b669060a5f99 req-0339855a-89d4-4270-a528-15498d02c3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "name": "network-vif-plugged", "status": "completed", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:57:58.184025 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:57:58.184025 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:57:58.191074 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a99cd600-e5b4-49fc-8bca-b669060a5f99 req-0339855a-89d4-4270-a528-15498d02c3fd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:58.192304 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a99cd600-e5b4-49fc-8bca-b669060a5f99 req-0339855a-89d4-4270-a528-15498d02c3fd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:58.202354 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a99cd600-e5b4-49fc-8bca-b669060a5f99 req-0339855a-89d4-4270-a528-15498d02c3fd service nova] Creating event network-vif-plugged:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch2-master-1 Nov 27 21:57:58.207235 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a99cd600-e5b4-49fc-8bca-b669060a5f99 req-0339855a-89d4-4270-a528-15498d02c3fd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085795 Nov 27 21:57:58.207863 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4449/8757] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:57:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:57:58.827802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:58.828458 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:57:58.835208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:58.835716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:58.836510 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:57:58.836965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:57:58.970052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:57:58.977468 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1543a961-a1d5-435b-bbd4-1c00beab1b49 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1391 microversion: 2.1 time: 0.153374 Nov 27 21:57:58.978048 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4309/8758] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:58 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:57:59.995732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:57:59.996437 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:58:00.002982 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:00.003465 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:00.004251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:00.004714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:00.139293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:58:00.146655 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-92911d0d-6413-4b59-898a-fae15f8a74d6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1562 microversion: 2.1 time: 0.156482 Nov 27 21:58:00.147223 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4450/8759] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:57:59 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:58:00.162930 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:58:00.163588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:58:00.170282 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:00.170755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:00.171583 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:00.172037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:00.301766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:58:00.309349 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a22b59a-42f2-4654-ad9a-e58643709847 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1562 microversion: 2.1 time: 0.150611 Nov 27 21:58:00.309915 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4310/8760] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:58:00 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:58:02.220970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:58:02.221594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:58:02.223284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-18f068af-9fb5-44bc-87fe-1dda8df472b4 req-d0bbdc1c-eef3-45b1-b860-ab7f5fd4cda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:58:02.225663 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:58:02.225663 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:58:02.230162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:02.230619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:02.231696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:02.232452 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:02.233809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-18f068af-9fb5-44bc-87fe-1dda8df472b4 req-d0bbdc1c-eef3-45b1-b860-ab7f5fd4cda9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:02.234280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-18f068af-9fb5-44bc-87fe-1dda8df472b4 req-d0bbdc1c-eef3-45b1-b860-ab7f5fd4cda9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:02.246389 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-18f068af-9fb5-44bc-87fe-1dda8df472b4 req-d0bbdc1c-eef3-45b1-b860-ab7f5fd4cda9 service nova] Creating event network-changed:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch2-master-1 Nov 27 21:58:02.251728 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-18f068af-9fb5-44bc-87fe-1dda8df472b4 req-d0bbdc1c-eef3-45b1-b860-ab7f5fd4cda9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032104 Nov 27 21:58:02.252805 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4311/8761] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:58:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:58:02.452981 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:58:02.460703 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cc060baf-220f-4060-8d43-d0faa3aaacbc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1562 microversion: 2.1 time: 0.243750 Nov 27 21:58:02.461272 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4451/8762] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:58:02 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:58:33.834274 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f9d9836-802c-4111-8818-7b11e1da808a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:58:33.835456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f9d9836-802c-4111-8818-7b11e1da808a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:58:33.841656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f9d9836-802c-4111-8818-7b11e1da808a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:33.842127 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f9d9836-802c-4111-8818-7b11e1da808a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:33.842925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f9d9836-802c-4111-8818-7b11e1da808a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:58:33.843412 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f9d9836-802c-4111-8818-7b11e1da808a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:58:33.903547 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f9d9836-802c-4111-8818-7b11e1da808a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action" status: 200 len: 24574 microversion: 2.1 time: 0.119995 Nov 27 21:58:33.904162 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4312/8763] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:58:33 2021] POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action => generated 24574 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:58:46.663844 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 21:58:46.664328 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 21:58:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 21:59:04.305830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:04.306790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:04.312724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:04.313171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:04.313941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:04.314377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:04.341335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:04.347084 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Old instance type m1.heat2, new instance type m1.heat {{(pid=135680) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 27 21:59:04.353784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 21:59:04.354203 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 21:59:04.354709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 21:59:04.355115 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 21:59:04.355550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 21:59:04.416823 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4785de07-7a25-4519-a32b-4adb22c6ecfb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action" status: 202 len: 0 microversion: 2.1 time: 0.115711 Nov 27 21:59:04.417427 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4452/8764] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:59:04 2021] POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 21:59:04.428221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:04.428221 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:04.434032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:04.439377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:04.439377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:04.439377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:04.584090 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:04.591940 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fd6d4d67-bb97-494c-815b-f51e8594728a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1690 microversion: 2.1 time: 0.170145 Nov 27 21:59:04.592631 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4313/8765] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:04 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:05.611098 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:05.611759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:05.617770 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:05.618217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:05.618991 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:05.619457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:05.758745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:05.766430 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-04ad8ee9-d61a-4120-ac26-31e6c68cc9d4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1690 microversion: 2.1 time: 0.160688 Nov 27 21:59:05.767000 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4453/8766] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:05 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:06.784247 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:06.784887 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:06.793121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:06.793592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:06.794394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:06.794857 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:06.931607 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:06.939013 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fdc282e7-fc63-4d77-8668-cd899ff1157b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.158480 Nov 27 21:59:06.939638 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4314/8767] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:06 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:07.956378 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:07.957023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:07.963837 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:07.964305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:07.965079 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:07.965516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:08.100747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:08.108173 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-493fd69a-956d-46f4-905f-c6bf938bd6b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.155504 Nov 27 21:59:08.108708 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4454/8768] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:07 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:09.125183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:09.125812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:09.133358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:09.133826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:09.134622 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:09.135079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:09.268469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:09.276155 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1dcde1d7-0d86-4357-b737-4f267ee08fdd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.154702 Nov 27 21:59:09.276742 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4315/8769] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:09 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:10.293247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:10.293865 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:10.300612 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:10.301067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:10.301857 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:10.302301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:10.434110 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:10.442133 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-894bcd58-c4d7-4c53-8ca5-90839bf76278 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.152633 Nov 27 21:59:10.442726 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4455/8770] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:10 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:11.459129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:11.460343 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:11.467143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:11.467650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:11.468445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:11.468902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:11.599705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:11.608141 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-255936b9-9a59-45de-a92e-7ff12641ea4a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.152537 Nov 27 21:59:11.608763 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4316/8771] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:11 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:12.625423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:12.625961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:12.632940 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:12.633387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:12.634154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:12.634588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:12.767243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:12.774573 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bfb82024-b125-4934-b592-ab5b81f6fe30 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.152920 Nov 27 21:59:12.775133 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4456/8772] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:12 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:59:13.791623 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:13.792258 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:13.799089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:13.799586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:13.800386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:13.800842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:13.938621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:13.948352 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1bdf52ec-abb1-4e76-88f2-5f2aa8d62697 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.160430 Nov 27 21:59:13.948926 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4317/8773] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:13 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:14.965460 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:14.966068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:14.972913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:14.973369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:14.974153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:14.974594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:15.105326 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:15.112917 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f58c9336-ed19-4ed2-973e-453aeb15386f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.151166 Nov 27 21:59:15.113488 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4457/8774] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:14 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:16.130128 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:16.130762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:16.137524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:16.138000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:16.138803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:16.139285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:16.284300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:16.294082 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-95dc2d60-ff2f-4636-bd71-f9f11758a940 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.167920 Nov 27 21:59:16.294676 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4318/8775] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:16 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:17.311643 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:17.312278 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:17.319639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:17.320092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:17.320880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:17.321320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:17.455370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:17.462804 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-167ae1f7-7018-4125-a5db-bf9166efc2b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1695 microversion: 2.1 time: 0.154880 Nov 27 21:59:17.463386 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4458/8776] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:17 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:18.480050 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:18.480684 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:18.487502 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:18.487977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:18.488791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:18.489252 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:18.757350 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:18.764771 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abc07300-f463-45fe-9ec2-788158151cbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1694 microversion: 2.1 time: 0.288474 Nov 27 21:59:18.765349 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4319/8777] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:18 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1694 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:18.921000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-e4b374a5-8466-4ee0-9efd-1c3c2188597d req-71831d7a-6714-4f67-9d53-5bb7be213db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "name": "network-vif-unplugged", "status": "completed", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:18.923114 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:59:18.923114 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:59:18.931087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e4b374a5-8466-4ee0-9efd-1c3c2188597d req-71831d7a-6714-4f67-9d53-5bb7be213db5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:18.931571 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-e4b374a5-8466-4ee0-9efd-1c3c2188597d req-71831d7a-6714-4f67-9d53-5bb7be213db5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:18.944817 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-e4b374a5-8466-4ee0-9efd-1c3c2188597d req-71831d7a-6714-4f67-9d53-5bb7be213db5 service nova] Creating event network-vif-unplugged:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch1-master-1 Nov 27 21:59:18.950233 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [req-e4b374a5-8466-4ee0-9efd-1c3c2188597d req-71831d7a-6714-4f67-9d53-5bb7be213db5 service nova] Instance 0f550caa-c386-42cd-b3e3-88addf0bf08c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:59:18.963010 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-e4b374a5-8466-4ee0-9efd-1c3c2188597d req-71831d7a-6714-4f67-9d53-5bb7be213db5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104127 Nov 27 21:59:18.964101 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4459/8778] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:59:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:59:19.781797 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:19.782434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:19.789253 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:19.789791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:19.790663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:19.791116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:19.933512 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:19.941007 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-59a3964f-9ba3-4cd8-8ba7-227d41b846b6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1694 microversion: 2.1 time: 0.162975 Nov 27 21:59:19.941750 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4320/8779] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:19 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:20.958225 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:20.958917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:20.966359 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:20.966812 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:20.967628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:20.968066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:21.003467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-aa680022-67b4-4ba4-81a5-93cc01ca8632 req-fa18b3fc-0a54-48f0-8fed-9804ab08beeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:21.005105 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:59:21.005105 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:59:21.012943 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa680022-67b4-4ba4-81a5-93cc01ca8632 req-fa18b3fc-0a54-48f0-8fed-9804ab08beeb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:21.013959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-aa680022-67b4-4ba4-81a5-93cc01ca8632 req-fa18b3fc-0a54-48f0-8fed-9804ab08beeb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:21.026887 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-aa680022-67b4-4ba4-81a5-93cc01ca8632 req-fa18b3fc-0a54-48f0-8fed-9804ab08beeb service nova] Creating event network-changed:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch1-master-1 Nov 27 21:59:21.032688 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [req-aa680022-67b4-4ba4-81a5-93cc01ca8632 req-fa18b3fc-0a54-48f0-8fed-9804ab08beeb service nova] Instance 0f550caa-c386-42cd-b3e3-88addf0bf08c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=135679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 27 21:59:21.046120 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-aa680022-67b4-4ba4-81a5-93cc01ca8632 req-fa18b3fc-0a54-48f0-8fed-9804ab08beeb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046408 Nov 27 21:59:21.047364 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4321/8780] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:59:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:59:21.144809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:21.153054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9dc02ac1-36cc-4308-bc2b-00aecb4f8a72 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1692 microversion: 2.1 time: 0.198830 Nov 27 21:59:21.153647 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4460/8781] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:20 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1692 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:22.171431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:22.172222 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:22.180141 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.180614 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:22.181421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.181884 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:22.315071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:22.322394 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0dbaa81c-c95e-4ce8-b174-7e777babb72f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1689 microversion: 2.1 time: 0.155190 Nov 27 21:59:22.322974 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4322/8782] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:22 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:22.339055 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-eb831182-ad06-4340-931e-d4697eff0106 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:22.339640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-eb831182-ad06-4340-931e-d4697eff0106 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:22.346213 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb831182-ad06-4340-931e-d4697eff0106 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.346668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb831182-ad06-4340-931e-d4697eff0106 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:22.347487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb831182-ad06-4340-931e-d4697eff0106 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.347948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-eb831182-ad06-4340-931e-d4697eff0106 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:22.404564 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-eb831182-ad06-4340-931e-d4697eff0106 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action" status: 204 len: 0 microversion: 2.1 time: 0.069516 Nov 27 21:59:22.405235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4461/8783] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:59:22 2021] POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:59:22.413785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:22.414415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:22.420366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.420831 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:22.421686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.422080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:22.566816 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:22.577411 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ec995fe-63f8-4423-8f89-2bc72c9a735d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1689 microversion: 2.1 time: 0.167124 Nov 27 21:59:22.578272 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4323/8784] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:22 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:22.594512 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:22.595209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:22.601900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.602350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:22.603137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:22.603603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:23.137547 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:23.145499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b0af3f3-26ad-4c0d-9720-5da9aa6fe092 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1689 microversion: 2.1 time: 0.554977 Nov 27 21:59:23.146404 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4462/8785] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:22 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1689 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:24.162519 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:24.163724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:24.170853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:24.171359 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:24.172170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:24.172632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:24.303228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:24.310643 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6f3cf42e-87a9-4d4c-be2f-91ea707a1b93 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1681 microversion: 2.1 time: 0.152072 Nov 27 21:59:24.311221 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4324/8786] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:24 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:25.292739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b582623f-9bf7-4b5b-93a9-ac639ef2f8df req-2ca9f339-d25d-484a-83f9-ba11ffae6607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "name": "network-vif-plugged", "status": "completed", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:25.294401 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:59:25.294401 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 21:59:25.302253 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b582623f-9bf7-4b5b-93a9-ac639ef2f8df req-2ca9f339-d25d-484a-83f9-ba11ffae6607 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:25.302705 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b582623f-9bf7-4b5b-93a9-ac639ef2f8df req-2ca9f339-d25d-484a-83f9-ba11ffae6607 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:25.314863 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b582623f-9bf7-4b5b-93a9-ac639ef2f8df req-2ca9f339-d25d-484a-83f9-ba11ffae6607 service nova] Creating event network-vif-plugged:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch1-master-1 Nov 27 21:59:25.320139 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b582623f-9bf7-4b5b-93a9-ac639ef2f8df req-2ca9f339-d25d-484a-83f9-ba11ffae6607 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031230 Nov 27 21:59:25.320762 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4463/8787] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:59:48.489493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b335864a-f9e6-4fc6-bd6b-35e968477569 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:48.490929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b335864a-f9e6-4fc6-bd6b-35e968477569 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:48.497421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b335864a-f9e6-4fc6-bd6b-35e968477569 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:48.497891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b335864a-f9e6-4fc6-bd6b-35e968477569 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:48.498690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b335864a-f9e6-4fc6-bd6b-35e968477569 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:48.499143 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b335864a-f9e6-4fc6-bd6b-35e968477569 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:48.555996 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b335864a-f9e6-4fc6-bd6b-35e968477569 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action" status: 200 len: 24575 microversion: 2.1 time: 0.070268 Nov 27 21:59:48.556640 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4325/8788] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 21:59:48 2021] POST /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c/action => generated 24575 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 21:59:55.587961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:55.589357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:55.592138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-70c1d919-e9d7-42a4-b642-e04f0dc63daa req-9fd1f393-9a44-4d8f-86c4-87a8e095c924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:55.594184 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:59:55.594184 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:59:55.595994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:55.596654 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:55.597772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:55.598221 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:55.603114 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-70c1d919-e9d7-42a4-b642-e04f0dc63daa req-9fd1f393-9a44-4d8f-86c4-87a8e095c924 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:55.603863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-70c1d919-e9d7-42a4-b642-e04f0dc63daa req-9fd1f393-9a44-4d8f-86c4-87a8e095c924 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:55.615806 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-70c1d919-e9d7-42a4-b642-e04f0dc63daa req-9fd1f393-9a44-4d8f-86c4-87a8e095c924 service nova] Creating event network-changed:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch1-master-1 Nov 27 21:59:55.621311 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-70c1d919-e9d7-42a4-b642-e04f0dc63daa req-9fd1f393-9a44-4d8f-86c4-87a8e095c924 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033643 Nov 27 21:59:55.622171 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4326/8789] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:59:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 21:59:55.623500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 21:59:55.722845 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-de32dca8-788c-4e16-9ed6-4b0b649eeac4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 204 len: 0 microversion: 2.1 time: 0.140191 Nov 27 21:59:55.724086 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4464/8790] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:59:55 2021] DELETE /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 21:59:55.733413 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:55.734428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:55.743733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:55.744423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:55.745269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:55.745722 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:55.970643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:55.978509 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-93e3b156-102c-47f1-98dc-b4f4c692cdd5 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1687 microversion: 2.1 time: 0.249792 Nov 27 21:59:55.979079 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4327/8791] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:55 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1687 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 21:59:56.996656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:56.997351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:57.004257 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:57.004708 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:57.005495 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:57.006431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:57.139642 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 21:59:57.147862 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa955068-5300-415b-b776-a9d250354376 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 200 len: 1568 microversion: 2.1 time: 0.155403 Nov 27 21:59:57.148470 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4465/8792] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:56 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 21:59:57.719948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-cca31765-957c-4dd1-bef6-b7e6a727b3ac req-a86963ac-0ab8-4deb-96b4-c730da5d4a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f550caa-c386-42cd-b3e3-88addf0bf08c", "name": "network-vif-deleted", "tag": "74832977-c280-4638-9451-4601069187b8"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 21:59:57.721481 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:59:57.721481 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 21:59:57.730326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cca31765-957c-4dd1-bef6-b7e6a727b3ac req-a86963ac-0ab8-4deb-96b4-c730da5d4a41 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:57.730794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-cca31765-957c-4dd1-bef6-b7e6a727b3ac req-a86963ac-0ab8-4deb-96b4-c730da5d4a41 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:57.742151 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-cca31765-957c-4dd1-bef6-b7e6a727b3ac req-a86963ac-0ab8-4deb-96b4-c730da5d4a41 service nova] Creating event network-vif-deleted:74832977-c280-4638-9451-4601069187b8 for instance 0f550caa-c386-42cd-b3e3-88addf0bf08c on nch1-master-1 Nov 27 21:59:57.747709 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-cca31765-957c-4dd1-bef6-b7e6a727b3ac req-a86963ac-0ab8-4deb-96b4-c730da5d4a41 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031437 Nov 27 21:59:57.748313 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4328/8793] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 21:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 21:59:58.166457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 21:59:58.167069 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 0f550caa-c386-42cd-b3e3-88addf0bf08c] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 21:59:58.173830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:58.174283 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:58.175070 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 21:59:58.175539 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 21:59:58.188591 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] HTTP exception thrown: Instance 0f550caa-c386-42cd-b3e3-88addf0bf08c could not be found. Nov 27 21:59:58.189176 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Returning 404 to user: Instance 0f550caa-c386-42cd-b3e3-88addf0bf08c could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 21:59:58.190023 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b0d6335e-580d-44e7-8d0b-6e4c9364c0d9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c" status: 404 len: 111 microversion: 2.1 time: 0.029313 Nov 27 21:59:58.190552 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4466/8794] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:59:58 2021] GET /compute/v2.1/servers/0f550caa-c386-42cd-b3e3-88addf0bf08c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 22:00:01.536305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-435a1ccc-2467-464a-bdb7-bf57a953cf66 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '.version_select at 0x7f15c734f700>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:01.585257 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-435a1ccc-2467-464a-bdb7-bf57a953cf66 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-339776816" status: 202 len: 0 microversion: 2.1 time: 0.040902 Nov 27 22:00:01.585257 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4329/8795] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 22:00:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-339776816 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:00:01.598819 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-499c09be-7b35-4223-abc5-ebd36bcd468c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: .version_select at 0x7f15c773d5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-628360275"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:00:01.615630 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-499c09be-7b35-4223-abc5-ebd36bcd468c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:00:01.624420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-499c09be-7b35-4223-abc5-ebd36bcd468c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:00:01.714209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-499c09be-7b35-4223-abc5-ebd36bcd468c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:00:01.718962 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-499c09be-7b35-4223-abc5-ebd36bcd468c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:00:01.733099 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-499c09be-7b35-4223-abc5-ebd36bcd468c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.140314 Nov 27 22:00:01.733711 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4467/8796] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 22:00:01 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:07.598783 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-291926368", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "b254de04-48d7-4ff6-b5c7-f8d1015844b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-628360275", "security_groups": [{"name": "tempest-secgroup-smoke-1208804010"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:00:07.722405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] validate_networks() for [('b254de04-48d7-4ff6-b5c7-f8d1015844b5', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 22:00:08.143421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 22:00:08.143897 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 22:00:08.144393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 22:00:08.144843 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 22:00:08.145361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 22:00:08.154619 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:08.155075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:08.155974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:08.156436 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:08.188807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:00:08.198626 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:00:08.213536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 22:00:08.216161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 22:00:08.265624 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [880f4612-1ace-4297-b2a7-99d2794ef18f] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:00:09.299745 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [880f4612-1ace-4297-b2a7-99d2794ef18f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 47352. Nov 27 22:00:09.316797 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-53b66e78-0efb-47b8-919e-69488f0b1214 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.722509 Nov 27 22:00:09.320531 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4330/8797] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 22:00:07 2021] POST /compute/v2.1/servers => generated 406 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 22:00:09.334045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-87a89ed1-4bd5-4bac-95f3-e17496f0b465 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:09.334663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-87a89ed1-4bd5-4bac-95f3-e17496f0b465 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:09.433175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-87a89ed1-4bd5-4bac-95f3-e17496f0b465 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:09.449911 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-87a89ed1-4bd5-4bac-95f3-e17496f0b465 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1265 microversion: 2.1 time: 0.122634 Nov 27 22:00:09.451118 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4468/8798] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:09 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:10.468431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:10.469738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:10.478464 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:10.479237 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:10.480355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:10.481016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:10.555113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:10.562692 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6c374e42-6b1a-4f0a-8a55-6c0af28249f3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1323 microversion: 2.1 time: 0.099833 Nov 27 22:00:10.563630 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4331/8799] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:10 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:11.580380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:11.580967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:11.590420 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:11.590874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:11.591838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:11.592356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:11.797553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9ffc5fe2-5caf-4623-a88b-a50815f829fc req-2333fa95-896e-4ff0-bc16-83b9a2eb6a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335ecee3-5742-4314-b51b-f0ff44f51ee7", "tag": "790d7e2b-dabb-4cde-a2d9-833976db3cdb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:00:11.801443 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:00:11.801443 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:00:11.811739 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9ffc5fe2-5caf-4623-a88b-a50815f829fc req-2333fa95-896e-4ff0-bc16-83b9a2eb6a52 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:11.812344 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9ffc5fe2-5caf-4623-a88b-a50815f829fc req-2333fa95-896e-4ff0-bc16-83b9a2eb6a52 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:11.838899 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9ffc5fe2-5caf-4623-a88b-a50815f829fc req-2333fa95-896e-4ff0-bc16-83b9a2eb6a52 service nova] Creating event network-changed:790d7e2b-dabb-4cde-a2d9-833976db3cdb for instance 335ecee3-5742-4314-b51b-f0ff44f51ee7 on nch2-master-1 Nov 27 22:00:11.844248 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9ffc5fe2-5caf-4623-a88b-a50815f829fc req-2333fa95-896e-4ff0-bc16-83b9a2eb6a52 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052763 Nov 27 22:00:11.849746 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4332/8800] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:00:11.862781 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:11.871658 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9880b9cc-1c32-49ae-b125-a3069079888a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.294932 Nov 27 22:00:11.872241 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4469/8801] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:11 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:12.889024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:12.889650 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:12.896609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:12.897079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:12.897874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:12.898328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:13.032362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:13.040656 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6596cb0b-3a75-40de-ab80-58333199408c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.155835 Nov 27 22:00:13.041227 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4333/8802] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:12 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:14.057996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:14.058634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:14.065320 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:14.065778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:14.066564 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:14.067002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:14.204771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:14.212250 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-42f7fb78-d655-422d-8e27-d80a1ffb7681 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.158532 Nov 27 22:00:14.212821 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4470/8803] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:14 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:15.229113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:15.229765 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:15.236608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:15.237079 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:15.237876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:15.238334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:15.368010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:15.375316 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b9be2c30-5fb5-4974-ac0c-ee1b62cda57f tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.149914 Nov 27 22:00:15.375894 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4334/8804] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:15 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:16.392057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:16.392693 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:16.400061 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:16.400517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:16.401300 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:16.401748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:16.535387 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:16.542650 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-abe91390-a924-427d-9a4d-36d6283964e3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.154328 Nov 27 22:00:16.543210 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4471/8805] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:16 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:17.559721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:17.560355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:17.567140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:17.567685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:17.568499 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:17.568959 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:17.707627 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:17.715404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a0fe27d5-e091-45d8-90f9-6fb70f21e56c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.159405 Nov 27 22:00:17.716006 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4335/8806] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:17 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:18.732656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:18.733199 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:18.739890 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:18.740338 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:18.741142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:18.742209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:18.877053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:18.884781 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d904dc82-cdbf-427e-b102-ad11cfe25f7e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.155928 Nov 27 22:00:18.885358 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4472/8807] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:18 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:19.160968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-f3016bf7-2daa-40d0-bbbc-cb46ce281875 req-7196339b-342c-48e4-b311-e7f041062f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335ecee3-5742-4314-b51b-f0ff44f51ee7", "name": "network-vif-plugged", "status": "completed", "tag": "790d7e2b-dabb-4cde-a2d9-833976db3cdb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:00:19.162669 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:00:19.162669 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:00:19.172669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f3016bf7-2daa-40d0-bbbc-cb46ce281875 req-7196339b-342c-48e4-b311-e7f041062f0d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:19.173011 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-f3016bf7-2daa-40d0-bbbc-cb46ce281875 req-7196339b-342c-48e4-b311-e7f041062f0d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:19.184880 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-f3016bf7-2daa-40d0-bbbc-cb46ce281875 req-7196339b-342c-48e4-b311-e7f041062f0d service nova] Creating event network-vif-plugged:790d7e2b-dabb-4cde-a2d9-833976db3cdb for instance 335ecee3-5742-4314-b51b-f0ff44f51ee7 on nch2-master-1 Nov 27 22:00:19.189870 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-f3016bf7-2daa-40d0-bbbc-cb46ce281875 req-7196339b-342c-48e4-b311-e7f041062f0d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032634 Nov 27 22:00:19.190473 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4336/8808] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:00:19.901543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:19.902145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:19.908801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:19.909255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:19.910029 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:19.910462 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:20.040053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:20.047405 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1ee40c5b-d4a2-41d2-96bd-4171d9cff62a tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1391 microversion: 2.1 time: 0.149636 Nov 27 22:00:20.047911 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4473/8809] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:19 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:21.065153 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:21.065860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:21.073721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:21.074130 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:21.074922 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:21.075403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:21.211567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:21.219002 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-026ceabc-4fab-4127-b88e-93a577957a83 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1563 microversion: 2.1 time: 0.157855 Nov 27 22:00:21.219635 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4337/8810] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:21 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:21.235044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:21.235676 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:21.242832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:21.243310 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:21.244102 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:21.244570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:21.381798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:21.389919 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2e663e36-58ab-459b-b06f-e7ccce199b0c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1563 microversion: 2.1 time: 0.158682 Nov 27 22:00:21.390493 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4474/8811] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:21 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:22.976364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:00:22.977016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:22.979946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-92805691-2aa5-4632-97ed-818a7f516352 req-754869ac-a7d8-46c4-bbc7-9de10c7f99d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335ecee3-5742-4314-b51b-f0ff44f51ee7", "tag": "790d7e2b-dabb-4cde-a2d9-833976db3cdb"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:00:22.981675 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:00:22.981675 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:00:22.988560 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-92805691-2aa5-4632-97ed-818a7f516352 req-754869ac-a7d8-46c4-bbc7-9de10c7f99d5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:22.989010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-92805691-2aa5-4632-97ed-818a7f516352 req-754869ac-a7d8-46c4-bbc7-9de10c7f99d5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:22.989659 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:22.990139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:22.990989 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:22.991974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:23.000750 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-92805691-2aa5-4632-97ed-818a7f516352 req-754869ac-a7d8-46c4-bbc7-9de10c7f99d5 service nova] Creating event network-changed:790d7e2b-dabb-4cde-a2d9-833976db3cdb for instance 335ecee3-5742-4314-b51b-f0ff44f51ee7 on nch2-master-1 Nov 27 22:00:23.006545 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-92805691-2aa5-4632-97ed-818a7f516352 req-754869ac-a7d8-46c4-bbc7-9de10c7f99d5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Nov 27 22:00:23.008011 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4475/8812] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:00:23.133668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:00:23.141075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b50b2d8a-865e-4f7e-a4d6-d980a8ca087d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1563 microversion: 2.1 time: 0.168815 Nov 27 22:00:23.141660 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4338/8813] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:00:22 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:00:54.443382 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f95d19b-9773-4e27-a7bd-fdbb3e82b7a8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:00:54.444397 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f95d19b-9773-4e27-a7bd-fdbb3e82b7a8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:00:54.450608 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f95d19b-9773-4e27-a7bd-fdbb3e82b7a8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:54.451064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f95d19b-9773-4e27-a7bd-fdbb3e82b7a8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:54.451888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f95d19b-9773-4e27-a7bd-fdbb3e82b7a8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:00:54.452331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f95d19b-9773-4e27-a7bd-fdbb3e82b7a8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:00:54.508698 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f95d19b-9773-4e27-a7bd-fdbb3e82b7a8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action" status: 200 len: 24562 microversion: 2.1 time: 0.070233 Nov 27 22:00:54.509329 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4476/8814] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:00:54 2021] POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action => generated 24562 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 22:01:24.934108 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-85767bb4-5f62-4ab5-a7a8-b76a697f027e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:01:24.940227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85767bb4-5f62-4ab5-a7a8-b76a697f027e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:24.940696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-85767bb4-5f62-4ab5-a7a8-b76a697f027e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:24.963748 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-85767bb4-5f62-4ab5-a7a8-b76a697f027e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Going to try to stop instance {{(pid=135679) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 27 22:01:25.005820 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-85767bb4-5f62-4ab5-a7a8-b76a697f027e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action" status: 202 len: 0 microversion: 2.1 time: 0.076691 Nov 27 22:01:25.006446 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4339/8815] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:01:24 2021] POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:01:25.015776 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:25.016488 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:25.024127 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:25.024594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:25.025659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:25.025840 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:25.162744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:25.170040 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6f7f500a-3c6f-4f1a-864e-dfa1364d11cf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.159174 Nov 27 22:01:25.170607 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4477/8816] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:25 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:26.189241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:26.189961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:26.196431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:26.196893 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:26.197815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:26.198825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:26.696204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:26.704539 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a6ac3cdb-806b-4d8f-a152-4e71b8709d85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.520528 Nov 27 22:01:26.705056 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4340/8817] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:26 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:27.722357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:27.722918 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:27.731080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:27.731566 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:27.732356 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:27.732805 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:27.862953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:27.870313 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41180a6c-99a2-42e4-bfc0-c58400aa994c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.151885 Nov 27 22:01:27.870884 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4478/8818] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:27 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:28.887904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:28.888529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:28.895378 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:28.895853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:28.896663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:28.897104 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:29.025981 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:29.034306 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db63e483-0119-42a1-9c72-89b9911e2307 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.150782 Nov 27 22:01:29.034887 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4341/8819] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:28 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:30.051996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:30.052600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:30.059913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:30.060363 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:30.061135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:30.061573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:30.189332 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:30.196852 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ceb5866e-a2cd-4409-a032-4ed3884a8fe4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.148593 Nov 27 22:01:30.197425 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4479/8820] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:30 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:31.214507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:31.215720 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:31.222417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:31.222888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:31.223717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:31.224169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:31.357101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:31.365682 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-635299e9-7fb4-4ec2-ac96-5949fb6b068e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.154963 Nov 27 22:01:31.366265 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4342/8821] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:31 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:32.382847 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:32.383553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:32.390692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:32.391550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:32.392790 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:32.393237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:32.527107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:32.534984 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3bcb72d3-effd-4f34-8699-9104d8a6acc4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.156078 Nov 27 22:01:32.535584 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4480/8822] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:32 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:33.551953 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:33.552590 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:33.559423 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:33.559898 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:33.560693 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:33.561147 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:33.744319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:33.751810 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92d7345d-767b-4987-922f-9eed017ed678 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.203552 Nov 27 22:01:33.752389 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4343/8823] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:33 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:34.769892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:34.770497 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:34.777220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:34.777669 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:34.778451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:34.778888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:34.952162 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:34.959524 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-fc70a183-24b6-4e02-90c6-39d2db663b92 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1692 microversion: 2.1 time: 0.193308 Nov 27 22:01:34.960108 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4481/8824] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:34 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:35.977375 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:35.978001 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:35.984776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:35.985244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:35.986036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:35.986492 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:36.115666 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:36.123848 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4f6fcb2d-d7b0-41e2-8e6f-31c76c504a26 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1669 microversion: 2.1 time: 0.150172 Nov 27 22:01:36.124420 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4344/8825] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:35 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:37.217619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7d03eee8-0980-4032-9a58-75de86e44ff2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:01:37.218617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7d03eee8-0980-4032-9a58-75de86e44ff2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:37.227752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d03eee8-0980-4032-9a58-75de86e44ff2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:37.228205 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d03eee8-0980-4032-9a58-75de86e44ff2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:37.229021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d03eee8-0980-4032-9a58-75de86e44ff2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:37.229461 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7d03eee8-0980-4032-9a58-75de86e44ff2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:37.303136 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7d03eee8-0980-4032-9a58-75de86e44ff2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action" status: 200 len: 37692 microversion: 2.1 time: 0.089740 Nov 27 22:01:37.303847 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4482/8826] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:01:37 2021] POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action => generated 37692 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 22:01:37.314937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a567e7f9-8b1a-43de-ad72-439e2c2de8ef tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:01:37.321809 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a567e7f9-8b1a-43de-ad72-439e2c2de8ef tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:37.322280 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a567e7f9-8b1a-43de-ad72-439e2c2de8ef tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:37.345460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a567e7f9-8b1a-43de-ad72-439e2c2de8ef tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Going to try to start instance {{(pid=135679) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 27 22:01:37.385713 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a567e7f9-8b1a-43de-ad72-439e2c2de8ef tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action" status: 202 len: 0 microversion: 2.1 time: 0.074429 Nov 27 22:01:37.386346 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4345/8827] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:01:37 2021] POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:01:37.396045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:37.396746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:37.406255 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:37.406707 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:37.407998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:37.409541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:37.631281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:37.639402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3f075feb-8657-4f76-bd4f-5c31d79b2542 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1678 microversion: 2.1 time: 0.247020 Nov 27 22:01:37.639985 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4483/8828] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:37 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:01:38.662815 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:38.663469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:38.669604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:38.670069 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:38.670851 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:38.671326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:38.805192 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:38.812660 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9a37751f-f121-4d15-b525-f2297eea22eb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1678 microversion: 2.1 time: 0.154904 Nov 27 22:01:38.813248 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4346/8829] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:38 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:01:39.831824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:01:39.832464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:01:39.839048 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:39.839559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:39.840331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:01:39.840768 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:01:39.975683 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:01:39.983669 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a758e297-711c-4a6a-a99c-44491b8acc7c tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1682 microversion: 2.1 time: 0.155479 Nov 27 22:01:39.984235 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4484/8830] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:01:39 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:06.682409 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:02:06.683102 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:02:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:02:10.218675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ea76e77-8018-4f65-94dc-d0661bd16426 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:10.219644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ea76e77-8018-4f65-94dc-d0661bd16426 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:10.225669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ea76e77-8018-4f65-94dc-d0661bd16426 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:10.226134 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ea76e77-8018-4f65-94dc-d0661bd16426 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:10.226920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ea76e77-8018-4f65-94dc-d0661bd16426 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:10.227406 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ea76e77-8018-4f65-94dc-d0661bd16426 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:10.278846 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ea76e77-8018-4f65-94dc-d0661bd16426 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action" status: 200 len: 62258 microversion: 2.1 time: 0.064052 Nov 27 22:02:10.279527 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4347/8831] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:02:10 2021] POST /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7/action => generated 62258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 22:02:27.370317 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:27.370874 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:27.372500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-e27b28f2-af52-4f1a-8ac4-2649e05527e5 req-e2845e87-7dd1-4a68-980e-a5476e1cac70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335ecee3-5742-4314-b51b-f0ff44f51ee7", "tag": "790d7e2b-dabb-4cde-a2d9-833976db3cdb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:27.374620 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:02:27.374620 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:02:27.378056 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:27.378538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:27.379349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:27.379882 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:27.383049 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e27b28f2-af52-4f1a-8ac4-2649e05527e5 req-e2845e87-7dd1-4a68-980e-a5476e1cac70 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:27.383540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-e27b28f2-af52-4f1a-8ac4-2649e05527e5 req-e2845e87-7dd1-4a68-980e-a5476e1cac70 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:27.395291 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-e27b28f2-af52-4f1a-8ac4-2649e05527e5 req-e2845e87-7dd1-4a68-980e-a5476e1cac70 service nova] Creating event network-changed:790d7e2b-dabb-4cde-a2d9-833976db3cdb for instance 335ecee3-5742-4314-b51b-f0ff44f51ee7 on nch2-master-1 Nov 27 22:02:27.399840 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-e27b28f2-af52-4f1a-8ac4-2649e05527e5 req-e2845e87-7dd1-4a68-980e-a5476e1cac70 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031343 Nov 27 22:02:27.400742 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4348/8832] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:02:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 22:02:27.407022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 22:02:27.500553 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d0c0c27-9109-404f-b15b-20329b6e51e2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 204 len: 0 microversion: 2.1 time: 0.134268 Nov 27 22:02:27.502055 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4485/8833] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 22:02:27 2021] DELETE /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 22:02:27.511729 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:27.512460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:27.518947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:27.519476 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:27.520311 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:27.520900 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:27.670201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:27.678467 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-abdd7877-10e7-4b9d-ba58-619c845e98da tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1688 microversion: 2.1 time: 0.171693 Nov 27 22:02:27.679861 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4349/8834] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:27 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:28.697892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:28.698500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:28.705227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:28.705679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:28.706453 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:28.706887 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:28.843583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:28.850951 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0fb14e8-e319-4c73-9e2b-06f6172170b2 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1569 microversion: 2.1 time: 0.157350 Nov 27 22:02:28.851537 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4486/8835] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:28 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:29.771580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-212c6076-b209-457a-ad9a-bd4b5a0b7700 req-bc678279-bd9f-4070-8c3f-a06eec314c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335ecee3-5742-4314-b51b-f0ff44f51ee7", "name": "network-vif-deleted", "tag": "790d7e2b-dabb-4cde-a2d9-833976db3cdb"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:29.773386 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:02:29.773386 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:02:29.783405 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-212c6076-b209-457a-ad9a-bd4b5a0b7700 req-bc678279-bd9f-4070-8c3f-a06eec314c97 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:29.783904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-212c6076-b209-457a-ad9a-bd4b5a0b7700 req-bc678279-bd9f-4070-8c3f-a06eec314c97 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:29.798741 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-212c6076-b209-457a-ad9a-bd4b5a0b7700 req-bc678279-bd9f-4070-8c3f-a06eec314c97 service nova] Creating event network-vif-deleted:790d7e2b-dabb-4cde-a2d9-833976db3cdb for instance 335ecee3-5742-4314-b51b-f0ff44f51ee7 on nch2-master-1 Nov 27 22:02:29.803992 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-212c6076-b209-457a-ad9a-bd4b5a0b7700 req-bc678279-bd9f-4070-8c3f-a06eec314c97 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035991 Nov 27 22:02:29.804622 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4350/8836] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:02:29.867881 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:29.868503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:29.875553 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:29.876068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:29.876914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:29.877357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:29.912071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:29.912503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:29.912947 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lazy-loading 'fault' on Instance uuid 335ecee3-5742-4314-b51b-f0ff44f51ee7 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 22:02:29.955130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:29.962818 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-83f1235e-376d-4469-ac7b-41f6573343d8 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 200 len: 1355 microversion: 2.1 time: 0.098603 Nov 27 22:02:29.963453 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4487/8837] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:29 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 1355 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:30.983812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:30.984574 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 335ecee3-5742-4314-b51b-f0ff44f51ee7] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:30.990927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:30.991431 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:30.992234 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:30.992692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:31.005776 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] HTTP exception thrown: Instance 335ecee3-5742-4314-b51b-f0ff44f51ee7 could not be found. Nov 27 22:02:31.006669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Returning 404 to user: Instance 335ecee3-5742-4314-b51b-f0ff44f51ee7 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 22:02:31.007603 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e85d44f7-3afb-4fa4-8f80-498f6893edcc tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7" status: 404 len: 111 microversion: 2.1 time: 0.029324 Nov 27 22:02:31.008139 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4351/8838] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:30 2021] GET /compute/v2.1/servers/335ecee3-5742-4314-b51b-f0ff44f51ee7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 22:02:33.970516 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-203a6791-c30f-44b3-bad7-0e31b88f7f71 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '.version_select at 0x7f15c7977280>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:34.003418 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-203a6791-c30f-44b3-bad7-0e31b88f7f71 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-628360275" status: 202 len: 0 microversion: 2.1 time: 0.037227 Nov 27 22:02:34.004091 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4488/8839] 10.222.0.21 () {58 vars in 1280 bytes} [Sat Nov 27 22:02:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-628360275 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:02:34.031390 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-afe2ff86-8e05-4841-b136-f18b5e3c0fd9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: .version_select at 0x7f15c6b02040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1329355949"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:34.047517 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-afe2ff86-8e05-4841-b136-f18b5e3c0fd9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:02:34.052521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-afe2ff86-8e05-4841-b136-f18b5e3c0fd9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:02:34.206265 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-afe2ff86-8e05-4841-b136-f18b5e3c0fd9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:02:34.211909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-afe2ff86-8e05-4841-b136-f18b5e3c0fd9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:02:34.226671 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-afe2ff86-8e05-4841-b136-f18b5e3c0fd9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.199643 Nov 27 22:02:34.227296 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4352/8840] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 22:02:34 2021] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:40.008206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-484668997", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "networks": [{"uuid": "d5778bdc-2447-46c6-b2eb-311c32d91678"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1329355949", "security_groups": [{"name": "tempest-secgroup-smoke-1344239683"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:40.119798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] validate_networks() for [('d5778bdc-2447-46c6-b2eb-311c32d91678', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 22:02:40.625121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 22:02:40.625628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 22:02:40.626237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 22:02:40.626791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 22:02:40.627390 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 22:02:40.636609 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:40.637147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:40.638679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:40.639202 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:40.655925 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:02:40.660838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Getting quotas for user 91a121eeb37c42efb5cab8c884e74c10 and project 5b468a4008c24bb3a5c854460c0e26b0. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:02:40.673077 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 22:02:40.675587 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 22:02:40.727780 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-33077e3a-cd36-4961-9193-e77e41a1f5b4 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723227 Nov 27 22:02:40.728563 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4489/8841] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 22:02:40 2021] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 22:02:40.739484 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12a78b26-bf61-46f4-a5aa-607f73161d61 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:40.740794 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12a78b26-bf61-46f4-a5aa-607f73161d61 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:40.803926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-12a78b26-bf61-46f4-a5aa-607f73161d61 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:40.811724 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12a78b26-bf61-46f4-a5aa-607f73161d61 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1266 microversion: 2.1 time: 0.076895 Nov 27 22:02:40.812309 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4353/8842] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:40 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:41.830975 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:41.833376 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:41.845656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:41.846605 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:41.856175 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:41.857641 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:41.938459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:41.949044 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-df16cff6-09f6-4cfa-8124-ddd67201f435 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1324 microversion: 2.1 time: 0.123872 Nov 27 22:02:41.949958 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4490/8843] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:41 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1324 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:42.967615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:42.968243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:42.975950 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:42.976450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:42.977479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:42.977934 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:43.139988 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:43.148611 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1834ffe4-5fb3-4433-99e9-3d65cd1e4059 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1392 microversion: 2.1 time: 0.185345 Nov 27 22:02:43.149294 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4354/8844] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:42 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:43.352457 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ea762057-7cb1-44c2-ab4f-4273bd943189 req-182b3c65-d7bb-4ffa-8f82-1c77c8a0f7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5752f691-9cae-445e-b57e-eb135de3ad51", "tag": "b41ed760-0783-4f91-9185-effcfccbb245"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:43.354131 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:02:43.354131 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:02:43.363152 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ea762057-7cb1-44c2-ab4f-4273bd943189 req-182b3c65-d7bb-4ffa-8f82-1c77c8a0f7bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:43.363627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ea762057-7cb1-44c2-ab4f-4273bd943189 req-182b3c65-d7bb-4ffa-8f82-1c77c8a0f7bc service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:43.376956 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ea762057-7cb1-44c2-ab4f-4273bd943189 req-182b3c65-d7bb-4ffa-8f82-1c77c8a0f7bc service nova] Creating event network-changed:b41ed760-0783-4f91-9185-effcfccbb245 for instance 5752f691-9cae-445e-b57e-eb135de3ad51 on nch2-master-1 Nov 27 22:02:43.382707 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ea762057-7cb1-44c2-ab4f-4273bd943189 req-182b3c65-d7bb-4ffa-8f82-1c77c8a0f7bc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129426 Nov 27 22:02:43.383945 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4491/8845] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:02:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:02:44.166101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:44.166877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:44.174136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:44.174609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:44.175432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:44.175890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:44.312495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:44.319905 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ed260221-e776-4cb3-b085-dc7741298c88 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1392 microversion: 2.1 time: 0.157640 Nov 27 22:02:44.320479 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4355/8846] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:44 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:45.338179 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:45.338911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:45.345224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:45.345684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:45.346463 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:45.346909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:45.480228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:45.488293 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-bf2a5182-97e4-4247-86a7-62748110ca7d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1392 microversion: 2.1 time: 0.154990 Nov 27 22:02:45.488889 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4492/8847] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:45 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:46.505083 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:46.505716 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:46.513117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:46.513589 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:46.514399 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:46.514854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:46.649454 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:46.657329 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-83dde3e5-7107-4924-9a66-85b341738073 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1392 microversion: 2.1 time: 0.155936 Nov 27 22:02:46.657902 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4356/8848] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:46 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:47.673725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:47.674333 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:47.680930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:47.681384 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:47.682159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:47.682594 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:47.817957 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:47.825871 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ae5ffe33-80a3-4c28-8917-8b1ab25ff3bb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1392 microversion: 2.1 time: 0.155355 Nov 27 22:02:47.826507 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4493/8849] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:47 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:48.842394 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:48.843029 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:48.849824 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:48.850298 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:48.851089 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:48.851567 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:48.985504 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:48.992732 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1d8b3fcd-e239-4ae5-b8f1-77129e50a605 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1392 microversion: 2.1 time: 0.154700 Nov 27 22:02:48.993312 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4357/8850] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:48 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:49.668085 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2687231e-8d73-44ad-86f2-b43d8e1d4ceb req-c0b98aaa-1912-4b71-ba7c-682370f96d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5752f691-9cae-445e-b57e-eb135de3ad51", "name": "network-vif-plugged", "status": "completed", "tag": "b41ed760-0783-4f91-9185-effcfccbb245"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:49.669654 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:02:49.669654 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:02:49.677392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2687231e-8d73-44ad-86f2-b43d8e1d4ceb req-c0b98aaa-1912-4b71-ba7c-682370f96d6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:49.677802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2687231e-8d73-44ad-86f2-b43d8e1d4ceb req-c0b98aaa-1912-4b71-ba7c-682370f96d6f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:49.690421 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2687231e-8d73-44ad-86f2-b43d8e1d4ceb req-c0b98aaa-1912-4b71-ba7c-682370f96d6f service nova] Creating event network-vif-plugged:b41ed760-0783-4f91-9185-effcfccbb245 for instance 5752f691-9cae-445e-b57e-eb135de3ad51 on nch2-master-1 Nov 27 22:02:49.695345 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2687231e-8d73-44ad-86f2-b43d8e1d4ceb req-c0b98aaa-1912-4b71-ba7c-682370f96d6f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030928 Nov 27 22:02:49.695939 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4494/8851] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:02:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:02:50.009632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:50.010259 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:50.017665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:50.018137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:50.018932 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:50.019420 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:50.152669 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:50.160709 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b3a6d847-df5a-4e3a-896d-d2bec7f76481 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1392 microversion: 2.1 time: 0.155056 Nov 27 22:02:50.161307 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4358/8852] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:50 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:51.178798 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:51.179543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:51.186123 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:51.186581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:51.187404 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:51.187851 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:51.333022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:51.340592 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6c854620-05e3-45a4-bdea-dacc55e14a85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1563 microversion: 2.1 time: 0.166730 Nov 27 22:02:51.341238 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4495/8853] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:51 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:51.357239 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:51.358145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:51.364990 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:51.365455 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:51.366244 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:51.366696 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:51.502723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:51.510396 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f9bc1aee-ac02-428e-9427-78860172ec82 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1563 microversion: 2.1 time: 0.157367 Nov 27 22:02:51.511103 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4359/8854] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:51 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:02:53.118101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4b3096d9-ca0e-4a09-8e94-a613fdeab352 req-91f7e6a4-21cc-4253-b967-040d1d7f86a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5752f691-9cae-445e-b57e-eb135de3ad51", "tag": "b41ed760-0783-4f91-9185-effcfccbb245"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:02:53.119685 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:02:53.119685 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:02:53.121353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:02:53.122047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:02:53.129771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:53.130231 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:53.131027 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:53.131570 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:53.133522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4b3096d9-ca0e-4a09-8e94-a613fdeab352 req-91f7e6a4-21cc-4253-b967-040d1d7f86a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:02:53.133984 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4b3096d9-ca0e-4a09-8e94-a613fdeab352 req-91f7e6a4-21cc-4253-b967-040d1d7f86a1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:02:53.146299 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4b3096d9-ca0e-4a09-8e94-a613fdeab352 req-91f7e6a4-21cc-4253-b967-040d1d7f86a1 service nova] Creating event network-changed:b41ed760-0783-4f91-9185-effcfccbb245 for instance 5752f691-9cae-445e-b57e-eb135de3ad51 on nch2-master-1 Nov 27 22:02:53.151633 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4b3096d9-ca0e-4a09-8e94-a613fdeab352 req-91f7e6a4-21cc-4253-b967-040d1d7f86a1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037195 Nov 27 22:02:53.152271 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4360/8855] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:02:53.358875 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:02:53.366612 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-48afa1a4-3d96-411e-b0c7-440bb6196462 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1563 microversion: 2.1 time: 0.256562 Nov 27 22:02:53.367627 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4496/8856] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:02:53 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:03:26.647868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7f69d1a3-57a5-4b2a-8df1-2872270765c6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:03:26.648879 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7f69d1a3-57a5-4b2a-8df1-2872270765c6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:03:26.656307 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f69d1a3-57a5-4b2a-8df1-2872270765c6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:26.657169 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f69d1a3-57a5-4b2a-8df1-2872270765c6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:26.658017 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f69d1a3-57a5-4b2a-8df1-2872270765c6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:26.658493 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7f69d1a3-57a5-4b2a-8df1-2872270765c6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:26.713073 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7f69d1a3-57a5-4b2a-8df1-2872270765c6 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action" status: 200 len: 24570 microversion: 2.1 time: 0.070086 Nov 27 22:03:26.713641 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4361/8857] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:03:26 2021] POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 22:03:57.139750 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:03:57.140319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:03:57.146137 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:57.146610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:57.147413 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:57.147850 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:57.169809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lazy-loading 'flavor' on Instance uuid 5752f691-9cae-445e-b57e-eb135de3ad51 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 22:03:57.235082 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5e66c01c-048a-4b32-a929-941efbdc8bf3 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action" status: 202 len: 0 microversion: 2.1 time: 0.285805 Nov 27 22:03:57.235663 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4497/8858] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:03:56 2021] POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 22:03:57.244357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:03:57.245750 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:03:57.253518 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:57.253985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:57.254787 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:57.255243 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:57.391600 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:03:57.399321 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3688467b-ee91-4cfb-a52e-8c7afa9f4bf1 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1689 microversion: 2.1 time: 0.159068 Nov 27 22:03:57.399887 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4362/8859] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:03:57 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:03:58.419517 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:03:58.420207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:03:58.426415 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:58.426861 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:58.427668 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:58.428104 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:58.563900 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:03:58.571384 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6a0f869b-ad89-4625-8b3f-e6175ee33504 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1689 microversion: 2.1 time: 0.157285 Nov 27 22:03:58.571967 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4498/8860] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:03:58 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:03:59.588284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:03:59.588911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:03:59.596398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:59.596869 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:59.597665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:03:59.598120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:03:59.734762 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:03:59.742169 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac561e6c-7b9c-4f79-a6a8-4a54affc4468 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1672 microversion: 2.1 time: 0.157568 Nov 27 22:03:59.742725 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4363/8861] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:03:59 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:04:00.830236 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-86709479-1a6b-4da1-912a-37ba20243e1b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:00.831167 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-86709479-1a6b-4da1-912a-37ba20243e1b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:00.837895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86709479-1a6b-4da1-912a-37ba20243e1b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:00.838349 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86709479-1a6b-4da1-912a-37ba20243e1b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:00.839131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86709479-1a6b-4da1-912a-37ba20243e1b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:00.839639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-86709479-1a6b-4da1-912a-37ba20243e1b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:00.888551 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-86709479-1a6b-4da1-912a-37ba20243e1b tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action" status: 200 len: 38465 microversion: 2.1 time: 0.062009 Nov 27 22:04:00.889184 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4499/8862] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:04:00 2021] POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action => generated 38465 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 22:04:00.900116 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-81b187a8-cf77-488d-a3cc-7b43137dd213 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:00.900663 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-81b187a8-cf77-488d-a3cc-7b43137dd213 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:00.908384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81b187a8-cf77-488d-a3cc-7b43137dd213 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:00.909005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81b187a8-cf77-488d-a3cc-7b43137dd213 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:00.910389 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81b187a8-cf77-488d-a3cc-7b43137dd213 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:00.910920 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-81b187a8-cf77-488d-a3cc-7b43137dd213 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:00.974932 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-81b187a8-cf77-488d-a3cc-7b43137dd213 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action" status: 202 len: 0 microversion: 2.1 time: 0.078315 Nov 27 22:04:00.975826 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4364/8863] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:04:00 2021] POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:04:00.984617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:00.985323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:00.992880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:00.993597 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:00.994470 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:00.994933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:01.215015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:01.221096 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9f02fdb7-410e-4397-89af-942427c03bbb tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1678 microversion: 2.1 time: 0.240787 Nov 27 22:04:01.221667 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4500/8864] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:00 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:02.239337 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:02.240060 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:02.247057 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:02.248058 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:02.248861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:02.249322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:02.393849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:02.401711 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d463e74f-1281-486d-adc4-9e28c521dddd tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1678 microversion: 2.1 time: 0.166832 Nov 27 22:04:02.402517 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4365/8865] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:02 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:03.418820 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:03.419941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:03.427392 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:03.427841 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:03.428616 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:03.429051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:03.563483 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:03.570745 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b01618d5-6c01-45af-b329-66a15136bc85 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1681 microversion: 2.1 time: 0.155665 Nov 27 22:04:03.571320 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4501/8866] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:03 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:03.660267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-67c46165-a8c6-4686-93d4-01f4907d18f9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:03.661204 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-67c46165-a8c6-4686-93d4-01f4907d18f9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:03.670190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67c46165-a8c6-4686-93d4-01f4907d18f9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:03.670595 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67c46165-a8c6-4686-93d4-01f4907d18f9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:03.671416 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67c46165-a8c6-4686-93d4-01f4907d18f9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:03.671868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-67c46165-a8c6-4686-93d4-01f4907d18f9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:03.711380 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-67c46165-a8c6-4686-93d4-01f4907d18f9 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action" status: 200 len: 38465 microversion: 2.1 time: 0.054608 Nov 27 22:04:03.712014 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4366/8867] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:04:03 2021] POST /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51/action => generated 38465 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 22:04:04.712734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:04.712734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:04.718465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-9c0306f3-8eef-435f-9c62-336669cb4952 req-b7d150f6-8ac4-4a73-b2e5-b12a9935ffcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5752f691-9cae-445e-b57e-eb135de3ad51", "tag": "b41ed760-0783-4f91-9185-effcfccbb245"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:04.720037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:04.720368 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:04:04.720368 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:04:04.720511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:04.721279 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:04.721724 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:04.729304 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9c0306f3-8eef-435f-9c62-336669cb4952 req-b7d150f6-8ac4-4a73-b2e5-b12a9935ffcd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:04.729937 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-9c0306f3-8eef-435f-9c62-336669cb4952 req-b7d150f6-8ac4-4a73-b2e5-b12a9935ffcd service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:04.741980 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-9c0306f3-8eef-435f-9c62-336669cb4952 req-b7d150f6-8ac4-4a73-b2e5-b12a9935ffcd service nova] Creating event network-changed:b41ed760-0783-4f91-9185-effcfccbb245 for instance 5752f691-9cae-445e-b57e-eb135de3ad51 on nch2-master-1 Nov 27 22:04:04.747114 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-9c0306f3-8eef-435f-9c62-336669cb4952 req-b7d150f6-8ac4-4a73-b2e5-b12a9935ffcd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034140 Nov 27 22:04:04.747865 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4367/8868] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:04:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:04:04.748301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Going to try to terminate instance {{(pid=135680) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 22:04:04.838160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e5dfbe76-a577-4ea0-84d2-546c9477e92d tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 204 len: 0 microversion: 2.1 time: 0.129988 Nov 27 22:04:04.842483 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4502/8869] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 22:04:04 2021] DELETE /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 22:04:04.848101 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:04.849037 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:04.856605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:04.857228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:04.858140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:04.858735 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:05.005608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:05.013951 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-402ee6e2-62f4-4dbd-bba9-1f480a7d0e86 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1687 microversion: 2.1 time: 0.169951 Nov 27 22:04:05.014647 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4368/8870] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:04 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:04:06.032634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:06.033330 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:06.040041 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:06.040490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:06.041265 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:06.041702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:06.173067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:06.180440 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a7347041-ffa0-4fde-b5b1-a843f20abe40 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1569 microversion: 2.1 time: 0.152363 Nov 27 22:04:06.181007 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4503/8871] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:06 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:07.065421 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-0ca1bf1b-ba0c-4a0c-980f-b66a9f8bfbc5 req-26e0761d-8225-4387-b542-c3d495435411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5752f691-9cae-445e-b57e-eb135de3ad51", "name": "network-vif-deleted", "tag": "b41ed760-0783-4f91-9185-effcfccbb245"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:07.067161 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:04:07.067161 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:04:07.078042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0ca1bf1b-ba0c-4a0c-980f-b66a9f8bfbc5 req-26e0761d-8225-4387-b542-c3d495435411 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:07.078604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-0ca1bf1b-ba0c-4a0c-980f-b66a9f8bfbc5 req-26e0761d-8225-4387-b542-c3d495435411 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:07.092789 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-0ca1bf1b-ba0c-4a0c-980f-b66a9f8bfbc5 req-26e0761d-8225-4387-b542-c3d495435411 service nova] Creating event network-vif-deleted:b41ed760-0783-4f91-9185-effcfccbb245 for instance 5752f691-9cae-445e-b57e-eb135de3ad51 on nch2-master-1 Nov 27 22:04:07.098095 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-0ca1bf1b-ba0c-4a0c-980f-b66a9f8bfbc5 req-26e0761d-8225-4387-b542-c3d495435411 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Nov 27 22:04:07.099345 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4369/8872] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:04:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:04:07.197478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:07.198091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:07.205410 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:07.205867 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:07.206662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:07.207107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:07.239758 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:07.240266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:07.240657 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.objects.instance [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lazy-loading 'fault' on Instance uuid 5752f691-9cae-445e-b57e-eb135de3ad51 {{(pid=135680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 22:04:07.279894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a121eeb37c42efb5cab8c884e74c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b468a4008c24bb3a5c854460c0e26b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:07.287455 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0383ee8f-d8ab-4930-ae51-62096faf657e tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 200 len: 1356 microversion: 2.1 time: 0.093737 Nov 27 22:04:07.288021 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4504/8873] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:07 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 1356 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:08.305756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:08.306469 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] [instance: 5752f691-9cae-445e-b57e-eb135de3ad51] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:08.313449 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:08.313911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:08.314700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:08.315149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:08.328015 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] HTTP exception thrown: Instance 5752f691-9cae-445e-b57e-eb135de3ad51 could not be found. Nov 27 22:04:08.328608 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Returning 404 to user: Instance 5752f691-9cae-445e-b57e-eb135de3ad51 could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 22:04:08.329432 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2dd6721d-b280-4186-a37a-409c3ee7ddaf tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51" status: 404 len: 111 microversion: 2.1 time: 0.027784 Nov 27 22:04:08.329941 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4370/8874] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:08 2021] GET /compute/v2.1/servers/5752f691-9cae-445e-b57e-eb135de3ad51 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 22:04:11.980178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-522de88c-9e3a-4819-9b12-0e3db35d47d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] Calling method '.version_select at 0x7f15c73e8dc0>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:12.004224 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-522de88c-9e3a-4819-9b12-0e3db35d47d0 tempest-TestNetworkAdvancedServerOps-1081281150 tempest-TestNetworkAdvancedServerOps-1081281150-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1329355949" status: 202 len: 0 microversion: 2.1 time: 0.028046 Nov 27 22:04:12.004814 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4505/8875] 10.222.0.21 () {58 vars in 1283 bytes} [Sat Nov 27 22:04:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1329355949 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 22:04:23.267803 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-48c9d45f-e222-4359-896f-e49b4d5741f5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'create', calling method: .version_select at 0x7f15c6ce51f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1658160235"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:23.282466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-48c9d45f-e222-4359-896f-e49b4d5741f5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:04:23.288872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-48c9d45f-e222-4359-896f-e49b4d5741f5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for user 1ca9642dc2294528a287553029ab7c54 and project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:04:23.591985 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-48c9d45f-e222-4359-896f-e49b4d5741f5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:04:23.597269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-48c9d45f-e222-4359-896f-e49b4d5741f5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for user 1ca9642dc2294528a287553029ab7c54 and project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:04:23.613013 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-48c9d45f-e222-4359-896f-e49b4d5741f5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.525617 Nov 27 22:04:23.613622 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4371/8876] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 22:04:23 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:24.689929 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1564864526", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1658160235", "security_groups": [{"name": "tempest-secgroup-smoke-1667558484"}], "networks": [{"uuid": "4b2d3d9a-f484-43ca-b576-e9a0753d2ca9"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:24.805848 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] validate_networks() for [('4b2d3d9a-f484-43ca-b576-e9a0753d2ca9', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 22:04:25.191500 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 22:04:25.191924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 22:04:25.192427 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 22:04:25.192838 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 22:04:25.193244 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 22:04:25.202209 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:25.202662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:25.203558 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:25.204021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:25.220365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:04:25.225505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for user 1ca9642dc2294528a287553029ab7c54 and project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:04:25.238506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 22:04:25.240915 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 22:04:25.286932 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b87ae56-39e9-445e-bd6f-b76573a3f5af tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.601737 Nov 27 22:04:25.287611 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4506/8877] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 22:04:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 27 22:04:25.298793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68f7a88f-d8ab-4d58-bf72-5e56d0e07466 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:25.299450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68f7a88f-d8ab-4d58-bf72-5e56d0e07466 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:25.352514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-68f7a88f-d8ab-4d58-bf72-5e56d0e07466 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:25.363781 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68f7a88f-d8ab-4d58-bf72-5e56d0e07466 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1247 microversion: 2.1 time: 0.069742 Nov 27 22:04:25.364608 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4372/8878] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:25 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:04:26.382207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1495cc1f-422d-48ef-9fd5-ce695df230d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:26.382989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1495cc1f-422d-48ef-9fd5-ce695df230d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:26.446914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1495cc1f-422d-48ef-9fd5-ce695df230d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:26.455411 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1495cc1f-422d-48ef-9fd5-ce695df230d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1247 microversion: 2.1 time: 0.078074 Nov 27 22:04:26.456077 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4507/8879] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:26 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:27.472929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0dfcbc8e-b2db-472c-96b1-54602ed2f1ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:27.473710 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0dfcbc8e-b2db-472c-96b1-54602ed2f1ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:27.531919 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0dfcbc8e-b2db-472c-96b1-54602ed2f1ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:27.538938 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0dfcbc8e-b2db-472c-96b1-54602ed2f1ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1247 microversion: 2.1 time: 0.069691 Nov 27 22:04:27.539550 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4373/8880] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:27 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:28.555714 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-6fd3a334-da48-4c21-b9da-8d1de9fe424a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:28.556366 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-6fd3a334-da48-4c21-b9da-8d1de9fe424a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:28.609555 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-6fd3a334-da48-4c21-b9da-8d1de9fe424a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:28.616584 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-6fd3a334-da48-4c21-b9da-8d1de9fe424a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1247 microversion: 2.1 time: 0.064594 Nov 27 22:04:28.617245 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4508/8881] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:28 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:29.633861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:29.634477 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:29.642522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:29.642986 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:29.643904 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:29.644358 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:29.703699 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:29.710944 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0c136a58-157d-44d8-944c-515d4c30e4ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1251 microversion: 2.1 time: 0.080988 Nov 27 22:04:29.711555 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4374/8882] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:29 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1251 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:30.728491 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:30.729099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:30.736897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:30.737351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:30.738135 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:30.738573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:30.827324 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:30.834861 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0af0c5e1-008d-40b1-9b64-15c7ceba69e2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1305 microversion: 2.1 time: 0.110110 Nov 27 22:04:30.835497 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4509/8883] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:30 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:31.762793 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-4db50399-069b-4fd7-a709-d8772d86c7f9 req-5295579d-2fba-4391-8b3d-5d05aba84476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:31.765303 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:04:31.765303 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:04:31.778355 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4db50399-069b-4fd7-a709-d8772d86c7f9 req-5295579d-2fba-4391-8b3d-5d05aba84476 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:31.779189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-4db50399-069b-4fd7-a709-d8772d86c7f9 req-5295579d-2fba-4391-8b3d-5d05aba84476 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:31.797702 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-4db50399-069b-4fd7-a709-d8772d86c7f9 req-5295579d-2fba-4391-8b3d-5d05aba84476 service nova] Creating event network-changed:e1c50157-7077-401c-80f1-e56cabd2f5ae for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 on nch2-master-1 Nov 27 22:04:31.803204 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-4db50399-069b-4fd7-a709-d8772d86c7f9 req-5295579d-2fba-4391-8b3d-5d05aba84476 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050303 Nov 27 22:04:31.804035 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4375/8884] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:04:31.851121 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:31.851784 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:31.859941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:31.860534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:31.861323 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:31.861753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:32.066204 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:32.073870 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-15c9301a-1456-467d-a3b1-3add34f4d2b2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1373 microversion: 2.1 time: 0.226475 Nov 27 22:04:32.074551 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4510/8885] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:31 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1373 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:33.093269 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:33.094486 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:33.100874 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:33.101342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:33.102140 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:33.102602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:33.236639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:33.243919 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-92bf7152-8154-4b54-adf4-e8cd42c9d338 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1373 microversion: 2.1 time: 0.156265 Nov 27 22:04:33.244485 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4376/8886] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:33 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:34.261024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:34.261636 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:34.268456 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:34.268909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:34.269777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:34.270216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:34.404621 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:34.412084 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4b704c74-ba8d-416e-a07c-e7a4af25401a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1373 microversion: 2.1 time: 0.155044 Nov 27 22:04:34.412684 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4511/8887] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:34 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:35.429336 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:35.429968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:35.437334 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:35.437807 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:35.438616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:35.439074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:35.570263 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:35.577559 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4fc0477a-cec6-455a-9288-87cb70dfeeae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1373 microversion: 2.1 time: 0.151940 Nov 27 22:04:35.578129 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4377/8888] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:35 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:36.594377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:36.594984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:36.602267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:36.602752 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:36.603651 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:36.604107 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:36.745739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:36.753733 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-da45db34-99c5-4b06-9f8f-fe2daecf0e17 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1373 microversion: 2.1 time: 0.163670 Nov 27 22:04:36.754311 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4512/8889] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:36 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:37.772775 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:37.773433 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:37.782106 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:37.782580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:37.783428 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:37.783894 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:37.914381 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:37.921787 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2a9a7e33-272f-4da4-a4d7-96241813915a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1373 microversion: 2.1 time: 0.153728 Nov 27 22:04:37.922359 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4378/8890] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:37 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:38.292580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-10e90ff7-95cf-4fcd-af25-39c8ce478fb1 req-03064d91-2af1-4099-9205-26833b475bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "name": "network-vif-plugged", "status": "completed", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:38.294180 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:04:38.294180 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:04:38.301198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-10e90ff7-95cf-4fcd-af25-39c8ce478fb1 req-03064d91-2af1-4099-9205-26833b475bc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:38.301581 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-10e90ff7-95cf-4fcd-af25-39c8ce478fb1 req-03064d91-2af1-4099-9205-26833b475bc7 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:38.312620 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-10e90ff7-95cf-4fcd-af25-39c8ce478fb1 req-03064d91-2af1-4099-9205-26833b475bc7 service nova] Creating event network-vif-plugged:e1c50157-7077-401c-80f1-e56cabd2f5ae for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 on nch2-master-1 Nov 27 22:04:38.317889 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-10e90ff7-95cf-4fcd-af25-39c8ce478fb1 req-03064d91-2af1-4099-9205-26833b475bc7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090169 Nov 27 22:04:38.318582 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4513/8891] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:04:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:04:38.939277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:38.939923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:38.946653 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:38.947122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:38.947958 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:38.948410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:39.093840 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:39.101159 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ff7f65e6-084a-4b71-b3c2-28a225a1eab5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1373 microversion: 2.1 time: 0.166279 Nov 27 22:04:39.101732 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4379/8892] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:38 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:40.118406 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:40.119128 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:40.126601 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:40.127047 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:40.127860 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:40.128297 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:40.259628 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:40.267148 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c5025e46-7968-45b2-86c7-085f25323d2f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1558 microversion: 2.1 time: 0.152954 Nov 27 22:04:40.267749 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4514/8893] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:40 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:40.283740 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:04:40.284363 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:04:40.291056 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:40.291577 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:40.292366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:40.292837 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:40.426329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:04:40.434152 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-7ff910e6-f48e-4791-9819-59278b14deb7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1558 microversion: 2.1 time: 0.154067 Nov 27 22:04:40.434712 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4380/8894] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:04:40 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:04:42.113484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-2f241edd-d975-47c2-b9da-59dc9f07aaa1 req-3ab9240d-b0b7-49e2-852d-0f18fdb708eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:04:42.115044 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:04:42.115044 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:04:42.123492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2f241edd-d975-47c2-b9da-59dc9f07aaa1 req-3ab9240d-b0b7-49e2-852d-0f18fdb708eb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:04:42.123941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-2f241edd-d975-47c2-b9da-59dc9f07aaa1 req-3ab9240d-b0b7-49e2-852d-0f18fdb708eb service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:04:42.135599 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-2f241edd-d975-47c2-b9da-59dc9f07aaa1 req-3ab9240d-b0b7-49e2-852d-0f18fdb708eb service nova] Creating event network-changed:e1c50157-7077-401c-80f1-e56cabd2f5ae for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 on nch2-master-1 Nov 27 22:04:42.141219 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-2f241edd-d975-47c2-b9da-59dc9f07aaa1 req-3ab9240d-b0b7-49e2-852d-0f18fdb708eb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031794 Nov 27 22:04:42.141820 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4515/8895] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:04:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:05:29.659776 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:05:29.660348 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:05:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:07:06.702674 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:07:06.703153 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:07:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:07:06.749075 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:07:06.749202 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:07:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:07:08.009091 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d920613-63e3-44eb-907c-edcf8c836592] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 22:07:08.010654 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47ffaf7c-8690-4a97-abbb-a3f69f154698] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 22:07:08.014303 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:07:08.015074 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:08.023150 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:08.023657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:08.024561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:08.025242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:08.050495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lazy-loading 'flavor' on Instance uuid 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 22:07:08.465789 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [9177ab1c-28b6-4bf1-afcc-73e62aac08e3] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:07:09.035543 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d920613-63e3-44eb-907c-edcf8c836592] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48058. Nov 27 22:07:09.037075 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] [47ffaf7c-8690-4a97-abbb-a3f69f154698] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48060. Nov 27 22:07:09.482425 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [9177ab1c-28b6-4bf1-afcc-73e62aac08e3] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48062. Nov 27 22:07:09.485674 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4ce9bb92-e309-43b8-b10a-5ee2a981ce9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6/action" status: 202 len: 0 microversion: 2.1 time: 1.478910 Nov 27 22:07:09.486313 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4381/8896] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:07:08 2021] POST /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6/action => generated 0 bytes in 1480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:07:09.492555 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:07:09.493333 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe283093-1cb0-4856-a0d5-8cfe41065dca] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:07:09.497132 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:09.497821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:09.504556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:09.505000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:09.505775 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:09.506215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:09.693272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:09.700858 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4113286e-b65c-4a55-bd98-b6940972beeb tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.209996 Nov 27 22:07:09.702033 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4516/8897] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:09 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:10.720325 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:10.720969 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:10.727967 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:10.728438 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:10.729232 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:10.729686 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:10.866883 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:10.874966 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1b98b366-0ce5-4fa5-9a67-7bb730451a62 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.159733 Nov 27 22:07:10.875575 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4382/8898] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:10 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:11.892761 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:11.893451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:11.925267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:11.925725 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:11.926505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:11.926941 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:11.932045 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48076. Nov 27 22:07:11.934018 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe283093-1cb0-4856-a0d5-8cfe41065dca] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48078. Nov 27 22:07:12.066746 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:12.076982 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61bdc587-25a1-4a2f-8610-157e84f282cf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.187539 Nov 27 22:07:12.077765 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4517/8899] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:11 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:13.094656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:13.095305 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:13.102002 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:13.102465 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:13.103267 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:13.103724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:13.232657 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:13.240007 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-61b6aac0-6313-46eb-8a10-93cdcad23bb5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.149705 Nov 27 22:07:13.240578 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4383/8900] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:13 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:14.256767 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:14.257355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:14.264369 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:14.264815 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:14.265585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:14.266021 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:14.401364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:14.409160 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-aa4bbaad-a83a-4fae-ab4e-dadeb0885213 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.156080 Nov 27 22:07:14.409721 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4518/8901] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:14 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:15.426339 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:15.426971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:15.434102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:15.434585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:15.436054 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:15.436521 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:15.570933 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:15.578399 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-721c065e-4d91-4c2a-95ae-4c0a2d127791 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.155847 Nov 27 22:07:15.578967 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4384/8902] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:15 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:16.595910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:16.596562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:16.603269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:16.603732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:16.604511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:16.604951 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:16.741096 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:16.748545 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd47f54d-ffa6-4d05-8558-a360ee8ac3e9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.156865 Nov 27 22:07:16.749114 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4519/8903] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:16 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:17.765309 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:17.765929 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:17.772668 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:17.773126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:17.773916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:17.774361 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:17.905692 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:17.913075 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f7864652-9b1c-4ab3-90d4-acdb463051ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.151555 Nov 27 22:07:17.913643 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4385/8904] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:17 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:18.930565 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:18.931208 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:18.939561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:18.939834 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:18.940632 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:18.941073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:19.074791 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:19.082134 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dc1e3b54-9a93-4198-ad31-c8a33dd83802 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.155282 Nov 27 22:07:19.082704 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4520/8905] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:18 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:20.098910 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:20.099576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:20.106342 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:20.106813 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:20.107637 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:20.108095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:20.238911 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:20.246232 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a47b6939-f53c-49c1-ab22-93794704b575 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.151011 Nov 27 22:07:20.246800 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4386/8906] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:20 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:21.263706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:21.264319 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:21.270961 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:21.271447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:21.272250 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:21.272687 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:21.402372 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:21.409811 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d7fce8a8-928d-4529-8c9a-3a21f2da046f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1703 microversion: 2.1 time: 0.150075 Nov 27 22:07:21.410368 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4521/8907] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:21 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1703 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:22.427434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:22.428066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:22.434868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:22.435927 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:22.436724 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:22.437183 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:22.576415 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:22.583756 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-a10f152b-90f8-4bbd-85f6-22582273291b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1703 microversion: 2.1 time: 0.160111 Nov 27 22:07:22.584336 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4387/8908] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:22 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1703 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:22.907038 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-35adcad7-4cce-44c8-8c55-650332a30647 req-04ee8dce-522e-4cd9-b4f2-ed563dfb8769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "name": "network-vif-plugged", "status": "completed", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:07:22.908595 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:07:22.908595 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:07:22.916247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-35adcad7-4cce-44c8-8c55-650332a30647 req-04ee8dce-522e-4cd9-b4f2-ed563dfb8769 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:22.916695 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-35adcad7-4cce-44c8-8c55-650332a30647 req-04ee8dce-522e-4cd9-b4f2-ed563dfb8769 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:22.928436 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-35adcad7-4cce-44c8-8c55-650332a30647 req-04ee8dce-522e-4cd9-b4f2-ed563dfb8769 service nova] Creating event network-vif-plugged:e1c50157-7077-401c-80f1-e56cabd2f5ae for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 on nch2-master-1 Nov 27 22:07:22.931942 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [req-35adcad7-4cce-44c8-8c55-650332a30647 req-04ee8dce-522e-4cd9-b4f2-ed563dfb8769 service nova] [bf3b7e0a-ce8a-4bbc-a2ff-8032d1f1e85f] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:07:23.600912 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:23.601540 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:23.608446 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:23.608914 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:23.609705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:23.610157 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:23.741129 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:23.749307 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-1615a342-21ee-4e27-ac68-dbae7fdc39b0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1703 microversion: 2.1 time: 0.151769 Nov 27 22:07:23.750310 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4388/8909] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:23 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1703 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:07:23.949206 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [req-35adcad7-4cce-44c8-8c55-650332a30647 req-04ee8dce-522e-4cd9-b4f2-ed563dfb8769 service nova] [bf3b7e0a-ce8a-4bbc-a2ff-8032d1f1e85f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48106. Nov 27 22:07:23.953498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-35adcad7-4cce-44c8-8c55-650332a30647 req-04ee8dce-522e-4cd9-b4f2-ed563dfb8769 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.050274 Nov 27 22:07:23.954911 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4522/8910] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:07:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:07:24.770410 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:24.771038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:24.779186 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:24.779679 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:24.780475 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:24.780923 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:24.917839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:24.926057 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-771677fd-8f4c-46b7-839e-888d4bde0c98 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.160240 Nov 27 22:07:24.926644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4389/8911] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:24 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:25.945971 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:25.947892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:25.959305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:25.960072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:25.961080 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:25.961786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:26.113322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:26.121219 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0d6b3663-fd66-4635-9165-fc2d23f3011f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.180359 Nov 27 22:07:26.123049 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4523/8912] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:25 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:27.140632 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:27.141326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:27.148690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:27.148690 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:27.149618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:27.149979 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:27.316123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:27.324001 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-15747fa4-8ec0-4dab-92d7-37fd824a24de tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.188021 Nov 27 22:07:27.325008 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4390/8913] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:27 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:28.340684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:28.342099 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:28.348993 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:28.349526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:28.350471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:28.350984 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:28.501745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:28.510061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b78eaa6d-afc1-481c-955e-f629c62b01d3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.173103 Nov 27 22:07:28.510903 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4524/8914] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:28 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:29.527925 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:29.529730 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:29.536651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:29.537395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:29.538409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:29.539080 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:29.688662 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:29.698661 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ae11197-87a7-42ed-83ff-90896de7c6e4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.174320 Nov 27 22:07:29.699354 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4391/8915] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:29 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:30.716071 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:30.716607 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:30.725759 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:30.726207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:30.726994 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:30.727454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:30.885341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:30.894188 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-288764f3-13ea-4f71-83df-be88360aa1c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.182343 Nov 27 22:07:30.895031 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4525/8916] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:30 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:31.912199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:31.913764 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:31.921290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:31.921834 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:31.922709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:31.923288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:32.072189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:32.080403 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9ea6fee6-7b1b-4ebe-bcbe-00a3f3a541f6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.172194 Nov 27 22:07:32.090077 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4392/8917] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:31 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:33.097832 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:33.098562 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:33.106235 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:33.106773 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:33.107610 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:33.108051 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:33.254370 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:33.262920 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-75b6f2ce-dac5-485d-a6cf-72a14b0b8ae3 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.168745 Nov 27 22:07:33.263549 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4526/8918] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:33 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:34.280983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:34.281674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:34.290980 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:34.291586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:34.292529 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:34.293097 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:34.437199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:34.444870 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-edabc7c3-d990-4648-af63-87b8f96bd5ce tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1698 microversion: 2.1 time: 0.168748 Nov 27 22:07:34.445452 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4393/8919] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:34 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:35.461814 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:35.462430 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:35.469730 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:35.470201 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:35.471142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:35.471603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:35.680747 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:35.688531 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5bdcd67f-2880-4560-9e8d-3606c275ba63 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1680 microversion: 2.1 time: 0.230530 Nov 27 22:07:35.689110 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4527/8920] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:35 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:36.705909 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:36.706466 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:36.713248 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:36.713728 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:36.714526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:36.714987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:36.850170 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:36.858199 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-978fc8c0-1654-4f49-80b6-281d1ac6c7c7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1680 microversion: 2.1 time: 0.156113 Nov 27 22:07:36.858926 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4394/8921] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:36 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:37.875000 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:37.875656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:37.882540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:37.882998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:37.883823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:37.884264 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:38.021755 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:38.029273 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-74329f8e-0f69-4e0a-8f8b-d760393ecb75 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1623 microversion: 2.1 time: 0.158590 Nov 27 22:07:38.029847 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4528/8922] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:37 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1623 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:38.045905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6ad3d773-c0c4-4255-a380-7534758a1fc7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:07:38.046500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6ad3d773-c0c4-4255-a380-7534758a1fc7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:38.053928 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ad3d773-c0c4-4255-a380-7534758a1fc7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:38.054524 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ad3d773-c0c4-4255-a380-7534758a1fc7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:38.055667 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ad3d773-c0c4-4255-a380-7534758a1fc7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:38.056132 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6ad3d773-c0c4-4255-a380-7534758a1fc7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:38.199489 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6ad3d773-c0c4-4255-a380-7534758a1fc7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6/action" status: 202 len: 0 microversion: 2.1 time: 0.157678 Nov 27 22:07:38.200119 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4395/8923] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:07:38 2021] POST /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 22:07:38.207930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:38.208541 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:38.214588 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:38.215044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:38.216350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:38.216795 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:38.358563 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:38.365942 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7aaf44fb-1906-4856-ab73-226493e44a94 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1631 microversion: 2.1 time: 0.161648 Nov 27 22:07:38.366644 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4529/8924] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:38 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1631 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:38.936284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-93eb4806-ba82-4dce-ae24-6a8d1733c21d req-2eba4ed6-8351-4f7b-ab18-e05a6c322547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "name": "network-vif-unplugged", "status": "completed", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:07:38.937860 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:07:38.937860 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:07:38.944868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-93eb4806-ba82-4dce-ae24-6a8d1733c21d req-2eba4ed6-8351-4f7b-ab18-e05a6c322547 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:38.945379 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-93eb4806-ba82-4dce-ae24-6a8d1733c21d req-2eba4ed6-8351-4f7b-ab18-e05a6c322547 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:38.957159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.compute.server_external_events [req-93eb4806-ba82-4dce-ae24-6a8d1733c21d req-2eba4ed6-8351-4f7b-ab18-e05a6c322547 service nova] Unable to find a host for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6. Dropping event network-vif-unplugged {{(pid=135679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 27 22:07:38.958053 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-93eb4806-ba82-4dce-ae24-6a8d1733c21d req-2eba4ed6-8351-4f7b-ab18-e05a6c322547 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026154 Nov 27 22:07:38.958685 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4396/8925] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:07:38 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 22:07:39.383281 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:39.383933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:39.390897 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:39.391432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:39.392224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:39.392662 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:39.611295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:39.618601 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c4d8d4cb-0f11-48e0-bb8d-0c3306b10143 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.239109 Nov 27 22:07:39.619178 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4530/8926] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:39 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:40.636780 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:40.637395 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:40.644505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:40.644977 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:40.645776 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:40.646231 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:40.785635 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:40.793480 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-02bed8b3-b625-402e-8ffe-d2e1f3390783 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.160773 Nov 27 22:07:40.794706 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4397/8927] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:40 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:41.374872 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:07:41.375189 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:07:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:07:41.813888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:41.813888 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:41.821450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:41.821907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:41.822709 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:41.823151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:41.969241 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:41.977460 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a172243f-21d8-47d7-87b4-cd9758391a2b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.169358 Nov 27 22:07:41.978309 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4531/8928] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:41 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:42.994639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:42.995422 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:43.003187 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:43.003826 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:43.004665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:43.005124 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:43.150105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:43.159575 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-cc4c86f6-7759-4d4c-9c8b-91de3087cb7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.168707 Nov 27 22:07:43.160769 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4398/8929] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:42 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:44.176743 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:44.177381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:44.184076 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:44.184525 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:44.185295 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:44.185727 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:44.337485 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:44.345556 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e2730eb-1ce8-467c-a95d-aec9cd854c7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.172493 Nov 27 22:07:44.346126 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4532/8930] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:44 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:45.364516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:45.366271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:45.376648 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:45.377122 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:45.377975 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:45.378450 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:45.546580 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:45.554065 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6c0f9ab3-927d-46f0-88da-463fd57d7889 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.194164 Nov 27 22:07:45.554644 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4399/8931] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:45 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:46.571619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:46.572212 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:46.579136 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:46.579619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:46.580405 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:46.580843 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:46.723484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:46.731142 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-55839311-c427-4b88-9e4d-a4d748a0e976 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.163088 Nov 27 22:07:46.737513 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4533/8932] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:46 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:47.749362 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:47.749962 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:47.756727 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:47.757199 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:47.757996 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:47.758483 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:47.899005 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:47.907852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-74a1e4cf-f0ca-419b-96a5-26d41d0b9e9b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.162826 Nov 27 22:07:47.908494 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4400/8933] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:47 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:48.925229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:48.925953 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:48.933170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:48.933806 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:48.935534 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:48.936054 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:49.089883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:49.098496 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-605f9fc2-2ea8-4068-8b1e-346cb343a9a2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.177131 Nov 27 22:07:49.099081 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4534/8934] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:48 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:50.116888 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:50.117561 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:50.124777 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:50.125241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:50.126026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:50.126481 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:50.266756 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:50.274294 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-064a342a-8e1f-4d98-8e26-69ac5aafab8d tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.161126 Nov 27 22:07:50.274875 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4401/8935] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:50 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:51.291328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:51.291914 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:51.298680 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:51.299153 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:51.299954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:51.300400 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:51.433073 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:51.440642 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2f4b19fd-3de2-42de-9aaa-51235bcbded0 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.153100 Nov 27 22:07:51.441216 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4535/8936] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:51 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:52.457812 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:52.458445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:52.465271 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:52.466238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:52.467028 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:52.467523 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:52.598377 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:52.606736 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-313a3d5f-8c9d-4bf0-9075-697ad1cb1aca tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.151890 Nov 27 22:07:52.607309 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4402/8937] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:52 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:53.623533 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:53.624178 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:53.631103 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:53.631591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:53.632399 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:53.632869 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:53.762263 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:53.769605 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-5ba61bd5-f766-4748-9e49-946dd621c816 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.150408 Nov 27 22:07:53.770180 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4536/8938] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:53 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:54.786726 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:54.787386 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:54.794366 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:54.794868 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:54.795725 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:54.796182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:54.935559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:54.942916 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-24e1aaf0-d4e8-48dd-b1f0-44b83faf3c02 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.159963 Nov 27 22:07:54.943514 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4403/8939] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:54 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:55.960919 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:55.961526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:55.969142 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:55.969589 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:55.970365 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:55.970800 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:56.107227 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:56.114643 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-f77d5e2c-2fde-4054-b003-18f626bb7681 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.157732 Nov 27 22:07:56.115210 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4537/8940] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:55 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:57.132799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:57.133507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:57.140609 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:57.141072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:57.141864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:57.142313 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:57.273890 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:57.282584 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-148fa634-60a9-4964-86c8-7074aad01fe1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.154078 Nov 27 22:07:57.283399 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4404/8941] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:57 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:58.299818 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:58.300431 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:58.307147 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:58.307624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:58.308451 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:58.308884 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:58.441126 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:58.448464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d2417268-f768-4d0f-ae0d-6d14158f5cf4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.152345 Nov 27 22:07:58.449030 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4538/8942] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:58 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:07:59.062442 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-093d870d-f3b8-4e52-8e37-f3865a641174 req-8ea88b03-92f2-4280-9868-7de3ff3344d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "name": "network-vif-plugged", "status": "completed", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:07:59.063941 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:07:59.063941 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:07:59.072496 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-093d870d-f3b8-4e52-8e37-f3865a641174 req-8ea88b03-92f2-4280-9868-7de3ff3344d9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:59.072971 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-093d870d-f3b8-4e52-8e37-f3865a641174 req-8ea88b03-92f2-4280-9868-7de3ff3344d9 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:59.086348 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-093d870d-f3b8-4e52-8e37-f3865a641174 req-8ea88b03-92f2-4280-9868-7de3ff3344d9 service nova] Creating event network-vif-plugged:e1c50157-7077-401c-80f1-e56cabd2f5ae for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 on nch2-master-1 Nov 27 22:07:59.092444 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-093d870d-f3b8-4e52-8e37-f3865a641174 req-8ea88b03-92f2-4280-9868-7de3ff3344d9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 Nov 27 22:07:59.093047 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4405/8943] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:07:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:07:59.467036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:07:59.467672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:07:59.474778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:59.475230 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:59.476035 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:07:59.476467 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:07:59.610482 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:07:59.617719 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-352454e5-d5eb-4204-a4d4-920046d027d1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.155781 Nov 27 22:07:59.618276 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4539/8944] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:07:59 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:08:00.636238 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:08:00.637048 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:08:00.646203 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:08:00.646674 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:08:00.647509 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:08:00.647961 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:08:00.792806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:08:00.800267 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c1d5a3ca-2005-4081-8efd-5d791b17fc5b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1689 microversion: 2.1 time: 0.168478 Nov 27 22:08:00.810632 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4406/8945] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:08:00 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:08:01.817973 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:08:01.818580 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:08:01.825634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:08:01.826091 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:08:01.826876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:08:01.827341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:08:01.959082 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:08:01.966623 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9b62ac35-dec4-4db9-9149-de9db626c4c5 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1676 microversion: 2.1 time: 0.152394 Nov 27 22:08:01.967194 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4540/8946] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:08:01 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:38.426798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:38.434506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:38.443373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:38.443373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:38.443373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:38.443373 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:38.470947 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 22:09:38.512536 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-ac3d56cb-38a7-4917-a29e-73a60ebccde9 req-bb61f83f-9175-4edf-82cb-547b5e8a46e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:09:38.514197 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:09:38.514197 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:09:38.521439 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ac3d56cb-38a7-4917-a29e-73a60ebccde9 req-bb61f83f-9175-4edf-82cb-547b5e8a46e0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:38.521972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-ac3d56cb-38a7-4917-a29e-73a60ebccde9 req-bb61f83f-9175-4edf-82cb-547b5e8a46e0 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:38.534260 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-ac3d56cb-38a7-4917-a29e-73a60ebccde9 req-bb61f83f-9175-4edf-82cb-547b5e8a46e0 service nova] Creating event network-changed:e1c50157-7077-401c-80f1-e56cabd2f5ae for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 on nch2-master-1 Nov 27 22:09:38.539889 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-ac3d56cb-38a7-4917-a29e-73a60ebccde9 req-bb61f83f-9175-4edf-82cb-547b5e8a46e0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111310 Nov 27 22:09:38.540721 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4541/8947] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:09:38.557876 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e65a88bb-ce90-4aed-a2fe-b5e80c7687fd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "DELETE /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 204 len: 0 microversion: 2.1 time: 0.136487 Nov 27 22:09:38.561726 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4407/8948] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 22:09:38 2021] DELETE /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 22:09:38.569892 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:38.570585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:38.577068 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:38.577540 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:38.578322 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:38.578753 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:38.785154 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:38.792646 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd997e64-4eba-404b-ba34-07a63f33c44c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1682 microversion: 2.1 time: 0.229224 Nov 27 22:09:38.793418 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4542/8949] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:38 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:09:39.810393 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:39.811038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:39.817494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:39.817968 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:39.818839 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:39.819326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:39.953003 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:39.960733 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e63947f2-dedc-490a-a038-55cba7498ebe tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1564 microversion: 2.1 time: 0.154520 Nov 27 22:09:39.961300 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4408/8950] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:39 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:40.773912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-a70eb362-7ca7-4123-a34d-f37879aa4c7e req-5da8a611-ba71-4276-a75d-b1654165851f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2991a6-017a-4f7b-95ee-b52db4ec0fe6", "name": "network-vif-deleted", "tag": "e1c50157-7077-401c-80f1-e56cabd2f5ae"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:09:40.775452 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:09:40.775452 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:09:40.783044 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a70eb362-7ca7-4123-a34d-f37879aa4c7e req-5da8a611-ba71-4276-a75d-b1654165851f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:40.783655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-a70eb362-7ca7-4123-a34d-f37879aa4c7e req-5da8a611-ba71-4276-a75d-b1654165851f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:40.795978 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-a70eb362-7ca7-4123-a34d-f37879aa4c7e req-5da8a611-ba71-4276-a75d-b1654165851f service nova] Creating event network-vif-deleted:e1c50157-7077-401c-80f1-e56cabd2f5ae for instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 on nch2-master-1 Nov 27 22:09:40.801163 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-a70eb362-7ca7-4123-a34d-f37879aa4c7e req-5da8a611-ba71-4276-a75d-b1654165851f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090071 Nov 27 22:09:40.801833 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4543/8951] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:09:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:09:40.978516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:40.979322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:40.986618 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:40.987610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:40.988417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:40.988872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:41.022066 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:41.022528 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:41.022994 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lazy-loading 'fault' on Instance uuid 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 22:09:41.063905 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:41.072440 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-9974d534-5e12-422e-b693-79ff2be995ac tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 200 len: 1337 microversion: 2.1 time: 0.097622 Nov 27 22:09:41.073198 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4409/8952] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:40 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 1337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:42.090972 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:42.091706 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:42.098329 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:42.098772 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:42.099567 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:42.100002 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:42.114006 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] HTTP exception thrown: Instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 could not be found. Nov 27 22:09:42.114583 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Returning 404 to user: Instance 5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 22:09:42.115434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-13972bc1-d565-4ca6-b86f-e445ca17f390 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6" status: 404 len: 111 microversion: 2.1 time: 0.029480 Nov 27 22:09:42.115971 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4544/8953] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:42 2021] GET /compute/v2.1/servers/5b2991a6-017a-4f7b-95ee-b52db4ec0fe6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 22:09:42.271759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-64cb1b1c-3178-4bea-9073-059130793abf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '.version_select at 0x7f15c7e83a60>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:42.296348 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-64cb1b1c-3178-4bea-9073-059130793abf tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1658160235" status: 202 len: 0 microversion: 2.1 time: 0.028228 Nov 27 22:09:42.297104 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4410/8954] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 22:09:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1658160235 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:09:42.321083 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9bd7d6ee-67d5-44d9-9b36-d978eb0ef61e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'create', calling method: .version_select at 0x7f15c7977940>, body: {"keypair": {"name": "tempest-TestShelveInstance-728498451"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:09:42.335188 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9bd7d6ee-67d5-44d9-9b36-d978eb0ef61e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:09:42.340171 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9bd7d6ee-67d5-44d9-9b36-d978eb0ef61e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for user 1ca9642dc2294528a287553029ab7c54 and project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:09:42.445037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9bd7d6ee-67d5-44d9-9b36-d978eb0ef61e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:09:42.449822 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-9bd7d6ee-67d5-44d9-9b36-d978eb0ef61e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for user 1ca9642dc2294528a287553029ab7c54 and project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:09:42.464080 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9bd7d6ee-67d5-44d9-9b36-d978eb0ef61e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.147619 Nov 27 22:09:42.464682 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4545/8955] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 22:09:42 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:09:44.813786 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-719003336", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-728498451", "security_groups": [{"name": "tempest-secgroup-smoke-1956363624"}], "networks": [{"uuid": "4b2d3d9a-f484-43ca-b576-e9a0753d2ca9"}], "block_device_mapping_v2": [{"uuid": "29b72438-124b-49c5-9fb2-cde91536dbe6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:09:44.921854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] validate_networks() for [('4b2d3d9a-f484-43ca-b576-e9a0753d2ca9', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 22:09:45.293241 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 22:09:45.293700 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 22:09:45.294182 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 22:09:45.294602 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 22:09:45.295026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 22:09:45.304322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:45.304782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:45.305604 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:45.306052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:45.322105 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:09:45.327102 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Getting quotas for user 1ca9642dc2294528a287553029ab7c54 and project 2673f0e267164ddc9371d10cb58d17aa. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:09:45.385396 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 22:09:45.387849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29b72438-124b-49c5-9fb2-cde91536dbe6',volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 22:09:45.520837 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-2ecbe71a-2596-4607-9d0c-46cd18e16c7a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711535 Nov 27 22:09:45.521541 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4411/8956] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 22:09:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 22:09:45.532062 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0b0a2a90-d688-4ba8-93f0-7fc442b9818b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:45.532682 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0b0a2a90-d688-4ba8-93f0-7fc442b9818b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:45.585066 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0b0a2a90-d688-4ba8-93f0-7fc442b9818b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:45.591880 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0b0a2a90-d688-4ba8-93f0-7fc442b9818b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1087 microversion: 2.1 time: 0.064332 Nov 27 22:09:45.592452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4546/8957] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:45 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:46.610075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-57c8c672-7bac-49a1-b298-75eff474449e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:46.610705 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-57c8c672-7bac-49a1-b298-75eff474449e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:46.663588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-57c8c672-7bac-49a1-b298-75eff474449e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:46.670258 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-57c8c672-7bac-49a1-b298-75eff474449e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1087 microversion: 2.1 time: 0.064707 Nov 27 22:09:46.670825 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4412/8958] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:46 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:47.687627 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d0cb255e-9895-4278-949f-f68de57f5adc tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:47.688243 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d0cb255e-9895-4278-949f-f68de57f5adc tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:47.740177 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d0cb255e-9895-4278-949f-f68de57f5adc tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:47.747196 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d0cb255e-9895-4278-949f-f68de57f5adc tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1087 microversion: 2.1 time: 0.062824 Nov 27 22:09:47.747572 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4547/8959] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:47 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1087 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:48.763273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08bf5e96-049b-4335-b267-a75fe38ed726 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:48.763939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-08bf5e96-049b-4335-b267-a75fe38ed726 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:48.815766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-08bf5e96-049b-4335-b267-a75fe38ed726 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:48.822535 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-08bf5e96-049b-4335-b267-a75fe38ed726 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1087 microversion: 2.1 time: 0.063221 Nov 27 22:09:48.823125 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4413/8960] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:48 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1087 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:49.839200 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:49.839830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:49.847717 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:49.848159 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:49.848927 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:49.849362 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:49.910515 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:49.917758 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0b1dafb-d359-4e0b-a740-d9ccd2e038bd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1137 microversion: 2.1 time: 0.082241 Nov 27 22:09:49.918319 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4548/8961] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:49 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:50.933854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:50.934585 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:50.942983 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:50.943559 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:50.944384 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:50.945070 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:51.011768 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:51.021039 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3b789f9f-828e-43ed-89df-13bdccebefd1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1203 microversion: 2.1 time: 0.090652 Nov 27 22:09:51.021818 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4414/8962] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:50 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:51.893634 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6f9d279c-8afb-4707-a182-b1765a8627ae req-7441298e-6af4-4df6-bcba-f6a277ec9b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:09:51.895724 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:09:51.895724 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:09:51.907998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6f9d279c-8afb-4707-a182-b1765a8627ae req-7441298e-6af4-4df6-bcba-f6a277ec9b4d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:51.908732 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6f9d279c-8afb-4707-a182-b1765a8627ae req-7441298e-6af4-4df6-bcba-f6a277ec9b4d service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:51.928567 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6f9d279c-8afb-4707-a182-b1765a8627ae req-7441298e-6af4-4df6-bcba-f6a277ec9b4d service nova] Creating event network-changed:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch2-master-1 Nov 27 22:09:51.933863 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6f9d279c-8afb-4707-a182-b1765a8627ae req-7441298e-6af4-4df6-bcba-f6a277ec9b4d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046170 Nov 27 22:09:51.934999 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4549/8963] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:09:52.037853 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:52.038584 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:52.045766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:52.046329 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:52.047246 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:52.047802 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:52.206833 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:52.214210 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf83c78d-d369-48e2-9053-c97427af63d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.180110 Nov 27 22:09:52.214791 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4415/8964] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:52 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:53.232043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:53.232733 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:53.238931 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:53.239414 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:53.240182 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:53.240614 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:53.373701 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:53.381498 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78a987dd-83a5-4b1b-99f1-f4a4049eeffd tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.154362 Nov 27 22:09:53.382066 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4550/8965] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:53 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:54.398227 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:54.398849 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:54.405639 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:54.406225 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:54.407016 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:54.407495 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:54.538372 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:54.545717 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4b94cb73-4b48-4365-b1d9-cb0319f47512 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.151201 Nov 27 22:09:54.546279 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4416/8966] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:54 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:55.562380 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:55.562990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:55.569802 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:55.570251 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:55.571036 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:55.571626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:55.704285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:55.711701 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b581baef-2b2e-4032-9584-1b3fd848c1ae tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.152970 Nov 27 22:09:55.712278 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4551/8967] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:55 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:56.728430 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:56.729024 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:56.735965 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:56.736429 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:56.737701 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:56.738151 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:56.870277 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:56.878624 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-bf3fc1d2-a781-4544-83df-19ea8341669e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.153908 Nov 27 22:09:56.879214 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4417/8968] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:56 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:57.896032 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:57.896631 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:57.903377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:57.903821 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:57.904590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:57.905023 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:58.046039 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:58.053499 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-66ed68c3-1bc3-42f4-9c77-92021d650a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.161752 Nov 27 22:09:58.054081 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4552/8969] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:57 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:59.070117 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:09:59.070744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:09:59.077685 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:59.078148 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:59.078942 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:59.079463 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:59.213139 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:09:59.220549 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4d5fd546-9735-43ed-a4df-fbe3dd05cc51 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.154206 Nov 27 22:09:59.221883 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4418/8970] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:09:59 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:09:59.636778 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6a0a61f5-ae46-4d27-be16-c932f9cd0dc6 req-dc4a081b-6d91-4c81-891a-a7315a2117ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "name": "network-vif-plugged", "status": "completed", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:09:59.638557 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:09:59.638557 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:09:59.645545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6a0a61f5-ae46-4d27-be16-c932f9cd0dc6 req-dc4a081b-6d91-4c81-891a-a7315a2117ba service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:09:59.645998 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6a0a61f5-ae46-4d27-be16-c932f9cd0dc6 req-dc4a081b-6d91-4c81-891a-a7315a2117ba service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:09:59.660966 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6a0a61f5-ae46-4d27-be16-c932f9cd0dc6 req-dc4a081b-6d91-4c81-891a-a7315a2117ba service nova] Creating event network-vif-plugged:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch2-master-1 Nov 27 22:09:59.666209 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6a0a61f5-ae46-4d27-be16-c932f9cd0dc6 req-dc4a081b-6d91-4c81-891a-a7315a2117ba service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085695 Nov 27 22:09:59.666812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4553/8971] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:09:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 22:10:00.238425 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:10:00.239045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:10:00.245796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:10:00.246254 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:10:00.247039 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:10:00.247514 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:10:00.376216 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:10:00.383669 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c1c8b5e1-8662-4283-b3b6-5d50f755b31b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1259 microversion: 2.1 time: 0.149571 Nov 27 22:10:00.384243 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4419/8972] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:10:00 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:10:01.401748 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:10:01.402445 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:10:01.410186 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:10:01.410638 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:10:01.411447 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:10:01.411886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:10:01.547112 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:10:01.554513 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-acf1683b-8b42-4785-b05a-437d90fd3a32 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1443 microversion: 2.1 time: 0.157659 Nov 27 22:10:01.555093 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4554/8973] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:10:01 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:10:01.570645 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:10:01.571288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:10:01.577982 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:10:01.578445 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:10:01.579233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:10:01.579709 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:10:01.712273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:10:01.719668 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f828003c-52bf-48be-9c4f-c020dd33223e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1443 microversion: 2.1 time: 0.152604 Nov 27 22:10:01.720238 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4420/8974] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:10:01 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:10:03.661086 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f43139aa-3061-462a-9d70-52a5baa3b612 req-5cf828c3-a22b-427e-9238-65c9e1b496b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:10:03.663116 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:10:03.663116 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:10:03.672435 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f43139aa-3061-462a-9d70-52a5baa3b612 req-5cf828c3-a22b-427e-9238-65c9e1b496b2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:10:03.673246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f43139aa-3061-462a-9d70-52a5baa3b612 req-5cf828c3-a22b-427e-9238-65c9e1b496b2 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:10:03.686229 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f43139aa-3061-462a-9d70-52a5baa3b612 req-5cf828c3-a22b-427e-9238-65c9e1b496b2 service nova] Creating event network-changed:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch2-master-1 Nov 27 22:10:03.692121 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f43139aa-3061-462a-9d70-52a5baa3b612 req-5cf828c3-a22b-427e-9238-65c9e1b496b2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034668 Nov 27 22:10:03.693052 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4555/8975] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:10:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:10:26.720489 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:10:26.721085 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:10:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:12:06.766883 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:12:06.771337 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:12:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:12:08.741551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:12:08.742138 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:08.748209 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:08.748675 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:08.749462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:08.749916 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:08.775322 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.objects.instance [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lazy-loading 'flavor' on Instance uuid 85541647-0e62-49bf-9969-1070f2906b6a {{(pid=135679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 27 22:12:08.845647 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-edb490b9-59ab-4fee-9486-49704b66fef9 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a/action" status: 202 len: 0 microversion: 2.1 time: 0.109259 Nov 27 22:12:08.846263 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4421/8976] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:12:08 2021] POST /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:12:08.855845 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:08.856545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:08.862970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:08.863478 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:08.864938 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:08.865423 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:09.001924 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:09.010231 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-43b02f47-d9e7-400f-a809-49a66873228a tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.159579 Nov 27 22:12:09.010796 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4556/8977] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:08 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:10.026181 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47ffaf7c-8690-4a97-abbb-a3f69f154698] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:12:10.026986 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d920613-63e3-44eb-907c-edcf8c836592] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:12:10.030625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:10.031371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:10.037625 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:10.038103 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:10.038902 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:10.039398 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:10.219800 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:10.227278 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3693a270-1dc2-400e-bc2a-12b8a8531821 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.202571 Nov 27 22:12:10.227861 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4422/8978] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:10 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:12:11.243573 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:11.244181 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:11.251072 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:11.251559 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:11.252335 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:11.252780 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:11.429956 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:11.437371 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c18aa7e8-5354-445e-9835-e1b6eaa03022 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.197538 Nov 27 22:12:11.437925 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4557/8979] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:11 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:12.455656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:12.456290 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:12.484478 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:12.484948 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:12.485752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:12.486206 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:12.492151 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] [47ffaf7c-8690-4a97-abbb-a3f69f154698] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48690. Nov 27 22:12:12.492908 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d920613-63e3-44eb-907c-edcf8c836592] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 48692. Nov 27 22:12:12.621741 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:12.629286 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-68a7578d-9ff6-4d5e-927c-bd3c836d1cd7 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.177371 Nov 27 22:12:12.629954 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4423/8980] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:12 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:13.646586 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:13.647207 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:13.653585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:13.654043 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:13.654823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:13.655284 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:13.784744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:13.792740 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4d7a6fd7-d00f-4ef9-845f-f23b9bb9f9f4 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.150072 Nov 27 22:12:13.793303 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4558/8981] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:13 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:14.809660 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:14.810288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:14.818007 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:14.818836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:14.820278 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:14.820766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:14.955820 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:14.963409 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-496c6e4b-b72b-46a4-a048-58de8109ce4f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.157448 Nov 27 22:12:14.963988 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4424/8982] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:14 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:15.980247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:15.980858 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:15.987599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:15.988053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:15.988829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:15.989269 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:16.121933 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:16.130334 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-323e670c-281c-429f-a1e5-0032bbe9af00 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.153195 Nov 27 22:12:16.130903 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4559/8983] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:15 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:17.148084 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:17.148738 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:17.155624 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:17.156096 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:17.156891 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:17.157354 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:17.286472 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:17.293920 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-baa59398-2948-4f40-b94f-ef7d59618c19 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.150105 Nov 27 22:12:17.294499 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4425/8984] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:17 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:12:18.309926 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:18.310513 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:18.317824 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:18.318267 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:18.319053 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:18.319503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:18.454842 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:18.462434 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-0dce7354-1625-46ec-a589-34d3a6c7ca08 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.156237 Nov 27 22:12:18.462998 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4560/8985] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:18 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:19.479432 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:19.480061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:19.487062 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:19.487563 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:19.488370 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:19.488864 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:19.625043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:19.633043 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-084ed2b0-7077-4859-965c-4369963061a6 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.157501 Nov 27 22:12:19.633634 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4426/8986] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:19 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:20.650829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:20.651484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:20.658661 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:20.659119 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:20.659986 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:20.661057 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:20.792771 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:20.800279 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-020f0094-af23-40de-8e5a-8b64d44d6a7e tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.153194 Nov 27 22:12:20.800844 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4561/8987] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:20 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:21.817766 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:21.819207 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:21.825403 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:21.825876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:21.826704 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:21.827163 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:21.959146 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:21.966708 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-43338aa7-0637-47ed-9f1a-5a3f2b0d0922 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1509 microversion: 2.1 time: 0.153260 Nov 27 22:12:21.967330 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4427/8988] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:21 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:21.982739 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:12:21.983327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:21.989880 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:21.990328 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:21.991092 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:21.991549 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:22.122448 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-91695fa9-8e7c-493d-afb7-8d5fe48fe643 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "POST /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a/action" status: 202 len: 0 microversion: 2.1 time: 0.143290 Nov 27 22:12:22.123151 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4562/8989] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:12:21 2021] POST /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:12:22.131531 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:22.132161 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:22.138638 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:22.139137 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:22.139964 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:22.140434 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:22.277854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:22.285729 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-f3a34e7d-eca6-4b5a-acce-a73a667c46ff tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1517 microversion: 2.1 time: 0.158494 Nov 27 22:12:22.286370 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4428/8990] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:22 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:23.303729 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:23.304353 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:23.310450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:23.310901 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:23.311702 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:23.312144 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:23.456327 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:23.467002 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-78653943-b400-4f56-b602-6d9ed63fb937 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1519 microversion: 2.1 time: 0.167456 Nov 27 22:12:23.467950 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4563/8991] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:23 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:23.959243 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:12:23.959466 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:12:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:12:24.485411 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:24.486032 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:24.492825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:24.493288 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:24.494082 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:24.494526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:24.595364 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-97c8009b-c36e-4128-925c-9ca3382bc2af req-c25fcf8a-b6f7-4647-94ed-4fd313cdb0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "name": "network-vif-unplugged", "status": "completed", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:12:24.597308 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:12:24.597308 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:12:24.607703 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-97c8009b-c36e-4128-925c-9ca3382bc2af req-c25fcf8a-b6f7-4647-94ed-4fd313cdb0c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:24.609490 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-97c8009b-c36e-4128-925c-9ca3382bc2af req-c25fcf8a-b6f7-4647-94ed-4fd313cdb0c3 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:24.622573 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-97c8009b-c36e-4128-925c-9ca3382bc2af req-c25fcf8a-b6f7-4647-94ed-4fd313cdb0c3 service nova] Creating event network-vif-unplugged:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch1-master-1 Nov 27 22:12:24.631057 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-97c8009b-c36e-4128-925c-9ca3382bc2af req-c25fcf8a-b6f7-4647-94ed-4fd313cdb0c3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039546 Nov 27 22:12:24.631812 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4564/8992] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:12:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 22:12:24.786181 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:24.794857 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-fec859b2-51dc-4071-be28-52a6e810d0f2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.313180 Nov 27 22:12:24.796142 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4429/8993] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:24 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:25.814106 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:25.814885 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:25.821246 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:25.821696 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:25.822471 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:25.822912 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:25.953934 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:25.961903 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-2530540b-efee-484f-b0f5-f6c899ddf8ec tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.152676 Nov 27 22:12:25.962474 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4565/8994] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:25 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:26.651459 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-034d5540-2e10-496e-8d34-d1d79abe9468 req-0f642927-e15e-49fa-b30c-0307901f9c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:12:26.653079 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:12:26.653079 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:12:26.661270 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-034d5540-2e10-496e-8d34-d1d79abe9468 req-0f642927-e15e-49fa-b30c-0307901f9c48 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:26.661734 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-034d5540-2e10-496e-8d34-d1d79abe9468 req-0f642927-e15e-49fa-b30c-0307901f9c48 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:26.673083 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-034d5540-2e10-496e-8d34-d1d79abe9468 req-0f642927-e15e-49fa-b30c-0307901f9c48 service nova] Creating event network-changed:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch1-master-1 Nov 27 22:12:26.678692 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-034d5540-2e10-496e-8d34-d1d79abe9468 req-0f642927-e15e-49fa-b30c-0307901f9c48 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031338 Nov 27 22:12:26.679305 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4430/8995] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:12:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:12:26.979407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:26.980016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:26.986640 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:26.987087 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:26.987909 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:26.988344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:27.125383 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:27.133088 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e3e9d575-0c42-4943-91dc-d982a30047d8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.157462 Nov 27 22:12:27.133673 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4566/8996] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:26 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:28.151615 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:28.152317 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:28.158526 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:28.158978 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:28.159799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:28.160245 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:28.291173 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:28.298593 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ac097f1c-e080-4674-89f7-cb4e698f0b0c tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.152035 Nov 27 22:12:28.299170 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4431/8997] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:28 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:29.315946 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:29.316561 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:29.323285 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:29.323731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:29.324510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:29.325010 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:29.466019 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:29.474099 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-e0d84794-7f7f-41df-b07e-75457d65e620 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.161403 Nov 27 22:12:29.474668 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4567/8998] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:29 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:30.490123 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:30.490752 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:30.497545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:30.498014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:30.498806 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:30.499285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:30.635095 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:30.643591 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-908afae8-05a2-40cf-bda4-d76e54013394 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.157187 Nov 27 22:12:30.644169 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4432/8999] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:30 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:31.661228 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:31.661763 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:31.668450 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:31.668894 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:31.669659 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:31.670095 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:31.802620 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:31.810339 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-342010d8-8519-4ca9-a5f4-34028e3c8cc8 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.152953 Nov 27 22:12:31.810913 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4568/9000] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:31 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:12:32.827876 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:32.828497 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:32.835754 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:32.836214 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:32.837000 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:32.837447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:32.969273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:32.977338 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b9e3599-a1ac-49dd-ac51-b847bc19e474 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.153157 Nov 27 22:12:32.977909 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4433/9001] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:32 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:33.396895 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-8f75b174-9cb5-4531-a120-2fd44edba1df req-b5a89bf5-cce9-4d1f-a164-dbfb505d6159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "name": "network-vif-plugged", "status": "completed", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:12:33.398429 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:12:33.398429 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:12:33.406886 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8f75b174-9cb5-4531-a120-2fd44edba1df req-b5a89bf5-cce9-4d1f-a164-dbfb505d6159 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:33.407438 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-8f75b174-9cb5-4531-a120-2fd44edba1df req-b5a89bf5-cce9-4d1f-a164-dbfb505d6159 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:33.418722 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-8f75b174-9cb5-4531-a120-2fd44edba1df req-b5a89bf5-cce9-4d1f-a164-dbfb505d6159 service nova] Creating event network-vif-plugged:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch1-master-1 Nov 27 22:12:33.423954 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-8f75b174-9cb5-4531-a120-2fd44edba1df req-b5a89bf5-cce9-4d1f-a164-dbfb505d6159 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030799 Nov 27 22:12:33.424719 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4569/9002] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:12:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:12:33.994586 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:33.995242 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:34.002075 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:34.002536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:34.003351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:34.003801 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:34.144319 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:34.153010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-e16dcbe9-5011-4700-94cd-6b141b9ed376 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1575 microversion: 2.1 time: 0.162114 Nov 27 22:12:34.154159 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4434/9003] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:33 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:35.172291 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:12:35.172996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:12:35.179130 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:35.179606 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:35.180374 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:12:35.180804 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:12:35.316015 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:12:35.323966 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-dba2fe8c-7ab9-4b6b-864a-fcc98fe8f809 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1562 microversion: 2.1 time: 0.156639 Nov 27 22:12:35.324531 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4570/9004] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:12:35 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:12:41.396337 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:12:41.396904 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:12:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:13:59.541216 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-0e704837-2115-465f-9e9a-ddb770fc4945 req-17e5ffdf-d963-4db0-a7f6-04fb02c5cbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:13:59.542798 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:13:59.542798 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:13:59.544649 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:13:59.545178 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:13:59.551472 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0e704837-2115-465f-9e9a-ddb770fc4945 req-17e5ffdf-d963-4db0-a7f6-04fb02c5cbe8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:13:59.551886 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:13:59.552013 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-0e704837-2115-465f-9e9a-ddb770fc4945 req-17e5ffdf-d963-4db0-a7f6-04fb02c5cbe8 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:13:59.552364 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:13:59.553175 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:13:59.553643 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:13:59.563518 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-0e704837-2115-465f-9e9a-ddb770fc4945 req-17e5ffdf-d963-4db0-a7f6-04fb02c5cbe8 service nova] Creating event network-changed:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch1-master-1 Nov 27 22:13:59.571753 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-0e704837-2115-465f-9e9a-ddb770fc4945 req-17e5ffdf-d963-4db0-a7f6-04fb02c5cbe8 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035022 Nov 27 22:13:59.572359 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4571/9005] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:13:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 22:13:59.582591 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 22:13:59.663404 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-297cc5a6-59e1-4352-a3e2-a68e00b0081f tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "DELETE /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 204 len: 0 microversion: 2.1 time: 0.129736 Nov 27 22:13:59.664143 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4435/9006] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 22:13:59 2021] DELETE /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 22:13:59.672355 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:13:59.673064 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:13:59.679948 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:13:59.680619 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:13:59.681624 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:13:59.682215 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:13:59.831499 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:13:59.841147 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-7e746f6f-74c8-4004-b378-0182ecb6a0e1 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1568 microversion: 2.1 time: 0.172730 Nov 27 22:13:59.841724 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4572/9007] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:13:59 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:14:00.859485 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:00.860208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:00.867409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:00.867878 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:00.868702 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:00.869152 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:01.007549 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:01.015160 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-680dd1f8-3c12-485a-8328-46529642a8ee tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1449 microversion: 2.1 time: 0.159803 Nov 27 22:14:01.015765 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4436/9008] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:00 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:02.001829 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-044701d6-9adc-4e50-a215-680a7adc8383 req-51ac1a97-806f-47e5-99cd-e3649857f501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85541647-0e62-49bf-9969-1070f2906b6a", "name": "network-vif-deleted", "tag": "a1936d7c-8eb8-488e-bf99-2bb4c7cfb711"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:14:02.003447 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:14:02.003447 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:14:02.012908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-044701d6-9adc-4e50-a215-680a7adc8383 req-51ac1a97-806f-47e5-99cd-e3649857f501 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:02.013656 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-044701d6-9adc-4e50-a215-680a7adc8383 req-51ac1a97-806f-47e5-99cd-e3649857f501 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:02.026247 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-044701d6-9adc-4e50-a215-680a7adc8383 req-51ac1a97-806f-47e5-99cd-e3649857f501 service nova] Creating event network-vif-deleted:a1936d7c-8eb8-488e-bf99-2bb4c7cfb711 for instance 85541647-0e62-49bf-9969-1070f2906b6a on nch1-master-1 Nov 27 22:14:02.032167 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-044701d6-9adc-4e50-a215-680a7adc8383 req-51ac1a97-806f-47e5-99cd-e3649857f501 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033907 Nov 27 22:14:02.032408 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:02.032894 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4573/9009] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:14:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:14:02.033072 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:02.042312 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:02.042854 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:02.043755 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:02.044273 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:02.105479 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca9642dc2294528a287553029ab7c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673f0e267164ddc9371d10cb58d17aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:02.112864 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b59d851f-ed9c-4e05-8335-df25e3e0c2d2 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 200 len: 1218 microversion: 2.1 time: 0.084198 Nov 27 22:14:02.113434 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4437/9010] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:02 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:03.130524 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:03.131224 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] [instance: 85541647-0e62-49bf-9969-1070f2906b6a] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:03.137590 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:03.138037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:03.139067 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:03.139543 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:03.154724 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] HTTP exception thrown: Instance 85541647-0e62-49bf-9969-1070f2906b6a could not be found. Nov 27 22:14:03.155341 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Returning 404 to user: Instance 85541647-0e62-49bf-9969-1070f2906b6a could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 22:14:03.156155 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4bbac4a6-8597-4363-aac5-4b24bb0e102b tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a" status: 404 len: 111 microversion: 2.1 time: 0.030617 Nov 27 22:14:03.156686 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4574/9011] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:03 2021] GET /compute/v2.1/servers/85541647-0e62-49bf-9969-1070f2906b6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 22:14:03.320219 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-16df3d60-1260-4c67-bd5c-46867d211099 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] Calling method '.version_select at 0x7f15d9342940>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:03.349441 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-16df3d60-1260-4c67-bd5c-46867d211099 tempest-TestShelveInstance-168226204 tempest-TestShelveInstance-168226204-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-728498451" status: 202 len: 0 microversion: 2.1 time: 0.033020 Nov 27 22:14:03.350346 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4438/9012] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 22:14:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-728498451 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:14:20.942913 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-41f4c6cc-3c31-4cec-8bdf-c542e7b6a3f0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Action: 'create', calling method: .version_select at 0x7f15d43053a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1754587782"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:14:20.957591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-41f4c6cc-3c31-4cec-8bdf-c542e7b6a3f0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for project 43420851d76644b8bd7d25b34365dce9. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:14:20.962639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-41f4c6cc-3c31-4cec-8bdf-c542e7b6a3f0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for user 601728112c7c4e689208826544604460 and project 43420851d76644b8bd7d25b34365dce9. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:14:21.285189 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-41f4c6cc-3c31-4cec-8bdf-c542e7b6a3f0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for project 43420851d76644b8bd7d25b34365dce9. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:14:21.291441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-41f4c6cc-3c31-4cec-8bdf-c542e7b6a3f0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for user 601728112c7c4e689208826544604460 and project 43420851d76644b8bd7d25b34365dce9. Resources: {'key_pairs'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:14:21.307464 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-41f4c6cc-3c31-4cec-8bdf-c542e7b6a3f0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.564850 Nov 27 22:14:21.308257 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4575/9013] 10.222.0.21 () {60 vars in 1157 bytes} [Sat Nov 27 22:14:20 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:14:22.262440 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1536590330", "imageRef": "dad06d36-e5fe-4577-8da6-2101ffe62bc8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1754587782", "security_groups": [{"name": "tempest-secgroup-smoke-880080713"}], "networks": [{"uuid": "743deef8-7ae2-412c-aa24-d9a0d80c526f"}]}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:14:22.372616 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.network.neutron [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] validate_networks() for [('743deef8-7ae2-412c-aa24-d9a0d80c526f', None, None, None, None, None)] {{(pid=135679) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 22:14:22.880025 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Flavor limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 22:14:22.880473 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Image limits 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 22:14:22.880963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Flavor pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 22:14:22.881387 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Image pref 0:0:0 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 22:14:22.881842 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.virt.hardware [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 22:14:22.898917 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:22.899302 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:22.900825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:22.901654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:22.920507 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for project 43420851d76644b8bd7d25b34365dce9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:14:22.925836 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.quota [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for user 601728112c7c4e689208826544604460 and project 43420851d76644b8bd7d25b34365dce9. Resources: {'instances', 'cores', 'ram'} {{(pid=135679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:14:22.938553 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Going to run 1 instances... {{(pid=135679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 22:14:22.940987 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dad06d36-e5fe-4577-8da6-2101ffe62bc8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 22:14:22.993494 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-d7f8b0da-6a57-4a3b-9eb5-ea272d9e3c56 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736526 Nov 27 22:14:22.994276 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4439/9014] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 22:14:22 2021] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 22:14:23.003907 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-d301a35b-5899-429b-aa4a-76b46a512e17 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:23.004526 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-d301a35b-5899-429b-aa4a-76b46a512e17 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:23.068765 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-d301a35b-5899-429b-aa4a-76b46a512e17 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:23.076975 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-d301a35b-5899-429b-aa4a-76b46a512e17 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1249 microversion: 2.1 time: 0.076664 Nov 27 22:14:23.077561 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4576/9015] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:22 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1249 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:24.095208 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:24.096121 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:24.102330 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:24.102810 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:24.103665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:24.104126 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:24.177588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:24.185588 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-138d1f0d-3bbe-43f5-999d-52a8c09af5b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1307 microversion: 2.1 time: 0.094800 Nov 27 22:14:24.186410 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4440/9016] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:24 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:14:25.203811 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:25.204433 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:25.213908 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:25.214600 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:25.215911 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:25.216503 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:25.500407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:25.513216 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3059bade-547b-446c-887e-94ee3297dbba tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1374 microversion: 2.1 time: 0.313204 Nov 27 22:14:25.516865 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4577/9017] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:25 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1374 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:25.580461 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-77f80b76-8017-440b-9236-485c50645a4b req-11340cc7-5044-420b-ba7c-3abb55caf899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c6fb2d-7f21-4d41-9338-f38532f3531e", "tag": "64c3ba68-63da-4845-9693-5ed608ed2cc3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:14:25.585880 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:14:25.585880 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:14:25.597368 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-77f80b76-8017-440b-9236-485c50645a4b req-11340cc7-5044-420b-ba7c-3abb55caf899 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:25.597860 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-77f80b76-8017-440b-9236-485c50645a4b req-11340cc7-5044-420b-ba7c-3abb55caf899 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:25.610320 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-77f80b76-8017-440b-9236-485c50645a4b req-11340cc7-5044-420b-ba7c-3abb55caf899 service nova] Creating event network-changed:64c3ba68-63da-4845-9693-5ed608ed2cc3 for instance 97c6fb2d-7f21-4d41-9338-f38532f3531e on nch2-master-1 Nov 27 22:14:25.616491 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-77f80b76-8017-440b-9236-485c50645a4b req-11340cc7-5044-420b-ba7c-3abb55caf899 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044934 Nov 27 22:14:25.617093 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4441/9018] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:14:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:14:26.533700 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:26.534219 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:26.541505 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:26.542158 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:26.542954 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:26.543421 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:26.690237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:26.697636 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-3d89c45a-6cb0-4891-9bdc-e1d6051423c0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1374 microversion: 2.1 time: 0.168301 Nov 27 22:14:26.698206 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4578/9019] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:26 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:27.720796 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:27.721448 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:27.727788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:27.728260 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:27.729055 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:27.729506 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:27.872042 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:27.879945 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-33b1a977-9d12-42d9-9f5c-c1a24abe57fc tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1374 microversion: 2.1 time: 0.164092 Nov 27 22:14:27.880517 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4442/9020] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:27 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:28.898206 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:28.898813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:28.905731 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:28.906180 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:28.906970 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:28.907442 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:29.039407 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:29.046815 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-101fafee-e099-4083-8a6b-bad5cde2047e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1374 microversion: 2.1 time: 0.152319 Nov 27 22:14:29.047414 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4579/9021] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:28 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:30.063582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:30.064223 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:30.071046 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:30.071536 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:30.072323 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:30.072769 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:30.204045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:30.211510 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-440b2aa1-7870-48e4-a9cc-0af9c5e8829e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1374 microversion: 2.1 time: 0.151583 Nov 27 22:14:30.212086 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4443/9022] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:30 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:31.078314 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-bc059a02-4ab5-494f-8265-2b568fb59ad1 req-617d316e-4d28-4fa8-9242-40b79aaa0f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c6fb2d-7f21-4d41-9338-f38532f3531e", "name": "network-vif-plugged", "status": "completed", "tag": "64c3ba68-63da-4845-9693-5ed608ed2cc3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:14:31.079952 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:14:31.079952 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:14:31.087883 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bc059a02-4ab5-494f-8265-2b568fb59ad1 req-617d316e-4d28-4fa8-9242-40b79aaa0f15 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:31.088272 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-bc059a02-4ab5-494f-8265-2b568fb59ad1 req-617d316e-4d28-4fa8-9242-40b79aaa0f15 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:31.100425 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-bc059a02-4ab5-494f-8265-2b568fb59ad1 req-617d316e-4d28-4fa8-9242-40b79aaa0f15 service nova] Creating event network-vif-plugged:64c3ba68-63da-4845-9693-5ed608ed2cc3 for instance 97c6fb2d-7f21-4d41-9338-f38532f3531e on nch2-master-1 Nov 27 22:14:31.105591 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-bc059a02-4ab5-494f-8265-2b568fb59ad1 req-617d316e-4d28-4fa8-9242-40b79aaa0f15 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030909 Nov 27 22:14:31.106378 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4580/9023] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:14:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:14:31.227791 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:31.228427 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:31.235320 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:31.236300 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:31.237120 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:31.237572 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:31.378351 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:31.385659 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6b36cc37-0cb4-413d-97d8-aeb430e6ae8d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1374 microversion: 2.1 time: 0.161594 Nov 27 22:14:31.386235 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4444/9024] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:31 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:32.403928 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:32.404535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:32.410684 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:32.411124 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:32.411944 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:32.412377 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:32.549792 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:32.557183 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9e08a49b-7bac-4f8c-887e-ea1d3008da6e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1374 microversion: 2.1 time: 0.158208 Nov 27 22:14:32.557758 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4581/9025] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:32 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:33.575505 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:33.576133 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:33.583494 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:33.583963 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:33.584759 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:33.585212 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:33.716818 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:33.724265 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-6486c3d9-7152-4871-a8ab-dce3263e64ff tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1559 microversion: 2.1 time: 0.152612 Nov 27 22:14:33.724838 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4445/9026] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:33 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:33.740217 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:14:33.740852 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:14:33.747617 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:33.748063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:33.748836 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:33.749266 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:33.884299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:14:33.891903 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-cd81f017-a449-400d-9961-e3116ef18e90 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1559 microversion: 2.1 time: 0.155311 Nov 27 22:14:33.892980 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4582/9027] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:14:33 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:14:35.843588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-b0626d43-3d51-4174-97d3-913157468a9c req-e96fe201-b237-48ce-b3b4-d2d36841a2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c6fb2d-7f21-4d41-9338-f38532f3531e", "tag": "64c3ba68-63da-4845-9693-5ed608ed2cc3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:14:35.843588 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:14:35.843588 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:14:35.850744 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b0626d43-3d51-4174-97d3-913157468a9c req-e96fe201-b237-48ce-b3b4-d2d36841a2ad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:14:35.851226 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-b0626d43-3d51-4174-97d3-913157468a9c req-e96fe201-b237-48ce-b3b4-d2d36841a2ad service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:14:35.862068 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-b0626d43-3d51-4174-97d3-913157468a9c req-e96fe201-b237-48ce-b3b4-d2d36841a2ad service nova] Creating event network-changed:64c3ba68-63da-4845-9693-5ed608ed2cc3 for instance 97c6fb2d-7f21-4d41-9338-f38532f3531e on nch2-master-1 Nov 27 22:14:35.867272 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-b0626d43-3d51-4174-97d3-913157468a9c req-e96fe201-b237-48ce-b3b4-d2d36841a2ad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029833 Nov 27 22:14:35.867918 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4446/9028] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:15:26.740552 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:15:26.741093 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:15:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:17:02.395874 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 22:17:02.397019 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe283093-1cb0-4856-a0d5-8cfe41065dca] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 22:17:02.400484 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-067bc56d-a791-4c30-b729-ef9817d301ce tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-382502292"}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:17:02.401487 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-067bc56d-a791-4c30-b729-ef9817d301ce tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:02.408097 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-067bc56d-a791-4c30-b729-ef9817d301ce tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:02.408545 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-067bc56d-a791-4c30-b729-ef9817d301ce tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:02.409305 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-067bc56d-a791-4c30-b729-ef9817d301ce tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:02.409735 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-067bc56d-a791-4c30-b729-ef9817d301ce tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:02.672101 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-067bc56d-a791-4c30-b729-ef9817d301ce tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "POST /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e/action" status: 202 len: 0 microversion: 2.1 time: 0.277713 Nov 27 22:17:02.673438 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4583/9029] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:17:02 2021] POST /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 22:17:06.787921 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:17:06.788476 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:17:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:17:09.686131 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:17:09.686710 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:17:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:17:09.975517 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [47ffaf7c-8690-4a97-abbb-a3f69f154698] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:17:09.976306 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d920613-63e3-44eb-907c-edcf8c836592] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:17:10.055026 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-3341d358-8264-4b7a-a078-d9d0c70df8f7 req-34169141-eba0-481b-901c-12864ba766ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c6fb2d-7f21-4d41-9338-f38532f3531e", "name": "network-vif-plugged", "status": "completed", "tag": "64c3ba68-63da-4845-9693-5ed608ed2cc3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:17:10.056600 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:17:10.056600 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:17:10.064233 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3341d358-8264-4b7a-a078-d9d0c70df8f7 req-34169141-eba0-481b-901c-12864ba766ef service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:10.064697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-3341d358-8264-4b7a-a078-d9d0c70df8f7 req-34169141-eba0-481b-901c-12864ba766ef service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:10.074576 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-3341d358-8264-4b7a-a078-d9d0c70df8f7 req-34169141-eba0-481b-901c-12864ba766ef service nova] Creating event network-vif-plugged:64c3ba68-63da-4845-9693-5ed608ed2cc3 for instance 97c6fb2d-7f21-4d41-9338-f38532f3531e on nch2-master-1 Nov 27 22:17:10.078050 ncdv-master-1 devstack@n-api.service[135679]: ERROR oslo.messaging._drivers.impl_rabbit [req-3341d358-8264-4b7a-a078-d9d0c70df8f7 req-34169141-eba0-481b-901c-12864ba766ef service nova] [9177ab1c-28b6-4bf1-afcc-73e62aac08e3] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 22:17:11.003523 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d920613-63e3-44eb-907c-edcf8c836592] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49200. Nov 27 22:17:11.004269 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] [47ffaf7c-8690-4a97-abbb-a3f69f154698] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49198. Nov 27 22:17:11.093470 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [req-3341d358-8264-4b7a-a078-d9d0c70df8f7 req-34169141-eba0-481b-901c-12864ba766ef service nova] [9177ab1c-28b6-4bf1-afcc-73e62aac08e3] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49202. Nov 27 22:17:11.097086 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-3341d358-8264-4b7a-a078-d9d0c70df8f7 req-34169141-eba0-481b-901c-12864ba766ef service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.123500 Nov 27 22:17:11.097684 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4447/9030] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:17:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:17:21.321694 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1198704919", "imageRef": "44dee32a-6c1b-4d25-9e14-8cdfefd460a3", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1754587782", "security_groups": [{"name": "tempest-secgroup-smoke-880080713"}], "networks": [{"uuid": "743deef8-7ae2-412c-aa24-d9a0d80c526f"}]}} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:17:21.343298 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49310. Nov 27 22:17:21.347060 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe283093-1cb0-4856-a0d5-8cfe41065dca] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49312. Nov 27 22:17:21.553299 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.network.neutron [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] validate_networks() for [('743deef8-7ae2-412c-aa24-d9a0d80c526f', None, None, None, None, None)] {{(pid=135680) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 27 22:17:21.973556 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Flavor limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 27 22:17:21.973974 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Image limits 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 27 22:17:21.974441 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Flavor pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 27 22:17:21.974846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Image pref 0:0:0 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 27 22:17:21.975398 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.virt.hardware [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 27 22:17:21.984016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:21.984459 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:21.985258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:21.985692 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:22.001591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for project 43420851d76644b8bd7d25b34365dce9. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 27 22:17:22.006464 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.quota [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Getting quotas for user 601728112c7c4e689208826544604460 and project 43420851d76644b8bd7d25b34365dce9. Resources: {'instances', 'cores', 'ram'} {{(pid=135680) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 27 22:17:22.018877 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Going to run 1 instances... {{(pid=135680) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 27 22:17:22.021340 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='44dee32a-6c1b-4d25-9e14-8cdfefd460a3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 27 22:17:22.067335 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-b867960d-0549-4269-9ecf-a2c7c7f0b0ae tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.774815 Nov 27 22:17:22.068340 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4584/9031] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 22:17:21 2021] POST /compute/v2.1/servers => generated 405 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 22:17:22.079798 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-87463abc-a00c-430d-9d54-9ff9abb963e4 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:22.080538 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-87463abc-a00c-430d-9d54-9ff9abb963e4 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:22.196145 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-87463abc-a00c-430d-9d54-9ff9abb963e4 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:22.204785 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-87463abc-a00c-430d-9d54-9ff9abb963e4 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1249 microversion: 2.1 time: 0.129283 Nov 27 22:17:22.205444 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4448/9032] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:22 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:23.223118 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:23.223726 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:23.231270 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:23.231801 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:23.232599 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:23.233046 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:23.295511 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:23.308061 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-61e1aa58-0057-4f04-8eff-6817f21ce1ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1307 microversion: 2.1 time: 0.090157 Nov 27 22:17:23.308679 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4585/9033] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:23 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:24.063447 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-2ddedb9a-470a-4b43-b816-f12ce9c80a32 req-4dad477a-d9d2-4769-8236-26d1037b91b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c6fb2d-7f21-4d41-9338-f38532f3531e", "name": "network-vif-unplugged", "status": "completed", "tag": "64c3ba68-63da-4845-9693-5ed608ed2cc3"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:17:24.066293 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:17:24.066293 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:17:24.075038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2ddedb9a-470a-4b43-b816-f12ce9c80a32 req-4dad477a-d9d2-4769-8236-26d1037b91b1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:24.075721 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-2ddedb9a-470a-4b43-b816-f12ce9c80a32 req-4dad477a-d9d2-4769-8236-26d1037b91b1 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:24.096153 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-2ddedb9a-470a-4b43-b816-f12ce9c80a32 req-4dad477a-d9d2-4769-8236-26d1037b91b1 service nova] Creating event network-vif-unplugged:64c3ba68-63da-4845-9693-5ed608ed2cc3 for instance 97c6fb2d-7f21-4d41-9338-f38532f3531e on nch2-master-1 Nov 27 22:17:24.102852 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-2ddedb9a-470a-4b43-b816-f12ce9c80a32 req-4dad477a-d9d2-4769-8236-26d1037b91b1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044504 Nov 27 22:17:24.103999 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4449/9034] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:17:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:17:24.325145 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:24.325846 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:24.333787 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:24.334507 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:24.335331 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:24.335777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:24.494131 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:24.502184 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-ead8fc4d-a241-43c7-b393-07628017dcfb tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.180864 Nov 27 22:17:24.511929 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4586/9035] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:24 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:17:25.522010 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:25.522861 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:25.529371 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:25.529924 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:25.530829 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:25.531391 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:25.674949 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:25.682824 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-c39a05a3-5740-48f6-bdbf-67048101c1b3 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.166492 Nov 27 22:17:25.693003 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4450/9036] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:25 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:26.700639 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:26.701242 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:26.709237 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:26.709681 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:26.710672 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:26.711156 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:26.856506 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:26.871348 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-167686ea-c874-4356-8db3-b7181ecbff57 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.174686 Nov 27 22:17:26.872298 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4587/9037] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:26 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:27.888955 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:27.890019 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:27.897041 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:27.897516 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:27.898326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:27.898785 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:28.041456 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:28.050165 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-ad099197-67ba-49df-80e2-6e582aba19ad tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.164728 Nov 27 22:17:28.051460 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4451/9038] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:27 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:29.068351 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:29.069967 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:29.078024 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:29.079603 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:29.080550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:29.081063 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:29.228904 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:29.236808 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-1f85b55c-dd21-4021-b385-0838c19de87f tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.172552 Nov 27 22:17:29.246562 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4588/9039] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:29 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:30.254172 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:30.254790 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:30.261926 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:30.262383 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:30.263189 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:30.263687 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:30.414284 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:30.422918 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4e8f9af1-7d24-4531-bd7a-186a73f22494 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.172409 Nov 27 22:17:30.428199 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4452/9040] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:30 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:31.443578 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:31.444301 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:31.452037 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:31.452492 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:31.453381 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:31.453813 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:31.623557 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:31.631542 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-c3207c5c-29ef-4a40-9fe2-4a0b257b1421 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.193222 Nov 27 22:17:31.632123 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4589/9041] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:31 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:32.648592 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:32.649201 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:32.655993 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:32.657061 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:32.657850 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:32.658299 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:32.794819 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:32.802247 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-3de5b49d-9329-492a-8a70-50c833ab5d65 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.157647 Nov 27 22:17:32.802810 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4453/9042] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:32 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:33.818591 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:33.819198 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:33.825989 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:33.826440 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:33.827220 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:33.827690 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:33.960611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:33.968063 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-11ee24a7-0001-42f6-b974-2b1cb1d1c9c9 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.153173 Nov 27 22:17:33.968636 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4590/9043] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:33 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:34.757782 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [req-dcdf2d89-26a5-42cc-aec0-c24c52204996 req-897eec13-3a56-4f40-8d62-65cb58401fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf0d856-24c7-421c-b45c-bd2b4b650c84", "tag": "59789da2-6523-40b0-973d-22414aeaeb96"}]} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:17:34.760001 ncdv-master-1 devstack@n-api.service[135679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:17:34.760001 ncdv-master-1 devstack@n-api.service[135679]: warnings.warn(msg) Nov 27 22:17:34.768268 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dcdf2d89-26a5-42cc-aec0-c24c52204996 req-897eec13-3a56-4f40-8d62-65cb58401fba service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:34.768877 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [req-dcdf2d89-26a5-42cc-aec0-c24c52204996 req-897eec13-3a56-4f40-8d62-65cb58401fba service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:34.781578 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.compute.server_external_events [req-dcdf2d89-26a5-42cc-aec0-c24c52204996 req-897eec13-3a56-4f40-8d62-65cb58401fba service nova] Creating event network-changed:59789da2-6523-40b0-973d-22414aeaeb96 for instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 on nch1-master-1 Nov 27 22:17:34.786751 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [req-dcdf2d89-26a5-42cc-aec0-c24c52204996 req-897eec13-3a56-4f40-8d62-65cb58401fba service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106088 Nov 27 22:17:34.787447 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4454/9044] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:17:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:17:34.985777 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:34.986519 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:34.993344 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:34.993799 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:34.994611 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:34.995045 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:35.131535 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:35.139079 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-68398610-df27-47ec-a37b-54d4429427b5 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.157546 Nov 27 22:17:35.139872 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4591/9045] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:34 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:36.159825 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:36.160551 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:36.166747 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:36.167211 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:36.168014 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:36.168462 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:36.301610 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:36.308843 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b8826abe-b275-442a-91f6-6215a83e9674 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.154578 Nov 27 22:17:36.309426 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4455/9046] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:36 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:37.325138 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:37.325754 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:37.332734 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:37.333346 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:37.333990 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:37.334432 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:37.472151 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:37.479481 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-4ddfcfa0-e079-4d25-b619-2bedf22c80ac tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.158104 Nov 27 22:17:37.480049 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4592/9047] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:37 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:38.497460 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:38.499779 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:38.506939 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:38.507588 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:38.508474 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:38.508941 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:38.645508 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:38.652793 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-080dec3d-07de-4b5c-91e8-db29c4ec2524 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.159374 Nov 27 22:17:38.653368 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4456/9048] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:38 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:39.107368 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-b525a553-0d1c-436c-9f6e-b830bc16ba49 req-7349c206-706b-46e1-9bb3-d1346fd6389f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf0d856-24c7-421c-b45c-bd2b4b650c84", "name": "network-vif-plugged", "status": "completed", "tag": "59789da2-6523-40b0-973d-22414aeaeb96"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:17:39.108972 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:17:39.108972 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:17:39.118218 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b525a553-0d1c-436c-9f6e-b830bc16ba49 req-7349c206-706b-46e1-9bb3-d1346fd6389f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:39.118665 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-b525a553-0d1c-436c-9f6e-b830bc16ba49 req-7349c206-706b-46e1-9bb3-d1346fd6389f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:39.129738 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-b525a553-0d1c-436c-9f6e-b830bc16ba49 req-7349c206-706b-46e1-9bb3-d1346fd6389f service nova] Creating event network-vif-plugged:59789da2-6523-40b0-973d-22414aeaeb96 for instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 on nch1-master-1 Nov 27 22:17:39.134799 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-b525a553-0d1c-436c-9f6e-b830bc16ba49 req-7349c206-706b-46e1-9bb3-d1346fd6389f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031272 Nov 27 22:17:39.135424 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4593/9049] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:17:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:17:39.669605 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:39.670228 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:39.677036 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:39.677500 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:39.678285 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:39.678723 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:39.813695 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:39.821067 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-dd1bf24a-8024-417b-b5e3-d1915c3a6c93 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1374 microversion: 2.1 time: 0.155166 Nov 27 22:17:39.821639 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4457/9050] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:39 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:40.839744 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:40.840454 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:40.846655 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:40.847108 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:40.847917 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:40.848360 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:40.987745 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:40.995475 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-9271abaf-949b-4603-b2f2-34804e617fdf tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1560 microversion: 2.1 time: 0.160693 Nov 27 22:17:40.996060 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4594/9051] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:40 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:41.011400 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:17:41.012033 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:17:41.018582 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:41.019043 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:41.019872 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:41.020328 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:41.164490 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:17:41.172513 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-4bf66e06-582e-4a78-bf91-80a878d6a740 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1560 microversion: 2.1 time: 0.164227 Nov 27 22:17:41.173085 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4458/9052] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:17:41 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:17:43.102910 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-38ce698b-41b6-400a-a1f1-ddf8f740d8ba req-5a4bce8b-2c90-4223-87fc-b70a3e5bd215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf0d856-24c7-421c-b45c-bd2b4b650c84", "tag": "59789da2-6523-40b0-973d-22414aeaeb96"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:17:43.105064 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:17:43.105064 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:17:43.113170 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-38ce698b-41b6-400a-a1f1-ddf8f740d8ba req-5a4bce8b-2c90-4223-87fc-b70a3e5bd215 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:17:43.113618 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-38ce698b-41b6-400a-a1f1-ddf8f740d8ba req-5a4bce8b-2c90-4223-87fc-b70a3e5bd215 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:17:43.124504 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-38ce698b-41b6-400a-a1f1-ddf8f740d8ba req-5a4bce8b-2c90-4223-87fc-b70a3e5bd215 service nova] Creating event network-changed:59789da2-6523-40b0-973d-22414aeaeb96 for instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 on nch1-master-1 Nov 27 22:17:43.129588 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-38ce698b-41b6-400a-a1f1-ddf8f740d8ba req-5a4bce8b-2c90-4223-87fc-b70a3e5bd215 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030269 Nov 27 22:17:43.130379 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4595/9053] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:17:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:19:21.417274 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:19:21.417881 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:19:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:19:26.224621 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-db9b2f97-62a4-49d2-9d9c-7350e7a7fec1 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-903912915"}} {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:19:26.225656 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-db9b2f97-62a4-49d2-9d9c-7350e7a7fec1 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:26.231576 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db9b2f97-62a4-49d2-9d9c-7350e7a7fec1 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:26.232045 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db9b2f97-62a4-49d2-9d9c-7350e7a7fec1 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:26.232873 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db9b2f97-62a4-49d2-9d9c-7350e7a7fec1 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:26.233326 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-db9b2f97-62a4-49d2-9d9c-7350e7a7fec1 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:26.505118 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-db9b2f97-62a4-49d2-9d9c-7350e7a7fec1 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "POST /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84/action" status: 202 len: 0 microversion: 2.1 time: 0.359169 Nov 27 22:19:26.505816 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4459/9054] 10.222.0.21 () {60 vars in 1277 bytes} [Sat Nov 27 22:19:26 2021] POST /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 22:19:31.674779 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] AMQP server on 10.222.0.21:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 27 22:19:31.675832 ncdv-master-1 devstack@n-api.service[135680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe283093-1cb0-4856-a0d5-8cfe41065dca] AMQP server on 10.222.0.21:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 27 22:19:31.681663 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-6a7a0bde-ff34-4164-8917-8d6c89aceeb9 req-0d750382-1cac-43f4-a81d-a0eacdc9a117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf0d856-24c7-421c-b45c-bd2b4b650c84", "name": "network-vif-plugged", "status": "completed", "tag": "59789da2-6523-40b0-973d-22414aeaeb96"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:19:31.683433 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:19:31.683433 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:19:31.692258 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6a7a0bde-ff34-4164-8917-8d6c89aceeb9 req-0d750382-1cac-43f4-a81d-a0eacdc9a117 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:31.693403 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-6a7a0bde-ff34-4164-8917-8d6c89aceeb9 req-0d750382-1cac-43f4-a81d-a0eacdc9a117 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:31.707141 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-6a7a0bde-ff34-4164-8917-8d6c89aceeb9 req-0d750382-1cac-43f4-a81d-a0eacdc9a117 service nova] Creating event network-vif-plugged:59789da2-6523-40b0-973d-22414aeaeb96 for instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 on nch1-master-1 Nov 27 22:19:31.713054 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-6a7a0bde-ff34-4164-8917-8d6c89aceeb9 req-0d750382-1cac-43f4-a81d-a0eacdc9a117 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043663 Nov 27 22:19:31.714082 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4596/9055] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:19:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 22:19:41.142171 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:41.142778 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:41.149071 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:41.149545 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:41.150338 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:41.150974 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:41.167214 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-5e5dbd4c-cf1e-45c9-a6fa-64feb14d44c5 req-ac6ed790-a8f5-47da-ba5f-709d98837eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf0d856-24c7-421c-b45c-bd2b4b650c84", "tag": "59789da2-6523-40b0-973d-22414aeaeb96"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:19:41.169015 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:19:41.169015 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:19:41.178004 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5e5dbd4c-cf1e-45c9-a6fa-64feb14d44c5 req-ac6ed790-a8f5-47da-ba5f-709d98837eac service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:41.178786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-5e5dbd4c-cf1e-45c9-a6fa-64feb14d44c5 req-ac6ed790-a8f5-47da-ba5f-709d98837eac service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:41.184642 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 22:19:41.192509 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-5e5dbd4c-cf1e-45c9-a6fa-64feb14d44c5 req-ac6ed790-a8f5-47da-ba5f-709d98837eac service nova] Creating event network-changed:59789da2-6523-40b0-973d-22414aeaeb96 for instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 on nch1-master-1 Nov 27 22:19:41.197276 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbacd544-6940-4062-96b9-dd079771cd8d] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49654. Nov 27 22:19:41.199017 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-5e5dbd4c-cf1e-45c9-a6fa-64feb14d44c5 req-ac6ed790-a8f5-47da-ba5f-709d98837eac service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060195 Nov 27 22:19:41.200154 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4597/9056] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:19:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 22:19:41.268231 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-03175649-3fc4-40bc-9578-ab116f573291 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "DELETE /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 204 len: 0 microversion: 2.1 time: 0.131739 Nov 27 22:19:41.269105 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4460/9057] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 22:19:41 2021] DELETE /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 22:19:41.278786 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:41.279698 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:41.282647 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe283093-1cb0-4856-a0d5-8cfe41065dca] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 49656. Nov 27 22:19:41.288626 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:41.289245 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:41.290229 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:41.290674 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:41.437585 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:19:41.450304 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-a22d9042-1bbc-4e3c-bfd3-772ea59a991c tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1685 microversion: 2.1 time: 0.176055 Nov 27 22:19:41.450895 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4598/9058] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:19:41 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:19:42.469697 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:42.470409 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:42.477190 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:42.477651 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:42.478443 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:42.478895 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:42.612863 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:19:42.620226 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-0f1ae0ec-3c2c-4ae7-80cd-0c88d4c3731d tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1566 microversion: 2.1 time: 0.155175 Nov 27 22:19:42.620797 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4461/9059] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:19:42 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:19:43.609538 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f7fe85fd-6a67-4e84-9f40-3399082938dd req-58f0d427-ac1b-4b92-8945-722d688e3411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf0d856-24c7-421c-b45c-bd2b4b650c84", "name": "network-vif-deleted", "tag": "59789da2-6523-40b0-973d-22414aeaeb96"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:19:43.611671 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:19:43.611671 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:19:43.619551 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f7fe85fd-6a67-4e84-9f40-3399082938dd req-58f0d427-ac1b-4b92-8945-722d688e3411 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:43.619996 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f7fe85fd-6a67-4e84-9f40-3399082938dd req-58f0d427-ac1b-4b92-8945-722d688e3411 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:43.631060 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f7fe85fd-6a67-4e84-9f40-3399082938dd req-58f0d427-ac1b-4b92-8945-722d688e3411 service nova] Creating event network-vif-deleted:59789da2-6523-40b0-973d-22414aeaeb96 for instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 on nch1-master-1 Nov 27 22:19:43.636402 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f7fe85fd-6a67-4e84-9f40-3399082938dd req-58f0d427-ac1b-4b92-8945-722d688e3411 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Nov 27 22:19:43.636979 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4599/9060] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:19:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:19:43.638136 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:43.638855 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:43.646548 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:43.647788 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:43.648579 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:43.649038 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:43.718417 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:19:43.726745 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-12f359d3-ee24-4289-a223-7ca2c9c3ca18 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 200 len: 1334 microversion: 2.1 time: 0.092898 Nov 27 22:19:43.727449 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4462/9061] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:19:43 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 22:19:44.746876 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:44.747510 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: bcf0d856-24c7-421c-b45c-bd2b4b650c84] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:44.754293 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:44.754742 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:44.755568 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:44.755992 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:44.769100 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.wsgi [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] HTTP exception thrown: Instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 could not be found. Nov 27 22:19:44.769679 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Returning 404 to user: Instance bcf0d856-24c7-421c-b45c-bd2b4b650c84 could not be found. {{(pid=135680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 22:19:44.770481 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-39e075d8-4128-4618-acd6-60946e17e6a2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84" status: 404 len: 111 microversion: 2.1 time: 0.028621 Nov 27 22:19:44.771008 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4600/9062] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:19:44 2021] GET /compute/v2.1/servers/bcf0d856-24c7-421c-b45c-bd2b4b650c84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 22:19:46.109076 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:46.109717 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:46.117957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:46.118644 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:46.119566 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:46.120113 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:46.148052 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Going to try to terminate instance {{(pid=135679) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 27 22:19:46.173830 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-d526a4d7-69d6-4372-a187-55f7be2a481d req-a2abc1ea-7907-43f6-ad94-c73449d7350f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c6fb2d-7f21-4d41-9338-f38532f3531e", "tag": "64c3ba68-63da-4845-9693-5ed608ed2cc3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:19:46.175352 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:19:46.175352 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:19:46.183409 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d526a4d7-69d6-4372-a187-55f7be2a481d req-a2abc1ea-7907-43f6-ad94-c73449d7350f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:46.183648 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-d526a4d7-69d6-4372-a187-55f7be2a481d req-a2abc1ea-7907-43f6-ad94-c73449d7350f service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:46.196527 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-d526a4d7-69d6-4372-a187-55f7be2a481d req-a2abc1ea-7907-43f6-ad94-c73449d7350f service nova] Creating event network-changed:64c3ba68-63da-4845-9693-5ed608ed2cc3 for instance 97c6fb2d-7f21-4d41-9338-f38532f3531e on nch2-master-1 Nov 27 22:19:46.201371 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-d526a4d7-69d6-4372-a187-55f7be2a481d req-a2abc1ea-7907-43f6-ad94-c73449d7350f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093126 Nov 27 22:19:46.202408 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4601/9063] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:19:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:19:46.239212 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-55c0b135-3a17-42d2-8d71-1f796e44d029 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "DELETE /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 204 len: 0 microversion: 2.1 time: 0.133397 Nov 27 22:19:46.239913 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4463/9064] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 22:19:46 2021] DELETE /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 22:19:46.251357 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:46.252930 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.compute.api [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135680) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:46.263016 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:46.264350 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:46.265650 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:46.266247 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:46.528550 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.policy [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135680) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:19:46.538720 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-def1495d-95d1-42d0-a286-865bc7b71c14 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1684 microversion: 2.1 time: 0.293643 Nov 27 22:19:46.539452 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4602/9065] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:19:46 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1684 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:19:47.557799 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:47.558522 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:47.566149 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:47.566903 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:47.567733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:47.568184 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:47.631654 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.policy [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601728112c7c4e689208826544604460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43420851d76644b8bd7d25b34365dce9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135679) authorize /opt/stack/nova/nova/policy.py:199}} Nov 27 22:19:47.639379 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-b6efbae8-d144-4477-b75d-39f947b02f7e tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 200 len: 1498 microversion: 2.1 time: 0.086211 Nov 27 22:19:47.640222 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4464/9066] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:19:47 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 1498 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 22:19:48.218022 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [req-f2da9e7b-e721-429a-bbbc-99339607fa97 req-1e58c547-2771-48fd-901e-b2477422abd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c6fb2d-7f21-4d41-9338-f38532f3531e", "name": "network-vif-deleted", "tag": "64c3ba68-63da-4845-9693-5ed608ed2cc3"}]} {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 22:19:48.220144 ncdv-master-1 devstack@n-api.service[135680]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 22:19:48.220144 ncdv-master-1 devstack@n-api.service[135680]: warnings.warn(msg) Nov 27 22:19:48.227823 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f2da9e7b-e721-429a-bbbc-99339607fa97 req-1e58c547-2771-48fd-901e-b2477422abd5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:48.228268 ncdv-master-1 devstack@n-api.service[135680]: DEBUG oslo_concurrency.lockutils [req-f2da9e7b-e721-429a-bbbc-99339607fa97 req-1e58c547-2771-48fd-901e-b2477422abd5 service nova] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:48.239275 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.compute.server_external_events [req-f2da9e7b-e721-429a-bbbc-99339607fa97 req-1e58c547-2771-48fd-901e-b2477422abd5 service nova] Creating event network-vif-deleted:64c3ba68-63da-4845-9693-5ed608ed2cc3 for instance 97c6fb2d-7f21-4d41-9338-f38532f3531e on nch2-master-1 Nov 27 22:19:48.244030 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [req-f2da9e7b-e721-429a-bbbc-99339607fa97 req-1e58c547-2771-48fd-901e-b2477422abd5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029596 Nov 27 22:19:48.244604 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4603/9067] 10.222.0.21 () {64 vars in 1317 bytes} [Sat Nov 27 22:19:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 22:19:48.657733 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '>' {{(pid=135679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:48.658357 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.compute.api [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] [instance: 97c6fb2d-7f21-4d41-9338-f38532f3531e] Fetching instance by UUID {{(pid=135679) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 27 22:19:48.665159 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:48.665665 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:48.666467 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 27 22:19:48.666957 ncdv-master-1 devstack@n-api.service[135679]: DEBUG oslo_concurrency.lockutils [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Lock "fd0553d0-e88d-4bc7-b202-511b681a6bf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 27 22:19:48.680010 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.wsgi [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] HTTP exception thrown: Instance 97c6fb2d-7f21-4d41-9338-f38532f3531e could not be found. Nov 27 22:19:48.680745 ncdv-master-1 devstack@n-api.service[135679]: DEBUG nova.api.openstack.wsgi [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Returning 404 to user: Instance 97c6fb2d-7f21-4d41-9338-f38532f3531e could not be found. {{(pid=135679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 22:19:48.681586 ncdv-master-1 devstack@n-api.service[135679]: INFO nova.api.openstack.requestlog [None req-08bea6c8-7f34-46a6-be10-882cf3d500b2 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e" status: 404 len: 111 microversion: 2.1 time: 0.028242 Nov 27 22:19:48.682122 ncdv-master-1 devstack@n-api.service[135679]: [pid: 135679|app: 0|req: 4465/9068] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 22:19:48 2021] GET /compute/v2.1/servers/97c6fb2d-7f21-4d41-9338-f38532f3531e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 22:19:48.844809 ncdv-master-1 devstack@n-api.service[135680]: DEBUG nova.api.openstack.wsgi [None req-8111d4d3-1cb3-42a6-baa2-1659bd423bc0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] Calling method '.version_select at 0x7f15c7853790>' {{(pid=135680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 22:19:48.871491 ncdv-master-1 devstack@n-api.service[135680]: INFO nova.api.openstack.requestlog [None req-8111d4d3-1cb3-42a6-baa2-1659bd423bc0 tempest-TestSnapshotPattern-318099115 tempest-TestSnapshotPattern-318099115-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1754587782" status: 202 len: 0 microversion: 2.1 time: 0.030525 Nov 27 22:19:48.872103 ncdv-master-1 devstack@n-api.service[135680]: [pid: 135680|app: 0|req: 4604/9069] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 22:19:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1754587782 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 22:20:26.760105 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:20:26.760840 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:20:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:20:29.704806 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:20:29.705355 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:20:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:22:06.807366 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 27 22:22:06.808392 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:22:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:22:21.375995 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:22:21.376623 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:22:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:22:23.983913 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:22:23.984674 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:22:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:22:41.435403 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:22:41.435899 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:22:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:23:46.777504 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:23:46.779070 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:23:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:23:49.722278 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:23:49.722855 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:23:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:25:26.824907 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:25:26.825488 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:25:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:25:41.393598 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:25:41.394125 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:25:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:25:44.002038 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:25:44.002592 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:25:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:26:01.454785 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:26:01.455321 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:26:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:27:06.798745 ncdv-master-1 devstack@n-api.service[135680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:27:06.799336 ncdv-master-1 devstack@n-api.service[135680]: Sat Nov 27 22:27:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 27 22:27:09.739498 ncdv-master-1 devstack@n-api.service[135679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 22:27:09.740051 ncdv-master-1 devstack@n-api.service[135679]: Sat Nov 27 22:27:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!